2023-10-06T22:41:13.084 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T22:41:13.084 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi --owner scheduled_rishabh@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} --verbose --archive /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744 -- /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/orig.config.yaml 2023-10-06T22:41:13.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T22:41:13.248 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744 branch: rishabh-cephfs-mon description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} email: null first_in_suite: false job_id: '7414744' kernel: flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-cephfs-mon ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_client_delegate_inos_pct: 50 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 14d8d032507701c76ca224e769ee65a96b660a8c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 14d8d032507701c76ca224e769ee65a96b660a8c kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mountpoint: /tmp/cephfs selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-cephfs-mon sha1: 14d8d032507701c76ca224e769ee65a96b660a8c owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7175 sha1: 14d8d032507701c76ca224e769ee65a96b660a8c sleep_before_teardown: 0 subset: 59/512 suite: fs suite_branch: rishabh-cephfs-mon suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 14d8d032507701c76ca224e769ee65a96b660a8c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-06_11:56:52 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T22:41:13.249 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa; will attempt to use it 2023-10-06T22:41:13.250 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks 2023-10-06T22:41:13.250 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T22:41:13.252 INFO:teuthology.task.internal:Checking packages... 2023-10-06T22:41:13.282 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '14d8d032507701c76ca224e769ee65a96b660a8c' 2023-10-06T22:41:13.283 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T22:41:13.283 INFO:teuthology.packaging:ref: None 2023-10-06T22:41:13.283 INFO:teuthology.packaging:tag: None 2023-10-06T22:41:13.283 INFO:teuthology.packaging:branch: rishabh-cephfs-mon 2023-10-06T22:41:13.283 INFO:teuthology.packaging:sha1: 14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T22:41:13.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-cephfs-mon 2023-10-06T22:41:13.511 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6616.g14d8d032 2023-10-06T22:41:13.512 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T22:41:13.526 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T22:41:13.526 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T22:41:13.576 INFO:teuthology.task.internal:Saving configuration 2023-10-06T22:41:13.597 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T22:41:13.611 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T22:41:13.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 22:36:02.580710', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T22:41:13.662 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 22:36:02.582118', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T22:41:13.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 22:36:02.583679', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T22:41:13.686 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T22:41:13.697 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-06T22:41:13.697 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-06T22:41:13.697 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-06T22:41:13.697 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T22:41:13.826 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efdb4539e50>, signals=[15]) 2023-10-06T22:41:13.826 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T22:41:13.834 INFO:teuthology.task.internal:Opening connections... 2023-10-06T22:41:13.834 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T22:41:13.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:41:13.904 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-10-06T22:41:13.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:41:13.971 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2023-10-06T22:41:13.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:41:14.037 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T22:41:14.045 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-06T22:41:14.067 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-06T22:41:14.069 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-06T22:41:14.128 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T22:41:14.128 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T22:41:14.128 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-10-06T22:41:14.128 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-10-06T22:41:14.128 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2023-10-06T22:41:14.128 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T22:41:14.129 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T22:41:14.130 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-06T22:41:14.158 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-10-06T22:41:14.179 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-10-06T22:41:14.179 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-10-06T22:41:14.237 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T22:41:14.237 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T22:41:14.238 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:41:14.239 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T22:41:14.239 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T22:41:14.239 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T22:41:14.239 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T22:41:14.239 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-10-06T22:41:14.258 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-10-06T22:41:14.278 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-10-06T22:41:14.278 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-06T22:41:14.335 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-06T22:41:14.336 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T22:41:14.337 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T22:41:14.337 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T22:41:14.337 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:41:14.337 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T22:41:14.337 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-06T22:41:14.337 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T22:41:14.337 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-06T22:41:14.337 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-06T22:41:14.358 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T22:41:14.367 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T22:41:14.389 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T22:41:14.389 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-10-06T22:41:14.392 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-10-06T22:41:14.394 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2023-10-06T22:41:14.410 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T22:41:14.424 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T22:41:14.424 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-10-06T22:41:14.452 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-10-06T22:41:14.454 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2023-10-06T22:41:14.483 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T22:41:14.562 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T22:41:14.577 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-06T22:41:14.577 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, timeout 300 2023-10-06T22:41:14.577 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T22:41:14.578 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T22:41:14.579 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T22:41:14.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T22:41:14.596 DEBUG:teuthology.task.kernel:sha1 for mon.c is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.596 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T22:41:14.597 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-10-06T22:41:14.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T22:41:14.598 DEBUG:teuthology.task.kernel:sha1 for mon.b is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.598 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T22:41:14.599 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-10-06T22:41:14.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T22:41:14.600 DEBUG:teuthology.task.kernel:sha1 for mon.a is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.600 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T22:41:14.600 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-06T22:41:14.655 INFO:teuthology.orchestra.run.smithi190.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-06T22:41:14.655 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.656 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T22:41:14.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.661 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-06T22:41:14.661 INFO:teuthology.orchestra.run.smithi156.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-06T22:41:14.661 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.661 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T22:41:14.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.663 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.663 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T22:41:14.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:14.813 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum upgrade -y linux-firmware 2023-10-06T22:41:14.878 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum upgrade -y linux-firmware 2023-10-06T22:41:14.882 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum upgrade -y linux-firmware 2023-10-06T22:41:15.960 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-10-06T22:41:15.960 INFO:teuthology.orchestra.run.smithi156.stdout:Unable to read consumer identity 2023-10-06T22:41:16.074 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T22:41:16.074 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-06T22:41:16.096 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-10-06T22:41:16.096 INFO:teuthology.orchestra.run.smithi190.stdout:Unable to read consumer identity 2023-10-06T22:41:17.490 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-06T22:41:17.494 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-06T22:41:17.589 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-06T22:41:18.290 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-06T22:41:18.578 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-06T22:41:19.573 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 16 MB 00:01 2023-10-06T22:41:21.824 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 394 kB/s | 24 kB 00:00 2023-10-06T22:41:22.320 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 361 kB/s | 24 kB 00:00 2023-10-06T22:41:22.607 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-10-06T22:41:22.608 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-10-06T22:41:22.608 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-10-06T22:41:22.730 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.b... 2023-10-06T22:41:22.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:22.949 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T22:41:22.950 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T22:41:22.952 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi156.front.sepia.ceph.com to complete... 2023-10-06T22:41:23.089 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 514 kB/s | 24 kB 00:00 2023-10-06T22:41:23.125 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-06T22:41:23.125 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-06T22:41:23.126 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-06T22:41:23.248 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.a... 2023-10-06T22:41:23.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:23.465 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T22:41:23.466 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T22:41:23.468 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi008.front.sepia.ceph.com to complete... 2023-10-06T22:41:23.847 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-10-06T22:41:23.848 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-10-06T22:41:23.848 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-10-06T22:41:23.966 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.c... 2023-10-06T22:41:23.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T22:41:24.185 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T22:41:24.186 DEBUG:teuthology.orchestra.run.smithi190:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T22:41:24.188 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi190.front.sepia.ceph.com to complete... 2023-10-06T22:41:51.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06 22:41:51 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T22:41:51.161 INFO:teuthology.orchestra.run.smithi156.stderr:FINISHED --2023-10-06 22:41:51-- 2023-10-06T22:41:51.161 INFO:teuthology.orchestra.run.smithi156.stderr:Total wall clock time: 28s 2023-10-06T22:41:51.162 INFO:teuthology.orchestra.run.smithi156.stderr:Downloaded: 1 files, 363M in 28s (13.0 MB/s) 2023-10-06T22:41:51.163 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.b... 2023-10-06T22:41:51.163 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T22:41:52.778 INFO:teuthology.orchestra.run.smithi156.stdout:Verifying... ######################################## 2023-10-06T22:41:52.858 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing... ######################################## 2023-10-06T22:41:52.944 INFO:teuthology.orchestra.run.smithi156.stdout:Updating / installing... 2023-10-06T22:42:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06 22:42:13 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T22:42:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:FINISHED --2023-10-06 22:42:13-- 2023-10-06T22:42:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:Total wall clock time: 50s 2023-10-06T22:42:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:Downloaded: 1 files, 363M in 50s (7.27 MB/s) 2023-10-06T22:42:13.723 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.a... 2023-10-06T22:42:13.723 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T22:42:15.401 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying... ######################################## 2023-10-06T22:42:15.486 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing... ######################################## 2023-10-06T22:42:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:Updating / installing... 2023-10-06T22:42:24.456 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06 22:42:24 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T22:42:24.456 INFO:teuthology.orchestra.run.smithi190.stderr:FINISHED --2023-10-06 22:42:24-- 2023-10-06T22:42:24.456 INFO:teuthology.orchestra.run.smithi190.stderr:Total wall clock time: 1m 0s 2023-10-06T22:42:24.456 INFO:teuthology.orchestra.run.smithi190.stderr:Downloaded: 1 files, 363M in 1m 0s (6.08 MB/s) 2023-10-06T22:42:24.457 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.c... 2023-10-06T22:42:24.458 DEBUG:teuthology.orchestra.run.smithi190:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T22:42:26.049 INFO:teuthology.orchestra.run.smithi190.stdout:Verifying... ######################################## 2023-10-06T22:42:26.104 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing... ######################################## 2023-10-06T22:42:26.193 INFO:teuthology.orchestra.run.smithi190.stdout:Updating / installing... 2023-10-06T22:42:31.156 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T22:42:54.844 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T22:42:54.845 DEBUG:teuthology.orchestra.run.smithi156:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T22:42:54.901 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:54.902 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:54.902 INFO:teuthology.orchestra.run.smithi156.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:54.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:54.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T22:42:54.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T22:42:54.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T22:42:54.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T22:42:54.902 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T22:42:54.903 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T22:42:54.904 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T22:42:54.905 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T22:42:54.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T22:42:54.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T22:42:54.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T22:42:54.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T22:42:54.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T22:42:54.906 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T22:42:54.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T22:42:54.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T22:42:54.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T22:42:54.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T22:42:54.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T22:42:54.907 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T22:42:54.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T22:42:54.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T22:42:54.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T22:42:54.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T22:42:54.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T22:42:54.908 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T22:42:54.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T22:42:54.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T22:42:54.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T22:42:54.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T22:42:54.909 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T22:42:54.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T22:42:54.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T22:42:54.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T22:42:54.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T22:42:54.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T22:42:54.910 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T22:42:54.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T22:42:54.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T22:42:54.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T22:42:54.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T22:42:54.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T22:42:54.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T22:42:54.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T22:42:54.911 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T22:42:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T22:42:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T22:42:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T22:42:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T22:42:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T22:42:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T22:42:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T22:42:54.912 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T22:42:54.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T22:42:54.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T22:42:54.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T22:42:54.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T22:42:54.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T22:42:54.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T22:42:54.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T22:42:54.913 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T22:42:54.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T22:42:54.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T22:42:54.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T22:42:54.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T22:42:54.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T22:42:54.914 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T22:42:54.915 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T22:42:54.916 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T22:42:54.917 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T22:42:54.918 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T22:42:54.919 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T22:42:54.920 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T22:42:54.921 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T22:42:54.922 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T22:42:54.923 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T22:42:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T22:42:54.925 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T22:42:54.926 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T22:42:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T22:42:54.928 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T22:42:54.929 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T22:42:54.930 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T22:42:54.931 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T22:42:54.932 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T22:42:54.933 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T22:42:54.934 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T22:42:54.935 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T22:42:54.936 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T22:42:54.937 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T22:42:54.938 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T22:42:54.939 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T22:42:54.940 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T22:42:54.941 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T22:42:54.942 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T22:42:54.943 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T22:42:54.944 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T22:42:54.945 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T22:42:54.946 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T22:42:54.947 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T22:42:54.948 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T22:42:54.949 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T22:42:54.950 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T22:42:54.951 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T22:42:54.952 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T22:42:54.953 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T22:42:54.954 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T22:42:54.955 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T22:42:54.956 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T22:42:54.957 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T22:42:54.958 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T22:42:54.959 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T22:42:54.960 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T22:42:54.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T22:42:54.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T22:42:54.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T22:42:54.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T22:42:54.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T22:42:54.961 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T22:42:54.962 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T22:42:54.963 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T22:42:54.964 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T22:42:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T22:42:54.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T22:42:54.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T22:42:54.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T22:42:54.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T22:42:54.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T22:42:54.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T22:42:54.966 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T22:42:54.967 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T22:42:54.968 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T22:42:54.969 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T22:42:54.970 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T22:42:54.970 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T22:42:54.970 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T22:42:54.970 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T22:42:54.970 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T22:42:54.970 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T22:42:54.971 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T22:42:54.971 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T22:42:54.971 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T22:42:54.971 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T22:42:54.971 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T22:42:54.971 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T22:42:54.972 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T22:42:54.972 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T22:42:54.972 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T22:42:54.972 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T22:42:54.972 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T22:42:54.972 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T22:42:54.972 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T22:42:54.973 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T22:42:54.974 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T22:42:54.975 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T22:42:54.976 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T22:42:54.977 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T22:42:54.978 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T22:42:54.978 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T22:42:54.978 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T22:42:54.978 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T22:42:54.978 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T22:42:54.978 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T22:42:54.979 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T22:42:54.980 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T22:42:54.981 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T22:42:54.982 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T22:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T22:42:54.984 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T22:42:54.985 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T22:42:54.985 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T22:42:54.985 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T22:42:54.985 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T22:42:54.985 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T22:42:54.985 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T22:42:54.985 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T22:42:54.986 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T22:42:54.987 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T22:42:54.988 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T22:42:54.989 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T22:42:54.990 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T22:42:54.991 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T22:42:54.992 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T22:42:54.993 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T22:42:54.994 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T22:42:54.995 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T22:42:54.995 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T22:42:54.995 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T22:42:54.995 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T22:42:54.995 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T22:42:54.995 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T22:42:54.995 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T22:42:54.995 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T22:42:54.996 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T22:42:54.997 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T22:42:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T22:42:54.999 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T22:42:55.000 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T22:42:55.001 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T22:42:55.002 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T22:42:55.002 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T22:42:55.002 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T22:42:55.002 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T22:42:55.002 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T22:42:55.002 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T22:42:55.002 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T22:42:55.002 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T22:42:55.003 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T22:42:55.004 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T22:42:55.004 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T22:42:55.004 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T22:42:55.004 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T22:42:55.004 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T22:42:55.004 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T22:42:55.004 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T22:42:55.004 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T22:42:55.005 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T22:42:55.006 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T22:42:55.007 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T22:42:55.008 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T22:42:55.009 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T22:42:55.010 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T22:42:55.011 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T22:42:55.012 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T22:42:55.012 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T22:42:55.012 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T22:42:55.012 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T22:42:55.012 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T22:42:55.012 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T22:42:55.012 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T22:42:55.012 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T22:42:55.013 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T22:42:55.014 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T22:42:55.015 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T22:42:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T22:42:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T22:42:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T22:42:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T22:42:55.020 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T22:42:55.021 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T22:42:55.022 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T22:42:55.022 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T22:42:55.022 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T22:42:55.022 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T22:42:55.022 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T22:42:55.022 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T22:42:55.023 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T22:42:55.024 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T22:42:55.025 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T22:42:55.026 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T22:42:55.027 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T22:42:55.027 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T22:42:55.027 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T22:42:55.027 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T22:42:55.027 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T22:42:55.027 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T22:42:55.028 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T22:42:55.028 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T22:42:55.028 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T22:42:55.028 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T22:42:55.028 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T22:42:55.028 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T22:42:55.029 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T22:42:55.030 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T22:42:55.031 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T22:42:55.032 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T22:42:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T22:42:55.034 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T22:42:55.034 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T22:42:55.034 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T22:42:55.034 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T22:42:55.034 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T22:42:55.035 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T22:42:55.035 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T22:42:55.035 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T22:42:55.035 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T22:42:55.035 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T22:42:55.035 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T22:42:55.035 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T22:42:55.035 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T22:42:55.036 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T22:42:55.037 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T22:42:55.038 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T22:42:55.038 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T22:42:55.038 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T22:42:55.038 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T22:42:55.038 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T22:42:55.038 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T22:42:55.038 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T22:42:55.039 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T22:42:55.039 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T22:42:55.039 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T22:42:55.039 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T22:42:55.041 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T22:42:55.041 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T22:42:55.041 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T22:42:55.041 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T22:42:55.041 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T22:42:55.041 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T22:42:55.041 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T22:42:55.042 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T22:42:55.043 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T22:42:55.043 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T22:42:55.043 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T22:42:55.043 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T22:42:55.043 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T22:42:55.043 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T22:42:55.044 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T22:42:55.044 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T22:42:55.044 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T22:42:55.044 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T22:42:55.044 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T22:42:55.044 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T22:42:55.045 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T22:42:55.046 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T22:42:55.047 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T22:42:55.048 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T22:42:55.049 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T22:42:55.050 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T22:42:55.051 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T22:42:55.052 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T22:42:55.053 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T22:42:55.054 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T22:42:55.055 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T22:42:55.056 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T22:42:55.057 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T22:42:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T22:42:55.059 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T22:42:55.060 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T22:42:55.060 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T22:42:55.060 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T22:42:55.060 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T22:42:55.060 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T22:42:55.060 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T22:42:55.060 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T22:42:55.060 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T22:42:55.061 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T22:42:55.062 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T22:42:55.063 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T22:42:55.064 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T22:42:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T22:42:55.066 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T22:42:55.067 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T22:42:55.068 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T22:42:55.069 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T22:42:55.070 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T22:42:55.071 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T22:42:55.072 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T22:42:55.073 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T22:42:55.074 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T22:42:55.075 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T22:42:55.075 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T22:42:55.075 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T22:42:55.075 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T22:42:55.075 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T22:42:55.075 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T22:42:55.075 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T22:42:55.075 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T22:42:55.076 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T22:42:55.076 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T22:42:55.076 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T22:42:55.076 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T22:42:55.076 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T22:42:55.076 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T22:42:55.077 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T22:42:55.077 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T22:42:55.077 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T22:42:55.077 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T22:42:55.077 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T22:42:55.077 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T22:42:55.078 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T22:42:55.078 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T22:42:55.078 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T22:42:55.078 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T22:42:55.078 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T22:42:55.079 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T22:42:55.079 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T22:42:55.079 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T22:42:55.079 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T22:42:55.079 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T22:42:55.079 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T22:42:55.079 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T22:42:55.080 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T22:42:55.080 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T22:42:55.080 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T22:42:55.080 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T22:42:55.080 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T22:42:55.080 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T22:42:55.080 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T22:42:55.080 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T22:42:55.081 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T22:42:55.081 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T22:42:55.081 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T22:42:55.081 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T22:42:55.081 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T22:42:55.081 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T22:42:55.081 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T22:42:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T22:42:55.083 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:55.083 DEBUG:teuthology.orchestra.run.smithi156:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T22:42:55.108 INFO:teuthology.orchestra.run.smithi156.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T22:42:55.108 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T22:42:55.108 INFO:teuthology.orchestra.run.smithi156.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:55.109 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2023-10-06T22:42:55.110 INFO:teuthology.orchestra.run.smithi156.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T22:42:55.110 INFO:teuthology.orchestra.run.smithi156.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T22:42:55.110 INFO:teuthology.orchestra.run.smithi156.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:55.110 INFO:teuthology.orchestra.run.smithi156.stdout:fi 2023-10-06T22:42:55.111 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2-tools 2023-10-06T22:42:55.186 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2-tools 2023-10-06T22:42:55.186 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.02 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 123.el8 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Group : System Environment/Base 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 9265450 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Relocations : (not relocatable) 2023-10-06T22:42:55.187 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : Red Hat, Inc. 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : Red Hat, Inc. 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Support tools for GRUB. 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:42:55.188 INFO:teuthology.orchestra.run.smithi156.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T22:42:55.189 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T22:42:55.189 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:42:55.189 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T22:42:56.103 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T22:42:59.483 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-10-06T22:43:01.264 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-10-06T22:43:01.266 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-10-06T22:43:01.283 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.myWRCHZYqG 2023-10-06T22:43:01.283 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.myWRCHZYqG 2023-10-06T22:43:01.356 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.myWRCHZYqG 2023-10-06T22:43:01.497 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.myWRCHZYqG is 6KB 2023-10-06T22:43:01.545 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.myWRCHZYqG 2023-10-06T22:43:01.561 DEBUG:teuthology.orchestra.run.smithi156:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T22:43:01.639 INFO:teuthology.orchestra.run.smithi156.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-06T22:43:01.639 INFO:teuthology.orchestra.run.smithi156.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-06T22:43:01.639 INFO:teuthology.orchestra.run.smithi156.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T22:43:01.640 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:01.773 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2023-10-06T22:43:04.126 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T22:43:21.459 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T22:43:21.459 DEBUG:teuthology.orchestra.run.smithi008:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T22:43:21.517 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.517 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T22:43:21.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T22:43:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T22:43:21.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T22:43:21.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T22:43:21.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T22:43:21.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T22:43:21.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T22:43:21.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T22:43:21.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T22:43:21.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T22:43:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T22:43:21.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T22:43:21.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T22:43:21.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T22:43:21.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T22:43:21.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T22:43:21.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T22:43:21.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T22:43:21.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T22:43:21.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T22:43:21.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T22:43:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T22:43:21.540 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T22:43:21.541 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T22:43:21.542 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T22:43:21.543 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T22:43:21.544 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T22:43:21.545 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T22:43:21.546 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T22:43:21.547 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T22:43:21.548 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T22:43:21.549 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T22:43:21.550 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T22:43:21.551 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T22:43:21.552 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T22:43:21.553 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T22:43:21.554 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T22:43:21.555 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T22:43:21.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T22:43:21.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T22:43:21.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T22:43:21.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T22:43:21.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T22:43:21.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T22:43:21.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T22:43:21.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T22:43:21.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T22:43:21.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T22:43:21.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T22:43:21.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T22:43:21.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T22:43:21.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T22:43:21.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T22:43:21.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T22:43:21.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T22:43:21.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T22:43:21.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T22:43:21.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T22:43:21.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T22:43:21.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T22:43:21.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T22:43:21.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T22:43:21.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T22:43:21.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T22:43:21.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T22:43:21.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T22:43:21.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T22:43:21.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T22:43:21.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T22:43:21.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T22:43:21.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T22:43:21.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T22:43:21.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T22:43:21.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T22:43:21.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T22:43:21.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T22:43:21.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T22:43:21.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T22:43:21.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T22:43:21.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T22:43:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T22:43:21.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T22:43:21.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T22:43:21.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T22:43:21.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T22:43:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T22:43:21.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T22:43:21.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T22:43:21.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T22:43:21.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T22:43:21.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T22:43:21.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T22:43:21.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T22:43:21.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T22:43:21.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T22:43:21.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T22:43:21.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T22:43:21.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T22:43:21.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T22:43:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T22:43:21.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T22:43:21.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T22:43:21.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T22:43:21.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T22:43:21.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T22:43:21.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T22:43:21.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T22:43:21.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T22:43:21.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T22:43:21.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T22:43:21.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T22:43:21.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T22:43:21.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T22:43:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T22:43:21.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T22:43:21.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T22:43:21.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T22:43:21.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T22:43:21.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T22:43:21.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T22:43:21.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T22:43:21.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T22:43:21.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T22:43:21.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T22:43:21.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T22:43:21.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T22:43:21.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T22:43:21.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T22:43:21.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T22:43:21.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T22:43:21.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T22:43:21.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T22:43:21.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T22:43:21.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T22:43:21.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T22:43:21.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T22:43:21.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T22:43:21.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T22:43:21.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T22:43:21.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T22:43:21.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T22:43:21.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T22:43:21.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T22:43:21.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T22:43:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T22:43:21.663 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T22:43:21.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T22:43:21.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T22:43:21.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T22:43:21.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T22:43:21.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T22:43:21.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T22:43:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T22:43:21.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T22:43:21.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T22:43:21.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T22:43:21.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T22:43:21.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T22:43:21.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T22:43:21.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T22:43:21.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T22:43:21.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T22:43:21.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T22:43:21.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T22:43:21.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T22:43:21.677 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.678 DEBUG:teuthology.orchestra.run.smithi008:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T22:43:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T22:43:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T22:43:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:43:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:43:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.705 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T22:43:21.706 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.707 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-06T22:43:21.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-10-06T22:43:21.786 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-10-06T22:43:21.786 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-10-06T22:43:21.786 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.02 2023-10-06T22:43:21.786 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 123.el8 2023-10-06T22:43:21.786 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-10-06T22:43:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-06T22:43:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:Group : System Environment/Base 2023-10-06T22:43:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 9265450 2023-10-06T22:43:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-10-06T22:43:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-06T22:43:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-06T22:43:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-06T22:43:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-06T22:43:21.788 INFO:teuthology.orchestra.run.smithi008.stdout:Relocations : (not relocatable) 2023-10-06T22:43:21.788 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : Red Hat, Inc. 2023-10-06T22:43:21.788 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : Red Hat, Inc. 2023-10-06T22:43:21.788 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T22:43:21.788 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-10-06T22:43:21.788 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-10-06T22:43:21.788 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:43:21.788 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T22:43:21.789 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T22:43:21.789 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T22:43:21.789 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-10-06T22:43:21.789 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:43:21.789 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T22:43:21.790 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T22:43:21.790 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:21.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T22:43:25.981 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-10-06T22:43:28.143 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-10-06T22:43:28.144 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-06T22:43:28.167 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.Ap2ZkmayA4 2023-10-06T22:43:28.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ap2ZkmayA4 2023-10-06T22:43:28.239 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.Ap2ZkmayA4 2023-10-06T22:43:28.495 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.Ap2ZkmayA4 is 6KB 2023-10-06T22:43:28.543 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.Ap2ZkmayA4 2023-10-06T22:43:28.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T22:43:28.634 INFO:teuthology.orchestra.run.smithi008.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-06T22:43:28.634 INFO:teuthology.orchestra.run.smithi008.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-06T22:43:28.634 INFO:teuthology.orchestra.run.smithi008.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T22:43:28.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:28.762 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-10-06T22:43:31.775 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T22:43:31.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T22:43:31.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:43:32.035 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T22:43:32.035 DEBUG:teuthology.orchestra.run.smithi190:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T22:43:32.092 INFO:teuthology.orchestra.run.smithi190.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T22:43:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T22:43:32.094 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T22:43:32.095 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T22:43:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T22:43:32.097 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T22:43:32.098 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T22:43:32.099 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T22:43:32.100 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T22:43:32.101 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T22:43:32.102 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T22:43:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T22:43:32.104 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T22:43:32.105 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T22:43:32.106 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T22:43:32.107 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T22:43:32.108 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T22:43:32.109 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T22:43:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T22:43:32.111 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T22:43:32.112 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T22:43:32.113 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T22:43:32.114 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T22:43:32.115 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T22:43:32.116 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T22:43:32.117 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T22:43:32.118 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T22:43:32.119 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T22:43:32.120 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T22:43:32.121 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T22:43:32.122 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T22:43:32.123 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T22:43:32.124 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T22:43:32.125 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T22:43:32.126 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T22:43:32.127 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T22:43:32.128 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T22:43:32.129 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T22:43:32.130 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T22:43:32.131 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T22:43:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T22:43:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T22:43:32.134 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T22:43:32.135 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T22:43:32.136 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T22:43:32.137 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T22:43:32.138 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T22:43:32.139 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T22:43:32.140 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T22:43:32.141 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T22:43:32.142 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T22:43:32.143 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T22:43:32.144 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T22:43:32.145 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T22:43:32.145 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T22:43:32.145 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T22:43:32.145 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T22:43:32.145 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T22:43:32.145 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T22:43:32.145 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T22:43:32.146 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T22:43:32.147 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T22:43:32.148 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T22:43:32.149 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T22:43:32.150 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T22:43:32.151 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T22:43:32.152 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T22:43:32.153 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T22:43:32.154 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T22:43:32.155 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T22:43:32.156 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T22:43:32.157 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T22:43:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T22:43:32.159 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T22:43:32.160 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T22:43:32.161 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T22:43:32.162 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T22:43:32.163 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T22:43:32.164 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T22:43:32.165 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T22:43:32.166 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T22:43:32.167 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T22:43:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T22:43:32.169 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T22:43:32.170 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T22:43:32.171 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T22:43:32.172 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T22:43:32.173 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T22:43:32.174 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T22:43:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T22:43:32.176 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T22:43:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T22:43:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T22:43:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T22:43:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T22:43:32.181 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T22:43:32.182 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T22:43:32.183 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T22:43:32.184 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T22:43:32.185 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T22:43:32.186 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T22:43:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T22:43:32.188 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T22:43:32.189 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T22:43:32.190 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T22:43:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T22:43:32.192 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T22:43:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T22:43:32.194 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T22:43:32.195 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T22:43:32.196 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T22:43:32.197 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T22:43:32.198 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T22:43:32.199 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T22:43:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T22:43:32.201 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T22:43:32.202 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T22:43:32.203 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T22:43:32.204 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T22:43:32.205 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T22:43:32.206 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T22:43:32.207 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T22:43:32.208 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T22:43:32.209 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T22:43:32.210 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T22:43:32.211 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T22:43:32.212 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T22:43:32.213 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T22:43:32.214 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T22:43:32.215 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T22:43:32.216 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T22:43:32.217 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T22:43:32.218 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T22:43:32.219 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T22:43:32.220 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T22:43:32.221 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T22:43:32.222 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T22:43:32.223 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T22:43:32.224 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T22:43:32.225 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T22:43:32.226 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T22:43:32.227 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T22:43:32.228 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T22:43:32.229 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T22:43:32.230 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T22:43:32.231 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T22:43:32.232 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T22:43:32.233 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T22:43:32.234 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T22:43:32.235 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T22:43:32.236 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T22:43:32.237 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T22:43:32.238 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T22:43:32.239 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T22:43:32.240 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T22:43:32.241 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T22:43:32.242 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T22:43:32.243 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T22:43:32.244 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T22:43:32.245 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T22:43:32.246 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T22:43:32.247 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T22:43:32.248 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T22:43:32.249 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T22:43:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T22:43:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T22:43:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T22:43:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T22:43:32.254 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T22:43:32.255 INFO:teuthology.orchestra.run.smithi190.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T22:43:32.256 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.256 DEBUG:teuthology.orchestra.run.smithi190:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T22:43:32.283 INFO:teuthology.orchestra.run.smithi190.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T22:43:32.283 INFO:teuthology.orchestra.run.smithi190.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T22:43:32.283 INFO:teuthology.orchestra.run.smithi190.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:43:32.283 INFO:teuthology.orchestra.run.smithi190.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:43:32.283 INFO:teuthology.orchestra.run.smithi190.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:fi 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:fi 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.284 INFO:teuthology.orchestra.run.smithi190.stdout:fi 2023-10-06T22:43:32.285 DEBUG:teuthology.orchestra.run.smithi190:> sudo rpm -qi grub2-tools 2023-10-06T22:43:32.363 INFO:teuthology.orchestra.run.smithi190.stdout:Name : grub2-tools 2023-10-06T22:43:32.363 INFO:teuthology.orchestra.run.smithi190.stdout:Epoch : 1 2023-10-06T22:43:32.363 INFO:teuthology.orchestra.run.smithi190.stdout:Version : 2.02 2023-10-06T22:43:32.363 INFO:teuthology.orchestra.run.smithi190.stdout:Release : 123.el8 2023-10-06T22:43:32.363 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: x86_64 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Group : System Environment/Base 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Size : 9265450 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:License : GPLv3+ 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Relocations : (not relocatable) 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Packager : Red Hat, Inc. 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Vendor : Red Hat, Inc. 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T22:43:32.364 INFO:teuthology.orchestra.run.smithi190.stdout:Summary : Support tools for GRUB. 2023-10-06T22:43:32.365 INFO:teuthology.orchestra.run.smithi190.stdout:Description : 2023-10-06T22:43:32.365 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:43:32.365 INFO:teuthology.orchestra.run.smithi190.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T22:43:32.365 INFO:teuthology.orchestra.run.smithi190.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T22:43:32.365 INFO:teuthology.orchestra.run.smithi190.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T22:43:32.365 INFO:teuthology.orchestra.run.smithi190.stdout:hardware devices. 2023-10-06T22:43:32.365 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:43:32.365 INFO:teuthology.orchestra.run.smithi190.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T22:43:32.366 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T22:43:32.366 INFO:teuthology.task.kernel:Updating grub on smithi190 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:32.366 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T22:43:34.880 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2023-10-06T22:43:36.727 INFO:teuthology.orchestra.run.smithi190.stderr:done 2023-10-06T22:43:36.729 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-10-06T22:43:36.760 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.D44lTuuGZr 2023-10-06T22:43:36.761 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.D44lTuuGZr 2023-10-06T22:43:36.836 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.D44lTuuGZr 2023-10-06T22:43:36.979 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.D44lTuuGZr is 6KB 2023-10-06T22:43:37.028 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.D44lTuuGZr 2023-10-06T22:43:37.044 DEBUG:teuthology.orchestra.run.smithi190:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T22:43:37.119 INFO:teuthology.orchestra.run.smithi190.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-06T22:43:37.119 INFO:teuthology.orchestra.run.smithi190.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-06T22:43:37.119 INFO:teuthology.orchestra.run.smithi190.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T22:43:37.120 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-06T22:43:37.266 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2023-10-06T22:43:50.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-06T22:43:58.770 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T22:43:58.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T22:43:58.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:43:59.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T22:43:59.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:44:02.331 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-06T22:44:07.274 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-10-06T22:44:07.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T22:44:07.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:44:14.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T22:44:14.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:44:17.150 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-06T22:44:25.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T22:44:26.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T22:44:26.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:44:29.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-06T22:44:34.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T22:44:34.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:44:37.658 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T22:44:41.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T22:44:41.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:44:49.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T22:44:49.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:45:08.090 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-06T22:45:13.260 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-06T22:45:13.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T22:45:13.636 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T22:45:13.637 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-06T22:45:13.679 INFO:teuthology.orchestra.run.smithi008.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T22:45:13.679 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:45:13.679 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T22:45:13.679 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T22:45:14.341 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T22:45:14.680 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T22:45:14.680 DEBUG:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T22:45:14.812 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2023-10-06T22:45:14.833 DEBUG:teuthology.parallel:result is None 2023-10-06T22:45:23.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T22:45:23.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:45:23.455 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-10-06T22:45:23.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T22:45:23.889 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T22:45:23.890 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-10-06T22:45:23.931 INFO:teuthology.orchestra.run.smithi190.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T22:45:23.931 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:45:23.931 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T22:45:23.932 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T22:45:24.933 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-10-06T22:45:24.933 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T22:45:25.054 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2023-10-06T22:45:25.076 DEBUG:teuthology.parallel:result is None 2023-10-06T22:45:29.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T22:45:29.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:45:29.696 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-10-06T22:45:30.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T22:45:30.155 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T22:45:30.155 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-10-06T22:45:30.197 INFO:teuthology.orchestra.run.smithi156.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T22:45:30.198 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T22:45:30.198 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T22:45:30.198 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T22:45:31.199 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T22:45:31.200 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T22:45:31.338 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2023-10-06T22:45:31.369 DEBUG:teuthology.parallel:result is None 2023-10-06T22:45:31.370 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T22:45:31.377 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T22:45:31.378 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T22:45:31.383 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T22:45:31.387 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T22:45:31.434 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T22:45:31.440 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T22:45:31.470 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T22:45:31.470 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T22:45:31.475 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T22:45:31.479 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T22:45:31.551 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T22:45:31.558 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T22:45:31.558 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T22:45:31.562 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T22:45:31.567 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T22:45:31.637 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T22:45:31.641 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T22:45:31.654 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T22:45:31.663 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T22:45:31.670 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T22:45:31.682 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T22:45:31.685 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T22:45:31.693 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T22:45:31.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T22:45:31.697 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T22:45:31.702 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T22:45:31.770 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T22:45:31.779 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T22:45:31.779 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T22:45:31.783 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T22:45:31.787 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T22:45:31.829 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T22:45:31.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T22:45:32.036 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T22:45:32.107 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T22:45:32.175 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T22:45:32.175 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T22:45:32.243 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T22:45:32.316 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T22:45:32.384 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T22:45:32.458 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T22:45:32.538 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T22:45:32.538 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T22:45:32.607 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T22:45:32.681 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T22:45:32.757 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T22:45:32.824 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T22:45:32.910 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T22:45:32.910 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T22:45:32.978 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-10-06T22:45:32.982 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-10-06T22:45:32.987 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2023-10-06T22:45:33.099 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T22:45:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T22:45:33.137 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T22:45:33.472 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T22:45:33.480 INFO:teuthology.task.internal:Starting timer... 2023-10-06T22:45:33.480 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T22:45:33.524 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T22:45:33.573 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T22:45:33.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-10-06T22:45:33.690 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-10-06T22:45:33.694 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2023-10-06T22:45:33.819 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2023-10-06T22:45:33.822 DEBUG:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2023-10-06T22:45:33.952 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: 2023-10-06T22:45:33.956 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T22:45:33.956 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-10-06T22:45:34.005 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-10-06T22:45:34.005 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2023-10-06T22:45:34.057 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2023-10-06T22:45:34.058 DEBUG:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2023-10-06T22:45:34.111 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2023-10-06T22:45:34.111 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': 'permissive'} 2023-10-06T22:45:34.112 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T22:45:34.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T22:45:34.185 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T22:45:34.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T22:45:34.257 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T22:45:34.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T22:45:34.326 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T22:45:34.326 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-10-06T22:45:34.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2023-10-06T22:45:34.467 DEBUG:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2023-10-06T22:45:34.534 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T22:45:34.545 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T22:45:34.550 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T22:45:34.685 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T22:45:34.706 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T22:45:34.708 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi156.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T22:58:42.780 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2023-10-06T22:58:42.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T22:58:42.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:58:42.870 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-06T22:58:42.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-06T22:58:42.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T22:58:42.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:58:43.074 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-10-06T22:58:43.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-06T22:58:43.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T22:58:43.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T22:58:43.278 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-10-06T22:58:43.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-06T22:58:43.400 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T22:58:43.412 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T22:58:43.412 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T22:58:43.412 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T22:58:43.417 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T22:58:43.417 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T22:58:43.422 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T22:58:43.422 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T22:58:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T22:58:43.491 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T22:58:43.515 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T22:58:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T22:58:43.526 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T22:58:43.549 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T22:58:43.618 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2023-10-06T22:58:43.623 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-10-06T22:58:43.644 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2023-10-06T22:58:43.647 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2023-10-06T22:58:43.653 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-10-06T22:58:43.673 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2023-10-06T22:58:43.682 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T22:58:43.688 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T22:58:43.708 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T22:58:43.717 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T22:58:43.724 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T22:58:43.741 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T22:58:43.807 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-10-06T22:58:43.814 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-06T22:58:43.815 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T22:58:43.815 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-10-06T22:58:43.815 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.815 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.815 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.815 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T22:58:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-06T22:58:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.822 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.832 INFO:teuthology.orchestra.run.smithi190.stderr:bash: ntpq: command not found 2023-10-06T22:58:43.839 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T22:58:43.839 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2023-10-06T22:58:43.839 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.839 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.839 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.840 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T22:58:43.840 INFO:teuthology.run_tasks:Running task pexec... 2023-10-06T22:58:43.850 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-06T22:58:43.850 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T22:58:43.850 DEBUG:teuthology.orchestra.run.smithi008:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T22:58:43.851 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi156.front.sepia.ceph.com 2023-10-06T22:58:43.851 DEBUG:teuthology.orchestra.run.smithi156:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T22:58:43.851 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi190.front.sepia.ceph.com 2023-10-06T22:58:43.851 DEBUG:teuthology.orchestra.run.smithi190:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-06T22:58:44.337 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-10-06T22:58:44.337 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-10-06T22:58:44.371 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T22:58:45.300 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:17 ago on Fri 06 Oct 2023 10:56:27 PM UTC. 2023-10-06T22:58:45.309 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:21 ago on Fri 06 Oct 2023 10:56:23 PM UTC. 2023-10-06T22:58:45.347 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:04 ago on Fri 06 Oct 2023 10:56:40 PM UTC. 2023-10-06T22:58:47.115 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-10-06T22:58:47.116 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-10-06T22:58:47.116 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-10-06T22:58:47.116 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-10-06T22:58:47.116 INFO:teuthology.orchestra.run.smithi156.stdout:Resetting modules: 2023-10-06T22:58:47.116 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools 2023-10-06T22:58:47.116 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:58:47.117 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-10-06T22:58:47.117 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-10-06T22:58:47.117 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:58:47.132 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-10-06T22:58:47.134 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-10-06T22:58:47.134 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2023-10-06T22:58:47.134 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-10-06T22:58:47.134 INFO:teuthology.orchestra.run.smithi190.stdout:Resetting modules: 2023-10-06T22:58:47.134 INFO:teuthology.orchestra.run.smithi190.stdout: container-tools 2023-10-06T22:58:47.134 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:58:47.134 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-10-06T22:58:47.134 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-10-06T22:58:47.135 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:58:47.356 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-06T22:58:47.357 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-06T22:58:47.358 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-06T22:58:47.358 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-06T22:58:47.358 INFO:teuthology.orchestra.run.smithi008.stdout:Resetting modules: 2023-10-06T22:58:47.358 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools 2023-10-06T22:58:47.358 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:58:47.358 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-06T22:58:47.358 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-06T22:58:47.358 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:58:48.346 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:20 ago on Fri 06 Oct 2023 10:56:27 PM UTC. 2023-10-06T22:58:48.400 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:24 ago on Fri 06 Oct 2023 10:56:23 PM UTC. 2023-10-06T22:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:08 ago on Fri 06 Oct 2023 10:56:40 PM UTC. 2023-10-06T22:58:51.036 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-10-06T22:58:51.236 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-10-06T22:58:51.642 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-10-06T22:58:51.672 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-06T22:58:51.816 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-10-06T22:58:52.297 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T22:58:53.000 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:25 ago on Fri 06 Oct 2023 10:56:27 PM UTC. 2023-10-06T22:58:53.329 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:29 ago on Fri 06 Oct 2023 10:56:23 PM UTC. 2023-10-06T22:58:54.092 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:13 ago on Fri 06 Oct 2023 10:56:40 PM UTC. 2023-10-06T22:58:54.772 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout:Installing group/module packages: 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-06T22:58:54.872 INFO:teuthology.orchestra.run.smithi156.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout:Installing module profiles: 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools/common 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout:Enabling module streams: 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools rhel8 2023-10-06T22:58:54.873 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:58:54.874 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-10-06T22:58:54.874 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-10-06T22:58:54.874 INFO:teuthology.orchestra.run.smithi156.stdout:Install 10 Packages 2023-10-06T22:58:54.874 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:58:54.874 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 18 M 2023-10-06T22:58:54.875 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 65 M 2023-10-06T22:58:54.875 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-10-06T22:58:55.071 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-10-06T22:58:55.170 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================================================ 2023-10-06T22:58:55.170 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-10-06T22:58:55.170 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================================================ 2023-10-06T22:58:55.170 INFO:teuthology.orchestra.run.smithi190.stdout:Installing group/module packages: 2023-10-06T22:58:55.170 INFO:teuthology.orchestra.run.smithi190.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-06T22:58:55.170 INFO:teuthology.orchestra.run.smithi190.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-06T22:58:55.170 INFO:teuthology.orchestra.run.smithi190.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout:Installing module profiles: 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: container-tools/common 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:58:55.171 INFO:teuthology.orchestra.run.smithi190.stdout:Enabling module streams: 2023-10-06T22:58:55.172 INFO:teuthology.orchestra.run.smithi190.stdout: container-tools rhel8 2023-10-06T22:58:55.172 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:58:55.172 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-10-06T22:58:55.172 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================================================ 2023-10-06T22:58:55.172 INFO:teuthology.orchestra.run.smithi190.stdout:Install 10 Packages 2023-10-06T22:58:55.172 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:58:55.172 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 18 M 2023-10-06T22:58:55.173 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 65 M 2023-10-06T22:58:55.173 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-10-06T22:58:55.327 INFO:teuthology.orchestra.run.smithi190.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 266 kB/s | 41 kB 00:00 2023-10-06T22:58:55.344 INFO:teuthology.orchestra.run.smithi190.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 146 kB/s | 25 kB 00:00 2023-10-06T22:58:55.346 INFO:teuthology.orchestra.run.smithi156.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 199 kB/s | 94 kB 00:00 2023-10-06T22:58:55.377 INFO:teuthology.orchestra.run.smithi190.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 460 kB/s | 94 kB 00:00 2023-10-06T22:58:55.378 INFO:teuthology.orchestra.run.smithi156.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 49 kB/s | 25 kB 00:00 2023-10-06T22:58:55.403 INFO:teuthology.orchestra.run.smithi156.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 77 kB/s | 41 kB 00:00 2023-10-06T22:58:55.462 INFO:teuthology.orchestra.run.smithi156.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 430 kB/s | 49 kB 00:00 2023-10-06T22:58:55.486 INFO:teuthology.orchestra.run.smithi190.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 311 kB/s | 49 kB 00:00 2023-10-06T22:58:55.520 INFO:teuthology.orchestra.run.smithi156.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.6 MB/s | 524 kB 00:00 2023-10-06T22:58:55.570 INFO:teuthology.orchestra.run.smithi190.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.3 MB/s | 524 kB 00:00 2023-10-06T22:58:55.611 INFO:teuthology.orchestra.run.smithi190.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.2 MB/s | 149 kB 00:00 2023-10-06T22:58:55.612 INFO:teuthology.orchestra.run.smithi156.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 996 kB/s | 149 kB 00:00 2023-10-06T22:58:55.679 INFO:teuthology.orchestra.run.smithi156.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.3 MB/s | 213 kB 00:00 2023-10-06T22:58:55.703 INFO:teuthology.orchestra.run.smithi190.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.6 MB/s | 213 kB 00:00 2023-10-06T22:58:55.804 INFO:teuthology.orchestra.run.smithi190.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 19 MB/s | 8.0 MB 00:00 2023-10-06T22:58:55.813 INFO:teuthology.orchestra.run.smithi156.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 19 MB/s | 8.0 MB 00:00 2023-10-06T22:58:55.905 INFO:teuthology.orchestra.run.smithi156.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 9.7 MB/s | 2.2 MB 00:00 2023-10-06T22:58:55.921 INFO:teuthology.orchestra.run.smithi190.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 10 MB/s | 2.2 MB 00:00 2023-10-06T22:58:56.029 INFO:teuthology.orchestra.run.smithi190.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 17 MB/s | 7.0 MB 00:00 2023-10-06T22:58:56.030 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-10-06T22:58:56.030 INFO:teuthology.orchestra.run.smithi190.stdout:Total 21 MB/s | 18 MB 00:00 2023-10-06T22:58:56.031 INFO:teuthology.orchestra.run.smithi156.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 17 MB/s | 7.0 MB 00:00 2023-10-06T22:58:56.031 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-10-06T22:58:56.031 INFO:teuthology.orchestra.run.smithi156.stdout:Total 16 MB/s | 18 MB 00:01 2023-10-06T22:58:56.060 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout:Installing group/module packages: 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-06T22:58:56.166 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout:Installing module profiles: 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools/common 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools rhel8 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:58:56.167 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-06T22:58:56.168 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-10-06T22:58:56.168 INFO:teuthology.orchestra.run.smithi008.stdout:Install 10 Packages 2023-10-06T22:58:56.168 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:58:56.168 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 18 M 2023-10-06T22:58:56.168 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 65 M 2023-10-06T22:58:56.168 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-06T22:58:56.327 INFO:teuthology.orchestra.run.smithi008.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 594 kB/s | 94 kB 00:00 2023-10-06T22:58:56.352 INFO:teuthology.orchestra.run.smithi008.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 223 kB/s | 41 kB 00:00 2023-10-06T22:58:56.358 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-10-06T22:58:56.363 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-10-06T22:58:56.378 INFO:teuthology.orchestra.run.smithi008.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 119 kB/s | 25 kB 00:00 2023-10-06T22:58:56.381 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-10-06T22:58:56.381 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-10-06T22:58:56.386 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-10-06T22:58:56.386 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-10-06T22:58:56.478 INFO:teuthology.orchestra.run.smithi008.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 327 kB/s | 49 kB 00:00 2023-10-06T22:58:56.528 INFO:teuthology.orchestra.run.smithi008.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.9 MB/s | 524 kB 00:00 2023-10-06T22:58:56.604 INFO:teuthology.orchestra.run.smithi008.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.2 MB/s | 149 kB 00:00 2023-10-06T22:58:56.654 INFO:teuthology.orchestra.run.smithi008.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.7 MB/s | 213 kB 00:00 2023-10-06T22:58:56.838 INFO:teuthology.orchestra.run.smithi008.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 17 MB/s | 8.0 MB 00:00 2023-10-06T22:58:56.896 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-10-06T22:58:56.900 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-10-06T22:58:56.909 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-10-06T22:58:56.914 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-10-06T22:58:56.930 INFO:teuthology.orchestra.run.smithi008.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 8.0 MB/s | 2.2 MB 00:00 2023-10-06T22:58:57.047 INFO:teuthology.orchestra.run.smithi008.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 16 MB/s | 7.0 MB 00:00 2023-10-06T22:58:57.047 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-06T22:58:57.047 INFO:teuthology.orchestra.run.smithi008.stdout:Total 21 MB/s | 18 MB 00:00 2023-10-06T22:58:57.388 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-06T22:58:57.412 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-06T22:58:57.412 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-06T22:58:57.454 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-10-06T22:58:57.481 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-10-06T22:58:57.642 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-06T22:58:57.683 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-06T22:58:57.859 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T22:58:57.881 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T22:58:57.961 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-06T22:58:57.966 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-06T22:58:58.085 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-06T22:58:58.132 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-06T22:58:58.307 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-06T22:58:58.362 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-06T22:58:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-06T22:58:58.700 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-06T22:58:58.721 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-06T22:58:58.757 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-06T22:58:58.923 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T22:58:59.136 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-06T22:58:59.335 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-06T22:58:59.528 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-06T22:58:59.590 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-06T22:58:59.712 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-06T22:59:00.469 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-06T22:59:00.541 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-06T22:59:00.553 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-06T22:59:00.725 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-06T22:59:00.808 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-06T22:59:00.906 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-06T22:59:00.977 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-06T22:59:01.098 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T22:59:01.235 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T22:59:01.492 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T22:59:01.493 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-06T22:59:01.493 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T22:59:01.493 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-06T22:59:01.493 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-06T22:59:01.493 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-06T22:59:01.493 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-06T22:59:01.493 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-06T22:59:01.493 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-06T22:59:01.494 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-06T22:59:01.523 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-06T22:59:01.630 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T22:59:01.631 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-06T22:59:01.631 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T22:59:01.631 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-06T22:59:01.631 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-06T22:59:01.631 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-06T22:59:01.631 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-06T22:59:01.631 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-06T22:59:01.631 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-06T22:59:01.632 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-06T22:59:01.812 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-06T22:59:01.985 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-06T22:59:02.210 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T22:59:02.612 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-06T22:59:02.612 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-06T22:59:02.612 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-06T22:59:02.612 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-06T22:59:02.612 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-06T22:59:02.612 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-06T22:59:02.612 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-06T22:59:02.613 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-06T22:59:02.613 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-06T22:59:02.613 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-06T22:59:03.035 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-06T22:59:03.035 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:35 ago on Fri 06 Oct 2023 10:56:27 PM UTC. 2023-10-06T22:59:03.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-06T22:59:03.140 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:39 ago on Fri 06 Oct 2023 10:56:23 PM UTC. 2023-10-06T22:59:04.060 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-06T22:59:04.060 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:23 ago on Fri 06 Oct 2023 10:56:40 PM UTC. 2023-10-06T22:59:06.066 INFO:teuthology.orchestra.run.smithi156.stdout:Installed products updated. 2023-10-06T22:59:06.260 INFO:teuthology.orchestra.run.smithi190.stdout:Installed products updated. 2023-10-06T22:59:06.280 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:06.281 INFO:teuthology.orchestra.run.smithi156.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T22:59:06.282 INFO:teuthology.orchestra.run.smithi156.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-06T22:59:06.282 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:59:06.282 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-10-06T22:59:06.463 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-06T22:59:06.464 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:59:06.465 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-10-06T22:59:06.515 DEBUG:teuthology.parallel:result is None 2023-10-06T22:59:06.666 DEBUG:teuthology.parallel:result is None 2023-10-06T22:59:08.174 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-06T22:59:08.385 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:59:08.385 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-06T22:59:08.385 INFO:teuthology.orchestra.run.smithi008.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:08.385 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T22:59:08.385 INFO:teuthology.orchestra.run.smithi008.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:08.385 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-06T22:59:08.385 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-06T22:59:08.386 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-06T22:59:08.386 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:08.386 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-06T22:59:08.386 INFO:teuthology.orchestra.run.smithi008.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-06T22:59:08.386 INFO:teuthology.orchestra.run.smithi008.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-06T22:59:08.386 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:59:08.386 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-06T22:59:08.588 DEBUG:teuthology.parallel:result is None 2023-10-06T22:59:08.588 INFO:teuthology.run_tasks:Running task install... 2023-10-06T22:59:08.597 DEBUG:teuthology.task.install:project ceph 2023-10-06T22:59:08.597 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c'}} 2023-10-06T22:59:08.598 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c'} 2023-10-06T22:59:08.598 INFO:teuthology.task.install:Using flavor: default 2023-10-06T22:59:08.603 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T22:59:08.603 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T22:59:08.604 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'tag': None, 'wait_for_package': False} 2023-10-06T22:59:08.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T22:59:08.606 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'tag': None, 'wait_for_package': False} 2023-10-06T22:59:08.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T22:59:08.607 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'tag': None, 'wait_for_package': False} 2023-10-06T22:59:08.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T22:59:08.747 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/ 2023-10-06T22:59:08.747 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6616.g14d8d032 2023-10-06T22:59:08.751 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/ 2023-10-06T22:59:08.752 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6616.g14d8d032 2023-10-06T22:59:08.819 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/ 2023-10-06T22:59:08.820 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6616.g14d8d032 2023-10-06T22:59:09.024 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T22:59:09.025 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T22:59:09.025 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T22:59:09.070 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T22:59:09.071 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T22:59:09.071 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T22:59:09.085 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T22:59:09.085 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T22:59:09.086 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T22:59:09.098 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-06T22:59:09.099 DEBUG:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/14d8d032507701c76ca224e769ee65a96b660a8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T22:59:09.142 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-06T22:59:09.142 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/14d8d032507701c76ca224e769ee65a96b660a8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T22:59:09.161 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-06T22:59:09.161 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/14d8d032507701c76ca224e769ee65a96b660a8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T22:59:09.209 DEBUG:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T22:59:09.253 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T22:59:09.273 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T22:59:09.305 DEBUG:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T22:59:09.351 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T22:59:09.369 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T22:59:09.371 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2023-10-06T22:59:09.374 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum clean all 2023-10-06T22:59:09.419 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-10-06T22:59:09.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-10-06T22:59:09.436 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2023-10-06T22:59:09.439 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2023-10-06T22:59:09.820 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-10-06T22:59:09.888 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-10-06T22:59:09.899 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T22:59:10.896 INFO:teuthology.orchestra.run.smithi190.stdout:44 files removed 2023-10-06T22:59:10.959 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-06T22:59:10.967 INFO:teuthology.orchestra.run.smithi156.stdout:44 files removed 2023-10-06T22:59:11.026 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-06T22:59:11.029 INFO:teuthology.orchestra.run.smithi008.stdout:44 files removed 2023-10-06T22:59:11.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-06T22:59:11.401 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-10-06T22:59:11.474 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-10-06T22:59:11.566 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-06T22:59:12.967 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 196 kB/s | 81 kB 00:00 2023-10-06T22:59:13.109 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 214 kB/s | 81 kB 00:00 2023-10-06T22:59:13.182 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 158 kB/s | 81 kB 00:00 2023-10-06T22:59:13.459 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 21 kB/s | 9.4 kB 00:00 2023-10-06T22:59:13.518 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-10-06T22:59:13.598 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-10-06T22:59:13.911 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-10-06T22:59:13.918 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2023-10-06T22:59:13.957 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-10-06T22:59:14.070 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-06T22:59:14.085 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-06T22:59:14.099 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-06T22:59:15.456 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-06T22:59:16.017 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 16 MB 00:01 2023-10-06T22:59:16.128 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 16 MB 00:02 2023-10-06T22:59:19.730 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 513 kB/s | 24 kB 00:00 2023-10-06T22:59:20.100 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 388 kB/s | 24 kB 00:00 2023-10-06T22:59:20.261 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 540 kB/s | 24 kB 00:00 2023-10-06T22:59:21.156 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 39 MB/s | 53 MB 00:01 2023-10-06T22:59:21.544 INFO:teuthology.orchestra.run.smithi190.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 39 MB/s | 53 MB 00:01 2023-10-06T22:59:21.589 INFO:teuthology.orchestra.run.smithi156.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 47 MB 00:01 2023-10-06T22:59:30.122 INFO:teuthology.orchestra.run.smithi156.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-10-06T22:59:30.353 INFO:teuthology.orchestra.run.smithi190.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 47 MB 00:01 2023-10-06T22:59:30.358 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 44 MB/s | 47 MB 00:01 2023-10-06T22:59:41.716 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T22:59:41.717 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T22:59:41.732 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-06T22:59:41.733 INFO:teuthology.orchestra.run.smithi156.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-06T22:59:41.734 INFO:teuthology.orchestra.run.smithi156.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-06T22:59:41.736 INFO:teuthology.orchestra.run.smithi156.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T22:59:41.738 INFO:teuthology.orchestra.run.smithi156.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T22:59:41.741 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T22:59:41.743 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T22:59:41.838 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T22:59:41.839 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T22:59:41.854 INFO:teuthology.orchestra.run.smithi190.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-06T22:59:41.855 INFO:teuthology.orchestra.run.smithi190.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-06T22:59:41.857 INFO:teuthology.orchestra.run.smithi190.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-06T22:59:41.858 INFO:teuthology.orchestra.run.smithi190.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T22:59:41.861 INFO:teuthology.orchestra.run.smithi190.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T22:59:41.864 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T22:59:41.865 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T22:59:41.880 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-10-06T22:59:41.893 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-10-06T22:59:41.893 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-10-06T22:59:41.893 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.4 k 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 5.4 M 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 918 k 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 167 k 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 1.6 M 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 132 k 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 1.8 M 2023-10-06T22:59:41.894 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 7.4 M 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 47 k 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 14 M 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 49 M 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 261 k 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 192 k 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 260 k 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 18 k 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T22:59:41.895 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 31 k 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 840 k 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 139 k 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 196 k 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 371 k 2023-10-06T22:59:41.896 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 364 k 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 107 k 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 94 k 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.6 M 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 179 k 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T22:59:41.897 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 23 M 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 23 k 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 2.3 M 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 242 k 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 4.6 M 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 18 M 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 15 k 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 24 k 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-06T22:59:41.898 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 183 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 518 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.9 M 2023-10-06T22:59:41.899 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T22:59:41.900 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 45 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 126 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T22:59:41.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T22:59:41.902 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T22:59:41.903 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T22:59:41.904 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout:Enabling module streams: 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql 10 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout:Install 128 Packages 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 3 Packages 2023-10-06T22:59:41.905 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T22:59:41.906 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 208 M 2023-10-06T22:59:41.906 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-10-06T22:59:42.005 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout:=========================================================================================================================== 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout:=========================================================================================================================== 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.4 k 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 5.4 M 2023-10-06T22:59:42.018 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 918 k 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 167 k 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 1.6 M 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 132 k 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 1.8 M 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 7.4 M 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 47 k 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 14 M 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 49 M 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 261 k 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 192 k 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 260 k 2023-10-06T22:59:42.019 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 18 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 31 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 840 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 139 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-06T22:59:42.020 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 196 k 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 371 k 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 364 k 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 107 k 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 94 k 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.6 M 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 179 k 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T22:59:42.021 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 23 M 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 23 k 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 2.3 M 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 242 k 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 4.6 M 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 18 M 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 15 k 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 24 k 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T22:59:42.022 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 183 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 518 k 2023-10-06T22:59:42.023 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.9 M 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T22:59:42.024 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 45 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 126 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T22:59:42.025 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T22:59:42.026 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T22:59:42.026 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T22:59:42.026 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T22:59:42.026 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T22:59:42.026 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T22:59:42.026 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T22:59:42.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-06T22:59:42.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T22:59:42.029 INFO:teuthology.orchestra.run.smithi190.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout:Enabling module streams: 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql 10 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout:=========================================================================================================================== 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout:Install 128 Packages 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 3 Packages 2023-10-06T22:59:42.030 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T22:59:42.031 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 208 M 2023-10-06T22:59:42.031 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-10-06T22:59:42.133 INFO:teuthology.orchestra.run.smithi156.stdout:(1/131): ceph-18.0.0-6616.g14d8d032.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-10-06T22:59:42.600 INFO:teuthology.orchestra.run.smithi156.stdout:(2/131): ceph-base-18.0.0-6616.g14d8d032.el8.x8 8.3 MB/s | 5.4 MB 00:00 2023-10-06T22:59:42.603 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T22:59:42.604 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T22:59:42.619 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-06T22:59:42.621 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-06T22:59:42.622 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-06T22:59:42.623 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T22:59:42.626 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T22:59:42.629 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T22:59:42.630 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T22:59:42.662 INFO:teuthology.orchestra.run.smithi190.stdout:(1/131): ceph-18.0.0-6616.g14d8d032.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-10-06T22:59:42.667 INFO:teuthology.orchestra.run.smithi156.stdout:(3/131): ceph-immutable-object-cache-18.0.0-661 2.5 MB/s | 167 kB 00:00 2023-10-06T22:59:42.779 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-06T22:59:42.793 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-10-06T22:59:42.793 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-06T22:59:42.794 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-10-06T22:59:42.794 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-06T22:59:42.794 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-06T22:59:42.794 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T22:59:42.794 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.4 k 2023-10-06T22:59:42.794 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 5.4 M 2023-10-06T22:59:42.794 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 918 k 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 167 k 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 1.6 M 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 132 k 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 1.8 M 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 7.4 M 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 47 k 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 14 M 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 49 M 2023-10-06T22:59:42.795 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 261 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 192 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 260 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 18 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 31 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 840 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 139 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T22:59:42.796 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 196 k 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 371 k 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 364 k 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 107 k 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 94 k 2023-10-06T22:59:42.797 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.6 M 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 179 k 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 3.7 M 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 23 M 2023-10-06T22:59:42.798 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 23 k 2023-10-06T22:59:42.799 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 2.3 M 2023-10-06T22:59:42.799 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 242 k 2023-10-06T22:59:42.799 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 4.6 M 2023-10-06T22:59:42.799 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 18 M 2023-10-06T22:59:42.799 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6616.g14d8d032.el8 ceph-noarch 15 k 2023-10-06T22:59:42.799 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 24 k 2023-10-06T22:59:42.799 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T22:59:42.799 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T22:59:42.800 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-06T22:59:42.800 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T22:59:42.800 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-06T22:59:42.800 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 183 k 2023-10-06T22:59:42.800 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-06T22:59:42.800 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-06T22:59:42.800 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T22:59:42.800 INFO:teuthology.orchestra.run.smithi008.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-06T22:59:42.801 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-06T22:59:42.801 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T22:59:42.801 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 518 k 2023-10-06T22:59:42.801 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-06T22:59:42.801 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 6.9 M 2023-10-06T22:59:42.801 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T22:59:42.801 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-06T22:59:42.801 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T22:59:42.802 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T22:59:42.802 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T22:59:42.802 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T22:59:42.802 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T22:59:42.802 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-06T22:59:42.802 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T22:59:42.803 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T22:59:42.803 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T22:59:42.803 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T22:59:42.803 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 45 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:18.0.0-6616.g14d8d032.el8 ceph 126 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T22:59:42.804 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T22:59:42.805 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T22:59:42.806 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T22:59:42.806 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T22:59:42.806 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T22:59:42.806 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T22:59:42.806 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T22:59:42.806 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-06T22:59:42.807 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T22:59:42.808 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql 10 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout:Install 128 Packages 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 3 Packages 2023-10-06T22:59:42.809 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T22:59:42.810 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 208 M 2023-10-06T22:59:42.810 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-06T22:59:42.942 INFO:teuthology.orchestra.run.smithi156.stdout:(4/131): ceph-mds-18.0.0-6616.g14d8d032.el8.x86 8.4 MB/s | 2.3 MB 00:00 2023-10-06T22:59:43.026 INFO:teuthology.orchestra.run.smithi156.stdout:(5/131): ceph-fuse-18.0.0-6616.g14d8d032.el8.x8 1.0 MB/s | 918 kB 00:00 2023-10-06T22:59:43.135 INFO:teuthology.orchestra.run.smithi156.stdout:(6/131): ceph-mgr-18.0.0-6616.g14d8d032.el8.x86 8.5 MB/s | 1.6 MB 00:00 2023-10-06T22:59:43.184 INFO:teuthology.orchestra.run.smithi008.stdout:(1/131): ceph-18.0.0-6616.g14d8d032.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-10-06T22:59:43.629 INFO:teuthology.orchestra.run.smithi190.stdout:(2/131): ceph-fuse-18.0.0-6616.g14d8d032.el8.x8 950 kB/s | 918 kB 00:00 2023-10-06T22:59:43.821 INFO:teuthology.orchestra.run.smithi190.stdout:(3/131): ceph-immutable-object-cache-18.0.0-661 874 kB/s | 167 kB 00:00 2023-10-06T22:59:44.052 INFO:teuthology.orchestra.run.smithi156.stdout:(7/131): ceph-common-18.0.0-6616.g14d8d032.el8. 11 MB/s | 23 MB 00:02 2023-10-06T22:59:44.426 INFO:teuthology.orchestra.run.smithi008.stdout:(2/131): ceph-fuse-18.0.0-6616.g14d8d032.el8.x8 740 kB/s | 918 kB 00:01 2023-10-06T22:59:44.626 INFO:teuthology.orchestra.run.smithi008.stdout:(3/131): ceph-immutable-object-cache-18.0.0-661 836 kB/s | 167 kB 00:00 2023-10-06T22:59:44.663 INFO:teuthology.orchestra.run.smithi190.stdout:(4/131): ceph-base-18.0.0-6616.g14d8d032.el8.x8 2.4 MB/s | 5.4 MB 00:02 2023-10-06T22:59:44.896 INFO:teuthology.orchestra.run.smithi190.stdout:(5/131): ceph-mds-18.0.0-6616.g14d8d032.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-06T22:59:45.085 INFO:teuthology.orchestra.run.smithi156.stdout:(8/131): ceph-osd-18.0.0-6616.g14d8d032.el8.x86 9.2 MB/s | 18 MB 00:01 2023-10-06T22:59:45.177 INFO:teuthology.orchestra.run.smithi156.stdout:(9/131): ceph-selinux-18.0.0-6616.g14d8d032.el8 266 kB/s | 24 kB 00:00 2023-10-06T22:59:45.472 INFO:teuthology.orchestra.run.smithi190.stdout:(6/131): ceph-mgr-18.0.0-6616.g14d8d032.el8.x86 2.0 MB/s | 1.6 MB 00:00 2023-10-06T22:59:46.018 INFO:teuthology.orchestra.run.smithi008.stdout:(4/131): ceph-mds-18.0.0-6616.g14d8d032.el8.x86 1.7 MB/s | 2.3 MB 00:01 2023-10-06T22:59:46.213 INFO:teuthology.orchestra.run.smithi190.stdout:(7/131): ceph-mon-18.0.0-6616.g14d8d032.el8.x86 3.5 MB/s | 4.6 MB 00:01 2023-10-06T22:59:46.394 INFO:teuthology.orchestra.run.smithi156.stdout:(10/131): ceph-radosgw-18.0.0-6616.g14d8d032.el 5.9 MB/s | 14 MB 00:02 2023-10-06T22:59:46.435 INFO:teuthology.orchestra.run.smithi008.stdout:(5/131): ceph-base-18.0.0-6616.g14d8d032.el8.x8 1.5 MB/s | 5.4 MB 00:03 2023-10-06T22:59:46.503 INFO:teuthology.orchestra.run.smithi156.stdout:(11/131): cephfs-mirror-18.0.0-6616.g14d8d032.e 2.4 MB/s | 260 kB 00:00 2023-10-06T22:59:46.594 INFO:teuthology.orchestra.run.smithi156.stdout:(12/131): libcephfs-devel-18.0.0-6616.g14d8d032 338 kB/s | 31 kB 00:00 2023-10-06T22:59:46.669 INFO:teuthology.orchestra.run.smithi008.stdout:(6/131): ceph-mgr-18.0.0-6616.g14d8d032.el8.x86 2.5 MB/s | 1.6 MB 00:00 2023-10-06T22:59:46.786 INFO:teuthology.orchestra.run.smithi156.stdout:(13/131): libcephfs2-18.0.0-6616.g14d8d032.el8. 4.3 MB/s | 840 kB 00:00 2023-10-06T22:59:46.903 INFO:teuthology.orchestra.run.smithi156.stdout:(14/131): libcephsqlite-18.0.0-6616.g14d8d032.e 1.5 MB/s | 183 kB 00:00 2023-10-06T22:59:47.020 INFO:teuthology.orchestra.run.smithi156.stdout:(15/131): librados-devel-18.0.0-6616.g14d8d032. 1.2 MB/s | 139 kB 00:00 2023-10-06T22:59:47.212 INFO:teuthology.orchestra.run.smithi156.stdout:(16/131): libradosstriper1-18.0.0-6616.g14d8d03 2.6 MB/s | 518 kB 00:00 2023-10-06T22:59:47.544 INFO:teuthology.orchestra.run.smithi008.stdout:(7/131): ceph-mon-18.0.0-6616.g14d8d032.el8.x86 4.2 MB/s | 4.6 MB 00:01 2023-10-06T22:59:48.138 INFO:teuthology.orchestra.run.smithi190.stdout:(8/131): ceph-common-18.0.0-6616.g14d8d032.el8. 3.9 MB/s | 23 MB 00:05 2023-10-06T22:59:48.180 INFO:teuthology.orchestra.run.smithi156.stdout:(17/131): librgw2-18.0.0-6616.g14d8d032.el8.x86 7.1 MB/s | 6.9 MB 00:00 2023-10-06T22:59:48.214 INFO:teuthology.orchestra.run.smithi190.stdout:(9/131): ceph-selinux-18.0.0-6616.g14d8d032.el8 326 kB/s | 24 kB 00:00 2023-10-06T22:59:48.247 INFO:teuthology.orchestra.run.smithi156.stdout:(18/131): python3-ceph-argparse-18.0.0-6616.g14 674 kB/s | 45 kB 00:00 2023-10-06T22:59:48.322 INFO:teuthology.orchestra.run.smithi156.stdout:(19/131): python3-ceph-common-18.0.0-6616.g14d8 1.6 MB/s | 126 kB 00:00 2023-10-06T22:59:48.405 INFO:teuthology.orchestra.run.smithi156.stdout:(20/131): python3-cephfs-18.0.0-6616.g14d8d032. 2.3 MB/s | 196 kB 00:00 2023-10-06T22:59:48.499 INFO:teuthology.orchestra.run.smithi156.stdout:(21/131): python3-rados-18.0.0-6616.g14d8d032.e 3.9 MB/s | 371 kB 00:00 2023-10-06T22:59:48.590 INFO:teuthology.orchestra.run.smithi156.stdout:(22/131): python3-rbd-18.0.0-6616.g14d8d032.el8 3.9 MB/s | 364 kB 00:00 2023-10-06T22:59:48.667 INFO:teuthology.orchestra.run.smithi156.stdout:(23/131): python3-rgw-18.0.0-6616.g14d8d032.el8 1.4 MB/s | 107 kB 00:00 2023-10-06T22:59:48.826 INFO:teuthology.orchestra.run.smithi156.stdout:(24/131): rbd-fuse-18.0.0-6616.g14d8d032.el8.x8 592 kB/s | 94 kB 00:00 2023-10-06T22:59:49.424 INFO:teuthology.orchestra.run.smithi156.stdout:(25/131): rbd-mirror-18.0.0-6616.g14d8d032.el8. 6.0 MB/s | 3.6 MB 00:00 2023-10-06T22:59:49.508 INFO:teuthology.orchestra.run.smithi156.stdout:(26/131): rbd-nbd-18.0.0-6616.g14d8d032.el8.x86 2.1 MB/s | 179 kB 00:00 2023-10-06T22:59:49.574 INFO:teuthology.orchestra.run.smithi156.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6616.g 347 kB/s | 23 kB 00:00 2023-10-06T22:59:49.658 INFO:teuthology.orchestra.run.smithi156.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6616.g14d8d03 1.5 MB/s | 132 kB 00:00 2023-10-06T22:59:49.966 INFO:teuthology.orchestra.run.smithi156.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6616.g14d8d 5.7 MB/s | 1.8 MB 00:00 2023-10-06T22:59:50.244 INFO:teuthology.orchestra.run.smithi008.stdout:(8/131): ceph-radosgw-18.0.0-6616.g14d8d032.el8 5.1 MB/s | 14 MB 00:02 2023-10-06T22:59:50.344 INFO:teuthology.orchestra.run.smithi008.stdout:(9/131): ceph-selinux-18.0.0-6616.g14d8d032.el8 244 kB/s | 24 kB 00:00 2023-10-06T22:59:50.864 INFO:teuthology.orchestra.run.smithi190.stdout:(10/131): ceph-radosgw-18.0.0-6616.g14d8d032.el 3.0 MB/s | 14 MB 00:04 2023-10-06T22:59:51.059 INFO:teuthology.orchestra.run.smithi156.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 6.8 MB/s | 7.4 MB 00:01 2023-10-06T22:59:51.064 INFO:teuthology.orchestra.run.smithi190.stdout:(11/131): cephfs-mirror-18.0.0-6616.g14d8d032.e 1.3 MB/s | 260 kB 00:00 2023-10-06T22:59:51.134 INFO:teuthology.orchestra.run.smithi156.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6616.g14 3.2 MB/s | 242 kB 00:00 2023-10-06T22:59:51.156 INFO:teuthology.orchestra.run.smithi190.stdout:(12/131): libcephfs-devel-18.0.0-6616.g14d8d032 338 kB/s | 31 kB 00:00 2023-10-06T22:59:51.192 INFO:teuthology.orchestra.run.smithi156.stdout:(32/131): ceph-mgr-rook-18.0.0-6616.g14d8d032.e 813 kB/s | 47 kB 00:00 2023-10-06T22:59:51.259 INFO:teuthology.orchestra.run.smithi156.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6616.g1 218 kB/s | 15 kB 00:00 2023-10-06T22:59:51.351 INFO:teuthology.orchestra.run.smithi156.stdout:(34/131): ceph-volume-18.0.0-6616.g14d8d032.el8 2.8 MB/s | 261 kB 00:00 2023-10-06T22:59:51.435 INFO:teuthology.orchestra.run.smithi156.stdout:(35/131): cephadm-18.0.0-6616.g14d8d032.el8.noa 2.2 MB/s | 192 kB 00:00 2023-10-06T22:59:51.518 INFO:teuthology.orchestra.run.smithi156.stdout:(36/131): cephfs-top-18.0.0-6616.g14d8d032.el8. 218 kB/s | 18 kB 00:00 2023-10-06T22:59:51.548 INFO:teuthology.orchestra.run.smithi190.stdout:(13/131): libcephfs2-18.0.0-6616.g14d8d032.el8. 2.1 MB/s | 840 kB 00:00 2023-10-06T22:59:51.648 INFO:teuthology.orchestra.run.smithi190.stdout:(14/131): libcephsqlite-18.0.0-6616.g14d8d032.e 1.8 MB/s | 183 kB 00:00 2023-10-06T22:59:51.740 INFO:teuthology.orchestra.run.smithi190.stdout:(15/131): librados-devel-18.0.0-6616.g14d8d032. 1.5 MB/s | 139 kB 00:00 2023-10-06T22:59:52.102 INFO:teuthology.orchestra.run.smithi156.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 525 kB/s | 306 kB 00:00 2023-10-06T22:59:52.115 INFO:teuthology.orchestra.run.smithi190.stdout:(16/131): ceph-osd-18.0.0-6616.g14d8d032.el8.x8 2.7 MB/s | 18 MB 00:06 2023-10-06T22:59:52.149 INFO:teuthology.orchestra.run.smithi190.stdout:(17/131): libradosstriper1-18.0.0-6616.g14d8d03 1.2 MB/s | 518 kB 00:00 2023-10-06T22:59:52.219 INFO:teuthology.orchestra.run.smithi156.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 505 kB/s | 59 kB 00:00 2023-10-06T22:59:52.241 INFO:teuthology.orchestra.run.smithi190.stdout:(18/131): python3-ceph-argparse-18.0.0-6616.g14 487 kB/s | 45 kB 00:00 2023-10-06T22:59:52.333 INFO:teuthology.orchestra.run.smithi190.stdout:(19/131): python3-ceph-common-18.0.0-6616.g14d8 1.3 MB/s | 126 kB 00:00 2023-10-06T22:59:52.344 INFO:teuthology.orchestra.run.smithi156.stdout:(39/131): ceph-mon-18.0.0-6616.g14d8d032.el8.x8 507 kB/s | 4.6 MB 00:09 2023-10-06T22:59:52.369 INFO:teuthology.orchestra.run.smithi156.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 500 kB/s | 75 kB 00:00 2023-10-06T22:59:52.478 INFO:teuthology.orchestra.run.smithi156.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-10-06T22:59:52.491 INFO:teuthology.orchestra.run.smithi190.stdout:(20/131): python3-cephfs-18.0.0-6616.g14d8d032. 1.2 MB/s | 196 kB 00:00 2023-10-06T22:59:52.620 INFO:teuthology.orchestra.run.smithi156.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-06T22:59:52.667 INFO:teuthology.orchestra.run.smithi190.stdout:(21/131): python3-rados-18.0.0-6616.g14d8d032.e 2.1 MB/s | 371 kB 00:00 2023-10-06T22:59:52.729 INFO:teuthology.orchestra.run.smithi156.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 305 kB/s | 33 kB 00:00 2023-10-06T22:59:52.833 INFO:teuthology.orchestra.run.smithi190.stdout:(22/131): python3-rbd-18.0.0-6616.g14d8d032.el8 2.1 MB/s | 364 kB 00:00 2023-10-06T22:59:52.837 INFO:teuthology.orchestra.run.smithi156.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-10-06T22:59:52.925 INFO:teuthology.orchestra.run.smithi190.stdout:(23/131): python3-rgw-18.0.0-6616.g14d8d032.el8 1.1 MB/s | 107 kB 00:00 2023-10-06T22:59:52.971 INFO:teuthology.orchestra.run.smithi156.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 760 kB/s | 476 kB 00:00 2023-10-06T22:59:53.005 INFO:teuthology.orchestra.run.smithi156.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.0 MB/s | 173 kB 00:00 2023-10-06T22:59:53.017 INFO:teuthology.orchestra.run.smithi190.stdout:(24/131): rbd-fuse-18.0.0-6616.g14d8d032.el8.x8 1.0 MB/s | 94 kB 00:00 2023-10-06T22:59:53.122 INFO:teuthology.orchestra.run.smithi156.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 697 kB/s | 81 kB 00:00 2023-10-06T22:59:53.561 INFO:teuthology.orchestra.run.smithi008.stdout:(10/131): ceph-osd-18.0.0-6616.g14d8d032.el8.x8 2.6 MB/s | 18 MB 00:06 2023-10-06T22:59:53.564 INFO:teuthology.orchestra.run.smithi156.stdout:(48/131): ceph-test-18.0.0-6616.g14d8d032.el8.x 5.8 MB/s | 49 MB 00:08 2023-10-06T22:59:53.589 INFO:teuthology.orchestra.run.smithi156.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 622 kB/s | 384 kB 00:00 2023-10-06T22:59:53.606 INFO:teuthology.orchestra.run.smithi156.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 23 kB/s | 11 kB 00:00 2023-10-06T22:59:53.665 INFO:teuthology.orchestra.run.smithi156.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-10-06T22:59:53.753 INFO:teuthology.orchestra.run.smithi008.stdout:(11/131): cephfs-mirror-18.0.0-6616.g14d8d032.e 1.3 MB/s | 260 kB 00:00 2023-10-06T22:59:53.782 INFO:teuthology.orchestra.run.smithi156.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 504 kB/s | 59 kB 00:00 2023-10-06T22:59:53.870 INFO:teuthology.orchestra.run.smithi008.stdout:(12/131): libcephfs-devel-18.0.0-6616.g14d8d032 266 kB/s | 31 kB 00:00 2023-10-06T22:59:53.940 INFO:teuthology.orchestra.run.smithi156.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 3.5 MB/s | 1.2 MB 00:00 2023-10-06T22:59:53.966 INFO:teuthology.orchestra.run.smithi156.stdout:(54/131): python3-logutils-0.3.5-11.el8.noarch. 136 kB/s | 49 kB 00:00 2023-10-06T22:59:53.991 INFO:teuthology.orchestra.run.smithi156.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 288 kB/s | 60 kB 00:00 2023-10-06T22:59:54.058 INFO:teuthology.orchestra.run.smithi156.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-06T22:59:54.083 INFO:teuthology.orchestra.run.smithi156.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-10-06T22:59:54.125 INFO:teuthology.orchestra.run.smithi156.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 251 kB/s | 34 kB 00:00 2023-10-06T22:59:54.184 INFO:teuthology.orchestra.run.smithi156.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 642 kB/s | 64 kB 00:00 2023-10-06T22:59:54.209 INFO:teuthology.orchestra.run.smithi156.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-10-06T22:59:54.210 INFO:teuthology.orchestra.run.smithi190.stdout:(25/131): librgw2-18.0.0-6616.g14d8d032.el8.x86 3.3 MB/s | 6.9 MB 00:02 2023-10-06T22:59:54.243 INFO:teuthology.orchestra.run.smithi156.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-10-06T22:59:54.245 INFO:teuthology.orchestra.run.smithi008.stdout:(13/131): libcephfs2-18.0.0-6616.g14d8d032.el8. 2.2 MB/s | 840 kB 00:00 2023-10-06T22:59:54.285 INFO:teuthology.orchestra.run.smithi156.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-10-06T22:59:54.293 INFO:teuthology.orchestra.run.smithi190.stdout:(26/131): rbd-nbd-18.0.0-6616.g14d8d032.el8.x86 2.1 MB/s | 179 kB 00:00 2023-10-06T22:59:54.318 INFO:teuthology.orchestra.run.smithi156.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-10-06T22:59:54.346 INFO:teuthology.orchestra.run.smithi008.stdout:(14/131): libcephsqlite-18.0.0-6616.g14d8d032.e 1.8 MB/s | 183 kB 00:00 2023-10-06T22:59:54.376 INFO:teuthology.orchestra.run.smithi190.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6616.g 277 kB/s | 23 kB 00:00 2023-10-06T22:59:54.385 INFO:teuthology.orchestra.run.smithi156.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 194 kB/s | 27 kB 00:00 2023-10-06T22:59:54.411 INFO:teuthology.orchestra.run.smithi156.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-06T22:59:54.446 INFO:teuthology.orchestra.run.smithi008.stdout:(15/131): librados-devel-18.0.0-6616.g14d8d032. 1.4 MB/s | 139 kB 00:00 2023-10-06T22:59:54.469 INFO:teuthology.orchestra.run.smithi190.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6616.g14d8d03 1.4 MB/s | 132 kB 00:00 2023-10-06T22:59:54.477 INFO:teuthology.orchestra.run.smithi156.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-10-06T22:59:54.520 INFO:teuthology.orchestra.run.smithi156.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 788 kB/s | 85 kB 00:00 2023-10-06T22:59:54.527 INFO:teuthology.orchestra.run.smithi190.stdout:(29/131): rbd-mirror-18.0.0-6616.g14d8d032.el8. 2.4 MB/s | 3.6 MB 00:01 2023-10-06T22:59:54.561 INFO:teuthology.orchestra.run.smithi156.stdout:(68/131): python3-websocket-client-0.56.0-5.el8 348 kB/s | 61 kB 00:00 2023-10-06T22:59:54.587 INFO:teuthology.orchestra.run.smithi156.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2023-10-06T22:59:54.612 INFO:teuthology.orchestra.run.smithi156.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-06T22:59:54.679 INFO:teuthology.orchestra.run.smithi156.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-06T22:59:54.688 INFO:teuthology.orchestra.run.smithi008.stdout:(16/131): libradosstriper1-18.0.0-6616.g14d8d03 2.1 MB/s | 518 kB 00:00 2023-10-06T22:59:54.721 INFO:teuthology.orchestra.run.smithi156.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2023-10-06T22:59:54.738 INFO:teuthology.orchestra.run.smithi156.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 929 kB/s | 54 kB 00:00 2023-10-06T22:59:54.788 INFO:teuthology.orchestra.run.smithi156.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-10-06T22:59:54.813 INFO:teuthology.orchestra.run.smithi156.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.5 MB/s | 323 kB 00:00 2023-10-06T22:59:54.830 INFO:teuthology.orchestra.run.smithi156.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 923 kB/s | 39 kB 00:00 2023-10-06T22:59:54.873 INFO:teuthology.orchestra.run.smithi156.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-06T22:59:54.914 INFO:teuthology.orchestra.run.smithi156.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-10-06T22:59:54.965 INFO:teuthology.orchestra.run.smithi156.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-10-06T22:59:54.998 INFO:teuthology.orchestra.run.smithi156.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-10-06T22:59:55.040 INFO:teuthology.orchestra.run.smithi156.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-10-06T22:59:55.082 INFO:teuthology.orchestra.run.smithi156.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 641 kB/s | 27 kB 00:00 2023-10-06T22:59:55.102 INFO:teuthology.orchestra.run.smithi190.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6616.g14d8d 2.8 MB/s | 1.8 MB 00:00 2023-10-06T22:59:55.141 INFO:teuthology.orchestra.run.smithi156.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-10-06T22:59:55.183 INFO:teuthology.orchestra.run.smithi156.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-10-06T22:59:55.253 INFO:teuthology.orchestra.run.smithi190.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6616.g14 1.6 MB/s | 242 kB 00:00 2023-10-06T22:59:55.316 INFO:teuthology.orchestra.run.smithi156.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-06T22:59:55.344 INFO:teuthology.orchestra.run.smithi190.stdout:(32/131): ceph-mgr-rook-18.0.0-6616.g14d8d032.e 518 kB/s | 47 kB 00:00 2023-10-06T22:59:55.367 INFO:teuthology.orchestra.run.smithi156.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-10-06T22:59:55.437 INFO:teuthology.orchestra.run.smithi190.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6616.g1 158 kB/s | 15 kB 00:00 2023-10-06T22:59:55.450 INFO:teuthology.orchestra.run.smithi156.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-10-06T22:59:55.476 INFO:teuthology.orchestra.run.smithi156.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-10-06T22:59:55.501 INFO:teuthology.orchestra.run.smithi156.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-10-06T22:59:55.526 INFO:teuthology.orchestra.run.smithi156.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-06T22:59:55.552 INFO:teuthology.orchestra.run.smithi156.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-10-06T22:59:55.577 INFO:teuthology.orchestra.run.smithi156.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-06T22:59:55.619 INFO:teuthology.orchestra.run.smithi156.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-06T22:59:55.628 INFO:teuthology.orchestra.run.smithi190.stdout:(34/131): ceph-volume-18.0.0-6616.g14d8d032.el8 1.3 MB/s | 261 kB 00:00 2023-10-06T22:59:55.661 INFO:teuthology.orchestra.run.smithi156.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-10-06T22:59:55.729 INFO:teuthology.orchestra.run.smithi190.stdout:(35/131): cephadm-18.0.0-6616.g14d8d032.el8.noa 1.9 MB/s | 192 kB 00:00 2023-10-06T22:59:55.821 INFO:teuthology.orchestra.run.smithi190.stdout:(36/131): cephfs-top-18.0.0-6616.g14d8d032.el8. 198 kB/s | 18 kB 00:00 2023-10-06T22:59:55.828 INFO:teuthology.orchestra.run.smithi156.stdout:(95/131): python3-scipy-1.0.0-21.module+el8.5.0 11 MB/s | 14 MB 00:01 2023-10-06T22:59:55.870 INFO:teuthology.orchestra.run.smithi156.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-06T22:59:55.929 INFO:teuthology.orchestra.run.smithi156.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-10-06T22:59:56.037 INFO:teuthology.orchestra.run.smithi156.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2023-10-06T22:59:56.104 INFO:teuthology.orchestra.run.smithi156.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-10-06T22:59:56.204 INFO:teuthology.orchestra.run.smithi156.stdout:(100/131): openblas-0.3.15-3.el8.x86_64.rpm 8.7 MB/s | 4.7 MB 00:00 2023-10-06T22:59:56.246 INFO:teuthology.orchestra.run.smithi156.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-06T22:59:56.288 INFO:teuthology.orchestra.run.smithi156.stdout:(102/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.7 MB/s | 200 kB 00:00 2023-10-06T22:59:56.322 INFO:teuthology.orchestra.run.smithi156.stdout:(103/131): postgresql-10.21-2.module+el8.6.0+15 6.9 MB/s | 1.5 MB 00:00 2023-10-06T22:59:56.339 INFO:teuthology.orchestra.run.smithi156.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 843 kB/s | 43 kB 00:00 2023-10-06T22:59:56.373 INFO:teuthology.orchestra.run.smithi156.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-06T22:59:56.389 INFO:teuthology.orchestra.run.smithi156.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 957 kB/s | 48 kB 00:00 2023-10-06T22:59:56.415 INFO:teuthology.orchestra.run.smithi156.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-10-06T22:59:56.440 INFO:teuthology.orchestra.run.smithi156.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 850 kB/s | 43 kB 00:00 2023-10-06T22:59:56.465 INFO:teuthology.orchestra.run.smithi156.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-06T22:59:56.488 INFO:teuthology.orchestra.run.smithi190.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 460 kB/s | 306 kB 00:00 2023-10-06T22:59:56.499 INFO:teuthology.orchestra.run.smithi156.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-10-06T22:59:56.574 INFO:teuthology.orchestra.run.smithi156.stdout:(111/131): postgresql-server-10.21-2.module+el8 7.8 MB/s | 5.1 MB 00:00 2023-10-06T22:59:56.600 INFO:teuthology.orchestra.run.smithi156.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 186 kB/s | 19 kB 00:00 2023-10-06T22:59:56.613 INFO:teuthology.orchestra.run.smithi190.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 470 kB/s | 59 kB 00:00 2023-10-06T22:59:56.633 INFO:teuthology.orchestra.run.smithi156.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-06T22:59:56.659 INFO:teuthology.orchestra.run.smithi156.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.8 MB/s | 155 kB 00:00 2023-10-06T22:59:56.684 INFO:teuthology.orchestra.run.smithi156.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 356 kB/s | 18 kB 00:00 2023-10-06T22:59:56.717 INFO:teuthology.orchestra.run.smithi156.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-10-06T22:59:56.747 INFO:teuthology.orchestra.run.smithi190.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 564 kB/s | 75 kB 00:00 2023-10-06T22:59:56.759 INFO:teuthology.orchestra.run.smithi156.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-10-06T22:59:56.785 INFO:teuthology.orchestra.run.smithi156.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-10-06T22:59:56.810 INFO:teuthology.orchestra.run.smithi156.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-06T22:59:56.836 INFO:teuthology.orchestra.run.smithi156.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-06T22:59:56.861 INFO:teuthology.orchestra.run.smithi156.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-06T22:59:56.886 INFO:teuthology.orchestra.run.smithi156.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-06T22:59:56.911 INFO:teuthology.orchestra.run.smithi156.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-06T22:59:56.937 INFO:teuthology.orchestra.run.smithi156.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 768 kB/s | 39 kB 00:00 2023-10-06T22:59:56.955 INFO:teuthology.orchestra.run.smithi190.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-10-06T22:59:56.978 INFO:teuthology.orchestra.run.smithi156.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-10-06T22:59:57.004 INFO:teuthology.orchestra.run.smithi156.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-06T22:59:57.037 INFO:teuthology.orchestra.run.smithi156.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.3 MB/s | 138 kB 00:00 2023-10-06T22:59:57.064 INFO:teuthology.orchestra.run.smithi190.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 404 kB/s | 44 kB 00:00 2023-10-06T22:59:57.097 INFO:teuthology.orchestra.run.smithi008.stdout:(17/131): ceph-common-18.0.0-6616.g14d8d032.el8 1.6 MB/s | 23 MB 00:14 2023-10-06T22:59:57.104 INFO:teuthology.orchestra.run.smithi156.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.0 MB/s | 2.3 MB 00:00 2023-10-06T22:59:57.155 INFO:teuthology.orchestra.run.smithi156.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-06T22:59:57.181 INFO:teuthology.orchestra.run.smithi190.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-10-06T22:59:57.280 INFO:teuthology.orchestra.run.smithi008.stdout:(18/131): librgw2-18.0.0-6616.g14d8d032.el8.x86 2.7 MB/s | 6.9 MB 00:02 2023-10-06T22:59:57.297 INFO:teuthology.orchestra.run.smithi008.stdout:(19/131): python3-ceph-argparse-18.0.0-6616.g14 224 kB/s | 45 kB 00:00 2023-10-06T22:59:57.316 INFO:teuthology.orchestra.run.smithi190.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 246 kB/s | 33 kB 00:00 2023-10-06T22:59:57.398 INFO:teuthology.orchestra.run.smithi008.stdout:(20/131): python3-ceph-common-18.0.0-6616.g14d8 1.0 MB/s | 126 kB 00:00 2023-10-06T22:59:57.432 INFO:teuthology.orchestra.run.smithi190.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 141 kB/s | 16 kB 00:00 2023-10-06T22:59:57.464 INFO:teuthology.orchestra.run.smithi008.stdout:(21/131): python3-cephfs-18.0.0-6616.g14d8d032. 1.1 MB/s | 196 kB 00:00 2023-10-06T22:59:57.591 INFO:teuthology.orchestra.run.smithi190.stdout:(45/131): ceph-mgr-diskprediction-local-18.0.0- 2.4 MB/s | 7.4 MB 00:03 2023-10-06T22:59:57.615 INFO:teuthology.orchestra.run.smithi008.stdout:(22/131): python3-rados-18.0.0-6616.g14d8d032.e 1.7 MB/s | 371 kB 00:00 2023-10-06T22:59:57.615 INFO:teuthology.orchestra.run.smithi190.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 942 kB/s | 173 kB 00:00 2023-10-06T22:59:57.724 INFO:teuthology.orchestra.run.smithi008.stdout:(23/131): python3-rbd-18.0.0-6616.g14d8d032.el8 1.4 MB/s | 364 kB 00:00 2023-10-06T22:59:57.757 INFO:teuthology.orchestra.run.smithi008.stdout:(24/131): python3-rgw-18.0.0-6616.g14d8d032.el8 750 kB/s | 107 kB 00:00 2023-10-06T22:59:57.758 INFO:teuthology.orchestra.run.smithi190.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 573 kB/s | 81 kB 00:00 2023-10-06T22:59:57.850 INFO:teuthology.orchestra.run.smithi008.stdout:(25/131): rbd-fuse-18.0.0-6616.g14d8d032.el8.x8 744 kB/s | 94 kB 00:00 2023-10-06T22:59:57.866 INFO:teuthology.orchestra.run.smithi190.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 103 kB/s | 11 kB 00:00 2023-10-06T22:59:58.110 INFO:teuthology.orchestra.run.smithi008.stdout:(26/131): rbd-nbd-18.0.0-6616.g14d8d032.el8.x86 690 kB/s | 179 kB 00:00 2023-10-06T22:59:58.113 INFO:teuthology.orchestra.run.smithi156.stdout:(130/131): librbd1-18.0.0-6616.g14d8d032.el8.x8 3.5 MB/s | 3.7 MB 00:01 2023-10-06T22:59:58.218 INFO:teuthology.orchestra.run.smithi008.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6616.g 214 kB/s | 23 kB 00:00 2023-10-06T22:59:58.258 INFO:teuthology.orchestra.run.smithi190.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 45 kB/s | 18 kB 00:00 2023-10-06T22:59:58.300 INFO:teuthology.orchestra.run.smithi190.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 542 kB/s | 384 kB 00:00 2023-10-06T22:59:58.425 INFO:teuthology.orchestra.run.smithi190.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-10-06T22:59:58.435 INFO:teuthology.orchestra.run.smithi008.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6616.g14d8d03 609 kB/s | 132 kB 00:00 2023-10-06T22:59:58.476 INFO:teuthology.orchestra.run.smithi190.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 5.4 MB/s | 1.2 MB 00:00 2023-10-06T22:59:58.534 INFO:teuthology.orchestra.run.smithi190.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 541 kB/s | 59 kB 00:00 2023-10-06T22:59:58.601 INFO:teuthology.orchestra.run.smithi190.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 481 kB/s | 60 kB 00:00 2023-10-06T22:59:58.693 INFO:teuthology.orchestra.run.smithi190.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-10-06T22:59:58.718 INFO:teuthology.orchestra.run.smithi190.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 134 kB/s | 16 kB 00:00 2023-10-06T22:59:58.935 INFO:teuthology.orchestra.run.smithi190.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 139 kB/s | 34 kB 00:00 2023-10-06T22:59:58.961 INFO:teuthology.orchestra.run.smithi190.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 811 kB/s | 196 kB 00:00 2023-10-06T22:59:59.053 INFO:teuthology.orchestra.run.smithi190.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 551 kB/s | 64 kB 00:00 2023-10-06T22:59:59.078 INFO:teuthology.orchestra.run.smithi190.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-10-06T22:59:59.161 INFO:teuthology.orchestra.run.smithi008.stdout:(29/131): rbd-mirror-18.0.0-6616.g14d8d032.el8. 2.6 MB/s | 3.6 MB 00:01 2023-10-06T22:59:59.203 INFO:teuthology.orchestra.run.smithi190.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 159 kB/s | 24 kB 00:00 2023-10-06T22:59:59.229 INFO:teuthology.orchestra.run.smithi190.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 195 kB/s | 29 kB 00:00 2023-10-06T22:59:59.303 INFO:teuthology.orchestra.run.smithi008.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6616.g14d8d 2.0 MB/s | 1.8 MB 00:00 2023-10-06T22:59:59.321 INFO:teuthology.orchestra.run.smithi190.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 236 kB/s | 27 kB 00:00 2023-10-06T22:59:59.396 INFO:teuthology.orchestra.run.smithi190.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.5 MB/s | 255 kB 00:00 2023-10-06T22:59:59.453 INFO:teuthology.orchestra.run.smithi008.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6616.g14 1.6 MB/s | 242 kB 00:00 2023-10-06T22:59:59.463 INFO:teuthology.orchestra.run.smithi190.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-10-06T22:59:59.530 INFO:teuthology.orchestra.run.smithi190.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 457 kB/s | 61 kB 00:00 2023-10-06T22:59:59.536 INFO:teuthology.orchestra.run.smithi008.stdout:(32/131): ceph-mgr-rook-18.0.0-6616.g14d8d032.e 572 kB/s | 47 kB 00:00 2023-10-06T22:59:59.580 INFO:teuthology.orchestra.run.smithi190.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 729 kB/s | 85 kB 00:00 2023-10-06T22:59:59.637 INFO:teuthology.orchestra.run.smithi008.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6616.g1 145 kB/s | 15 kB 00:00 2023-10-06T22:59:59.672 INFO:teuthology.orchestra.run.smithi190.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 162 kB/s | 23 kB 00:00 2023-10-06T22:59:59.689 INFO:teuthology.orchestra.run.smithi190.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-06T22:59:59.796 INFO:teuthology.orchestra.run.smithi008.stdout:(34/131): ceph-volume-18.0.0-6616.g14d8d032.el8 1.6 MB/s | 261 kB 00:00 2023-10-06T23:00:00.165 INFO:teuthology.orchestra.run.smithi190.stdout:(70/131): ceph-test-18.0.0-6616.g14d8d032.el8.x 4.1 MB/s | 49 MB 00:11 2023-10-06T23:00:00.190 INFO:teuthology.orchestra.run.smithi190.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 94 kB/s | 47 kB 00:00 2023-10-06T23:00:00.240 INFO:teuthology.orchestra.run.smithi190.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 2.6 MB/s | 1.7 MB 00:00 2023-10-06T23:00:00.286 INFO:teuthology.orchestra.run.smithi190.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 474 kB/s | 43 kB 00:00 2023-10-06T23:00:00.324 INFO:teuthology.orchestra.run.smithi190.stdout:(74/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-10-06T23:00:00.349 INFO:teuthology.orchestra.run.smithi190.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 842 kB/s | 48 kB 00:00 2023-10-06T23:00:00.371 INFO:teuthology.orchestra.run.smithi008.stdout:(35/131): ceph-test-18.0.0-6616.g14d8d032.el8.x 4.9 MB/s | 49 MB 00:10 2023-10-06T23:00:00.374 INFO:teuthology.orchestra.run.smithi190.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-06T23:00:00.400 INFO:teuthology.orchestra.run.smithi190.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2023-10-06T23:00:00.405 INFO:teuthology.orchestra.run.smithi008.stdout:(36/131): cephadm-18.0.0-6616.g14d8d032.el8.noa 315 kB/s | 192 kB 00:00 2023-10-06T23:00:00.425 INFO:teuthology.orchestra.run.smithi190.stdout:(78/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-10-06T23:00:00.447 INFO:teuthology.orchestra.run.smithi008.stdout:(37/131): cephfs-top-18.0.0-6616.g14d8d032.el8. 241 kB/s | 18 kB 00:00 2023-10-06T23:00:00.450 INFO:teuthology.orchestra.run.smithi190.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-10-06T23:00:00.476 INFO:teuthology.orchestra.run.smithi190.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-10-06T23:00:00.501 INFO:teuthology.orchestra.run.smithi190.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-10-06T23:00:00.526 INFO:teuthology.orchestra.run.smithi190.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-06T23:00:00.560 INFO:teuthology.orchestra.run.smithi190.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-10-06T23:00:00.585 INFO:teuthology.orchestra.run.smithi190.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 308 kB/s | 18 kB 00:00 2023-10-06T23:00:00.619 INFO:teuthology.orchestra.run.smithi190.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.7 MB/s | 559 kB 00:00 2023-10-06T23:00:00.652 INFO:teuthology.orchestra.run.smithi190.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-06T23:00:00.655 INFO:teuthology.orchestra.run.smithi008.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 282 kB/s | 59 kB 00:00 2023-10-06T23:00:00.717 INFO:teuthology.orchestra.run.smithi190.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.8 MB/s | 605 kB 00:00 2023-10-06T23:00:00.722 INFO:teuthology.orchestra.run.smithi008.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 965 kB/s | 306 kB 00:00 2023-10-06T23:00:00.745 INFO:teuthology.orchestra.run.smithi190.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 787 kB/s | 72 kB 00:00 2023-10-06T23:00:00.748 INFO:teuthology.orchestra.run.smithi008.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 819 kB/s | 75 kB 00:00 2023-10-06T23:00:00.770 INFO:teuthology.orchestra.run.smithi190.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.5 MB/s | 83 kB 00:00 2023-10-06T23:00:00.782 INFO:teuthology.orchestra.run.smithi156.stdout:(131/131): librados2-18.0.0-6616.g14d8d032.el8. 1.0 MB/s | 3.7 MB 00:03 2023-10-06T23:00:00.785 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-10-06T23:00:00.785 INFO:teuthology.orchestra.run.smithi156.stdout:Total 11 MB/s | 208 MB 00:18 2023-10-06T23:00:00.796 INFO:teuthology.orchestra.run.smithi190.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-06T23:00:00.807 INFO:teuthology.orchestra.run.smithi008.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 747 kB/s | 44 kB 00:00 2023-10-06T23:00:00.820 INFO:teuthology.orchestra.run.smithi190.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-06T23:00:00.832 INFO:teuthology.orchestra.run.smithi008.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-10-06T23:00:00.837 INFO:teuthology.orchestra.run.smithi190.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2023-10-06T23:00:00.854 INFO:teuthology.orchestra.run.smithi190.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-10-06T23:00:00.882 INFO:teuthology.orchestra.run.smithi008.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 662 kB/s | 33 kB 00:00 2023-10-06T23:00:00.896 INFO:teuthology.orchestra.run.smithi190.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-10-06T23:00:00.916 INFO:teuthology.orchestra.run.smithi008.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-10-06T23:00:00.922 INFO:teuthology.orchestra.run.smithi190.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-10-06T23:00:00.941 INFO:teuthology.orchestra.run.smithi008.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2023-10-06T23:00:00.947 INFO:teuthology.orchestra.run.smithi190.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-06T23:00:00.989 INFO:teuthology.orchestra.run.smithi190.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-10-06T23:00:01.033 INFO:teuthology.orchestra.run.smithi008.stdout:(46/131): ceph-mgr-diskprediction-local-18.0.0- 4.0 MB/s | 7.4 MB 00:01 2023-10-06T23:00:01.047 INFO:teuthology.orchestra.run.smithi190.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.4 MB/s | 2.3 MB 00:00 2023-10-06T23:00:01.058 INFO:teuthology.orchestra.run.smithi008.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-06T23:00:01.073 INFO:teuthology.orchestra.run.smithi190.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 649 kB/s | 54 kB 00:00 2023-10-06T23:00:01.084 INFO:teuthology.orchestra.run.smithi008.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2023-10-06T23:00:01.106 INFO:teuthology.orchestra.run.smithi190.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-06T23:00:01.117 INFO:teuthology.orchestra.run.smithi008.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-10-06T23:00:01.151 INFO:teuthology.orchestra.run.smithi008.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 284 kB/s | 18 kB 00:00 2023-10-06T23:00:01.165 INFO:teuthology.orchestra.run.smithi190.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-10-06T23:00:01.190 INFO:teuthology.orchestra.run.smithi190.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 466 kB/s | 39 kB 00:00 2023-10-06T23:00:01.210 INFO:teuthology.orchestra.run.smithi008.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 836 kB/s | 49 kB 00:00 2023-10-06T23:00:01.240 INFO:teuthology.orchestra.run.smithi190.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-10-06T23:00:01.268 INFO:teuthology.orchestra.run.smithi008.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 7.7 MB/s | 1.2 MB 00:00 2023-10-06T23:00:01.274 INFO:teuthology.orchestra.run.smithi190.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-10-06T23:00:01.294 INFO:teuthology.orchestra.run.smithi008.stdout:(53/131): python3-google-auth-1.1.1-10.el8.noar 312 kB/s | 81 kB 00:00 2023-10-06T23:00:01.299 INFO:teuthology.orchestra.run.smithi190.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-06T23:00:01.333 INFO:teuthology.orchestra.run.smithi190.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-06T23:00:01.344 INFO:teuthology.orchestra.run.smithi008.stdout:(54/131): python3-more-itertools-7.2.0-3.el8.no 439 kB/s | 59 kB 00:00 2023-10-06T23:00:01.369 INFO:teuthology.orchestra.run.smithi008.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 600 kB/s | 60 kB 00:00 2023-10-06T23:00:01.374 INFO:teuthology.orchestra.run.smithi190.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-10-06T23:00:01.395 INFO:teuthology.orchestra.run.smithi008.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-10-06T23:00:01.408 INFO:teuthology.orchestra.run.smithi190.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 798 kB/s | 27 kB 00:00 2023-10-06T23:00:01.412 INFO:teuthology.orchestra.run.smithi008.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-10-06T23:00:01.437 INFO:teuthology.orchestra.run.smithi008.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 502 kB/s | 34 kB 00:00 2023-10-06T23:00:01.450 INFO:teuthology.orchestra.run.smithi190.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.6 MB/s | 320 kB 00:00 2023-10-06T23:00:01.462 INFO:teuthology.orchestra.run.smithi008.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-10-06T23:00:01.488 INFO:teuthology.orchestra.run.smithi008.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 854 kB/s | 64 kB 00:00 2023-10-06T23:00:01.492 INFO:teuthology.orchestra.run.smithi190.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-06T23:00:01.504 INFO:teuthology.orchestra.run.smithi008.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 278 kB/s | 19 kB 00:00 2023-10-06T23:00:01.534 INFO:teuthology.orchestra.run.smithi008.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 344 kB/s | 24 kB 00:00 2023-10-06T23:00:01.557 INFO:teuthology.orchestra.run.smithi008.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 422 kB/s | 29 kB 00:00 2023-10-06T23:00:01.582 INFO:teuthology.orchestra.run.smithi008.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 355 kB/s | 27 kB 00:00 2023-10-06T23:00:01.608 INFO:teuthology.orchestra.run.smithi008.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-10-06T23:00:01.618 INFO:teuthology.orchestra.run.smithi190.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-10-06T23:00:01.641 INFO:teuthology.orchestra.run.smithi008.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-10-06T23:00:01.667 INFO:teuthology.orchestra.run.smithi008.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-10-06T23:00:01.667 INFO:teuthology.orchestra.run.smithi190.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-10-06T23:00:01.744 INFO:teuthology.orchestra.run.smithi190.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-10-06T23:00:01.768 INFO:teuthology.orchestra.run.smithi190.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.2 MB/s | 225 kB 00:00 2023-10-06T23:00:01.794 INFO:teuthology.orchestra.run.smithi190.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-10-06T23:00:01.819 INFO:teuthology.orchestra.run.smithi190.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-06T23:00:01.825 INFO:teuthology.orchestra.run.smithi008.stdout:(68/131): python3-webob-1.8.5-1.el8.1.noarch.rp 938 kB/s | 251 kB 00:00 2023-10-06T23:00:01.844 INFO:teuthology.orchestra.run.smithi190.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 400 kB/s | 20 kB 00:00 2023-10-06T23:00:01.850 INFO:teuthology.orchestra.run.smithi008.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 110 kB/s | 23 kB 00:00 2023-10-06T23:00:01.867 INFO:teuthology.orchestra.run.smithi008.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-10-06T23:00:01.869 INFO:teuthology.orchestra.run.smithi190.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-06T23:00:01.918 INFO:teuthology.orchestra.run.smithi008.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 701 kB/s | 47 kB 00:00 2023-10-06T23:00:01.919 INFO:teuthology.orchestra.run.smithi190.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-10-06T23:00:01.968 INFO:teuthology.orchestra.run.smithi008.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 5.8 MB/s | 1.7 MB 00:00 2023-10-06T23:00:01.983 INFO:teuthology.orchestra.run.smithi190.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 3.0 MB/s | 198 kB 00:00 2023-10-06T23:00:01.993 INFO:teuthology.orchestra.run.smithi008.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 567 kB/s | 43 kB 00:00 2023-10-06T23:00:02.044 INFO:teuthology.orchestra.run.smithi008.stdout:(74/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-10-06T23:00:02.069 INFO:teuthology.orchestra.run.smithi008.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 721 kB/s | 48 kB 00:00 2023-10-06T23:00:02.094 INFO:teuthology.orchestra.run.smithi008.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-06T23:00:02.119 INFO:teuthology.orchestra.run.smithi008.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2023-10-06T23:00:02.145 INFO:teuthology.orchestra.run.smithi008.stdout:(78/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-10-06T23:00:02.162 INFO:teuthology.orchestra.run.smithi190.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 11 MB/s | 14 MB 00:01 2023-10-06T23:00:02.170 INFO:teuthology.orchestra.run.smithi008.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-10-06T23:00:02.196 INFO:teuthology.orchestra.run.smithi008.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-10-06T23:00:02.212 INFO:teuthology.orchestra.run.smithi190.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-10-06T23:00:02.221 INFO:teuthology.orchestra.run.smithi008.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-10-06T23:00:02.246 INFO:teuthology.orchestra.run.smithi008.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-06T23:00:02.262 INFO:teuthology.orchestra.run.smithi190.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 7.0 MB/s | 354 kB 00:00 2023-10-06T23:00:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-10-06T23:00:02.305 INFO:teuthology.orchestra.run.smithi008.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 307 kB/s | 18 kB 00:00 2023-10-06T23:00:02.339 INFO:teuthology.orchestra.run.smithi008.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.6 MB/s | 559 kB 00:00 2023-10-06T23:00:02.346 INFO:teuthology.orchestra.run.smithi190.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 10 MB/s | 4.9 MB 00:00 2023-10-06T23:00:02.372 INFO:teuthology.orchestra.run.smithi008.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-06T23:00:02.406 INFO:teuthology.orchestra.run.smithi008.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-06T23:00:02.430 INFO:teuthology.orchestra.run.smithi190.stdout:(125/131): postgresql-contrib-10.21-2.module+el 9.5 MB/s | 808 kB 00:00 2023-10-06T23:00:02.431 INFO:teuthology.orchestra.run.smithi008.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-10-06T23:00:02.441 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-10-06T23:00:02.457 INFO:teuthology.orchestra.run.smithi008.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-06T23:00:02.482 INFO:teuthology.orchestra.run.smithi008.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-06T23:00:02.496 INFO:teuthology.orchestra.run.smithi190.stdout:(126/131): openblas-0.3.15-3.el8.x86_64.rpm 9.2 MB/s | 4.7 MB 00:00 2023-10-06T23:00:02.507 INFO:teuthology.orchestra.run.smithi008.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-06T23:00:02.533 INFO:teuthology.orchestra.run.smithi008.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-06T23:00:02.555 INFO:teuthology.orchestra.run.smithi190.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-06T23:00:02.558 INFO:teuthology.orchestra.run.smithi008.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-10-06T23:00:02.576 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-10-06T23:00:02.576 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-10-06T23:00:02.600 INFO:teuthology.orchestra.run.smithi008.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-10-06T23:00:02.625 INFO:teuthology.orchestra.run.smithi008.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-10-06T23:00:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-06T23:00:02.655 INFO:teuthology.orchestra.run.smithi190.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-10-06T23:00:02.693 INFO:teuthology.orchestra.run.smithi008.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-10-06T23:00:02.706 INFO:teuthology.orchestra.run.smithi190.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-06T23:00:02.762 INFO:teuthology.orchestra.run.smithi008.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.5 MB/s | 2.3 MB 00:00 2023-10-06T23:00:02.785 INFO:teuthology.orchestra.run.smithi008.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 589 kB/s | 54 kB 00:00 2023-10-06T23:00:02.819 INFO:teuthology.orchestra.run.smithi008.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-06T23:00:02.852 INFO:teuthology.orchestra.run.smithi008.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-06T23:00:02.877 INFO:teuthology.orchestra.run.smithi008.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-10-06T23:00:02.928 INFO:teuthology.orchestra.run.smithi008.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-10-06T23:00:02.978 INFO:teuthology.orchestra.run.smithi008.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.2 MB/s | 538 kB 00:00 2023-10-06T23:00:03.003 INFO:teuthology.orchestra.run.smithi008.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-10-06T23:00:03.037 INFO:teuthology.orchestra.run.smithi008.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-06T23:00:03.088 INFO:teuthology.orchestra.run.smithi008.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 8.3 MB/s | 713 kB 00:00 2023-10-06T23:00:03.123 INFO:teuthology.orchestra.run.smithi190.stdout:(130/131): librbd1-18.0.0-6616.g14d8d032.el8.x8 6.5 MB/s | 3.7 MB 00:00 2023-10-06T23:00:03.129 INFO:teuthology.orchestra.run.smithi008.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 640 kB/s | 27 kB 00:00 2023-10-06T23:00:03.180 INFO:teuthology.orchestra.run.smithi008.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-06T23:00:03.222 INFO:teuthology.orchestra.run.smithi008.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-06T23:00:03.427 INFO:teuthology.orchestra.run.smithi008.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-10-06T23:00:03.439 INFO:teuthology.orchestra.run.smithi190.stdout:(131/131): librados2-18.0.0-6616.g14d8d032.el8. 4.0 MB/s | 3.7 MB 00:00 2023-10-06T23:00:03.443 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-10-06T23:00:03.443 INFO:teuthology.orchestra.run.smithi190.stdout:Total 9.7 MB/s | 208 MB 00:21 2023-10-06T23:00:03.639 INFO:teuthology.orchestra.run.smithi008.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 2.1 MB/s | 457 kB 00:00 2023-10-06T23:00:03.690 INFO:teuthology.orchestra.run.smithi008.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 4.4 MB/s | 225 kB 00:00 2023-10-06T23:00:03.732 INFO:teuthology.orchestra.run.smithi008.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-10-06T23:00:03.774 INFO:teuthology.orchestra.run.smithi008.stdout:(115/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2023-10-06T23:00:03.842 INFO:teuthology.orchestra.run.smithi008.stdout:(116/131): python3-numpy-1.14.3-10.el8.x86_64.r 6.0 MB/s | 3.7 MB 00:00 2023-10-06T23:00:03.866 INFO:teuthology.orchestra.run.smithi008.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 218 kB/s | 20 kB 00:00 2023-10-06T23:00:03.891 INFO:teuthology.orchestra.run.smithi008.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-06T23:00:03.933 INFO:teuthology.orchestra.run.smithi008.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-06T23:00:04.101 INFO:teuthology.orchestra.run.smithi008.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 9.3 MB/s | 14 MB 00:01 2023-10-06T23:00:04.134 INFO:teuthology.orchestra.run.smithi008.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 988 kB/s | 198 kB 00:00 2023-10-06T23:00:04.196 INFO:teuthology.orchestra.run.smithi008.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.2 MB/s | 202 kB 00:00 2023-10-06T23:00:04.231 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-10-06T23:00:04.236 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-10-06T23:00:04.251 INFO:teuthology.orchestra.run.smithi008.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.3 MB/s | 354 kB 00:00 2023-10-06T23:00:04.377 INFO:teuthology.orchestra.run.smithi008.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 10 MB/s | 4.9 MB 00:00 2023-10-06T23:00:04.577 INFO:teuthology.orchestra.run.smithi008.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-10-06T23:00:04.628 INFO:teuthology.orchestra.run.smithi008.stdout:(126/131): postgresql-contrib-10.21-2.module+el 3.2 MB/s | 808 kB 00:00 2023-10-06T23:00:04.694 INFO:teuthology.orchestra.run.smithi008.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-10-06T23:00:04.770 INFO:teuthology.orchestra.run.smithi008.stdout:(128/131): postgresql-server-10.21-2.module+el8 9.8 MB/s | 5.1 MB 00:00 2023-10-06T23:00:04.828 INFO:teuthology.orchestra.run.smithi008.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-06T23:00:05.076 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-10-06T23:00:05.213 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-10-06T23:00:05.214 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-10-06T23:00:05.337 INFO:teuthology.orchestra.run.smithi008.stdout:(130/131): librados2-18.0.0-6616.g14d8d032.el8. 5.3 MB/s | 3.7 MB 00:00 2023-10-06T23:00:05.395 INFO:teuthology.orchestra.run.smithi008.stdout:(131/131): librbd1-18.0.0-6616.g14d8d032.el8.x8 5.3 MB/s | 3.7 MB 00:00 2023-10-06T23:00:05.398 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-06T23:00:05.398 INFO:teuthology.orchestra.run.smithi008.stdout:Total 9.2 MB/s | 208 MB 00:22 2023-10-06T23:00:06.760 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-10-06T23:00:06.765 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-10-06T23:00:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-06T23:00:07.218 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-06T23:00:07.219 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-06T23:00:09.083 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-10-06T23:00:09.124 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-06T23:00:09.129 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-06T23:00:09.447 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-06T23:00:09.652 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-06T23:00:09.850 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-06T23:00:10.022 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-06T23:00:10.165 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-06T23:00:10.397 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-06T23:00:10.875 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-06T23:00:11.113 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:00:11.587 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:00:11.746 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:00:11.906 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:00:12.105 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-06T23:00:12.115 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-10-06T23:00:12.226 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-06T23:00:12.325 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-06T23:00:12.428 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 9/134 2023-10-06T23:00:12.510 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-06T23:00:12.678 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-06T23:00:12.717 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-06T23:00:12.876 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-06T23:00:12.902 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-06T23:00:13.159 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-06T23:00:13.334 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-06T23:00:13.580 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-06T23:00:13.648 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-06T23:00:13.729 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-06T23:00:13.850 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 5/134 2023-10-06T23:00:13.861 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-06T23:00:14.013 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-06T23:00:14.120 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-06T23:00:14.225 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-06T23:00:14.317 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-06T23:00:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 5/134 2023-10-06T23:00:14.410 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-06T23:00:14.526 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:00:14.597 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-06T23:00:14.679 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:00:14.697 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-06T23:00:14.785 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-06T23:00:14.871 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-06T23:00:14.875 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:00:14.938 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-06T23:00:14.992 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:00:15.135 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-06T23:00:15.156 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-06T23:00:15.382 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-06T23:00:15.571 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-06T23:00:15.639 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-06T23:00:15.676 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-06T23:00:15.821 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-06T23:00:15.869 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 5/134 2023-10-06T23:00:15.898 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-06T23:00:16.322 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-06T23:00:16.350 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 5/134 2023-10-06T23:00:16.502 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-06T23:00:16.526 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:00:16.600 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-06T23:00:16.672 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:00:16.721 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-06T23:00:16.758 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-06T23:00:16.835 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:00:16.887 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-06T23:00:17.058 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-06T23:00:17.085 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:00:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-06T23:00:17.248 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-06T23:00:17.399 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-06T23:00:17.498 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-06T23:00:17.568 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-06T23:00:17.691 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-06T23:00:17.692 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-06T23:00:17.812 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-06T23:00:17.883 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-06T23:00:17.915 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-06T23:00:18.041 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-06T23:00:18.082 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-06T23:00:18.212 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-06T23:00:18.302 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-06T23:00:18.325 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-06T23:00:18.425 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-06T23:00:18.513 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-06T23:00:18.556 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-06T23:00:18.710 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-06T23:00:18.773 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-06T23:00:18.829 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 14/134 2023-10-06T23:00:19.027 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-06T23:00:19.041 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-06T23:00:19.110 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-06T23:00:19.211 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 26/134 2023-10-06T23:00:19.212 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 15/134 2023-10-06T23:00:19.325 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-06T23:00:19.359 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 27/134 2023-10-06T23:00:19.418 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-06T23:00:19.580 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-06T23:00:19.794 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-06T23:00:19.918 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-06T23:00:19.992 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-06T23:00:20.090 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-06T23:00:20.166 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-06T23:00:20.235 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-06T23:00:20.399 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 28/134 2023-10-06T23:00:20.759 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-06T23:00:20.982 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-06T23:00:20.999 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-06T23:00:21.036 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-06T23:00:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-06T23:00:21.264 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-06T23:00:21.341 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-06T23:00:21.510 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-06T23:00:21.570 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-06T23:00:21.804 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-06T23:00:21.904 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-06T23:00:21.965 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 26/134 2023-10-06T23:00:22.067 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-06T23:00:22.113 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 27/134 2023-10-06T23:00:22.361 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 28/134 2023-10-06T23:00:22.591 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-06T23:00:22.981 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-06T23:00:23.276 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-06T23:00:23.594 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-06T23:00:23.675 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-06T23:00:23.853 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-06T23:00:24.036 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-06T23:00:24.076 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 26/134 2023-10-06T23:00:24.225 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 27/134 2023-10-06T23:00:24.274 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-06T23:00:24.462 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 28/134 2023-10-06T23:00:24.476 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-06T23:00:24.643 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-06T23:00:24.694 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 36/134 2023-10-06T23:00:24.700 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-06T23:00:24.949 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 37/134 2023-10-06T23:00:25.112 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-06T23:00:25.298 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-06T23:00:25.531 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-06T23:00:25.709 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-06T23:00:25.779 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-06T23:00:25.985 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-06T23:00:26.162 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-06T23:00:26.201 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-06T23:00:26.439 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-06T23:00:26.611 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-06T23:00:26.703 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-06T23:00:26.893 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-06T23:00:26.942 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-06T23:00:26.945 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-06T23:00:27.084 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-06T23:00:27.135 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-06T23:00:27.331 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 36/134 2023-10-06T23:00:27.338 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-06T23:00:27.565 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 37/134 2023-10-06T23:00:27.613 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-06T23:00:27.766 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-06T23:00:27.933 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-06T23:00:27.995 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-06T23:00:28.141 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-06T23:00:28.156 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-06T23:00:28.229 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-06T23:00:28.250 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-06T23:00:28.414 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-06T23:00:28.499 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-06T23:00:28.501 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-06T23:00:28.638 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-06T23:00:28.746 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-06T23:00:28.763 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-06T23:00:28.827 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-06T23:00:28.907 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-06T23:00:29.036 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-06T23:00:29.041 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-06T23:00:29.157 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-06T23:00:29.271 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-06T23:00:29.376 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-06T23:00:29.385 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-06T23:00:29.462 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-06T23:00:29.611 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-06T23:00:29.615 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-06T23:00:29.690 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-06T23:00:29.784 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 36/134 2023-10-06T23:00:29.785 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-06T23:00:29.976 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-06T23:00:29.993 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 37/134 2023-10-06T23:00:30.018 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-06T23:00:30.135 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-06T23:00:30.170 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-06T23:00:30.260 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-06T23:00:30.314 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-06T23:00:30.419 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-06T23:00:30.461 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-06T23:00:30.475 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-06T23:00:30.574 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-06T23:00:30.619 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-06T23:00:30.674 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-06T23:00:30.820 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-06T23:00:30.877 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-06T23:00:30.970 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-06T23:00:31.049 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-06T23:00:31.056 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-06T23:00:31.191 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-06T23:00:31.216 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-06T23:00:31.277 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-06T23:00:31.380 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-06T23:00:31.466 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-06T23:00:31.506 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-06T23:00:31.610 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-06T23:00:31.638 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-06T23:00:31.705 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-06T23:00:31.706 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-06T23:00:31.835 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-06T23:00:31.876 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-06T23:00:31.940 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-06T23:00:31.988 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-06T23:00:32.121 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-06T23:00:32.144 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-06T23:00:32.149 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-06T23:00:32.291 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-06T23:00:32.303 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-06T23:00:32.488 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-06T23:00:32.501 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-06T23:00:32.545 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-06T23:00:32.716 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-06T23:00:32.753 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-06T23:00:32.809 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-06T23:00:32.937 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-06T23:00:33.010 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-06T23:00:33.182 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-06T23:00:33.190 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-06T23:00:33.331 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-06T23:00:33.345 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-06T23:00:33.422 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-06T23:00:33.549 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-06T23:00:33.586 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-06T23:00:33.634 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-06T23:00:33.758 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-06T23:00:33.867 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-06T23:00:33.956 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-06T23:00:33.982 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-06T23:00:34.109 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-06T23:00:34.171 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-06T23:00:34.208 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-06T23:00:34.341 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-06T23:00:34.471 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-06T23:00:34.581 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-06T23:00:34.589 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-06T23:00:34.784 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-06T23:00:34.882 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-06T23:00:34.925 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-06T23:00:34.940 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-06T23:00:35.108 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-06T23:00:35.128 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-06T23:00:35.166 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-06T23:00:35.362 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-06T23:00:35.380 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-06T23:00:35.445 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-06T23:00:35.571 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-06T23:00:35.619 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-06T23:00:35.714 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-06T23:00:35.758 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-06T23:00:35.802 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-06T23:00:35.869 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-06T23:00:35.948 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-06T23:00:36.040 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-06T23:00:36.060 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-06T23:00:36.271 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-06T23:00:36.278 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-06T23:00:36.515 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-06T23:00:36.615 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-06T23:00:36.713 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-06T23:00:36.887 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-06T23:00:36.926 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-06T23:00:37.088 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-06T23:00:37.120 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-06T23:00:37.327 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-06T23:00:37.339 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-06T23:00:37.417 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-06T23:00:37.527 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-06T23:00:37.561 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-06T23:00:37.762 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-06T23:00:37.788 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-06T23:00:37.817 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-06T23:00:38.048 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-06T23:00:38.070 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-06T23:00:38.075 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-06T23:00:38.246 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-06T23:00:38.298 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-06T23:00:38.409 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-06T23:00:38.422 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-06T23:00:38.475 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-06T23:00:38.620 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-06T23:00:38.731 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-06T23:00:38.758 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-06T23:00:38.854 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-06T23:00:38.986 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-06T23:00:39.052 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-06T23:00:39.287 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-06T23:00:39.466 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-06T23:00:39.706 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-06T23:00:39.862 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-06T23:00:39.949 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-06T23:00:40.108 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-06T23:00:40.184 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-06T23:00:40.190 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-06T23:00:40.276 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-06T23:00:40.417 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-06T23:00:40.459 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 93/134 2023-10-06T23:00:40.476 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-06T23:00:40.702 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-06T23:00:40.709 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-06T23:00:40.929 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-06T23:00:41.069 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-06T23:00:41.165 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-06T23:00:41.349 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-06T23:00:41.591 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-06T23:00:42.486 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-06T23:00:42.605 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-06T23:00:42.662 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-06T23:00:42.755 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-06T23:00:42.889 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-06T23:00:42.980 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 93/134 2023-10-06T23:00:43.199 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-06T23:00:43.562 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-06T23:00:43.863 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-06T23:00:44.070 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-06T23:00:44.976 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-06T23:00:45.190 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-06T23:00:45.286 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 92/134 2023-10-06T23:00:45.465 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 93/134 2023-10-06T23:00:45.469 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:46.150 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:46.853 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:47.134 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-06T23:00:47.294 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-06T23:00:47.474 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-06T23:00:48.419 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:48.679 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:49.373 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:49.692 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-06T23:00:49.850 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-06T23:00:50.045 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-06T23:00:50.745 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:50.931 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:51.667 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 94/134 2023-10-06T23:00:51.959 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-06T23:00:52.110 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 95/134 2023-10-06T23:00:52.247 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-06T23:01:08.116 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /run 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-10-06T23:01:08.117 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T23:01:08.530 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-06T23:01:10.307 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-06T23:01:10.505 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-06T23:01:10.737 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /run 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2023-10-06T23:01:10.738 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T23:01:10.778 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-06T23:01:10.996 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-06T23:01:11.168 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-06T23:01:11.529 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-06T23:01:11.738 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-06T23:01:11.780 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-06T23:01:12.914 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-06T23:01:13.113 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-06T23:01:13.382 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-06T23:01:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 96/134 2023-10-06T23:01:13.521 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-10-06T23:01:13.521 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-10-06T23:01:13.521 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-06T23:01:13.521 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-10-06T23:01:13.521 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-10-06T23:01:13.521 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-10-06T23:01:13.521 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-10-06T23:01:13.522 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-10-06T23:01:13.522 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-06T23:01:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:01:13.584 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-06T23:01:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-06T23:01:14.110 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-06T23:01:14.317 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-06T23:01:14.358 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-06T23:01:14.543 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-06T23:01:14.733 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-06T23:01:14.853 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 102/134 2023-10-06T23:01:15.044 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 103/134 2023-10-06T23:01:15.245 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-06T23:01:15.521 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-06T23:01:15.788 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-06T23:01:15.789 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 97/134 2023-10-06T23:01:15.981 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-06T23:01:16.267 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 98/134 2023-10-06T23:01:16.437 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-06T23:01:16.906 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-06T23:01:16.998 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 99/134 2023-10-06T23:01:17.128 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-06T23:01:17.136 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-06T23:01:17.186 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-06T23:01:17.229 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 100/134 2023-10-06T23:01:17.266 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-06T23:01:17.290 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-06T23:01:17.416 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 102/134 2023-10-06T23:01:17.631 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 103/134 2023-10-06T23:01:17.663 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 107/134 2023-10-06T23:01:17.816 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-06T23:01:17.912 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-06T23:01:17.978 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-06T23:01:18.087 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-06T23:01:18.194 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-06T23:01:18.224 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-06T23:01:18.370 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-06T23:01:19.480 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-06T23:01:19.681 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 110/134 2023-10-06T23:01:19.707 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-06T23:01:19.834 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-06T23:01:19.898 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-06T23:01:19.960 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-06T23:01:20.095 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-06T23:01:20.128 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-06T23:01:20.206 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-06T23:01:20.246 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 107/134 2023-10-06T23:01:20.267 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 101/134 2023-10-06T23:01:20.386 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-06T23:01:20.394 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 102/134 2023-10-06T23:01:20.483 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-06T23:01:20.549 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-06T23:01:20.619 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 103/134 2023-10-06T23:01:20.740 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-06T23:01:20.768 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-06T23:01:20.794 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-06T23:01:20.817 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-06T23:01:21.003 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-06T23:01:21.078 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 104/134 2023-10-06T23:01:21.338 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-06T23:01:22.220 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 110/134 2023-10-06T23:01:22.408 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-06T23:01:22.474 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-06T23:01:22.532 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 105/134 2023-10-06T23:01:22.657 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-06T23:01:22.739 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-06T23:01:22.743 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-06T23:01:22.883 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 106/134 2023-10-06T23:01:22.907 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-06T23:01:23.265 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 107/134 2023-10-06T23:01:23.329 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-06T23:01:23.494 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-06T23:01:23.507 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-06T23:01:23.561 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 108/134 2023-10-06T23:01:23.751 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-06T23:01:23.781 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 109/134 2023-10-06T23:01:25.314 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 110/134 2023-10-06T23:01:25.546 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-06T23:01:25.610 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 111/134 2023-10-06T23:01:25.751 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-06T23:01:25.838 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 112/134 2023-10-06T23:01:26.002 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-06T23:01:26.174 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-06T23:01:26.453 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 113/134 2023-10-06T23:01:26.506 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 115/134 2023-10-06T23:01:26.594 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-06T23:01:26.693 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-06T23:01:26.957 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-06T23:01:28.204 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-06T23:01:28.547 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-06T23:01:28.608 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-06T23:01:28.765 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 119/134 2023-10-06T23:01:28.956 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-06T23:01:29.173 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 121/134 2023-10-06T23:01:29.336 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-06T23:01:29.844 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 115/134 2023-10-06T23:01:30.175 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-06T23:01:30.403 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 117/134 2023-10-06T23:01:30.675 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-06T23:01:30.839 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-06T23:01:31.094 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-06T23:01:31.336 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-06T23:01:31.502 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 121/134 2023-10-06T23:01:31.673 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-06T23:01:32.073 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 114/134 2023-10-06T23:01:32.758 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:33.034 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:33.072 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:33.327 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 124/134 2023-10-06T23:01:33.398 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 115/134 2023-10-06T23:01:33.535 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 125/134 2023-10-06T23:01:33.733 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-06T23:01:33.875 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 126/134 2023-10-06T23:01:33.933 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 117/134 2023-10-06T23:01:34.217 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-06T23:01:34.219 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-06T23:01:34.392 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-06T23:01:34.433 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-06T23:01:34.457 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-06T23:01:34.669 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-06T23:01:34.672 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-06T23:01:34.875 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-06T23:01:34.939 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-06T23:01:34.989 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-06T23:01:35.128 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:35.131 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 121/134 2023-10-06T23:01:35.225 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-06T23:01:35.254 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-06T23:01:35.254 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:35.285 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-06T23:01:35.430 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:35.468 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:35.473 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:35.473 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-06T23:01:35.664 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 124/134 2023-10-06T23:01:35.748 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-06T23:01:35.906 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 125/134 2023-10-06T23:01:35.942 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:36.205 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:36.205 INFO:teuthology.orchestra.run.smithi156.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T23:01:36.205 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T23:01:36.238 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 126/134 2023-10-06T23:01:36.596 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-06T23:01:36.819 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 1/134 2023-10-06T23:01:36.819 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2/134 2023-10-06T23:01:36.819 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 3/134 2023-10-06T23:01:36.819 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 4/134 2023-10-06T23:01:36.819 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 5/134 2023-10-06T23:01:36.819 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:01:36.819 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:01:36.819 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 9/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 10/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 11/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 12/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 13/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 14/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 15/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 16/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 17/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 18/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 19/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 20/134 2023-10-06T23:01:36.820 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 21/134 2023-10-06T23:01:36.821 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 22/134 2023-10-06T23:01:36.821 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 23/134 2023-10-06T23:01:36.821 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 24/134 2023-10-06T23:01:36.821 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 25/134 2023-10-06T23:01:36.821 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 26/134 2023-10-06T23:01:36.821 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 27/134 2023-10-06T23:01:36.821 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 28/134 2023-10-06T23:01:36.821 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 29/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 30/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 31/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 32/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 33/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 34/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 35/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 36/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 37/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 38/134 2023-10-06T23:01:36.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-06T23:01:36.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-06T23:01:36.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-06T23:01:36.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-06T23:01:36.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-06T23:01:36.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-06T23:01:36.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-06T23:01:36.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-06T23:01:36.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-06T23:01:36.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-06T23:01:36.835 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-06T23:01:36.836 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-06T23:01:36.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-06T23:01:36.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-06T23:01:36.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-06T23:01:36.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-06T23:01:36.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-06T23:01:36.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-06T23:01:36.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-06T23:01:36.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 129/134 2023-10-06T23:01:36.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-06T23:01:36.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 131/134 2023-10-06T23:01:36.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:36.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-06T23:01:36.846 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-06T23:01:36.958 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-06T23:01:37.196 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-06T23:01:37.224 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-06T23:01:37.404 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-06T23:01:37.426 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-06T23:01:37.616 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-06T23:01:37.616 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:37.802 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:37.803 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-06T23:01:38.086 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-06T23:01:38.296 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:38.601 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:38.601 INFO:teuthology.orchestra.run.smithi190.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T23:01:38.602 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T23:01:38.864 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:39.167 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:39.206 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-06T23:01:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 1/134 2023-10-06T23:01:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2/134 2023-10-06T23:01:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 3/134 2023-10-06T23:01:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 4/134 2023-10-06T23:01:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 5/134 2023-10-06T23:01:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:01:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:01:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-06T23:01:39.228 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 9/134 2023-10-06T23:01:39.228 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 10/134 2023-10-06T23:01:39.228 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 11/134 2023-10-06T23:01:39.228 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 12/134 2023-10-06T23:01:39.228 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 13/134 2023-10-06T23:01:39.228 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 14/134 2023-10-06T23:01:39.228 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 15/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 16/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 17/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 18/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 19/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 20/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 21/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 22/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 23/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 24/134 2023-10-06T23:01:39.229 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 25/134 2023-10-06T23:01:39.230 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 26/134 2023-10-06T23:01:39.230 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 27/134 2023-10-06T23:01:39.239 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 28/134 2023-10-06T23:01:39.239 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 29/134 2023-10-06T23:01:39.239 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 30/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 31/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 32/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 33/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 34/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 35/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 36/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 37/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 38/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-06T23:01:39.240 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-06T23:01:39.241 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-06T23:01:39.242 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-06T23:01:39.243 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-06T23:01:39.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-06T23:01:39.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-06T23:01:39.246 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-06T23:01:39.247 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-06T23:01:39.248 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-06T23:01:39.249 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-06T23:01:39.249 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-06T23:01:39.249 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-06T23:01:39.249 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 129/134 2023-10-06T23:01:39.249 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-06T23:01:39.249 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 131/134 2023-10-06T23:01:39.249 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:39.249 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-06T23:01:39.418 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 124/134 2023-10-06T23:01:39.497 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:39.497 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:10 ago on Fri 06 Oct 2023 10:59:29 PM UTC. 2023-10-06T23:01:39.610 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 125/134 2023-10-06T23:01:39.954 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 126/134 2023-10-06T23:01:40.276 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-06T23:01:40.474 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-06T23:01:40.584 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-06T23:01:40.766 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-06T23:01:40.794 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-06T23:01:40.966 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-06T23:01:40.989 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-06T23:01:41.170 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-06T23:01:41.170 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:41.381 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:41.381 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-06T23:01:41.674 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-06T23:01:41.900 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:42.059 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:42.059 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:13 ago on Fri 06 Oct 2023 10:59:29 PM UTC. 2023-10-06T23:01:42.172 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:42.172 INFO:teuthology.orchestra.run.smithi008.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T23:01:42.172 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:01:42.813 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 1/134 2023-10-06T23:01:42.813 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2/134 2023-10-06T23:01:42.813 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 3/134 2023-10-06T23:01:42.813 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 4/134 2023-10-06T23:01:42.813 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6616.g14d8d 5/134 2023-10-06T23:01:42.813 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 6/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 7/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 8/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 9/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 10/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 11/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 12/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 13/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_ 14/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 15/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 16/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_6 17/134 2023-10-06T23:01:42.814 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86 18/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 19/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el 20/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:18.0.0-6616.g14d8d032.el8. 21/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_6 22/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 23/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 24/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 25/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 26/134 2023-10-06T23:01:42.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 27/134 2023-10-06T23:01:42.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 28/134 2023-10-06T23:01:42.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032. 29/134 2023-10-06T23:01:42.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noa 30/134 2023-10-06T23:01:42.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.n 31/134 2023-10-06T23:01:42.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d 32/134 2023-10-06T23:01:42.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el 33/134 2023-10-06T23:01:42.824 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 34/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.e 35/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 36/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 37/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 38/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-06T23:01:42.825 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-06T23:01:42.826 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-06T23:01:42.827 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-06T23:01:42.828 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-06T23:01:42.829 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-06T23:01:42.830 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-06T23:01:42.831 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 129/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 131/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-06T23:01:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-06T23:01:45.541 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-06T23:01:45.541 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:16 ago on Fri 06 Oct 2023 10:59:29 PM UTC. 2023-10-06T23:01:48.245 INFO:teuthology.orchestra.run.smithi156.stdout:Installed products updated. 2023-10-06T23:01:48.341 INFO:teuthology.orchestra.run.smithi190.stdout:Installed products updated. 2023-10-06T23:01:48.471 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T23:01:48.471 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2023-10-06T23:01:48.471 INFO:teuthology.orchestra.run.smithi156.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-06T23:01:48.471 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.471 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.472 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.473 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-3.el8.x86_64 2023-10-06T23:01:48.474 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: libpq-13.5-1.el8.x86_64 2023-10-06T23:01:48.475 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T23:01:48.476 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T23:01:48.477 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.478 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T23:01:48.479 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T23:01:48.480 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.481 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T23:01:48.482 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.483 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T23:01:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T23:01:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-06T23:01:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-06T23:01:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T23:01:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-06T23:01:48.484 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-06T23:01:48.484 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T23:01:48.564 INFO:teuthology.orchestra.run.smithi190.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.565 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: jq-1.6-3.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T23:01:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: libpq-13.5-1.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.568 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-06T23:01:48.569 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T23:01:48.570 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T23:01:48.571 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T23:01:48.572 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T23:01:48.573 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T23:01:48.574 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T23:01:48.575 INFO:teuthology.orchestra.run.smithi190.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-06T23:01:48.576 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-06T23:01:48.576 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T23:01:48.576 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-06T23:01:48.576 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T23:01:48.576 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-10-06T23:01:48.781 DEBUG:teuthology.parallel:result is None 2023-10-06T23:01:48.889 DEBUG:teuthology.parallel:result is None 2023-10-06T23:01:55.147 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-06T23:01:55.387 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:01:55.387 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.388 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.389 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:18.0.0-6616.g14d8d032.el8.noarch 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-3.el8.x86_64 2023-10-06T23:01:55.390 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: libpq-13.5-1.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T23:01:55.391 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-06T23:01:55.392 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T23:01:55.393 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T23:01:55.394 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T23:01:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T23:01:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T23:01:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:18.0.0-6616.g14d8d032.el8.x86_64 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-06T23:01:55.398 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T23:01:55.399 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-06T23:01:55.399 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:01:55.399 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-06T23:01:55.699 DEBUG:teuthology.parallel:result is None 2023-10-06T23:01:55.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:01:55.939 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T23:01:55.993 INFO:teuthology.orchestra.run.smithi008.stdout:18.0.0-6616.g14d8d032.el8 2023-10-06T23:01:55.994 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6616.g14d8d032.el8 2023-10-06T23:01:55.994 INFO:teuthology.task.install:The correct ceph version 18.0.0-6616.g14d8d032 is installed. 2023-10-06T23:01:55.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:01:56.135 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T23:01:56.197 INFO:teuthology.orchestra.run.smithi156.stdout:18.0.0-6616.g14d8d032.el8 2023-10-06T23:01:56.198 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6616.g14d8d032.el8 2023-10-06T23:01:56.198 INFO:teuthology.task.install:The correct ceph version 18.0.0-6616.g14d8d032 is installed. 2023-10-06T23:01:56.198 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:01:56.337 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T23:01:56.397 INFO:teuthology.orchestra.run.smithi190.stdout:18.0.0-6616.g14d8d032.el8 2023-10-06T23:01:56.397 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6616.g14d8d032.el8 2023-10-06T23:01:56.397 INFO:teuthology.task.install:The correct ceph version 18.0.0-6616.g14d8d032 is installed. 2023-10-06T23:01:56.398 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T23:01:56.398 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:01:56.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T23:01:56.489 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:01:56.489 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T23:01:56.586 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:01:56.587 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T23:01:56.681 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T23:01:56.682 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:01:56.682 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T23:01:56.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T23:01:56.859 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:01:56.859 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T23:01:56.931 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T23:01:57.039 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:01:57.039 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T23:01:57.110 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T23:01:57.219 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T23:01:57.219 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:01:57.219 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T23:01:57.289 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T23:01:57.397 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:01:57.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T23:01:57.465 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T23:01:57.572 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:01:57.573 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T23:01:57.639 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T23:01:57.746 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T23:01:57.747 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:01:57.747 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T23:01:57.816 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T23:01:57.924 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:01:57.924 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T23:01:57.992 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T23:01:58.099 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:01:58.100 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T23:01:58.167 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T23:01:58.273 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-06T23:01:58.357 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_client_delegate_inos_pct': 50, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c'} 2023-10-06T23:01:58.357 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:01:58.357 INFO:tasks.cephadm:Cluster fsid is 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:01:58.357 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-06T23:01:58.358 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.8', 'mon.b': '172.21.15.156', 'mon.c': '172.21.15.190'} 2023-10-06T23:01:58.358 INFO:tasks.cephadm:First mon is mon.a on smithi008 2023-10-06T23:01:58.358 INFO:tasks.cephadm:First mgr is x 2023-10-06T23:01:58.358 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-06T23:01:58.358 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname $(hostname -s) 2023-10-06T23:01:58.433 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname $(hostname -s) 2023-10-06T23:01:58.505 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname $(hostname -s) 2023-10-06T23:01:58.573 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-06T23:01:58.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:01:58.708 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '14d8d032507701c76ca224e769ee65a96b660a8c', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73047/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6616-g14d8d032', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6616.g14d8d032'}, 'url': 'https://1.chacra.ceph.com/r/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-06 10:46:00.441906', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-cephfs-mon', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-06T23:01:58.846 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref rishabh-cephfs-mon, sha1 14d8d032507701c76ca224e769ee65a96b660a8c from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=14d8d032507701c76ca224e769ee65a96b660a8c 2023-10-06T23:01:58.846 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/x86_64/flavors/default/cephadm 2023-10-06T23:01:58.929 DEBUG:teuthology.orchestra.run.smithi008:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:01.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 6 23:02 /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:01.443 DEBUG:teuthology.orchestra.run.smithi156:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:02.168 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 6 23:02 /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:02.168 DEBUG:teuthology.orchestra.run.smithi190:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/rishabh-cephfs-mon/14d8d032507701c76ca224e769ee65a96b660a8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:03.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 6 23:02 /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:03.251 DEBUG:teuthology.orchestra.run.smithi008:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:03.302 DEBUG:teuthology.orchestra.run.smithi156:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:03.353 DEBUG:teuthology.orchestra.run.smithi190:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-06T23:02:03.417 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c on all hosts... 2023-10-06T23:02:03.417 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c pull 2023-10-06T23:02:03.422 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c pull 2023-10-06T23:02:03.426 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c pull 2023-10-06T23:02:05.353 INFO:teuthology.orchestra.run.smithi156.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-06T23:02:05.431 INFO:teuthology.orchestra.run.smithi190.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-06T23:02:06.859 INFO:teuthology.orchestra.run.smithi008.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-06T23:02:34.214 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-10-06T23:02:34.214 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_version": "ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev)", 2023-10-06T23:02:34.214 INFO:teuthology.orchestra.run.smithi156.stdout: "image_id": "c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14", 2023-10-06T23:02:34.214 INFO:teuthology.orchestra.run.smithi156.stdout: "repo_digests": [ 2023-10-06T23:02:34.214 INFO:teuthology.orchestra.run.smithi156.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:80f40c42893bd196d52fcd70174d853855d3acb22cdc6bd7eee5f6d87be734f7" 2023-10-06T23:02:34.215 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-10-06T23:02:34.215 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-10-06T23:02:38.634 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:02:38.634 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev)", 2023-10-06T23:02:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "image_id": "c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14", 2023-10-06T23:02:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "repo_digests": [ 2023-10-06T23:02:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:80f40c42893bd196d52fcd70174d853855d3acb22cdc6bd7eee5f6d87be734f7" 2023-10-06T23:02:38.635 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:02:38.635 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:02:40.026 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-10-06T23:02:40.026 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev)", 2023-10-06T23:02:40.026 INFO:teuthology.orchestra.run.smithi190.stdout: "image_id": "c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14", 2023-10-06T23:02:40.026 INFO:teuthology.orchestra.run.smithi190.stdout: "repo_digests": [ 2023-10-06T23:02:40.026 INFO:teuthology.orchestra.run.smithi190.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:80f40c42893bd196d52fcd70174d853855d3acb22cdc6bd7eee5f6d87be734f7" 2023-10-06T23:02:40.027 INFO:teuthology.orchestra.run.smithi190.stdout: ] 2023-10-06T23:02:40.027 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-10-06T23:02:40.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph 2023-10-06T23:02:40.131 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph 2023-10-06T23:02:40.211 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph 2023-10-06T23:02:40.284 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /etc/ceph 2023-10-06T23:02:40.357 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /etc/ceph 2023-10-06T23:02:40.428 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /etc/ceph 2023-10-06T23:02:40.496 INFO:tasks.cephadm:Writing seed config... 2023-10-06T23:02:40.497 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-10-06T23:02:40.497 INFO:tasks.cephadm: override: [client] debug client = 20 2023-10-06T23:02:40.497 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-10-06T23:02:40.497 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-10-06T23:02:40.497 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-10-06T23:02:40.497 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-06T23:02:40.498 INFO:tasks.cephadm: override: [mds] mds_client_delegate_inos_pct = 50 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-10-06T23:02:40.499 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-06T23:02:40.500 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-10-06T23:02:40.501 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:02:40.501 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-06T23:02:40.545 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5a0d88f6-649c-11ee-8db5-212e2dc638e7 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_client_delegate_inos_pct = 50 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-10-06T23:02:40.546 DEBUG:teuthology.orchestra.run.smithi008:mon.a> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-06T23:02:40.591 DEBUG:teuthology.orchestra.run.smithi008:mgr.x> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-06T23:02:40.636 INFO:tasks.cephadm:Bootstrapping... 2023-10-06T23:02:40.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c -v bootstrap --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.8 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:02:40.660 INFO:journalctl@ceph.mon.a.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:02:40.705 INFO:journalctl@ceph.mgr.x.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:02:40.875 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-06T23:02:40.876 INFO:teuthology.orchestra.run.smithi008.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c', '-v', 'bootstrap', '--fsid', '5a0d88f6-649c-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.8', '--skip-admin-label'] 2023-10-06T23:02:41.048 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-10-06T23:02:41.049 INFO:teuthology.orchestra.run.smithi008.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-06T23:02:41.049 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying podman|docker is present... 2023-10-06T23:02:41.221 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-10-06T23:02:41.221 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying lvm2 is present... 2023-10-06T23:02:41.221 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying time synchronization is in place... 2023-10-06T23:02:41.235 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-06T23:02:41.235 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-06T23:02:41.249 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-06T23:02:41.249 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-06T23:02:41.262 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2023-10-06T23:02:41.275 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2023-10-06T23:02:41.276 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2023-10-06T23:02:41.276 INFO:teuthology.orchestra.run.smithi008.stdout:Repeating the final host check... 2023-10-06T23:02:41.446 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-10-06T23:02:41.446 INFO:teuthology.orchestra.run.smithi008.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-06T23:02:41.446 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl is present 2023-10-06T23:02:41.446 INFO:teuthology.orchestra.run.smithi008.stdout:lvcreate is present 2023-10-06T23:02:41.459 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-06T23:02:41.459 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-06T23:02:41.472 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-06T23:02:41.472 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-06T23:02:41.486 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2023-10-06T23:02:41.499 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2023-10-06T23:02:41.499 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2023-10-06T23:02:41.499 INFO:teuthology.orchestra.run.smithi008.stdout:Host looks OK 2023-10-06T23:02:41.499 INFO:teuthology.orchestra.run.smithi008.stdout:Cluster fsid: 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:02:41.500 INFO:teuthology.orchestra.run.smithi008.stdout:Acquiring lock 140555737508328 on /run/cephadm/5a0d88f6-649c-11ee-8db5-212e2dc638e7.lock 2023-10-06T23:02:41.500 INFO:teuthology.orchestra.run.smithi008.stdout:Lock 140555737508328 acquired on /run/cephadm/5a0d88f6-649c-11ee-8db5-212e2dc638e7.lock 2023-10-06T23:02:41.500 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 3300 ... 2023-10-06T23:02:41.500 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 6789 ... 2023-10-06T23:02:41.501 INFO:teuthology.orchestra.run.smithi008.stdout:Base mon IP(s) is [172.21.15.8:3300, 172.21.15.8:6789], mon addrv is [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-10-06T23:02:41.509 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-06T23:02:41.509 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.8 metric 100 2023-10-06T23:02:41.516 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-06T23:02:41.516 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-06T23:02:41.516 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2023-10-06T23:02:41.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-06T23:02:41.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-06T23:02:41.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-06T23:02:41.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-06T23:02:41.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-06T23:02:41.523 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-06T23:02:41.524 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2023-10-06T23:02:41.524 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2023-10-06T23:02:41.524 INFO:teuthology.orchestra.run.smithi008.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-06T23:02:41.525 INFO:teuthology.orchestra.run.smithi008.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-06T23:02:41.526 INFO:teuthology.orchestra.run.smithi008.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-06T23:02:42.000 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14 2023-10-06T23:02:42.000 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c... 2023-10-06T23:02:42.000 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Getting image source signatures 2023-10-06T23:02:42.000 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:a951a90ba2bd822dba777faf493a1625bb5a2f5c5042f0fdc315d633d2c600c8 2023-10-06T23:02:42.001 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-06T23:02:42.001 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying config sha256:c754feb42fd5218bf53a2fe4f07ffd844c4388a7db5210910b097caa02dbfd14 2023-10-06T23:02:42.001 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-06T23:02:42.001 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Storing signatures 2023-10-06T23:02:42.978 INFO:teuthology.orchestra.run.smithi008.stdout:ceph: stdout ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev) 2023-10-06T23:02:42.978 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph version: ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev) 2023-10-06T23:02:42.978 INFO:teuthology.orchestra.run.smithi008.stdout:Extracting ceph user uid/gid from container image... 2023-10-06T23:02:43.757 INFO:teuthology.orchestra.run.smithi008.stdout:stat: stdout 167 167 2023-10-06T23:02:43.757 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial keys... 2023-10-06T23:02:44.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQAUkiBly+cgChAAABhpCf9u0AWv5AB7QZDsyQ== 2023-10-06T23:02:45.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQAVkiBly/EqExAAF8WS58YPoZ12b/48gYSm5w== 2023-10-06T23:02:46.587 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQAWkiBlX58gBxAAZ/+CWhkYtz4Rs2uTe8uvww== 2023-10-06T23:02:46.588 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial monmap... 2023-10-06T23:02:47.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-06T23:02:47.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-06T23:02:47.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:02:47.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-06T23:02:47.363 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool for a [v2:172.21.15.8:3300,v1:172.21.15.8:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-06T23:02:47.363 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = pacific 2023-10-06T23:02:47.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: set fsid to 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:02:47.364 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-06T23:02:47.364 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:02:47.364 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mon... 2023-10-06T23:02:48.242 INFO:teuthology.orchestra.run.smithi008.stdout:create mon.a on 2023-10-06T23:02:48.496 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-06T23:02:48.700 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-06T23:02:48.940 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7.target. 2023-10-06T23:02:48.941 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7.target. 2023-10-06T23:02:49.318 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.a 2023-10-06T23:02:49.318 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-06T23:02:49.525 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7.target.wants/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@.service. 2023-10-06T23:02:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:49 smithi008 systemd[1]: Starting Ceph mon.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:02:51.436 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:51 smithi008 podman[97988]: 2023-10-06T23:02:51.436 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:51 smithi008 bash[97988]: 2f4a47e3fe924364a05be0374e94135a89b80a76f99da41cc71c72e62edcbead 2023-10-06T23:02:51.461 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-06T23:02:51.461 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-10-06T23:02:51.478 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-06T23:02:51.478 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-06T23:02:51.478 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-10-06T23:02:51.479 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2023-10-06T23:02:51.479 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon to start... 2023-10-06T23:02:51.479 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon... 2023-10-06T23:02:51.771 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:51 smithi008 systemd[1]: Started Ceph mon.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:02:51.771 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:51 smithi008 ceph-mon[98028]: mkfs 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:02:51.771 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:51 smithi008 ceph-mon[98028]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-06T23:02:52.663 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout cluster: 2023-10-06T23:02:52.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout id: 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:02:52.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-06T23:02:52.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:02:52.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout services: 2023-10-06T23:02:52.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.669362s) 2023-10-06T23:02:52.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-06T23:02:52.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-06T23:02:52.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout data: 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pgs: 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.036+0000 7f6839669700 1 Processor -- start 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.036+0000 7f6839669700 1 -- start start 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.036+0000 7f6839669700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683407a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.036+0000 7f6839669700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683407a870 con 0x7f683407be40 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.036+0000 7f6832ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683407a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:02:52.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.036+0000 7f6832ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683407a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44864/0 (socket says 172.21.15.8:44864) 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.036+0000 7f6832ffd700 1 -- 172.21.15.8:0/958401742 learned_addr learned my addr 172.21.15.8:0/958401742 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.037+0000 7f6832ffd700 1 -- 172.21.15.8:0/958401742 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683407a9b0 con 0x7f683407be40 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.037+0000 7f6832ffd700 1 --2- 172.21.15.8:0/958401742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683407a2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f68240098a0 tx=0x7f6824009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db8fc7a40ac0b0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.037+0000 7f6831ffb700 1 -- 172.21.15.8:0/958401742 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6824004160 con 0x7f683407be40 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.037+0000 7f6831ffb700 1 -- 172.21.15.8:0/958401742 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68240042c0 con 0x7f683407be40 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.037+0000 7f6831ffb700 1 -- 172.21.15.8:0/958401742 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68240045a0 con 0x7f683407be40 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.038+0000 7f6839669700 1 -- 172.21.15.8:0/958401742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 msgr2=0x7f683407a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.038+0000 7f6839669700 1 --2- 172.21.15.8:0/958401742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683407a2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f68240098a0 tx=0x7f6824009bb0 comp rx=0 tx=0).stop 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.038+0000 7f6839669700 1 -- 172.21.15.8:0/958401742 shutdown_connections 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.038+0000 7f6839669700 1 --2- 172.21.15.8:0/958401742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683407a2a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.038+0000 7f6839669700 1 -- 172.21.15.8:0/958401742 >> 172.21.15.8:0/958401742 conn(0x7f6834101bd0 msgr2=0x7f6834104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:02:52.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.038+0000 7f6839669700 1 -- 172.21.15.8:0/958401742 shutdown_connections 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.038+0000 7f6839669700 1 -- 172.21.15.8:0/958401742 wait complete. 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.039+0000 7f6839669700 1 Processor -- start 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.039+0000 7f6839669700 1 -- start start 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.039+0000 7f6839669700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683419bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.039+0000 7f6839669700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683419c1e0 con 0x7f683407be40 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.040+0000 7f6832ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683419bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.040+0000 7f6832ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683419bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44872/0 (socket says 172.21.15.8:44872) 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.040+0000 7f6832ffd700 1 -- 172.21.15.8:0/2792986710 learned_addr learned my addr 172.21.15.8:0/2792986710 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.040+0000 7f6832ffd700 1 -- 172.21.15.8:0/2792986710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009550 con 0x7f683407be40 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.040+0000 7f6832ffd700 1 --2- 172.21.15.8:0/2792986710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683419bca0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f683407b310 tx=0x7f6824004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:02:52.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.041+0000 7f681bfff700 1 -- 172.21.15.8:0/2792986710 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6824011630 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.041+0000 7f681bfff700 1 -- 172.21.15.8:0/2792986710 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6824011790 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.041+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683419c3e0 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.041+0000 7f681bfff700 1 -- 172.21.15.8:0/2792986710 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6824011a30 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.041+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683419c800 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.041+0000 7f681bfff700 1 -- 172.21.15.8:0/2792986710 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6824022070 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.041+0000 7f681bfff700 1 -- 172.21.15.8:0/2792986710 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f682401c450 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.042+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6834195be0 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.045+0000 7f681bfff700 1 -- 172.21.15.8:0/2792986710 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f682401b450 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.122+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f683407ad20 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.122+0000 7f681bfff700 1 -- 172.21.15.8:0/2792986710 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f682401b5f0 con 0x7f683407be40 2023-10-06T23:02:52.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.123+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 msgr2=0x7f683419bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:02:52.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.123+0000 7f6839669700 1 --2- 172.21.15.8:0/2792986710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683419bca0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f683407b310 tx=0x7f6824004750 comp rx=0 tx=0).stop 2023-10-06T23:02:52.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.123+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 shutdown_connections 2023-10-06T23:02:52.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.123+0000 7f6839669700 1 --2- 172.21.15.8:0/2792986710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f683407be40 0x7f683419bca0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:02:52.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.123+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 >> 172.21.15.8:0/2792986710 conn(0x7f6834101bd0 msgr2=0x7f6834103540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:02:52.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.123+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 shutdown_connections 2023-10-06T23:02:52.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:52.123+0000 7f6839669700 1 -- 172.21.15.8:0/2792986710 wait complete. 2023-10-06T23:02:52.675 INFO:teuthology.orchestra.run.smithi008.stdout:mon is available 2023-10-06T23:02:52.675 INFO:teuthology.orchestra.run.smithi008.stdout:Assimilating anything we can from ceph.conf... 2023-10-06T23:02:52.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:52 smithi008 ceph-mon[98028]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-06T23:02:52.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:52 smithi008 ceph-mon[98028]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} 2023-10-06T23:02:52.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:52 smithi008 ceph-mon[98028]: fsmap 2023-10-06T23:02:52.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:52 smithi008 ceph-mon[98028]: osdmap e1: 0 total, 0 up, 0 in 2023-10-06T23:02:52.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:52 smithi008 ceph-mon[98028]: mgrmap e1: no daemons active 2023-10-06T23:02:52.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:52 smithi008 ceph-mon[98028]: from='client.? 172.21.15.8:0/2792986710' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-06T23:02:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:53 smithi008 ceph-mon[98028]: from='client.? 172.21.15.8:0/2942941705' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-06T23:02:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:53 smithi008 ceph-mon[98028]: from='client.? 172.21.15.8:0/2942941705' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-06T23:02:53.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-06T23:02:53.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.175+0000 7f24e2c91700 1 Processor -- start 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24e2c91700 1 -- start start 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24e2c91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24e2c91700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc107040 con 0x7f24dc106650 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24e0a2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:02:53.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24e0a2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44886/0 (socket says 172.21.15.8:44886) 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24e0a2d700 1 -- 172.21.15.8:0/1818553204 learned_addr learned my addr 172.21.15.8:0/1818553204 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24e0a2d700 1 -- 172.21.15.8:0/1818553204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc107850 con 0x7f24dc106650 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24e0a2d700 1 --2- 172.21.15.8:0/1818553204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc106a70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f24d00098a0 tx=0x7f24d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19207d2e6373565e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24db7fe700 1 -- 172.21.15.8:0/1818553204 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24d0004160 con 0x7f24dc106650 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24db7fe700 1 -- 172.21.15.8:0/1818553204 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d00042c0 con 0x7f24dc106650 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.176+0000 7f24db7fe700 1 -- 172.21.15.8:0/1818553204 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24d00045a0 con 0x7f24dc106650 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.178+0000 7f24e2c91700 1 -- 172.21.15.8:0/1818553204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 msgr2=0x7f24dc106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.178+0000 7f24e2c91700 1 --2- 172.21.15.8:0/1818553204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc106a70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f24d00098a0 tx=0x7f24d0009bb0 comp rx=0 tx=0).stop 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.178+0000 7f24e2c91700 1 -- 172.21.15.8:0/1818553204 shutdown_connections 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.178+0000 7f24e2c91700 1 --2- 172.21.15.8:0/1818553204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc106a70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:02:53.655 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.178+0000 7f24e2c91700 1 -- 172.21.15.8:0/1818553204 >> 172.21.15.8:0/1818553204 conn(0x7f24dc101bd0 msgr2=0x7f24dc104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:02:53.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.178+0000 7f24e2c91700 1 -- 172.21.15.8:0/1818553204 shutdown_connections 2023-10-06T23:02:53.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.178+0000 7f24e2c91700 1 -- 172.21.15.8:0/1818553204 wait complete. 2023-10-06T23:02:53.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.179+0000 7f24e2c91700 1 Processor -- start 2023-10-06T23:02:53.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.179+0000 7f24e2c91700 1 -- start start 2023-10-06T23:02:53.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.179+0000 7f24e2c91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:02:53.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.179+0000 7f24e2c91700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc19a010 con 0x7f24dc106650 2023-10-06T23:02:53.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24e0a2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:02:53.656 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24e0a2d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44888/0 (socket says 172.21.15.8:44888) 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24e0a2d700 1 -- 172.21.15.8:0/2942941705 learned_addr learned my addr 172.21.15.8:0/2942941705 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24e0a2d700 1 -- 172.21.15.8:0/2942941705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0009550 con 0x7f24dc106650 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24e0a2d700 1 --2- 172.21.15.8:0/2942941705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc199ad0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f24d0004000 tx=0x7f24d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24d9ffb700 1 -- 172.21.15.8:0/2942941705 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24d0011630 con 0x7f24dc106650 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24d9ffb700 1 -- 172.21.15.8:0/2942941705 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0011790 con 0x7f24dc106650 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24d9ffb700 1 -- 172.21.15.8:0/2942941705 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24d0011a30 con 0x7f24dc106650 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.180+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc19a210 con 0x7f24dc106650 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.182+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc19a630 con 0x7f24dc106650 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.182+0000 7f24d9ffb700 1 -- 172.21.15.8:0/2942941705 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f24d0022070 con 0x7f24dc106650 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.182+0000 7f24d9ffb700 1 -- 172.21.15.8:0/2942941705 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f24d001c450 con 0x7f24dc106650 2023-10-06T23:02:53.657 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.182+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc193360 con 0x7f24dc106650 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.185+0000 7f24d9ffb700 1 -- 172.21.15.8:0/2942941705 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f24d001b450 con 0x7f24dc106650 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.259+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f24dc107e40 con 0x7f24dc106650 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.264+0000 7f24d9ffb700 1 -- 172.21.15.8:0/2942941705 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f24d001b5f0 con 0x7f24dc106650 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.265+0000 7f24d9ffb700 1 -- 172.21.15.8:0/2942941705 <== mon.0 v2:172.21.15.8:3300/0 8 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f24d001b790 con 0x7f24dc106650 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.265+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 msgr2=0x7f24dc199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.265+0000 7f24e2c91700 1 --2- 172.21.15.8:0/2942941705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc199ad0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f24d0004000 tx=0x7f24d0004750 comp rx=0 tx=0).stop 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.265+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 shutdown_connections 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.266+0000 7f24e2c91700 1 --2- 172.21.15.8:0/2942941705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc106650 0x7f24dc199ad0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.266+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 >> 172.21.15.8:0/2942941705 conn(0x7f24dc101bd0 msgr2=0x7f24dc18e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.266+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 shutdown_connections 2023-10-06T23:02:53.658 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:53.266+0000 7f24e2c91700 1 -- 172.21.15.8:0/2942941705 wait complete. 2023-10-06T23:02:53.659 INFO:teuthology.orchestra.run.smithi008.stdout:Generating new minimal ceph.conf... 2023-10-06T23:02:54.631 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.169+0000 7f7a93102700 1 Processor -- start 2023-10-06T23:02:54.631 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.169+0000 7f7a93102700 1 -- start start 2023-10-06T23:02:54.631 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.169+0000 7f7a93102700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:02:54.631 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.169+0000 7f7a93102700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c07a890 con 0x7f7a8c07be60 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.170+0000 7f7a90e9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.170+0000 7f7a90e9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44894/0 (socket says 172.21.15.8:44894) 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.170+0000 7f7a90e9e700 1 -- 172.21.15.8:0/71744192 learned_addr learned my addr 172.21.15.8:0/71744192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.170+0000 7f7a90e9e700 1 -- 172.21.15.8:0/71744192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c07a9d0 con 0x7f7a8c07be60 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.170+0000 7f7a90e9e700 1 --2- 172.21.15.8:0/71744192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c07a2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098a0 tx=0x7f7a80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802eb3ccf383eda3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a8b7fe700 1 -- 172.21.15.8:0/71744192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a80004160 con 0x7f7a8c07be60 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a8b7fe700 1 -- 172.21.15.8:0/71744192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7a800042c0 con 0x7f7a8c07be60 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a8b7fe700 1 -- 172.21.15.8:0/71744192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a80011940 con 0x7f7a8c07be60 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a93102700 1 -- 172.21.15.8:0/71744192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 msgr2=0x7f7a8c07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:02:54.632 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a93102700 1 --2- 172.21.15.8:0/71744192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c07a2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098a0 tx=0x7f7a80009bb0 comp rx=0 tx=0).stop 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a93102700 1 -- 172.21.15.8:0/71744192 shutdown_connections 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a93102700 1 --2- 172.21.15.8:0/71744192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c07a2c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a93102700 1 -- 172.21.15.8:0/71744192 >> 172.21.15.8:0/71744192 conn(0x7f7a8c101bd0 msgr2=0x7f7a8c104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a93102700 1 -- 172.21.15.8:0/71744192 shutdown_connections 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.171+0000 7f7a93102700 1 -- 172.21.15.8:0/71744192 wait complete. 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.172+0000 7f7a93102700 1 Processor -- start 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.173+0000 7f7a93102700 1 -- start start 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.173+0000 7f7a93102700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.173+0000 7f7a93102700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c19c930 con 0x7f7a8c07be60 2023-10-06T23:02:54.633 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.173+0000 7f7a90e9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.173+0000 7f7a90e9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c19c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44898/0 (socket says 172.21.15.8:44898) 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.173+0000 7f7a90e9e700 1 -- 172.21.15.8:0/3722250198 learned_addr learned my addr 172.21.15.8:0/3722250198 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.174+0000 7f7a90e9e700 1 -- 172.21.15.8:0/3722250198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80009550 con 0x7f7a8c07be60 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.174+0000 7f7a90e9e700 1 --2- 172.21.15.8:0/3722250198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c19c3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7a80011dc0 tx=0x7f7a80011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.174+0000 7f7a89ffb700 1 -- 172.21.15.8:0/3722250198 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800037d0 con 0x7f7a8c07be60 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.174+0000 7f7a89ffb700 1 -- 172.21.15.8:0/3722250198 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7a8001b440 con 0x7f7a8c07be60 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.174+0000 7f7a89ffb700 1 -- 172.21.15.8:0/3722250198 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a8001a560 con 0x7f7a8c07be60 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.174+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c19cb30 con 0x7f7a8c07be60 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.174+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c19cf50 con 0x7f7a8c07be60 2023-10-06T23:02:54.634 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.175+0000 7f7a89ffb700 1 -- 172.21.15.8:0/3722250198 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7a8001aad0 con 0x7f7a8c07be60 2023-10-06T23:02:54.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.175+0000 7f7a89ffb700 1 -- 172.21.15.8:0/3722250198 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7a800193f0 con 0x7f7a8c07be60 2023-10-06T23:02:54.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.175+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c0624e0 con 0x7f7a8c07be60 2023-10-06T23:02:54.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.178+0000 7f7a89ffb700 1 -- 172.21.15.8:0/3722250198 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7a80029060 con 0x7f7a8c07be60 2023-10-06T23:02:54.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.252+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7a8c10c9e0 con 0x7f7a8c07be60 2023-10-06T23:02:54.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.252+0000 7f7a89ffb700 1 -- 172.21.15.8:0/3722250198 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f7a80033090 con 0x7f7a8c07be60 2023-10-06T23:02:54.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.253+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 msgr2=0x7f7a8c19c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:02:54.635 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.253+0000 7f7a93102700 1 --2- 172.21.15.8:0/3722250198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c19c3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7a80011dc0 tx=0x7f7a80011ea0 comp rx=0 tx=0).stop 2023-10-06T23:02:54.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.253+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 shutdown_connections 2023-10-06T23:02:54.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.253+0000 7f7a93102700 1 --2- 172.21.15.8:0/3722250198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a8c07be60 0x7f7a8c19c3f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:02:54.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.253+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 >> 172.21.15.8:0/3722250198 conn(0x7f7a8c101bd0 msgr2=0x7f7a8c1032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:02:54.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.253+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 shutdown_connections 2023-10-06T23:02:54.636 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:54.253+0000 7f7a93102700 1 -- 172.21.15.8:0/3722250198 wait complete. 2023-10-06T23:02:54.636 INFO:teuthology.orchestra.run.smithi008.stdout:Restarting the monitor... 2023-10-06T23:02:54.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:54 smithi008 ceph-mon[98028]: from='client.? 172.21.15.8:0/3722250198' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:02:55.096 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:54 smithi008 systemd[1]: Stopping Ceph mon.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:02:55.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:55 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-a[98004]: 2023-10-06T23:02:55.094+0000 7f8e9a048700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:02:55.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:55 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-a[98004]: 2023-10-06T23:02:55.094+0000 7f8e9a048700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-06T23:02:55.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:55 smithi008 bash[98363]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-a 2023-10-06T23:02:56.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 systemd[1]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-06T23:02:56.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 systemd[1]: Stopped Ceph mon.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:02:56.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 systemd[1]: Starting Ceph mon.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:02:56.725 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 podman[98492]: 2023-10-06T23:02:56.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 bash[98492]: bb6cb7190b82c299cd1a554f5a62549f2bdc768d2ce647269defabf474b74320 2023-10-06T23:02:56.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: set uid:gid to 167:167 (ceph:ceph) 2023-10-06T23:02:56.800 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev), process ceph-mon, pid 7 2023-10-06T23:02:56.800 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: pidfile_write: ignore empty --pid-file 2023-10-06T23:02:56.800 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: load: jerasure load: lrc 2023-10-06T23:02:56.800 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: RocksDB version: 7.9.2 2023-10-06T23:02:56.800 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Git sha 0 2023-10-06T23:02:56.800 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Compile date 2023-10-06 09:28:03 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: DB SUMMARY 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: DB Session ID: 5L4I3BUDF0JL5UBME21A 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: CURRENT file: CURRENT 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: IDENTITY file: IDENTITY 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98865 ; 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.error_if_exists: 0 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.create_if_missing: 0 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.paranoid_checks: 1 2023-10-06T23:02:56.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.env: 0x556baa54ada0 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.fs: PosixFileSystem 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.info_log: 0x556bacda95c0 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_file_opening_threads: 16 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.statistics: (nil) 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.use_fsync: 0 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_log_file_size: 0 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-06T23:02:56.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.keep_log_file_num: 1000 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.recycle_log_file_num: 0 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.allow_fallocate: 1 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.allow_mmap_reads: 0 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.allow_mmap_writes: 0 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.use_direct_reads: 0 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.create_missing_column_families: 0 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.db_log_dir: 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.wal_dir: 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-06T23:02:56.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.advise_random_on_open: 1 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.db_write_buffer_size: 0 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.write_buffer_manager: 0x556bacd61360 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-06T23:02:56.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.rate_limiter: (nil) 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.wal_recovery_mode: 2 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.enable_thread_tracking: 0 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.enable_pipelined_write: 0 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.unordered_write: 0 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-06T23:02:56.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.row_cache: None 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.wal_filter: None 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.allow_ingest_behind: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.two_write_queues: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.manual_wal_flush: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.wal_compression: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.atomic_flush: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.log_readahead_size: 0 2023-10-06T23:02:56.807 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.best_efforts_recovery: 0 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.allow_data_in_errors: 0 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.db_host_id: __hostname__ 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_background_jobs: 2 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_background_compactions: -1 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_subcompactions: 1 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-06T23:02:56.808 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_total_wal_size: 0 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_open_files: -1 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bytes_per_sync: 0 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_readahead_size: 0 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_background_flushes: -1 2023-10-06T23:02:56.809 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Compression algorithms supported: 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: kZSTD supported: 0 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: kXpressCompression supported: 0 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: kLZ4HCCompression supported: 1 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: kZlibCompression supported: 1 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: kSnappyCompression supported: 1 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: kLZ4Compression supported: 1 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: kBZip2Compression supported: 0 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-06T23:02:56.810 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.merge_operator: 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_filter: None 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_filter_factory: None 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.sst_partitioner_factory: None 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556bacda96c0) 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks: 1 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-06T23:02:56.811 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_top_level_index_and_filter: 1 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_type: 0 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_index_type: 0 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_shortening: 1 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: checksum: 4 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: no_block_cache: 0 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache: 0x556bacdff1f0 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_name: BinnedLRUCache 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_options: 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: capacity : 536870912 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_shard_bits : 4 2023-10-06T23:02:56.812 INFO:journalctl@ceph.mon.a.smithi008.stdout: strict_capacity_limit : 0 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: high_pri_pool_ratio: 0.000 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_compressed: (nil) 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: persistent_cache: (nil) 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size: 4096 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size_deviation: 10 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_restart_interval: 16 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_block_restart_interval: 1 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: metadata_block_size: 4096 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: partition_filters: 0 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: use_delta_encoding: 1 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: filter_policy: bloomfilter 2023-10-06T23:02:56.813 INFO:journalctl@ceph.mon.a.smithi008.stdout: whole_key_filtering: 1 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: verify_compression: 0 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: read_amp_bytes_per_bit: 0 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: format_version: 5 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_index_compression: 1 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_align: 0 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: max_auto_readahead_size: 262144 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: prepopulate_block_cache: 0 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: initial_auto_readahead_size: 8192 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_file_reads_for_auto_readahead: 2 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.write_buffer_size: 33554432 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_write_buffer_number: 2 2023-10-06T23:02:56.814 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression: NoCompression 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression: Disabled 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.prefix_extractor: nullptr 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.num_levels: 7 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-06T23:02:56.815 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.level: 32767 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.strategy: 0 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.enabled: false 2023-10-06T23:02:56.816 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.target_file_size_base: 67108864 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-06T23:02:56.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.arena_block_size: 1048576 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.disable_auto_compactions: 0 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-06T23:02:56.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.table_properties_collectors: 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.inplace_update_support: 0 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-06T23:02:56.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.bloom_locality: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.max_successive_merges: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.paranoid_file_checks: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.force_consistency_checks: 1 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.report_bg_io_stats: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.ttl: 2592000 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-06T23:02:56.820 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.enable_blob_files: false 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.min_blob_size: 0 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.blob_file_size: 268435456 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.blob_file_starting_level: 0 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-06T23:02:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7e57b28b-3775-4eb8-bf00-122cb2d0c5f6 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633376735176, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633376737205, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94105, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 314, "table_properties": {"data_size": 92116, "index_size": 271, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13662, "raw_average_key_size": 50, "raw_value_size": 84654, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 273, "num_filter_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696633376, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7e57b28b-3775-4eb8-bf00-122cb2d0c5f6", "db_session_id": "5L4I3BUDF0JL5UBME21A", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633376737359, "job": 1, "event": "recovery_finished"} 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556bace9c000 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: DB pointer 0x556bace88000 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** DB Stats ** 2023-10-06T23:02:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: L0 2/0 93.73 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 67.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:02:56.823 INFO:journalctl@ceph.mon.a.smithi008.stdout: Sum 2/0 93.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 67.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 67.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 67.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-06T23:02:56.824 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative compaction: 0.00 GB write, 11.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval compaction: 0.00 GB write, 11.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache BinnedLRUCache@0x556bacdff1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: starting mon.a rank 0 at public addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] at bind addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:02:56.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a@-1(???) e1 preinit fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a@-1(???).mds e1 new map 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a@-1(???).mds e1 print_map 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout: e1 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout: legacy client fscid: -1 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout: No filesystems configured 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:02:56.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta expand map: {default=false} 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta from 'false' to 'false' 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta expanded map: {default=false} 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta expand map: {default=info} 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta from 'info' to 'info' 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta expanded map: {default=info} 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta expand map: {default=daemon} 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta expanded map: {default=daemon} 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta expand map: {default=debug} 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta from 'debug' to 'debug' 2023-10-06T23:02:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: expand_channel_meta expanded map: {default=debug} 2023-10-06T23:02:56.828 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 systemd[1]: Started Ceph mon.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:02:56.828 INFO:teuthology.orchestra.run.smithi008.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-06T23:02:57.049 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-06T23:02:57.050 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} 2023-10-06T23:02:57.050 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: fsmap 2023-10-06T23:02:57.050 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: osdmap e1: 0 total, 0 up, 0 in 2023-10-06T23:02:57.050 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:56 smithi008 ceph-mon[98532]: mgrmap e1: no daemons active 2023-10-06T23:02:57.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.316+0000 7fb7fbea4700 1 Processor -- start 2023-10-06T23:02:57.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.316+0000 7fb7fbea4700 1 -- start start 2023-10-06T23:02:57.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.316+0000 7fb7fbea4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f4106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:02:57.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.317+0000 7fb7fbea4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f4107040 con 0x7fb7f4106650 2023-10-06T23:02:57.791 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.317+0000 7fb7f9c40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f4106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.317+0000 7fb7f9c40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f4106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44908/0 (socket says 172.21.15.8:44908) 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.317+0000 7fb7f9c40700 1 -- 172.21.15.8:0/3068853162 learned_addr learned my addr 172.21.15.8:0/3068853162 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.318+0000 7fb7f9c40700 1 -- 172.21.15.8:0/3068853162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4107850 con 0x7fb7f4106650 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.318+0000 7fb7f9c40700 1 --2- 172.21.15.8:0/3068853162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f4106a70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00098a0 tx=0x7fb7f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e027cd2d29a6b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.318+0000 7fb7f8c3e700 1 -- 172.21.15.8:0/3068853162 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7f0004160 con 0x7fb7f4106650 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.318+0000 7fb7f8c3e700 1 -- 172.21.15.8:0/3068853162 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb7f00042c0 con 0x7fb7f4106650 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.318+0000 7fb7f8c3e700 1 -- 172.21.15.8:0/3068853162 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7f0011940 con 0x7fb7f4106650 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.319+0000 7fb7fbea4700 1 -- 172.21.15.8:0/3068853162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 msgr2=0x7fb7f4106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.319+0000 7fb7fbea4700 1 --2- 172.21.15.8:0/3068853162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f4106a70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00098a0 tx=0x7fb7f0009bb0 comp rx=0 tx=0).stop 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.319+0000 7fb7fbea4700 1 -- 172.21.15.8:0/3068853162 shutdown_connections 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.319+0000 7fb7fbea4700 1 --2- 172.21.15.8:0/3068853162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f4106a70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:02:57.792 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.319+0000 7fb7fbea4700 1 -- 172.21.15.8:0/3068853162 >> 172.21.15.8:0/3068853162 conn(0x7fb7f4101bd0 msgr2=0x7fb7f4104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.319+0000 7fb7fbea4700 1 -- 172.21.15.8:0/3068853162 shutdown_connections 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.319+0000 7fb7fbea4700 1 -- 172.21.15.8:0/3068853162 wait complete. 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.320+0000 7fb7fbea4700 1 Processor -- start 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.320+0000 7fb7fbea4700 1 -- start start 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.321+0000 7fb7fbea4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.321+0000 7fb7fbea4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f419a740 con 0x7fb7f4106650 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.321+0000 7fb7f9c40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.321+0000 7fb7f9c40700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44922/0 (socket says 172.21.15.8:44922) 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.321+0000 7fb7f9c40700 1 -- 172.21.15.8:0/4145927546 learned_addr learned my addr 172.21.15.8:0/4145927546 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.321+0000 7fb7f9c40700 1 -- 172.21.15.8:0/4145927546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0009550 con 0x7fb7f4106650 2023-10-06T23:02:57.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.321+0000 7fb7f9c40700 1 --2- 172.21.15.8:0/4145927546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f419a200 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0000c00 tx=0x7fb7f0011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.322+0000 7fb7eaffd700 1 -- 172.21.15.8:0/4145927546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00036a0 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.322+0000 7fb7eaffd700 1 -- 172.21.15.8:0/4145927546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb7f0003c70 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.322+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f419a940 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.322+0000 7fb7eaffd700 1 -- 172.21.15.8:0/4145927546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00193f0 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.322+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f419ad60 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.322+0000 7fb7eaffd700 1 -- 172.21.15.8:0/4145927546 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb7f0019920 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.322+0000 7fb7eaffd700 1 -- 172.21.15.8:0/4145927546 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb7f001a3d0 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.323+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f40624e0 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.326+0000 7fb7eaffd700 1 -- 172.21.15.8:0/4145927546 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb7f0029060 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.399+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fb7f419d9f0 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.401+0000 7fb7eaffd700 1 -- 172.21.15.8:0/4145927546 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb7f001f070 con 0x7fb7f4106650 2023-10-06T23:02:57.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.402+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 msgr2=0x7fb7f419a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:02:57.795 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.402+0000 7fb7fbea4700 1 --2- 172.21.15.8:0/4145927546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f419a200 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0000c00 tx=0x7fb7f0011e70 comp rx=0 tx=0).stop 2023-10-06T23:02:57.795 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.402+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 shutdown_connections 2023-10-06T23:02:57.795 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.402+0000 7fb7fbea4700 1 --2- 172.21.15.8:0/4145927546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7f4106650 0x7fb7f419a200 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:02:57.795 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.402+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 >> 172.21.15.8:0/4145927546 conn(0x7fb7f4101bd0 msgr2=0x7fb7f4102910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:02:57.795 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.402+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 shutdown_connections 2023-10-06T23:02:57.795 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:57.403+0000 7fb7fbea4700 1 -- 172.21.15.8:0/4145927546 wait complete. 2023-10-06T23:02:57.795 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-06T23:02:57.825 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:02:57.825 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mgr... 2023-10-06T23:02:57.826 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-06T23:02:57.826 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-06T23:02:58.197 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.x 2023-10-06T23:02:58.198 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-06T23:02:58.417 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7.target.wants/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@.service. 2023-10-06T23:02:58.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:58 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4145927546' entity='client.admin' 2023-10-06T23:02:58.646 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:58 smithi008 systemd[1]: Starting Ceph mgr.x for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:02:59.213 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:58 smithi008 podman[98763]: 2023-10-06T23:02:59.214 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:59 smithi008 bash[98763]: 93900bbba1cd5780ca81e65e3736ab5aab6f6397e593c2d79d5582fe127da943 2023-10-06T23:02:59.239 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-06T23:02:59.240 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-10-06T23:02:59.258 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-06T23:02:59.259 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-06T23:02:59.259 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-10-06T23:02:59.259 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2023-10-06T23:02:59.277 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-06T23:02:59.277 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-10-06T23:02:59.294 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-06T23:02:59.294 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-06T23:02:59.294 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-10-06T23:02:59.295 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-06T23:02:59.295 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr to start... 2023-10-06T23:02:59.295 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr... 2023-10-06T23:02:59.502 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:59 smithi008 systemd[1]: Started Ceph mgr.x for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:02:59.502 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:02:59.390+0000 7f1002ce0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T23:02:59.757 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:02:59.500+0000 7f1002ce0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T23:02:59.757 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:02:59.626+0000 7f1002ce0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T23:03:00.084 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:02:59 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4153346419' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-06T23:03:00.085 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:02:59.755+0000 7f1002ce0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T23:03:00.085 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:02:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:02:59.998+0000 7f1002ce0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T23:03:00.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:03:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-06T23:03:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "5a0d88f6-649c-11ee-8db5-212e2dc638e7", 2023-10-06T23:03:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-10-06T23:03:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-06T23:03:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-06T23:03:00.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-06T23:03:00.379 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:00.380 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-06T23:03:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-06T23:03:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-10-06T23:03:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-06T23:03:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-06T23:03:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-10-06T23:03:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-06T23:03:00.381 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-10-06T23:03:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-06T23:03:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-06T23:03:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-06T23:03:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-06T23:03:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-06T23:03:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-06T23:03:00.382 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-06T23:03:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-06T23:03:00.383 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-06T23:03:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-06T23:03:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-06T23:03:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-06T23:03:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:00.391 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-06T23:03:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-06T23:03:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-06T23:03:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-06T23:03:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-06T23:03:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-06T23:03:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-06T23:03:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-06T23:03:00.392 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-06T23:03:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-06T23:03:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-06T23:03:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-06T23:03:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-06T23:03:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-06T23:03:00.393 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-06T23:03:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-06T23:03:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-06T23:03:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-06T23:03:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-06T23:03:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-10-06T23:03:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-06T23:03:00.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-06T23:03:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-06T23:03:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-06T23:03:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-10-06T23:02:51.456528+0000", 2023-10-06T23:03:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-06T23:03:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-06T23:03:00.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-06T23:03:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.828+0000 7ff399a46700 1 Processor -- start 2023-10-06T23:03:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.828+0000 7ff399a46700 1 -- start start 2023-10-06T23:03:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.829+0000 7ff399a46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff394106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.829+0000 7ff399a46700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394107040 con 0x7ff394106650 2023-10-06T23:03:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.829+0000 7ff392ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff394106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.830+0000 7ff392ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff394106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49586/0 (socket says 172.21.15.8:49586) 2023-10-06T23:03:00.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.830+0000 7ff392ffd700 1 -- 172.21.15.8:0/3534061794 learned_addr learned my addr 172.21.15.8:0/3534061794 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.830+0000 7ff392ffd700 1 -- 172.21.15.8:0/3534061794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394107850 con 0x7ff394106650 2023-10-06T23:03:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.830+0000 7ff392ffd700 1 --2- 172.21.15.8:0/3534061794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff394106a70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff3840098a0 tx=0x7ff384009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f1ecbb7c1586f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.830+0000 7ff391ffb700 1 -- 172.21.15.8:0/3534061794 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff384004160 con 0x7ff394106650 2023-10-06T23:03:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.830+0000 7ff391ffb700 1 -- 172.21.15.8:0/3534061794 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff3840042c0 con 0x7ff394106650 2023-10-06T23:03:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.830+0000 7ff391ffb700 1 -- 172.21.15.8:0/3534061794 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff384011940 con 0x7ff394106650 2023-10-06T23:03:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.831+0000 7ff399a46700 1 -- 172.21.15.8:0/3534061794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 msgr2=0x7ff394106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:00.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.831+0000 7ff399a46700 1 --2- 172.21.15.8:0/3534061794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff394106a70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff3840098a0 tx=0x7ff384009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.831+0000 7ff399a46700 1 -- 172.21.15.8:0/3534061794 shutdown_connections 2023-10-06T23:03:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.831+0000 7ff399a46700 1 --2- 172.21.15.8:0/3534061794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff394106a70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.831+0000 7ff399a46700 1 -- 172.21.15.8:0/3534061794 >> 172.21.15.8:0/3534061794 conn(0x7ff394101bd0 msgr2=0x7ff394104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.831+0000 7ff399a46700 1 -- 172.21.15.8:0/3534061794 shutdown_connections 2023-10-06T23:03:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.831+0000 7ff399a46700 1 -- 172.21.15.8:0/3534061794 wait complete. 2023-10-06T23:03:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.832+0000 7ff399a46700 1 Processor -- start 2023-10-06T23:03:00.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.833+0000 7ff399a46700 1 -- start start 2023-10-06T23:03:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.833+0000 7ff399a46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff39407bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.833+0000 7ff399a46700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39407c170 con 0x7ff394106650 2023-10-06T23:03:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.833+0000 7ff392ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff39407bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.833+0000 7ff392ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff39407bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49588/0 (socket says 172.21.15.8:49588) 2023-10-06T23:03:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.833+0000 7ff392ffd700 1 -- 172.21.15.8:0/4153346419 learned_addr learned my addr 172.21.15.8:0/4153346419 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.834+0000 7ff392ffd700 1 -- 172.21.15.8:0/4153346419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384009550 con 0x7ff394106650 2023-10-06T23:03:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.834+0000 7ff392ffd700 1 --2- 172.21.15.8:0/4153346419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff39407bc30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff384000c00 tx=0x7ff384011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:00.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.834+0000 7ff398a44700 1 -- 172.21.15.8:0/4153346419 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3840036a0 con 0x7ff394106650 2023-10-06T23:03:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.834+0000 7ff398a44700 1 -- 172.21.15.8:0/4153346419 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff384003c70 con 0x7ff394106650 2023-10-06T23:03:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.834+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39407a280 con 0x7ff394106650 2023-10-06T23:03:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.834+0000 7ff398a44700 1 -- 172.21.15.8:0/4153346419 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3840193f0 con 0x7ff394106650 2023-10-06T23:03:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.834+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39407a6a0 con 0x7ff394106650 2023-10-06T23:03:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.835+0000 7ff398a44700 1 -- 172.21.15.8:0/4153346419 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff384019920 con 0x7ff394106650 2023-10-06T23:03:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.835+0000 7ff398a44700 1 -- 172.21.15.8:0/4153346419 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff38401a3d0 con 0x7ff394106650 2023-10-06T23:03:00.400 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.836+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3940624e0 con 0x7ff394106650 2023-10-06T23:03:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.839+0000 7ff398a44700 1 -- 172.21.15.8:0/4153346419 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff384029060 con 0x7ff394106650 2023-10-06T23:03:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.915+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff39407abe0 con 0x7ff394106650 2023-10-06T23:03:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.916+0000 7ff398a44700 1 -- 172.21.15.8:0/4153346419 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7ff38401f070 con 0x7ff394106650 2023-10-06T23:03:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.917+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 msgr2=0x7ff39407bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.917+0000 7ff399a46700 1 --2- 172.21.15.8:0/4153346419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff39407bc30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff384000c00 tx=0x7ff384011e70 comp rx=0 tx=0).stop 2023-10-06T23:03:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.917+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 shutdown_connections 2023-10-06T23:03:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.917+0000 7ff399a46700 1 --2- 172.21.15.8:0/4153346419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394106650 0x7ff39407bc30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:00.401 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.917+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 >> 172.21.15.8:0/4153346419 conn(0x7ff394101bd0 msgr2=0x7ff394102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.917+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 shutdown_connections 2023-10-06T23:03:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:02:59.917+0000 7ff399a46700 1 -- 172.21.15.8:0/4153346419 wait complete. 2023-10-06T23:03:00.402 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (1/15)... 2023-10-06T23:03:00.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:00 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:00.499+0000 7f1002ce0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T23:03:01.145 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:00 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:00.665+0000 7f1002ce0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T23:03:01.146 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:00 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:00.784+0000 7f1002ce0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T23:03:01.146 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:00 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:00.911+0000 7f1002ce0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T23:03:01.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:01 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:01.475+0000 7f1002ce0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T23:03:02.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:02 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:02.439+0000 7f1002ce0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T23:03:02.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:02 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:02.552+0000 7f1002ce0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T23:03:03.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:03 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:03.550+0000 7f1002ce0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:03:03.896 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:03 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:03.673+0000 7f1002ce0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T23:03:04.290 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:03 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:03.908+0000 7f1002ce0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:03:04.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:04 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:04.288+0000 7f1002ce0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T23:03:04.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:04 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:04.570+0000 7f1002ce0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T23:03:04.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:04 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:04.768+0000 7f1002ce0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T23:03:05.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:05.124+0000 7f1002ce0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T23:03:06.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:06.085+0000 7f1002ce0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T23:03:06.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:06.265+0000 7f1002ce0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T23:03:06.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:06.522+0000 7f1002ce0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T23:03:06.896 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:06.673+0000 7f1002ce0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T23:03:07.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:06.960+0000 7f1002ce0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T23:03:08.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:08.074+0000 7f1002ce0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: Activating manager daemon x 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: mgrmap e2: x(active, starting, since 0.00407792s) 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: Manager daemon x is now available 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' 2023-10-06T23:03:08.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' 2023-10-06T23:03:08.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:08 smithi008 ceph-mon[98532]: from='mgr.14100 172.21.15.8:0/1797835807' entity='mgr.x' 2023-10-06T23:03:09.999 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:03:09.999 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-06T23:03:10.001 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "5a0d88f6-649c-11ee-8db5-212e2dc638e7", 2023-10-06T23:03:10.001 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-10-06T23:03:10.001 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-06T23:03:10.001 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-06T23:03:10.001 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-06T23:03:10.002 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-06T23:03:10.003 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:10.003 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-06T23:03:10.003 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-06T23:03:10.003 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-06T23:03:10.003 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-06T23:03:10.003 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-06T23:03:10.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-06T23:03:10.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-06T23:03:10.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-06T23:03:10.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:10.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-06T23:03:10.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-06T23:03:10.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-06T23:03:10.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-06T23:03:10.014 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-10-06T23:02:51.456528+0000", 2023-10-06T23:03:10.014 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-06T23:03:10.014 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.205+0000 7ffaf227b700 1 Processor -- start 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.205+0000 7ffaf227b700 1 -- start start 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.205+0000 7ffaf227b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.205+0000 7ffaf227b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec107040 con 0x7ffaec106650 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.205+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.205+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49666/0 (socket says 172.21.15.8:49666) 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.205+0000 7ffaebfff700 1 -- 172.21.15.8:0/3863587627 learned_addr learned my addr 172.21.15.8:0/3863587627 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.206+0000 7ffaebfff700 1 -- 172.21.15.8:0/3863587627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec107850 con 0x7ffaec106650 2023-10-06T23:03:10.015 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.206+0000 7ffaebfff700 1 --2- 172.21.15.8:0/3863587627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec106a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0098a0 tx=0x7ffadc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcf1970d7e3f6f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:10.016 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.206+0000 7ffaeaffd700 1 -- 172.21.15.8:0/3863587627 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc004160 con 0x7ffaec106650 2023-10-06T23:03:10.016 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.206+0000 7ffaeaffd700 1 -- 172.21.15.8:0/3863587627 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ffadc0042c0 con 0x7ffaec106650 2023-10-06T23:03:10.016 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.206+0000 7ffaeaffd700 1 -- 172.21.15.8:0/3863587627 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc011940 con 0x7ffaec106650 2023-10-06T23:03:10.016 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.207+0000 7ffaf227b700 1 -- 172.21.15.8:0/3863587627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 msgr2=0x7ffaec106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:10.016 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.207+0000 7ffaf227b700 1 --2- 172.21.15.8:0/3863587627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec106a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0098a0 tx=0x7ffadc009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:10.016 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.207+0000 7ffaf227b700 1 -- 172.21.15.8:0/3863587627 shutdown_connections 2023-10-06T23:03:10.016 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.207+0000 7ffaf227b700 1 --2- 172.21.15.8:0/3863587627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec106a70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:10.017 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.207+0000 7ffaf227b700 1 -- 172.21.15.8:0/3863587627 >> 172.21.15.8:0/3863587627 conn(0x7ffaec101bd0 msgr2=0x7ffaec104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:10.017 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.207+0000 7ffaf227b700 1 -- 172.21.15.8:0/3863587627 shutdown_connections 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.207+0000 7ffaf227b700 1 -- 172.21.15.8:0/3863587627 wait complete. 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.208+0000 7ffaf227b700 1 Processor -- start 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.208+0000 7ffaf227b700 1 -- start start 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.208+0000 7ffaf227b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.208+0000 7ffaf227b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec19a740 con 0x7ffaec106650 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.209+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.209+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec19a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49676/0 (socket says 172.21.15.8:49676) 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.209+0000 7ffaebfff700 1 -- 172.21.15.8:0/990554530 learned_addr learned my addr 172.21.15.8:0/990554530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.209+0000 7ffaebfff700 1 -- 172.21.15.8:0/990554530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc009550 con 0x7ffaec106650 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.209+0000 7ffaebfff700 1 --2- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec19a200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffadc000c00 tx=0x7ffadc011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.210+0000 7ffae97fa700 1 -- 172.21.15.8:0/990554530 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc0036a0 con 0x7ffaec106650 2023-10-06T23:03:10.018 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.210+0000 7ffae97fa700 1 -- 172.21.15.8:0/990554530 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ffadc003c70 con 0x7ffaec106650 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.210+0000 7ffae97fa700 1 -- 172.21.15.8:0/990554530 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc0193f0 con 0x7ffaec106650 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.210+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec19a940 con 0x7ffaec106650 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.210+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec19ad60 con 0x7ffaec106650 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.211+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec0624e0 con 0x7ffaec106650 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.211+0000 7ffae97fa700 1 -- 172.21.15.8:0/990554530 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 3) v1 ==== 45462+0+0 (secure 0 0 0) 0x7ffadc01b440 con 0x7ffaec106650 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.211+0000 7ffae97fa700 1 --2- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7ffad4038760 0x7ffad403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.212+0000 7ffae97fa700 1 -- 172.21.15.8:0/990554530 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffadc04c470 con 0x7ffaec106650 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.212+0000 7ffaeb7fe700 1 --2- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7ffad4038760 0x7ffad403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.212+0000 7ffaeb7fe700 1 --2- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7ffad4038760 0x7ffad403ac20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009940 tx=0x7ffae0006e30 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.217+0000 7ffae97fa700 1 -- 172.21.15.8:0/990554530 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffadc022950 con 0x7ffaec106650 2023-10-06T23:03:10.019 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.511+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ffaec19da40 con 0x7ffaec106650 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.511+0000 7ffae97fa700 1 -- 172.21.15.8:0/990554530 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7ffadc01f070 con 0x7ffaec106650 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7ffad4038760 msgr2=0x7ffad403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 --2- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7ffad4038760 0x7ffad403ac20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009940 tx=0x7ffae0006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 msgr2=0x7ffaec19a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 --2- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec19a200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffadc000c00 tx=0x7ffadc011e70 comp rx=0 tx=0).stop 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 shutdown_connections 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 --2- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7ffad4038760 0x7ffad403ac20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 --2- 172.21.15.8:0/990554530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffaec106650 0x7ffaec19a200 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 >> 172.21.15.8:0/990554530 conn(0x7ffaec101bd0 msgr2=0x7ffaec102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 shutdown_connections 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:09.514+0000 7ffaf227b700 1 -- 172.21.15.8:0/990554530 wait complete. 2023-10-06T23:03:10.020 INFO:teuthology.orchestra.run.smithi008.stdout:mgr is available 2023-10-06T23:03:10.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:10 smithi008 ceph-mon[98532]: mgrmap e3: x(active, since 1.00911s) 2023-10-06T23:03:10.273 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:10 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/990554530' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-06T23:03:11.184 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:03:11.184 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2023-10-06T23:03:11.184 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:03:11.184 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-06T23:03:11.184 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-06T23:03:11.189 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-06T23:03:11.190 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.540+0000 7f3cb4316700 1 Processor -- start 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.540+0000 7f3cb4316700 1 -- start start 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.540+0000 7f3cb4316700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.540+0000 7f3cb4316700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac107040 con 0x7f3cac106650 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.541+0000 7f3cb20b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.541+0000 7f3cb20b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49034/0 (socket says 172.21.15.8:49034) 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.541+0000 7f3cb20b2700 1 -- 172.21.15.8:0/3516350339 learned_addr learned my addr 172.21.15.8:0/3516350339 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.541+0000 7f3cb20b2700 1 -- 172.21.15.8:0/3516350339 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac107850 con 0x7f3cac106650 2023-10-06T23:03:11.191 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.541+0000 7f3cb20b2700 1 --2- 172.21.15.8:0/3516350339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac106a70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80098a0 tx=0x7f3ca8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dca3c8e99741524 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb10b0700 1 -- 172.21.15.8:0/3516350339 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ca8004160 con 0x7f3cac106650 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb10b0700 1 -- 172.21.15.8:0/3516350339 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3ca80042c0 con 0x7f3cac106650 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb10b0700 1 -- 172.21.15.8:0/3516350339 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ca8011940 con 0x7f3cac106650 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb4316700 1 -- 172.21.15.8:0/3516350339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 msgr2=0x7f3cac106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb4316700 1 --2- 172.21.15.8:0/3516350339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac106a70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80098a0 tx=0x7f3ca8009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb4316700 1 -- 172.21.15.8:0/3516350339 shutdown_connections 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb4316700 1 --2- 172.21.15.8:0/3516350339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac106a70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb4316700 1 -- 172.21.15.8:0/3516350339 >> 172.21.15.8:0/3516350339 conn(0x7f3cac101bd0 msgr2=0x7f3cac104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb4316700 1 -- 172.21.15.8:0/3516350339 shutdown_connections 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.542+0000 7f3cb4316700 1 -- 172.21.15.8:0/3516350339 wait complete. 2023-10-06T23:03:11.192 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.543+0000 7f3cb4316700 1 Processor -- start 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.544+0000 7f3cb4316700 1 -- start start 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.544+0000 7f3cb4316700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac07bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.544+0000 7f3cb4316700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac07c170 con 0x7f3cac106650 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.544+0000 7f3cb20b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac07bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.544+0000 7f3cb20b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac07bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49046/0 (socket says 172.21.15.8:49046) 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.544+0000 7f3cb20b2700 1 -- 172.21.15.8:0/680918496 learned_addr learned my addr 172.21.15.8:0/680918496 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.545+0000 7f3cb20b2700 1 -- 172.21.15.8:0/680918496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8009550 con 0x7f3cac106650 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.545+0000 7f3cb20b2700 1 --2- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac07bc30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000c00 tx=0x7f3ca8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.545+0000 7f3ca37fe700 1 -- 172.21.15.8:0/680918496 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ca80036a0 con 0x7f3cac106650 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.545+0000 7f3ca37fe700 1 -- 172.21.15.8:0/680918496 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3ca8003c70 con 0x7f3cac106650 2023-10-06T23:03:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.545+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac07a280 con 0x7f3cac106650 2023-10-06T23:03:11.194 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.545+0000 7f3ca37fe700 1 -- 172.21.15.8:0/680918496 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ca80193f0 con 0x7f3cac106650 2023-10-06T23:03:11.194 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.545+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac07a6a0 con 0x7f3cac106650 2023-10-06T23:03:11.194 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.546+0000 7f3ca37fe700 1 -- 172.21.15.8:0/680918496 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f3ca801b440 con 0x7f3cac106650 2023-10-06T23:03:11.194 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.546+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac0624e0 con 0x7f3cac106650 2023-10-06T23:03:11.194 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.547+0000 7f3ca37fe700 1 --2- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f3c980388e0 0x7f3c9803ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:11.194 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.547+0000 7f3ca37fe700 1 -- 172.21.15.8:0/680918496 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3ca804c5f0 con 0x7f3cac106650 2023-10-06T23:03:11.194 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.547+0000 7f3cb18b1700 1 --2- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f3c980388e0 0x7f3c9803ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.548+0000 7f3cb18b1700 1 --2- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f3c980388e0 0x7f3c9803ada0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009940 tx=0x7f3c9c006e30 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.552+0000 7f3ca37fe700 1 -- 172.21.15.8:0/680918496 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3ca8022930 con 0x7f3cac106650 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.761+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3cac10aa80 con 0x7f3cac106650 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.762+0000 7f3ca37fe700 1 -- 172.21.15.8:0/680918496 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f3ca801f070 con 0x7f3cac106650 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.764+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f3c980388e0 msgr2=0x7f3c9803ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.764+0000 7f3cb4316700 1 --2- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f3c980388e0 0x7f3c9803ada0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009940 tx=0x7f3c9c006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.764+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 msgr2=0x7f3cac07bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.764+0000 7f3cb4316700 1 --2- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac07bc30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000c00 tx=0x7f3ca8011e70 comp rx=0 tx=0).stop 2023-10-06T23:03:11.196 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.764+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 shutdown_connections 2023-10-06T23:03:11.197 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.764+0000 7f3cb4316700 1 --2- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f3c980388e0 0x7f3c9803ada0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:11.197 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.764+0000 7f3cb4316700 1 --2- 172.21.15.8:0/680918496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3cac106650 0x7f3cac07bc30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:11.197 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.764+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 >> 172.21.15.8:0/680918496 conn(0x7f3cac101bd0 msgr2=0x7f3cac102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:11.197 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.765+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 shutdown_connections 2023-10-06T23:03:11.197 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:10.765+0000 7f3cb4316700 1 -- 172.21.15.8:0/680918496 wait complete. 2023-10-06T23:03:11.197 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling cephadm module... 2023-10-06T23:03:11.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:11 smithi008 ceph-mon[98532]: mgrmap e4: x(active, since 2s) 2023-10-06T23:03:11.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:11 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/680918496' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-06T23:03:13.022 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:12 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3998769136' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-06T23:03:13.022 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:12 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: ignoring --setuser ceph since I am not root 2023-10-06T23:03:13.022 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:12 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: ignoring --setgroup ceph since I am not root 2023-10-06T23:03:13.022 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:13.020+0000 7f5a1dc74200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T23:03:13.176 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.725+0000 7f5efcaa8700 1 Processor -- start 2023-10-06T23:03:13.176 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.725+0000 7f5efcaa8700 1 -- start start 2023-10-06T23:03:13.176 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.726+0000 7f5efcaa8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef8106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:13.176 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.726+0000 7f5efcaa8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8107040 con 0x7f5ef8106650 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.726+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef8106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.726+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef8106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49062/0 (socket says 172.21.15.8:49062) 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.726+0000 7f5ef659c700 1 -- 172.21.15.8:0/798100690 learned_addr learned my addr 172.21.15.8:0/798100690 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.727+0000 7f5ef659c700 1 -- 172.21.15.8:0/798100690 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8107850 con 0x7f5ef8106650 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.727+0000 7f5ef659c700 1 --2- 172.21.15.8:0/798100690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef8106a70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80098a0 tx=0x7f5ee8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2677b2f060fd69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.727+0000 7f5ef559a700 1 -- 172.21.15.8:0/798100690 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ee8004160 con 0x7f5ef8106650 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.727+0000 7f5ef559a700 1 -- 172.21.15.8:0/798100690 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5ee80042c0 con 0x7f5ef8106650 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.727+0000 7f5ef559a700 1 -- 172.21.15.8:0/798100690 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ee8011940 con 0x7f5ef8106650 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.728+0000 7f5efcaa8700 1 -- 172.21.15.8:0/798100690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 msgr2=0x7f5ef8106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:13.177 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.728+0000 7f5efcaa8700 1 --2- 172.21.15.8:0/798100690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef8106a70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80098a0 tx=0x7f5ee8009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.728+0000 7f5efcaa8700 1 -- 172.21.15.8:0/798100690 shutdown_connections 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.728+0000 7f5efcaa8700 1 --2- 172.21.15.8:0/798100690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef8106a70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.728+0000 7f5efcaa8700 1 -- 172.21.15.8:0/798100690 >> 172.21.15.8:0/798100690 conn(0x7f5ef8101bd0 msgr2=0x7f5ef8104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.728+0000 7f5efcaa8700 1 -- 172.21.15.8:0/798100690 shutdown_connections 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.728+0000 7f5efcaa8700 1 -- 172.21.15.8:0/798100690 wait complete. 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.729+0000 7f5efcaa8700 1 Processor -- start 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.729+0000 7f5efcaa8700 1 -- start start 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.730+0000 7f5efcaa8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:13.178 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.730+0000 7f5efcaa8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef819a740 con 0x7f5ef8106650 2023-10-06T23:03:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.730+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.730+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49066/0 (socket says 172.21.15.8:49066) 2023-10-06T23:03:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.730+0000 7f5ef659c700 1 -- 172.21.15.8:0/3998769136 learned_addr learned my addr 172.21.15.8:0/3998769136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.730+0000 7f5ef659c700 1 -- 172.21.15.8:0/3998769136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009550 con 0x7f5ef8106650 2023-10-06T23:03:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.730+0000 7f5ef659c700 1 --2- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef819a200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8000c00 tx=0x7f5ee8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.731+0000 7f5ee77fe700 1 -- 172.21.15.8:0/3998769136 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ee80036a0 con 0x7f5ef8106650 2023-10-06T23:03:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.731+0000 7f5ee77fe700 1 -- 172.21.15.8:0/3998769136 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5ee8003c70 con 0x7f5ef8106650 2023-10-06T23:03:13.179 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.731+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef819a940 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.731+0000 7f5ee77fe700 1 -- 172.21.15.8:0/3998769136 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ee80193f0 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.731+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef819ad60 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.732+0000 7f5ee77fe700 1 -- 172.21.15.8:0/3998769136 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f5ee801b440 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.732+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef80624e0 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.732+0000 7f5ee77fe700 1 --2- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f5ee00388e0 0x7f5ee003ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.732+0000 7f5ee77fe700 1 -- 172.21.15.8:0/3998769136 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5ee804c5f0 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.733+0000 7f5ef5d9b700 1 --2- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f5ee00388e0 0x7f5ee003ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.733+0000 7f5ef5d9b700 1 --2- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f5ee00388e0 0x7f5ee003ada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009940 tx=0x7f5eec006e30 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:11.737+0000 7f5ee77fe700 1 -- 172.21.15.8:0/3998769136 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5ee8022930 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.004+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f5ef819da40 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.752+0000 7f5ee77fe700 1 -- 172.21.15.8:0/3998769136 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f5ee801f070 con 0x7f5ef8106650 2023-10-06T23:03:13.180 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.754+0000 7f5ee77fe700 1 -- 172.21.15.8:0/3998769136 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f5ee8003990 con 0x7f5ef8106650 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f5ee00388e0 msgr2=0x7f5ee003ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 --2- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f5ee00388e0 0x7f5ee003ada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009940 tx=0x7f5eec006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 msgr2=0x7f5ef819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 --2- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef819a200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8000c00 tx=0x7f5ee8011e70 comp rx=0 tx=0).stop 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 shutdown_connections 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 --2- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f5ee00388e0 0x7f5ee003ada0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 --2- 172.21.15.8:0/3998769136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef8106650 0x7f5ef819a200 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 >> 172.21.15.8:0/3998769136 conn(0x7f5ef8101bd0 msgr2=0x7f5ef8102910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 shutdown_connections 2023-10-06T23:03:13.181 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:12.756+0000 7f5efcaa8700 1 -- 172.21.15.8:0/3998769136 wait complete. 2023-10-06T23:03:13.384 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:13.129+0000 7f5a1dc74200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T23:03:13.385 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:13.258+0000 7f5a1dc74200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T23:03:13.385 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:13.382+0000 7f5a1dc74200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T23:03:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:13 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3998769136' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-06T23:03:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:13 smithi008 ceph-mon[98532]: mgrmap e5: x(active, since 4s) 2023-10-06T23:03:13.896 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:13.635+0000 7f5a1dc74200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T23:03:14.300 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:14.129+0000 7f5a1dc74200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T23:03:14.300 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:14.299+0000 7f5a1dc74200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T23:03:14.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-06T23:03:14.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-06T23:03:14.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-06T23:03:14.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-06T23:03:14.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-06T23:03:14.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-06T23:03:14.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.723+0000 7f97173f6700 1 Processor -- start 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.723+0000 7f97173f6700 1 -- start start 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.723+0000 7f97173f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971007a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.723+0000 7f97173f6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971007a890 con 0x7f971007be60 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.723+0000 7f9715192700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971007a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.724+0000 7f9715192700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971007a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49086/0 (socket says 172.21.15.8:49086) 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.724+0000 7f9715192700 1 -- 172.21.15.8:0/3038948262 learned_addr learned my addr 172.21.15.8:0/3038948262 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.724+0000 7f9715192700 1 -- 172.21.15.8:0/3038948262 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971007a9d0 con 0x7f971007be60 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.724+0000 7f9715192700 1 --2- 172.21.15.8:0/3038948262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971007a2c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f970c0098a0 tx=0x7f970c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730a67de142a5e6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.724+0000 7f9707fff700 1 -- 172.21.15.8:0/3038948262 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f970c004160 con 0x7f971007be60 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.724+0000 7f9707fff700 1 -- 172.21.15.8:0/3038948262 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f970c0042c0 con 0x7f971007be60 2023-10-06T23:03:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.724+0000 7f9707fff700 1 -- 172.21.15.8:0/3038948262 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f970c011940 con 0x7f971007be60 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.725+0000 7f97173f6700 1 -- 172.21.15.8:0/3038948262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 msgr2=0x7f971007a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.725+0000 7f97173f6700 1 --2- 172.21.15.8:0/3038948262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971007a2c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f970c0098a0 tx=0x7f970c009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.725+0000 7f97173f6700 1 -- 172.21.15.8:0/3038948262 shutdown_connections 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.725+0000 7f97173f6700 1 --2- 172.21.15.8:0/3038948262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971007a2c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.725+0000 7f97173f6700 1 -- 172.21.15.8:0/3038948262 >> 172.21.15.8:0/3038948262 conn(0x7f9710101bd0 msgr2=0x7f9710104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.725+0000 7f97173f6700 1 -- 172.21.15.8:0/3038948262 shutdown_connections 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.725+0000 7f97173f6700 1 -- 172.21.15.8:0/3038948262 wait complete. 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.726+0000 7f97173f6700 1 Processor -- start 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.727+0000 7f97173f6700 1 -- start start 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.727+0000 7f97173f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.727+0000 7f97173f6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971019c930 con 0x7f971007be60 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.727+0000 7f9715192700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.727+0000 7f9715192700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971019c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49088/0 (socket says 172.21.15.8:49088) 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.727+0000 7f9715192700 1 -- 172.21.15.8:0/3124336110 learned_addr learned my addr 172.21.15.8:0/3124336110 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.728+0000 7f9715192700 1 -- 172.21.15.8:0/3124336110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c009550 con 0x7f971007be60 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.728+0000 7f9715192700 1 --2- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971019c3f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f970c011dc0 tx=0x7f970c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.728+0000 7f97067fc700 1 -- 172.21.15.8:0/3124336110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f970c0037d0 con 0x7f971007be60 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.728+0000 7f97067fc700 1 -- 172.21.15.8:0/3124336110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f970c01b440 con 0x7f971007be60 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.728+0000 7f97067fc700 1 -- 172.21.15.8:0/3124336110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f970c01a560 con 0x7f971007be60 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.728+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971019cb30 con 0x7f971007be60 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.728+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971019cf50 con 0x7f971007be60 2023-10-06T23:03:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.729+0000 7f97067fc700 1 -- 172.21.15.8:0/3124336110 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f970c003930 con 0x7f971007be60 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.729+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971010c9e0 con 0x7f971007be60 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.730+0000 7f97067fc700 1 --2- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f96fc038930 0x7f96fc03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.730+0000 7f97067fc700 1 -- 172.21.15.8:0/3124336110 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f970c04c680 con 0x7f971007be60 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.730+0000 7f9714991700 1 -- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f96fc038930 msgr2=0x7f96fc03adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/166376639 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.730+0000 7f9714991700 1 --2- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f96fc038930 0x7f96fc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.735+0000 7f97067fc700 1 -- 172.21.15.8:0/3124336110 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f970c01b920 con 0x7f971007be60 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.931+0000 7f9714991700 1 -- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f96fc038930 msgr2=0x7f96fc03adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/166376639 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:13.931+0000 7f9714991700 1 --2- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f96fc038930 0x7f96fc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.010+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f971019f990 con 0x7f971007be60 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.010+0000 7f97067fc700 1 -- 172.21.15.8:0/3124336110 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f970c01f020 con 0x7f971007be60 2023-10-06T23:03:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f96fc038930 msgr2=0x7f96fc03adf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 --2- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f96fc038930 0x7f96fc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 msgr2=0x7f971019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 --2- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971019c3f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f970c011dc0 tx=0x7f970c011ea0 comp rx=0 tx=0).stop 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 shutdown_connections 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 --2- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f96fc038930 0x7f96fc03adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 --2- 172.21.15.8:0/3124336110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f971007be60 0x7f971019c3f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 >> 172.21.15.8:0/3124336110 conn(0x7f9710101bd0 msgr2=0x7f97101032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 shutdown_connections 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.013+0000 7f97173f6700 1 -- 172.21.15.8:0/3124336110 wait complete. 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2023-10-06T23:03:14.375 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 5... 2023-10-06T23:03:14.565 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:14.432+0000 7f5a1dc74200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T23:03:14.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:14 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3124336110' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-06T23:03:14.896 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:14.563+0000 7f5a1dc74200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T23:03:15.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:15.127+0000 7f5a1dc74200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T23:03:16.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:16.001+0000 7f5a1dc74200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T23:03:16.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:16.111+0000 7f5a1dc74200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T23:03:17.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:17 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:17.099+0000 7f5a1dc74200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:03:17.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:17 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:17.222+0000 7f5a1dc74200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T23:03:17.827 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:17 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:17.453+0000 7f5a1dc74200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:03:17.827 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:17 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:17.826+0000 7f5a1dc74200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T23:03:18.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:18 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:18.108+0000 7f5a1dc74200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T23:03:18.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:18 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:18.308+0000 7f5a1dc74200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T23:03:19.145 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:18 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:18.661+0000 7f5a1dc74200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T23:03:19.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:19.634+0000 7f5a1dc74200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T23:03:19.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:19.812+0000 7f5a1dc74200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T23:03:20.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:20 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:20.066+0000 7f5a1dc74200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T23:03:20.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:20 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:20.216+0000 7f5a1dc74200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T23:03:20.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:20 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:20.501+0000 7f5a1dc74200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T23:03:21.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:21.607+0000 7f5a1dc74200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T23:03:21.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: Active manager daemon x restarted 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: Activating manager daemon x 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: osdmap e2: 0 total, 0 up, 0 in 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: mgrmap e6: x(active, starting, since 0.00412377s) 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: Manager daemon x is now available 2023-10-06T23:03:21.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:21.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:21.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:03:21.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:03:21.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:21 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:03:22.959 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:22 smithi008 ceph-mon[98532]: Found migration_current of "None". Setting to last migration. 2023-10-06T23:03:22.959 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:22 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-06T23:03:22.959 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:22 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-06T23:03:22.959 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:22 smithi008 ceph-mon[98532]: mgrmap e7: x(active, since 1.00717s) 2023-10-06T23:03:22.976 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-06T23:03:22.977 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-06T23:03:22.977 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-06T23:03:22.977 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-06T23:03:22.977 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.900+0000 7f66d8c7b700 1 Processor -- start 2023-10-06T23:03:22.977 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.901+0000 7f66d8c7b700 1 -- start start 2023-10-06T23:03:22.977 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.901+0000 7f66d8c7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d4106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:22.978 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.901+0000 7f66d8c7b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d4107040 con 0x7f66d4106650 2023-10-06T23:03:22.978 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.901+0000 7f66d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d4106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:22.978 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.901+0000 7f66d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d4106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49102/0 (socket says 172.21.15.8:49102) 2023-10-06T23:03:22.978 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.901+0000 7f66d259c700 1 -- 172.21.15.8:0/1201489428 learned_addr learned my addr 172.21.15.8:0/1201489428 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:22.978 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.902+0000 7f66d259c700 1 -- 172.21.15.8:0/1201489428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d4107850 con 0x7f66d4106650 2023-10-06T23:03:22.978 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.902+0000 7f66d259c700 1 --2- 172.21.15.8:0/1201489428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d4106a70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f66c40098a0 tx=0x7f66c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ecd1fdd3ea62e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:22.979 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.902+0000 7f66d159a700 1 -- 172.21.15.8:0/1201489428 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66c4004160 con 0x7f66d4106650 2023-10-06T23:03:22.979 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.902+0000 7f66d159a700 1 -- 172.21.15.8:0/1201489428 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f66c40042c0 con 0x7f66d4106650 2023-10-06T23:03:22.979 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.902+0000 7f66d159a700 1 -- 172.21.15.8:0/1201489428 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66c4011940 con 0x7f66d4106650 2023-10-06T23:03:22.979 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.903+0000 7f66d8c7b700 1 -- 172.21.15.8:0/1201489428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 msgr2=0x7f66d4106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:22.979 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.903+0000 7f66d8c7b700 1 --2- 172.21.15.8:0/1201489428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d4106a70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f66c40098a0 tx=0x7f66c4009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:22.979 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.903+0000 7f66d8c7b700 1 -- 172.21.15.8:0/1201489428 shutdown_connections 2023-10-06T23:03:22.980 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.903+0000 7f66d8c7b700 1 --2- 172.21.15.8:0/1201489428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d4106a70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:22.980 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.903+0000 7f66d8c7b700 1 -- 172.21.15.8:0/1201489428 >> 172.21.15.8:0/1201489428 conn(0x7f66d4101bd0 msgr2=0x7f66d4104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:22.980 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.903+0000 7f66d8c7b700 1 -- 172.21.15.8:0/1201489428 shutdown_connections 2023-10-06T23:03:22.980 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.903+0000 7f66d8c7b700 1 -- 172.21.15.8:0/1201489428 wait complete. 2023-10-06T23:03:22.980 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.904+0000 7f66d8c7b700 1 Processor -- start 2023-10-06T23:03:22.980 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.905+0000 7f66d8c7b700 1 -- start start 2023-10-06T23:03:22.981 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.905+0000 7f66d8c7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d407bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:22.981 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.905+0000 7f66d8c7b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d407c170 con 0x7f66d4106650 2023-10-06T23:03:22.981 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.905+0000 7f66d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d407bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:22.981 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.906+0000 7f66d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d407bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49108/0 (socket says 172.21.15.8:49108) 2023-10-06T23:03:22.981 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.906+0000 7f66d259c700 1 -- 172.21.15.8:0/3869363863 learned_addr learned my addr 172.21.15.8:0/3869363863 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:22.981 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.906+0000 7f66d259c700 1 -- 172.21.15.8:0/3869363863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4009550 con 0x7f66d4106650 2023-10-06T23:03:22.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.906+0000 7f66d259c700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d407bc30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f66c4000c00 tx=0x7f66c4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:22.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.906+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66c40036a0 con 0x7f66d4106650 2023-10-06T23:03:22.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.906+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f66c4003c70 con 0x7f66d4106650 2023-10-06T23:03:22.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.906+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66c40193f0 con 0x7f66d4106650 2023-10-06T23:03:22.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.906+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d407a280 con 0x7f66d4106650 2023-10-06T23:03:22.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.907+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d407a6a0 con 0x7f66d4106650 2023-10-06T23:03:22.982 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.908+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f66c401b440 con 0x7f66d4106650 2023-10-06T23:03:22.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.908+0000 7f66c37fe700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:22.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.908+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 --> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66bc03b500 con 0x7f66bc038930 2023-10-06T23:03:22.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.908+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f66c404c650 con 0x7f66d4106650 2023-10-06T23:03:22.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.908+0000 7f66d1d9b700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 msgr2=0x7f66bc03adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/166376639 2023-10-06T23:03:22.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:14.908+0000 7f66d1d9b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T23:03:22.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:15.109+0000 7f66d1d9b700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 msgr2=0x7f66bc03adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/166376639 2023-10-06T23:03:22.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:15.109+0000 7f66d1d9b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T23:03:22.983 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:15.510+0000 7f66d1d9b700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 msgr2=0x7f66bc03adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/166376639 2023-10-06T23:03:22.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:15.510+0000 7f66d1d9b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T23:03:22.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:16.311+0000 7f66d1d9b700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 msgr2=0x7f66bc03adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/166376639 2023-10-06T23:03:22.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:16.311+0000 7f66d1d9b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T23:03:22.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:17.912+0000 7f66d1d9b700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 msgr2=0x7f66bc03adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/166376639 2023-10-06T23:03:22.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:17.913+0000 7f66d1d9b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-06T23:03:22.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:21.116+0000 7f66d1d9b700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 msgr2=0x7f66bc03adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/166376639 2023-10-06T23:03:22.984 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:21.116+0000 7f66d1d9b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-10-06T23:03:22.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:21.612+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 6) v1 ==== 45346+0+0 (secure 0 0 0) 0x7f66c401b790 con 0x7f66d4106650 2023-10-06T23:03:22.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:21.612+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 msgr2=0x7f66bc03adf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T23:03:22.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:21.612+0000 7f66c37fe700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:22.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.614+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f66c404e170 con 0x7f66d4106650 2023-10-06T23:03:22.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.614+0000 7f66c37fe700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f66bc03bff0 0x7f66bc03e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:22.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.614+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66bc03b500 con 0x7f66bc03bff0 2023-10-06T23:03:22.985 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.615+0000 7f66d1d9b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f66bc03bff0 0x7f66bc03e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:22.986 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.615+0000 7f66d1d9b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f66bc03bff0 0x7f66bc03e3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f66c8003a60 tx=0x7f66c80092b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:22.986 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.617+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mgr.14116 v2:172.21.15.8:6800/2416919540 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f66bc03b500 con 0x7f66bc03bff0 2023-10-06T23:03:22.986 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.623+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f66d407b7d0 con 0x7f66bc03bff0 2023-10-06T23:03:22.986 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.623+0000 7f66c37fe700 1 -- 172.21.15.8:0/3869363863 <== mgr.14116 v2:172.21.15.8:6800/2416919540 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f66d407b7d0 con 0x7f66bc03bff0 2023-10-06T23:03:22.986 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f66bc03bff0 msgr2=0x7f66bc03e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:22.986 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f66bc03bff0 0x7f66bc03e3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f66c8003a60 tx=0x7f66c80092b0 comp rx=0 tx=0).stop 2023-10-06T23:03:22.986 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 msgr2=0x7f66d407bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d407bc30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f66c4000c00 tx=0x7f66c4011e70 comp rx=0 tx=0).stop 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 shutdown_connections 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f66bc03bff0 0x7f66bc03e3e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66d4106650 0x7f66d407bc30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 --2- 172.21.15.8:0/3869363863 >> [v2:172.21.15.8:6800/166376639,v1:172.21.15.8:6801/166376639] conn(0x7f66bc038930 0x7f66bc03adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 >> 172.21.15.8:0/3869363863 conn(0x7f66d4101bd0 msgr2=0x7f66d4102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 shutdown_connections 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:22.624+0000 7f66d8c7b700 1 -- 172.21.15.8:0/3869363863 wait complete. 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 5 is available 2023-10-06T23:03:22.987 INFO:teuthology.orchestra.run.smithi008.stdout:Setting orchestrator backend to cephadm... 2023-10-06T23:03:23.919 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:23 smithi008 ceph-mon[98532]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-06T23:03:23.919 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:23 smithi008 ceph-mon[98532]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-06T23:03:23.920 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:23 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:23.920 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:23 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:24.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.523+0000 7f7086311700 1 Processor -- start 2023-10-06T23:03:24.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.524+0000 7f7086311700 1 -- start start 2023-10-06T23:03:24.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.524+0000 7f7086311700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708007a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.524+0000 7f7086311700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708007a870 con 0x7f708007be40 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.524+0000 7f707ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708007a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.524+0000 7f707ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708007a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38824/0 (socket says 172.21.15.8:38824) 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.524+0000 7f707ffff700 1 -- 172.21.15.8:0/2430479628 learned_addr learned my addr 172.21.15.8:0/2430479628 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.525+0000 7f707ffff700 1 -- 172.21.15.8:0/2430479628 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708007a9b0 con 0x7f708007be40 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.525+0000 7f707ffff700 1 --2- 172.21.15.8:0/2430479628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708007a2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70700098a0 tx=0x7f7070009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e23fe1781a4aa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.525+0000 7f707effd700 1 -- 172.21.15.8:0/2430479628 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7070004160 con 0x7f708007be40 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.525+0000 7f707effd700 1 -- 172.21.15.8:0/2430479628 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f70700042c0 con 0x7f708007be40 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.525+0000 7f707effd700 1 -- 172.21.15.8:0/2430479628 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7070011940 con 0x7f708007be40 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.526+0000 7f7086311700 1 -- 172.21.15.8:0/2430479628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 msgr2=0x7f708007a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:24.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.526+0000 7f7086311700 1 --2- 172.21.15.8:0/2430479628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708007a2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70700098a0 tx=0x7f7070009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.526+0000 7f7086311700 1 -- 172.21.15.8:0/2430479628 shutdown_connections 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.526+0000 7f7086311700 1 --2- 172.21.15.8:0/2430479628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708007a2a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.526+0000 7f7086311700 1 -- 172.21.15.8:0/2430479628 >> 172.21.15.8:0/2430479628 conn(0x7f7080101bd0 msgr2=0x7f7080104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.526+0000 7f7086311700 1 -- 172.21.15.8:0/2430479628 shutdown_connections 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.526+0000 7f7086311700 1 -- 172.21.15.8:0/2430479628 wait complete. 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.527+0000 7f7086311700 1 Processor -- start 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.527+0000 7f7086311700 1 -- start start 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.527+0000 7f7086311700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.527+0000 7f7086311700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708019c900 con 0x7f708007be40 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.528+0000 7f707ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:24.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.528+0000 7f707ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708019c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38836/0 (socket says 172.21.15.8:38836) 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.528+0000 7f707ffff700 1 -- 172.21.15.8:0/2523836950 learned_addr learned my addr 172.21.15.8:0/2523836950 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.528+0000 7f707ffff700 1 -- 172.21.15.8:0/2523836950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070009550 con 0x7f708007be40 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.528+0000 7f707ffff700 1 --2- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708019c3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7070006af0 tx=0x7f7070011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.529+0000 7f707d7fa700 1 -- 172.21.15.8:0/2523836950 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7070003bf0 con 0x7f708007be40 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.529+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708019cb00 con 0x7f708007be40 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.529+0000 7f707d7fa700 1 -- 172.21.15.8:0/2523836950 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f707001b8b0 con 0x7f708007be40 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.529+0000 7f707d7fa700 1 -- 172.21.15.8:0/2523836950 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70700197b0 con 0x7f708007be40 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.529+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708019cf20 con 0x7f708007be40 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.530+0000 7f707d7fa700 1 -- 172.21.15.8:0/2523836950 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f707001ba20 con 0x7f708007be40 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.530+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70800624e0 con 0x7f708007be40 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.530+0000 7f707d7fa700 1 --2- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f7068038770 0x7f706803ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:24.265 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.530+0000 7f707d7fa700 1 -- 172.21.15.8:0/2523836950 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f707004c9b0 con 0x7f708007be40 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.531+0000 7f707f7fe700 1 --2- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f7068038770 0x7f706803ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.531+0000 7f707f7fe700 1 --2- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f7068038770 0x7f706803ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7074009940 tx=0x7f7074006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.535+0000 7f707d7fa700 1 -- 172.21.15.8:0/2523836950 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f707002bb00 con 0x7f708007be40 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.764+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f70801030d0 con 0x7f7068038770 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.770+0000 7f707d7fa700 1 -- 172.21.15.8:0/2523836950 <== mgr.14116 v2:172.21.15.8:6800/2416919540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f70801030d0 con 0x7f7068038770 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.773+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f7068038770 msgr2=0x7f706803ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.773+0000 7f7086311700 1 --2- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f7068038770 0x7f706803ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7074009940 tx=0x7f7074006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.773+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 msgr2=0x7f708019c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.773+0000 7f7086311700 1 --2- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708019c3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7070006af0 tx=0x7f7070011a30 comp rx=0 tx=0).stop 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.773+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 shutdown_connections 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.773+0000 7f7086311700 1 --2- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f7068038770 0x7f706803ac30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:24.266 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.773+0000 7f7086311700 1 --2- 172.21.15.8:0/2523836950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f708007be40 0x7f708019c3c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:24.267 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.773+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 >> 172.21.15.8:0/2523836950 conn(0x7f7080101bd0 msgr2=0x7f70801029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:24.267 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.774+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 shutdown_connections 2023-10-06T23:03:24.267 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:23.774+0000 7f7086311700 1 -- 172.21.15.8:0/2523836950 wait complete. 2023-10-06T23:03:24.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:24 smithi008 ceph-mon[98532]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:24.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:24 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:24.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:24 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:03:24.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:24 smithi008 ceph-mon[98532]: mgrmap e8: x(active, since 2s) 2023-10-06T23:03:24.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:24 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:03:25.446 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.800+0000 7f39c081c700 1 Processor -- start 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.800+0000 7f39c081c700 1 -- start start 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.800+0000 7f39c081c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.800+0000 7f39c081c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc107040 con 0x7f39bc106650 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.800+0000 7f39ba59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.801+0000 7f39ba59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38846/0 (socket says 172.21.15.8:38846) 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.801+0000 7f39ba59c700 1 -- 172.21.15.8:0/4258312912 learned_addr learned my addr 172.21.15.8:0/4258312912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.801+0000 7f39ba59c700 1 -- 172.21.15.8:0/4258312912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc107850 con 0x7f39bc106650 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.801+0000 7f39ba59c700 1 --2- 172.21.15.8:0/4258312912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc106a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0098a0 tx=0x7f39ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546ea156048b0210 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:25.447 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.801+0000 7f39b959a700 1 -- 172.21.15.8:0/4258312912 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39ac004160 con 0x7f39bc106650 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.801+0000 7f39b959a700 1 -- 172.21.15.8:0/4258312912 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f39ac0042c0 con 0x7f39bc106650 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.801+0000 7f39b959a700 1 -- 172.21.15.8:0/4258312912 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39ac011940 con 0x7f39bc106650 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.802+0000 7f39c081c700 1 -- 172.21.15.8:0/4258312912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 msgr2=0x7f39bc106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.802+0000 7f39c081c700 1 --2- 172.21.15.8:0/4258312912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc106a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0098a0 tx=0x7f39ac009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.802+0000 7f39c081c700 1 -- 172.21.15.8:0/4258312912 shutdown_connections 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.802+0000 7f39c081c700 1 --2- 172.21.15.8:0/4258312912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc106a70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.802+0000 7f39c081c700 1 -- 172.21.15.8:0/4258312912 >> 172.21.15.8:0/4258312912 conn(0x7f39bc101bd0 msgr2=0x7f39bc104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.802+0000 7f39c081c700 1 -- 172.21.15.8:0/4258312912 shutdown_connections 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.802+0000 7f39c081c700 1 -- 172.21.15.8:0/4258312912 wait complete. 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.803+0000 7f39c081c700 1 Processor -- start 2023-10-06T23:03:25.448 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.803+0000 7f39c081c700 1 -- start start 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.804+0000 7f39c081c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.804+0000 7f39c081c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc19a740 con 0x7f39bc106650 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.804+0000 7f39ba59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.804+0000 7f39ba59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc19a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38848/0 (socket says 172.21.15.8:38848) 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.804+0000 7f39ba59c700 1 -- 172.21.15.8:0/3890738525 learned_addr learned my addr 172.21.15.8:0/3890738525 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.804+0000 7f39ba59c700 1 -- 172.21.15.8:0/3890738525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009550 con 0x7f39bc106650 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.804+0000 7f39ba59c700 1 --2- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc19a200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c00 tx=0x7f39ac011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.805+0000 7f39ab7fe700 1 -- 172.21.15.8:0/3890738525 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0036a0 con 0x7f39bc106650 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.805+0000 7f39ab7fe700 1 -- 172.21.15.8:0/3890738525 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f39ac003c70 con 0x7f39bc106650 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.805+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc19a940 con 0x7f39bc106650 2023-10-06T23:03:25.449 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.805+0000 7f39ab7fe700 1 -- 172.21.15.8:0/3890738525 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0193f0 con 0x7f39bc106650 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.805+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc19ad60 con 0x7f39bc106650 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.806+0000 7f39ab7fe700 1 -- 172.21.15.8:0/3890738525 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f39ac003800 con 0x7f39bc106650 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.806+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc0624e0 con 0x7f39bc106650 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.806+0000 7f39ab7fe700 1 --2- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f39a4038930 0x7f39a403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.806+0000 7f39ab7fe700 1 -- 172.21.15.8:0/3890738525 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f39ac04c700 con 0x7f39bc106650 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.807+0000 7f39b9d9b700 1 --2- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f39a4038930 0x7f39a403adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.807+0000 7f39b9d9b700 1 --2- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f39a4038930 0x7f39a403adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009940 tx=0x7f39b0006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:24.811+0000 7f39ab7fe700 1 -- 172.21.15.8:0/3890738525 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f39ac0229b0 con 0x7f39bc106650 2023-10-06T23:03:25.450 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.025+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f39bc103040 con 0x7f39a4038930 2023-10-06T23:03:25.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.026+0000 7f39ab7fe700 1 -- 172.21.15.8:0/3890738525 <== mgr.14116 v2:172.21.15.8:6800/2416919540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f39bc103040 con 0x7f39a4038930 2023-10-06T23:03:25.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.028+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f39a4038930 msgr2=0x7f39a403adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.028+0000 7f39c081c700 1 --2- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f39a4038930 0x7f39a403adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009940 tx=0x7f39b0006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.028+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 msgr2=0x7f39bc19a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.028+0000 7f39c081c700 1 --2- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc19a200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c00 tx=0x7f39ac011e70 comp rx=0 tx=0).stop 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.029+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 shutdown_connections 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.029+0000 7f39c081c700 1 --2- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f39a4038930 0x7f39a403adf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.029+0000 7f39c081c700 1 --2- 172.21.15.8:0/3890738525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39bc106650 0x7f39bc19a200 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.029+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 >> 172.21.15.8:0/3890738525 conn(0x7f39bc101bd0 msgr2=0x7f39bc102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.029+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 shutdown_connections 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.029+0000 7f39c081c700 1 -- 172.21.15.8:0/3890738525 wait complete. 2023-10-06T23:03:25.453 INFO:teuthology.orchestra.run.smithi008.stdout:Generating ssh key... 2023-10-06T23:03:26.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:25 smithi008 ceph-mon[98532]: [06/Oct/2023:23:03:24] ENGINE Bus STARTING 2023-10-06T23:03:26.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:25 smithi008 ceph-mon[98532]: [06/Oct/2023:23:03:24] ENGINE Serving on http://172.21.15.8:8765 2023-10-06T23:03:26.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:25 smithi008 ceph-mon[98532]: [06/Oct/2023:23:03:24] ENGINE Serving on https://172.21.15.8:7150 2023-10-06T23:03:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:25 smithi008 ceph-mon[98532]: [06/Oct/2023:23:03:24] ENGINE Bus STARTED 2023-10-06T23:03:26.772 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: Generating public/private rsa key pair. 2023-10-06T23:03:26.772 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: Your identification has been saved in /tmp/tmp32o_t0ks/key. 2023-10-06T23:03:26.772 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: Your public key has been saved in /tmp/tmp32o_t0ks/key.pub. 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: The key fingerprint is: 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: SHA256:UD+m8YI0+bhMGyLGAopxhOenrt75MaI5P0llajXpghA ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: The key's randomart image is: 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: +---[RSA 3072]----+ 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: | .. . | 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: |E.. o . | 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: |o+. * . + | 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: |=+. .B * = . | 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: |= =oB * S . | 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: | +.* = + . | 2023-10-06T23:03:26.773 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: | .o.oo+ | 2023-10-06T23:03:26.774 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: | .=oo o | 2023-10-06T23:03:26.774 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: |o=o+o. | 2023-10-06T23:03:26.774 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: +----[SHA256]-----+ 2023-10-06T23:03:26.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.939+0000 7f866ff89700 1 Processor -- start 2023-10-06T23:03:26.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.939+0000 7f866ff89700 1 -- start start 2023-10-06T23:03:26.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.939+0000 7f866ff89700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f8668106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:26.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.939+0000 7f866ff89700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668107040 con 0x7f8668106650 2023-10-06T23:03:26.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.939+0000 7f866dd25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f8668106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:26.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.940+0000 7f866dd25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f8668106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38854/0 (socket says 172.21.15.8:38854) 2023-10-06T23:03:26.928 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.940+0000 7f866dd25700 1 -- 172.21.15.8:0/4063422262 learned_addr learned my addr 172.21.15.8:0/4063422262 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.940+0000 7f866dd25700 1 -- 172.21.15.8:0/4063422262 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668107850 con 0x7f8668106650 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.940+0000 7f866dd25700 1 --2- 172.21.15.8:0/4063422262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f8668106a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86640098a0 tx=0x7f8664009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d03b5c2a9176de9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.940+0000 7f866cd23700 1 -- 172.21.15.8:0/4063422262 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8664004160 con 0x7f8668106650 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.940+0000 7f866cd23700 1 -- 172.21.15.8:0/4063422262 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f86640042c0 con 0x7f8668106650 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.940+0000 7f866cd23700 1 -- 172.21.15.8:0/4063422262 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8664011940 con 0x7f8668106650 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.941+0000 7f866ff89700 1 -- 172.21.15.8:0/4063422262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 msgr2=0x7f8668106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.941+0000 7f866ff89700 1 --2- 172.21.15.8:0/4063422262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f8668106a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86640098a0 tx=0x7f8664009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.941+0000 7f866ff89700 1 -- 172.21.15.8:0/4063422262 shutdown_connections 2023-10-06T23:03:26.929 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.941+0000 7f866ff89700 1 --2- 172.21.15.8:0/4063422262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f8668106a70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.941+0000 7f866ff89700 1 -- 172.21.15.8:0/4063422262 >> 172.21.15.8:0/4063422262 conn(0x7f8668101bd0 msgr2=0x7f8668104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.941+0000 7f866ff89700 1 -- 172.21.15.8:0/4063422262 shutdown_connections 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.941+0000 7f866ff89700 1 -- 172.21.15.8:0/4063422262 wait complete. 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.942+0000 7f866ff89700 1 Processor -- start 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.942+0000 7f866ff89700 1 -- start start 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.943+0000 7f866ff89700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f866819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.943+0000 7f866ff89700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866819c980 con 0x7f8668106650 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.943+0000 7f866dd25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f866819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.943+0000 7f866dd25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f866819c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38870/0 (socket says 172.21.15.8:38870) 2023-10-06T23:03:26.930 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.943+0000 7f866dd25700 1 -- 172.21.15.8:0/3158002345 learned_addr learned my addr 172.21.15.8:0/3158002345 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.943+0000 7f866dd25700 1 -- 172.21.15.8:0/3158002345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664009550 con 0x7f8668106650 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.944+0000 7f866dd25700 1 --2- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f866819c440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8664006af0 tx=0x7f8664011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.944+0000 7f865effd700 1 -- 172.21.15.8:0/3158002345 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8664003bf0 con 0x7f8668106650 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.944+0000 7f865effd700 1 -- 172.21.15.8:0/3158002345 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f866401b8b0 con 0x7f8668106650 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.944+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866819cb80 con 0x7f8668106650 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.944+0000 7f865effd700 1 -- 172.21.15.8:0/3158002345 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86640197e0 con 0x7f8668106650 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.944+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866819cfa0 con 0x7f8668106650 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.945+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86680624e0 con 0x7f8668106650 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.945+0000 7f865effd700 1 -- 172.21.15.8:0/3158002345 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f866401ba20 con 0x7f8668106650 2023-10-06T23:03:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.946+0000 7f865effd700 1 --2- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f86540388e0 0x7f865403ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.946+0000 7f865effd700 1 -- 172.21.15.8:0/3158002345 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f866404cb60 con 0x7f8668106650 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.946+0000 7f866d524700 1 --2- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f86540388e0 0x7f865403ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.947+0000 7f866d524700 1 --2- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f86540388e0 0x7f865403ada0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8658009940 tx=0x7f8658006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:25.950+0000 7f865effd700 1 -- 172.21.15.8:0/3158002345 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8664018920 con 0x7f8668106650 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.159+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8668103040 con 0x7f86540388e0 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.528+0000 7f865effd700 1 -- 172.21.15.8:0/3158002345 <== mgr.14116 v2:172.21.15.8:6800/2416919540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8668103040 con 0x7f86540388e0 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.530+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f86540388e0 msgr2=0x7f865403ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.530+0000 7f866ff89700 1 --2- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f86540388e0 0x7f865403ada0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8658009940 tx=0x7f8658006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:26.932 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.530+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 msgr2=0x7f866819c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:26.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.530+0000 7f866ff89700 1 --2- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f866819c440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8664006af0 tx=0x7f8664011a30 comp rx=0 tx=0).stop 2023-10-06T23:03:26.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.531+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 shutdown_connections 2023-10-06T23:03:26.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.531+0000 7f866ff89700 1 --2- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f86540388e0 0x7f865403ada0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:26.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.531+0000 7f866ff89700 1 --2- 172.21.15.8:0/3158002345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8668106650 0x7f866819c440 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:26.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.531+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 >> 172.21.15.8:0/3158002345 conn(0x7f8668101bd0 msgr2=0x7f8668102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:26.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.531+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 shutdown_connections 2023-10-06T23:03:26.933 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:26.531+0000 7f866ff89700 1 -- 172.21.15.8:0/3158002345 wait complete. 2023-10-06T23:03:27.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-mon[98532]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:27.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:27.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:26 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:28.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:27 smithi008 ceph-mon[98532]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:28.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:27 smithi008 ceph-mon[98532]: Generating ssh key... 2023-10-06T23:03:28.111 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/cVvm+uROm4ZDs2HFk4lUIAlezua590J5E7vak2LQ9cKIocp2JD6Yaq4t46cuU3A3R5pDt3pbzakip/tSXpeGP+BCClDpkz/WYoCmoXobWiO7HbB2ubJa3HQuRv/CFgHJRCE2sYEL+ZTvr19qCeaeP8i6wxRuJ5LwNslV5Sd5CH+FB1nis7n9YJRaxUQ97Nr9JeBgtcHx4/Rt0ToWuVx7ofpmu0Pb5Krbcst/Zc7YbyfZR0ElLzhSTBdpzLg81Nt2uFvUgdzDgbTEKknhGrOUEYBVp8aixSSweTBnvVjdlqpbu+ZUbnPK6LtpSOK6Jd+KzEOrgPo6S7gYZ3ordR5eQJ5MtWxdXBL+ovEnFPLu80flfwgs58xWRu79T2f5zzRU8uPCbhC/vLZd51u+etqBrM5JP5VP49ZI4iItefsmbvvqGsyphbRQAMOehIFbldfZtKuuvjA6He0wmCLPa+wrb/+CAsTn4aWs1d7dvST4bSPA2KBZAC36yaEV8ASyLSs= ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:03:28.111 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.429+0000 7f025b45d700 1 Processor -- start 2023-10-06T23:03:28.111 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.430+0000 7f025b45d700 1 -- start start 2023-10-06T23:03:28.112 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.430+0000 7f025b45d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f0254109320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:28.112 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.430+0000 7f025b45d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0254079e50 con 0x7f0254106f30 2023-10-06T23:03:28.112 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.430+0000 7f025a45b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f0254109320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:28.112 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.430+0000 7f025a45b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f0254109320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38886/0 (socket says 172.21.15.8:38886) 2023-10-06T23:03:28.112 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.430+0000 7f025a45b700 1 -- 172.21.15.8:0/711530677 learned_addr learned my addr 172.21.15.8:0/711530677 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:28.112 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.431+0000 7f025a45b700 1 -- 172.21.15.8:0/711530677 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254109860 con 0x7f0254106f30 2023-10-06T23:03:28.112 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.431+0000 7f025a45b700 1 --2- 172.21.15.8:0/711530677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f0254109320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f02500098a0 tx=0x7f0250009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42059b41f43cffc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.431+0000 7f0259459700 1 -- 172.21.15.8:0/711530677 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0250004160 con 0x7f0254106f30 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.431+0000 7f0259459700 1 -- 172.21.15.8:0/711530677 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f02500042c0 con 0x7f0254106f30 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.431+0000 7f0259459700 1 -- 172.21.15.8:0/711530677 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0250011940 con 0x7f0254106f30 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.432+0000 7f025b45d700 1 -- 172.21.15.8:0/711530677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 msgr2=0x7f0254109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.432+0000 7f025b45d700 1 --2- 172.21.15.8:0/711530677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f0254109320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f02500098a0 tx=0x7f0250009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.432+0000 7f025b45d700 1 -- 172.21.15.8:0/711530677 shutdown_connections 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.432+0000 7f025b45d700 1 --2- 172.21.15.8:0/711530677 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f0254109320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.432+0000 7f025b45d700 1 -- 172.21.15.8:0/711530677 >> 172.21.15.8:0/711530677 conn(0x7f0254100920 msgr2=0x7f0254102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:28.113 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.432+0000 7f025b45d700 1 -- 172.21.15.8:0/711530677 shutdown_connections 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.432+0000 7f025b45d700 1 -- 172.21.15.8:0/711530677 wait complete. 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.433+0000 7f025b45d700 1 Processor -- start 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.433+0000 7f025b45d700 1 -- start start 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.433+0000 7f025b45d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f025419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.433+0000 7f025b45d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025419a830 con 0x7f0254106f30 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.434+0000 7f025a45b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f025419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.434+0000 7f025a45b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f025419a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38890/0 (socket says 172.21.15.8:38890) 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.434+0000 7f025a45b700 1 -- 172.21.15.8:0/1483116203 learned_addr learned my addr 172.21.15.8:0/1483116203 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.434+0000 7f025a45b700 1 -- 172.21.15.8:0/1483116203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250009550 con 0x7f0254106f30 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.434+0000 7f025a45b700 1 --2- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f025419a2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0250011dc0 tx=0x7f0250011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:28.114 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.435+0000 7f024b7fe700 1 -- 172.21.15.8:0/1483116203 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02500037d0 con 0x7f0254106f30 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.435+0000 7f024b7fe700 1 -- 172.21.15.8:0/1483116203 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f025001b440 con 0x7f0254106f30 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.435+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025419aa30 con 0x7f0254106f30 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.435+0000 7f024b7fe700 1 -- 172.21.15.8:0/1483116203 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f025001a560 con 0x7f0254106f30 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.435+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025419ae50 con 0x7f0254106f30 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.436+0000 7f024b7fe700 1 -- 172.21.15.8:0/1483116203 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f025001b5b0 con 0x7f0254106f30 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.436+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0254194210 con 0x7f0254106f30 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.436+0000 7f024b7fe700 1 --2- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f0240038930 0x7f024003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.436+0000 7f024b7fe700 1 -- 172.21.15.8:0/1483116203 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f025004c6c0 con 0x7f0254106f30 2023-10-06T23:03:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.437+0000 7f0259c5a700 1 --2- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f0240038930 0x7f024003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:28.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.437+0000 7f0259c5a700 1 --2- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f0240038930 0x7f024003adf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0244006fd0 tx=0x7f0244006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:28.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.442+0000 7f024b7fe700 1 -- 172.21.15.8:0/1483116203 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0250023590 con 0x7f0254106f30 2023-10-06T23:03:28.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.650+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f025410a880 con 0x7f0240038930 2023-10-06T23:03:28.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.651+0000 7f024b7fe700 1 -- 172.21.15.8:0/1483116203 <== mgr.14116 v2:172.21.15.8:6800/2416919540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f025410a880 con 0x7f0240038930 2023-10-06T23:03:28.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f0240038930 msgr2=0x7f024003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:28.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 --2- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f0240038930 0x7f024003adf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0244006fd0 tx=0x7f0244006e40 comp rx=0 tx=0).stop 2023-10-06T23:03:28.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 msgr2=0x7f025419a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:28.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 --2- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f025419a2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0250011dc0 tx=0x7f0250011ea0 comp rx=0 tx=0).stop 2023-10-06T23:03:28.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 shutdown_connections 2023-10-06T23:03:28.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 --2- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f0240038930 0x7f024003adf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:28.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 --2- 172.21.15.8:0/1483116203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0254106f30 0x7f025419a2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:28.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 >> 172.21.15.8:0/1483116203 conn(0x7f0254100920 msgr2=0x7f0254101840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:28.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 shutdown_connections 2023-10-06T23:03:28.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:27.653+0000 7f025b45d700 1 -- 172.21.15.8:0/1483116203 wait complete. 2023-10-06T23:03:28.118 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-06T23:03:28.118 INFO:teuthology.orchestra.run.smithi008.stdout:Adding key to root@localhost authorized_keys... 2023-10-06T23:03:28.118 INFO:teuthology.orchestra.run.smithi008.stdout:Adding host smithi008... 2023-10-06T23:03:29.047 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:28 smithi008 ceph-mon[98532]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:30.102 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:29 smithi008 ceph-mon[98532]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:31.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:30 smithi008 ceph-mon[98532]: Deploying cephadm binary to smithi008 2023-10-06T23:03:32.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Added host 'smithi008' with addr '172.21.15.8' 2023-10-06T23:03:32.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.600+0000 7f0038e18700 1 Processor -- start 2023-10-06T23:03:32.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.600+0000 7f0038e18700 1 -- start start 2023-10-06T23:03:32.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.600+0000 7f0038e18700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003407a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:32.697 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.600+0000 7f0038e18700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003407a890 con 0x7f003407be60 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.600+0000 7f003259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003407a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.600+0000 7f003259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003407a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38894/0 (socket says 172.21.15.8:38894) 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.600+0000 7f003259c700 1 -- 172.21.15.8:0/2071856625 learned_addr learned my addr 172.21.15.8:0/2071856625 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.601+0000 7f003259c700 1 -- 172.21.15.8:0/2071856625 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003407a9d0 con 0x7f003407be60 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.601+0000 7f003259c700 1 --2- 172.21.15.8:0/2071856625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003407a2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00240098a0 tx=0x7f0024009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c750a9d1e55fc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.601+0000 7f003159a700 1 -- 172.21.15.8:0/2071856625 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0024004160 con 0x7f003407be60 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.601+0000 7f003159a700 1 -- 172.21.15.8:0/2071856625 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f00240042c0 con 0x7f003407be60 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.601+0000 7f003159a700 1 -- 172.21.15.8:0/2071856625 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0024011940 con 0x7f003407be60 2023-10-06T23:03:32.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.602+0000 7f0038e18700 1 -- 172.21.15.8:0/2071856625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 msgr2=0x7f003407a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:32.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.602+0000 7f0038e18700 1 --2- 172.21.15.8:0/2071856625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003407a2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00240098a0 tx=0x7f0024009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:32.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.602+0000 7f0038e18700 1 -- 172.21.15.8:0/2071856625 shutdown_connections 2023-10-06T23:03:32.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.602+0000 7f0038e18700 1 --2- 172.21.15.8:0/2071856625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003407a2c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:32.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.602+0000 7f0038e18700 1 -- 172.21.15.8:0/2071856625 >> 172.21.15.8:0/2071856625 conn(0x7f0034101bd0 msgr2=0x7f0034104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:32.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.602+0000 7f0038e18700 1 -- 172.21.15.8:0/2071856625 shutdown_connections 2023-10-06T23:03:32.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.602+0000 7f0038e18700 1 -- 172.21.15.8:0/2071856625 wait complete. 2023-10-06T23:03:32.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.603+0000 7f0038e18700 1 Processor -- start 2023-10-06T23:03:32.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.603+0000 7f0038e18700 1 -- start start 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.604+0000 7f0038e18700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.604+0000 7f0038e18700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003419c900 con 0x7f003407be60 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.604+0000 7f003259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.604+0000 7f003259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003419c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38902/0 (socket says 172.21.15.8:38902) 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.604+0000 7f003259c700 1 -- 172.21.15.8:0/876652586 learned_addr learned my addr 172.21.15.8:0/876652586 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.604+0000 7f003259c700 1 -- 172.21.15.8:0/876652586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024009550 con 0x7f003407be60 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.604+0000 7f003259c700 1 --2- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003419c3c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0024011dc0 tx=0x7f0024011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.605+0000 7f00237fe700 1 -- 172.21.15.8:0/876652586 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00240037d0 con 0x7f003407be60 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.605+0000 7f00237fe700 1 -- 172.21.15.8:0/876652586 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f002401b440 con 0x7f003407be60 2023-10-06T23:03:32.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.605+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003419cb00 con 0x7f003407be60 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.605+0000 7f00237fe700 1 -- 172.21.15.8:0/876652586 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f002401a560 con 0x7f003407be60 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.605+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003419cf20 con 0x7f003407be60 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.606+0000 7f00237fe700 1 -- 172.21.15.8:0/876652586 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f002401b5b0 con 0x7f003407be60 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.606+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003410c9e0 con 0x7f003407be60 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.606+0000 7f00237fe700 1 --2- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f001c038930 0x7f001c03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.606+0000 7f00237fe700 1 -- 172.21.15.8:0/876652586 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f002404c780 con 0x7f003407be60 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.607+0000 7f0031d9b700 1 --2- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f001c038930 0x7f001c03adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.607+0000 7f0031d9b700 1 --2- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f001c038930 0x7f001c03adf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0028009940 tx=0x7f0028006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.611+0000 7f00237fe700 1 -- 172.21.15.8:0/876652586 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0024023590 con 0x7f003407be60 2023-10-06T23:03:32.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:28.829+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}) v1 -- 0x7f003419f960 con 0x7f001c038930 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.249+0000 7f00237fe700 1 -- 172.21.15.8:0/876652586 <== mgr.14116 v2:172.21.15.8:6800/2416919540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f003419f960 con 0x7f001c038930 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.252+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f001c038930 msgr2=0x7f001c03adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.252+0000 7f0038e18700 1 --2- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f001c038930 0x7f001c03adf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0028009940 tx=0x7f0028006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.252+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 msgr2=0x7f003419c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.252+0000 7f0038e18700 1 --2- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003419c3c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0024011dc0 tx=0x7f0024011ea0 comp rx=0 tx=0).stop 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.252+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 shutdown_connections 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.252+0000 7f0038e18700 1 --2- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f001c038930 0x7f001c03adf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.252+0000 7f0038e18700 1 --2- 172.21.15.8:0/876652586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f003407be60 0x7f003419c3c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.252+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 >> 172.21.15.8:0/876652586 conn(0x7f0034101bd0 msgr2=0x7f00341029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:32.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.253+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 shutdown_connections 2023-10-06T23:03:32.703 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:32.253+0000 7f0038e18700 1 -- 172.21.15.8:0/876652586 wait complete. 2023-10-06T23:03:32.703 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mon service... 2023-10-06T23:03:33.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:33 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:33.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:33 smithi008 ceph-mon[98532]: Added host smithi008 2023-10-06T23:03:33.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:33 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:03:34.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-06T23:03:34.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.364+0000 7f176c064700 1 Processor -- start 2023-10-06T23:03:34.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.365+0000 7f176c064700 1 -- start start 2023-10-06T23:03:34.079 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.365+0000 7f176c064700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f1764106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.365+0000 7f176c064700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764107040 con 0x7f1764106650 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.365+0000 7f1769e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f1764106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.365+0000 7f1769e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f1764106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54850/0 (socket says 172.21.15.8:54850) 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.365+0000 7f1769e00700 1 -- 172.21.15.8:0/1075917815 learned_addr learned my addr 172.21.15.8:0/1075917815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.366+0000 7f1769e00700 1 -- 172.21.15.8:0/1075917815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764107850 con 0x7f1764106650 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.366+0000 7f1769e00700 1 --2- 172.21.15.8:0/1075917815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f1764106a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17600098a0 tx=0x7f1760009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2554c921ad6ef1c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.366+0000 7f1768dfe700 1 -- 172.21.15.8:0/1075917815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1760004160 con 0x7f1764106650 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.366+0000 7f1768dfe700 1 -- 172.21.15.8:0/1075917815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f17600042c0 con 0x7f1764106650 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.366+0000 7f1768dfe700 1 -- 172.21.15.8:0/1075917815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1760011940 con 0x7f1764106650 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.367+0000 7f176c064700 1 -- 172.21.15.8:0/1075917815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 msgr2=0x7f1764106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.367+0000 7f176c064700 1 --2- 172.21.15.8:0/1075917815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f1764106a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17600098a0 tx=0x7f1760009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.367+0000 7f176c064700 1 -- 172.21.15.8:0/1075917815 shutdown_connections 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.367+0000 7f176c064700 1 --2- 172.21.15.8:0/1075917815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f1764106a70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.367+0000 7f176c064700 1 -- 172.21.15.8:0/1075917815 >> 172.21.15.8:0/1075917815 conn(0x7f1764101bd0 msgr2=0x7f1764104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.367+0000 7f176c064700 1 -- 172.21.15.8:0/1075917815 shutdown_connections 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.367+0000 7f176c064700 1 -- 172.21.15.8:0/1075917815 wait complete. 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.368+0000 7f176c064700 1 Processor -- start 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.368+0000 7f176c064700 1 -- start start 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.369+0000 7f176c064700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f176407bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.369+0000 7f176c064700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176407c170 con 0x7f1764106650 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.369+0000 7f1769e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f176407bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:34.081 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.369+0000 7f1769e00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f176407bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54856/0 (socket says 172.21.15.8:54856) 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.369+0000 7f1769e00700 1 -- 172.21.15.8:0/4228854651 learned_addr learned my addr 172.21.15.8:0/4228854651 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.369+0000 7f1769e00700 1 -- 172.21.15.8:0/4228854651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009550 con 0x7f1764106650 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.369+0000 7f1769e00700 1 --2- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f176407bc30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1760000c00 tx=0x7f1760011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.370+0000 7f175affd700 1 -- 172.21.15.8:0/4228854651 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17600036a0 con 0x7f1764106650 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.370+0000 7f175affd700 1 -- 172.21.15.8:0/4228854651 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1760003c70 con 0x7f1764106650 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.370+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176407a280 con 0x7f1764106650 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.370+0000 7f175affd700 1 -- 172.21.15.8:0/4228854651 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17600193f0 con 0x7f1764106650 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.370+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176407a6a0 con 0x7f1764106650 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.371+0000 7f175affd700 1 -- 172.21.15.8:0/4228854651 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f1760003800 con 0x7f1764106650 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.371+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17640624e0 con 0x7f1764106650 2023-10-06T23:03:34.082 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.371+0000 7f175affd700 1 --2- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f17500388e0 0x7f175003ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.371+0000 7f175affd700 1 -- 172.21.15.8:0/4228854651 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f176004c780 con 0x7f1764106650 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.372+0000 7f17695ff700 1 --2- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f17500388e0 0x7f175003ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.372+0000 7f17695ff700 1 --2- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f17500388e0 0x7f175003ada0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1754009940 tx=0x7f1754006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.376+0000 7f175affd700 1 -- 172.21.15.8:0/4228854651 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1760022540 con 0x7f1764106650 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.600+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f176407ae10 con 0x7f17500388e0 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.605+0000 7f175affd700 1 -- 172.21.15.8:0/4228854651 <== mgr.14116 v2:172.21.15.8:6800/2416919540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f176407ae10 con 0x7f17500388e0 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f17500388e0 msgr2=0x7f175003ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 --2- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f17500388e0 0x7f175003ada0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1754009940 tx=0x7f1754006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 msgr2=0x7f176407bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 --2- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f176407bc30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1760000c00 tx=0x7f1760011e70 comp rx=0 tx=0).stop 2023-10-06T23:03:34.083 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 shutdown_connections 2023-10-06T23:03:34.084 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 --2- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f17500388e0 0x7f175003ada0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:34.084 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 --2- 172.21.15.8:0/4228854651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1764106650 0x7f176407bc30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:34.084 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 >> 172.21.15.8:0/4228854651 conn(0x7f1764101bd0 msgr2=0x7f1764102910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:34.084 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 shutdown_connections 2023-10-06T23:03:34.084 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:33.608+0000 7f176c064700 1 -- 172.21.15.8:0/4228854651 wait complete. 2023-10-06T23:03:34.084 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mgr service... 2023-10-06T23:03:34.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:34 smithi008 ceph-mon[98532]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:34.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:34 smithi008 ceph-mon[98532]: Saving service mon spec with placement count:5 2023-10-06T23:03:34.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:34 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:35.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-06T23:03:35.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.007+0000 7fbd87039700 1 Processor -- start 2023-10-06T23:03:35.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.008+0000 7fbd87039700 1 -- start start 2023-10-06T23:03:35.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.008+0000 7fbd87039700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8007a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:35.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.008+0000 7fbd87039700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8007a870 con 0x7fbd8007be40 2023-10-06T23:03:35.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.008+0000 7fbd84dd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8007a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:35.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.008+0000 7fbd84dd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8007a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54862/0 (socket says 172.21.15.8:54862) 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.008+0000 7fbd84dd5700 1 -- 172.21.15.8:0/2549794768 learned_addr learned my addr 172.21.15.8:0/2549794768 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.009+0000 7fbd84dd5700 1 -- 172.21.15.8:0/2549794768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8007a9b0 con 0x7fbd8007be40 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.009+0000 7fbd84dd5700 1 --2- 172.21.15.8:0/2549794768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8007a2a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd740098a0 tx=0x7fbd74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9df1ef8e763e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.009+0000 7fbd7f7fe700 1 -- 172.21.15.8:0/2549794768 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd74004160 con 0x7fbd8007be40 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.009+0000 7fbd7f7fe700 1 -- 172.21.15.8:0/2549794768 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fbd740042c0 con 0x7fbd8007be40 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.009+0000 7fbd7f7fe700 1 -- 172.21.15.8:0/2549794768 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd74011940 con 0x7fbd8007be40 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.010+0000 7fbd87039700 1 -- 172.21.15.8:0/2549794768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 msgr2=0x7fbd8007a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.010+0000 7fbd87039700 1 --2- 172.21.15.8:0/2549794768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8007a2a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd740098a0 tx=0x7fbd74009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.010+0000 7fbd87039700 1 -- 172.21.15.8:0/2549794768 shutdown_connections 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.010+0000 7fbd87039700 1 --2- 172.21.15.8:0/2549794768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8007a2a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.010+0000 7fbd87039700 1 -- 172.21.15.8:0/2549794768 >> 172.21.15.8:0/2549794768 conn(0x7fbd80101bd0 msgr2=0x7fbd80104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.010+0000 7fbd87039700 1 -- 172.21.15.8:0/2549794768 shutdown_connections 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.010+0000 7fbd87039700 1 -- 172.21.15.8:0/2549794768 wait complete. 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.011+0000 7fbd87039700 1 Processor -- start 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.012+0000 7fbd87039700 1 -- start start 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.012+0000 7fbd87039700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.012+0000 7fbd87039700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8019c900 con 0x7fbd8007be40 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.012+0000 7fbd84dd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.012+0000 7fbd84dd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8019c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54864/0 (socket says 172.21.15.8:54864) 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.012+0000 7fbd84dd5700 1 -- 172.21.15.8:0/1491726659 learned_addr learned my addr 172.21.15.8:0/1491726659 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.013+0000 7fbd84dd5700 1 -- 172.21.15.8:0/1491726659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74009550 con 0x7fbd8007be40 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.013+0000 7fbd84dd5700 1 --2- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8019c3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd74011dc0 tx=0x7fbd74011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:35.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.013+0000 7fbd7dffb700 1 -- 172.21.15.8:0/1491726659 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd740037d0 con 0x7fbd8007be40 2023-10-06T23:03:35.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.013+0000 7fbd7dffb700 1 -- 172.21.15.8:0/1491726659 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fbd7401b440 con 0x7fbd8007be40 2023-10-06T23:03:35.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.013+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8019cb00 con 0x7fbd8007be40 2023-10-06T23:03:35.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.013+0000 7fbd7dffb700 1 -- 172.21.15.8:0/1491726659 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd7401a560 con 0x7fbd8007be40 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.013+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8019cf20 con 0x7fbd8007be40 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.015+0000 7fbd7dffb700 1 -- 172.21.15.8:0/1491726659 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fbd74003930 con 0x7fbd8007be40 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.014+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd800624e0 con 0x7fbd8007be40 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.015+0000 7fbd7dffb700 1 --2- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbd70038930 0x7fbd7003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.015+0000 7fbd7dffb700 1 -- 172.21.15.8:0/1491726659 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbd7404c6b0 con 0x7fbd8007be40 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.015+0000 7fbd7ffff700 1 --2- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbd70038930 0x7fbd7003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.016+0000 7fbd7ffff700 1 --2- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbd70038930 0x7fbd7003adf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009940 tx=0x7fbd6c006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.023+0000 7fbd7dffb700 1 -- 172.21.15.8:0/1491726659 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd7401b920 con 0x7fbd8007be40 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.047+0000 7fbd7dffb700 1 -- 172.21.15.8:0/1491726659 <== mon.0 v2:172.21.15.8:3300/0 7 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd7404c0c0 con 0x7fbd8007be40 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.251+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fbd801030d0 con 0x7fbd70038930 2023-10-06T23:03:35.683 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.256+0000 7fbd7dffb700 1 -- 172.21.15.8:0/1491726659 <== mgr.14116 v2:172.21.15.8:6800/2416919540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbd801030d0 con 0x7fbd70038930 2023-10-06T23:03:35.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbd70038930 msgr2=0x7fbd7003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:35.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 --2- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbd70038930 0x7fbd7003adf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009940 tx=0x7fbd6c006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:35.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 msgr2=0x7fbd8019c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:35.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 --2- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8019c3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd74011dc0 tx=0x7fbd74011ea0 comp rx=0 tx=0).stop 2023-10-06T23:03:35.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 shutdown_connections 2023-10-06T23:03:35.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 --2- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbd70038930 0x7fbd7003adf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:35.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 --2- 172.21.15.8:0/1491726659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd8007be40 0x7fbd8019c3c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:35.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 >> 172.21.15.8:0/1491726659 conn(0x7fbd80101bd0 msgr2=0x7fbd801029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:35.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 shutdown_connections 2023-10-06T23:03:35.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:35.259+0000 7fbd87039700 1 -- 172.21.15.8:0/1491726659 wait complete. 2023-10-06T23:03:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:36 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:36 smithi008 ceph-mon[98532]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:36 smithi008 ceph-mon[98532]: Saving service mgr spec with placement count:2 2023-10-06T23:03:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:36 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:36 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:36.965 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.313+0000 7ff5c53c6700 1 Processor -- start 2023-10-06T23:03:36.965 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.313+0000 7ff5c53c6700 1 -- start start 2023-10-06T23:03:36.965 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.314+0000 7ff5c53c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c007a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:36.966 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.314+0000 7ff5c53c6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c007a870 con 0x7ff5c007be40 2023-10-06T23:03:36.966 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.314+0000 7ff5beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c007a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:36.966 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.314+0000 7ff5beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c007a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54866/0 (socket says 172.21.15.8:54866) 2023-10-06T23:03:36.966 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.314+0000 7ff5beffd700 1 -- 172.21.15.8:0/3452047472 learned_addr learned my addr 172.21.15.8:0/3452047472 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:36.966 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.314+0000 7ff5beffd700 1 -- 172.21.15.8:0/3452047472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c007a9b0 con 0x7ff5c007be40 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.315+0000 7ff5beffd700 1 --2- 172.21.15.8:0/3452047472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c007a2a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00098a0 tx=0x7ff5b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca25dde34f80ac75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.315+0000 7ff5bdffb700 1 -- 172.21.15.8:0/3452047472 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5b0004160 con 0x7ff5c007be40 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.315+0000 7ff5bdffb700 1 -- 172.21.15.8:0/3452047472 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b00042c0 con 0x7ff5c007be40 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.315+0000 7ff5bdffb700 1 -- 172.21.15.8:0/3452047472 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5b00118e0 con 0x7ff5c007be40 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.316+0000 7ff5c53c6700 1 -- 172.21.15.8:0/3452047472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 msgr2=0x7ff5c007a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.316+0000 7ff5c53c6700 1 --2- 172.21.15.8:0/3452047472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c007a2a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00098a0 tx=0x7ff5b0009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.316+0000 7ff5c53c6700 1 -- 172.21.15.8:0/3452047472 shutdown_connections 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.316+0000 7ff5c53c6700 1 --2- 172.21.15.8:0/3452047472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c007a2a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.316+0000 7ff5c53c6700 1 -- 172.21.15.8:0/3452047472 >> 172.21.15.8:0/3452047472 conn(0x7ff5c0101bd0 msgr2=0x7ff5c0104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.316+0000 7ff5c53c6700 1 -- 172.21.15.8:0/3452047472 shutdown_connections 2023-10-06T23:03:36.967 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.316+0000 7ff5c53c6700 1 -- 172.21.15.8:0/3452047472 wait complete. 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.317+0000 7ff5c53c6700 1 Processor -- start 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.317+0000 7ff5c53c6700 1 -- start start 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.317+0000 7ff5c53c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c019c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.317+0000 7ff5c53c6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c019ca10 con 0x7ff5c007be40 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c019c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c019c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54876/0 (socket says 172.21.15.8:54876) 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5beffd700 1 -- 172.21.15.8:0/479801083 learned_addr learned my addr 172.21.15.8:0/479801083 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5beffd700 1 -- 172.21.15.8:0/479801083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0009550 con 0x7ff5c007be40 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5beffd700 1 --2- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c019c4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0006af0 tx=0x7ff5b0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:36.968 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5a7fff700 1 -- 172.21.15.8:0/479801083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5b00037d0 con 0x7ff5c007be40 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5a7fff700 1 -- 172.21.15.8:0/479801083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b001b440 con 0x7ff5c007be40 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5a7fff700 1 -- 172.21.15.8:0/479801083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5b0023400 con 0x7ff5c007be40 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.318+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c019cc10 con 0x7ff5c007be40 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.319+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c019d030 con 0x7ff5c007be40 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.320+0000 7ff5a7fff700 1 -- 172.21.15.8:0/479801083 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7ff5b001b5b0 con 0x7ff5c007be40 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.320+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c00624e0 con 0x7ff5c007be40 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.320+0000 7ff5a7fff700 1 --2- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7ff5a80388e0 0x7ff5a803ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.320+0000 7ff5a7fff700 1 -- 172.21.15.8:0/479801083 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff5b004c8a0 con 0x7ff5c007be40 2023-10-06T23:03:36.969 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.321+0000 7ff5be7fc700 1 --2- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7ff5a80388e0 0x7ff5a803ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.321+0000 7ff5be7fc700 1 --2- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7ff5a80388e0 0x7ff5a803ada0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009940 tx=0x7ff5b4006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.326+0000 7ff5a7fff700 1 -- 172.21.15.8:0/479801083 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff5b001b8d0 con 0x7ff5c007be40 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.546+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7ff5c010c9f0 con 0x7ff5c007be40 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.549+0000 7ff5a7fff700 1 -- 172.21.15.8:0/479801083 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7ff5b000bbd0 con 0x7ff5c007be40 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.552+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7ff5a80388e0 msgr2=0x7ff5a803ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.552+0000 7ff5c53c6700 1 --2- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7ff5a80388e0 0x7ff5a803ada0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009940 tx=0x7ff5b4006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.552+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 msgr2=0x7ff5c019c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.552+0000 7ff5c53c6700 1 --2- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c019c4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0006af0 tx=0x7ff5b0011ed0 comp rx=0 tx=0).stop 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.552+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 shutdown_connections 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.552+0000 7ff5c53c6700 1 --2- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7ff5a80388e0 0x7ff5a803ada0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.552+0000 7ff5c53c6700 1 --2- 172.21.15.8:0/479801083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5c007be40 0x7ff5c019c4d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:36.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.552+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 >> 172.21.15.8:0/479801083 conn(0x7ff5c0101bd0 msgr2=0x7ff5c01032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:36.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.553+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 shutdown_connections 2023-10-06T23:03:36.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:36.553+0000 7ff5c53c6700 1 -- 172.21.15.8:0/479801083 wait complete. 2023-10-06T23:03:37.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:37 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/479801083' entity='client.admin' 2023-10-06T23:03:38.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.682+0000 7f81f7f9e700 1 Processor -- start 2023-10-06T23:03:38.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.683+0000 7f81f7f9e700 1 -- start start 2023-10-06T23:03:38.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.683+0000 7f81f7f9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f007a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:38.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.683+0000 7f81f7f9e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f007a870 con 0x7f81f007be40 2023-10-06T23:03:38.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.683+0000 7f81f5d3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f007a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:38.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.684+0000 7f81f5d3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f007a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54888/0 (socket says 172.21.15.8:54888) 2023-10-06T23:03:38.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.684+0000 7f81f5d3a700 1 -- 172.21.15.8:0/167723947 learned_addr learned my addr 172.21.15.8:0/167723947 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:38.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.684+0000 7f81f5d3a700 1 -- 172.21.15.8:0/167723947 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f007a9b0 con 0x7f81f007be40 2023-10-06T23:03:38.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.684+0000 7f81f5d3a700 1 --2- 172.21.15.8:0/167723947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f007a2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0098a0 tx=0x7f81ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6da7fa88a7fdf24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:38.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.684+0000 7f81f4d38700 1 -- 172.21.15.8:0/167723947 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81ec004160 con 0x7f81f007be40 2023-10-06T23:03:38.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.684+0000 7f81f4d38700 1 -- 172.21.15.8:0/167723947 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81ec0042c0 con 0x7f81f007be40 2023-10-06T23:03:38.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.684+0000 7f81f4d38700 1 -- 172.21.15.8:0/167723947 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81ec0118e0 con 0x7f81f007be40 2023-10-06T23:03:38.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.685+0000 7f81f7f9e700 1 -- 172.21.15.8:0/167723947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 msgr2=0x7f81f007a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:38.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.685+0000 7f81f7f9e700 1 --2- 172.21.15.8:0/167723947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f007a2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0098a0 tx=0x7f81ec009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:38.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.685+0000 7f81f7f9e700 1 -- 172.21.15.8:0/167723947 shutdown_connections 2023-10-06T23:03:38.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.685+0000 7f81f7f9e700 1 --2- 172.21.15.8:0/167723947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f007a2a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:38.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.685+0000 7f81f7f9e700 1 -- 172.21.15.8:0/167723947 >> 172.21.15.8:0/167723947 conn(0x7f81f0101bd0 msgr2=0x7f81f0104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:38.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.685+0000 7f81f7f9e700 1 -- 172.21.15.8:0/167723947 shutdown_connections 2023-10-06T23:03:38.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.685+0000 7f81f7f9e700 1 -- 172.21.15.8:0/167723947 wait complete. 2023-10-06T23:03:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.686+0000 7f81f7f9e700 1 Processor -- start 2023-10-06T23:03:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.686+0000 7f81f7f9e700 1 -- start start 2023-10-06T23:03:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.687+0000 7f81f7f9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.687+0000 7f81f7f9e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f019c9c0 con 0x7f81f007be40 2023-10-06T23:03:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.687+0000 7f81f5d3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.687+0000 7f81f5d3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f019c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54904/0 (socket says 172.21.15.8:54904) 2023-10-06T23:03:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.687+0000 7f81f5d3a700 1 -- 172.21.15.8:0/1077064056 learned_addr learned my addr 172.21.15.8:0/1077064056 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:38.360 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.687+0000 7f81f5d3a700 1 -- 172.21.15.8:0/1077064056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec009550 con 0x7f81f007be40 2023-10-06T23:03:38.360 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.688+0000 7f81f5d3a700 1 --2- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f019c480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81ec003e30 tx=0x7f81ec0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:38.360 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.688+0000 7f81e6ffd700 1 -- 172.21.15.8:0/1077064056 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81ec0036a0 con 0x7f81f007be40 2023-10-06T23:03:38.360 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.688+0000 7f81e6ffd700 1 -- 172.21.15.8:0/1077064056 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81ec01b440 con 0x7f81f007be40 2023-10-06T23:03:38.360 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.688+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f019cbc0 con 0x7f81f007be40 2023-10-06T23:03:38.360 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.688+0000 7f81e6ffd700 1 -- 172.21.15.8:0/1077064056 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81ec023400 con 0x7f81f007be40 2023-10-06T23:03:38.361 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.688+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f019cfe0 con 0x7f81f007be40 2023-10-06T23:03:38.361 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.689+0000 7f81e6ffd700 1 -- 172.21.15.8:0/1077064056 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f81ec01b5b0 con 0x7f81f007be40 2023-10-06T23:03:38.361 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.689+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f00624e0 con 0x7f81f007be40 2023-10-06T23:03:38.361 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.689+0000 7f81e6ffd700 1 --2- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f81dc038930 0x7f81dc03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:38.361 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.690+0000 7f81e6ffd700 1 -- 172.21.15.8:0/1077064056 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f81ec04c810 con 0x7f81f007be40 2023-10-06T23:03:38.361 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.690+0000 7f81f5539700 1 --2- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f81dc038930 0x7f81dc03adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:38.361 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.690+0000 7f81f5539700 1 --2- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f81dc038930 0x7f81dc03adf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009940 tx=0x7f81e0006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:38.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.695+0000 7f81e6ffd700 1 -- 172.21.15.8:0/1077064056 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f81ec019840 con 0x7f81f007be40 2023-10-06T23:03:38.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.915+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f81f010c9f0 con 0x7f81f007be40 2023-10-06T23:03:38.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.918+0000 7f81e6ffd700 1 -- 172.21.15.8:0/1077064056 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f81ec019840 con 0x7f81f007be40 2023-10-06T23:03:38.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f81dc038930 msgr2=0x7f81dc03adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:38.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 --2- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f81dc038930 0x7f81dc03adf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009940 tx=0x7f81e0006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:38.362 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 msgr2=0x7f81f019c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:38.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 --2- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f019c480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81ec003e30 tx=0x7f81ec0119a0 comp rx=0 tx=0).stop 2023-10-06T23:03:38.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 shutdown_connections 2023-10-06T23:03:38.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 --2- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f81dc038930 0x7f81dc03adf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:38.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 --2- 172.21.15.8:0/1077064056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81f007be40 0x7f81f019c480 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:38.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 >> 172.21.15.8:0/1077064056 conn(0x7f81f0101bd0 msgr2=0x7f81f01032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:38.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 shutdown_connections 2023-10-06T23:03:38.363 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:37.921+0000 7f81f7f9e700 1 -- 172.21.15.8:0/1077064056 wait complete. 2023-10-06T23:03:38.364 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling the dashboard module... 2023-10-06T23:03:38.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:38 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:38.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:38 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1077064056' entity='client.admin' 2023-10-06T23:03:40.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:39 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1061099503' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-06T23:03:40.054 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:39 smithi008 ceph-mon[98532]: from='mgr.14116 172.21.15.8:0/680733044' entity='mgr.x' 2023-10-06T23:03:40.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: ignoring --setuser ceph since I am not root 2023-10-06T23:03:40.054 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: ignoring --setgroup ceph since I am not root 2023-10-06T23:03:40.350 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.929+0000 7f8e7100d700 1 Processor -- start 2023-10-06T23:03:40.350 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.929+0000 7f8e7100d700 1 -- start start 2023-10-06T23:03:40.350 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.929+0000 7f8e7100d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c07a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:40.350 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.929+0000 7f8e7100d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c07a870 con 0x7f8e6c07be40 2023-10-06T23:03:40.351 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.929+0000 7f8e6ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c07a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:40.351 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.929+0000 7f8e6ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c07a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54920/0 (socket says 172.21.15.8:54920) 2023-10-06T23:03:40.351 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.929+0000 7f8e6ad9d700 1 -- 172.21.15.8:0/1120018580 learned_addr learned my addr 172.21.15.8:0/1120018580 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:40.351 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.930+0000 7f8e6ad9d700 1 -- 172.21.15.8:0/1120018580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c07a9b0 con 0x7f8e6c07be40 2023-10-06T23:03:40.351 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.930+0000 7f8e6ad9d700 1 --2- 172.21.15.8:0/1120018580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c07a2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098a0 tx=0x7f8e5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d0af98e4301e55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:40.351 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.930+0000 7f8e69d9b700 1 -- 172.21.15.8:0/1120018580 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c004160 con 0x7f8e6c07be40 2023-10-06T23:03:40.352 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.930+0000 7f8e69d9b700 1 -- 172.21.15.8:0/1120018580 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5c0042c0 con 0x7f8e6c07be40 2023-10-06T23:03:40.352 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.930+0000 7f8e69d9b700 1 -- 172.21.15.8:0/1120018580 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c0118e0 con 0x7f8e6c07be40 2023-10-06T23:03:40.352 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.931+0000 7f8e7100d700 1 -- 172.21.15.8:0/1120018580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 msgr2=0x7f8e6c07a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:40.352 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.931+0000 7f8e7100d700 1 --2- 172.21.15.8:0/1120018580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c07a2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098a0 tx=0x7f8e5c009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:40.352 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.931+0000 7f8e7100d700 1 -- 172.21.15.8:0/1120018580 shutdown_connections 2023-10-06T23:03:40.352 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.931+0000 7f8e7100d700 1 --2- 172.21.15.8:0/1120018580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c07a2a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:40.353 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.931+0000 7f8e7100d700 1 -- 172.21.15.8:0/1120018580 >> 172.21.15.8:0/1120018580 conn(0x7f8e6c101bd0 msgr2=0x7f8e6c104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:40.353 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.931+0000 7f8e7100d700 1 -- 172.21.15.8:0/1120018580 shutdown_connections 2023-10-06T23:03:40.353 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.932+0000 7f8e7100d700 1 -- 172.21.15.8:0/1120018580 wait complete. 2023-10-06T23:03:40.353 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.932+0000 7f8e7100d700 1 Processor -- start 2023-10-06T23:03:40.353 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.933+0000 7f8e7100d700 1 -- start start 2023-10-06T23:03:40.353 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.933+0000 7f8e7100d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c19c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:40.353 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.933+0000 7f8e7100d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c19c9c0 con 0x7f8e6c07be40 2023-10-06T23:03:40.354 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.933+0000 7f8e6ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c19c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:40.354 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.933+0000 7f8e6ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c19c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54922/0 (socket says 172.21.15.8:54922) 2023-10-06T23:03:40.354 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.933+0000 7f8e6ad9d700 1 -- 172.21.15.8:0/1061099503 learned_addr learned my addr 172.21.15.8:0/1061099503 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:40.354 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.934+0000 7f8e6ad9d700 1 -- 172.21.15.8:0/1061099503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c009550 con 0x7f8e6c07be40 2023-10-06T23:03:40.354 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.934+0000 7f8e6ad9d700 1 --2- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c19c480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c003e30 tx=0x7f8e5c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:40.354 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.934+0000 7f8e53fff700 1 -- 172.21.15.8:0/1061099503 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c0036a0 con 0x7f8e6c07be40 2023-10-06T23:03:40.355 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.934+0000 7f8e53fff700 1 -- 172.21.15.8:0/1061099503 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5c01b440 con 0x7f8e6c07be40 2023-10-06T23:03:40.355 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.934+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c19cbc0 con 0x7f8e6c07be40 2023-10-06T23:03:40.355 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.934+0000 7f8e53fff700 1 -- 172.21.15.8:0/1061099503 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c023400 con 0x7f8e6c07be40 2023-10-06T23:03:40.355 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.934+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c19cfe0 con 0x7f8e6c07be40 2023-10-06T23:03:40.355 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.935+0000 7f8e53fff700 1 -- 172.21.15.8:0/1061099503 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f8e5c003800 con 0x7f8e6c07be40 2023-10-06T23:03:40.355 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.935+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c0624e0 con 0x7f8e6c07be40 2023-10-06T23:03:40.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.936+0000 7f8e53fff700 1 --2- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f8e54038930 0x7f8e5403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:40.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.936+0000 7f8e53fff700 1 -- 172.21.15.8:0/1061099503 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8e5c04c790 con 0x7f8e6c07be40 2023-10-06T23:03:40.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.936+0000 7f8e6a59c700 1 --2- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f8e54038930 0x7f8e5403adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:40.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.937+0000 7f8e6a59c700 1 --2- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f8e54038930 0x7f8e5403adf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009940 tx=0x7f8e60006e30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:40.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:38.941+0000 7f8e53fff700 1 -- 172.21.15.8:0/1061099503 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8e5c003ab0 con 0x7f8e6c07be40 2023-10-06T23:03:40.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.214+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f8e6c10c9f0 con 0x7f8e6c07be40 2023-10-06T23:03:40.356 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.798+0000 7f8e53fff700 1 -- 172.21.15.8:0/1061099503 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f8e5c02b350 con 0x7f8e6c07be40 2023-10-06T23:03:40.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.800+0000 7f8e53fff700 1 -- 172.21.15.8:0/1061099503 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f8e5c01b960 con 0x7f8e6c07be40 2023-10-06T23:03:40.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.802+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f8e54038930 msgr2=0x7f8e5403adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:40.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.802+0000 7f8e7100d700 1 --2- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f8e54038930 0x7f8e5403adf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009940 tx=0x7f8e60006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:40.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.802+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 msgr2=0x7f8e6c19c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:40.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.802+0000 7f8e7100d700 1 --2- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c19c480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c003e30 tx=0x7f8e5c0119a0 comp rx=0 tx=0).stop 2023-10-06T23:03:40.357 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.803+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 shutdown_connections 2023-10-06T23:03:40.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.803+0000 7f8e7100d700 1 --2- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f8e54038930 0x7f8e5403adf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:40.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.803+0000 7f8e7100d700 1 --2- 172.21.15.8:0/1061099503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e6c07be40 0x7f8e6c19c480 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:40.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.803+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 >> 172.21.15.8:0/1061099503 conn(0x7f8e6c101bd0 msgr2=0x7f8e6c1032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:40.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.803+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 shutdown_connections 2023-10-06T23:03:40.358 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:39.803+0000 7f8e7100d700 1 -- 172.21.15.8:0/1061099503 wait complete. 2023-10-06T23:03:40.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:40.123+0000 7f1ab7b27200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T23:03:40.396 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:40.232+0000 7f1ab7b27200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T23:03:40.396 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:40.352+0000 7f1ab7b27200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T23:03:40.758 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:40.500+0000 7f1ab7b27200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T23:03:41.090 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:40 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1061099503' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-06T23:03:41.090 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:40 smithi008 ceph-mon[98532]: mgrmap e9: x(active, since 18s) 2023-10-06T23:03:41.091 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:40.756+0000 7f1ab7b27200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T23:03:41.395 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:41.275+0000 7f1ab7b27200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T23:03:41.706 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:41.449+0000 7f1ab7b27200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T23:03:41.706 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:41.574+0000 7f1ab7b27200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T23:03:41.955 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-06T23:03:41.955 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-06T23:03:41.955 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.903+0000 7f1e39788700 1 Processor -- start 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.903+0000 7f1e39788700 1 -- start start 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.904+0000 7f1e39788700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e34105160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.904+0000 7f1e39788700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e34079e30 con 0x7f1e34104d40 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.904+0000 7f1e33fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e34105160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.904+0000 7f1e33fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e34105160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44058/0 (socket says 172.21.15.8:44058) 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.904+0000 7f1e33fff700 1 -- 172.21.15.8:0/1877499651 learned_addr learned my addr 172.21.15.8:0/1877499651 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.905+0000 7f1e33fff700 1 -- 172.21.15.8:0/1877499651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e341056a0 con 0x7f1e34104d40 2023-10-06T23:03:41.956 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.905+0000 7f1e33fff700 1 --2- 172.21.15.8:0/1877499651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e34105160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e240098a0 tx=0x7f1e24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8f7a59a3194031 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.905+0000 7f1e32ffd700 1 -- 172.21.15.8:0/1877499651 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e24004160 con 0x7f1e34104d40 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.905+0000 7f1e32ffd700 1 -- 172.21.15.8:0/1877499651 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e240042c0 con 0x7f1e34104d40 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.905+0000 7f1e32ffd700 1 -- 172.21.15.8:0/1877499651 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e240118e0 con 0x7f1e34104d40 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.906+0000 7f1e39788700 1 -- 172.21.15.8:0/1877499651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 msgr2=0x7f1e34105160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.906+0000 7f1e39788700 1 --2- 172.21.15.8:0/1877499651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e34105160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e240098a0 tx=0x7f1e24009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.906+0000 7f1e39788700 1 -- 172.21.15.8:0/1877499651 shutdown_connections 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.906+0000 7f1e39788700 1 --2- 172.21.15.8:0/1877499651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e34105160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.906+0000 7f1e39788700 1 -- 172.21.15.8:0/1877499651 >> 172.21.15.8:0/1877499651 conn(0x7f1e34100920 msgr2=0x7f1e34102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.906+0000 7f1e39788700 1 -- 172.21.15.8:0/1877499651 shutdown_connections 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.907+0000 7f1e39788700 1 -- 172.21.15.8:0/1877499651 wait complete. 2023-10-06T23:03:41.957 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.908+0000 7f1e39788700 1 Processor -- start 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.908+0000 7f1e39788700 1 -- start start 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.908+0000 7f1e39788700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e3410a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.908+0000 7f1e39788700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3410ae00 con 0x7f1e34104d40 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.908+0000 7f1e33fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e3410a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.909+0000 7f1e33fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e3410a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44072/0 (socket says 172.21.15.8:44072) 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.909+0000 7f1e33fff700 1 -- 172.21.15.8:0/2965326179 learned_addr learned my addr 172.21.15.8:0/2965326179 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.909+0000 7f1e33fff700 1 -- 172.21.15.8:0/2965326179 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24009550 con 0x7f1e34104d40 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.909+0000 7f1e33fff700 1 --2- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e3410a8c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e24003e30 tx=0x7f1e240119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.910+0000 7f1e317fa700 1 -- 172.21.15.8:0/2965326179 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e240036a0 con 0x7f1e34104d40 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.910+0000 7f1e317fa700 1 -- 172.21.15.8:0/2965326179 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e2401b440 con 0x7f1e34104d40 2023-10-06T23:03:41.958 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.910+0000 7f1e317fa700 1 -- 172.21.15.8:0/2965326179 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e24023400 con 0x7f1e34104d40 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.910+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3410b000 con 0x7f1e34104d40 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.910+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e341074f0 con 0x7f1e34104d40 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.911+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3410b190 con 0x7f1e34104d40 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.912+0000 7f1e317fa700 1 -- 172.21.15.8:0/2965326179 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f1e2401b5b0 con 0x7f1e34104d40 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.913+0000 7f1e317fa700 1 --2- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f1e1c038980 0x7f1e1c03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.913+0000 7f1e317fa700 1 -- 172.21.15.8:0/2965326179 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1e2404c9b0 con 0x7f1e34104d40 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.913+0000 7f1e337fe700 1 -- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f1e1c038980 msgr2=0x7f1e1c03ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2416919540 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.913+0000 7f1e337fe700 1 --2- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f1e1c038980 0x7f1e1c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:40.918+0000 7f1e317fa700 1 -- 172.21.15.8:0/2965326179 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1e2402b9e0 con 0x7f1e34104d40 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.114+0000 7f1e337fe700 1 -- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f1e1c038980 msgr2=0x7f1e1c03ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2416919540 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.114+0000 7f1e337fe700 1 --2- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f1e1c038980 0x7f1e1c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T23:03:41.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.213+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f1e341064f0 con 0x7f1e34104d40 2023-10-06T23:03:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.213+0000 7f1e317fa700 1 -- 172.21.15.8:0/2965326179 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f1e2402b800 con 0x7f1e34104d40 2023-10-06T23:03:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f1e1c038980 msgr2=0x7f1e1c03ae40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T23:03:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 --2- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f1e1c038980 0x7f1e1c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 msgr2=0x7f1e3410a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 --2- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e3410a8c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e24003e30 tx=0x7f1e240119a0 comp rx=0 tx=0).stop 2023-10-06T23:03:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 shutdown_connections 2023-10-06T23:03:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 --2- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7f1e1c038980 0x7f1e1c03ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:41.960 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 --2- 172.21.15.8:0/2965326179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e34104d40 0x7f1e3410a8c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:41.961 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 >> 172.21.15.8:0/2965326179 conn(0x7f1e34100920 msgr2=0x7f1e34193440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:41.961 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 shutdown_connections 2023-10-06T23:03:41.961 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:41.216+0000 7f1e39788700 1 -- 172.21.15.8:0/2965326179 wait complete. 2023-10-06T23:03:41.961 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2023-10-06T23:03:41.961 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 9... 2023-10-06T23:03:41.977 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:41 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2965326179' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-06T23:03:41.978 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:41.704+0000 7f1ab7b27200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T23:03:42.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:42 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:42.300+0000 7f1ab7b27200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T23:03:43.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:43 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:43.187+0000 7f1ab7b27200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T23:03:43.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:43 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:43.296+0000 7f1ab7b27200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T23:03:44.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:44 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:44.288+0000 7f1ab7b27200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:03:44.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:44 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:44.412+0000 7f1ab7b27200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T23:03:45.031 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:44 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:44.646+0000 7f1ab7b27200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:03:45.315 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:45 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:45.029+0000 7f1ab7b27200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T23:03:45.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:45 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:45.313+0000 7f1ab7b27200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T23:03:45.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:45 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:45.517+0000 7f1ab7b27200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T23:03:46.145 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:45 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:45.877+0000 7f1ab7b27200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T23:03:47.145 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:46 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:46.851+0000 7f1ab7b27200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T23:03:47.145 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:47.032+0000 7f1ab7b27200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T23:03:47.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:47.290+0000 7f1ab7b27200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T23:03:47.645 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:47.442+0000 7f1ab7b27200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T23:03:48.145 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:47.731+0000 7f1ab7b27200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T23:03:49.145 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:03:48.850+0000 7f1ab7b27200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: Active manager daemon x restarted 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: Activating manager daemon x 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: osdmap e3: 0 total, 0 up, 0 in 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: mgrmap e10: x(active, starting, since 0.00386357s) 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: Manager daemon x is now available 2023-10-06T23:03:49.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:03:49.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:03:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-06T23:03:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-06T23:03:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:49 smithi008 ceph-mon[98532]: mgrmap e11: x(active, since 1.00785s) 2023-10-06T23:03:50.257 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-06T23:03:50.257 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.501+0000 7fbe7039f700 1 Processor -- start 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.501+0000 7fbe7039f700 1 -- start start 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.501+0000 7fbe7039f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe68106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.501+0000 7fbe7039f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe68107040 con 0x7fbe68106650 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.502+0000 7fbe6e13b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe68106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.502+0000 7fbe6e13b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe68106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44086/0 (socket says 172.21.15.8:44086) 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.502+0000 7fbe6e13b700 1 -- 172.21.15.8:0/3705196119 learned_addr learned my addr 172.21.15.8:0/3705196119 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:50.258 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.502+0000 7fbe6e13b700 1 -- 172.21.15.8:0/3705196119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68107850 con 0x7fbe68106650 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.502+0000 7fbe6e13b700 1 --2- 172.21.15.8:0/3705196119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe68106a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe640098a0 tx=0x7fbe64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807e1979ab7ed8f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe6d139700 1 -- 172.21.15.8:0/3705196119 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe64004160 con 0x7fbe68106650 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe6d139700 1 -- 172.21.15.8:0/3705196119 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe640042c0 con 0x7fbe68106650 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe6d139700 1 -- 172.21.15.8:0/3705196119 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640118e0 con 0x7fbe68106650 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe7039f700 1 -- 172.21.15.8:0/3705196119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 msgr2=0x7fbe68106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe7039f700 1 --2- 172.21.15.8:0/3705196119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe68106a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe640098a0 tx=0x7fbe64009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe7039f700 1 -- 172.21.15.8:0/3705196119 shutdown_connections 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe7039f700 1 --2- 172.21.15.8:0/3705196119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe68106a70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe7039f700 1 -- 172.21.15.8:0/3705196119 >> 172.21.15.8:0/3705196119 conn(0x7fbe68101bd0 msgr2=0x7fbe68104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe7039f700 1 -- 172.21.15.8:0/3705196119 shutdown_connections 2023-10-06T23:03:50.259 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.503+0000 7fbe7039f700 1 -- 172.21.15.8:0/3705196119 wait complete. 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.504+0000 7fbe7039f700 1 Processor -- start 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.505+0000 7fbe7039f700 1 -- start start 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.505+0000 7fbe7039f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe6807bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.505+0000 7fbe7039f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6807c170 con 0x7fbe68106650 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.505+0000 7fbe6e13b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe6807bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.505+0000 7fbe6e13b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe6807bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44102/0 (socket says 172.21.15.8:44102) 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.505+0000 7fbe6e13b700 1 -- 172.21.15.8:0/2203244583 learned_addr learned my addr 172.21.15.8:0/2203244583 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.506+0000 7fbe6e13b700 1 -- 172.21.15.8:0/2203244583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64009550 con 0x7fbe68106650 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.506+0000 7fbe6e13b700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe6807bc30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbe64006af0 tx=0x7fbe64011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.506+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe640037d0 con 0x7fbe68106650 2023-10-06T23:03:50.260 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.506+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe6401b440 con 0x7fbe68106650 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.506+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6807a280 con 0x7fbe68106650 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.506+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe64023400 con 0x7fbe68106650 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.506+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6807a6a0 con 0x7fbe68106650 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.507+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7fbe64023670 con 0x7fbe68106650 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.508+0000 7fbe5f7fe700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.508+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 --> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe5403b500 con 0x7fbe54038930 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.508+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbe6404c950 con 0x7fbe68106650 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.508+0000 7fbe6d93a700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 msgr2=0x7fbe5403adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2416919540 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.508+0000 7fbe6d93a700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.709+0000 7fbe6d93a700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 msgr2=0x7fbe5403adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2416919540 2023-10-06T23:03:50.261 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:42.709+0000 7fbe6d93a700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:43.110+0000 7fbe6d93a700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 msgr2=0x7fbe5403adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2416919540 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:43.110+0000 7fbe6d93a700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:43.911+0000 7fbe6d93a700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 msgr2=0x7fbe5403adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2416919540 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:43.911+0000 7fbe6d93a700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:45.512+0000 7fbe6d93a700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 msgr2=0x7fbe5403adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2416919540 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:45.513+0000 7fbe6d93a700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:48.716+0000 7fbe6d93a700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 msgr2=0x7fbe5403adf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/2416919540 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:48.716+0000 7fbe6d93a700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:48.855+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 10) v1 ==== 45359+0+0 (secure 0 0 0) 0x7fbe6401b5b0 con 0x7fbe68106650 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:48.855+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 msgr2=0x7fbe5403adf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T23:03:50.262 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:48.855+0000 7fbe5f7fe700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.858+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 11) v1 ==== 45486+0+0 (secure 0 0 0) 0x7fbe6404e5a0 con 0x7fbe68106650 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.858+0000 7fbe5f7fe700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbe5403c3d0 0x7fbe5403e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.858+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe5403b500 con 0x7fbe5403c3d0 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.859+0000 7fbe6d93a700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbe5403c3d0 0x7fbe5403e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.860+0000 7fbe6d93a700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbe5403c3d0 0x7fbe5403e7c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbe58003a60 tx=0x7fbe58009270 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.860+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fbe5403b500 con 0x7fbe5403c3d0 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.867+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fbe6807b7d0 con 0x7fbe5403c3d0 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.868+0000 7fbe5f7fe700 1 -- 172.21.15.8:0/2203244583 <== mgr.14148 v2:172.21.15.8:6800/3959613712 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fbe6807b7d0 con 0x7fbe5403c3d0 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.868+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbe5403c3d0 msgr2=0x7fbe5403e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.868+0000 7fbe7039f700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbe5403c3d0 0x7fbe5403e7c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbe58003a60 tx=0x7fbe58009270 comp rx=0 tx=0).stop 2023-10-06T23:03:50.263 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.868+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 msgr2=0x7fbe6807bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.868+0000 7fbe7039f700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe6807bc30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbe64006af0 tx=0x7fbe64011ed0 comp rx=0 tx=0).stop 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.869+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 shutdown_connections 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.869+0000 7fbe7039f700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbe5403c3d0 0x7fbe5403e7c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.869+0000 7fbe7039f700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe68106650 0x7fbe6807bc30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.869+0000 7fbe7039f700 1 --2- 172.21.15.8:0/2203244583 >> [v2:172.21.15.8:6800/2416919540,v1:172.21.15.8:6801/2416919540] conn(0x7fbe54038930 0x7fbe5403adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.869+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 >> 172.21.15.8:0/2203244583 conn(0x7fbe68101bd0 msgr2=0x7fbe681029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.869+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 shutdown_connections 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:49.869+0000 7fbe7039f700 1 -- 172.21.15.8:0/2203244583 wait complete. 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 9 is available 2023-10-06T23:03:50.264 INFO:teuthology.orchestra.run.smithi008.stdout:Generating a dashboard self-signed certificate... 2023-10-06T23:03:51.366 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:50 smithi008 ceph-mon[98532]: [06/Oct/2023:23:03:49] ENGINE Bus STARTING 2023-10-06T23:03:51.366 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:50 smithi008 ceph-mon[98532]: [06/Oct/2023:23:03:49] ENGINE Serving on http://172.21.15.8:8765 2023-10-06T23:03:51.367 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:50 smithi008 ceph-mon[98532]: [06/Oct/2023:23:03:49] ENGINE Serving on https://172.21.15.8:7150 2023-10-06T23:03:51.367 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:50 smithi008 ceph-mon[98532]: [06/Oct/2023:23:03:49] ENGINE Bus STARTED 2023-10-06T23:03:51.367 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:50 smithi008 ceph-mon[98532]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-06T23:03:51.367 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:50 smithi008 ceph-mon[98532]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-06T23:03:51.742 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-06T23:03:51.742 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.965+0000 7f80db373700 1 Processor -- start 2023-10-06T23:03:51.742 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.965+0000 7f80db373700 1 -- start start 2023-10-06T23:03:51.742 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.965+0000 7f80db373700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d4106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:51.742 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.965+0000 7f80db373700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4107040 con 0x7f80d4106650 2023-10-06T23:03:51.742 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.966+0000 7f80d910f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d4106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:51.742 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.966+0000 7f80d910f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d4106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53758/0 (socket says 172.21.15.8:53758) 2023-10-06T23:03:51.742 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.966+0000 7f80d910f700 1 -- 172.21.15.8:0/1678593396 learned_addr learned my addr 172.21.15.8:0/1678593396 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:51.743 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.966+0000 7f80d910f700 1 -- 172.21.15.8:0/1678593396 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d4107850 con 0x7f80d4106650 2023-10-06T23:03:51.743 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80d910f700 1 --2- 172.21.15.8:0/1678593396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d4106a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80d00098a0 tx=0x7f80d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73df58aec928874 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:51.743 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80cbfff700 1 -- 172.21.15.8:0/1678593396 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d0004160 con 0x7f80d4106650 2023-10-06T23:03:51.743 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80cbfff700 1 -- 172.21.15.8:0/1678593396 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f80d00042c0 con 0x7f80d4106650 2023-10-06T23:03:51.743 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80cbfff700 1 -- 172.21.15.8:0/1678593396 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d00118e0 con 0x7f80d4106650 2023-10-06T23:03:51.743 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80db373700 1 -- 172.21.15.8:0/1678593396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 msgr2=0x7f80d4106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:51.743 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80db373700 1 --2- 172.21.15.8:0/1678593396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d4106a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80d00098a0 tx=0x7f80d0009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:51.743 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80db373700 1 -- 172.21.15.8:0/1678593396 shutdown_connections 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80db373700 1 --2- 172.21.15.8:0/1678593396 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d4106a70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.967+0000 7f80db373700 1 -- 172.21.15.8:0/1678593396 >> 172.21.15.8:0/1678593396 conn(0x7f80d4101bd0 msgr2=0x7f80d4104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.968+0000 7f80db373700 1 -- 172.21.15.8:0/1678593396 shutdown_connections 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.968+0000 7f80db373700 1 -- 172.21.15.8:0/1678593396 wait complete. 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.969+0000 7f80db373700 1 Processor -- start 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.969+0000 7f80db373700 1 -- start start 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.970+0000 7f80db373700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d407bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.970+0000 7f80db373700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d407c170 con 0x7f80d4106650 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.970+0000 7f80d910f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d407bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.970+0000 7f80d910f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d407bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53774/0 (socket says 172.21.15.8:53774) 2023-10-06T23:03:51.744 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.970+0000 7f80d910f700 1 -- 172.21.15.8:0/3237066295 learned_addr learned my addr 172.21.15.8:0/3237066295 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.970+0000 7f80d910f700 1 -- 172.21.15.8:0/3237066295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0009550 con 0x7f80d4106650 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.971+0000 7f80d910f700 1 --2- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d407bc30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80d0003e30 tx=0x7f80d00119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.971+0000 7f80ca7fc700 1 -- 172.21.15.8:0/3237066295 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d00036a0 con 0x7f80d4106650 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.971+0000 7f80ca7fc700 1 -- 172.21.15.8:0/3237066295 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f80d001b440 con 0x7f80d4106650 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.971+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d407a280 con 0x7f80d4106650 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.971+0000 7f80ca7fc700 1 -- 172.21.15.8:0/3237066295 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d0023400 con 0x7f80d4106650 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.971+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d407a6a0 con 0x7f80d4106650 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.972+0000 7f80ca7fc700 1 -- 172.21.15.8:0/3237066295 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f80d0023630 con 0x7f80d4106650 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.972+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d40624e0 con 0x7f80d4106650 2023-10-06T23:03:51.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.973+0000 7f80ca7fc700 1 --2- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80c0038980 0x7f80c003ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.973+0000 7f80ca7fc700 1 -- 172.21.15.8:0/3237066295 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f80d004ca80 con 0x7f80d4106650 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.973+0000 7f80d890e700 1 --2- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80c0038980 0x7f80c003ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.973+0000 7f80d890e700 1 --2- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80c0038980 0x7f80c003ae40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009940 tx=0x7f80c4006e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:50.978+0000 7f80ca7fc700 1 -- 172.21.15.8:0/3237066295 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f80d0018350 con 0x7f80d4106650 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.203+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f80d407ae50 con 0x7f80c0038980 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.341+0000 7f80ca7fc700 1 -- 172.21.15.8:0/3237066295 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f80d407ae50 con 0x7f80c0038980 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80c0038980 msgr2=0x7f80c003ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 --2- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80c0038980 0x7f80c003ae40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009940 tx=0x7f80c4006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 msgr2=0x7f80d407bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 --2- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d407bc30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80d0003e30 tx=0x7f80d00119a0 comp rx=0 tx=0).stop 2023-10-06T23:03:51.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 shutdown_connections 2023-10-06T23:03:51.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 --2- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80c0038980 0x7f80c003ae40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:51.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 --2- 172.21.15.8:0/3237066295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d4106650 0x7f80d407bc30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:51.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 >> 172.21.15.8:0/3237066295 conn(0x7f80d4101bd0 msgr2=0x7f80d41029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:51.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 shutdown_connections 2023-10-06T23:03:51.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:51.343+0000 7f80db373700 1 -- 172.21.15.8:0/3237066295 wait complete. 2023-10-06T23:03:51.747 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial admin user... 2023-10-06T23:03:52.052 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:51 smithi008 ceph-mon[98532]: mgrmap e12: x(active, since 2s) 2023-10-06T23:03:52.052 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:03:52.052 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:03:52.052 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Xfr51yI3hKB1GNvszHh1SuRP/0ZaLZX7rVgdFbWH8IbU4cO8r.MHK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696633432, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.264+0000 7f856eef5700 1 Processor -- start 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.264+0000 7f856eef5700 1 -- start start 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.264+0000 7f856eef5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856807a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.265+0000 7f856eef5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856807a870 con 0x7f856807be40 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.265+0000 7f856cc91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856807a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.265+0000 7f856cc91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856807a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53784/0 (socket says 172.21.15.8:53784) 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.265+0000 7f856cc91700 1 -- 172.21.15.8:0/1336959273 learned_addr learned my addr 172.21.15.8:0/1336959273 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.265+0000 7f856cc91700 1 -- 172.21.15.8:0/1336959273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856807a9b0 con 0x7f856807be40 2023-10-06T23:03:53.131 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.266+0000 7f856cc91700 1 --2- 172.21.15.8:0/1336959273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856807a2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f855c0098a0 tx=0x7f855c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d07e357edb3a96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.266+0000 7f85677fe700 1 -- 172.21.15.8:0/1336959273 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f855c004160 con 0x7f856807be40 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.266+0000 7f85677fe700 1 -- 172.21.15.8:0/1336959273 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f855c0042c0 con 0x7f856807be40 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.266+0000 7f85677fe700 1 -- 172.21.15.8:0/1336959273 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f855c0118e0 con 0x7f856807be40 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.267+0000 7f856eef5700 1 -- 172.21.15.8:0/1336959273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 msgr2=0x7f856807a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.267+0000 7f856eef5700 1 --2- 172.21.15.8:0/1336959273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856807a2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f855c0098a0 tx=0x7f855c009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.267+0000 7f856eef5700 1 -- 172.21.15.8:0/1336959273 shutdown_connections 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.267+0000 7f856eef5700 1 --2- 172.21.15.8:0/1336959273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856807a2a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.267+0000 7f856eef5700 1 -- 172.21.15.8:0/1336959273 >> 172.21.15.8:0/1336959273 conn(0x7f8568101bd0 msgr2=0x7f8568104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.267+0000 7f856eef5700 1 -- 172.21.15.8:0/1336959273 shutdown_connections 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.267+0000 7f856eef5700 1 -- 172.21.15.8:0/1336959273 wait complete. 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.268+0000 7f856eef5700 1 Processor -- start 2023-10-06T23:03:53.132 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.268+0000 7f856eef5700 1 -- start start 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.268+0000 7f856eef5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.268+0000 7f856eef5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856819ca10 con 0x7f856807be40 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.269+0000 7f856cc91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.269+0000 7f856cc91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53786/0 (socket says 172.21.15.8:53786) 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.269+0000 7f856cc91700 1 -- 172.21.15.8:0/4134214930 learned_addr learned my addr 172.21.15.8:0/4134214930 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.269+0000 7f856cc91700 1 -- 172.21.15.8:0/4134214930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c009550 con 0x7f856807be40 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.269+0000 7f856cc91700 1 --2- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856819c4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f855c006af0 tx=0x7f855c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.270+0000 7f8565ffb700 1 -- 172.21.15.8:0/4134214930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f855c0037d0 con 0x7f856807be40 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.270+0000 7f8565ffb700 1 -- 172.21.15.8:0/4134214930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f855c01b440 con 0x7f856807be40 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.270+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856819cc10 con 0x7f856807be40 2023-10-06T23:03:53.133 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.270+0000 7f8565ffb700 1 -- 172.21.15.8:0/4134214930 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f855c023400 con 0x7f856807be40 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.270+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856819d030 con 0x7f856807be40 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.271+0000 7f8565ffb700 1 -- 172.21.15.8:0/4134214930 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f855c023670 con 0x7f856807be40 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.271+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85680624e0 con 0x7f856807be40 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.272+0000 7f8565ffb700 1 --2- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8558038980 0x7f855803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.272+0000 7f8565ffb700 1 -- 172.21.15.8:0/4134214930 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f855c04cc30 con 0x7f856807be40 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.272+0000 7f8567fff700 1 --2- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8558038980 0x7f855803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.273+0000 7f8567fff700 1 --2- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8558038980 0x7f855803ae40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8554009940 tx=0x7f8554006e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.277+0000 7f8565ffb700 1 -- 172.21.15.8:0/4134214930 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f855c018350 con 0x7f856807be40 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.506+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8568062300 con 0x7f8558038980 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.753+0000 7f8565ffb700 1 -- 172.21.15.8:0/4134214930 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f8568062300 con 0x7f8558038980 2023-10-06T23:03:53.134 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8558038980 msgr2=0x7f855803ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 --2- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8558038980 0x7f855803ae40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8554009940 tx=0x7f8554006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 msgr2=0x7f856819c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 --2- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856819c4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f855c006af0 tx=0x7f855c011ed0 comp rx=0 tx=0).stop 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 shutdown_connections 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 --2- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8558038980 0x7f855803ae40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 --2- 172.21.15.8:0/4134214930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f856807be40 0x7f856819c4d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 >> 172.21.15.8:0/4134214930 conn(0x7f8568101bd0 msgr2=0x7f85681032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 shutdown_connections 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:52.756+0000 7f856eef5700 1 -- 172.21.15.8:0/4134214930 wait complete. 2023-10-06T23:03:53.135 INFO:teuthology.orchestra.run.smithi008.stdout:Fetching dashboard port number... 2023-10-06T23:03:53.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:52 smithi008 ceph-mon[98532]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:53.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:03:53.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:03:54.127 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:53 smithi008 ceph-mon[98532]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:03:54.127 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:53 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4284479051' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-06T23:03:54.717 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 8443 2023-10-06T23:03:54.717 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.676+0000 7fcade561700 1 Processor -- start 2023-10-06T23:03:54.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.676+0000 7fcade561700 1 -- start start 2023-10-06T23:03:54.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.677+0000 7fcade561700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad8106a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:54.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.677+0000 7fcade561700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8107050 con 0x7fcad8106660 2023-10-06T23:03:54.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.677+0000 7fcad7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad8106a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:54.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.677+0000 7fcad7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad8106a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53790/0 (socket says 172.21.15.8:53790) 2023-10-06T23:03:54.718 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.677+0000 7fcad7fff700 1 -- 172.21.15.8:0/1896397458 learned_addr learned my addr 172.21.15.8:0/1896397458 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:54.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.677+0000 7fcad7fff700 1 -- 172.21.15.8:0/1896397458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8107860 con 0x7fcad8106660 2023-10-06T23:03:54.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.678+0000 7fcad7fff700 1 --2- 172.21.15.8:0/1896397458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad8106a80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcac80098a0 tx=0x7fcac8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2396abba636e7991 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:54.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.678+0000 7fcad6ffd700 1 -- 172.21.15.8:0/1896397458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcac8004160 con 0x7fcad8106660 2023-10-06T23:03:54.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.678+0000 7fcad6ffd700 1 -- 172.21.15.8:0/1896397458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcac80042c0 con 0x7fcad8106660 2023-10-06T23:03:54.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.678+0000 7fcad6ffd700 1 -- 172.21.15.8:0/1896397458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcac80118e0 con 0x7fcad8106660 2023-10-06T23:03:54.719 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.678+0000 7fcade561700 1 -- 172.21.15.8:0/1896397458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 msgr2=0x7fcad8106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:54.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.679+0000 7fcade561700 1 --2- 172.21.15.8:0/1896397458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad8106a80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcac80098a0 tx=0x7fcac8009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:54.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.679+0000 7fcade561700 1 -- 172.21.15.8:0/1896397458 shutdown_connections 2023-10-06T23:03:54.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.679+0000 7fcade561700 1 --2- 172.21.15.8:0/1896397458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad8106a80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:54.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.679+0000 7fcade561700 1 -- 172.21.15.8:0/1896397458 >> 172.21.15.8:0/1896397458 conn(0x7fcad8101c20 msgr2=0x7fcad8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:54.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.679+0000 7fcade561700 1 -- 172.21.15.8:0/1896397458 shutdown_connections 2023-10-06T23:03:54.720 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.679+0000 7fcade561700 1 -- 172.21.15.8:0/1896397458 wait complete. 2023-10-06T23:03:54.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.680+0000 7fcade561700 1 Processor -- start 2023-10-06T23:03:54.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.680+0000 7fcade561700 1 -- start start 2023-10-06T23:03:54.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.681+0000 7fcade561700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad807bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:54.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.681+0000 7fcade561700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad807c170 con 0x7fcad8106660 2023-10-06T23:03:54.721 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.681+0000 7fcad7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad807bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:54.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.681+0000 7fcad7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad807bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53794/0 (socket says 172.21.15.8:53794) 2023-10-06T23:03:54.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.681+0000 7fcad7fff700 1 -- 172.21.15.8:0/4284479051 learned_addr learned my addr 172.21.15.8:0/4284479051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:54.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.681+0000 7fcad7fff700 1 -- 172.21.15.8:0/4284479051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8009550 con 0x7fcad8106660 2023-10-06T23:03:54.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.682+0000 7fcad7fff700 1 --2- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad807bc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcac8003e30 tx=0x7fcac80119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:54.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.682+0000 7fcad57fa700 1 -- 172.21.15.8:0/4284479051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcac80036a0 con 0x7fcad8106660 2023-10-06T23:03:54.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.682+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad807a280 con 0x7fcad8106660 2023-10-06T23:03:54.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.682+0000 7fcad57fa700 1 -- 172.21.15.8:0/4284479051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcac801b440 con 0x7fcad8106660 2023-10-06T23:03:54.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.682+0000 7fcad57fa700 1 -- 172.21.15.8:0/4284479051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcac8023400 con 0x7fcad8106660 2023-10-06T23:03:54.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.682+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad807a6a0 con 0x7fcad8106660 2023-10-06T23:03:54.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.683+0000 7fcad57fa700 1 -- 172.21.15.8:0/4284479051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7fcac801b5b0 con 0x7fcad8106660 2023-10-06T23:03:54.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.683+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad80624e0 con 0x7fcad8106660 2023-10-06T23:03:54.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.684+0000 7fcad57fa700 1 --2- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcac0038930 0x7fcac003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:54.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.684+0000 7fcad57fa700 1 -- 172.21.15.8:0/4284479051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcac804c990 con 0x7fcad8106660 2023-10-06T23:03:54.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.684+0000 7fcad77fe700 1 --2- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcac0038930 0x7fcac003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.685+0000 7fcad77fe700 1 --2- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcac0038930 0x7fcac003adf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcacc006fd0 tx=0x7fcacc006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.689+0000 7fcad57fa700 1 -- 172.21.15.8:0/4284479051 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcac800bc10 con 0x7fcad8106660 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.908+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fcad810aa50 con 0x7fcad8106660 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.909+0000 7fcad57fa700 1 -- 172.21.15.8:0/4284479051 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fcac800b3e0 con 0x7fcad8106660 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.911+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcac0038930 msgr2=0x7fcac003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.911+0000 7fcade561700 1 --2- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcac0038930 0x7fcac003adf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcacc006fd0 tx=0x7fcacc006e40 comp rx=0 tx=0).stop 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.911+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 msgr2=0x7fcad807bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.911+0000 7fcade561700 1 --2- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad807bc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcac8003e30 tx=0x7fcac80119a0 comp rx=0 tx=0).stop 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.912+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 shutdown_connections 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.912+0000 7fcade561700 1 --2- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcac0038930 0x7fcac003adf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:54.724 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.912+0000 7fcade561700 1 --2- 172.21.15.8:0/4284479051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcad8106660 0x7fcad807bc30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:54.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.912+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 >> 172.21.15.8:0/4284479051 conn(0x7fcad8101c20 msgr2=0x7fcad81032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:54.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.912+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 shutdown_connections 2023-10-06T23:03:54.725 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:53.912+0000 7fcade561700 1 -- 172.21.15.8:0/4284479051 wait complete. 2023-10-06T23:03:54.737 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-06T23:03:54.737 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-10-06T23:03:54.754 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-06T23:03:54.754 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-06T23:03:54.754 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-10-06T23:03:54.754 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-06T23:03:54.756 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph Dashboard is now available at: 2023-10-06T23:03:54.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:54.757 INFO:teuthology.orchestra.run.smithi008.stdout: URL: https://smithi008.front.sepia.ceph.com:8443/ 2023-10-06T23:03:54.757 INFO:teuthology.orchestra.run.smithi008.stdout: User: admin 2023-10-06T23:03:54.757 INFO:teuthology.orchestra.run.smithi008.stdout: Password: psix01se4f 2023-10-06T23:03:54.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:54.757 INFO:teuthology.orchestra.run.smithi008.stdout:Saving cluster configuration to /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config directory 2023-10-06T23:03:54.758 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling autotune for osd_memory_target 2023-10-06T23:03:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.397+0000 7fb9a75e8700 1 Processor -- start 2023-10-06T23:03:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.397+0000 7fb9a75e8700 1 -- start start 2023-10-06T23:03:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.398+0000 7fb9a75e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a007a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.398+0000 7fb9a75e8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a007a870 con 0x7fb9a007be40 2023-10-06T23:03:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.398+0000 7fb9a5384700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a007a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.398+0000 7fb9a5384700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a007a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53804/0 (socket says 172.21.15.8:53804) 2023-10-06T23:03:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.398+0000 7fb9a5384700 1 -- 172.21.15.8:0/2556084580 learned_addr learned my addr 172.21.15.8:0/2556084580 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.399+0000 7fb9a5384700 1 -- 172.21.15.8:0/2556084580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a007a9b0 con 0x7fb9a007be40 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.399+0000 7fb9a5384700 1 --2- 172.21.15.8:0/2556084580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a007a2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0098a0 tx=0x7fb99c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d457aaea3dd0d196 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.399+0000 7fb997fff700 1 -- 172.21.15.8:0/2556084580 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb99c004160 con 0x7fb9a007be40 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.399+0000 7fb997fff700 1 -- 172.21.15.8:0/2556084580 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb99c0042c0 con 0x7fb9a007be40 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.399+0000 7fb997fff700 1 -- 172.21.15.8:0/2556084580 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb99c0118e0 con 0x7fb9a007be40 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.400+0000 7fb9a75e8700 1 -- 172.21.15.8:0/2556084580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 msgr2=0x7fb9a007a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.400+0000 7fb9a75e8700 1 --2- 172.21.15.8:0/2556084580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a007a2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0098a0 tx=0x7fb99c009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.400+0000 7fb9a75e8700 1 -- 172.21.15.8:0/2556084580 shutdown_connections 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.400+0000 7fb9a75e8700 1 --2- 172.21.15.8:0/2556084580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a007a2a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.400+0000 7fb9a75e8700 1 -- 172.21.15.8:0/2556084580 >> 172.21.15.8:0/2556084580 conn(0x7fb9a0101bd0 msgr2=0x7fb9a0104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.400+0000 7fb9a75e8700 1 -- 172.21.15.8:0/2556084580 shutdown_connections 2023-10-06T23:03:56.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.400+0000 7fb9a75e8700 1 -- 172.21.15.8:0/2556084580 wait complete. 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.401+0000 7fb9a75e8700 1 Processor -- start 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.402+0000 7fb9a75e8700 1 -- start start 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.402+0000 7fb9a75e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.402+0000 7fb9a75e8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a019c9c0 con 0x7fb9a007be40 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.402+0000 7fb9a5384700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.402+0000 7fb9a5384700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a019c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53814/0 (socket says 172.21.15.8:53814) 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.402+0000 7fb9a5384700 1 -- 172.21.15.8:0/457221552 learned_addr learned my addr 172.21.15.8:0/457221552 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.403+0000 7fb9a5384700 1 -- 172.21.15.8:0/457221552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c009550 con 0x7fb9a007be40 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.403+0000 7fb9a5384700 1 --2- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a019c480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb99c003e30 tx=0x7fb99c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.403+0000 7fb9967fc700 1 -- 172.21.15.8:0/457221552 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb99c0036a0 con 0x7fb9a007be40 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.403+0000 7fb9967fc700 1 -- 172.21.15.8:0/457221552 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb99c01b440 con 0x7fb9a007be40 2023-10-06T23:03:56.042 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.403+0000 7fb9967fc700 1 -- 172.21.15.8:0/457221552 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb99c023400 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.403+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a019cbc0 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.403+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a019cfe0 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.404+0000 7fb9967fc700 1 -- 172.21.15.8:0/457221552 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fb99c01b5b0 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.404+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a010c9f0 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.405+0000 7fb9967fc700 1 --2- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb98c038a20 0x7fb98c03aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.405+0000 7fb9967fc700 1 -- 172.21.15.8:0/457221552 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb99c04ca60 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.405+0000 7fb9a4b83700 1 --2- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb98c038a20 0x7fb98c03aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.406+0000 7fb9a4b83700 1 --2- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb98c038a20 0x7fb98c03aee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb990009940 tx=0x7fb990006e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.410+0000 7fb9967fc700 1 -- 172.21.15.8:0/457221552 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb99c0195b0 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.619+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fb9a010cc30 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.619+0000 7fb9967fc700 1 -- 172.21.15.8:0/457221552 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fb99c0193d0 con 0x7fb9a007be40 2023-10-06T23:03:56.043 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.621+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb98c038a20 msgr2=0x7fb98c03aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.621+0000 7fb9a75e8700 1 --2- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb98c038a20 0x7fb98c03aee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb990009940 tx=0x7fb990006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.621+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 msgr2=0x7fb9a019c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.621+0000 7fb9a75e8700 1 --2- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a019c480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb99c003e30 tx=0x7fb99c0119a0 comp rx=0 tx=0).stop 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.621+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 shutdown_connections 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.621+0000 7fb9a75e8700 1 --2- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb98c038a20 0x7fb98c03aee0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.621+0000 7fb9a75e8700 1 --2- 172.21.15.8:0/457221552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9a007be40 0x7fb9a019c480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.621+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 >> 172.21.15.8:0/457221552 conn(0x7fb9a0101bd0 msgr2=0x7fb9a01032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.622+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 shutdown_connections 2023-10-06T23:03:56.044 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:55.622+0000 7fb9a75e8700 1 -- 172.21.15.8:0/457221552 wait complete. 2023-10-06T23:03:56.327 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:55 smithi008 ceph-mon[98532]: mgrmap e13: x(active, since 6s) 2023-10-06T23:03:57.319 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.586+0000 7f9c3d7e9700 1 Processor -- start 2023-10-06T23:03:57.319 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.586+0000 7f9c3d7e9700 1 -- start start 2023-10-06T23:03:57.319 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.587+0000 7f9c3d7e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c38106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:57.319 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.587+0000 7f9c3d7e9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c38107040 con 0x7f9c38106650 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.587+0000 7f9c36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c38106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.587+0000 7f9c36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c38106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53824/0 (socket says 172.21.15.8:53824) 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.587+0000 7f9c36ffd700 1 -- 172.21.15.8:0/3957340671 learned_addr learned my addr 172.21.15.8:0/3957340671 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.588+0000 7f9c36ffd700 1 -- 172.21.15.8:0/3957340671 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c38107850 con 0x7f9c38106650 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.588+0000 7f9c36ffd700 1 --2- 172.21.15.8:0/3957340671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c38106a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098a0 tx=0x7f9c28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198ff2978cc0022a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.588+0000 7f9c35ffb700 1 -- 172.21.15.8:0/3957340671 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c28004160 con 0x7f9c38106650 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.588+0000 7f9c35ffb700 1 -- 172.21.15.8:0/3957340671 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c280042c0 con 0x7f9c38106650 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.588+0000 7f9c35ffb700 1 -- 172.21.15.8:0/3957340671 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c280118e0 con 0x7f9c38106650 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.589+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/3957340671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 msgr2=0x7f9c38106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.589+0000 7f9c3d7e9700 1 --2- 172.21.15.8:0/3957340671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c38106a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098a0 tx=0x7f9c28009bb0 comp rx=0 tx=0).stop 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.589+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/3957340671 shutdown_connections 2023-10-06T23:03:57.320 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.589+0000 7f9c3d7e9700 1 --2- 172.21.15.8:0/3957340671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c38106a70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.589+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/3957340671 >> 172.21.15.8:0/3957340671 conn(0x7f9c38101bd0 msgr2=0x7f9c38104030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.589+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/3957340671 shutdown_connections 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.589+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/3957340671 wait complete. 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.590+0000 7f9c3d7e9700 1 Processor -- start 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.590+0000 7f9c3d7e9700 1 -- start start 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.590+0000 7f9c3d7e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c3819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.590+0000 7f9c3d7e9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3819ca10 con 0x7f9c38106650 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.591+0000 7f9c36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c3819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.591+0000 7f9c36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c3819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53826/0 (socket says 172.21.15.8:53826) 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.591+0000 7f9c36ffd700 1 -- 172.21.15.8:0/1458571148 learned_addr learned my addr 172.21.15.8:0/1458571148 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.591+0000 7f9c36ffd700 1 -- 172.21.15.8:0/1458571148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009550 con 0x7f9c38106650 2023-10-06T23:03:57.321 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.591+0000 7f9c36ffd700 1 --2- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c3819c4d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c28003e30 tx=0x7f9c280119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.592+0000 7f9c1ffff700 1 -- 172.21.15.8:0/1458571148 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c280036a0 con 0x7f9c38106650 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.592+0000 7f9c1ffff700 1 -- 172.21.15.8:0/1458571148 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c2801b440 con 0x7f9c38106650 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.592+0000 7f9c1ffff700 1 -- 172.21.15.8:0/1458571148 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c28023400 con 0x7f9c38106650 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.592+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3819cc10 con 0x7f9c38106650 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.592+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3819d030 con 0x7f9c38106650 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.593+0000 7f9c1ffff700 1 -- 172.21.15.8:0/1458571148 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f9c2801b5b0 con 0x7f9c38106650 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.593+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c380624e0 con 0x7f9c38106650 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.593+0000 7f9c1ffff700 1 --2- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9c20038a20 0x7f9c2003aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.593+0000 7f9c1ffff700 1 -- 172.21.15.8:0/1458571148 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c2804c960 con 0x7f9c38106650 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.594+0000 7f9c367fc700 1 --2- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9c20038a20 0x7f9c2003aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:03:57.322 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.594+0000 7f9c367fc700 1 --2- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9c20038a20 0x7f9c2003aee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009940 tx=0x7f9c2c006e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.598+0000 7f9c1ffff700 1 -- 172.21.15.8:0/1458571148 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9c2800be40 con 0x7f9c38106650 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.921+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f9c3819fc80 con 0x7f9c38106650 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.923+0000 7f9c1ffff700 1 -- 172.21.15.8:0/1458571148 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f9c2800b3e0 con 0x7f9c38106650 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9c20038a20 msgr2=0x7f9c2003aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 --2- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9c20038a20 0x7f9c2003aee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009940 tx=0x7f9c2c006e30 comp rx=0 tx=0).stop 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 msgr2=0x7f9c3819c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 --2- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c3819c4d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c28003e30 tx=0x7f9c280119a0 comp rx=0 tx=0).stop 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 shutdown_connections 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 --2- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9c20038a20 0x7f9c2003aee0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 --2- 172.21.15.8:0/1458571148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c38106650 0x7f9c3819c4d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 >> 172.21.15.8:0/1458571148 conn(0x7f9c38101bd0 msgr2=0x7f9c381029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:03:57.323 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 shutdown_connections 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-10-06T23:03:56.926+0000 7f9c3d7e9700 1 -- 172.21.15.8:0/1458571148 wait complete. 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout:Or, if you are only running a single cluster on this host: 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:57.324 INFO:teuthology.orchestra.run.smithi008.stdout: ceph telemetry on 2023-10-06T23:03:57.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:57.325 INFO:teuthology.orchestra.run.smithi008.stdout:For more information see: 2023-10-06T23:03:57.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:57.325 INFO:teuthology.orchestra.run.smithi008.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-06T23:03:57.325 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:03:57.325 INFO:teuthology.orchestra.run.smithi008.stdout:Bootstrap complete. 2023-10-06T23:03:57.380 INFO:tasks.cephadm:Fetching config... 2023-10-06T23:03:57.381 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:03:57.381 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-06T23:03:57.424 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-06T23:03:57.424 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:03:57.425 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-06T23:03:57.510 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-06T23:03:57.510 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:03:57.510 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-06T23:03:57.620 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-06T23:03:57.620 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:03:57.620 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-06T23:03:57.703 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-06T23:03:57.704 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/cVvm+uROm4ZDs2HFk4lUIAlezua590J5E7vak2LQ9cKIocp2JD6Yaq4t46cuU3A3R5pDt3pbzakip/tSXpeGP+BCClDpkz/WYoCmoXobWiO7HbB2ubJa3HQuRv/CFgHJRCE2sYEL+ZTvr19qCeaeP8i6wxRuJ5LwNslV5Sd5CH+FB1nis7n9YJRaxUQ97Nr9JeBgtcHx4/Rt0ToWuVx7ofpmu0Pb5Krbcst/Zc7YbyfZR0ElLzhSTBdpzLg81Nt2uFvUgdzDgbTEKknhGrOUEYBVp8aixSSweTBnvVjdlqpbu+ZUbnPK6LtpSOK6Jd+KzEOrgPo6S7gYZ3ordR5eQJ5MtWxdXBL+ovEnFPLu80flfwgs58xWRu79T2f5zzRU8uPCbhC/vLZd51u+etqBrM5JP5VP49ZI4iItefsmbvvqGsyphbRQAMOehIFbldfZtKuuvjA6He0wmCLPa+wrb/+CAsTn4aWs1d7dvST4bSPA2KBZAC36yaEV8ASyLSs= ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-06T23:03:57.845 INFO:teuthology.orchestra.run.smithi008.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/cVvm+uROm4ZDs2HFk4lUIAlezua590J5E7vak2LQ9cKIocp2JD6Yaq4t46cuU3A3R5pDt3pbzakip/tSXpeGP+BCClDpkz/WYoCmoXobWiO7HbB2ubJa3HQuRv/CFgHJRCE2sYEL+ZTvr19qCeaeP8i6wxRuJ5LwNslV5Sd5CH+FB1nis7n9YJRaxUQ97Nr9JeBgtcHx4/Rt0ToWuVx7ofpmu0Pb5Krbcst/Zc7YbyfZR0ElLzhSTBdpzLg81Nt2uFvUgdzDgbTEKknhGrOUEYBVp8aixSSweTBnvVjdlqpbu+ZUbnPK6LtpSOK6Jd+KzEOrgPo6S7gYZ3ordR5eQJ5MtWxdXBL+ovEnFPLu80flfwgs58xWRu79T2f5zzRU8uPCbhC/vLZd51u+etqBrM5JP5VP49ZI4iItefsmbvvqGsyphbRQAMOehIFbldfZtKuuvjA6He0wmCLPa+wrb/+CAsTn4aWs1d7dvST4bSPA2KBZAC36yaEV8ASyLSs= ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:03:57.878 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/cVvm+uROm4ZDs2HFk4lUIAlezua590J5E7vak2LQ9cKIocp2JD6Yaq4t46cuU3A3R5pDt3pbzakip/tSXpeGP+BCClDpkz/WYoCmoXobWiO7HbB2ubJa3HQuRv/CFgHJRCE2sYEL+ZTvr19qCeaeP8i6wxRuJ5LwNslV5Sd5CH+FB1nis7n9YJRaxUQ97Nr9JeBgtcHx4/Rt0ToWuVx7ofpmu0Pb5Krbcst/Zc7YbyfZR0ElLzhSTBdpzLg81Nt2uFvUgdzDgbTEKknhGrOUEYBVp8aixSSweTBnvVjdlqpbu+ZUbnPK6LtpSOK6Jd+KzEOrgPo6S7gYZ3ordR5eQJ5MtWxdXBL+ovEnFPLu80flfwgs58xWRu79T2f5zzRU8uPCbhC/vLZd51u+etqBrM5JP5VP49ZI4iItefsmbvvqGsyphbRQAMOehIFbldfZtKuuvjA6He0wmCLPa+wrb/+CAsTn4aWs1d7dvST4bSPA2KBZAC36yaEV8ASyLSs= ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-06T23:03:57.983 INFO:teuthology.orchestra.run.smithi156.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/cVvm+uROm4ZDs2HFk4lUIAlezua590J5E7vak2LQ9cKIocp2JD6Yaq4t46cuU3A3R5pDt3pbzakip/tSXpeGP+BCClDpkz/WYoCmoXobWiO7HbB2ubJa3HQuRv/CFgHJRCE2sYEL+ZTvr19qCeaeP8i6wxRuJ5LwNslV5Sd5CH+FB1nis7n9YJRaxUQ97Nr9JeBgtcHx4/Rt0ToWuVx7ofpmu0Pb5Krbcst/Zc7YbyfZR0ElLzhSTBdpzLg81Nt2uFvUgdzDgbTEKknhGrOUEYBVp8aixSSweTBnvVjdlqpbu+ZUbnPK6LtpSOK6Jd+KzEOrgPo6S7gYZ3ordR5eQJ5MtWxdXBL+ovEnFPLu80flfwgs58xWRu79T2f5zzRU8uPCbhC/vLZd51u+etqBrM5JP5VP49ZI4iItefsmbvvqGsyphbRQAMOehIFbldfZtKuuvjA6He0wmCLPa+wrb/+CAsTn4aWs1d7dvST4bSPA2KBZAC36yaEV8ASyLSs= ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:03:58.014 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/cVvm+uROm4ZDs2HFk4lUIAlezua590J5E7vak2LQ9cKIocp2JD6Yaq4t46cuU3A3R5pDt3pbzakip/tSXpeGP+BCClDpkz/WYoCmoXobWiO7HbB2ubJa3HQuRv/CFgHJRCE2sYEL+ZTvr19qCeaeP8i6wxRuJ5LwNslV5Sd5CH+FB1nis7n9YJRaxUQ97Nr9JeBgtcHx4/Rt0ToWuVx7ofpmu0Pb5Krbcst/Zc7YbyfZR0ElLzhSTBdpzLg81Nt2uFvUgdzDgbTEKknhGrOUEYBVp8aixSSweTBnvVjdlqpbu+ZUbnPK6LtpSOK6Jd+KzEOrgPo6S7gYZ3ordR5eQJ5MtWxdXBL+ovEnFPLu80flfwgs58xWRu79T2f5zzRU8uPCbhC/vLZd51u+etqBrM5JP5VP49ZI4iItefsmbvvqGsyphbRQAMOehIFbldfZtKuuvjA6He0wmCLPa+wrb/+CAsTn4aWs1d7dvST4bSPA2KBZAC36yaEV8ASyLSs= ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-06T23:03:58.118 INFO:teuthology.orchestra.run.smithi190.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/cVvm+uROm4ZDs2HFk4lUIAlezua590J5E7vak2LQ9cKIocp2JD6Yaq4t46cuU3A3R5pDt3pbzakip/tSXpeGP+BCClDpkz/WYoCmoXobWiO7HbB2ubJa3HQuRv/CFgHJRCE2sYEL+ZTvr19qCeaeP8i6wxRuJ5LwNslV5Sd5CH+FB1nis7n9YJRaxUQ97Nr9JeBgtcHx4/Rt0ToWuVx7ofpmu0Pb5Krbcst/Zc7YbyfZR0ElLzhSTBdpzLg81Nt2uFvUgdzDgbTEKknhGrOUEYBVp8aixSSweTBnvVjdlqpbu+ZUbnPK6LtpSOK6Jd+KzEOrgPo6S7gYZ3ordR5eQJ5MtWxdXBL+ovEnFPLu80flfwgs58xWRu79T2f5zzRU8uPCbhC/vLZd51u+etqBrM5JP5VP49ZI4iItefsmbvvqGsyphbRQAMOehIFbldfZtKuuvjA6He0wmCLPa+wrb/+CAsTn4aWs1d7dvST4bSPA2KBZAC36yaEV8ASyLSs= ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:03:58.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:03:57 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1458571148' entity='client.admin' 2023-10-06T23:03:58.148 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-06T23:03:58.911 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:04:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.020+0000 7ff764d34700 1 -- 172.21.15.8:0/2711461935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 msgr2=0x7ff760073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.020+0000 7ff764d34700 1 --2- 172.21.15.8:0/2711461935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 0x7ff760073340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff754009910 tx=0x7ff754009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.020+0000 7ff764d34700 1 -- 172.21.15.8:0/2711461935 shutdown_connections 2023-10-06T23:04:01.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.020+0000 7ff764d34700 1 --2- 172.21.15.8:0/2711461935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 0x7ff760073340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:01.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.020+0000 7ff764d34700 1 -- 172.21.15.8:0/2711461935 >> 172.21.15.8:0/2711461935 conn(0x7ff7600fbf80 msgr2=0x7ff7600fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:01.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.020+0000 7ff764d34700 1 -- 172.21.15.8:0/2711461935 shutdown_connections 2023-10-06T23:04:01.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.020+0000 7ff764d34700 1 -- 172.21.15.8:0/2711461935 wait complete. 2023-10-06T23:04:01.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.021+0000 7ff764d34700 1 Processor -- start 2023-10-06T23:04:01.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.021+0000 7ff764d34700 1 -- start start 2023-10-06T23:04:01.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.021+0000 7ff764d34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 0x7ff760197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:01.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.021+0000 7ff764d34700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601981b0 con 0x7ff760074ee0 2023-10-06T23:04:01.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.021+0000 7ff75e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 0x7ff760197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:01.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.021+0000 7ff75e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 0x7ff760197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60798/0 (socket says 172.21.15.8:60798) 2023-10-06T23:04:01.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.021+0000 7ff75e59c700 1 -- 172.21.15.8:0/986103072 learned_addr learned my addr 172.21.15.8:0/986103072 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:04:01.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.022+0000 7ff75e59c700 1 -- 172.21.15.8:0/986103072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540095f0 con 0x7ff760074ee0 2023-10-06T23:04:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.022+0000 7ff75e59c700 1 --2- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 0x7ff760197c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff754006010 tx=0x7ff754005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.022+0000 7ff74f7fe700 1 -- 172.21.15.8:0/986103072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff75400ba90 con 0x7ff760074ee0 2023-10-06T23:04:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.022+0000 7ff74f7fe700 1 -- 172.21.15.8:0/986103072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff75400bbf0 con 0x7ff760074ee0 2023-10-06T23:04:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.022+0000 7ff74f7fe700 1 -- 172.21.15.8:0/986103072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff754017440 con 0x7ff760074ee0 2023-10-06T23:04:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.022+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7601983b0 con 0x7ff760074ee0 2023-10-06T23:04:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.023+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff760198850 con 0x7ff760074ee0 2023-10-06T23:04:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.024+0000 7ff74f7fe700 1 -- 172.21.15.8:0/986103072 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7ff75400f460 con 0x7ff760074ee0 2023-10-06T23:04:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.024+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7601915d0 con 0x7ff760074ee0 2023-10-06T23:04:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.024+0000 7ff74f7fe700 1 --2- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff748038910 0x7ff74803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.024+0000 7ff74f7fe700 1 -- 172.21.15.8:0/986103072 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff75404cb40 con 0x7ff760074ee0 2023-10-06T23:04:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.024+0000 7ff75dd9b700 1 --2- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff748038910 0x7ff74803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:01.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.025+0000 7ff75dd9b700 1 --2- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff748038910 0x7ff74803add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff750006fd0 tx=0x7ff750006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:01.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.029+0000 7ff74f7fe700 1 -- 172.21.15.8:0/986103072 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff75402ad30 con 0x7ff760074ee0 2023-10-06T23:04:01.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.241+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ff760108810 con 0x7ff760074ee0 2023-10-06T23:04:01.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.244+0000 7ff74f7fe700 1 -- 172.21.15.8:0/986103072 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff754027070 con 0x7ff760074ee0 2023-10-06T23:04:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff748038910 msgr2=0x7ff74803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 --2- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff748038910 0x7ff74803add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff750006fd0 tx=0x7ff750006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 msgr2=0x7ff760197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 --2- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 0x7ff760197c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff754006010 tx=0x7ff754005810 comp rx=0 tx=0).stop 2023-10-06T23:04:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 shutdown_connections 2023-10-06T23:04:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 --2- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff748038910 0x7ff74803add0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 --2- 172.21.15.8:0/986103072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff760074ee0 0x7ff760197c70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 >> 172.21.15.8:0/986103072 conn(0x7ff7600fbf80 msgr2=0x7ff7600fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 shutdown_connections 2023-10-06T23:04:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:01.247+0000 7ff764d34700 1 -- 172.21.15.8:0/986103072 wait complete. 2023-10-06T23:04:01.384 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:01.384 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:01.384 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi008", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:04:01.384 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:01.384 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:01.384 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:01.759 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-06T23:04:01.760 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-06T23:04:02.365 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:02 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/986103072' entity='client.admin' 2023-10-06T23:04:02.365 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:02.365 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:02.578 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:04:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.976+0000 7faf8106f700 1 -- 172.21.15.8:0/1033719421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 msgr2=0x7faf7c100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.976+0000 7faf8106f700 1 --2- 172.21.15.8:0/1033719421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 0x7faf7c100e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009910 tx=0x7faf6c009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.976+0000 7faf8106f700 1 -- 172.21.15.8:0/1033719421 shutdown_connections 2023-10-06T23:04:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.976+0000 7faf8106f700 1 --2- 172.21.15.8:0/1033719421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 0x7faf7c100e20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.976+0000 7faf8106f700 1 -- 172.21.15.8:0/1033719421 >> 172.21.15.8:0/1033719421 conn(0x7faf7c0fbf80 msgr2=0x7faf7c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.976+0000 7faf8106f700 1 -- 172.21.15.8:0/1033719421 shutdown_connections 2023-10-06T23:04:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.976+0000 7faf8106f700 1 -- 172.21.15.8:0/1033719421 wait complete. 2023-10-06T23:04:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.977+0000 7faf8106f700 1 Processor -- start 2023-10-06T23:04:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.978+0000 7faf8106f700 1 -- start start 2023-10-06T23:04:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.978+0000 7faf8106f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 0x7faf7c195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.978+0000 7faf8106f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c195f50 con 0x7faf7c100a00 2023-10-06T23:04:03.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.978+0000 7faf7ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 0x7faf7c195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:03.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.978+0000 7faf7ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 0x7faf7c195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60824/0 (socket says 172.21.15.8:60824) 2023-10-06T23:04:03.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.978+0000 7faf7ad9d700 1 -- 172.21.15.8:0/2928137547 learned_addr learned my addr 172.21.15.8:0/2928137547 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:04:03.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.979+0000 7faf7ad9d700 1 -- 172.21.15.8:0/2928137547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0095f0 con 0x7faf7c100a00 2023-10-06T23:04:03.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.979+0000 7faf7ad9d700 1 --2- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 0x7faf7c195a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf6c005950 tx=0x7faf6c005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:03.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.979+0000 7faf63fff700 1 -- 172.21.15.8:0/2928137547 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf6c00ba90 con 0x7faf7c100a00 2023-10-06T23:04:03.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.979+0000 7faf63fff700 1 -- 172.21.15.8:0/2928137547 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf6c00bbf0 con 0x7faf7c100a00 2023-10-06T23:04:03.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.979+0000 7faf63fff700 1 -- 172.21.15.8:0/2928137547 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf6c017440 con 0x7faf7c100a00 2023-10-06T23:04:03.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.979+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c196150 con 0x7faf7c100a00 2023-10-06T23:04:03.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.979+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c1965f0 con 0x7faf7c100a00 2023-10-06T23:04:03.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.980+0000 7faf63fff700 1 -- 172.21.15.8:0/2928137547 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7faf6c00f460 con 0x7faf7c100a00 2023-10-06T23:04:03.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.981+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c18f3c0 con 0x7faf7c100a00 2023-10-06T23:04:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.981+0000 7faf63fff700 1 --2- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faf64038910 0x7faf6403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.981+0000 7faf63fff700 1 -- 172.21.15.8:0/2928137547 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faf6c04ca90 con 0x7faf7c100a00 2023-10-06T23:04:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.981+0000 7faf7a59c700 1 --2- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faf64038910 0x7faf6403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.982+0000 7faf7a59c700 1 --2- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faf64038910 0x7faf6403add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faf70006fd0 tx=0x7faf70006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:03.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:03.986+0000 7faf63fff700 1 -- 172.21.15.8:0/2928137547 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faf6c02ad30 con 0x7faf7c100a00 2023-10-06T23:04:04.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.199+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7faf7c02d160 con 0x7faf64038910 2023-10-06T23:04:04.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.203+0000 7faf63fff700 1 -- 172.21.15.8:0/2928137547 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faf7c02d160 con 0x7faf64038910 2023-10-06T23:04:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.205+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faf64038910 msgr2=0x7faf6403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.205+0000 7faf8106f700 1 --2- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faf64038910 0x7faf6403add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faf70006fd0 tx=0x7faf70006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.205+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 msgr2=0x7faf7c195a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.205+0000 7faf8106f700 1 --2- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 0x7faf7c195a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf6c005950 tx=0x7faf6c005810 comp rx=0 tx=0).stop 2023-10-06T23:04:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.205+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 shutdown_connections 2023-10-06T23:04:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.205+0000 7faf8106f700 1 --2- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faf64038910 0x7faf6403add0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:04.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.205+0000 7faf8106f700 1 --2- 172.21.15.8:0/2928137547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf7c100a00 0x7faf7c195a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:04.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.206+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 >> 172.21.15.8:0/2928137547 conn(0x7faf7c0fbf80 msgr2=0x7faf7c0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:04.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.206+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 shutdown_connections 2023-10-06T23:04:04.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:04.206+0000 7faf8106f700 1 -- 172.21.15.8:0/2928137547 wait complete. 2023-10-06T23:04:04.757 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi156 2023-10-06T23:04:04.757 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:04:04.758 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.conf 2023-10-06T23:04:04.806 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:04:04.806 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:04.891 INFO:tasks.cephadm:Adding host smithi156 to orchestrator... 2023-10-06T23:04:04.891 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi156 2023-10-06T23:04:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:04:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:05 smithi008 ceph-mon[98532]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:05 smithi008 ceph-mon[98532]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-06T23:04:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:05 smithi008 ceph-mon[98532]: Updating smithi008:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:06.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:06 smithi008 ceph-mon[98532]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:06.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:06 smithi008 ceph-mon[98532]: Updating smithi008:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-06T23:04:07.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.171+0000 7fde526d2700 1 -- 172.21.15.8:0/3973763290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 msgr2=0x7fde4c0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:07.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.171+0000 7fde526d2700 1 --2- 172.21.15.8:0/3973763290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 0x7fde4c0736c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009910 tx=0x7fde3c009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:07.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.171+0000 7fde526d2700 1 -- 172.21.15.8:0/3973763290 shutdown_connections 2023-10-06T23:04:07.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.171+0000 7fde526d2700 1 --2- 172.21.15.8:0/3973763290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 0x7fde4c0736c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:07.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.171+0000 7fde526d2700 1 -- 172.21.15.8:0/3973763290 >> 172.21.15.8:0/3973763290 conn(0x7fde4c0fc4a0 msgr2=0x7fde4c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:07.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.171+0000 7fde526d2700 1 -- 172.21.15.8:0/3973763290 shutdown_connections 2023-10-06T23:04:07.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.171+0000 7fde526d2700 1 -- 172.21.15.8:0/3973763290 wait complete. 2023-10-06T23:04:07.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.172+0000 7fde526d2700 1 Processor -- start 2023-10-06T23:04:07.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.172+0000 7fde526d2700 1 -- start start 2023-10-06T23:04:07.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.172+0000 7fde526d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 0x7fde4c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:07.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.172+0000 7fde526d2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c198560 con 0x7fde4c0732e0 2023-10-06T23:04:07.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.173+0000 7fde4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 0x7fde4c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:07.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.173+0000 7fde4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 0x7fde4c198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60842/0 (socket says 172.21.15.8:60842) 2023-10-06T23:04:07.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.173+0000 7fde4bfff700 1 -- 172.21.15.8:0/3758065901 learned_addr learned my addr 172.21.15.8:0/3758065901 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:04:07.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.173+0000 7fde4bfff700 1 -- 172.21.15.8:0/3758065901 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0095f0 con 0x7fde4c0732e0 2023-10-06T23:04:07.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.173+0000 7fde4bfff700 1 --2- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 0x7fde4c198020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde3c006010 tx=0x7fde3c004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:07.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.173+0000 7fde497fa700 1 -- 172.21.15.8:0/3758065901 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde3c01d070 con 0x7fde4c0732e0 2023-10-06T23:04:07.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.174+0000 7fde497fa700 1 -- 172.21.15.8:0/3758065901 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde3c00bdf0 con 0x7fde4c0732e0 2023-10-06T23:04:07.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.174+0000 7fde497fa700 1 -- 172.21.15.8:0/3758065901 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde3c022d80 con 0x7fde4c0732e0 2023-10-06T23:04:07.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.174+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c198760 con 0x7fde4c0732e0 2023-10-06T23:04:07.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.174+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c198b80 con 0x7fde4c0732e0 2023-10-06T23:04:07.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.175+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c0624e0 con 0x7fde4c0732e0 2023-10-06T23:04:07.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.175+0000 7fde497fa700 1 -- 172.21.15.8:0/3758065901 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fde3c022570 con 0x7fde4c0732e0 2023-10-06T23:04:07.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.175+0000 7fde497fa700 1 --2- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fde34038910 0x7fde3403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:07.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.175+0000 7fde497fa700 1 -- 172.21.15.8:0/3758065901 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fde3c04c9e0 con 0x7fde4c0732e0 2023-10-06T23:04:07.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.176+0000 7fde4b7fe700 1 --2- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fde34038910 0x7fde3403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:07.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.176+0000 7fde4b7fe700 1 --2- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fde34038910 0x7fde3403add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fde40006fd0 tx=0x7fde40006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:07.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.181+0000 7fde497fa700 1 -- 172.21.15.8:0/3758065901 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fde3c02bba0 con 0x7fde4c0732e0 2023-10-06T23:04:07.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:07.394+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}) v1 -- 0x7fde4c10cea0 con 0x7fde34038910 2023-10-06T23:04:07.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:07.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:07.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:08.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:08 smithi008 ceph-mon[98532]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:10.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:09 smithi008 ceph-mon[98532]: Deploying cephadm binary to smithi156 2023-10-06T23:04:10.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:09 smithi008 ceph-mon[98532]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:10.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.922+0000 7fde497fa700 1 -- 172.21.15.8:0/3758065901 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fde4c10cea0 con 0x7fde34038910 2023-10-06T23:04:10.924 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi156' with addr '172.21.15.156' 2023-10-06T23:04:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fde34038910 msgr2=0x7fde3403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 --2- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fde34038910 0x7fde3403add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fde40006fd0 tx=0x7fde40006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:10.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 msgr2=0x7fde4c198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 --2- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 0x7fde4c198020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde3c006010 tx=0x7fde3c004f40 comp rx=0 tx=0).stop 2023-10-06T23:04:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 shutdown_connections 2023-10-06T23:04:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 --2- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fde34038910 0x7fde3403add0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 --2- 172.21.15.8:0/3758065901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde4c0732e0 0x7fde4c198020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 >> 172.21.15.8:0/3758065901 conn(0x7fde4c0fc4a0 msgr2=0x7fde4c107550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 shutdown_connections 2023-10-06T23:04:10.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:10.925+0000 7fde526d2700 1 -- 172.21.15.8:0/3758065901 wait complete. 2023-10-06T23:04:11.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-06T23:04:12.170 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:04:12.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:11 smithi008 ceph-mon[98532]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:12.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:12.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:11 smithi008 ceph-mon[98532]: Added host smithi156 2023-10-06T23:04:12.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:12.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.577+0000 7f93bf028700 1 -- 172.21.15.8:0/954941011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 msgr2=0x7f93b80736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.577+0000 7f93bf028700 1 --2- 172.21.15.8:0/954941011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 0x7f93b80736c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009910 tx=0x7f93ac009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.577+0000 7f93bf028700 1 -- 172.21.15.8:0/954941011 shutdown_connections 2023-10-06T23:04:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.577+0000 7f93bf028700 1 --2- 172.21.15.8:0/954941011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 0x7f93b80736c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.577+0000 7f93bf028700 1 -- 172.21.15.8:0/954941011 >> 172.21.15.8:0/954941011 conn(0x7f93b80fc4a0 msgr2=0x7f93b80fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.577+0000 7f93bf028700 1 -- 172.21.15.8:0/954941011 shutdown_connections 2023-10-06T23:04:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.577+0000 7f93bf028700 1 -- 172.21.15.8:0/954941011 wait complete. 2023-10-06T23:04:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.578+0000 7f93bf028700 1 Processor -- start 2023-10-06T23:04:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.579+0000 7f93bf028700 1 -- start start 2023-10-06T23:04:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.579+0000 7f93bf028700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 0x7f93b8198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.579+0000 7f93bf028700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8198560 con 0x7f93b80732e0 2023-10-06T23:04:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.579+0000 7f93bcdc4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 0x7f93b8198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.579+0000 7f93bcdc4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 0x7f93b8198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58990/0 (socket says 172.21.15.8:58990) 2023-10-06T23:04:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.579+0000 7f93bcdc4700 1 -- 172.21.15.8:0/2109359863 learned_addr learned my addr 172.21.15.8:0/2109359863 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:04:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.579+0000 7f93bcdc4700 1 -- 172.21.15.8:0/2109359863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0095f0 con 0x7f93b80732e0 2023-10-06T23:04:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.580+0000 7f93bcdc4700 1 --2- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 0x7f93b8198020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006010 tx=0x7f93ac004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.580+0000 7f93b5ffb700 1 -- 172.21.15.8:0/2109359863 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ac01d070 con 0x7f93b80732e0 2023-10-06T23:04:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.580+0000 7f93b5ffb700 1 -- 172.21.15.8:0/2109359863 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93ac00bdf0 con 0x7f93b80732e0 2023-10-06T23:04:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.580+0000 7f93b5ffb700 1 -- 172.21.15.8:0/2109359863 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ac022d80 con 0x7f93b80732e0 2023-10-06T23:04:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.580+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b8198760 con 0x7f93b80732e0 2023-10-06T23:04:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.580+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b8198b80 con 0x7f93b80732e0 2023-10-06T23:04:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.581+0000 7f93b5ffb700 1 -- 172.21.15.8:0/2109359863 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f93ac022570 con 0x7f93b80732e0 2023-10-06T23:04:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.581+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b80624e0 con 0x7f93b80732e0 2023-10-06T23:04:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.582+0000 7f93b5ffb700 1 --2- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f93a8038910 0x7f93a803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.582+0000 7f93b5ffb700 1 -- 172.21.15.8:0/2109359863 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f93ac04ca70 con 0x7f93b80732e0 2023-10-06T23:04:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.582+0000 7f93b7fff700 1 --2- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f93a8038910 0x7f93a803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.583+0000 7f93b7fff700 1 --2- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f93a8038910 0x7f93a803add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f93a4006fd0 tx=0x7f93a4006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:13.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.587+0000 7f93b5ffb700 1 -- 172.21.15.8:0/2109359863 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f93ac02bb60 con 0x7f93b80732e0 2023-10-06T23:04:13.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:13.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:13 smithi008 ceph-mon[98532]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:13.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.804+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93b810ce70 con 0x7f93a8038910 2023-10-06T23:04:13.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.805+0000 7f93b5ffb700 1 -- 172.21.15.8:0/2109359863 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f93b810ce70 con 0x7f93a8038910 2023-10-06T23:04:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:04:13.808 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}] 2023-10-06T23:04:13.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f93a8038910 msgr2=0x7f93a803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:13.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 --2- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f93a8038910 0x7f93a803add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f93a4006fd0 tx=0x7f93a4006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 msgr2=0x7f93b8198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 --2- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 0x7f93b8198020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006010 tx=0x7f93ac004f40 comp rx=0 tx=0).stop 2023-10-06T23:04:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 shutdown_connections 2023-10-06T23:04:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 --2- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f93a8038910 0x7f93a803add0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 --2- 172.21.15.8:0/2109359863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b80732e0 0x7f93b8198020 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 >> 172.21.15.8:0/2109359863 conn(0x7f93b80fc4a0 msgr2=0x7f93b8107550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 shutdown_connections 2023-10-06T23:04:13.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:13.808+0000 7f93bf028700 1 -- 172.21.15.8:0/2109359863 wait complete. 2023-10-06T23:04:14.248 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi190 2023-10-06T23:04:14.248 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:04:14.249 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.conf 2023-10-06T23:04:14.296 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:04:14.296 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:14.381 INFO:tasks.cephadm:Adding host smithi190 to orchestrator... 2023-10-06T23:04:14.381 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi190 2023-10-06T23:04:15.117 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:04:15.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:14 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:15.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:14 smithi008 ceph-mon[98532]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:04:15.926 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:15 smithi008 ceph-mon[98532]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:16.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.503+0000 7f2ffa47d700 1 -- 172.21.15.8:0/438014786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 msgr2=0x7f2ff4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:16.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.503+0000 7f2ffa47d700 1 --2- 172.21.15.8:0/438014786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 0x7f2ff4106d50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009910 tx=0x7f2fe4009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:16.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.503+0000 7f2ffa47d700 1 -- 172.21.15.8:0/438014786 shutdown_connections 2023-10-06T23:04:16.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.503+0000 7f2ffa47d700 1 --2- 172.21.15.8:0/438014786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 0x7f2ff4106d50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:16.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.503+0000 7f2ffa47d700 1 -- 172.21.15.8:0/438014786 >> 172.21.15.8:0/438014786 conn(0x7f2ff40fc4a0 msgr2=0x7f2ff40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:16.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.503+0000 7f2ffa47d700 1 -- 172.21.15.8:0/438014786 shutdown_connections 2023-10-06T23:04:16.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.503+0000 7f2ffa47d700 1 -- 172.21.15.8:0/438014786 wait complete. 2023-10-06T23:04:16.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.504+0000 7f2ffa47d700 1 Processor -- start 2023-10-06T23:04:16.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.504+0000 7f2ffa47d700 1 -- start start 2023-10-06T23:04:16.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.504+0000 7f2ffa47d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 0x7f2ff4195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:16.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.504+0000 7f2ffa47d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff41962a0 con 0x7f2ff4106970 2023-10-06T23:04:16.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.505+0000 7f2ff3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 0x7f2ff4195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:16.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.505+0000 7f2ff3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 0x7f2ff4195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59016/0 (socket says 172.21.15.8:59016) 2023-10-06T23:04:16.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.505+0000 7f2ff3fff700 1 -- 172.21.15.8:0/456300067 learned_addr learned my addr 172.21.15.8:0/456300067 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:04:16.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.505+0000 7f2ff3fff700 1 -- 172.21.15.8:0/456300067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe40095f0 con 0x7f2ff4106970 2023-10-06T23:04:16.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.505+0000 7f2ff3fff700 1 --2- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 0x7f2ff4195d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4006010 tx=0x7f2fe4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:16.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.505+0000 7f2ff17fa700 1 -- 172.21.15.8:0/456300067 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2fe401d070 con 0x7f2ff4106970 2023-10-06T23:04:16.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.506+0000 7f2ff17fa700 1 -- 172.21.15.8:0/456300067 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2fe400bdf0 con 0x7f2ff4106970 2023-10-06T23:04:16.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.506+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff4196500 con 0x7f2ff4106970 2023-10-06T23:04:16.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.506+0000 7f2ff17fa700 1 -- 172.21.15.8:0/456300067 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2fe4022d80 con 0x7f2ff4106970 2023-10-06T23:04:16.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.506+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff4196980 con 0x7f2ff4106970 2023-10-06T23:04:16.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.507+0000 7f2ff17fa700 1 -- 172.21.15.8:0/456300067 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f2fe4022570 con 0x7f2ff4106970 2023-10-06T23:04:16.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.507+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff40624e0 con 0x7f2ff4106970 2023-10-06T23:04:16.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.507+0000 7f2ff17fa700 1 --2- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2fdc038910 0x7f2fdc03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:16.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.507+0000 7f2ff17fa700 1 -- 172.21.15.8:0/456300067 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2fe404caa0 con 0x7f2ff4106970 2023-10-06T23:04:16.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.507+0000 7f2ff37fe700 1 --2- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2fdc038910 0x7f2fdc03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:16.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.508+0000 7f2ff37fe700 1 --2- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2fdc038910 0x7f2fdc03add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8006fd0 tx=0x7f2fe8006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:16.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.512+0000 7f2ff17fa700 1 -- 172.21.15.8:0/456300067 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2fe402bba0 con 0x7f2ff4106970 2023-10-06T23:04:16.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:16.728+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ff40008d0 con 0x7f2fdc038910 2023-10-06T23:04:18.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:04:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:19.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:18 smithi008 ceph-mon[98532]: Updating smithi156:/etc/ceph/ceph.conf 2023-10-06T23:04:19.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:18 smithi008 ceph-mon[98532]: Deploying cephadm binary to smithi190 2023-10-06T23:04:20.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.038+0000 7f2ff17fa700 1 -- 172.21.15.8:0/456300067 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2ff40008d0 con 0x7f2fdc038910 2023-10-06T23:04:20.040 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi190' with addr '172.21.15.190' 2023-10-06T23:04:20.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2fdc038910 msgr2=0x7f2fdc03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 --2- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2fdc038910 0x7f2fdc03add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8006fd0 tx=0x7f2fe8006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 msgr2=0x7f2ff4195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 --2- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 0x7f2ff4195d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4006010 tx=0x7f2fe4004ff0 comp rx=0 tx=0).stop 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 shutdown_connections 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 --2- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2fdc038910 0x7f2fdc03add0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 --2- 172.21.15.8:0/456300067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ff4106970 0x7f2ff4195d60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 >> 172.21.15.8:0/456300067 conn(0x7f2ff40fc4a0 msgr2=0x7f2ff4108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 shutdown_connections 2023-10-06T23:04:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:20.040+0000 7f2ffa47d700 1 -- 172.21.15.8:0/456300067 wait complete. 2023-10-06T23:04:20.065 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:19 smithi008 ceph-mon[98532]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:20.065 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:19 smithi008 ceph-mon[98532]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:20.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-06T23:04:20.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:20 smithi008 ceph-mon[98532]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:20.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:20 smithi008 ceph-mon[98532]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-06T23:04:20.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:20.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:20.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:20.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:21.340 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:04:21.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:21 smithi008 ceph-mon[98532]: Added host smithi190 2023-10-06T23:04:21.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:21.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:21 smithi008 ceph-mon[98532]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:21.882 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.718+0000 7fb64cca2700 1 -- 172.21.15.8:0/1020679319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 msgr2=0x7fb648106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.718+0000 7fb64cca2700 1 --2- 172.21.15.8:0/1020679319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 0x7fb648106d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb638009910 tx=0x7fb638009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.718+0000 7fb64cca2700 1 -- 172.21.15.8:0/1020679319 shutdown_connections 2023-10-06T23:04:22.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.718+0000 7fb64cca2700 1 --2- 172.21.15.8:0/1020679319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 0x7fb648106d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:22.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.718+0000 7fb64cca2700 1 -- 172.21.15.8:0/1020679319 >> 172.21.15.8:0/1020679319 conn(0x7fb6480fc4a0 msgr2=0x7fb6480fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:22.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.718+0000 7fb64cca2700 1 -- 172.21.15.8:0/1020679319 shutdown_connections 2023-10-06T23:04:22.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.718+0000 7fb64cca2700 1 -- 172.21.15.8:0/1020679319 wait complete. 2023-10-06T23:04:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.719+0000 7fb64cca2700 1 Processor -- start 2023-10-06T23:04:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.720+0000 7fb64cca2700 1 -- start start 2023-10-06T23:04:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.720+0000 7fb64cca2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 0x7fb648195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.720+0000 7fb64cca2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6481962a0 con 0x7fb648106970 2023-10-06T23:04:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.720+0000 7fb64659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 0x7fb648195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.720+0000 7fb64659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 0x7fb648195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41882/0 (socket says 172.21.15.8:41882) 2023-10-06T23:04:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.720+0000 7fb64659c700 1 -- 172.21.15.8:0/4059504734 learned_addr learned my addr 172.21.15.8:0/4059504734 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:04:22.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.720+0000 7fb64659c700 1 -- 172.21.15.8:0/4059504734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380095f0 con 0x7fb648106970 2023-10-06T23:04:22.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.721+0000 7fb64659c700 1 --2- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 0x7fb648195d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb638004f40 tx=0x7fb638005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.721+0000 7fb6377fe700 1 -- 172.21.15.8:0/4059504734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb63801d070 con 0x7fb648106970 2023-10-06T23:04:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.721+0000 7fb6377fe700 1 -- 172.21.15.8:0/4059504734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6380044b0 con 0x7fb648106970 2023-10-06T23:04:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.721+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6481964a0 con 0x7fb648106970 2023-10-06T23:04:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.721+0000 7fb6377fe700 1 -- 172.21.15.8:0/4059504734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb638003810 con 0x7fb648106970 2023-10-06T23:04:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.721+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb648196920 con 0x7fb648106970 2023-10-06T23:04:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.722+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6480624e0 con 0x7fb648106970 2023-10-06T23:04:22.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.722+0000 7fb6377fe700 1 -- 172.21.15.8:0/4059504734 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fb63800b960 con 0x7fb648106970 2023-10-06T23:04:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.723+0000 7fb6377fe700 1 --2- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb630038900 0x7fb63003adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.723+0000 7fb6377fe700 1 -- 172.21.15.8:0/4059504734 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb63804c850 con 0x7fb648106970 2023-10-06T23:04:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.723+0000 7fb645d9b700 1 --2- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb630038900 0x7fb63003adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:22.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.724+0000 7fb645d9b700 1 --2- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb630038900 0x7fb63003adc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb63c006fd0 tx=0x7fb63c006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:22.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.728+0000 7fb6377fe700 1 -- 172.21.15.8:0/4059504734 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb6380042e0 con 0x7fb648106970 2023-10-06T23:04:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.941+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb64810ace0 con 0x7fb630038900 2023-10-06T23:04:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.942+0000 7fb6377fe700 1 -- 172.21.15.8:0/4059504734 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7fb64810ace0 con 0x7fb630038900 2023-10-06T23:04:22.945 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:04:22.945 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}, {"addr": "172.21.15.190", "hostname": "smithi190", "labels": [], "status": ""}] 2023-10-06T23:04:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.944+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb630038900 msgr2=0x7fb63003adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.944+0000 7fb64cca2700 1 --2- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb630038900 0x7fb63003adc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb63c006fd0 tx=0x7fb63c006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.944+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 msgr2=0x7fb648195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.944+0000 7fb64cca2700 1 --2- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 0x7fb648195d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb638004f40 tx=0x7fb638005020 comp rx=0 tx=0).stop 2023-10-06T23:04:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.944+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 shutdown_connections 2023-10-06T23:04:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.944+0000 7fb64cca2700 1 --2- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb630038900 0x7fb63003adc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.944+0000 7fb64cca2700 1 --2- 172.21.15.8:0/4059504734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb648106970 0x7fb648195d60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.944+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 >> 172.21.15.8:0/4059504734 conn(0x7fb6480fc4a0 msgr2=0x7fb648108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.945+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 shutdown_connections 2023-10-06T23:04:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:22.945+0000 7fb64cca2700 1 -- 172.21.15.8:0/4059504734 wait complete. 2023-10-06T23:04:23.418 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-06T23:04:23.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-06T23:04:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:23 smithi008 ceph-mon[98532]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:23 smithi008 ceph-mon[98532]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:04:24.152 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:04:24.664 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:24 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:25.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.568+0000 7f7150ba4700 1 -- 172.21.15.8:0/2641301068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 msgr2=0x7f714c106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:25.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.568+0000 7f7150ba4700 1 --2- 172.21.15.8:0/2641301068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 0x7f714c106d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f713c009910 tx=0x7f713c009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.568+0000 7f7150ba4700 1 -- 172.21.15.8:0/2641301068 shutdown_connections 2023-10-06T23:04:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.568+0000 7f7150ba4700 1 --2- 172.21.15.8:0/2641301068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 0x7f714c106d50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.568+0000 7f7150ba4700 1 -- 172.21.15.8:0/2641301068 >> 172.21.15.8:0/2641301068 conn(0x7f714c0fc4a0 msgr2=0x7f714c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.568+0000 7f7150ba4700 1 -- 172.21.15.8:0/2641301068 shutdown_connections 2023-10-06T23:04:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.568+0000 7f7150ba4700 1 -- 172.21.15.8:0/2641301068 wait complete. 2023-10-06T23:04:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.569+0000 7f7150ba4700 1 Processor -- start 2023-10-06T23:04:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.569+0000 7f7150ba4700 1 -- start start 2023-10-06T23:04:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.569+0000 7f7150ba4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 0x7f714c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.569+0000 7f7150ba4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c1984a0 con 0x7f714c106970 2023-10-06T23:04:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f714a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 0x7f714c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f714a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 0x7f714c197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41896/0 (socket says 172.21.15.8:41896) 2023-10-06T23:04:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f714a59c700 1 -- 172.21.15.8:0/4271376603 learned_addr learned my addr 172.21.15.8:0/4271376603 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:04:25.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f714a59c700 1 -- 172.21.15.8:0/4271376603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0095f0 con 0x7f714c106970 2023-10-06T23:04:25.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f714a59c700 1 --2- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 0x7f714c197f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f713c006010 tx=0x7f713c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:25.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f713b7fe700 1 -- 172.21.15.8:0/4271376603 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f713c01d070 con 0x7f714c106970 2023-10-06T23:04:25.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f713b7fe700 1 -- 172.21.15.8:0/4271376603 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f713c00bdf0 con 0x7f714c106970 2023-10-06T23:04:25.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c198700 con 0x7f714c106970 2023-10-06T23:04:25.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.570+0000 7f713b7fe700 1 -- 172.21.15.8:0/4271376603 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f713c022d80 con 0x7f714c106970 2023-10-06T23:04:25.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.571+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c198b80 con 0x7f714c106970 2023-10-06T23:04:25.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.572+0000 7f713b7fe700 1 -- 172.21.15.8:0/4271376603 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f713c00b960 con 0x7f714c106970 2023-10-06T23:04:25.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.572+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c0624e0 con 0x7f714c106970 2023-10-06T23:04:25.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.572+0000 7f713b7fe700 1 --2- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71340388c0 0x7f713403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:25.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.572+0000 7f713b7fe700 1 -- 172.21.15.8:0/4271376603 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f713c04cad0 con 0x7f714c106970 2023-10-06T23:04:25.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.572+0000 7f7149d9b700 1 --2- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71340388c0 0x7f713403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:25.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.573+0000 7f7149d9b700 1 --2- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71340388c0 0x7f713403ad80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7140006fd0 tx=0x7f7140006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:25.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.577+0000 7f713b7fe700 1 -- 172.21.15.8:0/4271376603 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f713c02bba0 con 0x7f714c106970 2023-10-06T23:04:25.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:25.793+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f714c0008d0 con 0x7f714c106970 2023-10-06T23:04:25.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:25 smithi008 ceph-mon[98532]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.585+0000 7f713b7fe700 1 -- 172.21.15.8:0/4271376603 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f713c027030 con 0x7f714c106970 2023-10-06T23:04:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71340388c0 msgr2=0x7f713403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 --2- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71340388c0 0x7f713403ad80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7140006fd0 tx=0x7f7140006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 msgr2=0x7f714c197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 --2- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 0x7f714c197f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f713c006010 tx=0x7f713c004ff0 comp rx=0 tx=0).stop 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 shutdown_connections 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 --2- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71340388c0 0x7f713403ad80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 --2- 172.21.15.8:0/4271376603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f714c106970 0x7f714c197f60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 >> 172.21.15.8:0/4271376603 conn(0x7f714c0fc4a0 msgr2=0x7f714c108e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 shutdown_connections 2023-10-06T23:04:26.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:26.588+0000 7f7150ba4700 1 -- 172.21.15.8:0/4271376603 wait complete. 2023-10-06T23:04:26.592 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-10-06T23:04:26.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:26 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4271376603' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-06T23:04:27.032 INFO:tasks.cephadm:Adding mon.a on smithi008 2023-10-06T23:04:27.032 INFO:tasks.cephadm:Adding mon.b on smithi156 2023-10-06T23:04:27.032 INFO:tasks.cephadm:Adding mon.c on smithi190 2023-10-06T23:04:27.033 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c' 2023-10-06T23:04:27.771 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-10-06T23:04:27.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4271376603' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-06T23:04:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:04:27.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:27.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:28.119 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-10-06T23:04:29.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:28 smithi008 ceph-mon[98532]: Updating smithi190:/etc/ceph/ceph.conf 2023-10-06T23:04:29.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:28 smithi008 ceph-mon[98532]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:29.610 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.608+0000 7f43279fe700 1 -- 172.21.15.190:0/3807879387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 msgr2=0x7f4320105c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:29.610 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.608+0000 7f43279fe700 1 --2- 172.21.15.190:0/3807879387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 0x7f4320105c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f431c009910 tx=0x7f431c009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:29.611 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.608+0000 7f43279fe700 1 -- 172.21.15.190:0/3807879387 shutdown_connections 2023-10-06T23:04:29.611 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.608+0000 7f43279fe700 1 --2- 172.21.15.190:0/3807879387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 0x7f4320105c30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:29.611 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.608+0000 7f43279fe700 1 -- 172.21.15.190:0/3807879387 >> 172.21.15.190:0/3807879387 conn(0x7f43200fb360 msgr2=0x7f43200fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:29.611 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.608+0000 7f43279fe700 1 -- 172.21.15.190:0/3807879387 shutdown_connections 2023-10-06T23:04:29.611 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.608+0000 7f43279fe700 1 -- 172.21.15.190:0/3807879387 wait complete. 2023-10-06T23:04:29.612 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.609+0000 7f43279fe700 1 Processor -- start 2023-10-06T23:04:29.612 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.609+0000 7f43279fe700 1 -- start start 2023-10-06T23:04:29.612 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.610+0000 7f43279fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 0x7f43200fb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:29.612 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.610+0000 7f43279fe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200fd790 con 0x7f4320105850 2023-10-06T23:04:29.612 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.610+0000 7f432579a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 0x7f43200fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:29.612 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.610+0000 7f432579a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 0x7f43200fb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.190:50260/0 (socket says 172.21.15.190:50260) 2023-10-06T23:04:29.612 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.610+0000 7f432579a700 1 -- 172.21.15.190:0/1106998003 learned_addr learned my addr 172.21.15.190:0/1106998003 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:04:29.613 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.611+0000 7f432579a700 1 -- 172.21.15.190:0/1106998003 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c0095f0 con 0x7f4320105850 2023-10-06T23:04:29.613 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.611+0000 7f432579a700 1 --2- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 0x7f43200fb810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f431c004f40 tx=0x7f431c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:29.613 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.611+0000 7f43167fc700 1 -- 172.21.15.190:0/1106998003 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f431c01d070 con 0x7f4320105850 2023-10-06T23:04:29.613 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.611+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43200fbd50 con 0x7f4320105850 2023-10-06T23:04:29.614 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.611+0000 7f43167fc700 1 -- 172.21.15.190:0/1106998003 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f431c0044b0 con 0x7f4320105850 2023-10-06T23:04:29.614 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.611+0000 7f43167fc700 1 -- 172.21.15.190:0/1106998003 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f431c003860 con 0x7f4320105850 2023-10-06T23:04:29.614 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.611+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43200fc1d0 con 0x7f4320105850 2023-10-06T23:04:29.614 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.612+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43200624e0 con 0x7f4320105850 2023-10-06T23:04:29.614 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.613+0000 7f43167fc700 1 -- 172.21.15.190:0/1106998003 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f431c003ae0 con 0x7f4320105850 2023-10-06T23:04:29.615 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.613+0000 7f43167fc700 1 --2- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f430c0388c0 0x7f430c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:29.615 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.613+0000 7f43167fc700 1 -- 172.21.15.190:0/1106998003 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f431c04c750 con 0x7f4320105850 2023-10-06T23:04:29.615 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.613+0000 7f4324f99700 1 --2- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f430c0388c0 0x7f430c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:29.615 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.614+0000 7f4324f99700 1 --2- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f430c0388c0 0x7f430c03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4310006fd0 tx=0x7f4310006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:29.620 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.619+0000 7f43167fc700 1 -- 172.21.15.190:0/1106998003 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f431c02a540 con 0x7f4320105850 2023-10-06T23:04:29.830 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.828+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f4320109a00 con 0x7f430c0388c0 2023-10-06T23:04:29.836 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.835+0000 7f43167fc700 1 -- 172.21.15.190:0/1106998003 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4320109a00 con 0x7f430c0388c0 2023-10-06T23:04:29.836 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mon update... 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f430c0388c0 msgr2=0x7f430c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 --2- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f430c0388c0 0x7f430c03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4310006fd0 tx=0x7f4310006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 msgr2=0x7f43200fb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 --2- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 0x7f43200fb810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f431c004f40 tx=0x7f431c005020 comp rx=0 tx=0).stop 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 shutdown_connections 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 --2- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f430c0388c0 0x7f430c03ad80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 --2- 172.21.15.190:0/1106998003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4320105850 0x7f43200fb810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 >> 172.21.15.190:0/1106998003 conn(0x7f43200fb360 msgr2=0x7f4320068970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:29.839 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 shutdown_connections 2023-10-06T23:04:29.840 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:29.837+0000 7f43279fe700 1 -- 172.21.15.190:0/1106998003 wait complete. 2023-10-06T23:04:30.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:29 smithi008 ceph-mon[98532]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:30.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:29 smithi008 ceph-mon[98532]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-06T23:04:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:29 smithi008 ceph-mon[98532]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:30.300 DEBUG:teuthology.orchestra.run.smithi156:mon.b> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-06T23:04:30.305 DEBUG:teuthology.orchestra.run.smithi190:mon.c> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-06T23:04:30.311 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-06T23:04:30.312 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-06T23:04:30.384 INFO:journalctl@ceph.mon.b.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:04:30.384 INFO:journalctl@ceph.mon.c.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:04:31.149 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:31.149 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c;count:3 2023-10-06T23:04:31.149 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:31.149 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:31.149 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:31.150 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:31.150 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:31.150 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:31.150 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:31.150 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:30 smithi008 ceph-mon[98532]: Deploying daemon mon.c on smithi190 2023-10-06T23:04:31.519 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:32.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:31 smithi008 ceph-mon[98532]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:33.783 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:33 smithi190 systemd[1]: Starting Ceph mon.c for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:04:33.971 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.969+0000 7fe053d8b700 1 -- 172.21.15.190:0/1965502653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 msgr2=0x7fe04c0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:33.971 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.969+0000 7fe053d8b700 1 --2- 172.21.15.190:0/1965502653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 0x7fe04c0736c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe048009910 tx=0x7fe048009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:33.971 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.969+0000 7fe053d8b700 1 -- 172.21.15.190:0/1965502653 shutdown_connections 2023-10-06T23:04:33.971 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.969+0000 7fe053d8b700 1 --2- 172.21.15.190:0/1965502653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 0x7fe04c0736c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:33.971 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.969+0000 7fe053d8b700 1 -- 172.21.15.190:0/1965502653 >> 172.21.15.190:0/1965502653 conn(0x7fe04c0fc4a0 msgr2=0x7fe04c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:33.972 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.969+0000 7fe053d8b700 1 -- 172.21.15.190:0/1965502653 shutdown_connections 2023-10-06T23:04:33.972 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.969+0000 7fe053d8b700 1 -- 172.21.15.190:0/1965502653 wait complete. 2023-10-06T23:04:33.973 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.970+0000 7fe053d8b700 1 Processor -- start 2023-10-06T23:04:33.973 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.970+0000 7fe053d8b700 1 -- start start 2023-10-06T23:04:33.973 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.970+0000 7fe053d8b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 0x7fe04c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:33.973 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.970+0000 7fe053d8b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c198560 con 0x7fe04c0732e0 2023-10-06T23:04:33.973 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.971+0000 7fe051b27700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 0x7fe04c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:33.974 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.971+0000 7fe051b27700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 0x7fe04c198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.190:53816/0 (socket says 172.21.15.190:53816) 2023-10-06T23:04:33.974 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.971+0000 7fe051b27700 1 -- 172.21.15.190:0/179527596 learned_addr learned my addr 172.21.15.190:0/179527596 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:04:33.974 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.971+0000 7fe051b27700 1 -- 172.21.15.190:0/179527596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480095f0 con 0x7fe04c0732e0 2023-10-06T23:04:33.974 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.971+0000 7fe051b27700 1 --2- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 0x7fe04c198020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe048006010 tx=0x7fe048004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:33.975 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.972+0000 7fe042ffd700 1 -- 172.21.15.190:0/179527596 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe04801d070 con 0x7fe04c0732e0 2023-10-06T23:04:33.975 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.972+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c198760 con 0x7fe04c0732e0 2023-10-06T23:04:33.975 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.972+0000 7fe042ffd700 1 -- 172.21.15.190:0/179527596 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe04800bdf0 con 0x7fe04c0732e0 2023-10-06T23:04:33.975 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.972+0000 7fe042ffd700 1 -- 172.21.15.190:0/179527596 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe048022d80 con 0x7fe04c0732e0 2023-10-06T23:04:33.975 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.972+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c198b80 con 0x7fe04c0732e0 2023-10-06T23:04:33.975 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.973+0000 7fe042ffd700 1 -- 172.21.15.190:0/179527596 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fe04800b960 con 0x7fe04c0732e0 2023-10-06T23:04:33.976 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.973+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c0624e0 con 0x7fe04c0732e0 2023-10-06T23:04:33.976 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.974+0000 7fe042ffd700 1 --2- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe038038910 0x7fe03803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:33.976 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.974+0000 7fe042ffd700 1 -- 172.21.15.190:0/179527596 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe04804ca50 con 0x7fe04c0732e0 2023-10-06T23:04:33.976 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.974+0000 7fe051326700 1 --2- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe038038910 0x7fe03803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:33.976 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.975+0000 7fe051326700 1 --2- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe038038910 0x7fe03803add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe03c006fd0 tx=0x7fe03c006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:33.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:33.980+0000 7fe042ffd700 1 -- 172.21.15.190:0/179527596 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe04802bba0 con 0x7fe04c0732e0 2023-10-06T23:04:34.279 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.276+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe04c10cd90 con 0x7fe04c0732e0 2023-10-06T23:04:34.279 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.277+0000 7fe042ffd700 1 -- 172.21.15.190:0/179527596 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7fe048027020 con 0x7fe04c0732e0 2023-10-06T23:04:34.279 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T23:04:34.279 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","modified":"2023-10-06T23:02:46.984901Z","created":"2023-10-06T23:02:46.984901Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-06T23:04:34.281 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe038038910 msgr2=0x7fe03803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 --2- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe038038910 0x7fe03803add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe03c006fd0 tx=0x7fe03c006e40 comp rx=0 tx=0).stop 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 msgr2=0x7fe04c198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 --2- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 0x7fe04c198020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe048006010 tx=0x7fe048004f40 comp rx=0 tx=0).stop 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 shutdown_connections 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 --2- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe038038910 0x7fe03803add0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 --2- 172.21.15.190:0/179527596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe04c0732e0 0x7fe04c198020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 >> 172.21.15.190:0/179527596 conn(0x7fe04c0fc4a0 msgr2=0x7fe04c107550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 shutdown_connections 2023-10-06T23:04:34.282 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:34.280+0000 7fe053d8b700 1 -- 172.21.15.190:0/179527596 wait complete. 2023-10-06T23:04:34.283 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-10-06T23:04:34.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:33 smithi008 ceph-mon[98532]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:34.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 podman[102597]: 2023-10-06T23:04:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: set uid:gid to 167:167 (ceph:ceph) 2023-10-06T23:04:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev), process ceph-mon, pid 7 2023-10-06T23:04:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pidfile_write: ignore empty --pid-file 2023-10-06T23:04:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: load: jerasure load: lrc 2023-10-06T23:04:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: RocksDB version: 7.9.2 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Git sha 0 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Compile date 2023-10-06 09:28:03 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: DB SUMMARY 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: DB Session ID: 67FLI8HFW4GC7NQ9IVXQ 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: CURRENT file: CURRENT 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: IDENTITY file: IDENTITY 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.error_if_exists: 0 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.create_if_missing: 0 2023-10-06T23:04:35.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.paranoid_checks: 1 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.env: 0x55dad285ada0 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.fs: PosixFileSystem 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.info_log: 0x55dad30cf5c0 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_file_opening_threads: 16 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.statistics: (nil) 2023-10-06T23:04:35.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.use_fsync: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_log_file_size: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.keep_log_file_num: 1000 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.recycle_log_file_num: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.allow_fallocate: 1 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.allow_mmap_reads: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.allow_mmap_writes: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.use_direct_reads: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.create_missing_column_families: 0 2023-10-06T23:04:35.196 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.db_log_dir: 2023-10-06T23:04:35.197 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.wal_dir: 2023-10-06T23:04:35.197 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-06T23:04:35.199 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-06T23:04:35.199 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-06T23:04:35.199 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-06T23:04:35.199 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-06T23:04:35.200 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-06T23:04:35.200 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.advise_random_on_open: 1 2023-10-06T23:04:35.200 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.db_write_buffer_size: 0 2023-10-06T23:04:35.200 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.write_buffer_manager: 0x55dad3087360 2023-10-06T23:04:35.200 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-06T23:04:35.200 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-06T23:04:35.201 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-06T23:04:35.201 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.rate_limiter: (nil) 2023-10-06T23:04:35.201 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-06T23:04:35.201 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.wal_recovery_mode: 2 2023-10-06T23:04:35.201 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.enable_thread_tracking: 0 2023-10-06T23:04:35.201 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.enable_pipelined_write: 0 2023-10-06T23:04:35.202 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.unordered_write: 0 2023-10-06T23:04:35.202 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-06T23:04:35.202 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-06T23:04:35.202 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-06T23:04:35.202 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-06T23:04:35.202 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.row_cache: None 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.wal_filter: None 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.allow_ingest_behind: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.two_write_queues: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.manual_wal_flush: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.wal_compression: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.atomic_flush: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-06T23:04:35.203 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.log_readahead_size: 0 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.best_efforts_recovery: 0 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.allow_data_in_errors: 0 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.db_host_id: __hostname__ 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_background_jobs: 2 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_background_compactions: -1 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_subcompactions: 1 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-06T23:04:35.204 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_total_wal_size: 0 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_open_files: -1 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bytes_per_sync: 0 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_readahead_size: 0 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_background_flushes: -1 2023-10-06T23:04:35.205 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Compression algorithms supported: 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: kZSTD supported: 0 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: kXpressCompression supported: 0 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: kLZ4HCCompression supported: 1 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: kZlibCompression supported: 1 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: kSnappyCompression supported: 1 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: kLZ4Compression supported: 1 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: kBZip2Compression supported: 0 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-06T23:04:35.206 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.merge_operator: 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_filter: None 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_filter_factory: None 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.sst_partitioner_factory: None 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dad30cf6c0) 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout: cache_index_and_filter_blocks: 1 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-06T23:04:35.207 INFO:journalctl@ceph.mon.c.smithi190.stdout: pin_top_level_index_and_filter: 1 2023-10-06T23:04:35.208 INFO:journalctl@ceph.mon.c.smithi190.stdout: index_type: 0 2023-10-06T23:04:35.208 INFO:journalctl@ceph.mon.c.smithi190.stdout: data_block_index_type: 0 2023-10-06T23:04:35.208 INFO:journalctl@ceph.mon.c.smithi190.stdout: index_shortening: 1 2023-10-06T23:04:35.208 INFO:journalctl@ceph.mon.c.smithi190.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-06T23:04:35.208 INFO:journalctl@ceph.mon.c.smithi190.stdout: checksum: 4 2023-10-06T23:04:35.208 INFO:journalctl@ceph.mon.c.smithi190.stdout: no_block_cache: 0 2023-10-06T23:04:35.208 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_cache: 0x55dad31251f0 2023-10-06T23:04:35.209 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_cache_name: BinnedLRUCache 2023-10-06T23:04:35.209 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_cache_options: 2023-10-06T23:04:35.209 INFO:journalctl@ceph.mon.c.smithi190.stdout: capacity : 536870912 2023-10-06T23:04:35.209 INFO:journalctl@ceph.mon.c.smithi190.stdout: num_shard_bits : 4 2023-10-06T23:04:35.209 INFO:journalctl@ceph.mon.c.smithi190.stdout: strict_capacity_limit : 0 2023-10-06T23:04:35.209 INFO:journalctl@ceph.mon.c.smithi190.stdout: high_pri_pool_ratio: 0.000 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_cache_compressed: (nil) 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: persistent_cache: (nil) 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_size: 4096 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_size_deviation: 10 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_restart_interval: 16 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: index_block_restart_interval: 1 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: metadata_block_size: 4096 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: partition_filters: 0 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: use_delta_encoding: 1 2023-10-06T23:04:35.210 INFO:journalctl@ceph.mon.c.smithi190.stdout: filter_policy: bloomfilter 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: whole_key_filtering: 1 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: verify_compression: 0 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: read_amp_bytes_per_bit: 0 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: format_version: 5 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: enable_index_compression: 1 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_align: 0 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: max_auto_readahead_size: 262144 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: prepopulate_block_cache: 0 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: initial_auto_readahead_size: 8192 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout: num_file_reads_for_auto_readahead: 2 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.write_buffer_size: 33554432 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_write_buffer_number: 2 2023-10-06T23:04:35.211 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression: NoCompression 2023-10-06T23:04:35.212 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression: Disabled 2023-10-06T23:04:35.212 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.prefix_extractor: nullptr 2023-10-06T23:04:35.212 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-06T23:04:35.212 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.num_levels: 7 2023-10-06T23:04:35.212 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-06T23:04:35.212 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-06T23:04:35.212 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-06T23:04:35.212 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-06T23:04:35.213 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-06T23:04:35.213 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-06T23:04:35.213 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-06T23:04:35.213 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-06T23:04:35.213 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-06T23:04:35.213 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-06T23:04:35.213 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-06T23:04:35.214 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-06T23:04:35.214 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-06T23:04:35.214 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.level: 32767 2023-10-06T23:04:35.214 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.strategy: 0 2023-10-06T23:04:35.214 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-06T23:04:35.214 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-06T23:04:35.215 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-06T23:04:35.215 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-06T23:04:35.215 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.enabled: false 2023-10-06T23:04:35.215 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-06T23:04:35.215 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-06T23:04:35.215 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-06T23:04:35.215 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-06T23:04:35.215 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.target_file_size_base: 67108864 2023-10-06T23:04:35.216 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-06T23:04:35.216 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-06T23:04:35.216 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-06T23:04:35.216 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-06T23:04:35.216 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-06T23:04:35.216 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-06T23:04:35.216 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-06T23:04:35.217 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-06T23:04:35.217 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-06T23:04:35.217 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-06T23:04:35.217 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-06T23:04:35.217 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-06T23:04:35.217 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-06T23:04:35.217 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-06T23:04:35.218 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.arena_block_size: 1048576 2023-10-06T23:04:35.218 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-06T23:04:35.218 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-06T23:04:35.218 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.disable_auto_compactions: 0 2023-10-06T23:04:35.218 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-06T23:04:35.218 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-06T23:04:35.218 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-06T23:04:35.219 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-06T23:04:35.219 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-06T23:04:35.219 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-06T23:04:35.219 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-06T23:04:35.219 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-06T23:04:35.219 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-06T23:04:35.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-06T23:04:35.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.table_properties_collectors: 2023-10-06T23:04:35.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.inplace_update_support: 0 2023-10-06T23:04:35.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-06T23:04:35.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-06T23:04:35.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-06T23:04:35.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-06T23:04:35.221 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.bloom_locality: 0 2023-10-06T23:04:35.221 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.max_successive_merges: 0 2023-10-06T23:04:35.221 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-06T23:04:35.221 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.paranoid_file_checks: 0 2023-10-06T23:04:35.221 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.force_consistency_checks: 1 2023-10-06T23:04:35.221 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.report_bg_io_stats: 0 2023-10-06T23:04:35.221 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.ttl: 2592000 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.enable_blob_files: false 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.min_blob_size: 0 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.blob_file_size: 268435456 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-06T23:04:35.222 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.blob_file_starting_level: 0 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 31b8603c-8c3e-4366-891a-552c2141f3bb 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633474738899, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633474739846, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696633474, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "31b8603c-8c3e-4366-891a-552c2141f3bb", "db_session_id": "67FLI8HFW4GC7NQ9IVXQ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633474740046, "job": 1, "event": "recovery_finished"} 2023-10-06T23:04:35.223 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dad31c2000 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: DB pointer 0x55dad31ae000 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout: ** DB Stats ** 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-06T23:04:35.224 INFO:journalctl@ceph.mon.c.smithi190.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: ** Compaction Stats [default] ** 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: ** Compaction Stats [default] ** 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-06T23:04:35.225 INFO:journalctl@ceph.mon.c.smithi190.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: Cumulative compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: Interval compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-06T23:04:35.226 INFO:journalctl@ceph.mon.c.smithi190.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout: Block cache BinnedLRUCache@0x55dad31251f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: using public_addr v2:172.21.15.190:0/0 -> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: starting mon.c rank -1 at public addrs [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] at bind addrs [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(???) e0 preinit fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 bash[102597]: 3d3bd764b2f0f7f5fdf0ed82646846f696bf02c60894e000274d2f4eb8604e94 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).mds e1 new map 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-06T23:04:35.227 INFO:journalctl@ceph.mon.c.smithi190.stdout: e1 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout: legacy client fscid: -1 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout: No filesystems configured 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-06T23:04:35.228 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:04:35.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Updating smithi156:/etc/ceph/ceph.conf 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Deploying cephadm binary to smithi190 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.230 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Added host smithi190 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4271376603' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-06T23:04:35.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4271376603' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Updating smithi190:/etc/ceph/ceph.conf 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:35.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c;count:3 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:35.233 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: Deploying daemon mon.c on smithi190 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta expand map: {default=false} 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta from 'false' to 'false' 2023-10-06T23:04:35.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta expanded map: {default=false} 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta expand map: {default=info} 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta from 'info' to 'info' 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta expanded map: {default=info} 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta expand map: {default=daemon} 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta expanded map: {default=daemon} 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta expand map: {default=debug} 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta from 'debug' to 'debug' 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 ceph-mon[102658]: expand_channel_meta expanded map: {default=debug} 2023-10-06T23:04:35.235 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:34 smithi190 systemd[1]: Started Ceph mon.c for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:04:35.861 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-06T23:04:35.861 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-06T23:04:36.592 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:04:40.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:04:40.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: mon.a calling monitor election 2023-10-06T23:04:40.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:40.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: mon.c calling monitor election 2023-10-06T23:04:40.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: fsmap 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: mgrmap e13: x(active, since 50s) 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: overall HEALTH_OK 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:40.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:40.148 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:40.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:04:40.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: mon.a calling monitor election 2023-10-06T23:04:40.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:40.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: mon.c calling monitor election 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: fsmap 2023-10-06T23:04:40.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:40.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: mgrmap e13: x(active, since 50s) 2023-10-06T23:04:40.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: overall HEALTH_OK 2023-10-06T23:04:40.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:40.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:40.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:41.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:41.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:41.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:40 smithi008 ceph-mon[98532]: Deploying daemon mon.b on smithi156 2023-10-06T23:04:41.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:41.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.158+0000 7f2b86515700 1 -- 172.21.15.190:0/3876587467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 msgr2=0x7f2b68005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:41.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.158+0000 7f2b86515700 1 --2- 172.21.15.190:0/3876587467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 0x7f2b68005a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b801009a0 tx=0x7f2b7000feb0 comp rx=0 tx=0).stop 2023-10-06T23:04:41.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.158+0000 7f2b86515700 1 -- 172.21.15.190:0/3876587467 shutdown_connections 2023-10-06T23:04:41.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.158+0000 7f2b86515700 1 --2- 172.21.15.190:0/3876587467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 0x7f2b68005a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:41.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.158+0000 7f2b86515700 1 -- 172.21.15.190:0/3876587467 >> 172.21.15.190:0/3876587467 conn(0x7f2b800fc540 msgr2=0x7f2b800fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:41.161 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.158+0000 7f2b86515700 1 -- 172.21.15.190:0/3876587467 shutdown_connections 2023-10-06T23:04:41.161 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.158+0000 7f2b86515700 1 -- 172.21.15.190:0/3876587467 wait complete. 2023-10-06T23:04:41.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.160+0000 7f2b86515700 1 Processor -- start 2023-10-06T23:04:41.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.160+0000 7f2b86515700 1 -- start start 2023-10-06T23:04:41.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.161+0000 7f2b86515700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 0x7f2b80198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:41.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.161+0000 7f2b86515700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 0x7f2b8019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:41.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.161+0000 7f2b86515700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80198c40 con 0x7f2b680035c0 2023-10-06T23:04:41.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.161+0000 7f2b86515700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80198db0 con 0x7f2b801986b0 2023-10-06T23:04:41.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.161+0000 7f2b7ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 0x7f2b80198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.161+0000 7f2b7ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 0x7f2b80198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.190:53906/0 (socket says 172.21.15.190:53906) 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.161+0000 7f2b7ffff700 1 -- 172.21.15.190:0/3764424533 learned_addr learned my addr 172.21.15.190:0/3764424533 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.161+0000 7f2b7f7fe700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 0x7f2b8019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7f7fe700 1 -- 172.21.15.190:0/3764424533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 msgr2=0x7f2b8019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7f7fe700 1 -- 172.21.15.190:0/3764424533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 msgr2=0x7f2b8019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7f7fe700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 0x7f2b8019cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7f7fe700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 0x7f2b8019cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7ffff700 1 -- 172.21.15.190:0/3764424533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 msgr2=0x7f2b8019cb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7ffff700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 0x7f2b8019cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:41.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7ffff700 1 -- 172.21.15.190:0/3764424533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7000f900 con 0x7f2b680035c0 2023-10-06T23:04:41.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7ffff700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 0x7f2b80198170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b70010010 tx=0x7f2b700049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:41.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.162+0000 7f2b7d7fa700 1 -- 172.21.15.190:0/3764424533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2b70013b70 con 0x7f2b680035c0 2023-10-06T23:04:41.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.163+0000 7f2b7d7fa700 1 -- 172.21.15.190:0/3764424533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b700044c0 con 0x7f2b680035c0 2023-10-06T23:04:41.166 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.163+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8019d0c0 con 0x7f2b680035c0 2023-10-06T23:04:41.166 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.163+0000 7f2b7d7fa700 1 -- 172.21.15.190:0/3764424533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2b70003db0 con 0x7f2b680035c0 2023-10-06T23:04:41.166 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.163+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8019d610 con 0x7f2b680035c0 2023-10-06T23:04:41.166 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.164+0000 7f2b7d7fa700 1 -- 172.21.15.190:0/3764424533 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f2b70004030 con 0x7f2b680035c0 2023-10-06T23:04:41.166 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.164+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b800624e0 con 0x7f2b680035c0 2023-10-06T23:04:41.167 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.164+0000 7f2b7d7fa700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2b6c038890 0x7f2b6c03ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:41.167 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.165+0000 7f2b7d7fa700 1 -- 172.21.15.190:0/3764424533 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2b7004dfd0 con 0x7f2b680035c0 2023-10-06T23:04:41.167 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.165+0000 7f2b7f7fe700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2b6c038890 0x7f2b6c03ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:41.167 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.166+0000 7f2b7f7fe700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2b6c038890 0x7f2b6c03ad50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009850 tx=0x7f2b74008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:41.172 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.170+0000 7f2b7d7fa700 1 -- 172.21.15.190:0/3764424533 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2b700349a0 con 0x7f2b680035c0 2023-10-06T23:04:41.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:41.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:40 smithi190 ceph-mon[102658]: Deploying daemon mon.b on smithi156 2023-10-06T23:04:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:41.451 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.449+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2b8019d8e0 con 0x7f2b680035c0 2023-10-06T23:04:41.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.450+0000 7f2b7d7fa700 1 -- 172.21.15.190:0/3764424533 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7f2b70013e60 con 0x7f2b680035c0 2023-10-06T23:04:41.452 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T23:04:41.452 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":2,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","modified":"2023-10-06T23:04:34.781818Z","created":"2023-10-06T23:02:46.984901Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2b6c038890 msgr2=0x7f2b6c03ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2b6c038890 0x7f2b6c03ad50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009850 tx=0x7f2b74008040 comp rx=0 tx=0).stop 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 msgr2=0x7f2b80198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 0x7f2b80198170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b70010010 tx=0x7f2b700049d0 comp rx=0 tx=0).stop 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 shutdown_connections 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2b6c038890 0x7f2b6c03ad50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b680035c0 0x7f2b80198170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 --2- 172.21.15.190:0/3764424533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b801986b0 0x7f2b8019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 >> 172.21.15.190:0/3764424533 conn(0x7f2b800fc540 msgr2=0x7f2b800730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:41.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 shutdown_connections 2023-10-06T23:04:41.456 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:41.453+0000 7f2b86515700 1 -- 172.21.15.190:0/3764424533 wait complete. 2023-10-06T23:04:41.456 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 2 2023-10-06T23:04:42.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:41 smithi008 ceph-mon[98532]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:42.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:41 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/3764424533' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-06T23:04:42.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:41 smithi190 ceph-mon[102658]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:42.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:41 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/3764424533' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-06T23:04:42.873 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-06T23:04:42.873 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-06T23:04:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:43 smithi156 systemd[1]: Starting Ceph mon.b for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:04:43.604 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:04:44.148 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:43 smithi190 ceph-mon[102658]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:43 smithi156 podman[102822]: 2023-10-06T23:04:44.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 bash[102822]: 3a841467e4e71c06a530f9b908881d50372d9aba56acf1afc3e3f1578c7e3e11 2023-10-06T23:04:44.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: set uid:gid to 167:167 (ceph:ceph) 2023-10-06T23:04:44.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev), process ceph-mon, pid 7 2023-10-06T23:04:44.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pidfile_write: ignore empty --pid-file 2023-10-06T23:04:44.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: load: jerasure load: lrc 2023-10-06T23:04:44.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: RocksDB version: 7.9.2 2023-10-06T23:04:44.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Git sha 0 2023-10-06T23:04:44.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:43 smithi008 ceph-mon[98532]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Compile date 2023-10-06 09:28:03 2023-10-06T23:04:44.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: DB SUMMARY 2023-10-06T23:04:44.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: DB Session ID: 8OWMHSN6MAY6X6RSWJQL 2023-10-06T23:04:44.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: CURRENT file: CURRENT 2023-10-06T23:04:44.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: IDENTITY file: IDENTITY 2023-10-06T23:04:44.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-06T23:04:44.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-06T23:04:44.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-06T23:04:44.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.error_if_exists: 0 2023-10-06T23:04:44.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.create_if_missing: 0 2023-10-06T23:04:44.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.paranoid_checks: 1 2023-10-06T23:04:44.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-06T23:04:44.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-06T23:04:44.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-06T23:04:44.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.env: 0x55c701b52da0 2023-10-06T23:04:44.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.fs: PosixFileSystem 2023-10-06T23:04:44.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.info_log: 0x55c70427d5c0 2023-10-06T23:04:44.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_file_opening_threads: 16 2023-10-06T23:04:44.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.statistics: (nil) 2023-10-06T23:04:44.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.use_fsync: 0 2023-10-06T23:04:44.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_log_file_size: 0 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.keep_log_file_num: 1000 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.recycle_log_file_num: 0 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.allow_fallocate: 1 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.allow_mmap_reads: 0 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.allow_mmap_writes: 0 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.use_direct_reads: 0 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-06T23:04:44.604 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.create_missing_column_families: 0 2023-10-06T23:04:44.605 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.db_log_dir: 2023-10-06T23:04:44.605 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.wal_dir: 2023-10-06T23:04:44.605 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-06T23:04:44.605 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-06T23:04:44.605 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-06T23:04:44.605 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-06T23:04:44.605 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-06T23:04:44.607 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-06T23:04:44.607 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.advise_random_on_open: 1 2023-10-06T23:04:44.607 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.db_write_buffer_size: 0 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.write_buffer_manager: 0x55c704235360 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.rate_limiter: (nil) 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.wal_recovery_mode: 2 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.enable_thread_tracking: 0 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.enable_pipelined_write: 0 2023-10-06T23:04:44.608 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.unordered_write: 0 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.row_cache: None 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.wal_filter: None 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.allow_ingest_behind: 0 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.two_write_queues: 0 2023-10-06T23:04:44.609 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.manual_wal_flush: 0 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.wal_compression: 0 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.atomic_flush: 0 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.log_readahead_size: 0 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.best_efforts_recovery: 0 2023-10-06T23:04:44.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.allow_data_in_errors: 0 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.db_host_id: __hostname__ 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_background_jobs: 2 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_background_compactions: -1 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_subcompactions: 1 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-06T23:04:44.611 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_total_wal_size: 0 2023-10-06T23:04:44.612 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-06T23:04:44.612 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-06T23:04:44.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-06T23:04:44.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-06T23:04:44.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_open_files: -1 2023-10-06T23:04:44.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bytes_per_sync: 0 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_readahead_size: 0 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_background_flushes: -1 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Compression algorithms supported: 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: kZSTD supported: 0 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: kXpressCompression supported: 0 2023-10-06T23:04:44.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: kLZ4HCCompression supported: 1 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: kZlibCompression supported: 1 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: kSnappyCompression supported: 1 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: kLZ4Compression supported: 1 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: kBZip2Compression supported: 0 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-06T23:04:44.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.merge_operator: 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_filter: None 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_filter_factory: None 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.sst_partitioner_factory: None 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c70427d6c0) 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout: cache_index_and_filter_blocks: 1 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-06T23:04:44.616 INFO:journalctl@ceph.mon.b.smithi156.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: pin_top_level_index_and_filter: 1 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: index_type: 0 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: data_block_index_type: 0 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: index_shortening: 1 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: checksum: 4 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: no_block_cache: 0 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_cache: 0x55c7042d31f0 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_cache_name: BinnedLRUCache 2023-10-06T23:04:44.617 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_cache_options: 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: capacity : 536870912 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: num_shard_bits : 4 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: strict_capacity_limit : 0 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: high_pri_pool_ratio: 0.000 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_cache_compressed: (nil) 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: persistent_cache: (nil) 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_size: 4096 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_size_deviation: 10 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_restart_interval: 16 2023-10-06T23:04:44.618 INFO:journalctl@ceph.mon.b.smithi156.stdout: index_block_restart_interval: 1 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: metadata_block_size: 4096 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: partition_filters: 0 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: use_delta_encoding: 1 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: filter_policy: bloomfilter 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: whole_key_filtering: 1 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: verify_compression: 0 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: read_amp_bytes_per_bit: 0 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: format_version: 5 2023-10-06T23:04:44.619 INFO:journalctl@ceph.mon.b.smithi156.stdout: enable_index_compression: 1 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_align: 0 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout: max_auto_readahead_size: 262144 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout: prepopulate_block_cache: 0 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout: initial_auto_readahead_size: 8192 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout: num_file_reads_for_auto_readahead: 2 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.write_buffer_size: 33554432 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_write_buffer_number: 2 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression: NoCompression 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression: Disabled 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.prefix_extractor: nullptr 2023-10-06T23:04:44.620 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.num_levels: 7 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-06T23:04:44.621 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.level: 32767 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.strategy: 0 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-06T23:04:44.622 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.enabled: false 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.target_file_size_base: 67108864 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-06T23:04:44.623 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-06T23:04:44.624 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.arena_block_size: 1048576 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.disable_auto_compactions: 0 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-06T23:04:44.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.table_properties_collectors: 2023-10-06T23:04:44.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.inplace_update_support: 0 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.bloom_locality: 0 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.max_successive_merges: 0 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.paranoid_file_checks: 0 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.force_consistency_checks: 1 2023-10-06T23:04:44.627 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.report_bg_io_stats: 0 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.ttl: 2592000 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.enable_blob_files: false 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.min_blob_size: 0 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.blob_file_size: 268435456 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-06T23:04:44.628 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.blob_file_starting_level: 0 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0e3d400a-4643-40fc-9b13-484d7ea284db 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633484217485, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-06T23:04:44.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633484218938, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696633484, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0e3d400a-4643-40fc-9b13-484d7ea284db", "db_session_id": "8OWMHSN6MAY6X6RSWJQL", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696633484219219, "job": 1, "event": "recovery_finished"} 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c704370000 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: DB pointer 0x55c70435c000 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout: ** DB Stats ** 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-06T23:04:44.630 INFO:journalctl@ceph.mon.b.smithi156.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: ** Compaction Stats [default] ** 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-06T23:04:44.631 INFO:journalctl@ceph.mon.b.smithi156.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: ** Compaction Stats [default] ** 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-10-06T23:04:44.632 INFO:journalctl@ceph.mon.b.smithi156.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: Interval compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-06T23:04:44.633 INFO:journalctl@ceph.mon.b.smithi156.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout: Block cache BinnedLRUCache@0x55c7042d31f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: using public_addr v2:172.21.15.156:0/0 -> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: starting mon.b rank -1 at public addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] at bind addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(???) e0 preinit fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:04:44.634 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).mds e1 new map 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout: e1 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout: legacy client fscid: -1 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout: No filesystems configured 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-06T23:04:44.635 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Updating smithi156:/etc/ceph/ceph.conf 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Deploying cephadm binary to smithi190 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:44.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Added host smithi190 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:44.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4271376603' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4271376603' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-06T23:04:44.639 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Updating smithi190:/etc/ceph/ceph.conf 2023-10-06T23:04:44.640 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c;count:3 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Deploying daemon mon.c on smithi190 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:04:44.643 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.a calling monitor election 2023-10-06T23:04:44.643 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:44.643 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.643 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:44.643 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:44.643 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.c calling monitor election 2023-10-06T23:04:44.643 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.643 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: fsmap 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mgrmap e13: x(active, since 50s) 2023-10-06T23:04:44.644 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: overall HEALTH_OK 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: Deploying daemon mon.b on smithi156 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/3764424533' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-06T23:04:44.645 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta expand map: {default=false} 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta from 'false' to 'false' 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta expanded map: {default=false} 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta expand map: {default=info} 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta from 'info' to 'info' 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta expanded map: {default=info} 2023-10-06T23:04:44.646 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta expand map: {default=daemon} 2023-10-06T23:04:44.647 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-06T23:04:44.647 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta expanded map: {default=daemon} 2023-10-06T23:04:44.647 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta expand map: {default=debug} 2023-10-06T23:04:44.647 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta from 'debug' to 'debug' 2023-10-06T23:04:44.647 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 ceph-mon[102862]: expand_channel_meta expanded map: {default=debug} 2023-10-06T23:04:44.647 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:44 smithi156 systemd[1]: Started Ceph mon.b for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:04:49.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.387+0000 7fce33240700 1 -- 172.21.15.190:0/292459268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 msgr2=0x7fce1c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:49.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.387+0000 7fce33240700 1 --2- 172.21.15.190:0/292459268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 0x7fce1c005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce2c1009a0 tx=0x7fce2000fe60 comp rx=0 tx=0).stop 2023-10-06T23:04:49.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.387+0000 7fce33240700 1 -- 172.21.15.190:0/292459268 shutdown_connections 2023-10-06T23:04:49.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.387+0000 7fce33240700 1 --2- 172.21.15.190:0/292459268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 0x7fce1c005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:49.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.387+0000 7fce33240700 1 -- 172.21.15.190:0/292459268 >> 172.21.15.190:0/292459268 conn(0x7fce2c0fc540 msgr2=0x7fce2c0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:49.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.387+0000 7fce33240700 1 -- 172.21.15.190:0/292459268 shutdown_connections 2023-10-06T23:04:49.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.387+0000 7fce33240700 1 -- 172.21.15.190:0/292459268 wait complete. 2023-10-06T23:04:49.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.389+0000 7fce33240700 1 Processor -- start 2023-10-06T23:04:49.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.389+0000 7fce33240700 1 -- start start 2023-10-06T23:04:49.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.389+0000 7fce33240700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 0x7fce2c196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:49.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.389+0000 7fce33240700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce2c196570 0x7fce2c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:49.392 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.389+0000 7fce33240700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce2c19af20 0x7fce2c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:49.392 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.389+0000 7fce33240700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c196c60 con 0x7fce1c0035c0 2023-10-06T23:04:49.392 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.389+0000 7fce33240700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1a2c90 con 0x7fce2c196570 2023-10-06T23:04:49.392 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.389+0000 7fce33240700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1a2dd0 con 0x7fce2c19af20 2023-10-06T23:04:49.392 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce30fdc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 0x7fce2c196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:49.392 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce30fdc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 0x7fce2c196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.190:57546/0 (socket says 172.21.15.190:57546) 2023-10-06T23:04:49.392 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce30fdc700 1 -- 172.21.15.190:0/3967667309 learned_addr learned my addr 172.21.15.190:0/3967667309 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce2bfff700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce2c196570 0x7fce2c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce30fdc700 1 -- 172.21.15.190:0/3967667309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce2c19af20 msgr2=0x7fce2c19b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce317dd700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce2c19af20 0x7fce2c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce30fdc700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce2c19af20 0x7fce2c19b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce30fdc700 1 -- 172.21.15.190:0/3967667309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce2c196570 msgr2=0x7fce2c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce30fdc700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce2c196570 0x7fce2c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce30fdc700 1 -- 172.21.15.190:0/3967667309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2000f8b0 con 0x7fce1c0035c0 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.390+0000 7fce317dd700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce2c19af20 0x7fce2c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.391+0000 7fce30fdc700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 0x7fce2c196030 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce20010010 tx=0x7fce20004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:49.394 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.391+0000 7fce29ffb700 1 -- 172.21.15.190:0/3967667309 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20014e00 con 0x7fce1c0035c0 2023-10-06T23:04:49.395 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.391+0000 7fce29ffb700 1 -- 172.21.15.190:0/3967667309 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce20012de0 con 0x7fce1c0035c0 2023-10-06T23:04:49.395 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.391+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c1a3050 con 0x7fce1c0035c0 2023-10-06T23:04:49.395 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.391+0000 7fce29ffb700 1 -- 172.21.15.190:0/3967667309 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2001d440 con 0x7fce1c0035c0 2023-10-06T23:04:49.395 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.391+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c1a35a0 con 0x7fce1c0035c0 2023-10-06T23:04:49.395 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.392+0000 7fce29ffb700 1 -- 172.21.15.190:0/3967667309 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fce20024050 con 0x7fce1c0035c0 2023-10-06T23:04:49.396 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.392+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2c1904c0 con 0x7fce1c0035c0 2023-10-06T23:04:49.396 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.393+0000 7fce29ffb700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce10038d40 0x7fce1003b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:49.396 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.393+0000 7fce29ffb700 1 -- 172.21.15.190:0/3967667309 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fce2004e360 con 0x7fce1c0035c0 2023-10-06T23:04:49.396 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.393+0000 7fce2bfff700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce10038d40 0x7fce1003b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:49.396 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.394+0000 7fce2bfff700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce10038d40 0x7fce1003b200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce18009850 tx=0x7fce18008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:49.400 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.398+0000 7fce29ffb700 1 -- 172.21.15.190:0/3967667309 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fce20038530 con 0x7fce1c0035c0 2023-10-06T23:04:49.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:04:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: mon.a calling monitor election 2023-10-06T23:04:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: mon.c calling monitor election 2023-10-06T23:04:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: fsmap 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: mgrmap e13: x(active, since 60s) 2023-10-06T23:04:49.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-06T23:04:49.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-06T23:04:49.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-06T23:04:49.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: mon.b (rank 2) addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] is down (out of quorum) 2023-10-06T23:04:49.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:49.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:49.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:49.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:04:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: mon.a calling monitor election 2023-10-06T23:04:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: mon.c calling monitor election 2023-10-06T23:04:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: fsmap 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: mgrmap e13: x(active, since 60s) 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-06T23:04:49.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-06T23:04:49.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-06T23:04:49.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: mon.b (rank 2) addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] is down (out of quorum) 2023-10-06T23:04:49.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:49.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:49.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:49.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:49.701 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.699+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fce2c0624e0 con 0x7fce1c0035c0 2023-10-06T23:04:49.701 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.700+0000 7fce29ffb700 1 -- 172.21.15.190:0/3967667309 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7fce20022090 con 0x7fce1c0035c0 2023-10-06T23:04:49.701 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-10-06T23:04:49.702 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":3,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","modified":"2023-10-06T23:04:44.261949Z","created":"2023-10-06T23:02:46.984901Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3300","nonce":0},{"type":"v1","addr":"172.21.15.156:6789","nonce":0}]},"addr":"172.21.15.156:6789/0","public_addr":"172.21.15.156:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-06T23:04:49.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce10038d40 msgr2=0x7fce1003b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:49.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce10038d40 0x7fce1003b200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce18009850 tx=0x7fce18008040 comp rx=0 tx=0).stop 2023-10-06T23:04:49.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 msgr2=0x7fce2c196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:49.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 0x7fce2c196030 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce20010010 tx=0x7fce20004360 comp rx=0 tx=0).stop 2023-10-06T23:04:49.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 shutdown_connections 2023-10-06T23:04:49.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce10038d40 0x7fce1003b200 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:49.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce1c0035c0 0x7fce2c196030 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:49.705 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce2c19af20 0x7fce2c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:49.705 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 --2- 172.21.15.190:0/3967667309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce2c196570 0x7fce2c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:49.705 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 >> 172.21.15.190:0/3967667309 conn(0x7fce2c0fc540 msgr2=0x7fce2c102710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:49.705 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 shutdown_connections 2023-10-06T23:04:49.705 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:49.702+0000 7fce33240700 1 -- 172.21.15.190:0/3967667309 wait complete. 2023-10-06T23:04:49.705 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 3 2023-10-06T23:04:50.201 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-06T23:04:50.201 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-06T23:04:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:50 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/3967667309' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-06T23:04:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:50.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:50.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:50 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/3967667309' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-06T23:04:50.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:04:51.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: mon.b calling monitor election 2023-10-06T23:04:51.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: mon.b calling monitor election 2023-10-06T23:04:51.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: mon.a calling monitor election 2023-10-06T23:04:51.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: mon.c calling monitor election 2023-10-06T23:04:51.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-06T23:04:51.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:51.486 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: fsmap 2023-10-06T23:04:51.487 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:51.487 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: mgrmap e13: x(active, since 62s) 2023-10-06T23:04:51.487 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-06T23:04:51.487 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: Cluster is now healthy 2023-10-06T23:04:51.487 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:51 smithi008 ceph-mon[98532]: overall HEALTH_OK 2023-10-06T23:04:51.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:04:51.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.a calling monitor election 2023-10-06T23:04:51.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.c calling monitor election 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-06T23:04:51.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: fsmap 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mgrmap e13: x(active, since 60s) 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.b (rank 2) addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] is down (out of quorum) 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:51.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/3967667309' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.b calling monitor election 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.b calling monitor election 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.a calling monitor election 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.c calling monitor election 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: fsmap 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:51.602 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: mgrmap e13: x(active, since 62s) 2023-10-06T23:04:51.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-06T23:04:51.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: Cluster is now healthy 2023-10-06T23:04:51.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:51 smithi156 ceph-mon[102862]: overall HEALTH_OK 2023-10-06T23:04:51.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: mon.b calling monitor election 2023-10-06T23:04:51.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: mon.b calling monitor election 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: mon.a calling monitor election 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: mon.c calling monitor election 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: fsmap 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: osdmap e4: 0 total, 0 up, 0 in 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: mgrmap e13: x(active, since 62s) 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: Cluster is now healthy 2023-10-06T23:04:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:51 smithi190 ceph-mon[102658]: overall HEALTH_OK 2023-10-06T23:04:52.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: Updating smithi156:/etc/ceph/ceph.conf 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: Updating smithi190:/etc/ceph/ceph.conf 2023-10-06T23:04:52.527 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:52.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.397+0000 7f50dfb69700 1 -- 172.21.15.8:0/220739660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80ff6a0 msgr2=0x7f50d80ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.397+0000 7f50dfb69700 1 --2- 172.21.15.8:0/220739660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80ff6a0 0x7f50d80ffa80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009910 tx=0x7f50d4009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.397+0000 7f50dfb69700 1 -- 172.21.15.8:0/220739660 shutdown_connections 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.397+0000 7f50dfb69700 1 --2- 172.21.15.8:0/220739660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d80ff6a0 0x7f50d80ffa80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.397+0000 7f50dfb69700 1 -- 172.21.15.8:0/220739660 >> 172.21.15.8:0/220739660 conn(0x7f50d80fb360 msgr2=0x7f50d80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.397+0000 7f50dfb69700 1 -- 172.21.15.8:0/220739660 shutdown_connections 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.397+0000 7f50dfb69700 1 -- 172.21.15.8:0/220739660 wait complete. 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.399+0000 7f50dfb69700 1 Processor -- start 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.399+0000 7f50dfb69700 1 -- start start 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.399+0000 7f50dfb69700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d80ff6a0 0x7f50d81981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.399+0000 7f50dfb69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d8198720 0x7f50d819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.399+0000 7f50dfb69700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d819d080 0x7f50d819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.399+0000 7f50dfb69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8198e10 con 0x7f50d8198720 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.399+0000 7f50dfb69700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d81a4df0 con 0x7f50d80ff6a0 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.399+0000 7f50dfb69700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d81a4f30 con 0x7f50d819d080 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd104700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d8198720 0x7f50d819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd104700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d8198720 0x7f50d819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36768/0 (socket says 172.21.15.8:36768) 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd104700 1 -- 172.21.15.8:0/830561189 learned_addr learned my addr 172.21.15.8:0/830561189 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd905700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d80ff6a0 0x7f50d81981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd104700 1 -- 172.21.15.8:0/830561189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d819d080 msgr2=0x7f50d819d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50de106700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d819d080 0x7f50d819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd104700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d819d080 0x7f50d819d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd104700 1 -- 172.21.15.8:0/830561189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d80ff6a0 msgr2=0x7f50d81981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd104700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d80ff6a0 0x7f50d81981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd104700 1 -- 172.21.15.8:0/830561189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40095f0 con 0x7f50d8198720 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50de106700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d819d080 0x7f50d819d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.400+0000 7f50dd905700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d80ff6a0 0x7f50d81981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.401+0000 7f50dd104700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d8198720 0x7f50d819cb40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f50c800b780 tx=0x7f50c800ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.401+0000 7f50ceffd700 1 -- 172.21.15.8:0/830561189 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8004230 con 0x7f50d8198720 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.401+0000 7f50ceffd700 1 -- 172.21.15.8:0/830561189 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50c8004390 con 0x7f50d8198720 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.401+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d81a5210 con 0x7f50d8198720 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.401+0000 7f50ceffd700 1 -- 172.21.15.8:0/830561189 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011a50 con 0x7f50d8198720 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.401+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d81a5710 con 0x7f50d8198720 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.402+0000 7f50ceffd700 1 -- 172.21.15.8:0/830561189 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f50c8011bb0 con 0x7f50d8198720 2023-10-06T23:04:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.402+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d80624e0 con 0x7f50d8198720 2023-10-06T23:04:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.403+0000 7f50ceffd700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f50c4038d40 0x7f50c403b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.403+0000 7f50ceffd700 1 -- 172.21.15.8:0/830561189 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f50c804af20 con 0x7f50d8198720 2023-10-06T23:04:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.403+0000 7f50dd905700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f50c4038d40 0x7f50c403b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.404+0000 7f50dd905700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f50c4038d40 0x7f50c403b200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f50d4006010 tx=0x7f50d400b540 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.409+0000 7f50ceffd700 1 -- 172.21.15.8:0/830561189 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f50c801a400 con 0x7f50d8198720 2023-10-06T23:04:52.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.629+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f50d810cf50 con 0x7f50d8198720 2023-10-06T23:04:52.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.630+0000 7f50ceffd700 1 -- 172.21.15.8:0/830561189 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f50c8018350 con 0x7f50d8198720 2023-10-06T23:04:52.631 INFO:teuthology.orchestra.run.smithi008.stdout:# minimal ceph.conf for 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:04:52.632 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-06T23:04:52.632 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:04:52.632 INFO:teuthology.orchestra.run.smithi008.stdout: mon_host = [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2023-10-06T23:04:52.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f50c4038d40 msgr2=0x7f50c403b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:52.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f50c4038d40 0x7f50c403b200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f50d4006010 tx=0x7f50d400b540 comp rx=0 tx=0).stop 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d8198720 msgr2=0x7f50d819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d8198720 0x7f50d819cb40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f50c800b780 tx=0x7f50c800ba90 comp rx=0 tx=0).stop 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 shutdown_connections 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f50c4038d40 0x7f50c403b200 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50d819d080 0x7f50d819d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d80ff6a0 0x7f50d81981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 --2- 172.21.15.8:0/830561189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50d8198720 0x7f50d819cb40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 >> 172.21.15.8:0/830561189 conn(0x7f50d80fb360 msgr2=0x7f50d8107cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 shutdown_connections 2023-10-06T23:04:52.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:04:52.633+0000 7f50dfb69700 1 -- 172.21.15.8:0/830561189 wait complete. 2023-10-06T23:04:52.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: Updating smithi156:/etc/ceph/ceph.conf 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: Updating smithi190:/etc/ceph/ceph.conf 2023-10-06T23:04:52.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: Updating smithi156:/etc/ceph/ceph.conf 2023-10-06T23:04:52.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: Updating smithi190:/etc/ceph/ceph.conf 2023-10-06T23:04:52.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:04:53.049 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-06T23:04:53.049 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:04:53.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.conf 2023-10-06T23:04:53.123 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:04:53.123 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:53.240 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:04:53.240 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.conf 2023-10-06T23:04:53.313 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:04:53.313 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:53.421 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:04:53.421 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.conf 2023-10-06T23:04:53.495 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:04:53.495 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-06T23:04:53.605 INFO:tasks.cephadm:Adding mgr.x on smithi008 2023-10-06T23:04:53.605 INFO:tasks.cephadm:Adding mgr.y on smithi156 2023-10-06T23:04:53.606 INFO:tasks.cephadm:Adding mgr.z on smithi190 2023-10-06T23:04:53.606 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi008=x;smithi156=y;smithi190=z' 2023-10-06T23:04:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: Updating smithi008:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/830561189' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: Reconfiguring mon.a (unknown last config time)... 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:53.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:53 smithi156 ceph-mon[102862]: Reconfiguring daemon mon.a on smithi008 2023-10-06T23:04:53.860 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: Updating smithi008:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.861 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/830561189' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:53.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:53.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.862 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: Reconfiguring mon.a (unknown last config time)... 2023-10-06T23:04:53.863 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:53.863 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:53.863 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:53.863 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:53 smithi008 ceph-mon[98532]: Reconfiguring daemon mon.a on smithi008 2023-10-06T23:04:53.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: Updating smithi008:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: Updating smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: Updating smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-06T23:04:53.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/830561189' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: Reconfiguring mon.a (unknown last config time)... 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:53.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:53.945 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:53.945 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:53 smithi190 ceph-mon[102658]: Reconfiguring daemon mon.a on smithi008 2023-10-06T23:04:54.358 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:04:55.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:55.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:55.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:55.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:55.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:55.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:55.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:55.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:55.749 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.747+0000 7f86732c6700 1 -- 172.21.15.190:0/3093604526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c100af0 msgr2=0x7f866c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:55.749 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.747+0000 7f86732c6700 1 --2- 172.21.15.190:0/3093604526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c100af0 0x7f866c100f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8668009910 tx=0x7f8668009c20 comp rx=0 tx=0).stop 2023-10-06T23:04:55.749 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.747+0000 7f86732c6700 1 -- 172.21.15.190:0/3093604526 shutdown_connections 2023-10-06T23:04:55.749 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.747+0000 7f86732c6700 1 --2- 172.21.15.190:0/3093604526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c100af0 0x7f866c100f10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:55.749 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.747+0000 7f86732c6700 1 -- 172.21.15.190:0/3093604526 >> 172.21.15.190:0/3093604526 conn(0x7f866c0fc0b0 msgr2=0x7f866c0fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:55.749 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.747+0000 7f86732c6700 1 -- 172.21.15.190:0/3093604526 shutdown_connections 2023-10-06T23:04:55.749 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.747+0000 7f86732c6700 1 -- 172.21.15.190:0/3093604526 wait complete. 2023-10-06T23:04:55.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.748+0000 7f86732c6700 1 Processor -- start 2023-10-06T23:04:55.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.748+0000 7f86732c6700 1 -- start start 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.748+0000 7f86732c6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f866c100af0 0x7f866c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.748+0000 7f86732c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c198470 0x7f866c19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f86732c6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f866c1988f0 0x7f866c19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f86732c6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1a0210 con 0x7f866c198470 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f86732c6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1a0380 con 0x7f866c1988f0 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f86732c6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1a0540 con 0x7f866c100af0 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671062700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f866c100af0 0x7f866c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671062700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f866c100af0 0x7f866c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40468/0 (socket says 172.21.15.190:40468) 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671062700 1 -- 172.21.15.190:0/168816093 learned_addr learned my addr 172.21.15.190:0/168816093 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:04:55.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8670861700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c198470 0x7f866c19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671863700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f866c1988f0 0x7f866c19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671062700 1 -- 172.21.15.190:0/168816093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f866c1988f0 msgr2=0x7f866c19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671062700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f866c1988f0 0x7f866c19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671062700 1 -- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c198470 msgr2=0x7f866c19d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671062700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c198470 0x7f866c19d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671062700 1 -- 172.21.15.190:0/168816093 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680095f0 con 0x7f866c100af0 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.749+0000 7f8671863700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f866c1988f0 0x7f866c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.750+0000 7f8671062700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f866c100af0 0x7f866c197f30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8668006010 tx=0x7f866800bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.750+0000 7f86627fc700 1 -- 172.21.15.190:0/168816093 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866801d070 con 0x7f866c100af0 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.750+0000 7f86627fc700 1 -- 172.21.15.190:0/168816093 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8668004db0 con 0x7f866c100af0 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.750+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c1a07c0 con 0x7f866c100af0 2023-10-06T23:04:55.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.750+0000 7f86627fc700 1 -- 172.21.15.190:0/168816093 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668022d70 con 0x7f866c100af0 2023-10-06T23:04:55.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.750+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c1a0ce0 con 0x7f866c100af0 2023-10-06T23:04:55.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.751+0000 7f86627fc700 1 -- 172.21.15.190:0/168816093 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f8668004920 con 0x7f866c100af0 2023-10-06T23:04:55.755 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.751+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c1066f0 con 0x7f866c100af0 2023-10-06T23:04:55.755 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.752+0000 7f86627fc700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8658038d90 0x7f865803b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:04:55.755 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.752+0000 7f86627fc700 1 -- 172.21.15.190:0/168816093 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f866804ca50 con 0x7f866c100af0 2023-10-06T23:04:55.755 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.752+0000 7f8670861700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8658038d90 0x7f865803b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:04:55.755 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.753+0000 7f8670861700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8658038d90 0x7f865803b250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f865c009ad0 tx=0x7f865c009210 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:04:55.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.757+0000 7f86627fc700 1 -- 172.21.15.190:0/168816093 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8668022470 con 0x7f866c100af0 2023-10-06T23:04:55.978 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.977+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi156=y;smithi190=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f866c0738f0 con 0x7f8658038d90 2023-10-06T23:04:55.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.983+0000 7f86627fc700 1 -- 172.21.15.190:0/168816093 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f866c0738f0 con 0x7f8658038d90 2023-10-06T23:04:55.985 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mgr update... 2023-10-06T23:04:55.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8658038d90 msgr2=0x7f865803b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:55.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8658038d90 0x7f865803b250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f865c009ad0 tx=0x7f865c009210 comp rx=0 tx=0).stop 2023-10-06T23:04:55.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f866c100af0 msgr2=0x7f866c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:04:55.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f866c100af0 0x7f866c197f30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8668006010 tx=0x7f866800bcf0 comp rx=0 tx=0).stop 2023-10-06T23:04:55.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 shutdown_connections 2023-10-06T23:04:55.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8658038d90 0x7f865803b250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:55.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f866c1988f0 0x7f866c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:55.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f866c100af0 0x7f866c197f30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:55.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 --2- 172.21.15.190:0/168816093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c198470 0x7f866c19d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:04:55.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 >> 172.21.15.190:0/168816093 conn(0x7f866c0fc0b0 msgr2=0x7f866c0731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:04:55.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 shutdown_connections 2023-10-06T23:04:55.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:04:55.986+0000 7f86732c6700 1 -- 172.21.15.190:0/168816093 wait complete. 2023-10-06T23:04:56.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:55 smithi156 ceph-mon[102862]: Reconfiguring mon.b (monmap changed)... 2023-10-06T23:04:56.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:55 smithi156 ceph-mon[102862]: Reconfiguring daemon mon.b on smithi156 2023-10-06T23:04:56.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:55 smithi156 ceph-mon[102862]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:56.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:56.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:56.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:55 smithi190 ceph-mon[102658]: Reconfiguring mon.b (monmap changed)... 2023-10-06T23:04:56.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:55 smithi190 ceph-mon[102658]: Reconfiguring daemon mon.b on smithi156 2023-10-06T23:04:56.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:55 smithi190 ceph-mon[102658]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:56.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:56.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:55 smithi008 ceph-mon[98532]: Reconfiguring mon.b (monmap changed)... 2023-10-06T23:04:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:55 smithi008 ceph-mon[98532]: Reconfiguring daemon mon.b on smithi156 2023-10-06T23:04:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:55 smithi008 ceph-mon[98532]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:56.527 DEBUG:teuthology.orchestra.run.smithi156:mgr.y> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-06T23:04:56.532 DEBUG:teuthology.orchestra.run.smithi190:mgr.z> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-06T23:04:56.537 INFO:tasks.cephadm:Deploying OSDs... 2023-10-06T23:04:56.538 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:04:56.538 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T23:04:56.586 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T23:04:56.586 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-10-06T23:04:56.603 INFO:journalctl@ceph.mgr.y.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:04:56.610 INFO:journalctl@ceph.mgr.z.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:04:56.673 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T23:04:56.673 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:56.673 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-06T23:04:56.673 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:56.673 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:56.674 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-06 23:04:01.319111203 +0000 2023-10-06T23:04:56.674 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-06 22:57:59.895979168 +0000 2023-10-06T23:04:56.674 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-06 22:57:59.895979168 +0000 2023-10-06T23:04:56.674 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-06 22:57:59.872979389 +0000 2023-10-06T23:04:56.674 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T23:04:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-06T23:04:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-06T23:04:56.784 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000177839 s, 2.9 MB/s 2023-10-06T23:04:56.786 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T23:04:56.832 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-10-06T23:04:56.877 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T23:04:56.877 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:56.877 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-06T23:04:56.877 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:56.878 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:56.878 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-06 23:04:01.413110275 +0000 2023-10-06T23:04:56.878 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-06 22:58:00.733971089 +0000 2023-10-06T23:04:56.878 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-06 22:58:00.733971089 +0000 2023-10-06T23:04:56.878 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-06 22:58:00.710971311 +0000 2023-10-06T23:04:56.878 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T23:04:56.984 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-06T23:04:56.984 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-06T23:04:56.984 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000190695 s, 2.7 MB/s 2023-10-06T23:04:56.986 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T23:04:57.031 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-10-06T23:04:57.058 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:56 smithi190 ceph-mon[102658]: Reconfiguring mon.c (monmap changed)... 2023-10-06T23:04:57.059 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:57.059 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:57.059 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:57.059 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:56 smithi190 ceph-mon[102658]: Reconfiguring daemon mon.c on smithi190 2023-10-06T23:04:57.059 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:56 smithi190 ceph-mon[102658]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi156=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:57.059 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:57.117 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T23:04:57.117 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:57.118 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-06T23:04:57.118 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:57.118 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:57.118 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-06 23:04:01.493109486 +0000 2023-10-06T23:04:57.118 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-06 22:58:01.560963117 +0000 2023-10-06T23:04:57.118 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-06 22:58:01.560963117 +0000 2023-10-06T23:04:57.118 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-06 22:58:01.537963338 +0000 2023-10-06T23:04:57.118 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T23:04:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:56 smithi008 ceph-mon[98532]: Reconfiguring mon.c (monmap changed)... 2023-10-06T23:04:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:56 smithi008 ceph-mon[98532]: Reconfiguring daemon mon.c on smithi190 2023-10-06T23:04:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:56 smithi008 ceph-mon[98532]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi156=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:57.211 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-06T23:04:57.211 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-06T23:04:57.211 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.00018986 s, 2.7 MB/s 2023-10-06T23:04:57.214 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T23:04:57.259 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-10-06T23:04:57.343 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T23:04:57.343 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:57.343 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-06T23:04:57.343 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:57.343 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:57.343 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-06 23:04:01.569108736 +0000 2023-10-06T23:04:57.343 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-06 22:58:02.389955125 +0000 2023-10-06T23:04:57.344 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-06 22:58:02.389955125 +0000 2023-10-06T23:04:57.344 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-06 22:58:02.366955347 +0000 2023-10-06T23:04:57.344 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T23:04:57.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:56 smithi156 ceph-mon[102862]: Reconfiguring mon.c (monmap changed)... 2023-10-06T23:04:57.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-06T23:04:57.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-06T23:04:57.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:57.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:56 smithi156 ceph-mon[102862]: Reconfiguring daemon mon.c on smithi190 2023-10-06T23:04:57.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:56 smithi156 ceph-mon[102862]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi156=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:04:57.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:57.452 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-06T23:04:57.452 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-06T23:04:57.452 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000178461 s, 2.9 MB/s 2023-10-06T23:04:57.455 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T23:04:57.502 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-10-06T23:04:57.502 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T23:04:57.552 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T23:04:57.553 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-10-06T23:04:57.640 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T23:04:57.640 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:57.640 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-06T23:04:57.640 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:57.640 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:57.640 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-10-06 23:04:43.376135121 +0000 2023-10-06T23:04:57.640 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-10-06 22:57:38.318149926 +0000 2023-10-06T23:04:57.641 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-10-06 22:57:38.318149926 +0000 2023-10-06T23:04:57.641 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-10-06 22:57:38.294150262 +0000 2023-10-06T23:04:57.641 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T23:04:57.711 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-10-06T23:04:57.711 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-10-06T23:04:57.712 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000202252 s, 2.5 MB/s 2023-10-06T23:04:57.714 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T23:04:57.763 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-10-06T23:04:57.847 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T23:04:57.847 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:57.847 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-06T23:04:57.848 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:57.848 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:57.848 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-10-06 23:04:43.376135121 +0000 2023-10-06T23:04:57.848 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-10-06 22:57:39.136138456 +0000 2023-10-06T23:04:57.848 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-10-06 22:57:39.136138456 +0000 2023-10-06T23:04:57.848 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-10-06 22:57:39.114138765 +0000 2023-10-06T23:04:57.848 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T23:04:57.955 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-10-06T23:04:57.955 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-10-06T23:04:57.955 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000172832 s, 3.0 MB/s 2023-10-06T23:04:57.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:57 smithi156 ceph-mon[102862]: Saving service mgr spec with placement smithi008=x;smithi156=y;smithi190=z;count:3 2023-10-06T23:04:57.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:57 smithi156 ceph-mon[102862]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:57.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:57.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:57.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:57.958 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T23:04:58.003 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-10-06T23:04:58.087 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T23:04:58.087 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:58.087 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-06T23:04:58.088 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:58.088 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:58.088 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-10-06 23:04:43.376135121 +0000 2023-10-06T23:04:58.088 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-10-06 22:57:39.941127169 +0000 2023-10-06T23:04:58.088 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-10-06 22:57:39.941127169 +0000 2023-10-06T23:04:58.088 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-10-06 22:57:39.919127478 +0000 2023-10-06T23:04:58.088 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T23:04:58.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:57 smithi190 ceph-mon[102658]: Saving service mgr spec with placement smithi008=x;smithi156=y;smithi190=z;count:3 2023-10-06T23:04:58.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:57 smithi190 ceph-mon[102658]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:58.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:58.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:58.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:58.193 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-10-06T23:04:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-10-06T23:04:58.194 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.00020297 s, 2.5 MB/s 2023-10-06T23:04:58.196 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T23:04:58.240 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-10-06T23:04:58.325 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T23:04:58.325 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:58.325 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-06T23:04:58.325 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:58.325 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:58.325 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-10-06 23:04:43.376135121 +0000 2023-10-06T23:04:58.325 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-10-06 22:57:40.790115265 +0000 2023-10-06T23:04:58.326 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-10-06 22:57:40.790115265 +0000 2023-10-06T23:04:58.326 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-10-06 22:57:40.768115573 +0000 2023-10-06T23:04:58.326 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T23:04:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:57 smithi008 ceph-mon[98532]: Saving service mgr spec with placement smithi008=x;smithi156=y;smithi190=z;count:3 2023-10-06T23:04:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:57 smithi008 ceph-mon[98532]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:04:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:58.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:58.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:04:58.430 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-10-06T23:04:58.430 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-10-06T23:04:58.430 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.00020307 s, 2.5 MB/s 2023-10-06T23:04:58.432 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T23:04:58.478 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-10-06T23:04:58.478 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T23:04:58.521 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T23:04:58.522 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2023-10-06T23:04:58.607 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T23:04:58.607 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:58.607 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-06T23:04:58.607 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:58.607 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:58.608 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-10-06 23:04:33.641783208 +0000 2023-10-06T23:04:58.608 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-10-06 22:57:32.474672490 +0000 2023-10-06T23:04:58.608 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-10-06 22:57:32.474672490 +0000 2023-10-06T23:04:58.608 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-10-06 22:57:32.448673200 +0000 2023-10-06T23:04:58.608 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T23:04:58.716 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-10-06T23:04:58.716 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-10-06T23:04:58.716 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000351866 s, 1.5 MB/s 2023-10-06T23:04:58.719 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T23:04:58.764 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2023-10-06T23:04:58.851 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T23:04:58.852 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:58.852 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-06T23:04:58.852 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:58.852 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:58.852 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-10-06 23:04:33.641783208 +0000 2023-10-06T23:04:58.852 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-10-06 22:57:33.297650002 +0000 2023-10-06T23:04:58.852 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-10-06 22:57:33.297650002 +0000 2023-10-06T23:04:58.852 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-10-06 22:57:33.272650686 +0000 2023-10-06T23:04:58.852 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T23:04:58.925 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-10-06T23:04:58.925 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-10-06T23:04:58.925 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000379083 s, 1.4 MB/s 2023-10-06T23:04:58.928 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T23:04:58.975 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2023-10-06T23:04:59.018 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T23:04:59.018 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:59.018 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-06T23:04:59.019 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:59.019 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:59.019 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-10-06 23:04:33.641783208 +0000 2023-10-06T23:04:59.019 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-10-06 22:57:34.111627761 +0000 2023-10-06T23:04:59.019 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-10-06 22:57:34.111627761 +0000 2023-10-06T23:04:59.019 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-10-06 22:57:34.086628444 +0000 2023-10-06T23:04:59.019 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T23:04:59.118 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:59.118 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:59.118 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:59.119 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:04:59.119 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-06T23:04:59.119 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:04:59.119 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:59.124 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-10-06T23:04:59.124 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-10-06T23:04:59.125 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000315154 s, 1.6 MB/s 2023-10-06T23:04:59.127 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T23:04:59.173 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2023-10-06T23:04:59.259 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T23:04:59.260 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T23:04:59.261 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-06T23:04:59.261 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T23:04:59.261 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T23:04:59.261 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-10-06 23:04:33.641783208 +0000 2023-10-06T23:04:59.261 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-10-06 22:57:34.944605000 +0000 2023-10-06T23:04:59.261 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-10-06 22:57:34.944605000 +0000 2023-10-06T23:04:59.261 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-10-06 22:57:34.919605683 +0000 2023-10-06T23:04:59.261 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T23:04:59.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:04:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-06T23:04:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:04:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:59.369 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-10-06T23:04:59.369 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-10-06T23:04:59.369 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000312584 s, 1.6 MB/s 2023-10-06T23:04:59.371 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T23:04:59.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:59.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:04:59.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:04:59.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:04:59.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-06T23:04:59.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:04:59.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:04:59.416 INFO:tasks.cephadm:Deploying osd.0 on smithi008 with /dev/vg_nvme/lv_4... 2023-10-06T23:04:59.417 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-06T23:05:00.155 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:05:00.181 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:59 smithi190 ceph-mon[102658]: Deploying daemon mgr.z on smithi190 2023-10-06T23:05:00.181 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:04:59 smithi190 ceph-mon[102658]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:00.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:59 smithi156 ceph-mon[102862]: Deploying daemon mgr.z on smithi190 2023-10-06T23:05:00.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:04:59 smithi156 ceph-mon[102862]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:59 smithi008 ceph-mon[98532]: Deploying daemon mgr.z on smithi190 2023-10-06T23:05:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:04:59 smithi008 ceph-mon[98532]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:00.436 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:00 smithi190 systemd[1]: Starting Ceph mgr.z for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:05:01.169 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:00 smithi190 podman[104765]: 2023-10-06T23:05:01.442 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:01 smithi190 bash[104765]: 4b80218899863cbae33b23f77c33c37e80280d1c2ec379d2b0ba6d865b33aee7 2023-10-06T23:05:01.443 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mgr[104804]: -- 172.21.15.190:0/2717376465 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558f30f911e0 con 0x558f30f66800 2023-10-06T23:05:01.443 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:01 smithi190 systemd[1]: Started Ceph mgr.z for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:05:01.443 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:01.356+0000 7f62396c9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T23:05:01.913 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:01.460+0000 7f62396c9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T23:05:01.913 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:01.573+0000 7f62396c9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T23:05:01.913 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:01.690+0000 7f62396c9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T23:05:01.913 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:01.912+0000 7f62396c9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T23:05:02.131 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-06T23:05:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-06T23:05:02.132 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-06T23:05:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-06T23:05:02.132 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0341348 s, 307 MB/s 2023-10-06T23:05:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-06T23:05:02.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mon[102658]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:05:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-06T23:05:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:05:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:02.276 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:01 smithi008 ceph-mon[98532]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:02.276 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.276 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.276 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.277 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:05:02.277 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-06T23:05:02.277 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:05:02.277 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:02.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:01 smithi156 ceph-mon[102862]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:02.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:02.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:05:02.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-06T23:05:02.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:05:02.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:02.645 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_4 2023-10-06T23:05:02.648 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:02.370+0000 7f62396c9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T23:05:02.648 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:02.531+0000 7f62396c9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T23:05:02.648 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:02.646+0000 7f62396c9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T23:05:02.935 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:02.767+0000 7f62396c9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T23:05:03.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:02 smithi190 ceph-mon[102658]: Deploying daemon mgr.y on smithi156 2023-10-06T23:05:03.271 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:02 smithi156 ceph-mon[102862]: Deploying daemon mgr.y on smithi156 2023-10-06T23:05:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:05:03.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:02 smithi008 ceph-mon[98532]: Deploying daemon mgr.y on smithi156 2023-10-06T23:05:03.599 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:03 smithi156 systemd[1]: Starting Ceph mgr.y for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:05:03.693 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:03.309+0000 7f62396c9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T23:05:04.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:03 smithi008 ceph-mon[98532]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:04.203 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:03 smithi156 ceph-mon[102862]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:04.203 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:03 smithi156 podman[104316]: 2023-10-06T23:05:04.294 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:03 smithi190 ceph-mon[102658]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:04.294 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:04 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:04.188+0000 7f62396c9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T23:05:04.484 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:04 smithi156 bash[104316]: 4470000d0cd8d5ff7473429cf0824edb3e65f32100bcf0a019278239f0bdef4f 2023-10-06T23:05:04.484 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:04 smithi156 ceph-mgr[104356]: -- 172.21.15.156:0/2765869131 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d0045d71e0 con 0x55d0045acc00 2023-10-06T23:05:04.484 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:04 smithi156 systemd[1]: Started Ceph mgr.y for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:05:04.484 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:04.378+0000 7fea19ec6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T23:05:04.692 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:04 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:04.292+0000 7f62396c9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T23:05:04.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 -- 172.21.15.8:0/3959767348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818074ee0 msgr2=0x7fb818073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:04.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 --2- 172.21.15.8:0/3959767348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818074ee0 0x7fb818073340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb814009990 tx=0x7fb814009ca0 comp rx=0 tx=0).stop 2023-10-06T23:05:04.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 -- 172.21.15.8:0/3959767348 shutdown_connections 2023-10-06T23:05:04.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 --2- 172.21.15.8:0/3959767348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818074ee0 0x7fb818073340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:04.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 --2- 172.21.15.8:0/3959767348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81810d550 0x7fb81810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:04.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 --2- 172.21.15.8:0/3959767348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb818073910 0x7fb818073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:04.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 -- 172.21.15.8:0/3959767348 >> 172.21.15.8:0/3959767348 conn(0x7fb8180fc4d0 msgr2=0x7fb8180fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:05:04.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 -- 172.21.15.8:0/3959767348 shutdown_connections 2023-10-06T23:05:04.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.802+0000 7fb81f532700 1 -- 172.21.15.8:0/3959767348 wait complete. 2023-10-06T23:05:04.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.803+0000 7fb81f532700 1 Processor -- start 2023-10-06T23:05:04.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.803+0000 7fb81f532700 1 -- start start 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81f532700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818073910 0x7fb81819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81f532700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb818074ee0 0x7fb81819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81f532700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81810d550 0x7fb8181a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81f532700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8181a4df0 con 0x7fb818073910 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81f532700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8181a4f30 con 0x7fb81810d550 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81f532700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8181a50c0 con 0x7fb818074ee0 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81d2ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818073910 0x7fb81819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81cacd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb818074ee0 0x7fb81819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81d2ce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818073910 0x7fb81819d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55090/0 (socket says 172.21.15.8:55090) 2023-10-06T23:05:04.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81d2ce700 1 -- 172.21.15.8:0/1006809975 learned_addr learned my addr 172.21.15.8:0/1006809975 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:05:04.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81dacf700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81810d550 0x7fb8181a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81cacd700 1 -- 172.21.15.8:0/1006809975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81810d550 msgr2=0x7fb8181a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81cacd700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81810d550 0x7fb8181a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81cacd700 1 -- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818073910 msgr2=0x7fb81819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.804+0000 7fb81cacd700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818073910 0x7fb81819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.805+0000 7fb81cacd700 1 -- 172.21.15.8:0/1006809975 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140095f0 con 0x7fb818074ee0 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.805+0000 7fb81d2ce700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818073910 0x7fb81819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.805+0000 7fb81cacd700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb818074ee0 0x7fb81819d7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb80800e9f0 tx=0x7fb80800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.805+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808004220 con 0x7fb818074ee0 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.805+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb808004380 con 0x7fb818074ee0 2023-10-06T23:05:04.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.805+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8181a53a0 con 0x7fb818074ee0 2023-10-06T23:05:04.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.805+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808003b40 con 0x7fb818074ee0 2023-10-06T23:05:04.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.805+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8181a5970 con 0x7fb818074ee0 2023-10-06T23:05:04.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.806+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8181030a0 con 0x7fb818074ee0 2023-10-06T23:05:04.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.806+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fb808003ca0 con 0x7fb818074ee0 2023-10-06T23:05:04.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.807+0000 7fb80e7fc700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb804038af0 0x7fb80403afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:04.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.807+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb808014070 con 0x7fb818074ee0 2023-10-06T23:05:04.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.807+0000 7fb81d2ce700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb804038af0 0x7fb80403afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:04.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.808+0000 7fb81d2ce700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb804038af0 0x7fb80403afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb814006010 tx=0x7fb81400b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:05:04.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:04.813+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb80800fbb0 con 0x7fb818074ee0 2023-10-06T23:05:04.849 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:04.481+0000 7fea19ec6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T23:05:04.849 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:04.600+0000 7fea19ec6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T23:05:04.849 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:04.718+0000 7fea19ec6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T23:05:05.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:05.031+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb81802d1a0 con 0x7fb804038af0 2023-10-06T23:05:05.348 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:04.950+0000 7fea19ec6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T23:05:05.624 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:05.453+0000 7fea19ec6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T23:05:05.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.625 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:05.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:05.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:05.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:05.626 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:05.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:05.668 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:05.302+0000 7f62396c9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:05:05.668 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:05.432+0000 7f62396c9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T23:05:05.668 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:05.666+0000 7f62396c9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:05:05.668 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.669 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.669 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.669 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:05.669 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:05.669 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:05.669 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:05.669 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:05.669 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:05.875 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:05.622+0000 7fea19ec6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T23:05:05.876 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:05.741+0000 7fea19ec6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T23:05:06.343 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:06.040+0000 7f62396c9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T23:05:06.348 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:05 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:05.873+0000 7fea19ec6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T23:05:06.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:06 smithi008 ceph-mon[98532]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:05:06.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:06 smithi190 ceph-mon[102658]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:05:06.693 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:06.341+0000 7f62396c9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T23:05:06.693 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:06.546+0000 7f62396c9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T23:05:06.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:06 smithi156 ceph-mon[102862]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:05:06.849 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:06 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:06.457+0000 7fea19ec6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T23:05:07.192 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:06.896+0000 7f62396c9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T23:05:07.643 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:07.366+0000 7fea19ec6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T23:05:07.644 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:07.470+0000 7fea19ec6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T23:05:07.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:07.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:07.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:07.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:05:07.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:05:07.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:07.942 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:07.827+0000 7f62396c9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:05:07.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:05:07.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:08.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-06T23:05:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:08.394 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:08.000+0000 7f62396c9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T23:05:08.394 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:08.248+0000 7f62396c9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T23:05:08.669 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:08.392+0000 7f62396c9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T23:05:08.771 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:08.428+0000 7fea19ec6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:05:08.771 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:08.546+0000 7fea19ec6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T23:05:08.771 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:08.769+0000 7fea19ec6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T23:05:08.942 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:08.667+0000 7f62396c9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T23:05:08.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-mon[102658]: Reconfiguring mgr.x (unknown last config time)... 2023-10-06T23:05:08.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-mon[102658]: Reconfiguring daemon mgr.x on smithi008 2023-10-06T23:05:08.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1076342983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa"}]: dispatch 2023-10-06T23:05:08.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1076342983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa"}]': finished 2023-10-06T23:05:08.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-mon[102658]: osdmap e5: 1 total, 0 up, 1 in 2023-10-06T23:05:08.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:08 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:09.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-mon[102862]: Reconfiguring mgr.x (unknown last config time)... 2023-10-06T23:05:09.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-mon[102862]: Reconfiguring daemon mgr.x on smithi008 2023-10-06T23:05:09.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1076342983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa"}]: dispatch 2023-10-06T23:05:09.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1076342983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa"}]': finished 2023-10-06T23:05:09.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-mon[102862]: osdmap e5: 1 total, 0 up, 1 in 2023-10-06T23:05:09.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:08 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:09.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:08 smithi008 ceph-mon[98532]: Reconfiguring mgr.x (unknown last config time)... 2023-10-06T23:05:09.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:08 smithi008 ceph-mon[98532]: Reconfiguring daemon mgr.x on smithi008 2023-10-06T23:05:09.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:08 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1076342983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa"}]: dispatch 2023-10-06T23:05:09.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:08 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1076342983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa"}]': finished 2023-10-06T23:05:09.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:08 smithi008 ceph-mon[98532]: osdmap e5: 1 total, 0 up, 1 in 2023-10-06T23:05:09.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:08 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:09.409 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:09.133+0000 7fea19ec6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T23:05:09.409 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:09.407+0000 7fea19ec6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T23:05:09.811 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:09.595+0000 7fea19ec6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T23:05:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:09.927+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mgrmap(e 14) v1 ==== 90790+0+0 (secure 0 0 0) 0x7fb80801dd40 con 0x7fb818074ee0 2023-10-06T23:05:10.099 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:09.936+0000 7fea19ec6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T23:05:10.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-mon[102862]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:10.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1978972451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:05:10.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:10.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-mon[102862]: Standby manager daemon z started 2023-10-06T23:05:10.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-mon[102862]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-06T23:05:10.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-mon[102862]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-06T23:05:10.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-mon[102862]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-06T23:05:10.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:09 smithi156 ceph-mon[102862]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-06T23:05:10.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:09 smithi008 ceph-mon[98532]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:10.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:09 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1978972451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:05:10.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:10.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:09 smithi008 ceph-mon[98532]: Standby manager daemon z started 2023-10-06T23:05:10.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:09 smithi008 ceph-mon[98532]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-06T23:05:10.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:09 smithi008 ceph-mon[98532]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-06T23:05:10.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:09 smithi008 ceph-mon[98532]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-06T23:05:10.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:09 smithi008 ceph-mon[98532]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-06T23:05:10.193 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z[104780]: 2023-10-06T23:05:09.741+0000 7f62396c9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T23:05:10.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-mon[102658]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:10.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1978972451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:05:10.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:10.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-mon[102658]: Standby manager daemon z started 2023-10-06T23:05:10.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-mon[102658]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-06T23:05:10.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-mon[102658]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-06T23:05:10.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-mon[102658]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-06T23:05:10.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:09 smithi190 ceph-mon[102658]: from='mgr.? 172.21.15.190:0/1681589061' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-06T23:05:11.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:10 smithi190 ceph-mon[102658]: mgrmap e14: x(active, since 81s), standbys: z 2023-10-06T23:05:11.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:10 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-06T23:05:11.281 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:10 smithi156 ceph-mon[102862]: mgrmap e14: x(active, since 81s), standbys: z 2023-10-06T23:05:11.281 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:10 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-06T23:05:11.282 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:10 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:10.861+0000 7fea19ec6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T23:05:11.282 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:11.034+0000 7fea19ec6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T23:05:11.282 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:11.279+0000 7fea19ec6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T23:05:11.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:10 smithi008 ceph-mon[98532]: mgrmap e14: x(active, since 81s), standbys: z 2023-10-06T23:05:11.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:10 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-06T23:05:11.598 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:11.425+0000 7fea19ec6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T23:05:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:11 smithi156 ceph-mon[102862]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:12.099 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:11.700+0000 7fea19ec6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T23:05:12.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:11 smithi190 ceph-mon[102658]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:12.234 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:11 smithi008 ceph-mon[98532]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:12.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:12.948+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mon.1 v2:172.21.15.190:3300/0 8 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fb80800f3c0 con 0x7fb818074ee0 2023-10-06T23:05:13.099 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:05:12 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y[104332]: 2023-10-06T23:05:12.764+0000 7fea19ec6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T23:05:13.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:12 smithi156 ceph-mon[102862]: Standby manager daemon y started 2023-10-06T23:05:13.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:12 smithi156 ceph-mon[102862]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-06T23:05:13.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:12 smithi156 ceph-mon[102862]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-06T23:05:13.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:12 smithi156 ceph-mon[102862]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-06T23:05:13.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:12 smithi156 ceph-mon[102862]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-06T23:05:13.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:12 smithi190 ceph-mon[102658]: Standby manager daemon y started 2023-10-06T23:05:13.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:12 smithi190 ceph-mon[102658]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-06T23:05:13.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:12 smithi190 ceph-mon[102658]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-06T23:05:13.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:12 smithi190 ceph-mon[102658]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-06T23:05:13.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:12 smithi190 ceph-mon[102658]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-06T23:05:13.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:12 smithi008 ceph-mon[98532]: Standby manager daemon y started 2023-10-06T23:05:13.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:12 smithi008 ceph-mon[98532]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-06T23:05:13.308 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:12 smithi008 ceph-mon[98532]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-06T23:05:13.309 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:12 smithi008 ceph-mon[98532]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-06T23:05:13.309 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:12 smithi008 ceph-mon[98532]: from='mgr.? 172.21.15.156:0/1169244146' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-06T23:05:14.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:13 smithi008 ceph-mon[98532]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:14.256 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:13 smithi008 ceph-mon[98532]: mgrmap e15: x(active, since 84s), standbys: y, z 2023-10-06T23:05:14.256 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-06T23:05:14.256 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:14.256 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:14.256 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:13 smithi156 ceph-mon[102862]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:13 smithi156 ceph-mon[102862]: mgrmap e15: x(active, since 84s), standbys: y, z 2023-10-06T23:05:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-06T23:05:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:14.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:13 smithi190 ceph-mon[102658]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:13 smithi190 ceph-mon[102658]: mgrmap e15: x(active, since 84s), standbys: y, z 2023-10-06T23:05:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-06T23:05:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:15.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:14 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:15.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:14 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:15.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:14 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:15.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:14 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:15.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:14 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:15.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:14 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:14 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:14 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:14 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:15 smithi156 ceph-mon[102862]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:15 smithi008 ceph-mon[98532]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:15 smithi190 ceph-mon[102658]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:17.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-06T23:05:17.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:17.375 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-06T23:05:17.375 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:17.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-06T23:05:17.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:17 smithi156 ceph-mon[102862]: Deploying daemon osd.0 on smithi008 2023-10-06T23:05:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:17 smithi156 ceph-mon[102862]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:18.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:17 smithi008 ceph-mon[98532]: Deploying daemon osd.0 on smithi008 2023-10-06T23:05:18.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:17 smithi008 ceph-mon[98532]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:17 smithi190 ceph-mon[102658]: Deploying daemon osd.0 on smithi008 2023-10-06T23:05:18.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:17 smithi190 ceph-mon[102658]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:20.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:19 smithi156 ceph-mon[102862]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:20.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:19 smithi008 ceph-mon[98532]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:19 smithi190 ceph-mon[102658]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:22.287 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:21 smithi008 ceph-mon[98532]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:21 smithi156 ceph-mon[102862]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:22.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:21 smithi190 ceph-mon[102658]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:23.682 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:23.682 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:23.682 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:23.682 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:23 smithi008 ceph-mon[98532]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:23 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:23 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:23 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:23 smithi190 ceph-mon[102658]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:23 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:23 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:23 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:23 smithi156 ceph-mon[102862]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.848+0000 7fb80e7fc700 1 -- 172.21.15.8:0/1006809975 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb81802d1a0 con 0x7fb804038af0 2023-10-06T23:05:25.850 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 0 on host 'smithi008' 2023-10-06T23:05:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb804038af0 msgr2=0x7fb80403afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb804038af0 0x7fb80403afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb814006010 tx=0x7fb81400b260 comp rx=0 tx=0).stop 2023-10-06T23:05:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb818074ee0 msgr2=0x7fb81819d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb818074ee0 0x7fb81819d7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb80800e9f0 tx=0x7fb80800ed00 comp rx=0 tx=0).stop 2023-10-06T23:05:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 shutdown_connections 2023-10-06T23:05:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb804038af0 0x7fb80403afb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb818073910 0x7fb81819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb81810d550 0x7fb8181a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 --2- 172.21.15.8:0/1006809975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb818074ee0 0x7fb81819d7a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 >> 172.21.15.8:0/1006809975 conn(0x7fb8180fc4d0 msgr2=0x7fb8180fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:05:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 shutdown_connections 2023-10-06T23:05:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:05:25.851+0000 7fb81f532700 1 -- 172.21.15.8:0/1006809975 wait complete. 2023-10-06T23:05:26.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:26.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:26.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:26.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:26.310 DEBUG:teuthology.orchestra.run.smithi008:osd.0> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-06T23:05:26.315 INFO:tasks.cephadm:Deploying osd.1 on smithi156 with /dev/vg_nvme/lv_4... 2023-10-06T23:05:26.315 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-06T23:05:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:26.391 INFO:journalctl@ceph.osd.0.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:05:26.645 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:05:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-0[117354]: 2023-10-06T23:05:26.446+0000 7f32e847b640 -1 osd.0 0 log_to_monitors true 2023-10-06T23:05:27.051 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:05:27.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:26 smithi190 ceph-mon[102658]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-06T23:05:27.232 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:26 smithi008 ceph-mon[98532]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-06T23:05:27.340 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:26 smithi156 ceph-mon[102862]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-06T23:05:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:27 smithi190 ceph-mon[102658]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:27 smithi190 ceph-mon[102658]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-06T23:05:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:27 smithi190 ceph-mon[102658]: osdmap e6: 1 total, 0 up, 1 in 2023-10-06T23:05:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:27 smithi190 ceph-mon[102658]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:05:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:28.318 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:27 smithi156 ceph-mon[102862]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:28.318 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:27 smithi156 ceph-mon[102862]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-06T23:05:28.318 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:27 smithi156 ceph-mon[102862]: osdmap e6: 1 total, 0 up, 1 in 2023-10-06T23:05:28.318 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:27 smithi156 ceph-mon[102862]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:05:28.319 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:28.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:27 smithi008 ceph-mon[98532]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:28.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:27 smithi008 ceph-mon[98532]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-06T23:05:28.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:27 smithi008 ceph-mon[98532]: osdmap e6: 1 total, 0 up, 1 in 2023-10-06T23:05:28.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:27 smithi008 ceph-mon[98532]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:05:28.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:28.397 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:05:27 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-0[117354]: 2023-10-06T23:05:27.943+0000 7f32ddaf2700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T23:05:28.397 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:05:27 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-0[117354]: 2023-10-06T23:05:27.947+0000 7f32d80e4700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:05:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-06T23:05:29.040 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-06T23:05:29.040 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-10-06T23:05:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-10-06T23:05:29.041 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0378004 s, 277 MB/s 2023-10-06T23:05:29.041 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-10-06T23:05:29.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:28 smithi156 ceph-mon[102862]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:05:29.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:28 smithi156 ceph-mon[102862]: osdmap e7: 1 total, 0 up, 1 in 2023-10-06T23:05:29.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:28 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:29.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:28 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:29.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:28 smithi008 ceph-mon[98532]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:05:29.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:28 smithi008 ceph-mon[98532]: osdmap e7: 1 total, 0 up, 1 in 2023-10-06T23:05:29.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:28 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:29.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:28 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:29.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:28 smithi190 ceph-mon[102658]: from='osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:05:29.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:28 smithi190 ceph-mon[102658]: osdmap e7: 1 total, 0 up, 1 in 2023-10-06T23:05:29.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:28 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:29.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:28 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:29.526 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi156:vg_nvme/lv_4 2023-10-06T23:05:30.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] boot 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: osdmap e8: 1 total, 1 up, 1 in 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:05:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:30.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:30.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.299 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] boot 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: osdmap e8: 1 total, 1 up, 1 in 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:05:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:30.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:30.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: osd.0 [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] boot 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: osdmap e8: 1 total, 1 up, 1 in 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:05:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:30.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:30.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:30.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:31.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:30 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi008 2023-10-06T23:05:31.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:30 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi008 to 17272M 2023-10-06T23:05:31.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:30 smithi156 ceph-mon[102862]: osdmap e9: 1 total, 1 up, 1 in 2023-10-06T23:05:31.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:30 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi008 2023-10-06T23:05:31.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:30 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi008 to 17272M 2023-10-06T23:05:31.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:30 smithi008 ceph-mon[98532]: osdmap e9: 1 total, 1 up, 1 in 2023-10-06T23:05:31.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:30 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi008 2023-10-06T23:05:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:30 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi008 to 17272M 2023-10-06T23:05:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:30 smithi190 ceph-mon[102658]: osdmap e9: 1 total, 1 up, 1 in 2023-10-06T23:05:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 -- 172.21.15.156:0/3098422678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102b10 msgr2=0x7f80081093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 --2- 172.21.15.156:0/3098422678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102b10 0x7f80081093c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f800000b0d0 tx=0x7f800000b3e0 comp rx=0 tx=0).stop 2023-10-06T23:05:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 -- 172.21.15.156:0/3098422678 shutdown_connections 2023-10-06T23:05:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 --2- 172.21.15.156:0/3098422678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8008100f70 0x7f8008101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:31.789 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 --2- 172.21.15.156:0/3098422678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102b10 0x7f80081093c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 --2- 172.21.15.156:0/3098422678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8008102170 0x7f80081025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 -- 172.21.15.156:0/3098422678 >> 172.21.15.156:0/3098422678 conn(0x7f80080fc4d0 msgr2=0x7f80080fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 -- 172.21.15.156:0/3098422678 shutdown_connections 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.786+0000 7f800ea54700 1 -- 172.21.15.156:0/3098422678 wait complete. 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.787+0000 7f800ea54700 1 Processor -- start 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.787+0000 7f800ea54700 1 -- start start 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f800ea54700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8008100f70 0x7f8008106d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f800ea54700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102170 0x7f8008107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f800ea54700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8008102b10 0x7f8008103880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f800ea54700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008104020 con 0x7f8008102b10 2023-10-06T23:05:31.790 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f800ea54700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008104190 con 0x7f8008102170 2023-10-06T23:05:31.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f800ea54700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008104350 con 0x7f8008100f70 2023-10-06T23:05:31.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f80077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102170 0x7f8008107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:31.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f80077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102170 0x7f8008107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:45426/0 (socket says 172.21.15.156:45426) 2023-10-06T23:05:31.791 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f80077fe700 1 -- 172.21.15.156:0/1325749969 learned_addr learned my addr 172.21.15.156:0/1325749969 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-10-06T23:05:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f8007fff700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8008100f70 0x7f8008106d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f800cff1700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8008102b10 0x7f8008103880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f80077fe700 1 -- 172.21.15.156:0/1325749969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8008100f70 msgr2=0x7f8008106d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f80077fe700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8008100f70 0x7f8008106d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f80077fe700 1 -- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8008102b10 msgr2=0x7f8008103880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f80077fe700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8008102b10 0x7f8008103880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.788+0000 7f80077fe700 1 -- 172.21.15.156:0/1325749969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000009d00 con 0x7f8008102170 2023-10-06T23:05:31.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.789+0000 7f80077fe700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102170 0x7f8008107240 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00e9a0 tx=0x7f7ffc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:05:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.789+0000 7f80057fa700 1 -- 172.21.15.156:0/1325749969 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc009790 con 0x7f8008102170 2023-10-06T23:05:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.789+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80081a5330 con 0x7f8008102170 2023-10-06T23:05:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.789+0000 7f80057fa700 1 -- 172.21.15.156:0/1325749969 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ffc010430 con 0x7f8008102170 2023-10-06T23:05:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.789+0000 7f80057fa700 1 -- 172.21.15.156:0/1325749969 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00cea0 con 0x7f8008102170 2023-10-06T23:05:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.789+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80081a5830 con 0x7f8008102170 2023-10-06T23:05:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.790+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8008193420 con 0x7f8008102170 2023-10-06T23:05:31.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.792+0000 7f80057fa700 1 -- 172.21.15.156:0/1325749969 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f7ffc0105a0 con 0x7f8008102170 2023-10-06T23:05:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.793+0000 7f80057fa700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7ff00a1470 0x7f7ff00a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.793+0000 7f80057fa700 1 -- 172.21.15.156:0/1325749969 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f7ffc014070 con 0x7f8008102170 2023-10-06T23:05:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.794+0000 7f8007fff700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7ff00a1470 0x7f7ff00a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:31.796 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.795+0000 7f8007fff700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7ff00a1470 0x7f7ff00a3930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8008101fd0 tx=0x7f7ff800a3b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:05:31.799 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:31.798+0000 7f80057fa700 1 -- 172.21.15.156:0/1325749969 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ffc096440 con 0x7f8008102170 2023-10-06T23:05:32.008 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:32.007+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f800802d1c0 con 0x7f7ff00a1470 2023-10-06T23:05:32.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:31 smithi156 ceph-mon[102862]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:31 smithi008 ceph-mon[98532]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:32.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:31 smithi190 ceph-mon[102658]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:33.222 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:33.222 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:33.222 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:33.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:33.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:33.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:33.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:33.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:33.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:33 smithi156 ceph-mon[102862]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:05:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:33 smithi156 ceph-mon[102862]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:34.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:33 smithi008 ceph-mon[98532]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:05:34.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:33 smithi008 ceph-mon[98532]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:34.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:33 smithi190 ceph-mon[102658]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:05:34.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:33 smithi190 ceph-mon[102658]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:35 smithi156 ceph-mon[102862]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:35 smithi156 ceph-mon[102862]: from='client.? 172.21.15.156:0/2328209976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]: dispatch 2023-10-06T23:05:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:35 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]: dispatch 2023-10-06T23:05:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:35 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]': finished 2023-10-06T23:05:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:35 smithi156 ceph-mon[102862]: osdmap e10: 2 total, 1 up, 2 in 2023-10-06T23:05:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:35 smithi156 ceph-mon[102862]: from='client.? 172.21.15.156:0/1748359417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:05:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:35 smithi008 ceph-mon[98532]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:35 smithi008 ceph-mon[98532]: from='client.? 172.21.15.156:0/2328209976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]: dispatch 2023-10-06T23:05:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:35 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]: dispatch 2023-10-06T23:05:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:35 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]': finished 2023-10-06T23:05:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:35 smithi008 ceph-mon[98532]: osdmap e10: 2 total, 1 up, 2 in 2023-10-06T23:05:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:35 smithi008 ceph-mon[98532]: from='client.? 172.21.15.156:0/1748359417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:05:36.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:35 smithi190 ceph-mon[102658]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:35 smithi190 ceph-mon[102658]: from='client.? 172.21.15.156:0/2328209976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]: dispatch 2023-10-06T23:05:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:35 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]: dispatch 2023-10-06T23:05:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:35 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f340f2e0-7165-45d3-9222-f55119169cfc"}]': finished 2023-10-06T23:05:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:35 smithi190 ceph-mon[102658]: osdmap e10: 2 total, 1 up, 2 in 2023-10-06T23:05:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:35 smithi190 ceph-mon[102658]: from='client.? 172.21.15.156:0/1748359417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:05:38.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:37 smithi156 ceph-mon[102862]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:38.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:37 smithi008 ceph-mon[98532]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:38.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:37 smithi190 ceph-mon[102658]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:40.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:39 smithi190 ceph-mon[102658]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:40.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:39 smithi156 ceph-mon[102862]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:39 smithi008 ceph-mon[98532]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:42.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:41 smithi190 ceph-mon[102658]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:42.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:41 smithi156 ceph-mon[102862]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:41 smithi008 ceph-mon[98532]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:43.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-06T23:05:43.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:43.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-06T23:05:43.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:43.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-06T23:05:43.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:44.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:43 smithi156 ceph-mon[102862]: Deploying daemon osd.1 on smithi156 2023-10-06T23:05:44.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:43 smithi156 ceph-mon[102862]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:44.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:43 smithi190 ceph-mon[102658]: Deploying daemon osd.1 on smithi156 2023-10-06T23:05:44.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:43 smithi190 ceph-mon[102658]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:44.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:43 smithi008 ceph-mon[98532]: Deploying daemon osd.1 on smithi156 2023-10-06T23:05:44.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:43 smithi008 ceph-mon[98532]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:46.194 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:45 smithi156 ceph-mon[102862]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:45 smithi008 ceph-mon[98532]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:45 smithi190 ceph-mon[102658]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:47 smithi156 ceph-mon[102862]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:47 smithi008 ceph-mon[98532]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:48.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:47 smithi190 ceph-mon[102658]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:49 smithi008 ceph-mon[98532]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:50.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:50.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:49 smithi156 ceph-mon[102862]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:50.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:50.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:50.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:50.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:49 smithi190 ceph-mon[102658]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:51 smithi156 ceph-mon[102862]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:51 smithi008 ceph-mon[98532]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:51 smithi190 ceph-mon[102658]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:52.337 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.335+0000 7f80057fa700 1 -- 172.21.15.156:0/1325749969 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f800802d1c0 con 0x7f7ff00a1470 2023-10-06T23:05:52.337 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 1 on host 'smithi156' 2023-10-06T23:05:52.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7ff00a1470 msgr2=0x7f7ff00a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:52.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7ff00a1470 0x7f7ff00a3930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8008101fd0 tx=0x7f7ff800a3b0 comp rx=0 tx=0).stop 2023-10-06T23:05:52.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102170 msgr2=0x7f8008107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:52.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102170 0x7f8008107240 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00e9a0 tx=0x7f7ffc00ecb0 comp rx=0 tx=0).stop 2023-10-06T23:05:52.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 shutdown_connections 2023-10-06T23:05:52.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7ff00a1470 0x7f7ff00a3930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:52.340 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8008102b10 0x7f8008103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:52.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8008100f70 0x7f8008106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:52.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 --2- 172.21.15.156:0/1325749969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8008102170 0x7f8008107240 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:52.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.338+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 >> 172.21.15.156:0/1325749969 conn(0x7f80080fc4d0 msgr2=0x7f8008107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:05:52.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.339+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 shutdown_connections 2023-10-06T23:05:52.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:05:52.339+0000 7f800ea54700 1 -- 172.21.15.156:0/1325749969 wait complete. 2023-10-06T23:05:52.932 DEBUG:teuthology.orchestra.run.smithi156:osd.1> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-06T23:05:52.937 INFO:tasks.cephadm:Deploying osd.2 on smithi190 with /dev/vg_nvme/lv_4... 2023-10-06T23:05:52.938 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-06T23:05:53.010 INFO:journalctl@ceph.osd.1.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:05:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:53 smithi156 ceph-mon[102862]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:53 smithi156 ceph-mon[102862]: from='osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-06T23:05:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:53 smithi156 ceph-mon[102862]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-06T23:05:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:53 smithi008 ceph-mon[98532]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:53 smithi008 ceph-mon[98532]: from='osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-06T23:05:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:53 smithi008 ceph-mon[98532]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-06T23:05:53.671 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:05:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:53.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:05:53.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:53 smithi190 ceph-mon[102658]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:53.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:53 smithi190 ceph-mon[102658]: from='osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-06T23:05:53.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:53 smithi190 ceph-mon[102658]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-06T23:05:54.349 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:05:54 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-1[107959]: 2023-10-06T23:05:54.321+0000 7f73ae654700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T23:05:54.349 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:05:54 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-1[107959]: 2023-10-06T23:05:54.326+0000 7f73a8c46700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:05:54.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:54 smithi156 ceph-mon[102862]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-06T23:05:54.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:54 smithi156 ceph-mon[102862]: from='osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:05:54.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:54 smithi156 ceph-mon[102862]: osdmap e11: 2 total, 1 up, 2 in 2023-10-06T23:05:54.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:54.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:54 smithi156 ceph-mon[102862]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:05:54.493 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:54 smithi190 ceph-mon[102658]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-06T23:05:54.493 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:54 smithi190 ceph-mon[102658]: from='osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:05:54.494 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:54 smithi190 ceph-mon[102658]: osdmap e11: 2 total, 1 up, 2 in 2023-10-06T23:05:54.494 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:54.494 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:54 smithi190 ceph-mon[102658]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:05:54.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:54 smithi008 ceph-mon[98532]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-06T23:05:54.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:54 smithi008 ceph-mon[98532]: from='osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:05:54.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:54 smithi008 ceph-mon[98532]: osdmap e11: 2 total, 1 up, 2 in 2023-10-06T23:05:54.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:54.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:54 smithi008 ceph-mon[98532]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:05:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:55 smithi156 ceph-mon[102862]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:05:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:55 smithi156 ceph-mon[102862]: osdmap e12: 2 total, 1 up, 2 in 2023-10-06T23:05:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:55.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:55 smithi156 ceph-mon[102862]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:55.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:55 smithi008 ceph-mon[98532]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:05:55.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:55 smithi008 ceph-mon[98532]: osdmap e12: 2 total, 1 up, 2 in 2023-10-06T23:05:55.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:55.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:55.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:55 smithi008 ceph-mon[98532]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:55.655 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-06T23:05:55.655 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-06T23:05:55.655 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2023-10-06T23:05:55.655 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2023-10-06T23:05:55.655 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0383156 s, 274 MB/s 2023-10-06T23:05:55.656 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2023-10-06T23:05:55.690 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:55 smithi190 ceph-mon[102658]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:05:55.691 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:55 smithi190 ceph-mon[102658]: osdmap e12: 2 total, 1 up, 2 in 2023-10-06T23:05:55.691 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:55.691 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:55.691 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:55 smithi190 ceph-mon[102658]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-06T23:05:56.142 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi190:vg_nvme/lv_4 2023-10-06T23:05:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:05:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:05:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] boot 2023-10-06T23:05:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: osdmap e13: 2 total, 2 up, 2 in 2023-10-06T23:05:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:05:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] boot 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: osdmap e13: 2 total, 2 up, 2 in 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: osd.1 [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] boot 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: osdmap e13: 2 total, 2 up, 2 in 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:56.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:05:56.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:05:56.870 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:05:57.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:57 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi156 2023-10-06T23:05:57.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:57 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi156 to 17267M 2023-10-06T23:05:57.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:57 smithi190 ceph-mon[102658]: osdmap e14: 2 total, 2 up, 2 in 2023-10-06T23:05:57.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:57 smithi190 ceph-mon[102658]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:05:57.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:57 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi156 2023-10-06T23:05:57.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:57 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi156 to 17267M 2023-10-06T23:05:57.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:57 smithi156 ceph-mon[102862]: osdmap e14: 2 total, 2 up, 2 in 2023-10-06T23:05:57.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:57 smithi156 ceph-mon[102862]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:05:57.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:57 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi156 2023-10-06T23:05:57.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:57 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi156 to 17267M 2023-10-06T23:05:57.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:57 smithi008 ceph-mon[98532]: osdmap e14: 2 total, 2 up, 2 in 2023-10-06T23:05:57.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:57 smithi008 ceph-mon[98532]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:05:58.380 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 -- 172.21.15.190:0/423811176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0100f70 msgr2=0x7f36b0101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:58.380 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 --2- 172.21.15.190:0/423811176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0100f70 0x7f36b0101390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009990 tx=0x7f36ac009ca0 comp rx=0 tx=0).stop 2023-10-06T23:05:58.380 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 -- 172.21.15.190:0/423811176 shutdown_connections 2023-10-06T23:05:58.380 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 --2- 172.21.15.190:0/423811176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36b0102b10 0x7f36b01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:58.380 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 --2- 172.21.15.190:0/423811176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0100f70 0x7f36b0101390 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:58.381 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 --2- 172.21.15.190:0/423811176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36b0102170 0x7f36b01025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:58.381 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 -- 172.21.15.190:0/423811176 >> 172.21.15.190:0/423811176 conn(0x7f36b00fc4d0 msgr2=0x7f36b00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:05:58.381 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 -- 172.21.15.190:0/423811176 shutdown_connections 2023-10-06T23:05:58.381 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.378+0000 7f36b87b3700 1 -- 172.21.15.190:0/423811176 wait complete. 2023-10-06T23:05:58.383 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.379+0000 7f36b87b3700 1 Processor -- start 2023-10-06T23:05:58.383 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b87b3700 1 -- start start 2023-10-06T23:05:58.383 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b87b3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36b0100f70 0x7f36b0198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:58.383 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b87b3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0102170 0x7f36b0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:58.383 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b87b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36b0102b10 0x7f36b01a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:58.383 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b87b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b01a0960 con 0x7f36b0102b10 2023-10-06T23:05:58.383 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b87b3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b01a0aa0 con 0x7f36b0100f70 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b87b3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b01a0c30 con 0x7f36b0102170 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b5d4e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0102170 0x7f36b0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b5d4e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0102170 0x7f36b0199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:54512/0 (socket says 172.21.15.190:54512) 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b5d4e700 1 -- 172.21.15.190:0/3035058661 learned_addr learned my addr 172.21.15.190:0/3035058661 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b654f700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36b0100f70 0x7f36b0198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.380+0000 7f36b5d4e700 1 -- 172.21.15.190:0/3035058661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36b0100f70 msgr2=0x7f36b0198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36b5d4e700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36b0100f70 0x7f36b0198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36b5d4e700 1 -- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36b0102b10 msgr2=0x7f36b01a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36b5d4e700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36b0102b10 0x7f36b01a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36b5d4e700 1 -- 172.21.15.190:0/3035058661 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0095f0 con 0x7f36b0102170 2023-10-06T23:05:58.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36b5d4e700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0102170 0x7f36b0199310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f36a000b560 tx=0x7f36a000b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:05:58.385 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36a77fe700 1 -- 172.21.15.190:0/3035058661 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0011830 con 0x7f36b0102170 2023-10-06T23:05:58.385 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36a77fe700 1 -- 172.21.15.190:0/3035058661 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36a0011e20 con 0x7f36b0102170 2023-10-06T23:05:58.385 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b01a0f10 con 0x7f36b0102170 2023-10-06T23:05:58.385 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36a77fe700 1 -- 172.21.15.190:0/3035058661 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0010dd0 con 0x7f36b0102170 2023-10-06T23:05:58.385 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.381+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b01a1450 con 0x7f36b0102170 2023-10-06T23:05:58.385 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.382+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b01934e0 con 0x7f36b0102170 2023-10-06T23:05:58.386 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.385+0000 7f36a77fe700 1 -- 172.21.15.190:0/3035058661 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f36a0011990 con 0x7f36b0102170 2023-10-06T23:05:58.388 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.386+0000 7f36a77fe700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f369c0a1470 0x7f369c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:05:58.388 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.386+0000 7f36a77fe700 1 -- 172.21.15.190:0/3035058661 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f36a00cb360 con 0x7f36b0102170 2023-10-06T23:05:58.388 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.386+0000 7f36b654f700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f369c0a1470 0x7f369c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:05:58.388 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.387+0000 7f36b654f700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f369c0a1470 0x7f369c0a3930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00b5c0 tx=0x7f36ac005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:05:58.390 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.389+0000 7f36a77fe700 1 -- 172.21.15.190:0/3035058661 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f36a0096170 con 0x7f36b0102170 2023-10-06T23:05:58.595 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:05:58.593+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f36b002d2b0 con 0x7f369c0a1470 2023-10-06T23:05:59.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:59.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:59.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:59.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:59.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:59.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:59.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:05:59.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:05:59.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:05:59.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:59 smithi190 ceph-mon[102658]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:05:59.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:05:59 smithi190 ceph-mon[102658]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:00.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:59 smithi156 ceph-mon[102862]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:06:00.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:05:59 smithi156 ceph-mon[102862]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:00.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:59 smithi008 ceph-mon[98532]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:06:00.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:05:59 smithi008 ceph-mon[98532]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:02.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:01 smithi190 ceph-mon[102658]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/3351779856' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]: dispatch 2023-10-06T23:06:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:01 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]: dispatch 2023-10-06T23:06:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:01 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]': finished 2023-10-06T23:06:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:01 smithi190 ceph-mon[102658]: osdmap e15: 3 total, 2 up, 3 in 2023-10-06T23:06:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:01 smithi156 ceph-mon[102862]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/3351779856' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]: dispatch 2023-10-06T23:06:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:01 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]: dispatch 2023-10-06T23:06:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:01 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]': finished 2023-10-06T23:06:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:01 smithi156 ceph-mon[102862]: osdmap e15: 3 total, 2 up, 3 in 2023-10-06T23:06:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:01 smithi008 ceph-mon[98532]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/3351779856' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]: dispatch 2023-10-06T23:06:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:01 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]: dispatch 2023-10-06T23:06:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:01 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0986122c-3438-4e4e-bad5-857c27371b25"}]': finished 2023-10-06T23:06:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:01 smithi008 ceph-mon[98532]: osdmap e15: 3 total, 2 up, 3 in 2023-10-06T23:06:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:03.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:02 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/323295806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:03.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:02 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/323295806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:03.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:02 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/323295806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:04.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:03 smithi190 ceph-mon[102658]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:04.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:03 smithi156 ceph-mon[102862]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:04.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:03 smithi008 ceph-mon[98532]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:06.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:05 smithi190 ceph-mon[102658]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:06.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:05 smithi156 ceph-mon[102862]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:05 smithi008 ceph-mon[98532]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:07 smithi156 ceph-mon[102862]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:08.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:07 smithi008 ceph-mon[98532]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:08.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:07 smithi190 ceph-mon[102658]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:10.151 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:09 smithi190 ceph-mon[102658]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:10.151 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-06T23:06:10.152 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:10.152 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:09 smithi190 ceph-mon[102658]: Deploying daemon osd.2 on smithi190 2023-10-06T23:06:10.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:09 smithi156 ceph-mon[102862]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:10.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-06T23:06:10.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:10.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:09 smithi156 ceph-mon[102862]: Deploying daemon osd.2 on smithi190 2023-10-06T23:06:10.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:09 smithi008 ceph-mon[98532]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:10.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-06T23:06:10.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:10.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:09 smithi008 ceph-mon[98532]: Deploying daemon osd.2 on smithi190 2023-10-06T23:06:12.133 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:11 smithi190 ceph-mon[102658]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:12.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:11 smithi156 ceph-mon[102862]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:11 smithi008 ceph-mon[98532]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:14.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:13 smithi190 ceph-mon[102658]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:14.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:13 smithi156 ceph-mon[102862]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:13 smithi008 ceph-mon[98532]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:15 smithi156 ceph-mon[102862]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:15 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:15 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:15 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:16.389 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:15 smithi190 ceph-mon[102658]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:16.390 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:15 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:16.390 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:15 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:16.390 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:15 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:15 smithi008 ceph-mon[98532]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:15 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:16.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:15 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:16.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:15 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:17.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:17 smithi190 ceph-mon[102658]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:17.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:17.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:17.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:17.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:17.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:17 smithi156 ceph-mon[102862]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:18.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:17 smithi008 ceph-mon[98532]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:18.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:18.724 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.722+0000 7f36a77fe700 1 -- 172.21.15.190:0/3035058661 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f36b002d2b0 con 0x7f369c0a1470 2023-10-06T23:06:18.724 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 2 on host 'smithi190' 2023-10-06T23:06:18.726 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f369c0a1470 msgr2=0x7f369c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:18.726 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f369c0a1470 0x7f369c0a3930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00b5c0 tx=0x7f36ac005fb0 comp rx=0 tx=0).stop 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0102170 msgr2=0x7f36b0199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0102170 0x7f36b0199310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f36a000b560 tx=0x7f36a000b920 comp rx=0 tx=0).stop 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 shutdown_connections 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f369c0a1470 0x7f369c0a3930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36b0102b10 0x7f36b01a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36b0100f70 0x7f36b0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 --2- 172.21.15.190:0/3035058661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b0102170 0x7f36b0199310 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 >> 172.21.15.190:0/3035058661 conn(0x7f36b00fc4d0 msgr2=0x7f36b0107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 shutdown_connections 2023-10-06T23:06:18.727 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:06:18.725+0000 7f36b87b3700 1 -- 172.21.15.190:0/3035058661 wait complete. 2023-10-06T23:06:19.192 DEBUG:teuthology.orchestra.run.smithi190:osd.2> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-06T23:06:19.198 INFO:tasks.cephadm:Deploying osd.3 on smithi008 with /dev/vg_nvme/lv_3... 2023-10-06T23:06:19.199 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-06T23:06:19.286 INFO:journalctl@ceph.osd.2.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:06:19.442 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-2[108490]: 2023-10-06T23:06:19.285+0000 7fae85c56640 -1 osd.2 0 log_to_monitors true 2023-10-06T23:06:19.942 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:06:19.990 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:19 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:19.991 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:19 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:19.991 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:19 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:19.991 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:19 smithi190 ceph-mon[102658]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:19.991 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:19 smithi190 ceph-mon[102658]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-06T23:06:20.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:19 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:20.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:19 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:20.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:19 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:20.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:19 smithi156 ceph-mon[102862]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:20.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:19 smithi156 ceph-mon[102862]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-06T23:06:20.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:19 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:20.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:19 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:20.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:19 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:20.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:19 smithi008 ceph-mon[98532]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:20.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:19 smithi008 ceph-mon[98532]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-06T23:06:20.795 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:20 smithi190 ceph-mon[102658]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-06T23:06:20.795 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:20 smithi190 ceph-mon[102658]: osdmap e16: 3 total, 2 up, 3 in 2023-10-06T23:06:20.796 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:20 smithi190 ceph-mon[102658]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:06:20.796 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:20 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:20.796 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-2[108490]: 2023-10-06T23:06:20.713+0000 7fae7bace700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T23:06:20.796 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-2[108490]: 2023-10-06T23:06:20.718+0000 7fae738bb700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:06:20.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:20 smithi008 ceph-mon[98532]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-06T23:06:20.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:20 smithi008 ceph-mon[98532]: osdmap e16: 3 total, 2 up, 3 in 2023-10-06T23:06:20.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:20 smithi008 ceph-mon[98532]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:06:20.843 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:21.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:20 smithi156 ceph-mon[102862]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-06T23:06:21.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:20 smithi156 ceph-mon[102862]: osdmap e16: 3 total, 2 up, 3 in 2023-10-06T23:06:21.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:20 smithi156 ceph-mon[102862]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:06:21.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:20 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:21.935 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-06T23:06:21.935 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-06T23:06:21.935 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-06T23:06:21.935 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-06T23:06:21.935 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0295472 s, 355 MB/s 2023-10-06T23:06:21.935 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-06T23:06:21.971 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:21 smithi008 ceph-mon[98532]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:06:21.971 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:21 smithi008 ceph-mon[98532]: osdmap e17: 3 total, 2 up, 3 in 2023-10-06T23:06:21.972 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:21.972 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:21.972 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:21 smithi008 ceph-mon[98532]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:21.979 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:21 smithi190 ceph-mon[102658]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:06:21.979 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:21 smithi190 ceph-mon[102658]: osdmap e17: 3 total, 2 up, 3 in 2023-10-06T23:06:21.979 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:21.979 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:21.979 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:21 smithi190 ceph-mon[102658]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:22.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:21 smithi156 ceph-mon[102862]: from='osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:06:22.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:21 smithi156 ceph-mon[102862]: osdmap e17: 3 total, 2 up, 3 in 2023-10-06T23:06:22.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:22.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:22.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:21 smithi156 ceph-mon[102862]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-06T23:06:22.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_3 2023-10-06T23:06:23.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:06:23.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:06:23.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] boot 2023-10-06T23:06:23.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: osdmap e18: 3 total, 3 up, 3 in 2023-10-06T23:06:23.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:23.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:23.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:23.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:23.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:06:23.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] boot 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: osdmap e18: 3 total, 3 up, 3 in 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.169 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:06:23.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: osd.2 [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] boot 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: osdmap e18: 3 total, 3 up, 3 in 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:24.061 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:23 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi190 2023-10-06T23:06:24.061 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:23 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi190 to 17267M 2023-10-06T23:06:24.061 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:23 smithi008 ceph-mon[98532]: osdmap e19: 3 total, 3 up, 3 in 2023-10-06T23:06:24.062 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:23 smithi008 ceph-mon[98532]: pgmap v86: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:24.062 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-06T23:06:24.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:23 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi190 2023-10-06T23:06:24.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:23 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi190 to 17267M 2023-10-06T23:06:24.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:23 smithi156 ceph-mon[102862]: osdmap e19: 3 total, 3 up, 3 in 2023-10-06T23:06:24.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:23 smithi156 ceph-mon[102862]: pgmap v86: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:24.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:23 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-06T23:06:24.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:23 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi190 2023-10-06T23:06:24.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:23 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi190 to 17267M 2023-10-06T23:06:24.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:23 smithi190 ceph-mon[102658]: osdmap e19: 3 total, 3 up, 3 in 2023-10-06T23:06:24.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:23 smithi190 ceph-mon[102658]: pgmap v86: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:24.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:23 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-06T23:06:24.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/3447889383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 msgr2=0x7f2cb0101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:24.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/3447889383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 0x7f2cb0101390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40099c0 tx=0x7f2ca4009cd0 comp rx=0 tx=0).stop 2023-10-06T23:06:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/3447889383 shutdown_connections 2023-10-06T23:06:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/3447889383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 0x7f2cb0101390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/3447889383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb0102b10 0x7f2cb01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/3447889383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb0102170 0x7f2cb01025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/3447889383 >> 172.21.15.8:0/3447889383 conn(0x7f2cb00fc4d0 msgr2=0x7f2cb00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:06:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/3447889383 shutdown_connections 2023-10-06T23:06:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.682+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/3447889383 wait complete. 2023-10-06T23:06:24.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.683+0000 7f2cb6ad2700 1 Processor -- start 2023-10-06T23:06:24.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.683+0000 7f2cb6ad2700 1 -- start start 2023-10-06T23:06:24.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.683+0000 7f2cb6ad2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 0x7f2cb0196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:06:24.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.683+0000 7f2cb6ad2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb0102170 0x7f2cb01970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:06:24.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.683+0000 7f2cb6ad2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb0102b10 0x7f2cb019e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:06:24.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.683+0000 7f2cb6ad2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019e740 con 0x7f2cb0100f70 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.683+0000 7f2cb6ad2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019e880 con 0x7f2cb0102b10 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.683+0000 7f2cb6ad2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019ea10 con 0x7f2cb0102170 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 0x7f2cb0196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 0x7f2cb0196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60054/0 (socket says 172.21.15.8:60054) 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 -- 172.21.15.8:0/2243828721 learned_addr learned my addr 172.21.15.8:0/2243828721 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2caffff700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb0102170 0x7f2cb01970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb506f700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb0102b10 0x7f2cb019e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 -- 172.21.15.8:0/2243828721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb0102170 msgr2=0x7f2cb01970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb0102170 0x7f2cb01970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 -- 172.21.15.8:0/2243828721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb0102b10 msgr2=0x7f2cb019e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb0102b10 0x7f2cb019e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:24.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 -- 172.21.15.8:0/2243828721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca40095f0 con 0x7f2cb0100f70 2023-10-06T23:06:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb506f700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb0102b10 0x7f2cb019e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:06:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.684+0000 7f2cb486e700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 0x7f2cb0196bb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009990 tx=0x7f2ca400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:06:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.685+0000 7f2cadffb700 1 -- 172.21.15.8:0/2243828721 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca401d070 con 0x7f2cb0100f70 2023-10-06T23:06:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.685+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb019ec90 con 0x7f2cb0100f70 2023-10-06T23:06:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.685+0000 7f2cadffb700 1 -- 172.21.15.8:0/2243828721 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ca400fe30 con 0x7f2cb0100f70 2023-10-06T23:06:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.685+0000 7f2cadffb700 1 -- 172.21.15.8:0/2243828721 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4017650 con 0x7f2cb0100f70 2023-10-06T23:06:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.685+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb019f100 con 0x7f2cb0100f70 2023-10-06T23:06:24.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.686+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb0108640 con 0x7f2cb0100f70 2023-10-06T23:06:24.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.689+0000 7f2cadffb700 1 -- 172.21.15.8:0/2243828721 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f2ca4022470 con 0x7f2cb0100f70 2023-10-06T23:06:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.691+0000 7f2cadffb700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2ca00a13f0 0x7f2ca00a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:06:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.691+0000 7f2cadffb700 1 -- 172.21.15.8:0/2243828721 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f2ca40ccd00 con 0x7f2cb0100f70 2023-10-06T23:06:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.691+0000 7f2caffff700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2ca00a13f0 0x7f2ca00a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:06:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.692+0000 7f2caffff700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2ca00a13f0 0x7f2ca00a38b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c005950 tx=0x7f2c9c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:06:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.694+0000 7f2cadffb700 1 -- 172.21.15.8:0/2243828721 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2ca4097810 con 0x7f2cb0100f70 2023-10-06T23:06:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:24.919+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cb002d230 con 0x7f2ca00a13f0 2023-10-06T23:06:25.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:24 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-06T23:06:25.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:24 smithi156 ceph-mon[102862]: osdmap e20: 3 total, 3 up, 3 in 2023-10-06T23:06:25.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:24 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-06T23:06:25.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:24 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-06T23:06:25.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:24 smithi008 ceph-mon[98532]: osdmap e20: 3 total, 3 up, 3 in 2023-10-06T23:06:25.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:24 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-06T23:06:25.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:24 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-06T23:06:25.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:24 smithi190 ceph-mon[102658]: osdmap e20: 3 total, 3 up, 3 in 2023-10-06T23:06:25.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:24 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-06T23:06:25.809 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:06:25 smithi008 sudo[122761]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-06T23:06:25.809 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:06:25 smithi008 sudo[122761]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:25.809 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:06:25 smithi008 sudo[122761]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:25.809 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:06:25 smithi008 sudo[122761]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:26.083 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-06T23:06:26.083 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:25 smithi008 ceph-mon[98532]: osdmap e21: 3 total, 3 up, 3 in 2023-10-06T23:06:26.083 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:25 smithi008 ceph-mon[98532]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:26.083 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:25 smithi008 ceph-mon[98532]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:06:26.084 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:06:26.084 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:06:26.084 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-06T23:06:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:25 smithi156 ceph-mon[102862]: osdmap e21: 3 total, 3 up, 3 in 2023-10-06T23:06:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:25 smithi156 ceph-mon[102862]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:25 smithi156 ceph-mon[102862]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:06:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:06:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:06:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-06T23:06:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:25 smithi190 ceph-mon[102658]: osdmap e21: 3 total, 3 up, 3 in 2023-10-06T23:06:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:25 smithi190 ceph-mon[102658]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:25 smithi190 ceph-mon[102658]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:06:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:06:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:06:26.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:26.354 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:06:26 smithi008 sudo[122815]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-06T23:06:26.355 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:06:26 smithi008 sudo[122815]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:26.355 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:06:26 smithi008 sudo[122815]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:26.355 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:06:26 smithi008 sudo[122815]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:27.030 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:26 smithi008 ceph-mon[98532]: osdmap e22: 3 total, 3 up, 3 in 2023-10-06T23:06:27.030 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:27.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:26 smithi156 ceph-mon[102862]: osdmap e22: 3 total, 3 up, 3 in 2023-10-06T23:06:27.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:27.099 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:06:26 smithi156 sudo[112819]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-06T23:06:27.099 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:06:26 smithi156 sudo[112819]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:27.099 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:06:26 smithi156 sudo[112819]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:27.099 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:06:26 smithi156 sudo[112819]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:27.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:26 smithi190 ceph-mon[102658]: osdmap e22: 3 total, 3 up, 3 in 2023-10-06T23:06:27.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:27.598 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:06:27 smithi156 sudo[112822]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-06T23:06:27.599 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:06:27 smithi156 sudo[112822]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:27.599 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:06:27 smithi156 sudo[112822]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:27.599 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:06:27 smithi156 sudo[112822]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:27.829+0000 7f2cadffb700 1 -- 172.21.15.8:0/2243828721 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2ca4097be0 con 0x7f2cb0100f70 2023-10-06T23:06:28.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:27 smithi156 ceph-mon[102862]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:28.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:27 smithi008 ceph-mon[98532]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:28.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:27 smithi190 ceph-mon[102658]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:28.193 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:27 smithi190 sudo[113021]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-06T23:06:28.193 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:27 smithi190 sudo[113021]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:28.193 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:27 smithi190 sudo[113021]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:28.193 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:27 smithi190 sudo[113021]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:28.692 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:28 smithi190 sudo[113024]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-06T23:06:28.693 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:28 smithi190 sudo[113024]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:28.693 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:28 smithi190 sudo[113024]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:28.693 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:06:28 smithi190 sudo[113024]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:29.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:28 smithi008 sudo[122968]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-06T23:06:29.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:28 smithi008 sudo[122968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:29.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:28 smithi008 sudo[122968]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:29.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:28 smithi008 sudo[122968]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:29.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 sudo[123023]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-06T23:06:29.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 sudo[123023]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:29.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 sudo[123023]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:29.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 sudo[123023]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:29.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 ceph-mon[98532]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-06T23:06:29.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1251141156' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "956d60a4-72e7-4072-8e10-396101b01a36"}]: dispatch 2023-10-06T23:06:29.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1251141156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "956d60a4-72e7-4072-8e10-396101b01a36"}]': finished 2023-10-06T23:06:29.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 ceph-mon[98532]: osdmap e23: 4 total, 3 up, 4 in 2023-10-06T23:06:29.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:29.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:29.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:29 smithi008 ceph-mon[98532]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:29.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 ceph-mon[102658]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-06T23:06:29.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1251141156' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "956d60a4-72e7-4072-8e10-396101b01a36"}]: dispatch 2023-10-06T23:06:29.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1251141156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "956d60a4-72e7-4072-8e10-396101b01a36"}]': finished 2023-10-06T23:06:29.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 ceph-mon[102658]: osdmap e23: 4 total, 3 up, 4 in 2023-10-06T23:06:29.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:29.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:29.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 ceph-mon[102658]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:29 smithi156 ceph-mon[102862]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-06T23:06:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:29 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1251141156' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "956d60a4-72e7-4072-8e10-396101b01a36"}]: dispatch 2023-10-06T23:06:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:29 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1251141156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "956d60a4-72e7-4072-8e10-396101b01a36"}]': finished 2023-10-06T23:06:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:29 smithi156 ceph-mon[102862]: osdmap e23: 4 total, 3 up, 4 in 2023-10-06T23:06:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:29 smithi156 ceph-mon[102862]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:30.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 sudo[113027]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-06T23:06:30.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 sudo[113027]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:30.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 sudo[113027]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:30.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:29 smithi190 sudo[113027]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:30.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 sudo[113030]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-06T23:06:30.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 sudo[113030]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:30.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 sudo[113030]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:30.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 sudo[113030]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:30.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/711959019' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:30.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:30.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:30.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:30.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:30.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:30.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:30.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:30.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:30.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/711959019' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:30.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:30.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:30.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:30.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:30.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:30.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:30.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:30.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:31.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:30 smithi156 sudo[112825]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-06T23:06:31.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:30 smithi156 sudo[112825]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:31.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:30 smithi156 sudo[112825]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:31.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:30 smithi156 sudo[112825]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:31 smithi190 ceph-mon[102658]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:31 smithi190 ceph-mon[102658]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:31 smithi190 ceph-mon[102658]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:31.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 sudo[112828]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-06T23:06:31.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 sudo[112828]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-06T23:06:31.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 sudo[112828]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-06T23:06:31.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 sudo[112828]: pam_unix(sudo:session): session closed for user root 2023-10-06T23:06:31.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/711959019' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:31.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:31.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:31.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:31.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:31 smithi156 ceph-mon[102862]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:31.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:31 smithi008 ceph-mon[98532]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:31.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:31 smithi008 ceph-mon[98532]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:31.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-06T23:06:31.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-06T23:06:31.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-06T23:06:31.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:31 smithi008 ceph-mon[98532]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:32.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:32 smithi190 ceph-mon[102658]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:32.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:32 smithi190 ceph-mon[102658]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:32.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:32 smithi156 ceph-mon[102862]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:32.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:32 smithi156 ceph-mon[102862]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:32.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:32 smithi008 ceph-mon[98532]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-06T23:06:32.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:32 smithi008 ceph-mon[98532]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-06T23:06:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:33 smithi190 ceph-mon[102658]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-10-06T23:06:33.771 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:33 smithi008 ceph-mon[98532]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-10-06T23:06:33.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:33 smithi156 ceph-mon[102862]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-10-06T23:06:36.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:35 smithi190 ceph-mon[102658]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-10-06T23:06:36.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-06T23:06:36.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:35 smithi156 ceph-mon[102862]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-10-06T23:06:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-06T23:06:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:35 smithi008 ceph-mon[98532]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-10-06T23:06:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-06T23:06:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:37.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:36 smithi008 ceph-mon[98532]: Deploying daemon osd.3 on smithi008 2023-10-06T23:06:37.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:36 smithi190 ceph-mon[102658]: Deploying daemon osd.3 on smithi008 2023-10-06T23:06:37.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:36 smithi156 ceph-mon[102862]: Deploying daemon osd.3 on smithi008 2023-10-06T23:06:38.231 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:37 smithi008 ceph-mon[98532]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-10-06T23:06:38.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:37 smithi156 ceph-mon[102862]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-10-06T23:06:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:37 smithi190 ceph-mon[102658]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-10-06T23:06:40.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:39 smithi156 ceph-mon[102862]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-10-06T23:06:40.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:39 smithi008 ceph-mon[98532]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-10-06T23:06:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:39 smithi190 ceph-mon[102658]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-10-06T23:06:42.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:41 smithi008 ceph-mon[98532]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-06T23:06:42.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:42.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:42.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:42.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:41 smithi156 ceph-mon[102862]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-06T23:06:42.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:42.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:42.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:41 smithi190 ceph-mon[102658]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-06T23:06:42.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:42.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:42.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:44.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:43 smithi008 ceph-mon[98532]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-06T23:06:44.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:43 smithi156 ceph-mon[102862]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-06T23:06:44.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:43 smithi190 ceph-mon[102658]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-06T23:06:45.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.631+0000 7f2cadffb700 1 -- 172.21.15.8:0/2243828721 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2cb002d230 con 0x7f2ca00a13f0 2023-10-06T23:06:45.634 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 3 on host 'smithi008' 2023-10-06T23:06:45.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2ca00a13f0 msgr2=0x7f2ca00a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:45.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2ca00a13f0 0x7f2ca00a38b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c005950 tx=0x7f2c9c00b410 comp rx=0 tx=0).stop 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 msgr2=0x7f2cb0196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 0x7f2cb0196bb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009990 tx=0x7f2ca400fa00 comp rx=0 tx=0).stop 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 shutdown_connections 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2ca00a13f0 0x7f2ca00a38b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0100f70 0x7f2cb0196bb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb0102b10 0x7f2cb019e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 --2- 172.21.15.8:0/2243828721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb0102170 0x7f2cb01970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 >> 172.21.15.8:0/2243828721 conn(0x7f2cb00fc4d0 msgr2=0x7f2cb0105780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 shutdown_connections 2023-10-06T23:06:45.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:06:45.634+0000 7f2cb6ad2700 1 -- 172.21.15.8:0/2243828721 wait complete. 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.784 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:45 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:45.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-06T23:06:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:45 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:46.093 DEBUG:teuthology.orchestra.run.smithi008:osd.3> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-06T23:06:46.098 INFO:tasks.cephadm:Deploying osd.4 on smithi156 with /dev/vg_nvme/lv_3... 2023-10-06T23:06:46.098 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-06T23:06:46.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:46.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:46.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:46.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:46.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:46.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-06T23:06:46.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:46.101 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:46.101 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:45 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:06:46.174 INFO:journalctl@ceph.osd.3.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:06:46.839 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:06:46.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:46 smithi008 ceph-mon[98532]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-06T23:06:46.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:46 smithi190 ceph-mon[102658]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-06T23:06:47.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:46 smithi156 ceph-mon[102862]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-06T23:06:47.742 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:47 smithi156 ceph-mon[102862]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-06T23:06:47.742 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:47 smithi156 ceph-mon[102862]: osdmap e24: 4 total, 3 up, 4 in 2023-10-06T23:06:47.742 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:47 smithi156 ceph-mon[102862]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:06:47.742 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:47.742 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:47 smithi156 ceph-mon[102862]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:47.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:47 smithi008 ceph-mon[98532]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-06T23:06:47.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:47 smithi008 ceph-mon[98532]: osdmap e24: 4 total, 3 up, 4 in 2023-10-06T23:06:47.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:47 smithi008 ceph-mon[98532]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:06:47.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:47.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:47 smithi008 ceph-mon[98532]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:47.897 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:06:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:06:47.647+0000 7fd98b683700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T23:06:47.897 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:06:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:06:47.653+0000 7fd983470700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:06:47.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:47 smithi190 ceph-mon[102658]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-06T23:06:47.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:47 smithi190 ceph-mon[102658]: osdmap e24: 4 total, 3 up, 4 in 2023-10-06T23:06:47.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:47 smithi190 ceph-mon[102658]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:06:47.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:47.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:47 smithi190 ceph-mon[102658]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-06T23:06:48.830 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-06T23:06:48.830 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-06T23:06:48.830 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-10-06T23:06:48.830 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-10-06T23:06:48.831 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0298338 s, 351 MB/s 2023-10-06T23:06:48.831 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-10-06T23:06:48.908 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:48 smithi008 ceph-mon[98532]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:06:48.908 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:48 smithi008 ceph-mon[98532]: osdmap e25: 4 total, 3 up, 4 in 2023-10-06T23:06:48.909 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:48.909 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:48 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:48.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:48 smithi190 ceph-mon[102658]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:06:48.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:48 smithi190 ceph-mon[102658]: osdmap e25: 4 total, 3 up, 4 in 2023-10-06T23:06:48.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:48 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:48.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:48 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:48.971 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:48 smithi156 ceph-mon[102862]: from='osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:06:48.971 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:48 smithi156 ceph-mon[102862]: osdmap e25: 4 total, 3 up, 4 in 2023-10-06T23:06:48.971 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:48 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:48.972 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:48 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:49.319 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi156:vg_nvme/lv_3 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] boot 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: osdmap e26: 4 total, 4 up, 4 in 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:49.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:49.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:49.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:49.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:49.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:49 smithi190 ceph-mon[102658]: osdmap e27: 4 total, 4 up, 4 in 2023-10-06T23:06:50.052 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:06:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:06:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:06:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] boot 2023-10-06T23:06:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: osdmap e26: 4 total, 4 up, 4 in 2023-10-06T23:06:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:06:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:50.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:50.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:50.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:50.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:50.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:50.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:50.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:49 smithi156 ceph-mon[102862]: osdmap e27: 4 total, 4 up, 4 in 2023-10-06T23:06:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: osd.3 [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] boot 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: osdmap e26: 4 total, 4 up, 4 in 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:50.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:06:50.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:06:50.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:49 smithi008 ceph-mon[98532]: osdmap e27: 4 total, 4 up, 4 in 2023-10-06T23:06:50.881 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:50 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi008 2023-10-06T23:06:50.881 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:50 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi008 to 8636M 2023-10-06T23:06:50.882 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:50 smithi156 ceph-mon[102862]: osdmap e28: 4 total, 4 up, 4 in 2023-10-06T23:06:50.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:50 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi008 2023-10-06T23:06:50.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:50 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi008 to 8636M 2023-10-06T23:06:50.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:50 smithi190 ceph-mon[102658]: osdmap e28: 4 total, 4 up, 4 in 2023-10-06T23:06:51.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:50 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi008 2023-10-06T23:06:51.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:50 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi008 to 8636M 2023-10-06T23:06:51.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:50 smithi008 ceph-mon[98532]: osdmap e28: 4 total, 4 up, 4 in 2023-10-06T23:06:51.549 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/3758795756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 msgr2=0x7f6ad0073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/3758795756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 0x7f6ad0073d90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009990 tx=0x7f6ac4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:06:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/3758795756 shutdown_connections 2023-10-06T23:06:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/3758795756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad0074ee0 0x7f6ad0073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/3758795756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ad0108e40 0x7f6ad010b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/3758795756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 0x7f6ad0073d90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/3758795756 >> 172.21.15.156:0/3758795756 conn(0x7f6ad00fc4d0 msgr2=0x7f6ad00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:06:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/3758795756 shutdown_connections 2023-10-06T23:06:51.550 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.548+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/3758795756 wait complete. 2023-10-06T23:06:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.550+0000 7f6ad4d8a700 1 Processor -- start 2023-10-06T23:06:51.551 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.550+0000 7f6ad4d8a700 1 -- start start 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.550+0000 7f6ad4d8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 0x7f6ad0198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.550+0000 7f6ad4d8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad0074ee0 0x7f6ad0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.550+0000 7f6ad4d8a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ad0108e40 0x7f6ad01a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.550+0000 7f6ad4d8a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01a0980 con 0x7f6ad0074ee0 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.550+0000 7f6ad4d8a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01a0ac0 con 0x7f6ad0073910 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.550+0000 7f6ad4d8a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01a0c50 con 0x7f6ad0108e40 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 0x7f6ad0198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 0x7f6ad0198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:58370/0 (socket says 172.21.15.156:58370) 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 -- 172.21.15.156:0/2026416402 learned_addr learned my addr 172.21.15.156:0/2026416402 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-10-06T23:06:51.552 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6acdd9b700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad0074ee0 0x7f6ad0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:06:51.553 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6aced9d700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ad0108e40 0x7f6ad01a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 -- 172.21.15.156:0/2026416402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ad0108e40 msgr2=0x7f6ad01a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ad0108e40 0x7f6ad01a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 -- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad0074ee0 msgr2=0x7f6ad0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad0074ee0 0x7f6ad0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 -- 172.21.15.156:0/2026416402 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40095f0 con 0x7f6ad0073910 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6aced9d700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ad0108e40 0x7f6ad01a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6ace59c700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 0x7f6ad0198df0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d980 tx=0x7f6ac000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.551+0000 7f6abf7fe700 1 -- 172.21.15.156:0/2026416402 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0009930 con 0x7f6ad0073910 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.552+0000 7f6abf7fe700 1 -- 172.21.15.156:0/2026416402 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ac0010460 con 0x7f6ad0073910 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.552+0000 7f6abf7fe700 1 -- 172.21.15.156:0/2026416402 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000f620 con 0x7f6ad0073910 2023-10-06T23:06:51.554 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.552+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad01a0f30 con 0x7f6ad0073910 2023-10-06T23:06:51.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.552+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad01a1340 con 0x7f6ad0073910 2023-10-06T23:06:51.555 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.553+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad01074f0 con 0x7f6ad0073910 2023-10-06T23:06:51.556 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.555+0000 7f6abf7fe700 1 -- 172.21.15.156:0/2026416402 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6ac00105d0 con 0x7f6ad0073910 2023-10-06T23:06:51.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.556+0000 7f6abf7fe700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6ab80a1500 0x7f6ab80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:06:51.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.556+0000 7f6abf7fe700 1 -- 172.21.15.156:0/2026416402 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f6ac00cb540 con 0x7f6ad0073910 2023-10-06T23:06:51.557 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.557+0000 7f6acdd9b700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6ab80a1500 0x7f6ab80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:06:51.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.557+0000 7f6acdd9b700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6ab80a1500 0x7f6ab80a39c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098e0 tx=0x7f6ac400b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:06:51.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.559+0000 7f6abf7fe700 1 -- 172.21.15.156:0/2026416402 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6ac0095d80 con 0x7f6ad0073910 2023-10-06T23:06:51.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:06:51.767+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ad002d370 con 0x7f6ab80a1500 2023-10-06T23:06:51.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:51 smithi190 ceph-mon[102658]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:06:52.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:51 smithi156 ceph-mon[102862]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:06:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:51 smithi008 ceph-mon[98532]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:06:52.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:52 smithi190 ceph-mon[102658]: osdmap e29: 4 total, 4 up, 4 in 2023-10-06T23:06:52.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:52 smithi190 ceph-mon[102658]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:06:52.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:06:52.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:06:52.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:52 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:52.976 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:52 smithi156 ceph-mon[102862]: osdmap e29: 4 total, 4 up, 4 in 2023-10-06T23:06:52.976 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:52 smithi156 ceph-mon[102862]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:06:52.976 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:06:52.976 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:06:52.977 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:52 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:53.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:52 smithi008 ceph-mon[98532]: osdmap e29: 4 total, 4 up, 4 in 2023-10-06T23:06:53.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:52 smithi008 ceph-mon[98532]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:06:53.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:06:53.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:06:53.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:52 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:06:53.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:53 smithi190 ceph-mon[102658]: osdmap e30: 4 total, 4 up, 4 in 2023-10-06T23:06:53.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:53 smithi190 ceph-mon[102658]: pgmap v112: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-06T23:06:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:53 smithi156 ceph-mon[102862]: osdmap e30: 4 total, 4 up, 4 in 2023-10-06T23:06:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:53 smithi156 ceph-mon[102862]: pgmap v112: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-06T23:06:54.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:53 smithi008 ceph-mon[98532]: osdmap e30: 4 total, 4 up, 4 in 2023-10-06T23:06:54.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:53 smithi008 ceph-mon[98532]: pgmap v112: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-06T23:06:55.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:54 smithi156 ceph-mon[102862]: from='client.? 172.21.15.156:0/50166578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]: dispatch 2023-10-06T23:06:55.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:54 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]: dispatch 2023-10-06T23:06:55.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:54 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]': finished 2023-10-06T23:06:55.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:54 smithi156 ceph-mon[102862]: osdmap e31: 5 total, 4 up, 5 in 2023-10-06T23:06:55.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:06:55.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:54 smithi008 ceph-mon[98532]: from='client.? 172.21.15.156:0/50166578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]: dispatch 2023-10-06T23:06:55.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:54 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]: dispatch 2023-10-06T23:06:55.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:54 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]': finished 2023-10-06T23:06:55.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:54 smithi008 ceph-mon[98532]: osdmap e31: 5 total, 4 up, 5 in 2023-10-06T23:06:55.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:06:55.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:54 smithi190 ceph-mon[102658]: from='client.? 172.21.15.156:0/50166578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]: dispatch 2023-10-06T23:06:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:54 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]: dispatch 2023-10-06T23:06:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:54 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7560640-14b6-458a-adfe-dae3821de4fe"}]': finished 2023-10-06T23:06:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:54 smithi190 ceph-mon[102658]: osdmap e31: 5 total, 4 up, 5 in 2023-10-06T23:06:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:06:56.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:55 smithi156 ceph-mon[102862]: pgmap v114: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-10-06T23:06:56.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:55 smithi156 ceph-mon[102862]: from='client.? 172.21.15.156:0/3151663681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:56.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:55 smithi008 ceph-mon[98532]: pgmap v114: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-10-06T23:06:56.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:55 smithi008 ceph-mon[98532]: from='client.? 172.21.15.156:0/3151663681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:56.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:55 smithi190 ceph-mon[102658]: pgmap v114: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-10-06T23:06:56.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:55 smithi190 ceph-mon[102658]: from='client.? 172.21.15.156:0/3151663681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:06:58.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:57 smithi156 ceph-mon[102862]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:06:58.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:57 smithi008 ceph-mon[98532]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:06:58.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:57 smithi190 ceph-mon[102658]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:07:00.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:06:59 smithi156 ceph-mon[102862]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:06:59 smithi008 ceph-mon[98532]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:06:59 smithi190 ceph-mon[102658]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:02.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:01 smithi156 ceph-mon[102862]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:01 smithi008 ceph-mon[98532]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:02.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:01 smithi190 ceph-mon[102658]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:03.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:02 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-06T23:07:03.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:02 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:03.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-06T23:07:03.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:03.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:02 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-06T23:07:03.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:02 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:04.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:03 smithi156 ceph-mon[102862]: Deploying daemon osd.4 on smithi156 2023-10-06T23:07:04.211 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:03 smithi156 ceph-mon[102862]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:04.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:03 smithi008 ceph-mon[98532]: Deploying daemon osd.4 on smithi156 2023-10-06T23:07:04.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:03 smithi008 ceph-mon[98532]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:04.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:03 smithi190 ceph-mon[102658]: Deploying daemon osd.4 on smithi156 2023-10-06T23:07:04.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:03 smithi190 ceph-mon[102658]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:06.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:05 smithi156 ceph-mon[102862]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:05 smithi008 ceph-mon[98532]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:06.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:05 smithi190 ceph-mon[102658]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:08.076 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:07 smithi156 ceph-mon[102862]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:08.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:07 smithi008 ceph-mon[98532]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:08.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:07 smithi190 ceph-mon[102658]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:09.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:09 smithi190 ceph-mon[102658]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:09.694 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:09.695 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:09.695 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:09.695 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:09 smithi156 ceph-mon[102862]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:09.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:09 smithi008 ceph-mon[98532]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:12.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:11 smithi156 ceph-mon[102862]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.196 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.195+0000 7f6abf7fe700 1 -- 172.21.15.156:0/2026416402 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6ad002d370 con 0x7f6ab80a1500 2023-10-06T23:07:12.197 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 4 on host 'smithi156' 2023-10-06T23:07:12.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6ab80a1500 msgr2=0x7f6ab80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6ab80a1500 0x7f6ab80a39c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098e0 tx=0x7f6ac400b260 comp rx=0 tx=0).stop 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 msgr2=0x7f6ad0198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 0x7f6ad0198df0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d980 tx=0x7f6ac000dc90 comp rx=0 tx=0).stop 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 shutdown_connections 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6ab80a1500 0x7f6ab80a39c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ad0108e40 0x7f6ad01a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ad0073910 0x7f6ad0198df0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 --2- 172.21.15.156:0/2026416402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ad0074ee0 0x7f6ad0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 >> 172.21.15.156:0/2026416402 conn(0x7f6ad00fc4d0 msgr2=0x7f6ad00fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:07:12.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 shutdown_connections 2023-10-06T23:07:12.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:07:12.197+0000 7f6ad4d8a700 1 -- 172.21.15.156:0/2026416402 wait complete. 2023-10-06T23:07:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:11 smithi008 ceph-mon[98532]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:11 smithi190 ceph-mon[102658]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:12.671 DEBUG:teuthology.orchestra.run.smithi156:osd.4> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-06T23:07:12.675 INFO:tasks.cephadm:Deploying osd.5 on smithi190 with /dev/vg_nvme/lv_3... 2023-10-06T23:07:12.675 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-06T23:07:12.772 INFO:journalctl@ceph.osd.4.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:07:13.429 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:07:13.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:13 smithi156 ceph-mon[102862]: from='osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-06T23:07:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:13 smithi156 ceph-mon[102862]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-06T23:07:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:13 smithi156 ceph-mon[102862]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:13.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:13 smithi190 ceph-mon[102658]: from='osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-06T23:07:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:13 smithi190 ceph-mon[102658]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-06T23:07:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:13 smithi190 ceph-mon[102658]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:13.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:13.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:13.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:13.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:13 smithi008 ceph-mon[98532]: from='osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-06T23:07:13.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:13 smithi008 ceph-mon[98532]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-06T23:07:13.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:13 smithi008 ceph-mon[98532]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:14.386 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:14 smithi190 ceph-mon[102658]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-06T23:07:14.387 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:14 smithi190 ceph-mon[102658]: osdmap e32: 5 total, 4 up, 5 in 2023-10-06T23:07:14.387 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:14 smithi190 ceph-mon[102658]: from='osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:07:14.387 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:14 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:14.387 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:14 smithi190 ceph-mon[102658]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:07:14.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:14 smithi156 ceph-mon[102862]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-06T23:07:14.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:14 smithi156 ceph-mon[102862]: osdmap e32: 5 total, 4 up, 5 in 2023-10-06T23:07:14.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:14 smithi156 ceph-mon[102862]: from='osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:07:14.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:14 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:14.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:14 smithi156 ceph-mon[102862]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:07:14.600 INFO:journalctl@ceph.osd.4.smithi156.stdout:Oct 06 23:07:14 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-4[115931]: 2023-10-06T23:07:14.183+0000 7f0c7d5f7700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T23:07:14.600 INFO:journalctl@ceph.osd.4.smithi156.stdout:Oct 06 23:07:14 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-4[115931]: 2023-10-06T23:07:14.191+0000 7f0c76be7700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:07:14.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:14 smithi008 ceph-mon[98532]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-06T23:07:14.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:14 smithi008 ceph-mon[98532]: osdmap e32: 5 total, 4 up, 5 in 2023-10-06T23:07:14.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:14 smithi008 ceph-mon[98532]: from='osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:07:14.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:14 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:14.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:14 smithi008 ceph-mon[98532]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:07:15.391 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-06T23:07:15.391 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-06T23:07:15.391 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2023-10-06T23:07:15.391 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2023-10-06T23:07:15.391 INFO:teuthology.orchestra.run.smithi190.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0468216 s, 224 MB/s 2023-10-06T23:07:15.391 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 2023-10-06T23:07:15.391 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2023-10-06T23:07:15.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:15 smithi190 ceph-mon[102658]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:07:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:15 smithi190 ceph-mon[102658]: osdmap e33: 5 total, 4 up, 5 in 2023-10-06T23:07:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:15 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:15 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:15 smithi190 ceph-mon[102658]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:15.573 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:15 smithi156 ceph-mon[102862]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:07:15.573 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:15 smithi156 ceph-mon[102862]: osdmap e33: 5 total, 4 up, 5 in 2023-10-06T23:07:15.573 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:15 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:15.574 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:15 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:15.574 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:15 smithi156 ceph-mon[102862]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:15 smithi008 ceph-mon[98532]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:07:15.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:15 smithi008 ceph-mon[98532]: osdmap e33: 5 total, 4 up, 5 in 2023-10-06T23:07:15.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:15 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:15.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:15 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:15.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:15 smithi008 ceph-mon[98532]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-06T23:07:15.807 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi190:vg_nvme/lv_3 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] boot 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: osdmap e34: 5 total, 5 up, 5 in 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:16.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:16.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:16.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:16.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:16 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] boot 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: osdmap e34: 5 total, 5 up, 5 in 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:16.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:16 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.537 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:07:16.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: osd.4 [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] boot 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: osdmap e34: 5 total, 5 up, 5 in 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:16.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:16.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:16.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:16.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:16.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:16 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:17.440 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:17 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi156 2023-10-06T23:07:17.440 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:17 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi156 to 8633M 2023-10-06T23:07:17.440 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:17 smithi190 ceph-mon[102658]: osdmap e35: 5 total, 5 up, 5 in 2023-10-06T23:07:17.440 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:17 smithi190 ceph-mon[102658]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:17 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi156 2023-10-06T23:07:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:17 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi156 to 8633M 2023-10-06T23:07:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:17 smithi156 ceph-mon[102862]: osdmap e35: 5 total, 5 up, 5 in 2023-10-06T23:07:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:17 smithi156 ceph-mon[102862]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:17.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:17 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi156 2023-10-06T23:07:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:17 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi156 to 8633M 2023-10-06T23:07:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:17 smithi008 ceph-mon[98532]: osdmap e35: 5 total, 5 up, 5 in 2023-10-06T23:07:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:17 smithi008 ceph-mon[98532]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:18.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 -- 172.21.15.190:0/3665370797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102b10 msgr2=0x7fd5001093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:18.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 --2- 172.21.15.190:0/3665370797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102b10 0x7fd5001093c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800b0a0 tx=0x7fd4f800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:07:18.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 -- 172.21.15.190:0/3665370797 shutdown_connections 2023-10-06T23:07:18.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 --2- 172.21.15.190:0/3665370797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102b10 0x7fd5001093c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:18.021 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 --2- 172.21.15.190:0/3665370797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd500100f70 0x7fd500101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:18.021 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 --2- 172.21.15.190:0/3665370797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd500102170 0x7fd5001025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:18.021 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 -- 172.21.15.190:0/3665370797 >> 172.21.15.190:0/3665370797 conn(0x7fd5000fc4d0 msgr2=0x7fd5000fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:07:18.021 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 -- 172.21.15.190:0/3665370797 shutdown_connections 2023-10-06T23:07:18.021 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.018+0000 7fd506c35700 1 -- 172.21.15.190:0/3665370797 wait complete. 2023-10-06T23:07:18.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.019+0000 7fd506c35700 1 Processor -- start 2023-10-06T23:07:18.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.019+0000 7fd506c35700 1 -- start start 2023-10-06T23:07:18.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd506c35700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd500100f70 0x7fd500198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:07:18.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd506c35700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102170 0x7fd500199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:07:18.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd506c35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd500102b10 0x7fd5001a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:07:18.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd506c35700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5001a09c0 con 0x7fd500102b10 2023-10-06T23:07:18.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd506c35700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5001a0b00 con 0x7fd500100f70 2023-10-06T23:07:18.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd506c35700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5001a0c90 con 0x7fd500102170 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd4fffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102170 0x7fd500199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd4fffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102170 0x7fd500199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:46250/0 (socket says 172.21.15.190:46250) 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd4fffff700 1 -- 172.21.15.190:0/3754856482 learned_addr learned my addr 172.21.15.190:0/3754856482 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd5051d2700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd500102b10 0x7fd5001a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd5049d1700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd500100f70 0x7fd500198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd4fffff700 1 -- 172.21.15.190:0/3754856482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd500100f70 msgr2=0x7fd500198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd4fffff700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd500100f70 0x7fd500198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd4fffff700 1 -- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd500102b10 msgr2=0x7fd5001a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd4fffff700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd500102b10 0x7fd5001a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd4fffff700 1 -- 172.21.15.190:0/3754856482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8009d00 con 0x7fd500102170 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.020+0000 7fd5049d1700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd500100f70 0x7fd500198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:07:18.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.021+0000 7fd4fffff700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102170 0x7fd500199370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00e9d0 tx=0x7fd4ec00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:07:18.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.021+0000 7fd4fdffb700 1 -- 172.21.15.190:0/3754856482 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec009790 con 0x7fd500102170 2023-10-06T23:07:18.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.021+0000 7fd4fdffb700 1 -- 172.21.15.190:0/3754856482 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd4ec00cbd0 con 0x7fd500102170 2023-10-06T23:07:18.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.021+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5001a0f70 con 0x7fd500102170 2023-10-06T23:07:18.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.021+0000 7fd4fdffb700 1 -- 172.21.15.190:0/3754856482 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec018680 con 0x7fd500102170 2023-10-06T23:07:18.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.021+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5001a1430 con 0x7fd500102170 2023-10-06T23:07:18.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.022+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd500193420 con 0x7fd500102170 2023-10-06T23:07:18.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.024+0000 7fd4fdffb700 1 -- 172.21.15.190:0/3754856482 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd4ec00cd40 con 0x7fd500102170 2023-10-06T23:07:18.027 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.026+0000 7fd4fdffb700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4f00a1500 0x7fd4f00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:07:18.027 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.026+0000 7fd4fdffb700 1 -- 172.21.15.190:0/3754856482 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fd4ec014070 con 0x7fd500102170 2023-10-06T23:07:18.028 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.026+0000 7fd5049d1700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4f00a1500 0x7fd4f00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:07:18.028 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.027+0000 7fd5049d1700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4f00a1500 0x7fd4f00a39c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd500101fd0 tx=0x7fd4f4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:07:18.030 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.028+0000 7fd4fdffb700 1 -- 172.21.15.190:0/3754856482 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd4ec0968e0 con 0x7fd500102170 2023-10-06T23:07:18.234 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:18.233+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5000008d0 con 0x7fd4f00a1500 2023-10-06T23:07:19.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:18 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:07:19.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:18 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:07:19.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:18 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:19.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:18 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:07:19.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:18 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:07:19.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:18 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:19.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:18 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:07:19.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:18 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:07:19.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:18 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:19.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:19 smithi190 ceph-mon[102658]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:07:19.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:19 smithi190 ceph-mon[102658]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:20.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:19 smithi156 ceph-mon[102862]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:07:20.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:19 smithi156 ceph-mon[102862]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:20.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:19 smithi008 ceph-mon[98532]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:07:20.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:19 smithi008 ceph-mon[98532]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:21 smithi156 ceph-mon[102862]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:21 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/2880824568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]: dispatch 2023-10-06T23:07:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:21 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]: dispatch 2023-10-06T23:07:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:21 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]': finished 2023-10-06T23:07:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:21 smithi156 ceph-mon[102862]: osdmap e36: 6 total, 5 up, 6 in 2023-10-06T23:07:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:22.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:21 smithi008 ceph-mon[98532]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:22.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:21 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/2880824568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]: dispatch 2023-10-06T23:07:22.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:21 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]: dispatch 2023-10-06T23:07:22.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:21 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]': finished 2023-10-06T23:07:22.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:21 smithi008 ceph-mon[98532]: osdmap e36: 6 total, 5 up, 6 in 2023-10-06T23:07:22.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:22.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:21 smithi190 ceph-mon[102658]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:21 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/2880824568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]: dispatch 2023-10-06T23:07:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:21 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]: dispatch 2023-10-06T23:07:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:21 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c9e854b-52ad-4f73-a354-e0ca49b57389"}]': finished 2023-10-06T23:07:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:21 smithi190 ceph-mon[102658]: osdmap e36: 6 total, 5 up, 6 in 2023-10-06T23:07:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:22 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/1022617300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:07:23.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:22 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/1022617300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:07:23.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:22 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/1022617300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:07:24.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:23 smithi156 ceph-mon[102862]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:24.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:23 smithi008 ceph-mon[98532]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:24.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:23 smithi190 ceph-mon[102658]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:25 smithi156 ceph-mon[102862]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:26.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:25 smithi008 ceph-mon[98532]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:25 smithi190 ceph-mon[102658]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:27.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:27 smithi190 ceph-mon[102658]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:28.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:27 smithi156 ceph-mon[102862]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:27 smithi008 ceph-mon[98532]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:28.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:28 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-06T23:07:28.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:28 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:29.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:28 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-06T23:07:29.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:28 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:29.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:28 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-06T23:07:29.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:28 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:30.078 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:29 smithi190 ceph-mon[102658]: Deploying daemon osd.5 on smithi190 2023-10-06T23:07:30.078 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:29 smithi190 ceph-mon[102658]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:30.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:29 smithi156 ceph-mon[102862]: Deploying daemon osd.5 on smithi190 2023-10-06T23:07:30.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:29 smithi156 ceph-mon[102862]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:30.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:29 smithi008 ceph-mon[98532]: Deploying daemon osd.5 on smithi190 2023-10-06T23:07:30.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:29 smithi008 ceph-mon[98532]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:32.058 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:31 smithi190 ceph-mon[102658]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:32.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:31 smithi156 ceph-mon[102862]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:31 smithi008 ceph-mon[98532]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:34.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:33 smithi190 ceph-mon[102658]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:33 smithi156 ceph-mon[102862]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:34.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:33 smithi008 ceph-mon[98532]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:36.012 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:36.012 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:36.012 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:36.012 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:35 smithi190 ceph-mon[102658]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:36.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:36.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:36.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:36.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:35 smithi156 ceph-mon[102862]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:36.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:35 smithi008 ceph-mon[98532]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:38.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:37 smithi156 ceph-mon[102862]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:38.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:38.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:38.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:37 smithi008 ceph-mon[98532]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:38.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:37 smithi190 ceph-mon[102658]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:38.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:38.366 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.364+0000 7fd4fdffb700 1 -- 172.21.15.190:0/3754856482 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd5000008d0 con 0x7fd4f00a1500 2023-10-06T23:07:38.366 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 5 on host 'smithi190' 2023-10-06T23:07:38.369 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.366+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4f00a1500 msgr2=0x7fd4f00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:38.369 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.366+0000 7fd506c35700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4f00a1500 0x7fd4f00a39c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd500101fd0 tx=0x7fd4f4009260 comp rx=0 tx=0).stop 2023-10-06T23:07:38.369 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.366+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102170 msgr2=0x7fd500199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:38.370 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.366+0000 7fd506c35700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102170 0x7fd500199370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00e9d0 tx=0x7fd4ec00ece0 comp rx=0 tx=0).stop 2023-10-06T23:07:38.370 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.367+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 shutdown_connections 2023-10-06T23:07:38.370 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.367+0000 7fd506c35700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4f00a1500 0x7fd4f00a39c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:38.370 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.367+0000 7fd506c35700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd500102b10 0x7fd5001a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:38.370 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.367+0000 7fd506c35700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd500100f70 0x7fd500198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:38.370 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.367+0000 7fd506c35700 1 --2- 172.21.15.190:0/3754856482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd500102170 0x7fd500199370 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:38.371 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.367+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 >> 172.21.15.190:0/3754856482 conn(0x7fd5000fc4d0 msgr2=0x7fd500107aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:07:38.371 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.367+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 shutdown_connections 2023-10-06T23:07:38.371 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:07:38.367+0000 7fd506c35700 1 -- 172.21.15.190:0/3754856482 wait complete. 2023-10-06T23:07:38.859 DEBUG:teuthology.orchestra.run.smithi190:osd.5> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-06T23:07:38.863 INFO:tasks.cephadm:Deploying osd.6 on smithi008 with /dev/vg_nvme/lv_2... 2023-10-06T23:07:38.864 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-06T23:07:38.939 INFO:journalctl@ceph.osd.5.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:07:39.356 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:39.357 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:39.357 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:39.357 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:39 smithi008 ceph-mon[98532]: from='osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-06T23:07:39.357 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:39 smithi008 ceph-mon[98532]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-06T23:07:39.357 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:39 smithi008 ceph-mon[98532]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:39.632 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:07:39.636 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:39.637 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:39.637 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:39.637 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:39 smithi190 ceph-mon[102658]: from='osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-06T23:07:39.637 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:39 smithi190 ceph-mon[102658]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-06T23:07:39.637 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:39 smithi190 ceph-mon[102658]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:39.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:39 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:39.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:39 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:39.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:39 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:07:39.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:39 smithi156 ceph-mon[102862]: from='osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-06T23:07:39.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:39 smithi156 ceph-mon[102862]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-06T23:07:39.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:39 smithi156 ceph-mon[102862]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:40 smithi190 ceph-mon[102658]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-06T23:07:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:40 smithi190 ceph-mon[102658]: osdmap e37: 6 total, 5 up, 6 in 2023-10-06T23:07:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:40 smithi190 ceph-mon[102658]: from='osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:07:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:40 smithi190 ceph-mon[102658]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:07:40.444 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:07:40 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:07:40.372+0000 7fa78ae34700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T23:07:40.444 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:07:40 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:07:40.380+0000 7fa783c23700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:07:40.565 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:40 smithi008 ceph-mon[98532]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-06T23:07:40.565 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:40 smithi008 ceph-mon[98532]: osdmap e37: 6 total, 5 up, 6 in 2023-10-06T23:07:40.565 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:40 smithi008 ceph-mon[98532]: from='osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:07:40.565 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:40.565 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:40 smithi008 ceph-mon[98532]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:07:40.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:40 smithi156 ceph-mon[102862]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-06T23:07:40.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:40 smithi156 ceph-mon[102862]: osdmap e37: 6 total, 5 up, 6 in 2023-10-06T23:07:40.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:40 smithi156 ceph-mon[102862]: from='osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:07:40.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:40.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:40 smithi156 ceph-mon[102862]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:07:41.621 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-06T23:07:41.621 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-06T23:07:41.622 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-06T23:07:41.622 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-06T23:07:41.622 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0299683 s, 350 MB/s 2023-10-06T23:07:41.622 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-06T23:07:41.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:41 smithi008 ceph-mon[98532]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:07:41.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:41 smithi008 ceph-mon[98532]: osdmap e38: 6 total, 5 up, 6 in 2023-10-06T23:07:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:41 smithi008 ceph-mon[98532]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:41.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:41 smithi190 ceph-mon[102658]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:07:41.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:41 smithi190 ceph-mon[102658]: osdmap e38: 6 total, 5 up, 6 in 2023-10-06T23:07:41.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:41.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:41.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:41 smithi190 ceph-mon[102658]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:41.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:41 smithi156 ceph-mon[102862]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:07:41.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:41 smithi156 ceph-mon[102862]: osdmap e38: 6 total, 5 up, 6 in 2023-10-06T23:07:41.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:41.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:41.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:41 smithi156 ceph-mon[102862]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-06T23:07:42.112 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_2 2023-10-06T23:07:42.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:07:42.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:07:42.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:42.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] boot 2023-10-06T23:07:42.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: osdmap e39: 6 total, 6 up, 6 in 2023-10-06T23:07:42.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:42.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: osdmap e40: 6 total, 6 up, 6 in 2023-10-06T23:07:42.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:42.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:42.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:42.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:42.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] boot 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: osdmap e39: 6 total, 6 up, 6 in 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: osdmap e40: 6 total, 6 up, 6 in 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:42.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:42.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:42.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:42.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: osd.5 [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] boot 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: osdmap e39: 6 total, 6 up, 6 in 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: osdmap e40: 6 total, 6 up, 6 in 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:42.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:07:42.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:42.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:07:42.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:07:42.856 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:07:44.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:43 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi190 2023-10-06T23:07:44.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:43 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi190 to 8633M 2023-10-06T23:07:44.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:43 smithi156 ceph-mon[102862]: osdmap e41: 6 total, 6 up, 6 in 2023-10-06T23:07:44.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:43 smithi156 ceph-mon[102862]: pgmap v148: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:07:44.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:43 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi190 2023-10-06T23:07:44.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:43 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi190 to 8633M 2023-10-06T23:07:44.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:43 smithi008 ceph-mon[98532]: osdmap e41: 6 total, 6 up, 6 in 2023-10-06T23:07:44.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:43 smithi008 ceph-mon[98532]: pgmap v148: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:07:44.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:43 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi190 2023-10-06T23:07:44.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:43 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi190 to 8633M 2023-10-06T23:07:44.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:43 smithi190 ceph-mon[102658]: osdmap e41: 6 total, 6 up, 6 in 2023-10-06T23:07:44.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:43 smithi190 ceph-mon[102658]: pgmap v148: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:07:44.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 -- 172.21.15.8:0/4168865645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102170 msgr2=0x7fce6c1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 --2- 172.21.15.8:0/4168865645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102170 0x7fce6c1025d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0099c0 tx=0x7fce5c009cd0 comp rx=0 tx=0).stop 2023-10-06T23:07:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 -- 172.21.15.8:0/4168865645 shutdown_connections 2023-10-06T23:07:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 --2- 172.21.15.8:0/4168865645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c102b10 0x7fce6c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 --2- 172.21.15.8:0/4168865645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6c100f70 0x7fce6c101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 --2- 172.21.15.8:0/4168865645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102170 0x7fce6c1025d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 -- 172.21.15.8:0/4168865645 >> 172.21.15.8:0/4168865645 conn(0x7fce6c0fc4d0 msgr2=0x7fce6c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:07:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 -- 172.21.15.8:0/4168865645 shutdown_connections 2023-10-06T23:07:44.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.456+0000 7fce73d8f700 1 -- 172.21.15.8:0/4168865645 wait complete. 2023-10-06T23:07:44.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.457+0000 7fce73d8f700 1 Processor -- start 2023-10-06T23:07:44.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.457+0000 7fce73d8f700 1 -- start start 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce73d8f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6c100f70 0x7fce6c074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce73d8f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c102170 0x7fce6c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce73d8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102b10 0x7fce6c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce73d8f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c073f60 con 0x7fce6c102b10 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce73d8f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c0740d0 con 0x7fce6c102170 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce73d8f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c1a0ba0 con 0x7fce6c100f70 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce71b2b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6c100f70 0x7fce6c074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce7232c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102b10 0x7fce6c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce71b2b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6c100f70 0x7fce6c074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:33046/0 (socket says 172.21.15.8:33046) 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce71b2b700 1 -- 172.21.15.8:0/1312572167 learned_addr learned my addr 172.21.15.8:0/1312572167 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:07:44.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.458+0000 7fce7132a700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c102170 0x7fce6c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:07:44.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce7232c700 1 -- 172.21.15.8:0/1312572167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6c100f70 msgr2=0x7fce6c074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce7232c700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6c100f70 0x7fce6c074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce7232c700 1 -- 172.21.15.8:0/1312572167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c102170 msgr2=0x7fce6c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce7232c700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c102170 0x7fce6c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce7232c700 1 -- 172.21.15.8:0/1312572167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c0095f0 con 0x7fce6c102b10 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce7232c700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102b10 0x7fce6c0737e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce64007f10 tx=0x7fce6400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce62ffd700 1 -- 172.21.15.8:0/1312572167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6400ddd0 con 0x7fce6c102b10 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce62ffd700 1 -- 172.21.15.8:0/1312572167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce6400f040 con 0x7fce6c102b10 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce62ffd700 1 -- 172.21.15.8:0/1312572167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640059c0 con 0x7fce6c102b10 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c1a0e80 con 0x7fce6c102b10 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.459+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c1a12a0 con 0x7fce6c102b10 2023-10-06T23:07:44.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.460+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c10c620 con 0x7fce6c102b10 2023-10-06T23:07:44.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.462+0000 7fce62ffd700 1 -- 172.21.15.8:0/1312572167 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fce64005000 con 0x7fce6c102b10 2023-10-06T23:07:44.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.464+0000 7fce62ffd700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce580a1480 0x7fce580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:07:44.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.464+0000 7fce62ffd700 1 -- 172.21.15.8:0/1312572167 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4533+0+0 (secure 0 0 0) 0x7fce640cbea0 con 0x7fce6c102b10 2023-10-06T23:07:44.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.464+0000 7fce71b2b700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce580a1480 0x7fce580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:07:44.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.464+0000 7fce71b2b700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce580a1480 0x7fce580a3940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce6800ace0 tx=0x7fce6800a430 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:07:44.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.467+0000 7fce62ffd700 1 -- 172.21.15.8:0/1312572167 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fce64096320 con 0x7fce6c102b10 2023-10-06T23:07:44.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:07:44.687+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fce6c0612f0 con 0x7fce580a1480 2023-10-06T23:07:45.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:44 smithi156 ceph-mon[102862]: osdmap e42: 6 total, 6 up, 6 in 2023-10-06T23:07:45.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:07:45.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:07:45.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:45.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:44 smithi008 ceph-mon[98532]: osdmap e42: 6 total, 6 up, 6 in 2023-10-06T23:07:45.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:44 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:07:45.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:44 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:07:45.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:44 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:45.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:44 smithi190 ceph-mon[102658]: osdmap e42: 6 total, 6 up, 6 in 2023-10-06T23:07:45.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:44 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:07:45.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:44 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:07:45.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:44 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:46.084 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:45 smithi008 ceph-mon[98532]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:07:46.084 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:45 smithi008 ceph-mon[98532]: osdmap e43: 6 total, 6 up, 6 in 2023-10-06T23:07:46.084 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:45 smithi008 ceph-mon[98532]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:07:46.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:45 smithi156 ceph-mon[102862]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:07:46.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:45 smithi156 ceph-mon[102862]: osdmap e43: 6 total, 6 up, 6 in 2023-10-06T23:07:46.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:45 smithi156 ceph-mon[102862]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:07:46.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:45 smithi190 ceph-mon[102658]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:07:46.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:45 smithi190 ceph-mon[102658]: osdmap e43: 6 total, 6 up, 6 in 2023-10-06T23:07:46.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:45 smithi190 ceph-mon[102658]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:07:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:47 smithi156 ceph-mon[102862]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2023-10-06T23:07:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:47 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4064728339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d19254b-4665-4044-806b-2db2a15ece1c"}]: dispatch 2023-10-06T23:07:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:47 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4064728339' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d19254b-4665-4044-806b-2db2a15ece1c"}]': finished 2023-10-06T23:07:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:47 smithi156 ceph-mon[102862]: osdmap e44: 7 total, 6 up, 7 in 2023-10-06T23:07:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:07:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:47 smithi008 ceph-mon[98532]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2023-10-06T23:07:48.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:47 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4064728339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d19254b-4665-4044-806b-2db2a15ece1c"}]: dispatch 2023-10-06T23:07:48.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:47 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4064728339' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d19254b-4665-4044-806b-2db2a15ece1c"}]': finished 2023-10-06T23:07:48.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:47 smithi008 ceph-mon[98532]: osdmap e44: 7 total, 6 up, 7 in 2023-10-06T23:07:48.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:07:48.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:47 smithi190 ceph-mon[102658]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2023-10-06T23:07:48.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:47 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4064728339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d19254b-4665-4044-806b-2db2a15ece1c"}]: dispatch 2023-10-06T23:07:48.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:47 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4064728339' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d19254b-4665-4044-806b-2db2a15ece1c"}]': finished 2023-10-06T23:07:48.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:47 smithi190 ceph-mon[102658]: osdmap e44: 7 total, 6 up, 7 in 2023-10-06T23:07:48.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:07:49.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:48 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3564922661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:07:49.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:48 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3564922661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:07:49.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:48 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3564922661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:07:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:49 smithi156 ceph-mon[102862]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:07:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:49 smithi008 ceph-mon[98532]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:07:50.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:49 smithi190 ceph-mon[102658]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:07:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:51 smithi008 ceph-mon[98532]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-06T23:07:52.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:51 smithi156 ceph-mon[102862]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-06T23:07:52.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:51 smithi190 ceph-mon[102658]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-10-06T23:07:54.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:53 smithi008 ceph-mon[98532]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-06T23:07:54.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:53 smithi156 ceph-mon[102862]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-06T23:07:54.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:53 smithi190 ceph-mon[102658]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-06T23:07:56.239 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:55 smithi008 ceph-mon[98532]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-06T23:07:56.239 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-06T23:07:56.239 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:56.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:55 smithi156 ceph-mon[102862]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-06T23:07:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-06T23:07:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:55 smithi190 ceph-mon[102658]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-06T23:07:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-06T23:07:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:07:57.228 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:56 smithi008 ceph-mon[98532]: Deploying daemon osd.6 on smithi008 2023-10-06T23:07:57.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:56 smithi156 ceph-mon[102862]: Deploying daemon osd.6 on smithi008 2023-10-06T23:07:57.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:56 smithi190 ceph-mon[102658]: Deploying daemon osd.6 on smithi008 2023-10-06T23:07:58.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:57 smithi156 ceph-mon[102862]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:07:58.378 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:57 smithi008 ceph-mon[98532]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:07:58.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:57 smithi190 ceph-mon[102658]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:00.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:07:59 smithi008 ceph-mon[98532]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:00.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:07:59 smithi156 ceph-mon[102862]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:07:59 smithi190 ceph-mon[102658]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:02.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:01 smithi008 ceph-mon[98532]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:02.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:02.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:02.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:02.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:01 smithi156 ceph-mon[102862]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:02.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:01 smithi190 ceph-mon[102658]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:02.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:02.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:02.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:04.319 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:03 smithi008 ceph-mon[98532]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:04.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:03 smithi156 ceph-mon[102862]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:04.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:03 smithi190 ceph-mon[102658]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:04.799 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 6 on host 'smithi008' 2023-10-06T23:08:04.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.797+0000 7fce62ffd700 1 -- 172.21.15.8:0/1312572167 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fce6c0612f0 con 0x7fce580a1480 2023-10-06T23:08:04.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.800+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce580a1480 msgr2=0x7fce580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:04.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.800+0000 7fce73d8f700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce580a1480 0x7fce580a3940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce6800ace0 tx=0x7fce6800a430 comp rx=0 tx=0).stop 2023-10-06T23:08:04.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102b10 msgr2=0x7fce6c0737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:04.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102b10 0x7fce6c0737e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce64007f10 tx=0x7fce6400d3b0 comp rx=0 tx=0).stop 2023-10-06T23:08:04.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 shutdown_connections 2023-10-06T23:08:04.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fce580a1480 0x7fce580a3940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:04.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce6c102b10 0x7fce6c0737e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:04.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6c100f70 0x7fce6c074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:04.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 --2- 172.21.15.8:0/1312572167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c102170 0x7fce6c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:04.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 >> 172.21.15.8:0/1312572167 conn(0x7fce6c0fc4d0 msgr2=0x7fce6c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:08:04.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 shutdown_connections 2023-10-06T23:08:04.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:08:04.801+0000 7fce73d8f700 1 -- 172.21.15.8:0/1312572167 wait complete. 2023-10-06T23:08:05.372 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.372 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.372 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:05.373 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:05.373 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.373 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.373 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.373 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:05.373 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:05 smithi008 ceph-mon[98532]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:05.383 DEBUG:teuthology.orchestra.run.smithi008:osd.6> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-06T23:08:05.390 INFO:tasks.cephadm:Deploying osd.7 on smithi156 with /dev/vg_nvme/lv_2... 2023-10-06T23:08:05.390 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-06T23:08:05.475 INFO:journalctl@ceph.osd.6.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:05 smithi156 ceph-mon[102862]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:05 smithi190 ceph-mon[102658]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:06.132 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:08:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:06 smithi008 ceph-mon[98532]: from='osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-06T23:08:06.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:06 smithi008 ceph-mon[98532]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-06T23:08:06.549 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:06 smithi156 ceph-mon[102862]: from='osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-06T23:08:06.549 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:06 smithi156 ceph-mon[102862]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-06T23:08:06.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:06 smithi190 ceph-mon[102658]: from='osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-06T23:08:06.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:06 smithi190 ceph-mon[102658]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-06T23:08:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:07 smithi156 ceph-mon[102862]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-06T23:08:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:07 smithi156 ceph-mon[102862]: osdmap e45: 7 total, 6 up, 7 in 2023-10-06T23:08:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:07 smithi156 ceph-mon[102862]: from='osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:08:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:07 smithi156 ceph-mon[102862]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:08:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:07 smithi156 ceph-mon[102862]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:07.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:07 smithi008 ceph-mon[98532]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-06T23:08:07.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:07 smithi008 ceph-mon[98532]: osdmap e45: 7 total, 6 up, 7 in 2023-10-06T23:08:07.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:07.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:07 smithi008 ceph-mon[98532]: from='osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:08:07.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:07 smithi008 ceph-mon[98532]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:08:07.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:07 smithi008 ceph-mon[98532]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:07.647 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:08:07 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:08:07.264+0000 7f46d67a0700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T23:08:07.647 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:08:07 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:08:07.277+0000 7f46d2595700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:08:07.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:07 smithi190 ceph-mon[102658]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-06T23:08:07.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:07 smithi190 ceph-mon[102658]: osdmap e45: 7 total, 6 up, 7 in 2023-10-06T23:08:07.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:07.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:07 smithi190 ceph-mon[102658]: from='osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:08:07.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:07 smithi190 ceph-mon[102658]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:08:07.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:07 smithi190 ceph-mon[102658]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-06T23:08:08.075 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-06T23:08:08.075 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-06T23:08:08.075 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-10-06T23:08:08.075 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-10-06T23:08:08.075 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0312109 s, 336 MB/s 2023-10-06T23:08:08.075 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-10-06T23:08:08.506 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:08 smithi156 ceph-mon[102862]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:08:08.506 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:08 smithi156 ceph-mon[102862]: osdmap e46: 7 total, 6 up, 7 in 2023-10-06T23:08:08.506 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:08 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:08.506 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:08 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:08.509 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi156:vg_nvme/lv_2 2023-10-06T23:08:08.544 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:08 smithi008 ceph-mon[98532]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:08:08.544 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:08 smithi008 ceph-mon[98532]: osdmap e46: 7 total, 6 up, 7 in 2023-10-06T23:08:08.545 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:08 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:08.545 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:08 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:08.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:08 smithi190 ceph-mon[102658]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:08:08.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:08 smithi190 ceph-mon[102658]: osdmap e46: 7 total, 6 up, 7 in 2023-10-06T23:08:08.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:08 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:08.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:08 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:09.244 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:08:09.537 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:08:09.537 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:08:09.537 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] boot 2023-10-06T23:08:09.537 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: osdmap e47: 7 total, 7 up, 7 in 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi008 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi008 to 5757M 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:09.538 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:09.539 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:08:09.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:08:09.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] boot 2023-10-06T23:08:09.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: osdmap e47: 7 total, 7 up, 7 in 2023-10-06T23:08:09.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:09.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi008 2023-10-06T23:08:09.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi008 to 5757M 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:09.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:08:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:08:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: osd.6 [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] boot 2023-10-06T23:08:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: osdmap e47: 7 total, 7 up, 7 in 2023-10-06T23:08:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-06T23:08:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi008 2023-10-06T23:08:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi008 to 5757M 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:09.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:10.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:10 smithi156 ceph-mon[102862]: osdmap e48: 7 total, 7 up, 7 in 2023-10-06T23:08:10.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.636+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2858176049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588102b10 msgr2=0x7fb5881093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:10.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.636+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2858176049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588102b10 0x7fb5881093c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb58000b0d0 tx=0x7fb58000b3e0 comp rx=0 tx=0).stop 2023-10-06T23:08:10.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.636+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2858176049 shutdown_connections 2023-10-06T23:08:10.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.636+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2858176049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb588100f70 0x7fb588101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:10.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.636+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2858176049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588102b10 0x7fb5881093c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:10.638 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.636+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2858176049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588102170 0x7fb5881025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:10.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.636+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2858176049 >> 172.21.15.156:0/2858176049 conn(0x7fb5880fc4d0 msgr2=0x7fb5880fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:08:10.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.637+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2858176049 shutdown_connections 2023-10-06T23:08:10.639 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.637+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2858176049 wait complete. 2023-10-06T23:08:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb58d8d7700 1 Processor -- start 2023-10-06T23:08:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb58d8d7700 1 -- start start 2023-10-06T23:08:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb58d8d7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588100f70 0x7fb588196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:08:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb58d8d7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588102170 0x7fb588197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:08:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb58d8d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb588102b10 0x7fb58819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:08:10.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb58d8d7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58819e790 con 0x7fb588102b10 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb58d8d7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58819e8d0 con 0x7fb588100f70 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb58d8d7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58819ea90 con 0x7fb588102170 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb586ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588100f70 0x7fb588196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb586ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588100f70 0x7fb588196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50994/0 (socket says 172.21.15.156:50994) 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb586ffd700 1 -- 172.21.15.156:0/2277819251 learned_addr learned my addr 172.21.15.156:0/2277819251 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb5867fc700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588102170 0x7fb588197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.638+0000 7fb5877fe700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb588102b10 0x7fb58819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb586ffd700 1 -- 172.21.15.156:0/2277819251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588102170 msgr2=0x7fb588197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb586ffd700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588102170 0x7fb588197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb586ffd700 1 -- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb588102b10 msgr2=0x7fb58819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb586ffd700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb588102b10 0x7fb58819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:10.641 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb586ffd700 1 -- 172.21.15.156:0/2277819251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580009d00 con 0x7fb588100f70 2023-10-06T23:08:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb586ffd700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588100f70 0x7fb588196c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb57800e970 tx=0x7fb57800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:08:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb58c8d5700 1 -- 172.21.15.156:0/2277819251 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578009790 con 0x7fb588100f70 2023-10-06T23:08:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58819ed70 con 0x7fb588100f70 2023-10-06T23:08:10.642 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb58c8d5700 1 -- 172.21.15.156:0/2277819251 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb57800c7e0 con 0x7fb588100f70 2023-10-06T23:08:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb58c8d5700 1 -- 172.21.15.156:0/2277819251 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578003bd0 con 0x7fb588100f70 2023-10-06T23:08:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.639+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58819f200 con 0x7fb588100f70 2023-10-06T23:08:10.643 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.640+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb588108560 con 0x7fb588100f70 2023-10-06T23:08:10.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:10 smithi008 ceph-mon[98532]: osdmap e48: 7 total, 7 up, 7 in 2023-10-06T23:08:10.645 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.644+0000 7fb58c8d5700 1 -- 172.21.15.156:0/2277819251 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb57800c950 con 0x7fb588100f70 2023-10-06T23:08:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.645+0000 7fb58c8d5700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5700a1480 0x7fb5700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:08:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.645+0000 7fb58c8d5700 1 -- 172.21.15.156:0/2277819251 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fb578014070 con 0x7fb588100f70 2023-10-06T23:08:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.646+0000 7fb5867fc700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5700a1480 0x7fb5700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:08:10.647 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.646+0000 7fb5867fc700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5700a1480 0x7fb5700a3940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb57c005950 tx=0x7fb57c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:08:10.648 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.647+0000 7fb58c8d5700 1 -- 172.21.15.156:0/2277819251 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb578096620 con 0x7fb588100f70 2023-10-06T23:08:10.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:10 smithi190 ceph-mon[102658]: osdmap e48: 7 total, 7 up, 7 in 2023-10-06T23:08:10.856 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:10.855+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb58802d2b0 con 0x7fb5700a1480 2023-10-06T23:08:11.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:11 smithi156 ceph-mon[102862]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:08:11.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:08:11.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:08:11.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:11.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:11 smithi156 ceph-mon[102862]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:11.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:11 smithi008 ceph-mon[98532]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:08:11.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:08:11.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:08:11.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:11.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:11 smithi008 ceph-mon[98532]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:11.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:11 smithi190 ceph-mon[102658]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:08:11.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:08:11.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:08:11.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:11.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:11 smithi190 ceph-mon[102658]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:13 smithi156 ceph-mon[102862]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:13 smithi156 ceph-mon[102862]: from='client.? 172.21.15.156:0/292171951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]: dispatch 2023-10-06T23:08:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:13 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]: dispatch 2023-10-06T23:08:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:13 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]': finished 2023-10-06T23:08:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:13 smithi156 ceph-mon[102862]: osdmap e49: 8 total, 7 up, 8 in 2023-10-06T23:08:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:13 smithi008 ceph-mon[98532]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:13 smithi008 ceph-mon[98532]: from='client.? 172.21.15.156:0/292171951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]: dispatch 2023-10-06T23:08:14.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:13 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]: dispatch 2023-10-06T23:08:14.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:13 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]': finished 2023-10-06T23:08:14.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:13 smithi008 ceph-mon[98532]: osdmap e49: 8 total, 7 up, 8 in 2023-10-06T23:08:14.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:13 smithi190 ceph-mon[102658]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:13 smithi190 ceph-mon[102658]: from='client.? 172.21.15.156:0/292171951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]: dispatch 2023-10-06T23:08:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:13 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]: dispatch 2023-10-06T23:08:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:13 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0631aa31-44e8-4f3b-8306-b7c9d5a64d02"}]': finished 2023-10-06T23:08:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:13 smithi190 ceph-mon[102658]: osdmap e49: 8 total, 7 up, 8 in 2023-10-06T23:08:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:15.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:14 smithi156 ceph-mon[102862]: from='client.? 172.21.15.156:0/1688231052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:08:15.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:14 smithi008 ceph-mon[98532]: from='client.? 172.21.15.156:0/1688231052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:08:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:14 smithi190 ceph-mon[102658]: from='client.? 172.21.15.156:0/1688231052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:08:16.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:15 smithi156 ceph-mon[102862]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:15 smithi008 ceph-mon[98532]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:15 smithi190 ceph-mon[102658]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:18.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:17 smithi156 ceph-mon[102862]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:18.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:17 smithi008 ceph-mon[98532]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:18.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:17 smithi190 ceph-mon[102658]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:20.279 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:19 smithi156 ceph-mon[102862]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:20.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:19 smithi008 ceph-mon[98532]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:19 smithi190 ceph-mon[102658]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:22.272 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:21 smithi156 ceph-mon[102862]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:22.273 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-06T23:08:22.273 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:22.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:21 smithi008 ceph-mon[98532]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:22.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-06T23:08:22.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:21 smithi190 ceph-mon[102658]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-06T23:08:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:23.328 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:22 smithi156 ceph-mon[102862]: Deploying daemon osd.7 on smithi156 2023-10-06T23:08:23.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:22 smithi008 ceph-mon[98532]: Deploying daemon osd.7 on smithi156 2023-10-06T23:08:23.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:22 smithi190 ceph-mon[102658]: Deploying daemon osd.7 on smithi156 2023-10-06T23:08:24.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:23 smithi156 ceph-mon[102862]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:24.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:23 smithi008 ceph-mon[98532]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:24.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:23 smithi190 ceph-mon[102658]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:26.315 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:25 smithi156 ceph-mon[102862]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:26.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:25 smithi008 ceph-mon[98532]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:25 smithi190 ceph-mon[102658]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:28.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:27 smithi156 ceph-mon[102862]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:28.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:28.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:28.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:27 smithi008 ceph-mon[98532]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:28.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:28.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:28.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:27 smithi190 ceph-mon[102658]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:30.254 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:29 smithi156 ceph-mon[102862]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:29 smithi008 ceph-mon[98532]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:30.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:29 smithi190 ceph-mon[102658]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:30.831 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 7 on host 'smithi156' 2023-10-06T23:08:30.831 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.829+0000 7fb58c8d5700 1 -- 172.21.15.156:0/2277819251 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb58802d2b0 con 0x7fb5700a1480 2023-10-06T23:08:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5700a1480 msgr2=0x7fb5700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5700a1480 0x7fb5700a3940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb57c005950 tx=0x7fb57c00b410 comp rx=0 tx=0).stop 2023-10-06T23:08:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588100f70 msgr2=0x7fb588196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588100f70 0x7fb588196c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb57800e970 tx=0x7fb57800ec80 comp rx=0 tx=0).stop 2023-10-06T23:08:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 shutdown_connections 2023-10-06T23:08:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5700a1480 0x7fb5700a3940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb588102b10 0x7fb58819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:30.834 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb588100f70 0x7fb588196c40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 --2- 172.21.15.156:0/2277819251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588102170 0x7fb588197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.831+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 >> 172.21.15.156:0/2277819251 conn(0x7fb5880fc4d0 msgr2=0x7fb5881056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:08:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.832+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 shutdown_connections 2023-10-06T23:08:30.835 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:08:30.832+0000 7fb58d8d7700 1 -- 172.21.15.156:0/2277819251 wait complete. 2023-10-06T23:08:31.266 DEBUG:teuthology.orchestra.run.smithi156:osd.7> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-06T23:08:31.271 INFO:tasks.cephadm:Deploying osd.8 on smithi190 with /dev/vg_nvme/lv_2... 2023-10-06T23:08:31.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-06T23:08:31.343 INFO:journalctl@ceph.osd.7.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:08:31.598 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:08:31.428+0000 7f9214533640 -1 osd.7 0 log_to_monitors true 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:31 smithi156 ceph-mon[102862]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:31.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:31.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:31.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:31.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:31 smithi008 ceph-mon[98532]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:31.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:31.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:31 smithi190 ceph-mon[102658]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:32.009 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:08:32.545 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:32 smithi190 ceph-mon[102658]: from='osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-06T23:08:32.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:32 smithi190 ceph-mon[102658]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-06T23:08:32.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:32 smithi156 ceph-mon[102862]: from='osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-06T23:08:32.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:32 smithi156 ceph-mon[102862]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-06T23:08:32.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:32 smithi008 ceph-mon[98532]: from='osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-06T23:08:32.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:32 smithi008 ceph-mon[98532]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-06T23:08:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:33 smithi156 ceph-mon[102862]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-06T23:08:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:33 smithi156 ceph-mon[102862]: osdmap e50: 8 total, 7 up, 8 in 2023-10-06T23:08:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:33 smithi156 ceph-mon[102862]: from='osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:08:33.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:33 smithi156 ceph-mon[102862]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:08:33.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:33 smithi156 ceph-mon[102862]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:33.600 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:08:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:08:33.269+0000 7f9209baa700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T23:08:33.600 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:08:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:08:33.281+0000 7f920319a700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:08:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:33 smithi008 ceph-mon[98532]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-06T23:08:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:33 smithi008 ceph-mon[98532]: osdmap e50: 8 total, 7 up, 8 in 2023-10-06T23:08:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:33 smithi008 ceph-mon[98532]: from='osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:08:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:33 smithi008 ceph-mon[98532]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:08:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:33 smithi008 ceph-mon[98532]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:33 smithi190 ceph-mon[102658]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-06T23:08:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:33 smithi190 ceph-mon[102658]: osdmap e50: 8 total, 7 up, 8 in 2023-10-06T23:08:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:33 smithi190 ceph-mon[102658]: from='osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:08:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:33 smithi190 ceph-mon[102658]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:08:33.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:33 smithi190 ceph-mon[102658]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-06T23:08:33.970 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-06T23:08:33.970 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-06T23:08:33.970 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2023-10-06T23:08:33.970 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2023-10-06T23:08:33.970 INFO:teuthology.orchestra.run.smithi190.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.029295 s, 358 MB/s 2023-10-06T23:08:33.970 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2023-10-06T23:08:34.483 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi190:vg_nvme/lv_2 2023-10-06T23:08:34.545 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:34 smithi190 ceph-mon[102658]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:08:34.545 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:34 smithi190 ceph-mon[102658]: osdmap e51: 8 total, 7 up, 8 in 2023-10-06T23:08:34.545 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:34.545 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:34.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:34 smithi156 ceph-mon[102862]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:08:34.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:34 smithi156 ceph-mon[102862]: osdmap e51: 8 total, 7 up, 8 in 2023-10-06T23:08:34.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:34.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:34.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:34 smithi008 ceph-mon[98532]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:08:34.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:34 smithi008 ceph-mon[98532]: osdmap e51: 8 total, 7 up, 8 in 2023-10-06T23:08:34.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:34.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:35.216 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:08:35.545 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] boot 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: osdmap e52: 8 total, 8 up, 8 in 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi156 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.546 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.547 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi156 to 5755M 2023-10-06T23:08:35.547 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.547 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:35.547 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:35.547 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.547 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:35 smithi190 ceph-mon[102658]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] boot 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: osdmap e52: 8 total, 8 up, 8 in 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi156 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi156 to 5755M 2023-10-06T23:08:35.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:35.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:35.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:35 smithi156 ceph-mon[102862]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: osd.7 [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] boot 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: osdmap e52: 8 total, 8 up, 8 in 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi156 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:08:35.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi156 to 5755M 2023-10-06T23:08:35.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:35.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:35.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:35.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:35 smithi008 ceph-mon[98532]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:36 smithi190 ceph-mon[102658]: osdmap e53: 8 total, 8 up, 8 in 2023-10-06T23:08:36.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:36 smithi156 ceph-mon[102862]: osdmap e53: 8 total, 8 up, 8 in 2023-10-06T23:08:36.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:36 smithi008 ceph-mon[98532]: osdmap e53: 8 total, 8 up, 8 in 2023-10-06T23:08:36.715 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 -- 172.21.15.190:0/4087583443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102b10 msgr2=0x7f3e6c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:36.715 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 --2- 172.21.15.190:0/4087583443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102b10 0x7f3e6c1093c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400b0a0 tx=0x7f3e6400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:08:36.715 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 -- 172.21.15.190:0/4087583443 shutdown_connections 2023-10-06T23:08:36.715 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 --2- 172.21.15.190:0/4087583443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e6c100f70 0x7f3e6c101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:36.715 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 --2- 172.21.15.190:0/4087583443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102b10 0x7f3e6c1093c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:36.715 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 --2- 172.21.15.190:0/4087583443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e6c102170 0x7f3e6c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:36.715 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 -- 172.21.15.190:0/4087583443 >> 172.21.15.190:0/4087583443 conn(0x7f3e6c0fc4d0 msgr2=0x7f3e6c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:08:36.715 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 -- 172.21.15.190:0/4087583443 shutdown_connections 2023-10-06T23:08:36.716 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.714+0000 7f3e73f74700 1 -- 172.21.15.190:0/4087583443 wait complete. 2023-10-06T23:08:36.716 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.715+0000 7f3e73f74700 1 Processor -- start 2023-10-06T23:08:36.716 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e73f74700 1 -- start start 2023-10-06T23:08:36.717 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e73f74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e6c100f70 0x7f3e6c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:08:36.717 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e73f74700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102170 0x7f3e6c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:08:36.717 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e73f74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e6c102b10 0x7f3e6c19e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e73f74700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c19e8c0 con 0x7f3e6c102b10 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e73f74700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c19ea00 con 0x7f3e6c100f70 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e73f74700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c19eb90 con 0x7f3e6c102170 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e7150f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102170 0x7f3e6c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e7150f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102170 0x7f3e6c197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:39252/0 (socket says 172.21.15.190:39252) 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.716+0000 7f3e7150f700 1 -- 172.21.15.190:0/2390188834 learned_addr learned my addr 172.21.15.190:0/2390188834 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e71d10700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e6c100f70 0x7f3e6c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e7150f700 1 -- 172.21.15.190:0/2390188834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e6c100f70 msgr2=0x7f3e6c196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e7150f700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e6c100f70 0x7f3e6c196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e72511700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e6c102b10 0x7f3e6c19e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e7150f700 1 -- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e6c102b10 msgr2=0x7f3e6c19e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:36.718 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e7150f700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e6c102b10 0x7f3e6c19e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:36.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e7150f700 1 -- 172.21.15.190:0/2390188834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64009d00 con 0x7f3e6c102170 2023-10-06T23:08:36.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e71d10700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e6c100f70 0x7f3e6c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:08:36.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e72511700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e6c102b10 0x7f3e6c19e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:08:36.719 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e7150f700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102170 0x7f3e6c197270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00d980 tx=0x7f3e5c00dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:08:36.722 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e62ffd700 1 -- 172.21.15.190:0/2390188834 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c009b40 con 0x7f3e6c102170 2023-10-06T23:08:36.722 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c19ee70 con 0x7f3e6c102170 2023-10-06T23:08:36.722 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e62ffd700 1 -- 172.21.15.190:0/2390188834 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e5c00b6e0 con 0x7f3e6c102170 2023-10-06T23:08:36.722 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e62ffd700 1 -- 172.21.15.190:0/2390188834 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00f620 con 0x7f3e6c102170 2023-10-06T23:08:36.722 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.717+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c19f360 con 0x7f3e6c102170 2023-10-06T23:08:36.722 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.719+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c108550 con 0x7f3e6c102170 2023-10-06T23:08:36.722 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.721+0000 7f3e62ffd700 1 -- 172.21.15.190:0/2390188834 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3e5c010460 con 0x7f3e6c102170 2023-10-06T23:08:36.723 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.722+0000 7f3e62ffd700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e580a1480 0x7f3e580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:08:36.723 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.722+0000 7f3e62ffd700 1 -- 172.21.15.190:0/2390188834 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f3e5c0cc120 con 0x7f3e6c102170 2023-10-06T23:08:36.723 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.722+0000 7f3e71d10700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e580a1480 0x7f3e580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:08:36.723 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.723+0000 7f3e71d10700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e580a1480 0x7f3e580a3940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c101fd0 tx=0x7f3e68008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:08:36.726 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.726+0000 7f3e62ffd700 1 -- 172.21.15.190:0/2390188834 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e5c096220 con 0x7f3e6c102170 2023-10-06T23:08:36.936 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:36.935+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e6c02d2b0 con 0x7f3e580a1480 2023-10-06T23:08:37.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:37 smithi156 ceph-mon[102862]: osdmap e54: 8 total, 8 up, 8 in 2023-10-06T23:08:37.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:37 smithi156 ceph-mon[102862]: osdmap e55: 8 total, 8 up, 8 in 2023-10-06T23:08:37.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:37 smithi156 ceph-mon[102862]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:37.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:37 smithi156 ceph-mon[102862]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:08:37.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:08:37.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:08:37.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:37.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:37 smithi008 ceph-mon[98532]: osdmap e54: 8 total, 8 up, 8 in 2023-10-06T23:08:37.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:37 smithi008 ceph-mon[98532]: osdmap e55: 8 total, 8 up, 8 in 2023-10-06T23:08:37.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:37 smithi008 ceph-mon[98532]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:37.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:37 smithi008 ceph-mon[98532]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:08:37.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:08:37.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:08:37.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:37.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:37 smithi190 ceph-mon[102658]: osdmap e54: 8 total, 8 up, 8 in 2023-10-06T23:08:37.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:37 smithi190 ceph-mon[102658]: osdmap e55: 8 total, 8 up, 8 in 2023-10-06T23:08:37.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:37 smithi190 ceph-mon[102658]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:37.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:37 smithi190 ceph-mon[102658]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:08:37.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:08:37.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:08:37.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:39.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:38 smithi156 ceph-mon[102862]: osdmap e56: 8 total, 8 up, 8 in 2023-10-06T23:08:39.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:38 smithi008 ceph-mon[98532]: osdmap e56: 8 total, 8 up, 8 in 2023-10-06T23:08:39.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:38 smithi190 ceph-mon[102658]: osdmap e56: 8 total, 8 up, 8 in 2023-10-06T23:08:40.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:39 smithi156 ceph-mon[102862]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:40.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:39 smithi008 ceph-mon[98532]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:40.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:39 smithi190 ceph-mon[102658]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:41.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:40 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/1166029456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]: dispatch 2023-10-06T23:08:41.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:40 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]: dispatch 2023-10-06T23:08:41.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:40 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]': finished 2023-10-06T23:08:41.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:40 smithi008 ceph-mon[98532]: osdmap e57: 9 total, 8 up, 9 in 2023-10-06T23:08:41.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:08:41.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:40 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/3014022409' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:08:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:40 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/1166029456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]: dispatch 2023-10-06T23:08:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:40 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]: dispatch 2023-10-06T23:08:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:40 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]': finished 2023-10-06T23:08:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:40 smithi190 ceph-mon[102658]: osdmap e57: 9 total, 8 up, 9 in 2023-10-06T23:08:41.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:08:41.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:40 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/3014022409' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:08:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:40 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/1166029456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]: dispatch 2023-10-06T23:08:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:40 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]: dispatch 2023-10-06T23:08:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:40 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "491859be-3372-46a8-be19-6b70bee94107"}]': finished 2023-10-06T23:08:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:40 smithi156 ceph-mon[102862]: osdmap e57: 9 total, 8 up, 9 in 2023-10-06T23:08:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:08:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:40 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/3014022409' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:08:42.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:41 smithi008 ceph-mon[98532]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:42.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:41 smithi190 ceph-mon[102658]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:42.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:41 smithi156 ceph-mon[102862]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:44.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:43 smithi190 ceph-mon[102658]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:43 smithi156 ceph-mon[102862]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:44.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:43 smithi008 ceph-mon[98532]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:46.066 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:45 smithi190 ceph-mon[102658]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:46.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:45 smithi156 ceph-mon[102862]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:45 smithi008 ceph-mon[98532]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:48.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:47 smithi156 ceph-mon[102862]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-06T23:08:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:47 smithi008 ceph-mon[98532]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-06T23:08:48.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:48.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:47 smithi190 ceph-mon[102658]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:48.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-06T23:08:48.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:49.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:48 smithi156 ceph-mon[102862]: Deploying daemon osd.8 on smithi190 2023-10-06T23:08:49.101 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:48 smithi190 ceph-mon[102658]: Deploying daemon osd.8 on smithi190 2023-10-06T23:08:49.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:48 smithi008 ceph-mon[98532]: Deploying daemon osd.8 on smithi190 2023-10-06T23:08:50.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:49 smithi156 ceph-mon[102862]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:50.134 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:49 smithi190 ceph-mon[102658]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:49 smithi008 ceph-mon[98532]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:51 smithi190 ceph-mon[102658]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:52.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:51 smithi156 ceph-mon[102862]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:52.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:51 smithi008 ceph-mon[98532]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:54.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:53 smithi156 ceph-mon[102862]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:54.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:54.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:54.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:54.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:53 smithi008 ceph-mon[98532]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:54.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:54.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:54.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:54.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:53 smithi190 ceph-mon[102658]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:54.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:54.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:54.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:56.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:55 smithi190 ceph-mon[102658]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:56.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:55 smithi156 ceph-mon[102862]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:55 smithi008 ceph-mon[98532]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:57.421 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.419+0000 7f3e62ffd700 1 -- 172.21.15.190:0/2390188834 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3e6c02d2b0 con 0x7f3e580a1480 2023-10-06T23:08:57.422 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 8 on host 'smithi190' 2023-10-06T23:08:57.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e580a1480 msgr2=0x7f3e580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:57.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e580a1480 0x7f3e580a3940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c101fd0 tx=0x7f3e68008040 comp rx=0 tx=0).stop 2023-10-06T23:08:57.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102170 msgr2=0x7f3e6c197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:08:57.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102170 0x7f3e6c197270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00d980 tx=0x7f3e5c00dd40 comp rx=0 tx=0).stop 2023-10-06T23:08:57.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 shutdown_connections 2023-10-06T23:08:57.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e580a1480 0x7f3e580a3940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:57.425 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e6c102b10 0x7f3e6c19e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:57.425 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e6c100f70 0x7f3e6c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:57.425 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 --2- 172.21.15.190:0/2390188834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e6c102170 0x7f3e6c197270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:08:57.425 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 >> 172.21.15.190:0/2390188834 conn(0x7f3e6c0fc4d0 msgr2=0x7f3e6c105690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:08:57.425 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 shutdown_connections 2023-10-06T23:08:57.426 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:08:57.422+0000 7f3e73f74700 1 -- 172.21.15.190:0/2390188834 wait complete. 2023-10-06T23:08:57.935 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:57.935 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-06T23:08:57.936 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:57 smithi190 ceph-mon[102658]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-06T23:08:57.938 DEBUG:teuthology.orchestra.run.smithi190:osd.8> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-06T23:08:57.943 INFO:tasks.cephadm:Deploying osd.9 on smithi008 with /dev/vg_nvme/lv_1... 2023-10-06T23:08:57.944 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-06T23:08:58.016 INFO:journalctl@ceph.osd.8.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-06T23:08:58.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:57 smithi156 ceph-mon[102862]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-06T23:08:58.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-06T23:08:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:57 smithi008 ceph-mon[98532]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-06T23:08:58.692 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:08:59.582 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:59 smithi008 ceph-mon[98532]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-06T23:08:59.582 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:59 smithi008 ceph-mon[98532]: osdmap e58: 9 total, 8 up, 9 in 2023-10-06T23:08:59.582 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:59 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:08:59.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:59 smithi008 ceph-mon[98532]: from='osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:08:59.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:59 smithi008 ceph-mon[98532]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:08:59.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:08:59 smithi008 ceph-mon[98532]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:59.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:59 smithi190 ceph-mon[102658]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-06T23:08:59.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:59 smithi190 ceph-mon[102658]: osdmap e58: 9 total, 8 up, 9 in 2023-10-06T23:08:59.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:59 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:08:59.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:59 smithi190 ceph-mon[102658]: from='osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:08:59.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:59 smithi190 ceph-mon[102658]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:08:59.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:08:59 smithi190 ceph-mon[102658]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:08:59.694 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:08:59 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:08:59.408+0000 7f88256f4700 -1 osd.8 0 waiting for initial osdmap 2023-10-06T23:08:59.694 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:08:59 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:08:59.419+0000 7f881fce6700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:08:59.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:59 smithi156 ceph-mon[102862]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-06T23:08:59.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:59 smithi156 ceph-mon[102862]: osdmap e58: 9 total, 8 up, 9 in 2023-10-06T23:08:59.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:59 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:08:59.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:59 smithi156 ceph-mon[102862]: from='osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:08:59.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:59 smithi156 ceph-mon[102862]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:08:59.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:08:59 smithi156 ceph-mon[102862]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-06T23:09:00.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:00 smithi190 ceph-mon[102658]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:09:00.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:00 smithi190 ceph-mon[102658]: osdmap e59: 9 total, 8 up, 9 in 2023-10-06T23:09:00.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:00 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:00.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:00 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-06T23:09:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-06T23:09:00.758 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-06T23:09:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-06T23:09:00.758 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0300333 s, 349 MB/s 2023-10-06T23:09:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-06T23:09:00.795 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:00 smithi008 ceph-mon[98532]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:09:00.795 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:00 smithi008 ceph-mon[98532]: osdmap e59: 9 total, 8 up, 9 in 2023-10-06T23:09:00.795 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:00 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:00.795 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:00 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:00.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:00 smithi156 ceph-mon[102862]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:09:00.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:00 smithi156 ceph-mon[102862]: osdmap e59: 9 total, 8 up, 9 in 2023-10-06T23:09:00.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:00 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:00.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:00 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:01.275 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_1 2023-10-06T23:09:01.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:09:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:09:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] boot 2023-10-06T23:09:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: osdmap e60: 9 total, 9 up, 9 in 2023-10-06T23:09:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:01.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:01.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] boot 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: osdmap e60: 9 total, 9 up, 9 in 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:01.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:01.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: osd.8 [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] boot 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: osdmap e60: 9 total, 9 up, 9 in 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:01.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:01.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:01.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:01.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:02.031 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:09:02.638 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:02 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi190 2023-10-06T23:09:02.638 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:02 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi190 to 5755M 2023-10-06T23:09:02.638 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:02 smithi008 ceph-mon[98532]: osdmap e61: 9 total, 9 up, 9 in 2023-10-06T23:09:02.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:02 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi190 2023-10-06T23:09:02.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:02 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi190 to 5755M 2023-10-06T23:09:02.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:02 smithi190 ceph-mon[102658]: osdmap e61: 9 total, 9 up, 9 in 2023-10-06T23:09:02.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:02 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi190 2023-10-06T23:09:02.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:02 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi190 to 5755M 2023-10-06T23:09:02.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:02 smithi156 ceph-mon[102862]: osdmap e61: 9 total, 9 up, 9 in 2023-10-06T23:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.572+0000 7f323d1f3700 1 -- 172.21.15.8:0/3473848702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238100f70 msgr2=0x7f3238101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:03.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.572+0000 7f323d1f3700 1 --2- 172.21.15.8:0/3473848702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238100f70 0x7f3238101390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f32280099c0 tx=0x7f3228009cd0 comp rx=0 tx=0).stop 2023-10-06T23:09:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.573+0000 7f323d1f3700 1 -- 172.21.15.8:0/3473848702 shutdown_connections 2023-10-06T23:09:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.573+0000 7f323d1f3700 1 --2- 172.21.15.8:0/3473848702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238100f70 0x7f3238101390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.573+0000 7f323d1f3700 1 --2- 172.21.15.8:0/3473848702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3238102b10 0x7f32381093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.573+0000 7f323d1f3700 1 --2- 172.21.15.8:0/3473848702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3238102170 0x7f32381025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.573+0000 7f323d1f3700 1 -- 172.21.15.8:0/3473848702 >> 172.21.15.8:0/3473848702 conn(0x7f32380fc4d0 msgr2=0x7f32380fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:09:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.573+0000 7f323d1f3700 1 -- 172.21.15.8:0/3473848702 shutdown_connections 2023-10-06T23:09:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.573+0000 7f323d1f3700 1 -- 172.21.15.8:0/3473848702 wait complete. 2023-10-06T23:09:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.574+0000 7f323d1f3700 1 Processor -- start 2023-10-06T23:09:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.574+0000 7f323d1f3700 1 -- start start 2023-10-06T23:09:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.574+0000 7f323d1f3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3238100f70 0x7f3238198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.574+0000 7f323d1f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238102170 0x7f3238199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.574+0000 7f323d1f3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3238102b10 0x7f32381a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.574+0000 7f323d1f3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32381a0960 con 0x7f3238102170 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.574+0000 7f323d1f3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32381a0aa0 con 0x7f3238102b10 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.574+0000 7f323d1f3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32381a0c30 con 0x7f3238100f70 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238102170 0x7f3238199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238102170 0x7f3238199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60248/0 (socket says 172.21.15.8:60248) 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 -- 172.21.15.8:0/997918486 learned_addr learned my addr 172.21.15.8:0/997918486 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323759e700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3238102b10 0x7f32381a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f3236d9d700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3238100f70 0x7f3238198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 -- 172.21.15.8:0/997918486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3238100f70 msgr2=0x7f3238198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3238100f70 0x7f3238198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 -- 172.21.15.8:0/997918486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3238102b10 msgr2=0x7f32381a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3238102b10 0x7f32381a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 -- 172.21.15.8:0/997918486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32280095f0 con 0x7f3238102170 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f3236d9d700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3238100f70 0x7f3238198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323759e700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3238102b10 0x7f32381a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.575+0000 7f323659c700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238102170 0x7f3238199310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f322c00d980 tx=0x7f322c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.576+0000 7f321ffff700 1 -- 172.21.15.8:0/997918486 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c009b40 con 0x7f3238102170 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.576+0000 7f321ffff700 1 -- 172.21.15.8:0/997918486 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f322c00b6e0 con 0x7f3238102170 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.576+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32381a0f10 con 0x7f3238102170 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.576+0000 7f321ffff700 1 -- 172.21.15.8:0/997918486 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c00f620 con 0x7f3238102170 2023-10-06T23:09:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.576+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32381a13d0 con 0x7f3238102170 2023-10-06T23:09:03.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.577+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3238193490 con 0x7f3238102170 2023-10-06T23:09:03.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.579+0000 7f321ffff700 1 -- 172.21.15.8:0/997918486 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f322c010460 con 0x7f3238102170 2023-10-06T23:09:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.581+0000 7f321ffff700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32200a1500 0x7f32200a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.581+0000 7f321ffff700 1 -- 172.21.15.8:0/997918486 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f322c0cc230 con 0x7f3238102170 2023-10-06T23:09:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.581+0000 7f3236d9d700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32200a1500 0x7f32200a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.582+0000 7f3236d9d700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32200a1500 0x7f32200a39c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3228000c00 tx=0x7f3228005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:09:03.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.585+0000 7f321ffff700 1 -- 172.21.15.8:0/997918486 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f322c0961a0 con 0x7f3238102170 2023-10-06T23:09:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:03 smithi008 ceph-mon[98532]: osdmap e62: 9 total, 9 up, 9 in 2023-10-06T23:09:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:03 smithi008 ceph-mon[98532]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:03 smithi190 ceph-mon[102658]: osdmap e62: 9 total, 9 up, 9 in 2023-10-06T23:09:03.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:03 smithi190 ceph-mon[102658]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:03.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:03.805+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f323802d2b0 con 0x7f32200a1500 2023-10-06T23:09:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:03 smithi156 ceph-mon[102862]: osdmap e62: 9 total, 9 up, 9 in 2023-10-06T23:09:03.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:03 smithi156 ceph-mon[102862]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:04.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:04 smithi190 ceph-mon[102658]: osdmap e63: 9 total, 9 up, 9 in 2023-10-06T23:09:04.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:04 smithi190 ceph-mon[102658]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:04.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:04 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:04.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:04 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:04.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:04 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:04.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:04 smithi156 ceph-mon[102862]: osdmap e63: 9 total, 9 up, 9 in 2023-10-06T23:09:04.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:04 smithi156 ceph-mon[102862]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:04.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:04 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:04.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:04 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:04.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:04 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:04.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:04 smithi008 ceph-mon[98532]: osdmap e63: 9 total, 9 up, 9 in 2023-10-06T23:09:04.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:04 smithi008 ceph-mon[98532]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:04.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:04 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:04.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:04 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:04.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:04 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:05.596 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:05 smithi008 ceph-mon[98532]: osdmap e64: 9 total, 9 up, 9 in 2023-10-06T23:09:05.597 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:05 smithi008 ceph-mon[98532]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-06T23:09:05.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:05 smithi156 ceph-mon[102862]: osdmap e64: 9 total, 9 up, 9 in 2023-10-06T23:09:05.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:05 smithi156 ceph-mon[102862]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-06T23:09:05.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:05 smithi190 ceph-mon[102658]: osdmap e64: 9 total, 9 up, 9 in 2023-10-06T23:09:05.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:05 smithi190 ceph-mon[102658]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-06T23:09:08.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:07 smithi156 ceph-mon[102862]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-10-06T23:09:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:07 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2905933170' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ed52c56-1603-45a4-b9dd-aa6c07d0181c"}]: dispatch 2023-10-06T23:09:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:07 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2905933170' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ed52c56-1603-45a4-b9dd-aa6c07d0181c"}]': finished 2023-10-06T23:09:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:07 smithi156 ceph-mon[102862]: osdmap e65: 10 total, 9 up, 10 in 2023-10-06T23:09:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:07 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/786868966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:09:08.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:07 smithi008 ceph-mon[98532]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-10-06T23:09:08.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:07 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2905933170' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ed52c56-1603-45a4-b9dd-aa6c07d0181c"}]: dispatch 2023-10-06T23:09:08.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:07 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2905933170' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ed52c56-1603-45a4-b9dd-aa6c07d0181c"}]': finished 2023-10-06T23:09:08.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:07 smithi008 ceph-mon[98532]: osdmap e65: 10 total, 9 up, 10 in 2023-10-06T23:09:08.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:08.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:07 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/786868966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:09:08.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:07 smithi190 ceph-mon[102658]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-10-06T23:09:08.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:07 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2905933170' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ed52c56-1603-45a4-b9dd-aa6c07d0181c"}]: dispatch 2023-10-06T23:09:08.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:07 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2905933170' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ed52c56-1603-45a4-b9dd-aa6c07d0181c"}]': finished 2023-10-06T23:09:08.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:07 smithi190 ceph-mon[102658]: osdmap e65: 10 total, 9 up, 10 in 2023-10-06T23:09:08.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:08.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:07 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/786868966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:09:10.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:09 smithi156 ceph-mon[102862]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:09:10.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:09 smithi008 ceph-mon[98532]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:09:10.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:09 smithi190 ceph-mon[102658]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-06T23:09:12.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:11 smithi156 ceph-mon[102862]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-10-06T23:09:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:11 smithi008 ceph-mon[98532]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-10-06T23:09:12.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:11 smithi190 ceph-mon[102658]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-10-06T23:09:14.302 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:13 smithi008 ceph-mon[98532]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:14.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:13 smithi156 ceph-mon[102862]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:13 smithi190 ceph-mon[102658]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:15.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:14 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-06T23:09:15.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:14 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:15.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:14 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-06T23:09:15.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:14 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:15.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:14 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-06T23:09:15.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:14 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:16.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:15 smithi008 ceph-mon[98532]: Deploying daemon osd.9 on smithi008 2023-10-06T23:09:16.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:15 smithi008 ceph-mon[98532]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:16.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:15 smithi156 ceph-mon[102862]: Deploying daemon osd.9 on smithi008 2023-10-06T23:09:16.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:15 smithi156 ceph-mon[102862]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:15 smithi190 ceph-mon[102658]: Deploying daemon osd.9 on smithi008 2023-10-06T23:09:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:15 smithi190 ceph-mon[102658]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:17 smithi008 ceph-mon[98532]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:18.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:17 smithi156 ceph-mon[102862]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:18.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:17 smithi190 ceph-mon[102658]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:20.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:19 smithi008 ceph-mon[98532]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:20.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:19 smithi156 ceph-mon[102862]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:19 smithi190 ceph-mon[102658]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:21.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:21.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:21.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:21.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:20 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:21.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:20 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:21.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:20 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:21.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:20 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:21.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:20 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:21.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:20 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:22.239 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:21 smithi008 ceph-mon[98532]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:22.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:21 smithi156 ceph-mon[102862]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:22.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:21 smithi190 ceph-mon[102658]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:24.334 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:23 smithi008 ceph-mon[98532]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:24.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:23 smithi156 ceph-mon[102862]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:24.366 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 9 on host 'smithi008' 2023-10-06T23:09:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.364+0000 7f321ffff700 1 -- 172.21.15.8:0/997918486 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f323802d2b0 con 0x7f32200a1500 2023-10-06T23:09:24.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32200a1500 msgr2=0x7f32200a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:24.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32200a1500 0x7f32200a39c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3228000c00 tx=0x7f3228005fb0 comp rx=0 tx=0).stop 2023-10-06T23:09:24.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238102170 msgr2=0x7f3238199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:24.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238102170 0x7f3238199310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f322c00d980 tx=0x7f322c00dd40 comp rx=0 tx=0).stop 2023-10-06T23:09:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 shutdown_connections 2023-10-06T23:09:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32200a1500 0x7f32200a39c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3238102b10 0x7f32381a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3238100f70 0x7f3238198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 --2- 172.21.15.8:0/997918486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3238102170 0x7f3238199310 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 >> 172.21.15.8:0/997918486 conn(0x7f32380fc4d0 msgr2=0x7f3238107b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:09:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 shutdown_connections 2023-10-06T23:09:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:09:24.367+0000 7f323d1f3700 1 -- 172.21.15.8:0/997918486 wait complete. 2023-10-06T23:09:24.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:23 smithi190 ceph-mon[102658]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:24.855 DEBUG:teuthology.orchestra.run.smithi008:osd.9> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-06T23:09:24.860 INFO:tasks.cephadm:Deploying osd.10 on smithi156 with /dev/vg_nvme/lv_1... 2023-10-06T23:09:24.860 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-06T23:09:24.947 INFO:journalctl@ceph.osd.9.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:09:25.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:09:24 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:09:24.955+0000 7f88bd897640 -1 osd.9 0 log_to_monitors true 2023-10-06T23:09:25.578 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.579 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.579 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.579 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.579 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:25 smithi008 ceph-mon[98532]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:25.579 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:25 smithi008 ceph-mon[98532]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-06T23:09:25.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:25 smithi156 ceph-mon[102862]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:25.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:25 smithi156 ceph-mon[102862]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-06T23:09:25.599 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:09:25.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:25.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:25 smithi190 ceph-mon[102658]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:25.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:25 smithi190 ceph-mon[102658]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-06T23:09:26.425 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:26 smithi008 ceph-mon[98532]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-06T23:09:26.425 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:26 smithi008 ceph-mon[98532]: osdmap e66: 10 total, 9 up, 10 in 2023-10-06T23:09:26.425 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:26 smithi008 ceph-mon[98532]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:09:26.425 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:26.426 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:09:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:09:26.399+0000 7f88b2f0e700 -1 osd.9 0 waiting for initial osdmap 2023-10-06T23:09:26.495 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:26 smithi156 ceph-mon[102862]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-06T23:09:26.495 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:26 smithi156 ceph-mon[102862]: osdmap e66: 10 total, 9 up, 10 in 2023-10-06T23:09:26.495 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:26 smithi156 ceph-mon[102862]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:09:26.496 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:26.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:26 smithi190 ceph-mon[102658]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-06T23:09:26.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:26 smithi190 ceph-mon[102658]: osdmap e66: 10 total, 9 up, 10 in 2023-10-06T23:09:26.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:26 smithi190 ceph-mon[102658]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-06T23:09:26.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:26.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:09:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:09:26.422+0000 7f88ae502700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:09:27.553 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-06T23:09:27.553 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-06T23:09:27.553 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-10-06T23:09:27.553 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-10-06T23:09:27.553 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0300032 s, 349 MB/s 2023-10-06T23:09:27.554 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-10-06T23:09:27.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:27 smithi190 ceph-mon[102658]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:09:27.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:27 smithi190 ceph-mon[102658]: osdmap e67: 10 total, 9 up, 10 in 2023-10-06T23:09:27.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:27.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:27.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:27 smithi190 ceph-mon[102658]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:27.696 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:27 smithi156 ceph-mon[102862]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:09:27.696 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:27 smithi156 ceph-mon[102862]: osdmap e67: 10 total, 9 up, 10 in 2023-10-06T23:09:27.696 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:27.696 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:27.696 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:27 smithi156 ceph-mon[102862]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:27.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:27 smithi008 ceph-mon[98532]: from='osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-06T23:09:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:27 smithi008 ceph-mon[98532]: osdmap e67: 10 total, 9 up, 10 in 2023-10-06T23:09:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:27.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:27 smithi008 ceph-mon[98532]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-06T23:09:28.075 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi156:vg_nvme/lv_1 2023-10-06T23:09:28.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:28 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:09:28.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:28 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:09:28.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:28 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:28.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:28 smithi190 ceph-mon[102658]: osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] boot 2023-10-06T23:09:28.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:28 smithi190 ceph-mon[102658]: osdmap e68: 10 total, 10 up, 10 in 2023-10-06T23:09:28.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:28 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:28.803 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:09:28.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:28 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:09:28.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:28 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:09:28.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:28 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:28.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:28 smithi156 ceph-mon[102862]: osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] boot 2023-10-06T23:09:28.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:28 smithi156 ceph-mon[102862]: osdmap e68: 10 total, 10 up, 10 in 2023-10-06T23:09:28.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:28 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:28.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:28 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:09:28.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:28 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:09:28.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:28 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:28.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:28 smithi008 ceph-mon[98532]: osd.9 [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] boot 2023-10-06T23:09:28.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:28 smithi008 ceph-mon[98532]: osdmap e68: 10 total, 10 up, 10 in 2023-10-06T23:09:28.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:28 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-06T23:09:29.704 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi008 2023-10-06T23:09:29.704 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.704 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.704 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.704 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi008 to 4318M 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:29.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:29.706 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.706 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: osdmap e69: 10 total, 10 up, 10 in 2023-10-06T23:09:29.706 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:29 smithi156 ceph-mon[102862]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:29.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi008 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi008 to 4318M 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:29.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:29.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:29.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:29.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:29.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: osdmap e69: 10 total, 10 up, 10 in 2023-10-06T23:09:29.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:29 smithi008 ceph-mon[98532]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi008 2023-10-06T23:09:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi008 to 4318M 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: osdmap e69: 10 total, 10 up, 10 in 2023-10-06T23:09:29.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:29 smithi190 ceph-mon[102658]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 -- 172.21.15.156:0/393633685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 msgr2=0x7fb670101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 --2- 172.21.15.156:0/393633685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 0x7fb670101390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0099c0 tx=0x7fb66c009cd0 comp rx=0 tx=0).stop 2023-10-06T23:09:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 -- 172.21.15.156:0/393633685 shutdown_connections 2023-10-06T23:09:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 --2- 172.21.15.156:0/393633685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb670102b10 0x7fb6701093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 --2- 172.21.15.156:0/393633685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 0x7fb670101390 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 --2- 172.21.15.156:0/393633685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670102170 0x7fb6701025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:30.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 -- 172.21.15.156:0/393633685 >> 172.21.15.156:0/393633685 conn(0x7fb6700fc4d0 msgr2=0x7fb6700fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:09:30.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 -- 172.21.15.156:0/393633685 shutdown_connections 2023-10-06T23:09:30.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.291+0000 7fb6780a8700 1 -- 172.21.15.156:0/393633685 wait complete. 2023-10-06T23:09:30.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.292+0000 7fb6780a8700 1 Processor -- start 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.292+0000 7fb6780a8700 1 -- start start 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb6780a8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 0x7fb670074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb6780a8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb670102170 0x7fb6700732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb6780a8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670102b10 0x7fb6700737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb6780a8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670073f60 con 0x7fb670102b10 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb6780a8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6700740d0 con 0x7fb670100f70 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb6780a8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701a0bb0 con 0x7fb670102170 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb675e44700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 0x7fb670074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb675e44700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 0x7fb670074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39432/0 (socket says 172.21.15.156:39432) 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb675e44700 1 -- 172.21.15.156:0/528250591 learned_addr learned my addr 172.21.15.156:0/528250591 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-10-06T23:09:30.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb676645700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670102b10 0x7fb6700737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb675643700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb670102170 0x7fb6700732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb675e44700 1 -- 172.21.15.156:0/528250591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb670102170 msgr2=0x7fb6700732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb675e44700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb670102170 0x7fb6700732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb675e44700 1 -- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670102b10 msgr2=0x7fb6700737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.293+0000 7fb675e44700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670102b10 0x7fb6700737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.294+0000 7fb675e44700 1 -- 172.21.15.156:0/528250591 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0095f0 con 0x7fb670100f70 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.294+0000 7fb675e44700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 0x7fb670074c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0098e0 tx=0x7fb66c0045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.294+0000 7fb666ffd700 1 -- 172.21.15.156:0/528250591 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c01d070 con 0x7fb670100f70 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.294+0000 7fb666ffd700 1 -- 172.21.15.156:0/528250591 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb66c003e20 con 0x7fb670100f70 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.294+0000 7fb666ffd700 1 -- 172.21.15.156:0/528250591 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c004e80 con 0x7fb670100f70 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.294+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6701a0e30 con 0x7fb670100f70 2023-10-06T23:09:30.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.294+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6701a1190 con 0x7fb670100f70 2023-10-06T23:09:30.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.295+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67010c690 con 0x7fb670100f70 2023-10-06T23:09:30.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.299+0000 7fb666ffd700 1 -- 172.21.15.156:0/528250591 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb66c003990 con 0x7fb670100f70 2023-10-06T23:09:30.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.300+0000 7fb666ffd700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb65c0a1500 0x7fb65c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:30.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.300+0000 7fb666ffd700 1 -- 172.21.15.156:0/528250591 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fb66c0cd250 con 0x7fb670100f70 2023-10-06T23:09:30.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.300+0000 7fb675643700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb65c0a1500 0x7fb65c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:30.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.301+0000 7fb675643700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb65c0a1500 0x7fb65c0a39c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb660009c60 tx=0x7fb660009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:09:30.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.303+0000 7fb666ffd700 1 -- 172.21.15.156:0/528250591 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb66c0970a0 con 0x7fb670100f70 2023-10-06T23:09:30.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:30.511+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6700612f0 con 0x7fb65c0a1500 2023-10-06T23:09:31.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:31.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:31.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:30 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:31.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:31.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:31.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:30 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:31.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:30 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:31.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:30 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:31.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:30 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:32.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:31 smithi008 ceph-mon[98532]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:32.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:31 smithi008 ceph-mon[98532]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:32.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:31 smithi190 ceph-mon[102658]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:32.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:31 smithi190 ceph-mon[102658]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:32.228 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:31 smithi156 ceph-mon[102862]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:32.228 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:31 smithi156 ceph-mon[102862]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:33 smithi156 ceph-mon[102862]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:33 smithi156 ceph-mon[102862]: from='client.? 172.21.15.156:0/135648059' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]: dispatch 2023-10-06T23:09:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:33 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]: dispatch 2023-10-06T23:09:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:33 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]': finished 2023-10-06T23:09:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:33 smithi156 ceph-mon[102862]: osdmap e70: 11 total, 10 up, 11 in 2023-10-06T23:09:34.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:34.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:33 smithi008 ceph-mon[98532]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:34.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:33 smithi008 ceph-mon[98532]: from='client.? 172.21.15.156:0/135648059' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]: dispatch 2023-10-06T23:09:34.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:33 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]: dispatch 2023-10-06T23:09:34.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:33 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]': finished 2023-10-06T23:09:34.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:33 smithi008 ceph-mon[98532]: osdmap e70: 11 total, 10 up, 11 in 2023-10-06T23:09:34.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:34.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:33 smithi190 ceph-mon[102658]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:34.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:33 smithi190 ceph-mon[102658]: from='client.? 172.21.15.156:0/135648059' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]: dispatch 2023-10-06T23:09:34.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:33 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]: dispatch 2023-10-06T23:09:34.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:33 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6af790-47f8-4faf-80de-d04e11236910"}]': finished 2023-10-06T23:09:34.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:33 smithi190 ceph-mon[102658]: osdmap e70: 11 total, 10 up, 11 in 2023-10-06T23:09:34.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:35.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:34 smithi156 ceph-mon[102862]: from='client.? 172.21.15.156:0/2357552511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:09:35.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:34 smithi008 ceph-mon[98532]: from='client.? 172.21.15.156:0/2357552511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:09:35.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:34 smithi190 ceph-mon[102658]: from='client.? 172.21.15.156:0/2357552511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:09:36.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:35 smithi156 ceph-mon[102862]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:35 smithi008 ceph-mon[98532]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:36.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:35 smithi190 ceph-mon[102658]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:38.044 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:37 smithi156 ceph-mon[102862]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:38.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:37 smithi008 ceph-mon[98532]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:38.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:37 smithi190 ceph-mon[102658]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:40.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:39 smithi156 ceph-mon[102862]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:39 smithi008 ceph-mon[98532]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:39 smithi190 ceph-mon[102658]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:42.308 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:41 smithi156 ceph-mon[102862]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:42.308 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-06T23:09:42.308 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:41 smithi008 ceph-mon[98532]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-06T23:09:42.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:41 smithi190 ceph-mon[102658]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:42.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-06T23:09:42.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:43.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:42 smithi156 ceph-mon[102862]: Deploying daemon osd.10 on smithi156 2023-10-06T23:09:43.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:42 smithi008 ceph-mon[98532]: Deploying daemon osd.10 on smithi156 2023-10-06T23:09:43.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:42 smithi190 ceph-mon[102658]: Deploying daemon osd.10 on smithi156 2023-10-06T23:09:44.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:43 smithi156 ceph-mon[102862]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:44.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:43 smithi008 ceph-mon[98532]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:44.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:43 smithi190 ceph-mon[102658]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:46.324 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:45 smithi156 ceph-mon[102862]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:45 smithi008 ceph-mon[98532]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:45 smithi190 ceph-mon[102658]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:47 smithi008 ceph-mon[98532]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:48.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:48.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:47 smithi190 ceph-mon[102658]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:48.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:48.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:48.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:48.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:47 smithi156 ceph-mon[102862]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:48.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:48.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:48.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:49 smithi156 ceph-mon[102862]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:49 smithi008 ceph-mon[98532]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:49 smithi190 ceph-mon[102658]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:51.339 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.337+0000 7fb666ffd700 1 -- 172.21.15.156:0/528250591 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fb6700612f0 con 0x7fb65c0a1500 2023-10-06T23:09:51.339 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 10 on host 'smithi156' 2023-10-06T23:09:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb65c0a1500 msgr2=0x7fb65c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb65c0a1500 0x7fb65c0a39c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb660009c60 tx=0x7fb660009260 comp rx=0 tx=0).stop 2023-10-06T23:09:51.341 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 msgr2=0x7fb670074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 0x7fb670074c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0098e0 tx=0x7fb66c0045e0 comp rx=0 tx=0).stop 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 shutdown_connections 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb65c0a1500 0x7fb65c0a39c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb670102b10 0x7fb6700737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb670100f70 0x7fb670074c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 --2- 172.21.15.156:0/528250591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb670102170 0x7fb6700732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 >> 172.21.15.156:0/528250591 conn(0x7fb6700fc4d0 msgr2=0x7fb6700fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 shutdown_connections 2023-10-06T23:09:51.342 INFO:teuthology.orchestra.run.smithi156.stderr:2023-10-06T23:09:51.340+0000 7fb6780a8700 1 -- 172.21.15.156:0/528250591 wait complete. 2023-10-06T23:09:51.826 DEBUG:teuthology.orchestra.run.smithi156:osd.10> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-06T23:09:51.830 INFO:tasks.cephadm:Deploying osd.11 on smithi190 with /dev/vg_nvme/lv_1... 2023-10-06T23:09:51.830 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-06T23:09:51.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:51.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:51.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:51.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:51.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:51.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:51.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:51.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:51.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:51.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-06T23:09:51.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:51 smithi156 ceph-mon[102862]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-06T23:09:51.905 INFO:journalctl@ceph.osd.10.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:09:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-06T23:09:52.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:51 smithi008 ceph-mon[98532]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-06T23:09:52.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-06T23:09:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:51 smithi190 ceph-mon[102658]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-06T23:09:52.566 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:09:53.430 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:53 smithi190 ceph-mon[102658]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-06T23:09:53.431 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:53 smithi190 ceph-mon[102658]: osdmap e71: 11 total, 10 up, 11 in 2023-10-06T23:09:53.431 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:53 smithi190 ceph-mon[102658]: from='osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:09:53.431 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:53.431 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:53 smithi190 ceph-mon[102658]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:09:53.431 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:53 smithi190 ceph-mon[102658]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:53 smithi156 ceph-mon[102862]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-06T23:09:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:53 smithi156 ceph-mon[102862]: osdmap e71: 11 total, 10 up, 11 in 2023-10-06T23:09:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:53 smithi156 ceph-mon[102862]: from='osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:09:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:53 smithi156 ceph-mon[102862]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:09:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:53 smithi156 ceph-mon[102862]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:53.600 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:09:53 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:09:53.298+0000 7f582c1a5700 -1 osd.10 0 waiting for initial osdmap 2023-10-06T23:09:53.600 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:09:53 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:09:53.314+0000 7f5826f98700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:09:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:53 smithi008 ceph-mon[98532]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-06T23:09:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:53 smithi008 ceph-mon[98532]: osdmap e71: 11 total, 10 up, 11 in 2023-10-06T23:09:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:53 smithi008 ceph-mon[98532]: from='osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:09:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:53 smithi008 ceph-mon[98532]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-10-06T23:09:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:53 smithi008 ceph-mon[98532]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:54.550 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-06T23:09:54.550 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-06T23:09:54.550 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2023-10-06T23:09:54.550 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2023-10-06T23:09:54.551 INFO:teuthology.orchestra.run.smithi190.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0386865 s, 271 MB/s 2023-10-06T23:09:54.551 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2023-10-06T23:09:54.587 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:54 smithi190 ceph-mon[102658]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:09:54.587 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:54 smithi190 ceph-mon[102658]: osdmap e72: 11 total, 10 up, 11 in 2023-10-06T23:09:54.587 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:54.587 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:54 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:54.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:54 smithi156 ceph-mon[102862]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:09:54.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:54 smithi156 ceph-mon[102862]: osdmap e72: 11 total, 10 up, 11 in 2023-10-06T23:09:54.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:54.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:54 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:54.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:54 smithi008 ceph-mon[98532]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-10-06T23:09:54.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:54 smithi008 ceph-mon[98532]: osdmap e72: 11 total, 10 up, 11 in 2023-10-06T23:09:54.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:54.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:54 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:55.040 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi190:vg_nvme/lv_1 2023-10-06T23:09:55.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:55 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:09:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:55 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:09:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:55 smithi156 ceph-mon[102862]: osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] boot 2023-10-06T23:09:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:55 smithi156 ceph-mon[102862]: osdmap e73: 11 total, 11 up, 11 in 2023-10-06T23:09:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:55.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:55 smithi156 ceph-mon[102862]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:55.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:55 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:09:55.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:55 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:09:55.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:55 smithi008 ceph-mon[98532]: osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] boot 2023-10-06T23:09:55.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:55 smithi008 ceph-mon[98532]: osdmap e73: 11 total, 11 up, 11 in 2023-10-06T23:09:55.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:55.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:55 smithi008 ceph-mon[98532]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:55.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:55 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:09:55.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:55 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:09:55.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:55 smithi190 ceph-mon[102658]: osd.10 [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] boot 2023-10-06T23:09:55.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:55 smithi190 ceph-mon[102658]: osdmap e73: 11 total, 11 up, 11 in 2023-10-06T23:09:55.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-06T23:09:55.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:55 smithi190 ceph-mon[102658]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-06T23:09:55.770 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:09:56.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: osdmap e74: 11 total, 11 up, 11 in 2023-10-06T23:09:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi156 2023-10-06T23:09:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi156 to 4316M 2023-10-06T23:09:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:56.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: osdmap e74: 11 total, 11 up, 11 in 2023-10-06T23:09:56.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi156 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi156 to 4316M 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:56.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:56.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.682 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: osdmap e74: 11 total, 11 up, 11 in 2023-10-06T23:09:56.682 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi156 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi156 to 4316M 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:09:56.683 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:09:57.262 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.260+0000 7f225d6ae700 1 -- 172.21.15.190:0/2512202717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 msgr2=0x7f2258101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:57.263 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.260+0000 7f225d6ae700 1 --2- 172.21.15.190:0/2512202717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 0x7f2258101390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2248009990 tx=0x7f2248009ca0 comp rx=0 tx=0).stop 2023-10-06T23:09:57.263 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.260+0000 7f225d6ae700 1 -- 172.21.15.190:0/2512202717 shutdown_connections 2023-10-06T23:09:57.263 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.260+0000 7f225d6ae700 1 --2- 172.21.15.190:0/2512202717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2258102b10 0x7f22581093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:57.263 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.260+0000 7f225d6ae700 1 --2- 172.21.15.190:0/2512202717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 0x7f2258101390 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:57.263 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.260+0000 7f225d6ae700 1 --2- 172.21.15.190:0/2512202717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2258102170 0x7f22581025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:57.263 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.260+0000 7f225d6ae700 1 -- 172.21.15.190:0/2512202717 >> 172.21.15.190:0/2512202717 conn(0x7f22580fc4d0 msgr2=0x7f22580fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:09:57.263 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.260+0000 7f225d6ae700 1 -- 172.21.15.190:0/2512202717 shutdown_connections 2023-10-06T23:09:57.263 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.261+0000 7f225d6ae700 1 -- 172.21.15.190:0/2512202717 wait complete. 2023-10-06T23:09:57.264 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.262+0000 7f225d6ae700 1 Processor -- start 2023-10-06T23:09:57.264 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.262+0000 7f225d6ae700 1 -- start start 2023-10-06T23:09:57.264 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f225d6ae700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 0x7f2258074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f225d6ae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2258102170 0x7f22580732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f225d6ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2258102b10 0x7f22580737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f225d6ae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2258073f60 con 0x7f2258102170 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f225d6ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580740d0 con 0x7f2258102b10 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f225d6ae700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22581a0c30 con 0x7f2258100f70 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 0x7f2258074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 0x7f2258074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:37540/0 (socket says 172.21.15.190:37540) 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 -- 172.21.15.190:0/3955599717 learned_addr learned my addr 172.21.15.190:0/3955599717 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:09:57.265 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f22567fc700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2258102170 0x7f22580732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:57.266 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 -- 172.21.15.190:0/3955599717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2258102b10 msgr2=0x7f22580737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:57.266 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2258102b10 0x7f22580737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:57.266 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 -- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2258102170 msgr2=0x7f22580732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:09:57.266 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2258102170 0x7f22580732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:09:57.266 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 -- 172.21.15.190:0/3955599717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480095f0 con 0x7f2258100f70 2023-10-06T23:09:57.267 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.263+0000 7f2256ffd700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 0x7f2258074c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2248004730 tx=0x7f2248004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:09:57.267 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.264+0000 7f223ffff700 1 -- 172.21.15.190:0/3955599717 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224801d070 con 0x7f2258100f70 2023-10-06T23:09:57.267 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.264+0000 7f223ffff700 1 -- 172.21.15.190:0/3955599717 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2248004c60 con 0x7f2258100f70 2023-10-06T23:09:57.267 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.264+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22581a0eb0 con 0x7f2258100f70 2023-10-06T23:09:57.267 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.264+0000 7f223ffff700 1 -- 172.21.15.190:0/3955599717 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248003b30 con 0x7f2258100f70 2023-10-06T23:09:57.267 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.264+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22581a1260 con 0x7f2258100f70 2023-10-06T23:09:57.267 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.265+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225810c6e0 con 0x7f2258100f70 2023-10-06T23:09:57.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.267+0000 7f223ffff700 1 -- 172.21.15.190:0/3955599717 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2248005000 con 0x7f2258100f70 2023-10-06T23:09:57.270 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.268+0000 7f223ffff700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f22400a1500 0x7f22400a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:09:57.270 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.268+0000 7f223ffff700 1 -- 172.21.15.190:0/3955599717 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f22480cd670 con 0x7f2258100f70 2023-10-06T23:09:57.270 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.269+0000 7f22567fc700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f22400a1500 0x7f22400a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:09:57.270 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.269+0000 7f22567fc700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f22400a1500 0x7f22400a39c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f224c007c60 tx=0x7f224c0073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:09:57.274 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.273+0000 7f223ffff700 1 -- 172.21.15.190:0/3955599717 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2248097310 con 0x7f2258100f70 2023-10-06T23:09:57.484 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:09:57.482+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f22580612f0 con 0x7f22400a1500 2023-10-06T23:09:57.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:57 smithi156 ceph-mon[102862]: osdmap e75: 11 total, 11 up, 11 in 2023-10-06T23:09:57.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:57 smithi156 ceph-mon[102862]: osdmap e76: 11 total, 11 up, 11 in 2023-10-06T23:09:57.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:57 smithi156 ceph-mon[102862]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:09:57.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:57 smithi008 ceph-mon[98532]: osdmap e75: 11 total, 11 up, 11 in 2023-10-06T23:09:57.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:57 smithi008 ceph-mon[98532]: osdmap e76: 11 total, 11 up, 11 in 2023-10-06T23:09:57.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:57 smithi008 ceph-mon[98532]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:09:57.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:57 smithi190 ceph-mon[102658]: osdmap e75: 11 total, 11 up, 11 in 2023-10-06T23:09:57.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:57 smithi190 ceph-mon[102658]: osdmap e76: 11 total, 11 up, 11 in 2023-10-06T23:09:57.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:57 smithi190 ceph-mon[102658]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:09:58.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:58 smithi156 ceph-mon[102862]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:58.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:58.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:58.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:58 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:58.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:58 smithi156 ceph-mon[102862]: osdmap e77: 11 total, 11 up, 11 in 2023-10-06T23:09:58.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:58 smithi190 ceph-mon[102658]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:58.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:58.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:58.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:58 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:58.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:58 smithi190 ceph-mon[102658]: osdmap e77: 11 total, 11 up, 11 in 2023-10-06T23:09:58.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:58 smithi008 ceph-mon[98532]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:09:58.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-06T23:09:58.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-06T23:09:58.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:58 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:09:58.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:58 smithi008 ceph-mon[98532]: osdmap e77: 11 total, 11 up, 11 in 2023-10-06T23:09:59.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:09:59 smithi156 ceph-mon[102862]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:09:59.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:09:59 smithi008 ceph-mon[98532]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:09:59.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:09:59 smithi190 ceph-mon[102658]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:00.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:00 smithi156 ceph-mon[102862]: overall HEALTH_OK 2023-10-06T23:10:00.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:00 smithi008 ceph-mon[98532]: overall HEALTH_OK 2023-10-06T23:10:00.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:00 smithi190 ceph-mon[102658]: overall HEALTH_OK 2023-10-06T23:10:01.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/1769905399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]: dispatch 2023-10-06T23:10:01.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:01 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]: dispatch 2023-10-06T23:10:01.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:01 smithi156 ceph-mon[102862]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]': finished 2023-10-06T23:10:01.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:01 smithi156 ceph-mon[102862]: osdmap e78: 12 total, 11 up, 12 in 2023-10-06T23:10:01.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:01 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:01.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:01 smithi156 ceph-mon[102862]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2023-10-06T23:10:01.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.190:0/3997696028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:10:01.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/1769905399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]: dispatch 2023-10-06T23:10:01.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:01 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]: dispatch 2023-10-06T23:10:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:01 smithi008 ceph-mon[98532]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]': finished 2023-10-06T23:10:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:01 smithi008 ceph-mon[98532]: osdmap e78: 12 total, 11 up, 12 in 2023-10-06T23:10:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:01 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:01 smithi008 ceph-mon[98532]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2023-10-06T23:10:01.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.190:0/3997696028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:10:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/1769905399' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]: dispatch 2023-10-06T23:10:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:01 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]: dispatch 2023-10-06T23:10:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:01 smithi190 ceph-mon[102658]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7d0e66f-912f-4088-bf84-ef021b8a2883"}]': finished 2023-10-06T23:10:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:01 smithi190 ceph-mon[102658]: osdmap e78: 12 total, 11 up, 12 in 2023-10-06T23:10:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:01 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:01.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:01 smithi190 ceph-mon[102658]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2023-10-06T23:10:01.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.190:0/3997696028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-06T23:10:04.324 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:03 smithi190 ceph-mon[102658]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-06T23:10:04.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:03 smithi156 ceph-mon[102862]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-06T23:10:04.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:03 smithi008 ceph-mon[98532]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-06T23:10:06.173 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:05 smithi190 ceph-mon[102658]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-06T23:10:06.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:05 smithi156 ceph-mon[102862]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-06T23:10:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:05 smithi008 ceph-mon[98532]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-06T23:10:08.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:07 smithi008 ceph-mon[98532]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-06T23:10:08.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:07 smithi190 ceph-mon[102658]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-06T23:10:08.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:07 smithi156 ceph-mon[102862]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-06T23:10:09.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:08 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-06T23:10:09.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:08 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:09.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:08 smithi008 ceph-mon[98532]: Deploying daemon osd.11 on smithi190 2023-10-06T23:10:09.164 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:08 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-06T23:10:09.164 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:08 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:09.164 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:08 smithi190 ceph-mon[102658]: Deploying daemon osd.11 on smithi190 2023-10-06T23:10:09.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:08 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-06T23:10:09.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:08 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:09.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:08 smithi156 ceph-mon[102862]: Deploying daemon osd.11 on smithi190 2023-10-06T23:10:10.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:09 smithi008 ceph-mon[98532]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-06T23:10:10.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:09 smithi190 ceph-mon[102658]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-06T23:10:10.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:09 smithi156 ceph-mon[102862]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-06T23:10:12.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:11 smithi156 ceph-mon[102862]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:12.350 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:11 smithi190 ceph-mon[102658]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:11 smithi008 ceph-mon[98532]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:14.191 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:13 smithi190 ceph-mon[102658]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:14.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:13 smithi156 ceph-mon[102862]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:13 smithi008 ceph-mon[98532]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:15.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:15 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:15.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:15 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:15.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:15 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:15.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:15 smithi156 ceph-mon[102862]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:15 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:15 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:15 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:15.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:15 smithi008 ceph-mon[98532]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:15.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:15 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:15.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:15 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:15.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:15 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:15.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:15 smithi190 ceph-mon[102658]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:17.564 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.562+0000 7f223ffff700 1 -- 172.21.15.190:0/3955599717 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f22580612f0 con 0x7f22400a1500 2023-10-06T23:10:17.564 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 11 on host 'smithi190' 2023-10-06T23:10:17.566 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f22400a1500 msgr2=0x7f22400a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:17.566 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f22400a1500 0x7f22400a39c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f224c007c60 tx=0x7f224c0073d0 comp rx=0 tx=0).stop 2023-10-06T23:10:17.566 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 msgr2=0x7f2258074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:17.566 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 0x7f2258074c50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2248004730 tx=0x7f2248004760 comp rx=0 tx=0).stop 2023-10-06T23:10:17.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 shutdown_connections 2023-10-06T23:10:17.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f22400a1500 0x7f22400a39c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:17.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2258102b10 0x7f22580737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:17.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2258100f70 0x7f2258074c50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:17.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 --2- 172.21.15.190:0/3955599717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2258102170 0x7f22580732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:17.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.564+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 >> 172.21.15.190:0/3955599717 conn(0x7f22580fc4d0 msgr2=0x7f22580fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:17.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.565+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 shutdown_connections 2023-10-06T23:10:17.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:17.565+0000 7f225d6ae700 1 -- 172.21.15.190:0/3955599717 wait complete. 2023-10-06T23:10:17.993 DEBUG:teuthology.orchestra.run.smithi190:osd.11> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-06T23:10:17.998 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-06T23:10:17.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-06T23:10:18.075 INFO:journalctl@ceph.osd.11.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:10:18.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:17 smithi008 ceph-mon[98532]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:17 smithi190 ceph-mon[102658]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:18.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.193 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:10:18 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:10:18.083+0000 7f31ef1e3640 -1 osd.11 0 log_to_monitors true 2023-10-06T23:10:18.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:17 smithi156 ceph-mon[102862]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:18.746 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:10:19.046 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:18 smithi190 ceph-mon[102658]: from='osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-06T23:10:19.046 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:18 smithi190 ceph-mon[102658]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-06T23:10:19.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:18 smithi008 ceph-mon[98532]: from='osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-06T23:10:19.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:18 smithi008 ceph-mon[98532]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-06T23:10:19.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:18 smithi156 ceph-mon[102862]: from='osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-06T23:10:19.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:18 smithi156 ceph-mon[102862]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-06T23:10:19.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:19 smithi008 ceph-mon[98532]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-06T23:10:19.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:19 smithi008 ceph-mon[98532]: osdmap e79: 12 total, 11 up, 12 in 2023-10-06T23:10:19.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:19 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:19.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:19 smithi008 ceph-mon[98532]: from='osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:10:19.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:19 smithi008 ceph-mon[98532]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:10:19.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:19 smithi008 ceph-mon[98532]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:19.943 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:10:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:10:19.882+0000 7f31e485a700 -1 osd.11 0 waiting for initial osdmap 2023-10-06T23:10:19.943 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:10:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:10:19.907+0000 7f31de64b700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T23:10:19.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:19 smithi190 ceph-mon[102658]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-06T23:10:19.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:19 smithi190 ceph-mon[102658]: osdmap e79: 12 total, 11 up, 12 in 2023-10-06T23:10:19.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:19 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:19.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:19 smithi190 ceph-mon[102658]: from='osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:10:19.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:19 smithi190 ceph-mon[102658]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:10:19.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:19 smithi190 ceph-mon[102658]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.256+0000 7f9979fb9700 1 -- 172.21.15.8:0/3200976283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974108e40 msgr2=0x7f997410b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.256+0000 7f9979fb9700 1 --2- 172.21.15.8:0/3200976283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974108e40 0x7f997410b2d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f996c00b0a0 tx=0x7f996c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.257+0000 7f9979fb9700 1 -- 172.21.15.8:0/3200976283 shutdown_connections 2023-10-06T23:10:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.257+0000 7f9979fb9700 1 --2- 172.21.15.8:0/3200976283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974108e40 0x7f997410b2d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.257+0000 7f9979fb9700 1 --2- 172.21.15.8:0/3200976283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9974074ee0 0x7f9974073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.257+0000 7f9979fb9700 1 --2- 172.21.15.8:0/3200976283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9974073910 0x7f9974073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.257+0000 7f9979fb9700 1 -- 172.21.15.8:0/3200976283 >> 172.21.15.8:0/3200976283 conn(0x7f99740fc4d0 msgr2=0x7f99740fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:20.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.257+0000 7f9979fb9700 1 -- 172.21.15.8:0/3200976283 shutdown_connections 2023-10-06T23:10:20.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.257+0000 7f9979fb9700 1 -- 172.21.15.8:0/3200976283 wait complete. 2023-10-06T23:10:20.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.258+0000 7f9979fb9700 1 Processor -- start 2023-10-06T23:10:20.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.258+0000 7f9979fb9700 1 -- start start 2023-10-06T23:10:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f9979fb9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974073910 0x7f9974198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f9979fb9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9974074ee0 0x7f99741993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f9979fb9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9974108e40 0x7f99741a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f9979fb9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99741a0a00 con 0x7f9974073910 2023-10-06T23:10:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f9979fb9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99741a0b40 con 0x7f9974074ee0 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f9979fb9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99741a0cd0 con 0x7f9974108e40 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f99737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974073910 0x7f9974198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f99737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974073910 0x7f9974198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40114/0 (socket says 172.21.15.8:40114) 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f99737fe700 1 -- 172.21.15.8:0/1213735657 learned_addr learned my addr 172.21.15.8:0/1213735657 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f9973fff700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9974108e40 0x7f99741a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.259+0000 7f9972ffd700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9974074ee0 0x7f99741993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f99737fe700 1 -- 172.21.15.8:0/1213735657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9974108e40 msgr2=0x7f99741a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f99737fe700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9974108e40 0x7f99741a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f99737fe700 1 -- 172.21.15.8:0/1213735657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9974074ee0 msgr2=0x7f99741993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f99737fe700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9974074ee0 0x7f99741993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f99737fe700 1 -- 172.21.15.8:0/1213735657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c009d00 con 0x7f9974073910 2023-10-06T23:10:20.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f9972ffd700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9974074ee0 0x7f99741993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:10:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f9973fff700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9974108e40 0x7f99741a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:10:20.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f99737fe700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974073910 0x7f9974198e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f996400d9b0 tx=0x7f996400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f9970ff9700 1 -- 172.21.15.8:0/1213735657 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964009930 con 0x7f9974073910 2023-10-06T23:10:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f9970ff9700 1 -- 172.21.15.8:0/1213735657 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9964010460 con 0x7f9974073910 2023-10-06T23:10:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f9970ff9700 1 -- 172.21.15.8:0/1213735657 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996400f620 con 0x7f9974073910 2023-10-06T23:10:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.260+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99741a0fb0 con 0x7f9974073910 2023-10-06T23:10:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.261+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99741a1370 con 0x7f9974073910 2023-10-06T23:10:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.262+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99741074f0 con 0x7f9974073910 2023-10-06T23:10:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.264+0000 7f9970ff9700 1 -- 172.21.15.8:0/1213735657 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f99640105d0 con 0x7f9974073910 2023-10-06T23:10:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.265+0000 7f9970ff9700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f995c0a1500 0x7f995c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.265+0000 7f9970ff9700 1 -- 172.21.15.8:0/1213735657 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f99640cc1a0 con 0x7f9974073910 2023-10-06T23:10:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.265+0000 7f9972ffd700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f995c0a1500 0x7f995c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:20.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.266+0000 7f9972ffd700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f995c0a1500 0x7f995c0a39c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9974074c10 tx=0x7f9968009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:20.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.269+0000 7f9970ff9700 1 -- 172.21.15.8:0/1213735657 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9964095d20 con 0x7f9974073910 2023-10-06T23:10:20.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:19 smithi156 ceph-mon[102862]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-06T23:10:20.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:19 smithi156 ceph-mon[102862]: osdmap e79: 12 total, 11 up, 12 in 2023-10-06T23:10:20.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:19 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:20.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:19 smithi156 ceph-mon[102862]: from='osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:10:20.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:19 smithi156 ceph-mon[102862]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-10-06T23:10:20.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:19 smithi156 ceph-mon[102862]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-06T23:10:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.480+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f997410e840 con 0x7f9974073910 2023-10-06T23:10:20.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.480+0000 7f9970ff9700 1 -- 172.21.15.8:0/1213735657 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f9964099340 con 0x7f9974073910 2023-10-06T23:10:20.482 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:20.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f995c0a1500 msgr2=0x7f995c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:20.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f995c0a1500 0x7f995c0a39c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9974074c10 tx=0x7f9968009260 comp rx=0 tx=0).stop 2023-10-06T23:10:20.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974073910 msgr2=0x7f9974198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:20.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974073910 0x7f9974198e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f996400d9b0 tx=0x7f996400dcc0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 shutdown_connections 2023-10-06T23:10:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f995c0a1500 0x7f995c0a39c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9974073910 0x7f9974198e70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9974108e40 0x7f99741a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 --2- 172.21.15.8:0/1213735657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9974074ee0 0x7f99741993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 >> 172.21.15.8:0/1213735657 conn(0x7f99740fc4d0 msgr2=0x7f99740fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 shutdown_connections 2023-10-06T23:10:20.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:20.483+0000 7f9979fb9700 1 -- 172.21.15.8:0/1213735657 wait complete. 2023-10-06T23:10:21.030 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1696633794,"num_in_osds":12,"osd_in_since":1696633800,"num_remapped_pgs":0} 2023-10-06T23:10:21.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:20 smithi008 ceph-mon[98532]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:10:21.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:20 smithi008 ceph-mon[98532]: osdmap e80: 12 total, 11 up, 12 in 2023-10-06T23:10:21.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:21.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:20 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:21.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:20 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1213735657' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-06T23:10:21.154 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:20 smithi190 ceph-mon[102658]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:10:21.154 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:20 smithi190 ceph-mon[102658]: osdmap e80: 12 total, 11 up, 12 in 2023-10-06T23:10:21.154 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:20 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:21.155 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:20 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:21.155 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:20 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1213735657' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-06T23:10:21.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:20 smithi156 ceph-mon[102862]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-10-06T23:10:21.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:20 smithi156 ceph-mon[102862]: osdmap e80: 12 total, 11 up, 12 in 2023-10-06T23:10:21.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:20 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:21.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:20 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:21.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:20 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1213735657' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-06T23:10:22.032 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-06T23:10:22.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: purged_snaps scrub starts 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: purged_snaps scrub ok 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] boot 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: osdmap e81: 12 total, 12 up, 12 in 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:22.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:22.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: purged_snaps scrub starts 2023-10-06T23:10:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: purged_snaps scrub ok 2023-10-06T23:10:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] boot 2023-10-06T23:10:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: osdmap e81: 12 total, 12 up, 12 in 2023-10-06T23:10:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: purged_snaps scrub starts 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: purged_snaps scrub ok 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: osd.11 [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] boot 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: osdmap e81: 12 total, 12 up, 12 in 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:10:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:10:23.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:22 smithi008 ceph-mon[98532]: Detected new or changed devices on smithi190 2023-10-06T23:10:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:22 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi190 to 4316M 2023-10-06T23:10:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:22 smithi008 ceph-mon[98532]: osdmap e82: 12 total, 12 up, 12 in 2023-10-06T23:10:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:23.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:23.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:22 smithi190 ceph-mon[102658]: Detected new or changed devices on smithi190 2023-10-06T23:10:23.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:22 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi190 to 4316M 2023-10-06T23:10:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:22 smithi190 ceph-mon[102658]: osdmap e82: 12 total, 12 up, 12 in 2023-10-06T23:10:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:23.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:22 smithi156 ceph-mon[102862]: Detected new or changed devices on smithi190 2023-10-06T23:10:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:22 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi190 to 4316M 2023-10-06T23:10:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:22 smithi156 ceph-mon[102862]: osdmap e82: 12 total, 12 up, 12 in 2023-10-06T23:10:23.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:23.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:23.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:24.126 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:23 smithi008 ceph-mon[98532]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:24.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:23 smithi190 ceph-mon[102658]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:24.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:23 smithi156 ceph-mon[102862]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 -- 172.21.15.8:0/1666461894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88102170 msgr2=0x7f3b881025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1666461894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88102170 0x7f3b881025d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b780099c0 tx=0x7f3b78009cd0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 -- 172.21.15.8:0/1666461894 shutdown_connections 2023-10-06T23:10:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1666461894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b88102b10 0x7f3b881093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1666461894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b88100f70 0x7f3b88101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1666461894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88102170 0x7f3b881025d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 -- 172.21.15.8:0/1666461894 >> 172.21.15.8:0/1666461894 conn(0x7f3b880fc4d0 msgr2=0x7f3b880fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 -- 172.21.15.8:0/1666461894 shutdown_connections 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.372+0000 7f3b9019f700 1 -- 172.21.15.8:0/1666461894 wait complete. 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.373+0000 7f3b9019f700 1 Processor -- start 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.373+0000 7f3b9019f700 1 -- start start 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b9019f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88100f70 0x7f3b88198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b9019f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b88102170 0x7f3b881991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b9019f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b88102b10 0x7f3b881a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b9019f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b881a0830 con 0x7f3b88100f70 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b9019f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b881a0970 con 0x7f3b88102170 2023-10-06T23:10:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b9019f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b881a0b30 con 0x7f3b88102b10 2023-10-06T23:10:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8df3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88100f70 0x7f3b88198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8df3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88100f70 0x7f3b88198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40122/0 (socket says 172.21.15.8:40122) 2023-10-06T23:10:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8df3b700 1 -- 172.21.15.8:0/1686981738 learned_addr learned my addr 172.21.15.8:0/1686981738 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8e73c700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b88102b10 0x7f3b881a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8d73a700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b88102170 0x7f3b881991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8df3b700 1 -- 172.21.15.8:0/1686981738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b88102b10 msgr2=0x7f3b881a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:24.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8df3b700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b88102b10 0x7f3b881a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8df3b700 1 -- 172.21.15.8:0/1686981738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b88102170 msgr2=0x7f3b881991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:24.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8df3b700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b88102170 0x7f3b881991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8df3b700 1 -- 172.21.15.8:0/1686981738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780095f0 con 0x7f3b88100f70 2023-10-06T23:10:24.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.374+0000 7f3b8e73c700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b88102b10 0x7f3b881a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:10:24.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.375+0000 7f3b8df3b700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88100f70 0x7f3b88198cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400d980 tx=0x7f3b8400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:24.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.375+0000 7f3b7effd700 1 -- 172.21.15.8:0/1686981738 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400de60 con 0x7f3b88100f70 2023-10-06T23:10:24.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.375+0000 7f3b7effd700 1 -- 172.21.15.8:0/1686981738 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b840044b0 con 0x7f3b88100f70 2023-10-06T23:10:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.375+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b881a0e10 con 0x7f3b88100f70 2023-10-06T23:10:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.375+0000 7f3b7effd700 1 -- 172.21.15.8:0/1686981738 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84003b40 con 0x7f3b88100f70 2023-10-06T23:10:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.375+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b881a1280 con 0x7f3b88100f70 2023-10-06T23:10:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.376+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b88193410 con 0x7f3b88100f70 2023-10-06T23:10:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.378+0000 7f3b7effd700 1 -- 172.21.15.8:0/1686981738 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3b84003ca0 con 0x7f3b88100f70 2023-10-06T23:10:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.379+0000 7f3b7effd700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3b740a1500 0x7f3b740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.379+0000 7f3b7effd700 1 -- 172.21.15.8:0/1686981738 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3b840cc590 con 0x7f3b88100f70 2023-10-06T23:10:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.379+0000 7f3b8d73a700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3b740a1500 0x7f3b740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:24.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.380+0000 7f3b8d73a700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3b740a1500 0x7f3b740a39c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b8819a1c0 tx=0x7f3b78005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:24.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.384+0000 7f3b7effd700 1 -- 172.21.15.8:0/1686981738 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b84095ff0 con 0x7f3b88100f70 2023-10-06T23:10:24.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.595+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f3b8810c620 con 0x7f3b88100f70 2023-10-06T23:10:24.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.596+0000 7f3b7effd700 1 -- 172.21.15.8:0/1686981738 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7f3b84009940 con 0x7f3b88100f70 2023-10-06T23:10:24.597 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3b740a1500 msgr2=0x7f3b740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:24.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3b740a1500 0x7f3b740a39c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b8819a1c0 tx=0x7f3b78005fb0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88100f70 msgr2=0x7f3b88198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88100f70 0x7f3b88198cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400d980 tx=0x7f3b8400dd40 comp rx=0 tx=0).stop 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 shutdown_connections 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3b740a1500 0x7f3b740a39c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b88100f70 0x7f3b88198cb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b88102b10 0x7f3b881a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 --2- 172.21.15.8:0/1686981738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b88102170 0x7f3b881991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 >> 172.21.15.8:0/1686981738 conn(0x7f3b880fc4d0 msgr2=0x7f3b88107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 shutdown_connections 2023-10-06T23:10:24.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:24.598+0000 7f3b9019f700 1 -- 172.21.15.8:0/1686981738 wait complete. 2023-10-06T23:10:25.055 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1696633820,"num_in_osds":12,"osd_in_since":1696633800,"num_remapped_pgs":0} 2023-10-06T23:10:25.056 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-06T23:10:25.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:24 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1686981738' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-06T23:10:25.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:24 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1686981738' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-06T23:10:25.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:24 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1686981738' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-06T23:10:25.790 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:10:26.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:25 smithi190 ceph-mon[102658]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:26.193 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:25 smithi008 ceph-mon[98532]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:25 smithi156 ceph-mon[102862]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 -- 172.21.15.8:0/2874442769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c100f80 msgr2=0x7f6f7c101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 --2- 172.21.15.8:0/2874442769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c100f80 0x7f6f7c101400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f700099c0 tx=0x7f6f70009cd0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 -- 172.21.15.8:0/2874442769 shutdown_connections 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 --2- 172.21.15.8:0/2874442769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c101940 0x7f6f7c10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 --2- 172.21.15.8:0/2874442769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f7c106f90 0x7f6f7c107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 --2- 172.21.15.8:0/2874442769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c100f80 0x7f6f7c101400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 -- 172.21.15.8:0/2874442769 >> 172.21.15.8:0/2874442769 conn(0x7f6f7c0780a0 msgr2=0x7f6f7c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 -- 172.21.15.8:0/2874442769 shutdown_connections 2023-10-06T23:10:27.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.314+0000 7f6f827d7700 1 -- 172.21.15.8:0/2874442769 wait complete. 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.315+0000 7f6f827d7700 1 Processor -- start 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.315+0000 7f6f827d7700 1 -- start start 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f827d7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f7c100f80 0x7f6f7c196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f827d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c101940 0x7f6f7c1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f827d7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c106f90 0x7f6f7c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f827d7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c19be50 con 0x7f6f7c101940 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f827d7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c19bfc0 con 0x7f6f7c100f80 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f827d7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c19c180 con 0x7f6f7c106f90 2023-10-06T23:10:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f7b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c101940 0x7f6f7c1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f7b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c101940 0x7f6f7c1973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40150/0 (socket says 172.21.15.8:40150) 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f7b7fe700 1 -- 172.21.15.8:0/574126834 learned_addr learned my addr 172.21.15.8:0/574126834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f7bfff700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f7c100f80 0x7f6f7c196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.316+0000 7f6f80d74700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c106f90 0x7f6f7c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f7b7fe700 1 -- 172.21.15.8:0/574126834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c106f90 msgr2=0x7f6f7c19b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f7b7fe700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c106f90 0x7f6f7c19b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f7b7fe700 1 -- 172.21.15.8:0/574126834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f7c100f80 msgr2=0x7f6f7c196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f7b7fe700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f7c100f80 0x7f6f7c196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f7b7fe700 1 -- 172.21.15.8:0/574126834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f700095f0 con 0x7f6f7c101940 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f80d74700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c106f90 0x7f6f7c19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:10:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f7b7fe700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c101940 0x7f6f7c1973d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009f50 tx=0x7f6f70005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:27.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f797fa700 1 -- 172.21.15.8:0/574126834 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7001d070 con 0x7f6f7c101940 2023-10-06T23:10:27.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c19c400 con 0x7f6f7c101940 2023-10-06T23:10:27.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f797fa700 1 -- 172.21.15.8:0/574126834 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6f70003fc0 con 0x7f6f7c101940 2023-10-06T23:10:27.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f797fa700 1 -- 172.21.15.8:0/574126834 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70022d10 con 0x7f6f7c101940 2023-10-06T23:10:27.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.317+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c1a3cc0 con 0x7f6f7c101940 2023-10-06T23:10:27.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.318+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c04ebb0 con 0x7f6f7c101940 2023-10-06T23:10:27.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.320+0000 7f6f797fa700 1 -- 172.21.15.8:0/574126834 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6f70022470 con 0x7f6f7c101940 2023-10-06T23:10:27.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.322+0000 7f6f797fa700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6f640a1500 0x7f6f640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:27.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.322+0000 7f6f797fa700 1 -- 172.21.15.8:0/574126834 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6f700cdc20 con 0x7f6f7c101940 2023-10-06T23:10:27.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.322+0000 7f6f7bfff700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6f640a1500 0x7f6f640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:27.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.322+0000 7f6f7bfff700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6f640a1500 0x7f6f640a39c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c005950 tx=0x7f6f6c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:27.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.326+0000 7f6f797fa700 1 -- 172.21.15.8:0/574126834 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6f70097710 con 0x7f6f7c101940 2023-10-06T23:10:27.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.537+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f7c1981f0 con 0x7f6f7c101940 2023-10-06T23:10:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.538+0000 7f6f797fa700 1 -- 172.21.15.8:0/574126834 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f6f7009ad30 con 0x7f6f7c101940 2023-10-06T23:10:27.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:27.540 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":82,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:10:21.885807+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:10:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6f640a1500 msgr2=0x7f6f640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6f640a1500 0x7f6f640a39c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c005950 tx=0x7f6f6c00b410 comp rx=0 tx=0).stop 2023-10-06T23:10:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c101940 msgr2=0x7f6f7c1973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c101940 0x7f6f7c1973d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009f50 tx=0x7f6f70005740 comp rx=0 tx=0).stop 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 shutdown_connections 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6f640a1500 0x7f6f640a39c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c106f90 0x7f6f7c19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f7c100f80 0x7f6f7c196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 --2- 172.21.15.8:0/574126834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f7c101940 0x7f6f7c1973d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 >> 172.21.15.8:0/574126834 conn(0x7f6f7c0780a0 msgr2=0x7f6f7c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 shutdown_connections 2023-10-06T23:10:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:27.541+0000 7f6f827d7700 1 -- 172.21.15.8:0/574126834 wait complete. 2023-10-06T23:10:28.068 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:10:28.068 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-06T23:10:28.132 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:27 smithi008 ceph-mon[98532]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:28.132 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:27 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/574126834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:10:28.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:27 smithi190 ceph-mon[102658]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:28.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:27 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/574126834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:10:28.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:27 smithi156 ceph-mon[102862]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:28.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:27 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/574126834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:10:28.804 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:10:30.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 -- 172.21.15.8:0/592399211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840101940 msgr2=0x7f084010ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 --2- 172.21.15.8:0/592399211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840101940 0x7f084010ddb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f083800b0d0 tx=0x7f083800b3e0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 -- 172.21.15.8:0/592399211 shutdown_connections 2023-10-06T23:10:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 --2- 172.21.15.8:0/592399211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840101940 0x7f084010ddb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 --2- 172.21.15.8:0/592399211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0840106f90 0x7f0840107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 --2- 172.21.15.8:0/592399211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0840100f80 0x7f0840101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 -- 172.21.15.8:0/592399211 >> 172.21.15.8:0/592399211 conn(0x7f08400780a0 msgr2=0x7f08400784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 -- 172.21.15.8:0/592399211 shutdown_connections 2023-10-06T23:10:30.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.317+0000 7f084597c700 1 -- 172.21.15.8:0/592399211 wait complete. 2023-10-06T23:10:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.319+0000 7f084597c700 1 Processor -- start 2023-10-06T23:10:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.319+0000 7f084597c700 1 -- start start 2023-10-06T23:10:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.319+0000 7f084597c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0840100f80 0x7f0840199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.319+0000 7f084597c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0840101940 0x7f08401996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.319+0000 7f084597c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840106f90 0x7f084019db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.319+0000 7f084597c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084019e140 con 0x7f0840106f90 2023-10-06T23:10:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.319+0000 7f084597c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084019e2b0 con 0x7f0840100f80 2023-10-06T23:10:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f084597c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084019e470 con 0x7f0840101940 2023-10-06T23:10:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840106f90 0x7f084019db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:30.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0840100f80 0x7f0840199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:30.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0840100f80 0x7f0840199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49994/0 (socket says 172.21.15.8:49994) 2023-10-06T23:10:30.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840106f90 0x7f084019db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55844/0 (socket says 172.21.15.8:55844) 2023-10-06T23:10:30.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083effd700 1 -- 172.21.15.8:0/776656023 learned_addr learned my addr 172.21.15.8:0/776656023 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083e7fc700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0840101940 0x7f08401996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083f7fe700 1 -- 172.21.15.8:0/776656023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0840101940 msgr2=0x7f08401996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083f7fe700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0840101940 0x7f08401996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083f7fe700 1 -- 172.21.15.8:0/776656023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0840100f80 msgr2=0x7f0840199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083f7fe700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0840100f80 0x7f0840199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083f7fe700 1 -- 172.21.15.8:0/776656023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838009d00 con 0x7f0840106f90 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083e7fc700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0840101940 0x7f08401996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.320+0000 7f083f7fe700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840106f90 0x7f084019db30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f083800b770 tx=0x7f0838008e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.321+0000 7f084497a700 1 -- 172.21.15.8:0/776656023 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800e040 con 0x7f0840106f90 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.321+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084019e6f0 con 0x7f0840106f90 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.321+0000 7f084497a700 1 -- 172.21.15.8:0/776656023 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f083801d900 con 0x7f0840106f90 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.321+0000 7f084497a700 1 -- 172.21.15.8:0/776656023 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083801b7e0 con 0x7f0840106f90 2023-10-06T23:10:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.321+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08401a5fb0 con 0x7f0840106f90 2023-10-06T23:10:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.322+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084004ebb0 con 0x7f0840106f90 2023-10-06T23:10:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.324+0000 7f084497a700 1 -- 172.21.15.8:0/776656023 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f083801da70 con 0x7f0840106f90 2023-10-06T23:10:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.325+0000 7f084497a700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08280a1480 0x7f08280a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.325+0000 7f084497a700 1 -- 172.21.15.8:0/776656023 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f08380cdc20 con 0x7f0840106f90 2023-10-06T23:10:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.325+0000 7f083effd700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08280a1480 0x7f08280a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:30.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.326+0000 7f083effd700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08280a1480 0x7f08280a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0830007c90 tx=0x7f0830007480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:30.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.329+0000 7f084497a700 1 -- 172.21.15.8:0/776656023 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0838097710 con 0x7f0840106f90 2023-10-06T23:10:30.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:29 smithi156 ceph-mon[102862]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:29 smithi008 ceph-mon[98532]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:30.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:29 smithi190 ceph-mon[102658]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:30.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.537+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0840110d80 con 0x7f0840106f90 2023-10-06T23:10:30.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.538+0000 7f084497a700 1 -- 172.21.15.8:0/776656023 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f083809ad30 con 0x7f0840106f90 2023-10-06T23:10:30.539 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:10:30.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08280a1480 msgr2=0x7f08280a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08280a1480 0x7f08280a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0830007c90 tx=0x7f0830007480 comp rx=0 tx=0).stop 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840106f90 msgr2=0x7f084019db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840106f90 0x7f084019db30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f083800b770 tx=0x7f0838008e50 comp rx=0 tx=0).stop 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 shutdown_connections 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08280a1480 0x7f08280a3940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0840106f90 0x7f084019db30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0840100f80 0x7f0840199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 --2- 172.21.15.8:0/776656023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0840101940 0x7f08401996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 >> 172.21.15.8:0/776656023 conn(0x7f08400780a0 msgr2=0x7f08400730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 shutdown_connections 2023-10-06T23:10:30.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:30.540+0000 7f084597c700 1 -- 172.21.15.8:0/776656023 wait complete. 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.a on smithi008 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.d on smithi008 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.g on smithi008 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.j on smithi008 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.b on smithi156 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.e on smithi156 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.h on smithi156 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.k on smithi156 2023-10-06T23:10:31.079 INFO:tasks.cephadm:Adding mds.c on smithi190 2023-10-06T23:10:31.080 INFO:tasks.cephadm:Adding mds.f on smithi190 2023-10-06T23:10:31.080 INFO:tasks.cephadm:Adding mds.i on smithi190 2023-10-06T23:10:31.080 INFO:tasks.cephadm:Adding mds.l on smithi190 2023-10-06T23:10:31.080 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l' 2023-10-06T23:10:31.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:30 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/776656023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:10:31.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:30 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/776656023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:10:31.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:30 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/776656023' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:10:31.814 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:10:32.310 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:31 smithi190 ceph-mon[102658]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:32.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:31 smithi156 ceph-mon[102862]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:31 smithi008 ceph-mon[98532]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:33.346 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.344+0000 7fcb32ffe700 1 -- 172.21.15.190:0/3262432258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 msgr2=0x7fcb2c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:33.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.344+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/3262432258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 0x7fcb2c1093c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400b0a0 tx=0x7fcb2400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.344+0000 7fcb32ffe700 1 -- 172.21.15.190:0/3262432258 shutdown_connections 2023-10-06T23:10:33.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.344+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/3262432258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 0x7fcb2c1093c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.344+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/3262432258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb2c100f70 0x7fcb2c101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.344+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/3262432258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb2c102170 0x7fcb2c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.344+0000 7fcb32ffe700 1 -- 172.21.15.190:0/3262432258 >> 172.21.15.190:0/3262432258 conn(0x7fcb2c0fc4d0 msgr2=0x7fcb2c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:33.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.344+0000 7fcb32ffe700 1 -- 172.21.15.190:0/3262432258 shutdown_connections 2023-10-06T23:10:33.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.345+0000 7fcb32ffe700 1 -- 172.21.15.190:0/3262432258 wait complete. 2023-10-06T23:10:33.349 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.345+0000 7fcb32ffe700 1 Processor -- start 2023-10-06T23:10:33.349 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb32ffe700 1 -- start start 2023-10-06T23:10:33.349 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb32ffe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb2c100f70 0x7fcb2c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:33.349 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb32ffe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb2c102170 0x7fcb2c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:33.349 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb32ffe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 0x7fcb2c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:33.349 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb32ffe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1a09e0 con 0x7fcb2c102170 2023-10-06T23:10:33.349 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb32ffe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1a0b20 con 0x7fcb2c100f70 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb32ffe700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1a0cb0 con 0x7fcb2c102b10 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb3159b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 0x7fcb2c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb3159b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 0x7fcb2c1a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:51858/0 (socket says 172.21.15.190:51858) 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb3159b700 1 -- 172.21.15.190:0/383849400 learned_addr learned my addr 172.21.15.190:0/383849400 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.346+0000 7fcb2bfff700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb2c102170 0x7fcb2c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb30d9a700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb2c100f70 0x7fcb2c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb3159b700 1 -- 172.21.15.190:0/383849400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb2c100f70 msgr2=0x7fcb2c198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb3159b700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb2c100f70 0x7fcb2c198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb3159b700 1 -- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb2c102170 msgr2=0x7fcb2c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb3159b700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb2c102170 0x7fcb2c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.350 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb3159b700 1 -- 172.21.15.190:0/383849400 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24009d00 con 0x7fcb2c102b10 2023-10-06T23:10:33.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb30d9a700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb2c100f70 0x7fcb2c198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:10:33.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb3159b700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 0x7fcb2c1a0410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcb240079f0 tx=0x7fcb2400be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:33.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb29ffb700 1 -- 172.21.15.190:0/383849400 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400e040 con 0x7fcb2c102b10 2023-10-06T23:10:33.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb29ffb700 1 -- 172.21.15.190:0/383849400 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb24004e60 con 0x7fcb2c102b10 2023-10-06T23:10:33.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c1a0f30 con 0x7fcb2c102b10 2023-10-06T23:10:33.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb29ffb700 1 -- 172.21.15.190:0/383849400 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24005390 con 0x7fcb2c102b10 2023-10-06T23:10:33.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.347+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c1a12e0 con 0x7fcb2c102b10 2023-10-06T23:10:33.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.348+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c10c5e0 con 0x7fcb2c102b10 2023-10-06T23:10:33.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.350+0000 7fcb29ffb700 1 -- 172.21.15.190:0/383849400 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fcb2401d470 con 0x7fcb2c102b10 2023-10-06T23:10:33.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.352+0000 7fcb29ffb700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb1c0a1480 0x7fcb1c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:33.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.352+0000 7fcb29ffb700 1 -- 172.21.15.190:0/383849400 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcb240ce4d0 con 0x7fcb2c102b10 2023-10-06T23:10:33.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.352+0000 7fcb30d9a700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb1c0a1480 0x7fcb1c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:33.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.353+0000 7fcb30d9a700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb1c0a1480 0x7fcb1c0a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb20005fd0 tx=0x7fcb20005f00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:33.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.354+0000 7fcb29ffb700 1 -- 172.21.15.190:0/383849400 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcb24097fc0 con 0x7fcb2c102b10 2023-10-06T23:10:33.561 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.560+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb2c108bf0 con 0x7fcb1c0a1480 2023-10-06T23:10:33.571 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.569+0000 7fcb29ffb700 1 -- 172.21.15.190:0/383849400 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fcb2c108bf0 con 0x7fcb1c0a1480 2023-10-06T23:10:33.571 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mds.all update... 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb1c0a1480 msgr2=0x7fcb1c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb1c0a1480 0x7fcb1c0a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb20005fd0 tx=0x7fcb20005f00 comp rx=0 tx=0).stop 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 msgr2=0x7fcb2c1a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 0x7fcb2c1a0410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcb240079f0 tx=0x7fcb2400be10 comp rx=0 tx=0).stop 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 shutdown_connections 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb1c0a1480 0x7fcb1c0a3940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb2c102b10 0x7fcb2c1a0410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb2c100f70 0x7fcb2c198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.574 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 --2- 172.21.15.190:0/383849400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb2c102170 0x7fcb2c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:33.575 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 >> 172.21.15.190:0/383849400 conn(0x7fcb2c0fc4d0 msgr2=0x7fcb2c0fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:33.575 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 shutdown_connections 2023-10-06T23:10:33.575 INFO:teuthology.orchestra.run.smithi190.stderr:2023-10-06T23:10:33.572+0000 7fcb32ffe700 1 -- 172.21.15.190:0/383849400 wait complete. 2023-10-06T23:10:34.090 DEBUG:teuthology.orchestra.run.smithi008:mds.a> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-06T23:10:34.095 DEBUG:teuthology.orchestra.run.smithi008:mds.d> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-06T23:10:34.143 DEBUG:teuthology.orchestra.run.smithi008:mds.g> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-06T23:10:34.180 INFO:journalctl@ceph.mds.a.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:10:34.184 DEBUG:teuthology.orchestra.run.smithi008:mds.j> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-06T23:10:34.219 INFO:journalctl@ceph.mds.d.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:10:34.222 DEBUG:teuthology.orchestra.run.smithi156:mds.b> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-06T23:10:34.227 DEBUG:teuthology.orchestra.run.smithi156:mds.e> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-06T23:10:34.256 INFO:journalctl@ceph.mds.g.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:10:34.273 DEBUG:teuthology.orchestra.run.smithi156:mds.h> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-06T23:10:34.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:34.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:34.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:34.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:34.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:34.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:34.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:34.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:34.281 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:34.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:34.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:34.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:34.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:34.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:34.292 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:34.292 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:34.292 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:34.292 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:34.293 INFO:journalctl@ceph.mds.j.smithi008.stdout:-- Logs begin at Fri 2023-10-06 22:44:51 UTC. -- 2023-10-06T23:10:34.294 DEBUG:teuthology.orchestra.run.smithi156:mds.k> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-06T23:10:34.306 INFO:journalctl@ceph.mds.b.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:10:34.310 DEBUG:teuthology.orchestra.run.smithi190:mds.c> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-06T23:10:34.314 DEBUG:teuthology.orchestra.run.smithi190:mds.f> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-06T23:10:34.347 INFO:journalctl@ceph.mds.e.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:10:34.359 DEBUG:teuthology.orchestra.run.smithi190:mds.i> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-06T23:10:34.368 INFO:journalctl@ceph.mds.h.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:10:34.376 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:34.376 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:34.376 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:10:34.376 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:34.376 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:10:34.377 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:34.377 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:34.377 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:34.377 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:34.379 INFO:journalctl@ceph.mds.k.smithi156.stdout:-- Logs begin at Fri 2023-10-06 22:44:35 UTC. -- 2023-10-06T23:10:34.380 DEBUG:teuthology.orchestra.run.smithi190:mds.l> sudo journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-06T23:10:34.393 INFO:journalctl@ceph.mds.c.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:10:34.396 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-06T23:10:34.397 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:10:34.440 INFO:journalctl@ceph.mds.f.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:10:34.462 INFO:journalctl@ceph.mds.i.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:10:34.470 INFO:journalctl@ceph.mds.l.smithi190.stdout:-- Logs begin at Fri 2023-10-06 22:45:03 UTC. -- 2023-10-06T23:10:34.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.617+0000 7f8df59ff700 1 -- 172.21.15.8:0/3072275429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0100ea0 msgr2=0x7f8df01012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:34.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.617+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3072275429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0100ea0 0x7f8df01012c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009990 tx=0x7f8de0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.617+0000 7f8df59ff700 1 -- 172.21.15.8:0/3072275429 shutdown_connections 2023-10-06T23:10:34.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.617+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3072275429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0100ea0 0x7f8df01012c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.617+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3072275429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8df0102a40 0x7f8df0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.617+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3072275429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8df0102080 0x7f8df0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.617+0000 7f8df59ff700 1 -- 172.21.15.8:0/3072275429 >> 172.21.15.8:0/3072275429 conn(0x7f8df00fc420 msgr2=0x7f8df00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.618+0000 7f8df59ff700 1 -- 172.21.15.8:0/3072275429 shutdown_connections 2023-10-06T23:10:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.618+0000 7f8df59ff700 1 -- 172.21.15.8:0/3072275429 wait complete. 2023-10-06T23:10:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8df59ff700 1 Processor -- start 2023-10-06T23:10:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8df59ff700 1 -- start start 2023-10-06T23:10:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8df59ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8df0100ea0 0x7f8df0196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8df59ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8df0102080 0x7f8df0197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8df59ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0102a40 0x7f8df019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8df59ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df019e6a0 con 0x7f8df0102a40 2023-10-06T23:10:34.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8df59ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df019e7e0 con 0x7f8df0100ea0 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8df59ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df019e970 con 0x7f8df0102080 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0102a40 0x7f8df019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0102a40 0x7f8df019e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55876/0 (socket says 172.21.15.8:55876) 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8def7fe700 1 -- 172.21.15.8:0/3914764816 learned_addr learned my addr 172.21.15.8:0/3914764816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.619+0000 7f8dee7fc700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8df0102080 0x7f8df0197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8deeffd700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8df0100ea0 0x7f8df0196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8def7fe700 1 -- 172.21.15.8:0/3914764816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8df0102080 msgr2=0x7f8df0197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8def7fe700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8df0102080 0x7f8df0197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8def7fe700 1 -- 172.21.15.8:0/3914764816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8df0100ea0 msgr2=0x7f8df0196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8def7fe700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8df0100ea0 0x7f8df0196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8def7fe700 1 -- 172.21.15.8:0/3914764816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00095f0 con 0x7f8df0102a40 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8deeffd700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8df0100ea0 0x7f8df0196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:10:34.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8def7fe700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0102a40 0x7f8df019e0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8de800ef30 tx=0x7f8de800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8df49fd700 1 -- 172.21.15.8:0/3914764816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8018070 con 0x7f8df0102a40 2023-10-06T23:10:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8df49fd700 1 -- 172.21.15.8:0/3914764816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8de800f040 con 0x7f8df0102a40 2023-10-06T23:10:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df019ebf0 con 0x7f8df0102a40 2023-10-06T23:10:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8df49fd700 1 -- 172.21.15.8:0/3914764816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de800cc70 con 0x7f8df0102a40 2023-10-06T23:10:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.620+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df019f100 con 0x7f8df0102a40 2023-10-06T23:10:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.621+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df0108500 con 0x7f8df0102a40 2023-10-06T23:10:34.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.623+0000 7f8df49fd700 1 -- 172.21.15.8:0/3914764816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8de8007500 con 0x7f8df0102a40 2023-10-06T23:10:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.625+0000 7f8df49fd700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dd80a1550 0x7f8dd80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.625+0000 7f8df49fd700 1 -- 172.21.15.8:0/3914764816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8de80cc3d0 con 0x7f8df0102a40 2023-10-06T23:10:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.625+0000 7f8deeffd700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dd80a1550 0x7f8dd80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:34.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.625+0000 7f8deeffd700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dd80a1550 0x7f8dd80a3a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8de00098e0 tx=0x7f8de0004740 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:34.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.629+0000 7f8df49fd700 1 -- 172.21.15.8:0/3914764816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8de8095ec0 con 0x7f8df0102a40 2023-10-06T23:10:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.840+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8df010c610 con 0x7f8df0102a40 2023-10-06T23:10:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.841+0000 7f8df49fd700 1 -- 172.21.15.8:0/3914764816 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f8de80994e0 con 0x7f8df0102a40 2023-10-06T23:10:34.843 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:34.843 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":82,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:10:21.885807+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:10:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dd80a1550 msgr2=0x7f8dd80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dd80a1550 0x7f8dd80a3a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8de00098e0 tx=0x7f8de0004740 comp rx=0 tx=0).stop 2023-10-06T23:10:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0102a40 msgr2=0x7f8df019e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0102a40 0x7f8df019e0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8de800ef30 tx=0x7f8de800c3a0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 shutdown_connections 2023-10-06T23:10:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dd80a1550 0x7f8dd80a3a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8df0102a40 0x7f8df019e0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8df0100ea0 0x7f8df0196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 --2- 172.21.15.8:0/3914764816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8df0102080 0x7f8df0197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 >> 172.21.15.8:0/3914764816 conn(0x7f8df00fc420 msgr2=0x7f8df0105640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 shutdown_connections 2023-10-06T23:10:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:34.844+0000 7f8df59ff700 1 -- 172.21.15.8:0/3914764816 wait complete. 2023-10-06T23:10:34.865 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:10:34.866 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:10:35.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.071+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/3151607428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74100ea0 msgr2=0x7f3a741012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.071+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/3151607428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74100ea0 0x7f3a741012c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009990 tx=0x7f3a70009ca0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.071+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/3151607428 shutdown_connections 2023-10-06T23:10:35.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.072+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/3151607428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74100ea0 0x7f3a741012c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.072+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/3151607428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a74102a40 0x7f3a74109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.072+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/3151607428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a74102080 0x7f3a74102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.072+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/3151607428 >> 172.21.15.8:0/3151607428 conn(0x7f3a740fc460 msgr2=0x7f3a740fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:35.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.072+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/3151607428 shutdown_connections 2023-10-06T23:10:35.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.072+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/3151607428 wait complete. 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7c5ff700 1 Processor -- start 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7c5ff700 1 -- start start 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7c5ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a74100ea0 0x7f3a74198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7c5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a74102080 0x7f3a741992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7c5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74102a40 0x7f3a741a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7c5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741a08f0 con 0x7f3a74102a40 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7c5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741a0a60 con 0x7f3a74102080 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7c5ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741a0c20 con 0x7f3a74100ea0 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7ab9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74102a40 0x7f3a741a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7a39b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a74100ea0 0x7f3a74198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:35.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7a39b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a74100ea0 0x7f3a74198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:41876/0 (socket says 172.21.15.8:41876) 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.073+0000 7f3a7a39b700 1 -- 172.21.15.8:0/201565731 learned_addr learned my addr 172.21.15.8:0/201565731 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a79b9a700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a74102080 0x7f3a741992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a7a39b700 1 -- 172.21.15.8:0/201565731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a74102080 msgr2=0x7f3a741992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a7a39b700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a74102080 0x7f3a741992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a7a39b700 1 -- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74102a40 msgr2=0x7f3a741a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a7a39b700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74102a40 0x7f3a741a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a7a39b700 1 -- 172.21.15.8:0/201565731 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700095f0 con 0x7f3a74100ea0 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a7ab9c700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74102a40 0x7f3a741a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a79b9a700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a74102080 0x7f3a741992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a7a39b700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a74100ea0 0x7f3a74198db0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a700098e0 tx=0x7f3a70004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a6b7fe700 1 -- 172.21.15.8:0/201565731 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7001d070 con 0x7f3a74100ea0 2023-10-06T23:10:35.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a6b7fe700 1 -- 172.21.15.8:0/201565731 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a7000be30 con 0x7f3a74100ea0 2023-10-06T23:10:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.074+0000 7f3a6b7fe700 1 -- 172.21.15.8:0/201565731 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70022dd0 con 0x7f3a74100ea0 2023-10-06T23:10:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.075+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a741a0ea0 con 0x7f3a74100ea0 2023-10-06T23:10:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.075+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a741a1210 con 0x7f3a74100ea0 2023-10-06T23:10:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.076+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a74193400 con 0x7f3a74100ea0 2023-10-06T23:10:35.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.077+0000 7f3a6b7fe700 1 -- 172.21.15.8:0/201565731 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3a70022570 con 0x7f3a74100ea0 2023-10-06T23:10:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.079+0000 7f3a6b7fe700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a600a1480 0x7f3a600a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.079+0000 7f3a6b7fe700 1 -- 172.21.15.8:0/201565731 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3a700cdec0 con 0x7f3a74100ea0 2023-10-06T23:10:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.079+0000 7f3a79b9a700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a600a1480 0x7f3a600a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:35.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.079+0000 7f3a79b9a700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a600a1480 0x7f3a600a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3a74100bc0 tx=0x7f3a6400b670 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:35.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.082+0000 7f3a6b7fe700 1 -- 172.21.15.8:0/201565731 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a700979b0 con 0x7f3a74100ea0 2023-10-06T23:10:35.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:35 smithi008 ceph-mon[98532]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:10:35.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:35 smithi008 ceph-mon[98532]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2023-10-06T23:10:35.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:35 smithi008 ceph-mon[98532]: Deploying daemon mds.l on smithi190 2023-10-06T23:10:35.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:35 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3914764816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:10:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:35 smithi190 ceph-mon[102658]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:10:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:35 smithi190 ceph-mon[102658]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2023-10-06T23:10:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:35 smithi190 ceph-mon[102658]: Deploying daemon mds.l on smithi190 2023-10-06T23:10:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:35 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3914764816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:10:35.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.292+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a7402d1a0 con 0x7f3a74100ea0 2023-10-06T23:10:35.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.293+0000 7f3a6b7fe700 1 -- 172.21.15.8:0/201565731 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a7009afd0 con 0x7f3a74100ea0 2023-10-06T23:10:35.294 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:10:35.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a600a1480 msgr2=0x7f3a600a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a600a1480 0x7f3a600a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3a74100bc0 tx=0x7f3a6400b670 comp rx=0 tx=0).stop 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a74100ea0 msgr2=0x7f3a74198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a74100ea0 0x7f3a74198db0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a700098e0 tx=0x7f3a70004730 comp rx=0 tx=0).stop 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 shutdown_connections 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a600a1480 0x7f3a600a3940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a74102a40 0x7f3a741a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a74100ea0 0x7f3a74198db0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 --2- 172.21.15.8:0/201565731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a74102080 0x7f3a741992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 >> 172.21.15.8:0/201565731 conn(0x7f3a740fc460 msgr2=0x7f3a74107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:35.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 shutdown_connections 2023-10-06T23:10:35.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.295+0000 7f3a7c5ff700 1 -- 172.21.15.8:0/201565731 wait complete. 2023-10-06T23:10:35.316 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:35.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:35 smithi156 ceph-mon[102862]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:10:35.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:35 smithi156 ceph-mon[102862]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2023-10-06T23:10:35.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:35 smithi156 ceph-mon[102862]: Deploying daemon mds.l on smithi190 2023-10-06T23:10:35.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:35 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3914764816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:10:35.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 -- 172.21.15.8:0/2841628591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560102a40 msgr2=0x7f2560109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 --2- 172.21.15.8:0/2841628591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560102a40 0x7f2560109360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f255800b0a0 tx=0x7f255800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 -- 172.21.15.8:0/2841628591 shutdown_connections 2023-10-06T23:10:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 --2- 172.21.15.8:0/2841628591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560102a40 0x7f2560109360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 --2- 172.21.15.8:0/2841628591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2560100ea0 0x7f25601012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 --2- 172.21.15.8:0/2841628591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2560102080 0x7f2560102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 -- 172.21.15.8:0/2841628591 >> 172.21.15.8:0/2841628591 conn(0x7f25600fc420 msgr2=0x7f25600fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 -- 172.21.15.8:0/2841628591 shutdown_connections 2023-10-06T23:10:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.518+0000 7f2567dff700 1 -- 172.21.15.8:0/2841628591 wait complete. 2023-10-06T23:10:35.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2567dff700 1 Processor -- start 2023-10-06T23:10:35.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2567dff700 1 -- start start 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2567dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560100ea0 0x7f2560074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2567dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2560102080 0x7f25600732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2567dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2560102a40 0x7f25600737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2567dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560073f80 con 0x7f2560100ea0 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2567dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600740f0 con 0x7f2560102a40 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2567dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25601a0c00 con 0x7f2560102080 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2565b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560100ea0 0x7f2560074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2565b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560100ea0 0x7f2560074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55922/0 (socket says 172.21.15.8:55922) 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.519+0000 7f2565b9b700 1 -- 172.21.15.8:0/1609570689 learned_addr learned my addr 172.21.15.8:0/1609570689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f256539a700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2560102080 0x7f25600732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f256639c700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2560102a40 0x7f25600737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2565b9b700 1 -- 172.21.15.8:0/1609570689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2560102080 msgr2=0x7f25600732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2565b9b700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2560102080 0x7f25600732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2565b9b700 1 -- 172.21.15.8:0/1609570689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2560102a40 msgr2=0x7f25600737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2565b9b700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2560102a40 0x7f25600737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2565b9b700 1 -- 172.21.15.8:0/1609570689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558009d00 con 0x7f2560100ea0 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2565b9b700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560100ea0 0x7f2560074c60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f255c00e970 tx=0x7f255c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2556ffd700 1 -- 172.21.15.8:0/1609570689 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c009790 con 0x7f2560100ea0 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2556ffd700 1 -- 172.21.15.8:0/1609570689 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f255c00eec0 con 0x7f2560100ea0 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25601a0ee0 con 0x7f2560100ea0 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.520+0000 7f2556ffd700 1 -- 172.21.15.8:0/1609570689 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c003c10 con 0x7f2560100ea0 2023-10-06T23:10:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.521+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25601a1360 con 0x7f2560100ea0 2023-10-06T23:10:35.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.521+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256010c5c0 con 0x7f2560100ea0 2023-10-06T23:10:35.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.523+0000 7f2556ffd700 1 -- 172.21.15.8:0/1609570689 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f255c003db0 con 0x7f2560100ea0 2023-10-06T23:10:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.525+0000 7f2556ffd700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f254c0a1550 0x7f254c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.525+0000 7f2556ffd700 1 -- 172.21.15.8:0/1609570689 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f255c014070 con 0x7f2560100ea0 2023-10-06T23:10:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.525+0000 7f256539a700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f254c0a1550 0x7f254c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.526+0000 7f256539a700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f254c0a1550 0x7f254c0a3a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2560100bc0 tx=0x7f2550009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.528+0000 7f2556ffd700 1 -- 172.21.15.8:0/1609570689 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f255c096560 con 0x7f2560100ea0 2023-10-06T23:10:35.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.784+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2560107e00 con 0x7f2560100ea0 2023-10-06T23:10:35.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.784+0000 7f2556ffd700 1 -- 172.21.15.8:0/1609570689 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f255c099b80 con 0x7f2560100ea0 2023-10-06T23:10:35.786 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:35.786 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-06T23:10:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f254c0a1550 msgr2=0x7f254c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f254c0a1550 0x7f254c0a3a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2560100bc0 tx=0x7f2550009260 comp rx=0 tx=0).stop 2023-10-06T23:10:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560100ea0 msgr2=0x7f2560074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560100ea0 0x7f2560074c60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f255c00e970 tx=0x7f255c00ec80 comp rx=0 tx=0).stop 2023-10-06T23:10:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 shutdown_connections 2023-10-06T23:10:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f254c0a1550 0x7f254c0a3a10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2560100ea0 0x7f2560074c60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2560102a40 0x7f25600737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 --2- 172.21.15.8:0/1609570689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2560102080 0x7f25600732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 >> 172.21.15.8:0/1609570689 conn(0x7f25600fc420 msgr2=0x7f25600fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 shutdown_connections 2023-10-06T23:10:35.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:35.787+0000 7f2567dff700 1 -- 172.21.15.8:0/1609570689 wait complete. 2023-10-06T23:10:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 1 2023-10-06T23:10:35.887 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:10:35 smithi190 systemd[1]: Starting Ceph mds.l for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:10:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:36 smithi008 ceph-mon[98532]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:36 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/201565731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:10:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:36 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1609570689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:36.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:36 smithi156 ceph-mon[102862]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:36 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/201565731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:10:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:36 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1609570689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:36 smithi190 ceph-mon[102658]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:36 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/201565731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:10:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:36 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1609570689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:36.748 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:10:36 smithi190 podman[137600]: 2023-10-06T23:10:36.748 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:10:36 smithi190 bash[137600]: c384209dc6a04e6825a01f8ba995b9d00ad095ee8255596f87799fbc58298305 2023-10-06T23:10:36.749 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:10:36 smithi190 ceph-mds[137640]: -- 172.21.15.190:0/1753208937 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557382f531e0 con 0x557382f28800 2023-10-06T23:10:36.749 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:10:36 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-l[137616]: starting mds.l at 2023-10-06T23:10:37.192 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:10:36 smithi190 systemd[1]: Started Ceph mds.l for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:10:37.808 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 -- 172.21.15.8:0/158392140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8102a40 msgr2=0x7f0cf8109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 --2- 172.21.15.8:0/158392140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8102a40 0x7f0cf8109360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000b0a0 tx=0x7f0cf000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 -- 172.21.15.8:0/158392140 shutdown_connections 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 --2- 172.21.15.8:0/158392140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8102a40 0x7f0cf8109360 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 --2- 172.21.15.8:0/158392140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf8100ea0 0x7f0cf81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 --2- 172.21.15.8:0/158392140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf8102080 0x7f0cf8102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 -- 172.21.15.8:0/158392140 >> 172.21.15.8:0/158392140 conn(0x7f0cf80fc420 msgr2=0x7f0cf80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 -- 172.21.15.8:0/158392140 shutdown_connections 2023-10-06T23:10:38.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.021+0000 7f0cfddff700 1 -- 172.21.15.8:0/158392140 wait complete. 2023-10-06T23:10:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.022+0000 7f0cfddff700 1 Processor -- start 2023-10-06T23:10:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.022+0000 7f0cfddff700 1 -- start start 2023-10-06T23:10:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cfddff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8100ea0 0x7f0cf8074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cfddff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf8102080 0x7f0cf80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cf77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8100ea0 0x7f0cf8074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cf77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8100ea0 0x7f0cf8074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55946/0 (socket says 172.21.15.8:55946) 2023-10-06T23:10:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cfddff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf8102a40 0x7f0cf80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:38.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cfddff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8073f80 con 0x7f0cf8100ea0 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cfddff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80740f0 con 0x7f0cf8102080 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cf77fe700 1 -- 172.21.15.8:0/3101457903 learned_addr learned my addr 172.21.15.8:0/3101457903 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf81a0bd0 con 0x7f0cf8102a40 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.023+0000 7f0cf6ffd700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf8102080 0x7f0cf80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf7fff700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf8102a40 0x7f0cf80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf77fe700 1 -- 172.21.15.8:0/3101457903 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf8102a40 msgr2=0x7f0cf80737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf77fe700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf8102a40 0x7f0cf80737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf77fe700 1 -- 172.21.15.8:0/3101457903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf8102080 msgr2=0x7f0cf80732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf77fe700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf8102080 0x7f0cf80732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf77fe700 1 -- 172.21.15.8:0/3101457903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0009d00 con 0x7f0cf8100ea0 2023-10-06T23:10:38.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf77fe700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8100ea0 0x7f0cf8074c60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800d980 tx=0x7f0ce800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf4ff9700 1 -- 172.21.15.8:0/3101457903 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8004020 con 0x7f0cf8100ea0 2023-10-06T23:10:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf4ff9700 1 -- 172.21.15.8:0/3101457903 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ce8009730 con 0x7f0cf8100ea0 2023-10-06T23:10:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cf4ff9700 1 -- 172.21.15.8:0/3101457903 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8003a00 con 0x7f0cf8100ea0 2023-10-06T23:10:38.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf81a0eb0 con 0x7f0cf8100ea0 2023-10-06T23:10:38.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.024+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf81a1220 con 0x7f0cf8100ea0 2023-10-06T23:10:38.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.026+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf810c5c0 con 0x7f0cf8100ea0 2023-10-06T23:10:38.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.028+0000 7f0cf4ff9700 1 -- 172.21.15.8:0/3101457903 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0ce80098a0 con 0x7f0cf8100ea0 2023-10-06T23:10:38.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.029+0000 7f0cf4ff9700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ce00a14d0 0x7f0ce00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:38.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.029+0000 7f0cf4ff9700 1 -- 172.21.15.8:0/3101457903 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0ce80cc5c0 con 0x7f0cf8100ea0 2023-10-06T23:10:38.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.029+0000 7f0cf6ffd700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ce00a14d0 0x7f0ce00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:38.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.030+0000 7f0cf6ffd700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ce00a14d0 0x7f0ce00a3990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8100bc0 tx=0x7f0cec009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:38.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.033+0000 7f0cf4ff9700 1 -- 172.21.15.8:0/3101457903 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0ce8096020 con 0x7f0cf8100ea0 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.190:6832/345838273,v1:172.21.15.190:6833/345838273] up:boot 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: fsmap 1 up:standby 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:38.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:38.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: Deploying daemon mds.k on smithi156 2023-10-06T23:10:38.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:37 smithi156 ceph-mon[102862]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:38.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.190:6832/345838273,v1:172.21.15.190:6833/345838273] up:boot 2023-10-06T23:10:38.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: fsmap 1 up:standby 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: Deploying daemon mds.k on smithi156 2023-10-06T23:10:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:37 smithi008 ceph-mon[98532]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.190:6832/345838273,v1:172.21.15.190:6833/345838273] up:boot 2023-10-06T23:10:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: fsmap 1 up:standby 2023-10-06T23:10:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-06T23:10:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:38.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:38.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:38.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:38.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: Deploying daemon mds.k on smithi156 2023-10-06T23:10:38.194 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:37 smithi190 ceph-mon[102658]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:38.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.290+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cf81a17d0 con 0x7f0cf8100ea0 2023-10-06T23:10:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.291+0000 7f0cf4ff9700 1 -- 172.21.15.8:0/3101457903 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7f0ce8099640 con 0x7f0cf8100ea0 2023-10-06T23:10:38.292 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:38.292 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-06T23:10:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.293+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ce00a14d0 msgr2=0x7f0ce00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.293+0000 7f0cfddff700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ce00a14d0 0x7f0ce00a3990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8100bc0 tx=0x7f0cec009260 comp rx=0 tx=0).stop 2023-10-06T23:10:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.293+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8100ea0 msgr2=0x7f0cf8074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.293+0000 7f0cfddff700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8100ea0 0x7f0cf8074c60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800d980 tx=0x7f0ce800dc90 comp rx=0 tx=0).stop 2023-10-06T23:10:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.294+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 shutdown_connections 2023-10-06T23:10:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.294+0000 7f0cfddff700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ce00a14d0 0x7f0ce00a3990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.294+0000 7f0cfddff700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0cf8100ea0 0x7f0cf8074c60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.294+0000 7f0cfddff700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cf8102a40 0x7f0cf80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.294+0000 7f0cfddff700 1 --2- 172.21.15.8:0/3101457903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cf8102080 0x7f0cf80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.294+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 >> 172.21.15.8:0/3101457903 conn(0x7f0cf80fc420 msgr2=0x7f0cf80fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.294+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 shutdown_connections 2023-10-06T23:10:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:38.294+0000 7f0cfddff700 1 -- 172.21.15.8:0/3101457903 wait complete. 2023-10-06T23:10:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2023-10-06T23:10:39.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:38 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3101457903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:39.087 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:10:39 smithi156 systemd[1]: Starting Ceph mds.k for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:10:39.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:38 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3101457903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:39.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:38 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3101457903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:39.800 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:10:39 smithi156 podman[138313]: 2023-10-06T23:10:39.800 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:10:39 smithi156 bash[138313]: 9563f2e3a977efa32e1dccb0109ce1a7b75e4eb313f5c7ce7f4288901307f5ba 2023-10-06T23:10:40.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:39 smithi156 ceph-mon[102862]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:40.099 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:10:39 smithi156 ceph-mds[138353]: -- 172.21.15.156:0/1280038425 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5589558451e0 con 0x55895581b000 2023-10-06T23:10:40.099 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:10:39 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-k[138329]: starting mds.k at 2023-10-06T23:10:40.100 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:10:39 smithi156 systemd[1]: Started Ceph mds.k for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:10:40.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:39 smithi008 ceph-mon[98532]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:40.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:39 smithi190 ceph-mon[102658]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:40.315 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.539+0000 7f1d531ff700 1 -- 172.21.15.8:0/407477540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c101940 msgr2=0x7f1d4c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.539+0000 7f1d531ff700 1 --2- 172.21.15.8:0/407477540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c101940 0x7f1d4c103d30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009990 tx=0x7f1d40009ca0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.539+0000 7f1d531ff700 1 -- 172.21.15.8:0/407477540 shutdown_connections 2023-10-06T23:10:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.539+0000 7f1d531ff700 1 --2- 172.21.15.8:0/407477540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c101940 0x7f1d4c103d30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.539+0000 7f1d531ff700 1 --2- 172.21.15.8:0/407477540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c106ba0 0x7f1d4c109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.539+0000 7f1d531ff700 1 --2- 172.21.15.8:0/407477540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4c104270 0x7f1d4c106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.539+0000 7f1d531ff700 1 -- 172.21.15.8:0/407477540 >> 172.21.15.8:0/407477540 conn(0x7f1d4c0fb310 msgr2=0x7f1d4c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:40.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.540+0000 7f1d531ff700 1 -- 172.21.15.8:0/407477540 shutdown_connections 2023-10-06T23:10:40.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.540+0000 7f1d531ff700 1 -- 172.21.15.8:0/407477540 wait complete. 2023-10-06T23:10:40.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d531ff700 1 Processor -- start 2023-10-06T23:10:40.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d531ff700 1 -- start start 2023-10-06T23:10:40.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d531ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c101940 0x7f1d4c198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d531ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c104270 0x7f1d4c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d531ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4c106ba0 0x7f1d4c1a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d531ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1a0820 con 0x7f1d4c104270 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d531ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1a0990 con 0x7f1d4c106ba0 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d531ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1a0b50 con 0x7f1d4c101940 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c104270 0x7f1d4c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c104270 0x7f1d4c1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37044/0 (socket says 172.21.15.8:37044) 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d4bfff700 1 -- 172.21.15.8:0/211509192 learned_addr learned my addr 172.21.15.8:0/211509192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.541+0000 7f1d50f9b700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c101940 0x7f1d4c198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d5179c700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4c106ba0 0x7f1d4c1a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:40.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d4bfff700 1 -- 172.21.15.8:0/211509192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c101940 msgr2=0x7f1d4c198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d4bfff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c101940 0x7f1d4c198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d4bfff700 1 -- 172.21.15.8:0/211509192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4c106ba0 msgr2=0x7f1d4c1a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d4bfff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4c106ba0 0x7f1d4c1a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d4bfff700 1 -- 172.21.15.8:0/211509192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400095f0 con 0x7f1d4c104270 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d5179c700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4c106ba0 0x7f1d4c1a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d4bfff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c104270 0x7f1d4c1991f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800e9a0 tx=0x7f1d3800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d49ffb700 1 -- 172.21.15.8:0/211509192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38009790 con 0x7f1d4c104270 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d49ffb700 1 -- 172.21.15.8:0/211509192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d3800cbd0 con 0x7f1d4c104270 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d49ffb700 1 -- 172.21.15.8:0/211509192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38018680 con 0x7f1d4c104270 2023-10-06T23:10:40.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.542+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c1a0e30 con 0x7f1d4c104270 2023-10-06T23:10:40.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.543+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c1a1260 con 0x7f1d4c104270 2023-10-06T23:10:40.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.544+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c108770 con 0x7f1d4c104270 2023-10-06T23:10:40.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.546+0000 7f1d49ffb700 1 -- 172.21.15.8:0/211509192 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1d3800cd40 con 0x7f1d4c104270 2023-10-06T23:10:40.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.547+0000 7f1d49ffb700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1d3c0a1550 0x7f1d3c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:40.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.547+0000 7f1d49ffb700 1 -- 172.21.15.8:0/211509192 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1d38014070 con 0x7f1d4c104270 2023-10-06T23:10:40.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.548+0000 7f1d50f9b700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1d3c0a1550 0x7f1d3c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:40.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.548+0000 7f1d50f9b700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1d3c0a1550 0x7f1d3c0a3a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1d40006010 tx=0x7f1d4000b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:40.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.551+0000 7f1d49ffb700 1 -- 172.21.15.8:0/211509192 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1d38096500 con 0x7f1d4c104270 2023-10-06T23:10:40.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.831+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d4c10c5f0 con 0x7f1d4c104270 2023-10-06T23:10:40.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.832+0000 7f1d49ffb700 1 -- 172.21.15.8:0/211509192 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7f1d38099b20 con 0x7f1d4c104270 2023-10-06T23:10:40.833 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:40.834 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1d3c0a1550 msgr2=0x7f1d3c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1d3c0a1550 0x7f1d3c0a3a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1d40006010 tx=0x7f1d4000b260 comp rx=0 tx=0).stop 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c104270 msgr2=0x7f1d4c1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c104270 0x7f1d4c1991f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800e9a0 tx=0x7f1d3800ecb0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 shutdown_connections 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1d3c0a1550 0x7f1d3c0a3a10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d4c106ba0 0x7f1d4c1a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c101940 0x7f1d4c198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 --2- 172.21.15.8:0/211509192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d4c104270 0x7f1d4c1991f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:40.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.834+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 >> 172.21.15.8:0/211509192 conn(0x7f1d4c0fb310 msgr2=0x7f1d4c0fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:40.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.835+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 shutdown_connections 2023-10-06T23:10:40.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:40.835+0000 7f1d531ff700 1 -- 172.21.15.8:0/211509192 wait complete. 2023-10-06T23:10:40.837 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-10-06T23:10:41.115 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.156:6832/865735895,v1:172.21.15.156:6833/865735895] up:boot 2023-10-06T23:10:41.115 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: fsmap 2 up:standby 2023-10-06T23:10:41.115 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-06T23:10:41.115 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.115 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.116 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.116 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:41.116 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:41.116 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:41.116 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: Deploying daemon mds.j on smithi008 2023-10-06T23:10:41.116 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:40 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/211509192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:41.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.156:6832/865735895,v1:172.21.15.156:6833/865735895] up:boot 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: fsmap 2 up:standby 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: Deploying daemon mds.j on smithi008 2023-10-06T23:10:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:40 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/211509192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:41.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.156:6832/865735895,v1:172.21.15.156:6833/865735895] up:boot 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: fsmap 2 up:standby 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: Deploying daemon mds.j on smithi008 2023-10-06T23:10:41.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:40 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/211509192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:41.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:41 smithi008 ceph-mon[98532]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:42.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:41 smithi190 ceph-mon[102658]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:42.314 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:10:42 smithi008 systemd[1]: Starting Ceph mds.j for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:10:42.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:41 smithi156 ceph-mon[102862]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:42.856 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:43.064 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:10:42 smithi008 podman[147494]: 2023-10-06T23:10:43.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.080+0000 7fd4217ff700 1 -- 172.21.15.8:0/3525596658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 msgr2=0x7fd41c109070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:43.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.080+0000 7fd4217ff700 1 --2- 172.21.15.8:0/3525596658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 0x7fd41c109070 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd41400b0a0 tx=0x7fd41400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.080+0000 7fd4217ff700 1 -- 172.21.15.8:0/3525596658 shutdown_connections 2023-10-06T23:10:43.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.080+0000 7fd4217ff700 1 --2- 172.21.15.8:0/3525596658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd41c1019a0 0x7fd41c103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.080+0000 7fd4217ff700 1 --2- 172.21.15.8:0/3525596658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 0x7fd41c109070 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.080+0000 7fd4217ff700 1 --2- 172.21.15.8:0/3525596658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c1042d0 0x7fd41c1066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.080+0000 7fd4217ff700 1 -- 172.21.15.8:0/3525596658 >> 172.21.15.8:0/3525596658 conn(0x7fd41c0fb3b0 msgr2=0x7fd41c0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:43.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.081+0000 7fd4217ff700 1 -- 172.21.15.8:0/3525596658 shutdown_connections 2023-10-06T23:10:43.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.081+0000 7fd4217ff700 1 -- 172.21.15.8:0/3525596658 wait complete. 2023-10-06T23:10:43.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.082+0000 7fd4217ff700 1 Processor -- start 2023-10-06T23:10:43.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd4217ff700 1 -- start start 2023-10-06T23:10:43.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd4217ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd41c1019a0 0x7fd41c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:43.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd4217ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c1042d0 0x7fd41c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:43.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd4217ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 0x7fd41c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:43.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd4217ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1a08e0 con 0x7fd41c1019a0 2023-10-06T23:10:43.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd4217ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1a0a20 con 0x7fd41c106c00 2023-10-06T23:10:43.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd4217ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1a0bb0 con 0x7fd41c1042d0 2023-10-06T23:10:43.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd41b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 0x7fd41c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:43.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd41b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 0x7fd41c1a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:60830/0 (socket says 172.21.15.8:60830) 2023-10-06T23:10:43.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.083+0000 7fd41b7fe700 1 -- 172.21.15.8:0/829280504 learned_addr learned my addr 172.21.15.8:0/829280504 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:43.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.084+0000 7fd41a7fc700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c1042d0 0x7fd41c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:43.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.084+0000 7fd41affd700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd41c1019a0 0x7fd41c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:43.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.084+0000 7fd41b7fe700 1 -- 172.21.15.8:0/829280504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c1042d0 msgr2=0x7fd41c1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:43.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.084+0000 7fd41b7fe700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c1042d0 0x7fd41c1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.084+0000 7fd41b7fe700 1 -- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd41c1019a0 msgr2=0x7fd41c198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:43.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.084+0000 7fd41b7fe700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd41c1019a0 0x7fd41c198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.084+0000 7fd41b7fe700 1 -- 172.21.15.8:0/829280504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414009d00 con 0x7fd41c106c00 2023-10-06T23:10:43.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.084+0000 7fd41b7fe700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 0x7fd41c1a0310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd41400d010 tx=0x7fd41400bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:43.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.085+0000 7fd403fff700 1 -- 172.21.15.8:0/829280504 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41400e040 con 0x7fd41c106c00 2023-10-06T23:10:43.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.085+0000 7fd403fff700 1 -- 172.21.15.8:0/829280504 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd414009480 con 0x7fd41c106c00 2023-10-06T23:10:43.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.085+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c1a0e30 con 0x7fd41c106c00 2023-10-06T23:10:43.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.085+0000 7fd403fff700 1 -- 172.21.15.8:0/829280504 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140052a0 con 0x7fd41c106c00 2023-10-06T23:10:43.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.085+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c1a1250 con 0x7fd41c106c00 2023-10-06T23:10:43.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.086+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c108780 con 0x7fd41c106c00 2023-10-06T23:10:43.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.088+0000 7fd403fff700 1 -- 172.21.15.8:0/829280504 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd414005400 con 0x7fd41c106c00 2023-10-06T23:10:43.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.089+0000 7fd403fff700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4040a1550 0x7fd4040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:43.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.090+0000 7fd403fff700 1 -- 172.21.15.8:0/829280504 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd4140cd8a0 con 0x7fd41c106c00 2023-10-06T23:10:43.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.090+0000 7fd41affd700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4040a1550 0x7fd4040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:43.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.091+0000 7fd41affd700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4040a1550 0x7fd4040a3a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009c60 tx=0x7fd40c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:43.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.094+0000 7fd403fff700 1 -- 172.21.15.8:0/829280504 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd414097390 con 0x7fd41c106c00 2023-10-06T23:10:43.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.379+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd41c10c5b0 con 0x7fd41c106c00 2023-10-06T23:10:43.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.379+0000 7fd403fff700 1 -- 172.21.15.8:0/829280504 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7fd41409a9b0 con 0x7fd41c106c00 2023-10-06T23:10:43.381 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:43.381 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-06T23:10:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4040a1550 msgr2=0x7fd4040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4040a1550 0x7fd4040a3a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009c60 tx=0x7fd40c009260 comp rx=0 tx=0).stop 2023-10-06T23:10:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 msgr2=0x7fd41c1a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:43.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 0x7fd41c1a0310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd41400d010 tx=0x7fd41400bcc0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 shutdown_connections 2023-10-06T23:10:43.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd4040a1550 0x7fd4040a3a10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd41c1019a0 0x7fd41c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd41c106c00 0x7fd41c1a0310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 --2- 172.21.15.8:0/829280504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd41c1042d0 0x7fd41c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:43.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 >> 172.21.15.8:0/829280504 conn(0x7fd41c0fb3b0 msgr2=0x7fd41c100020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 shutdown_connections 2023-10-06T23:10:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:43.383+0000 7fd4217ff700 1 -- 172.21.15.8:0/829280504 wait complete. 2023-10-06T23:10:43.387 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-10-06T23:10:43.395 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:10:43 smithi008 bash[147494]: ee416821a99d3c52a1937e74b44995913443756fa683b34953bfa28ca0a8ac4a 2023-10-06T23:10:43.395 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mds[147557]: -- 172.21.15.8:0/3985031720 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559b34ce51e0 con 0x559b34cbb000 2023-10-06T23:10:43.396 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-j[147529]: starting mds.j at 2023-10-06T23:10:43.396 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:10:43 smithi008 systemd[1]: Started Ceph mds.j for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:10:44.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mon[98532]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:44.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:44.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:44.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:44.262 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:43 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/829280504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:43 smithi156 ceph-mon[102862]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:44.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:43 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/829280504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:44.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:43 smithi190 ceph-mon[102658]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:44.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:44.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:44.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:44.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:44.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:43 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/829280504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:45.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:44 smithi008 ceph-mon[98532]: Deploying daemon mds.d on smithi008 2023-10-06T23:10:45.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:44 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.8:6834/3180877421,v1:172.21.15.8:6835/3180877421] up:boot 2023-10-06T23:10:45.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:44 smithi008 ceph-mon[98532]: fsmap 3 up:standby 2023-10-06T23:10:45.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:44 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-06T23:10:45.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:44 smithi156 ceph-mon[102862]: Deploying daemon mds.d on smithi008 2023-10-06T23:10:45.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:44 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.8:6834/3180877421,v1:172.21.15.8:6835/3180877421] up:boot 2023-10-06T23:10:45.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:44 smithi156 ceph-mon[102862]: fsmap 3 up:standby 2023-10-06T23:10:45.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-06T23:10:45.412 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:45.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:44 smithi190 ceph-mon[102658]: Deploying daemon mds.d on smithi008 2023-10-06T23:10:45.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:44 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.8:6834/3180877421,v1:172.21.15.8:6835/3180877421] up:boot 2023-10-06T23:10:45.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:44 smithi190 ceph-mon[102658]: fsmap 3 up:standby 2023-10-06T23:10:45.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:44 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-06T23:10:45.518 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:10:45 smithi008 systemd[1]: Starting Ceph mds.d for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:10:45.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.660+0000 7f92099ff700 1 -- 172.21.15.8:0/2257479339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9204100fc0 msgr2=0x7f9204101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:45.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.660+0000 7f92099ff700 1 --2- 172.21.15.8:0/2257479339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9204100fc0 0x7f9204101420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91f80099c0 tx=0x7f91f8009cd0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.661+0000 7f92099ff700 1 -- 172.21.15.8:0/2257479339 shutdown_connections 2023-10-06T23:10:45.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.661+0000 7f92099ff700 1 --2- 172.21.15.8:0/2257479339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9204101960 0x7f9204108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.661+0000 7f92099ff700 1 --2- 172.21.15.8:0/2257479339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92040ffdd0 0x7f92041001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.661+0000 7f92099ff700 1 --2- 172.21.15.8:0/2257479339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9204100fc0 0x7f9204101420 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.661+0000 7f92099ff700 1 -- 172.21.15.8:0/2257479339 >> 172.21.15.8:0/2257479339 conn(0x7f92040fb340 msgr2=0x7f92040fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:45.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.661+0000 7f92099ff700 1 -- 172.21.15.8:0/2257479339 shutdown_connections 2023-10-06T23:10:45.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.661+0000 7f92099ff700 1 -- 172.21.15.8:0/2257479339 wait complete. 2023-10-06T23:10:45.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.662+0000 7f92099ff700 1 Processor -- start 2023-10-06T23:10:45.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.662+0000 7f92099ff700 1 -- start start 2023-10-06T23:10:45.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92099ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92040ffdd0 0x7f9204196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:45.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92099ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9204100fc0 0x7f9204196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:45.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92099ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9204101960 0x7f920419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:45.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92099ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920419e5f0 con 0x7f92040ffdd0 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92099ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920419e730 con 0x7f9204101960 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92099ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920419e8c0 con 0x7f9204100fc0 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f9202ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92040ffdd0 0x7f9204196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92027fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9204100fc0 0x7f9204196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f9202ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92040ffdd0 0x7f9204196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37098/0 (socket says 172.21.15.8:37098) 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f9202ffd700 1 -- 172.21.15.8:0/3827921813 learned_addr learned my addr 172.21.15.8:0/3827921813 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92027fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9204100fc0 0x7f9204196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40928/0 (socket says 172.21.15.8:40928) 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.663+0000 7f92037fe700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9204101960 0x7f920419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f9202ffd700 1 -- 172.21.15.8:0/3827921813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9204100fc0 msgr2=0x7f9204196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:45.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f9202ffd700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9204100fc0 0x7f9204196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f9202ffd700 1 -- 172.21.15.8:0/3827921813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9204101960 msgr2=0x7f920419e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f9202ffd700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9204101960 0x7f920419e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f9202ffd700 1 -- 172.21.15.8:0/3827921813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f80095f0 con 0x7f92040ffdd0 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f9202ffd700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92040ffdd0 0x7f9204196a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c990 tx=0x7f91f400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f92089fd700 1 -- 172.21.15.8:0/3827921813 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4007b00 con 0x7f92040ffdd0 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920419eba0 con 0x7f92040ffdd0 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f92089fd700 1 -- 172.21.15.8:0/3827921813 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91f4007c60 con 0x7f92040ffdd0 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f92089fd700 1 -- 172.21.15.8:0/3827921813 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4018420 con 0x7f92040ffdd0 2023-10-06T23:10:45.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.664+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920419f100 con 0x7f92040ffdd0 2023-10-06T23:10:45.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.666+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9204107310 con 0x7f92040ffdd0 2023-10-06T23:10:45.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.669+0000 7f92089fd700 1 -- 172.21.15.8:0/3827921813 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f91f400f450 con 0x7f92040ffdd0 2023-10-06T23:10:45.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.670+0000 7f92089fd700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f91ec0a14d0 0x7f91ec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:45.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.670+0000 7f92089fd700 1 -- 172.21.15.8:0/3827921813 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f91f40cc9a0 con 0x7f92040ffdd0 2023-10-06T23:10:45.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.670+0000 7f92027fc700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f91ec0a14d0 0x7f91ec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:45.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.671+0000 7f92027fc700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f91ec0a14d0 0x7f91ec0a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91f800b580 tx=0x7f91f800b7b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:45.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.672+0000 7f92089fd700 1 -- 172.21.15.8:0/3827921813 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f91f4096490 con 0x7f92040ffdd0 2023-10-06T23:10:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.960+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f920410c620 con 0x7f92040ffdd0 2023-10-06T23:10:45.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.961+0000 7f92089fd700 1 -- 172.21.15.8:0/3827921813 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2904 (secure 0 0 0) 0x7f91f400f700 con 0x7f92040ffdd0 2023-10-06T23:10:45.962 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:45.962 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f91ec0a14d0 msgr2=0x7f91ec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f91ec0a14d0 0x7f91ec0a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91f800b580 tx=0x7f91f800b7b0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92040ffdd0 msgr2=0x7f9204196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92040ffdd0 0x7f9204196a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c990 tx=0x7f91f400cca0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 shutdown_connections 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f91ec0a14d0 0x7f91ec0a3990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92040ffdd0 0x7f9204196a70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9204101960 0x7f920419e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 --2- 172.21.15.8:0/3827921813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9204100fc0 0x7f9204196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 >> 172.21.15.8:0/3827921813 conn(0x7f92040fb340 msgr2=0x7f9204104450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 shutdown_connections 2023-10-06T23:10:45.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:45.963+0000 7f92099ff700 1 -- 172.21.15.8:0/3827921813 wait complete. 2023-10-06T23:10:45.966 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 4 2023-10-06T23:10:46.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:46 smithi008 ceph-mon[98532]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:46.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:46 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3827921813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:46.306 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:10:46 smithi008 podman[147928]: 2023-10-06T23:10:46.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:46 smithi156 ceph-mon[102862]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:46.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:46 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3827921813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:46 smithi190 ceph-mon[102658]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:46.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:46 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3827921813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:46.645 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:10:46 smithi008 bash[147928]: 0a29e04d79eb783af8c6a1a0e870c681c6b49a53d87edde7cd2dd7428d8aa241 2023-10-06T23:10:46.645 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:10:46 smithi008 ceph-mds[147970]: -- 172.21.15.8:0/1176976465 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b65d01d1e0 con 0x55b65cff2800 2023-10-06T23:10:46.645 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:10:46 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-d[147946]: starting mds.d at 2023-10-06T23:10:46.646 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:10:46 smithi008 systemd[1]: Started Ceph mds.d for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:10:47.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: Deploying daemon mds.e on smithi156 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.8:6836/3213157438,v1:172.21.15.8:6837/3213157438] up:boot 2023-10-06T23:10:47.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: fsmap 4 up:standby 2023-10-06T23:10:47.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:47 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-06T23:10:47.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: Deploying daemon mds.e on smithi156 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.8:6836/3213157438,v1:172.21.15.8:6837/3213157438] up:boot 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: fsmap 4 up:standby 2023-10-06T23:10:47.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:47 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: Deploying daemon mds.e on smithi156 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.8:6836/3213157438,v1:172.21.15.8:6837/3213157438] up:boot 2023-10-06T23:10:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: fsmap 4 up:standby 2023-10-06T23:10:47.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:47 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-06T23:10:47.985 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.201+0000 7f65b59ff700 1 -- 172.21.15.8:0/4039749799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102080 msgr2=0x7f65b0102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.201+0000 7f65b59ff700 1 --2- 172.21.15.8:0/4039749799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102080 0x7f65b0102500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009990 tx=0x7f65a4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.201+0000 7f65b59ff700 1 -- 172.21.15.8:0/4039749799 shutdown_connections 2023-10-06T23:10:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.201+0000 7f65b59ff700 1 --2- 172.21.15.8:0/4039749799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b0102a40 0x7f65b0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.201+0000 7f65b59ff700 1 --2- 172.21.15.8:0/4039749799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65b0100ea0 0x7f65b01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.201+0000 7f65b59ff700 1 --2- 172.21.15.8:0/4039749799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102080 0x7f65b0102500 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.201+0000 7f65b59ff700 1 -- 172.21.15.8:0/4039749799 >> 172.21.15.8:0/4039749799 conn(0x7f65b00fc420 msgr2=0x7f65b00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.202+0000 7f65b59ff700 1 -- 172.21.15.8:0/4039749799 shutdown_connections 2023-10-06T23:10:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.202+0000 7f65b59ff700 1 -- 172.21.15.8:0/4039749799 wait complete. 2023-10-06T23:10:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.203+0000 7f65b59ff700 1 Processor -- start 2023-10-06T23:10:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.203+0000 7f65b59ff700 1 -- start start 2023-10-06T23:10:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.203+0000 7f65b59ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65b0100ea0 0x7f65b0196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.203+0000 7f65b59ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b0102080 0x7f65b0197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.203+0000 7f65b59ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102a40 0x7f65b019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.203+0000 7f65b59ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b019e770 con 0x7f65b0102a40 2023-10-06T23:10:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.203+0000 7f65b59ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b019e8e0 con 0x7f65b0100ea0 2023-10-06T23:10:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.203+0000 7f65b59ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b019eaa0 con 0x7f65b0102080 2023-10-06T23:10:48.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102a40 0x7f65b019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:48.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65b0100ea0 0x7f65b0196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:48.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65b0100ea0 0x7f65b0196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:60892/0 (socket says 172.21.15.8:60892) 2023-10-06T23:10:48.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 -- 172.21.15.8:0/2992415069 learned_addr learned my addr 172.21.15.8:0/2992415069 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65ae7fc700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b0102080 0x7f65b0197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 -- 172.21.15.8:0/2992415069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b0102080 msgr2=0x7f65b0197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b0102080 0x7f65b0197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 -- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102a40 msgr2=0x7f65b019e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102a40 0x7f65b019e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 -- 172.21.15.8:0/2992415069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40095f0 con 0x7f65b0100ea0 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65af7fe700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102a40 0x7f65b019e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65aeffd700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65b0100ea0 0x7f65b0196c30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65a000e970 tx=0x7f65a000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.204+0000 7f65b49fd700 1 -- 172.21.15.8:0/2992415069 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0009790 con 0x7f65b0100ea0 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.205+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b0073140 con 0x7f65b0100ea0 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.205+0000 7f65b49fd700 1 -- 172.21.15.8:0/2992415069 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65a000eec0 con 0x7f65b0100ea0 2023-10-06T23:10:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.205+0000 7f65b49fd700 1 -- 172.21.15.8:0/2992415069 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0003c10 con 0x7f65b0100ea0 2023-10-06T23:10:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.205+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b00736a0 con 0x7f65b0100ea0 2023-10-06T23:10:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.206+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b01085b0 con 0x7f65b0100ea0 2023-10-06T23:10:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.208+0000 7f65b49fd700 1 -- 172.21.15.8:0/2992415069 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f65a0003d90 con 0x7f65b0100ea0 2023-10-06T23:10:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.209+0000 7f65b49fd700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65980a14d0 0x7f65980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.209+0000 7f65b49fd700 1 -- 172.21.15.8:0/2992415069 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f65a0014070 con 0x7f65b0100ea0 2023-10-06T23:10:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.210+0000 7f65ae7fc700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65980a14d0 0x7f65980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.210+0000 7f65ae7fc700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65980a14d0 0x7f65980a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f65a4003f60 tx=0x7f65a4005c20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.213+0000 7f65b49fd700 1 -- 172.21.15.8:0/2992415069 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f65a0096760 con 0x7f65b0100ea0 2023-10-06T23:10:48.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.471+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b010c690 con 0x7f65b0100ea0 2023-10-06T23:10:48.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.471+0000 7f65b49fd700 1 -- 172.21.15.8:0/2992415069 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3692 (secure 0 0 0) 0x7f65a0099d80 con 0x7f65b0100ea0 2023-10-06T23:10:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:48.473 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2023-10-06T23:10:48.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65980a14d0 msgr2=0x7f65980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:48.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65980a14d0 0x7f65980a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f65a4003f60 tx=0x7f65a4005c20 comp rx=0 tx=0).stop 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65b0100ea0 msgr2=0x7f65b0196c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65b0100ea0 0x7f65b0196c30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65a000e970 tx=0x7f65a000ec80 comp rx=0 tx=0).stop 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 shutdown_connections 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65980a14d0 0x7f65980a3990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65b0102a40 0x7f65b019e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65b0100ea0 0x7f65b0196c30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 --2- 172.21.15.8:0/2992415069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65b0102080 0x7f65b0197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 >> 172.21.15.8:0/2992415069 conn(0x7f65b00fc420 msgr2=0x7f65b01056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 shutdown_connections 2023-10-06T23:10:48.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:48.474+0000 7f65b59ff700 1 -- 172.21.15.8:0/2992415069 wait complete. 2023-10-06T23:10:48.477 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 5 2023-10-06T23:10:48.774 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:10:48 smithi156 systemd[1]: Starting Ceph mds.e for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:10:49.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:48 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2992415069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:49.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:48 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2992415069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:49.228 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:48 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2992415069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:49.515 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:10:49 smithi156 podman[138664]: 2023-10-06T23:10:49.848 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-mds[138705]: -- 172.21.15.156:0/3923080826 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f457faf1e0 con 0x55f457f85000 2023-10-06T23:10:49.849 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-e[138680]: starting mds.e at 2023-10-06T23:10:49.849 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:10:49 smithi156 bash[138664]: 9348fa4bd8097d538fffac991f5ff58bc4635a33a27e92695db9d5730505d2e3 2023-10-06T23:10:49.849 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:10:49 smithi156 systemd[1]: Started Ceph mds.e for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:10:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:49 smithi008 ceph-mon[98532]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:50.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:49 smithi190 ceph-mon[102658]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:50.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-mon[102862]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:50.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:50.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:50.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 -- 172.21.15.8:0/3392423231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 msgr2=0x7fecf8102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 --2- 172.21.15.8:0/3392423231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 0x7fecf8102500 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fece8009990 tx=0x7fece8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 -- 172.21.15.8:0/3392423231 shutdown_connections 2023-10-06T23:10:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 --2- 172.21.15.8:0/3392423231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecf8102a40 0x7fecf8109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 --2- 172.21.15.8:0/3392423231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecf8100ea0 0x7fecf81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 --2- 172.21.15.8:0/3392423231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 0x7fecf8102500 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 -- 172.21.15.8:0/3392423231 >> 172.21.15.8:0/3392423231 conn(0x7fecf80fc420 msgr2=0x7fecf80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:50.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 -- 172.21.15.8:0/3392423231 shutdown_connections 2023-10-06T23:10:50.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.709+0000 7fecfffff700 1 -- 172.21.15.8:0/3392423231 wait complete. 2023-10-06T23:10:50.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.710+0000 7fecfffff700 1 Processor -- start 2023-10-06T23:10:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.710+0000 7fecfffff700 1 -- start start 2023-10-06T23:10:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecf8100ea0 0x7fecf8196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 0x7fecf8197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecf8102a40 0x7fecf819e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf819e670 con 0x7fecf8102080 2023-10-06T23:10:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf819e7b0 con 0x7fecf8100ea0 2023-10-06T23:10:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfffff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf819e940 con 0x7fecf8102a40 2023-10-06T23:10:50.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfd59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 0x7fecf8197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:50.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfd59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 0x7fecf8197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44978/0 (socket says 172.21.15.8:44978) 2023-10-06T23:10:50.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfd59a700 1 -- 172.21.15.8:0/2084046962 learned_addr learned my addr 172.21.15.8:0/2084046962 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:50.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfe59c700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecf8102a40 0x7fecf819e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:50.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfdd9b700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecf8100ea0 0x7fecf8196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:50.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfd59a700 1 -- 172.21.15.8:0/2084046962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecf8102a40 msgr2=0x7fecf819e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:50.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfd59a700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecf8102a40 0x7fecf819e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfd59a700 1 -- 172.21.15.8:0/2084046962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecf8100ea0 msgr2=0x7fecf8196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:50.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfd59a700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecf8100ea0 0x7fecf8196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfd59a700 1 -- 172.21.15.8:0/2084046962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece80095f0 con 0x7fecf8102080 2023-10-06T23:10:50.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.711+0000 7fecfdd9b700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecf8100ea0 0x7fecf8196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:10:50.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.712+0000 7fecfd59a700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 0x7fecf8197030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fece800c010 tx=0x7fece8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:50.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.712+0000 7feceeffd700 1 -- 172.21.15.8:0/2084046962 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece801d070 con 0x7fecf8102080 2023-10-06T23:10:50.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.712+0000 7feceeffd700 1 -- 172.21.15.8:0/2084046962 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fece80054c0 con 0x7fecf8102080 2023-10-06T23:10:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.712+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf819ebc0 con 0x7fecf8102080 2023-10-06T23:10:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.712+0000 7feceeffd700 1 -- 172.21.15.8:0/2084046962 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8003ab0 con 0x7fecf8102080 2023-10-06T23:10:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.712+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf819f040 con 0x7fecf8102080 2023-10-06T23:10:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.713+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf810c5c0 con 0x7fecf8102080 2023-10-06T23:10:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.715+0000 7feceeffd700 1 -- 172.21.15.8:0/2084046962 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fece80047a0 con 0x7fecf8102080 2023-10-06T23:10:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.717+0000 7feceeffd700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fece40a1550 0x7fece40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.717+0000 7feceeffd700 1 -- 172.21.15.8:0/2084046962 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fece80cdbe0 con 0x7fecf8102080 2023-10-06T23:10:50.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.717+0000 7fecfdd9b700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fece40a1550 0x7fece40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:50.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.717+0000 7fecfdd9b700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fece40a1550 0x7fece40a3a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fecf8101bf0 tx=0x7fecf400b670 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:50.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.719+0000 7feceeffd700 1 -- 172.21.15.8:0/2084046962 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fece80976d0 con 0x7fecf8102080 2023-10-06T23:10:50.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:50 smithi190 ceph-mon[102658]: Deploying daemon mds.f on smithi190 2023-10-06T23:10:50.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:50 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.156:6834/3086367655,v1:172.21.15.156:6835/3086367655] up:boot 2023-10-06T23:10:50.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:50 smithi190 ceph-mon[102658]: fsmap 5 up:standby 2023-10-06T23:10:50.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-06T23:10:50.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.978+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecf8107ec0 con 0x7fecf8102080 2023-10-06T23:10:50.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.978+0000 7feceeffd700 1 -- 172.21.15.8:0/2084046962 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7fece809acf0 con 0x7fecf8102080 2023-10-06T23:10:50.980 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:50.980 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-06T23:10:50.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fece40a1550 msgr2=0x7fece40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:50.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fece40a1550 0x7fece40a3a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fecf8101bf0 tx=0x7fecf400b670 comp rx=0 tx=0).stop 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 msgr2=0x7fecf8197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 0x7fecf8197030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fece800c010 tx=0x7fece8004730 comp rx=0 tx=0).stop 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 shutdown_connections 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fece40a1550 0x7fece40a3a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fecf8102a40 0x7fecf819e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecf8100ea0 0x7fecf8196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 --2- 172.21.15.8:0/2084046962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fecf8102080 0x7fecf8197030 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 >> 172.21.15.8:0/2084046962 conn(0x7fecf80fc420 msgr2=0x7fecf80fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 shutdown_connections 2023-10-06T23:10:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:50.981+0000 7fecfffff700 1 -- 172.21.15.8:0/2084046962 wait complete. 2023-10-06T23:10:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 6 2023-10-06T23:10:51.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:50 smithi008 ceph-mon[98532]: Deploying daemon mds.f on smithi190 2023-10-06T23:10:51.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:50 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.156:6834/3086367655,v1:172.21.15.156:6835/3086367655] up:boot 2023-10-06T23:10:51.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:50 smithi008 ceph-mon[98532]: fsmap 5 up:standby 2023-10-06T23:10:51.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-06T23:10:51.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:50 smithi156 ceph-mon[102862]: Deploying daemon mds.f on smithi190 2023-10-06T23:10:51.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:50 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.156:6834/3086367655,v1:172.21.15.156:6835/3086367655] up:boot 2023-10-06T23:10:51.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:50 smithi156 ceph-mon[102862]: fsmap 5 up:standby 2023-10-06T23:10:51.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-06T23:10:51.860 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:10:51 smithi190 systemd[1]: Starting Ceph mds.f for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:10:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:51 smithi008 ceph-mon[98532]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:51 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2084046962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:52.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:51 smithi190 ceph-mon[102658]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:51 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2084046962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:52.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:51 smithi156 ceph-mon[102862]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:52.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:51 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2084046962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:52.615 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:10:52 smithi190 podman[137945]: 2023-10-06T23:10:52.616 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:10:52 smithi190 bash[137945]: 00fcd9e230ebd649c65038c2c65686f5f7e816f8edad66f9c03cb6d62b26c000 2023-10-06T23:10:52.616 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:10:52 smithi190 ceph-mds[137985]: -- 172.21.15.190:0/2347602300 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5611d523d1e0 con 0x5611d5212c00 2023-10-06T23:10:52.616 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:10:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-f[137961]: starting mds.f at 2023-10-06T23:10:52.942 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:10:52 smithi190 systemd[1]: Started Ceph mds.f for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:10:53.002 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/1394888719 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc04102a40 msgr2=0x7fdc04109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/1394888719 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc04102a40 0x7fdc04109360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009f90 tx=0x7fdbfc00b330 comp rx=0 tx=0).stop 2023-10-06T23:10:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/1394888719 shutdown_connections 2023-10-06T23:10:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/1394888719 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc04102a40 0x7fdc04109360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/1394888719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc04100ea0 0x7fdc041012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/1394888719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc04102080 0x7fdc04102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/1394888719 >> 172.21.15.8:0/1394888719 conn(0x7fdc040fc420 msgr2=0x7fdc040fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/1394888719 shutdown_connections 2023-10-06T23:10:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.216+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/1394888719 wait complete. 2023-10-06T23:10:53.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.217+0000 7fdc0b3ff700 1 Processor -- start 2023-10-06T23:10:53.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.217+0000 7fdc0b3ff700 1 -- start start 2023-10-06T23:10:53.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.217+0000 7fdc0b3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc04100ea0 0x7fdc04198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.217+0000 7fdc0b3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc04102080 0x7fdc04199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.217+0000 7fdc0b3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc04102a40 0x7fdc041a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.217+0000 7fdc0b3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041a0970 con 0x7fdc04100ea0 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.217+0000 7fdc0b3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041a0ab0 con 0x7fdc04102a40 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.217+0000 7fdc0b3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041a0c40 con 0x7fdc04102080 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc04100ea0 0x7fdc04198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc04100ea0 0x7fdc04198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44990/0 (socket says 172.21.15.8:44990) 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 -- 172.21.15.8:0/934158665 learned_addr learned my addr 172.21.15.8:0/934158665 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0899a700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc04102080 0x7fdc04199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0999c700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc04102a40 0x7fdc041a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 -- 172.21.15.8:0/934158665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc04102080 msgr2=0x7fdc04199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:53.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc04102080 0x7fdc04199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 -- 172.21.15.8:0/934158665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc04102a40 msgr2=0x7fdc041a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc04102a40 0x7fdc041a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 -- 172.21.15.8:0/934158665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc009c40 con 0x7fdc04100ea0 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdc0919b700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc04100ea0 0x7fdc04198df0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000e970 tx=0x7fdc0000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.218+0000 7fdbfa7fc700 1 -- 172.21.15.8:0/934158665 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00009790 con 0x7fdc04100ea0 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.219+0000 7fdbfa7fc700 1 -- 172.21.15.8:0/934158665 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc0000c7c0 con 0x7fdc04100ea0 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.219+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc041a0f20 con 0x7fdc04100ea0 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.219+0000 7fdbfa7fc700 1 -- 172.21.15.8:0/934158665 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00003b40 con 0x7fdc04100ea0 2023-10-06T23:10:53.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.219+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc041a1340 con 0x7fdc04100ea0 2023-10-06T23:10:53.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.220+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc04193400 con 0x7fdc04100ea0 2023-10-06T23:10:53.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.222+0000 7fdbfa7fc700 1 -- 172.21.15.8:0/934158665 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdc0000c930 con 0x7fdc04100ea0 2023-10-06T23:10:53.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.223+0000 7fdbfa7fc700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdbf00a14d0 0x7fdbf00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:53.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.224+0000 7fdbfa7fc700 1 -- 172.21.15.8:0/934158665 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdc00014070 con 0x7fdc04100ea0 2023-10-06T23:10:53.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.224+0000 7fdc0899a700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdbf00a14d0 0x7fdbf00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:53.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.224+0000 7fdc0899a700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdbf00a14d0 0x7fdbf00a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc04100bc0 tx=0x7fdbf4009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:53.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.226+0000 7fdbfa7fc700 1 -- 172.21.15.8:0/934158665 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdc00096620 con 0x7fdc04100ea0 2023-10-06T23:10:53.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.483+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc0410c8c0 con 0x7fdc04100ea0 2023-10-06T23:10:53.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.484+0000 7fdbfa7fc700 1 -- 172.21.15.8:0/934158665 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5280 (secure 0 0 0) 0x7fdc000a0070 con 0x7fdc04100ea0 2023-10-06T23:10:53.485 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:53.485 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-06T23:10:53.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdbf00a14d0 msgr2=0x7fdbf00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:53.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdbf00a14d0 0x7fdbf00a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc04100bc0 tx=0x7fdbf4009310 comp rx=0 tx=0).stop 2023-10-06T23:10:53.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc04100ea0 msgr2=0x7fdc04198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:53.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc04100ea0 0x7fdc04198df0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000e970 tx=0x7fdc0000ec80 comp rx=0 tx=0).stop 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 shutdown_connections 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdbf00a14d0 0x7fdbf00a3990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdc04100ea0 0x7fdc04198df0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc04102a40 0x7fdc041a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 --2- 172.21.15.8:0/934158665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc04102080 0x7fdc04199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 >> 172.21.15.8:0/934158665 conn(0x7fdc040fc420 msgr2=0x7fdc041079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 shutdown_connections 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:53.486+0000 7fdc0b3ff700 1 -- 172.21.15.8:0/934158665 wait complete. 2023-10-06T23:10:53.488 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 7 2023-10-06T23:10:53.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:53.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:53.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:53.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:53.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:53.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:53.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: Deploying daemon mds.c on smithi190 2023-10-06T23:10:53.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] up:boot 2023-10-06T23:10:53.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: fsmap 6 up:standby 2023-10-06T23:10:53.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-06T23:10:53.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:53.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:53 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/934158665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: Deploying daemon mds.c on smithi190 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] up:boot 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: fsmap 6 up:standby 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:53.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:53 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/934158665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:54.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: Deploying daemon mds.c on smithi190 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] up:boot 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: fsmap 6 up:standby 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-06T23:10:54.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:54.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:53 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/934158665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:55.193 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:10:54 smithi190 systemd[1]: Starting Ceph mds.c for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:10:55.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:55.550 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:10:55 smithi190 podman[138288]: 2023-10-06T23:10:55.550 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:10:55 smithi190 bash[138288]: d3bf868a1042fc00c80f971659fe23a7488b2e3d265a1825eb9f30db9a798940 2023-10-06T23:10:55.550 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mds[138328]: -- 172.21.15.190:0/2522338126 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5578be8df1e0 con 0x5578be8b5000 2023-10-06T23:10:55.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3182988259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 msgr2=0x7f6bac109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:55.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3182988259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 0x7f6bac109360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400b0a0 tx=0x7f6ba400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3182988259 shutdown_connections 2023-10-06T23:10:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3182988259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 0x7f6bac109360 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3182988259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bac100ea0 0x7f6bac1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3182988259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bac102080 0x7f6bac102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3182988259 >> 172.21.15.8:0/3182988259 conn(0x7f6bac0fc420 msgr2=0x7f6bac0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:55.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3182988259 shutdown_connections 2023-10-06T23:10:55.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.723+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3182988259 wait complete. 2023-10-06T23:10:55.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.724+0000 7f6bb3fff700 1 Processor -- start 2023-10-06T23:10:55.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.724+0000 7f6bb3fff700 1 -- start start 2023-10-06T23:10:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.724+0000 7f6bb3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bac100ea0 0x7f6bac074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.724+0000 7f6bb3fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bac102080 0x7f6bac0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.724+0000 7f6bb3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 0x7f6bac0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.724+0000 7f6bb3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac073f80 con 0x7f6bac102a40 2023-10-06T23:10:55.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.724+0000 7f6bb3fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0740f0 con 0x7f6bac100ea0 2023-10-06T23:10:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.724+0000 7f6bb3fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac1a0c00 con 0x7f6bac102080 2023-10-06T23:10:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 0x7f6bac0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bac100ea0 0x7f6bac074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 0x7f6bac0737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45008/0 (socket says 172.21.15.8:45008) 2023-10-06T23:10:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 -- 172.21.15.8:0/3019852417 learned_addr learned my addr 172.21.15.8:0/3019852417 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb159a700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bac102080 0x7f6bac0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:55.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 -- 172.21.15.8:0/3019852417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bac102080 msgr2=0x7f6bac0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bac102080 0x7f6bac0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 -- 172.21.15.8:0/3019852417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bac100ea0 msgr2=0x7f6bac074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bac100ea0 0x7f6bac074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 -- 172.21.15.8:0/3019852417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4009d00 con 0x7f6bac102a40 2023-10-06T23:10:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb1d9b700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bac100ea0 0x7f6bac074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:10:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.725+0000 7f6bb259c700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 0x7f6bac0737e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400d010 tx=0x7f6ba400bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:55.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.726+0000 7f6ba2ffd700 1 -- 172.21.15.8:0/3019852417 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400e040 con 0x7f6bac102a40 2023-10-06T23:10:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.726+0000 7f6ba2ffd700 1 -- 172.21.15.8:0/3019852417 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ba4003e10 con 0x7f6bac102a40 2023-10-06T23:10:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.726+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac1a0e80 con 0x7f6bac102a40 2023-10-06T23:10:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.726+0000 7f6ba2ffd700 1 -- 172.21.15.8:0/3019852417 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40052a0 con 0x7f6bac102a40 2023-10-06T23:10:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.726+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac1a12a0 con 0x7f6bac102a40 2023-10-06T23:10:55.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.727+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac10c5c0 con 0x7f6bac102a40 2023-10-06T23:10:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.729+0000 7f6ba2ffd700 1 -- 172.21.15.8:0/3019852417 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6ba401d9a0 con 0x7f6bac102a40 2023-10-06T23:10:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.730+0000 7f6ba2ffd700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b980a1550 0x7f6b980a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.730+0000 7f6ba2ffd700 1 -- 172.21.15.8:0/3019852417 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6ba40cdf30 con 0x7f6bac102a40 2023-10-06T23:10:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.730+0000 7f6bb1d9b700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b980a1550 0x7f6b980a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.731+0000 7f6bb1d9b700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b980a1550 0x7f6b980a3a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6bac101bf0 tx=0x7f6ba8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:55.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.732+0000 7f6ba2ffd700 1 -- 172.21.15.8:0/3019852417 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6ba4097ab0 con 0x7f6bac102a40 2023-10-06T23:10:55.942 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-c[138304]: starting mds.c at 2023-10-06T23:10:55.943 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:10:55 smithi190 systemd[1]: Started Ceph mds.c for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:10:55.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.988+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bac107e00 con 0x7f6bac102a40 2023-10-06T23:10:55.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.988+0000 7f6ba2ffd700 1 -- 172.21.15.8:0/3019852417 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5280 (secure 0 0 0) 0x7f6ba409b0d0 con 0x7f6bac102a40 2023-10-06T23:10:55.990 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:55.990 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-06T23:10:55.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b980a1550 msgr2=0x7f6b980a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:55.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b980a1550 0x7f6b980a3a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6bac101bf0 tx=0x7f6ba8009260 comp rx=0 tx=0).stop 2023-10-06T23:10:55.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 msgr2=0x7f6bac0737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 0x7f6bac0737e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400d010 tx=0x7f6ba400bcc0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 shutdown_connections 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b980a1550 0x7f6b980a3a10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bac102a40 0x7f6bac0737e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bac100ea0 0x7f6bac074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 --2- 172.21.15.8:0/3019852417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bac102080 0x7f6bac0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 >> 172.21.15.8:0/3019852417 conn(0x7f6bac0fc420 msgr2=0x7f6bac0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 shutdown_connections 2023-10-06T23:10:55.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:55.991+0000 7f6bb3fff700 1 -- 172.21.15.8:0/3019852417 wait complete. 2023-10-06T23:10:55.994 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 7 2023-10-06T23:10:56.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:55 smithi156 ceph-mon[102862]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:56.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:55 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3019852417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:55 smithi008 ceph-mon[98532]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:56.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:55 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3019852417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:56.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mon[102658]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:56.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:56.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:56.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:56.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:56.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:55 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3019852417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:57.303 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:56 smithi156 ceph-mon[102862]: Deploying daemon mds.h on smithi156 2023-10-06T23:10:57.303 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:56 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.190:6836/3967292194,v1:172.21.15.190:6837/3967292194] up:boot 2023-10-06T23:10:57.303 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:56 smithi156 ceph-mon[102862]: fsmap 7 up:standby 2023-10-06T23:10:57.303 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-06T23:10:57.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:56 smithi008 ceph-mon[98532]: Deploying daemon mds.h on smithi156 2023-10-06T23:10:57.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:56 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.190:6836/3967292194,v1:172.21.15.190:6837/3967292194] up:boot 2023-10-06T23:10:57.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:56 smithi008 ceph-mon[98532]: fsmap 7 up:standby 2023-10-06T23:10:57.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-06T23:10:57.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:56 smithi190 ceph-mon[102658]: Deploying daemon mds.h on smithi156 2023-10-06T23:10:57.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:56 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.190:6836/3967292194,v1:172.21.15.190:6837/3967292194] up:boot 2023-10-06T23:10:57.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:56 smithi190 ceph-mon[102658]: fsmap 7 up:standby 2023-10-06T23:10:57.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-06T23:10:57.998 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:10:57 smithi156 systemd[1]: Starting Ceph mds.h for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:10:58.013 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.224+0000 7f99cffff700 1 -- 172.21.15.8:0/2942678862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102080 msgr2=0x7f99c8102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.224+0000 7f99cffff700 1 --2- 172.21.15.8:0/2942678862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102080 0x7f99c8102500 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009990 tx=0x7f99b8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.224+0000 7f99cffff700 1 -- 172.21.15.8:0/2942678862 shutdown_connections 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.224+0000 7f99cffff700 1 --2- 172.21.15.8:0/2942678862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c8102a40 0x7f99c8109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.224+0000 7f99cffff700 1 --2- 172.21.15.8:0/2942678862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c8100ea0 0x7f99c81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.224+0000 7f99cffff700 1 --2- 172.21.15.8:0/2942678862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102080 0x7f99c8102500 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.224+0000 7f99cffff700 1 -- 172.21.15.8:0/2942678862 >> 172.21.15.8:0/2942678862 conn(0x7f99c80fc420 msgr2=0x7f99c80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.224+0000 7f99cffff700 1 -- 172.21.15.8:0/2942678862 shutdown_connections 2023-10-06T23:10:58.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.225+0000 7f99cffff700 1 -- 172.21.15.8:0/2942678862 wait complete. 2023-10-06T23:10:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.225+0000 7f99cffff700 1 Processor -- start 2023-10-06T23:10:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cffff700 1 -- start start 2023-10-06T23:10:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c8100ea0 0x7f99c8074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c8102080 0x7f99c80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102a40 0x7f99c80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8073f80 con 0x7f99c8102a40 2023-10-06T23:10:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c80740f0 con 0x7f99c8102080 2023-10-06T23:10:58.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cffff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c81a0bd0 con 0x7f99c8100ea0 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cd59a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c8102080 0x7f99c80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cdd9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c8100ea0 0x7f99c8074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99ce59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102a40 0x7f99c80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cd59a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c8102080 0x7f99c80732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:52394/0 (socket says 172.21.15.8:52394) 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.226+0000 7f99cd59a700 1 -- 172.21.15.8:0/2323513955 learned_addr learned my addr 172.21.15.8:0/2323513955 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99cd59a700 1 -- 172.21.15.8:0/2323513955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c8100ea0 msgr2=0x7f99c8074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99cd59a700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c8100ea0 0x7f99c8074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99cd59a700 1 -- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102a40 msgr2=0x7f99c80737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99cd59a700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102a40 0x7f99c80737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99cd59a700 1 -- 172.21.15.8:0/2323513955 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80095f0 con 0x7f99c8102080 2023-10-06T23:10:58.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99ce59c700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102a40 0x7f99c80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:10:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99cdd9b700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c8100ea0 0x7f99c8074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:10:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99cd59a700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c8102080 0x7f99c80732a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99b80098e0 tx=0x7f99b8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.227+0000 7f99beffd700 1 -- 172.21.15.8:0/2323513955 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b801d070 con 0x7f99c8102080 2023-10-06T23:10:58.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.228+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c81a0e50 con 0x7f99c8102080 2023-10-06T23:10:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.228+0000 7f99beffd700 1 -- 172.21.15.8:0/2323513955 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99b800be30 con 0x7f99c8102080 2023-10-06T23:10:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.228+0000 7f99beffd700 1 -- 172.21.15.8:0/2323513955 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8022d80 con 0x7f99c8102080 2023-10-06T23:10:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.228+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c81a1210 con 0x7f99c8102080 2023-10-06T23:10:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.229+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c810c610 con 0x7f99c8102080 2023-10-06T23:10:58.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.230+0000 7f99beffd700 1 -- 172.21.15.8:0/2323513955 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f99b8022470 con 0x7f99c8102080 2023-10-06T23:10:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.232+0000 7f99beffd700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99b40a14d0 0x7f99b40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:10:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.232+0000 7f99beffd700 1 -- 172.21.15.8:0/2323513955 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f99b80cdd60 con 0x7f99c8102080 2023-10-06T23:10:58.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.232+0000 7f99cdd9b700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99b40a14d0 0x7f99b40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:10:58.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.233+0000 7f99cdd9b700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99b40a14d0 0x7f99b40a3990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99c8101bf0 tx=0x7f99c4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:10:58.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.234+0000 7f99beffd700 1 -- 172.21.15.8:0/2323513955 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99b8097850 con 0x7f99c8102080 2023-10-06T23:10:58.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:57 smithi156 ceph-mon[102862]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:58.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:57 smithi008 ceph-mon[98532]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:58.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:57 smithi190 ceph-mon[102658]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:10:58.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.492+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99c8107ef0 con 0x7f99c8102080 2023-10-06T23:10:58.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.493+0000 7f99beffd700 1 -- 172.21.15.8:0/2323513955 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6074 (secure 0 0 0) 0x7f99b809ae70 con 0x7f99c8102080 2023-10-06T23:10:58.495 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:10:58.495 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-06T23:10:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99b40a14d0 msgr2=0x7f99b40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99b40a14d0 0x7f99b40a3990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99c8101bf0 tx=0x7f99c4009260 comp rx=0 tx=0).stop 2023-10-06T23:10:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c8102080 msgr2=0x7f99c80732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:10:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c8102080 0x7f99c80732a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99b80098e0 tx=0x7f99b8004730 comp rx=0 tx=0).stop 2023-10-06T23:10:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 shutdown_connections 2023-10-06T23:10:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99b40a14d0 0x7f99b40a3990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c8102a40 0x7f99c80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c8100ea0 0x7f99c8074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 --2- 172.21.15.8:0/2323513955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c8102080 0x7f99c80732a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:10:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 >> 172.21.15.8:0/2323513955 conn(0x7f99c80fc420 msgr2=0x7f99c80fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:10:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.495+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 shutdown_connections 2023-10-06T23:10:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:10:58.496+0000 7f99cffff700 1 -- 172.21.15.8:0/2323513955 wait complete. 2023-10-06T23:10:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-06T23:10:58.720 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:10:58 smithi156 podman[139006]: 2023-10-06T23:10:59.004 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:10:58 smithi156 bash[139006]: 03a9ecf3173eca6a56f38c9bdc02a51ffb9bdf1c2c44a7e433de067a2210943c 2023-10-06T23:10:59.004 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:10:58 smithi156 ceph-mds[139046]: -- 172.21.15.156:0/1539726249 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5643ed7031e0 con 0x5643ed6d9000 2023-10-06T23:10:59.005 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:10:58 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-h[139022]: starting mds.h at 2023-10-06T23:10:59.005 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:10:58 smithi156 systemd[1]: Started Ceph mds.h for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:10:59.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:59 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2323513955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:59 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:59 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:59 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:59 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:59 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:59.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:10:59 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:59.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:59 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2323513955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:59.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:59 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:59 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:59 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:59 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:59.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:59 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:59.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:10:59 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:10:59.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:59 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2323513955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:10:59.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:59 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:59 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:59 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:10:59.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:59 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:10:59.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:59 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:10:59.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:10:59 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:00.141 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:00 smithi190 ceph-mon[102658]: Deploying daemon mds.i on smithi190 2023-10-06T23:11:00.142 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:00 smithi190 ceph-mon[102658]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:00.142 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:00 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.156:6836/2054249175,v1:172.21.15.156:6837/2054249175] up:boot 2023-10-06T23:11:00.142 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:00 smithi190 ceph-mon[102658]: fsmap 8 up:standby 2023-10-06T23:11:00.142 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:00 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-06T23:11:00.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:00 smithi156 ceph-mon[102862]: Deploying daemon mds.i on smithi190 2023-10-06T23:11:00.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:00 smithi156 ceph-mon[102862]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:00.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:00 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.156:6836/2054249175,v1:172.21.15.156:6837/2054249175] up:boot 2023-10-06T23:11:00.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:00 smithi156 ceph-mon[102862]: fsmap 8 up:standby 2023-10-06T23:11:00.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:00 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-06T23:11:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:00 smithi008 ceph-mon[98532]: Deploying daemon mds.i on smithi190 2023-10-06T23:11:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:00 smithi008 ceph-mon[98532]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:00 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.156:6836/2054249175,v1:172.21.15.156:6837/2054249175] up:boot 2023-10-06T23:11:00.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:00 smithi008 ceph-mon[98532]: fsmap 8 up:standby 2023-10-06T23:11:00.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:00 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-06T23:11:00.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:11:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 -- 172.21.15.8:0/4201765678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 msgr2=0x7f9048106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4201765678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 0x7f9048106660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9034009990 tx=0x7f9034009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 -- 172.21.15.8:0/4201765678 shutdown_connections 2023-10-06T23:11:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4201765678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9048106ba0 0x7f9048109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4201765678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9048101940 0x7f9048103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4201765678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 0x7f9048106660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 -- 172.21.15.8:0/4201765678 >> 172.21.15.8:0/4201765678 conn(0x7f90480fb310 msgr2=0x7f90480fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 -- 172.21.15.8:0/4201765678 shutdown_connections 2023-10-06T23:11:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.729+0000 7f904f1ff700 1 -- 172.21.15.8:0/4201765678 wait complete. 2023-10-06T23:11:00.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.731+0000 7f904f1ff700 1 Processor -- start 2023-10-06T23:11:00.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.731+0000 7f904f1ff700 1 -- start start 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.731+0000 7f904f1ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9048101940 0x7f9048196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.731+0000 7f904f1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 0x7f9048197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.731+0000 7f904f1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9048106ba0 0x7f904819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.731+0000 7f904f1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904819e680 con 0x7f9048104270 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.731+0000 7f904f1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904819e7c0 con 0x7f9048106ba0 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.731+0000 7f904f1ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904819e950 con 0x7f9048101940 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 0x7f9048197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 0x7f9048197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33902/0 (socket says 172.21.15.8:33902) 2023-10-06T23:11:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 -- 172.21.15.8:0/4129672183 learned_addr learned my addr 172.21.15.8:0/4129672183 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f904cf9b700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9048101940 0x7f9048196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f904d79c700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9048106ba0 0x7f904819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 -- 172.21.15.8:0/4129672183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9048101940 msgr2=0x7f9048196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9048101940 0x7f9048196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 -- 172.21.15.8:0/4129672183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9048106ba0 msgr2=0x7f904819e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9048106ba0 0x7f904819e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 -- 172.21.15.8:0/4129672183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340095f0 con 0x7f9048104270 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.732+0000 7f9047fff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 0x7f9048197040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9034005910 tx=0x7f9034005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.733+0000 7f9045ffb700 1 -- 172.21.15.8:0/4129672183 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903401d070 con 0x7f9048104270 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.733+0000 7f9045ffb700 1 -- 172.21.15.8:0/4129672183 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9034022470 con 0x7f9048104270 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.733+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904819ebd0 con 0x7f9048104270 2023-10-06T23:11:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.733+0000 7f9045ffb700 1 -- 172.21.15.8:0/4129672183 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400f6c0 con 0x7f9048104270 2023-10-06T23:11:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.733+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904819eff0 con 0x7f9048104270 2023-10-06T23:11:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.734+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90480fce90 con 0x7f9048104270 2023-10-06T23:11:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.736+0000 7f9045ffb700 1 -- 172.21.15.8:0/4129672183 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f90340225e0 con 0x7f9048104270 2023-10-06T23:11:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.738+0000 7f9045ffb700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f90380a14d0 0x7f90380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.738+0000 7f9045ffb700 1 -- 172.21.15.8:0/4129672183 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f90340cdeb0 con 0x7f9048104270 2023-10-06T23:11:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.738+0000 7f904cf9b700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f90380a14d0 0x7f90380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.739+0000 7f904cf9b700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f90380a14d0 0x7f90380a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f903c005950 tx=0x7f903c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:00.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:00.742+0000 7f9045ffb700 1 -- 172.21.15.8:0/4129672183 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f90340979a0 con 0x7f9048104270 2023-10-06T23:11:01.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.001+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f904810c5b0 con 0x7f9048104270 2023-10-06T23:11:01.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.001+0000 7f9045ffb700 1 -- 172.21.15.8:0/4129672183 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6868 (secure 0 0 0) 0x7f903409afc0 con 0x7f9048104270 2023-10-06T23:11:01.004 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:01.004 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-06T23:11:01.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f90380a14d0 msgr2=0x7f90380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:01.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f90380a14d0 0x7f90380a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f903c005950 tx=0x7f903c00b410 comp rx=0 tx=0).stop 2023-10-06T23:11:01.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 msgr2=0x7f9048197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 0x7f9048197040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9034005910 tx=0x7f9034005720 comp rx=0 tx=0).stop 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 shutdown_connections 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f90380a14d0 0x7f90380a3990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9048106ba0 0x7f904819e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9048101940 0x7f9048196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 --2- 172.21.15.8:0/4129672183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9048104270 0x7f9048197040 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 >> 172.21.15.8:0/4129672183 conn(0x7f90480fb310 msgr2=0x7f90481025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 shutdown_connections 2023-10-06T23:11:01.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:01.004+0000 7f904f1ff700 1 -- 172.21.15.8:0/4129672183 wait complete. 2023-10-06T23:11:01.008 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-06T23:11:01.097 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4129672183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:01.098 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:11:01 smithi190 systemd[1]: Starting Ceph mds.i for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:11:01.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4129672183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:01.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4129672183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:01.857 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:11:01 smithi190 podman[138628]: 2023-10-06T23:11:01.857 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:11:01 smithi190 bash[138628]: 1dc4a75f91ceb5e4a6c9572de21b4a295126cb1d929b7ed666043aed54092226 2023-10-06T23:11:01.857 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:11:01 smithi190 ceph-mds[138668]: -- 172.21.15.190:0/2049741381 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56316290b1e0 con 0x5631628e0c00 2023-10-06T23:11:01.857 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:11:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-i[138644]: starting mds.i at 2023-10-06T23:11:02.192 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:11:01 smithi190 systemd[1]: Started Ceph mds.i for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:11:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:02 smithi190 ceph-mon[102658]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:02 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:02 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:02 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:02 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:02 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:02 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:02.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:02 smithi156 ceph-mon[102862]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:02 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:02 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:02 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:02 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:02 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:02 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:02 smithi008 ceph-mon[98532]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:02.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:02 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:03.027 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:11:03.223 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:03 smithi008 ceph-mon[98532]: Deploying daemon mds.g on smithi008 2023-10-06T23:11:03.223 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:03 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] up:boot 2023-10-06T23:11:03.223 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:03 smithi008 ceph-mon[98532]: fsmap 9 up:standby 2023-10-06T23:11:03.223 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:03 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-06T23:11:03.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 -- 172.21.15.8:0/3156886313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 msgr2=0x7f32d0109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:03.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3156886313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 0x7f32d0109010 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b0a0 tx=0x7f32c800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 -- 172.21.15.8:0/3156886313 shutdown_connections 2023-10-06T23:11:03.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3156886313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 0x7f32d0109010 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3156886313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0101940 0x7f32d0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3156886313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32d0104270 0x7f32d0106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 -- 172.21.15.8:0/3156886313 >> 172.21.15.8:0/3156886313 conn(0x7f32d00fb310 msgr2=0x7f32d00fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:03.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 -- 172.21.15.8:0/3156886313 shutdown_connections 2023-10-06T23:11:03.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.255+0000 7f32d7dff700 1 -- 172.21.15.8:0/3156886313 wait complete. 2023-10-06T23:11:03.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.256+0000 7f32d7dff700 1 Processor -- start 2023-10-06T23:11:03.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.256+0000 7f32d7dff700 1 -- start start 2023-10-06T23:11:03.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.256+0000 7f32d7dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32d0101940 0x7f32d0196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:03.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.256+0000 7f32d7dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0104270 0x7f32d0197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:03.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.256+0000 7f32d7dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 0x7f32d019e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:03.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.256+0000 7f32d7dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d019e670 con 0x7f32d0106ba0 2023-10-06T23:11:03.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.256+0000 7f32d7dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d019e7b0 con 0x7f32d0104270 2023-10-06T23:11:03.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.256+0000 7f32d7dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d019e940 con 0x7f32d0101940 2023-10-06T23:11:03.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 0x7f32d019e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:03.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 0x7f32d019e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33922/0 (socket says 172.21.15.8:33922) 2023-10-06T23:11:03.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 -- 172.21.15.8:0/3388236054 learned_addr learned my addr 172.21.15.8:0/3388236054 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:03.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d539a700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0104270 0x7f32d0197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:03.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d5b9b700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32d0101940 0x7f32d0196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 -- 172.21.15.8:0/3388236054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32d0101940 msgr2=0x7f32d0196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32d0101940 0x7f32d0196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 -- 172.21.15.8:0/3388236054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0104270 msgr2=0x7f32d0197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0104270 0x7f32d0197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 -- 172.21.15.8:0/3388236054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0009520 con 0x7f32d0106ba0 2023-10-06T23:11:03.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.257+0000 7f32d639c700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 0x7f32d019e0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f32c800d010 tx=0x7f32c800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.258+0000 7f32c6ffd700 1 -- 172.21.15.8:0/3388236054 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800e040 con 0x7f32d0106ba0 2023-10-06T23:11:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.258+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c8009d00 con 0x7f32d0106ba0 2023-10-06T23:11:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.258+0000 7f32c6ffd700 1 -- 172.21.15.8:0/3388236054 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32c8003e10 con 0x7f32d0106ba0 2023-10-06T23:11:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.258+0000 7f32c6ffd700 1 -- 172.21.15.8:0/3388236054 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c80052a0 con 0x7f32d0106ba0 2023-10-06T23:11:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.258+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d019ee50 con 0x7f32d0106ba0 2023-10-06T23:11:03.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.259+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d00fce90 con 0x7f32d0106ba0 2023-10-06T23:11:03.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.261+0000 7f32c6ffd700 1 -- 172.21.15.8:0/3388236054 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f32c801d9a0 con 0x7f32d0106ba0 2023-10-06T23:11:03.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.262+0000 7f32c6ffd700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32bc0a14d0 0x7f32bc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:03.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.262+0000 7f32c6ffd700 1 -- 172.21.15.8:0/3388236054 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f32c80cda50 con 0x7f32d0106ba0 2023-10-06T23:11:03.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.262+0000 7f32d5b9b700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32bc0a14d0 0x7f32bc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:03.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.263+0000 7f32d5b9b700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32bc0a14d0 0x7f32bc0a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00ac50 tx=0x7f32cc00a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:03.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.266+0000 7f32c6ffd700 1 -- 172.21.15.8:0/3388236054 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f32c8097540 con 0x7f32d0106ba0 2023-10-06T23:11:03.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:03 smithi156 ceph-mon[102862]: Deploying daemon mds.g on smithi008 2023-10-06T23:11:03.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:03 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] up:boot 2023-10-06T23:11:03.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:03 smithi156 ceph-mon[102862]: fsmap 9 up:standby 2023-10-06T23:11:03.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:03 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-06T23:11:03.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:03 smithi190 ceph-mon[102658]: Deploying daemon mds.g on smithi008 2023-10-06T23:11:03.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:03 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] up:boot 2023-10-06T23:11:03.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:03 smithi190 ceph-mon[102658]: fsmap 9 up:standby 2023-10-06T23:11:03.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:03 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-06T23:11:03.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.533+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32d010c550 con 0x7f32d0106ba0 2023-10-06T23:11:03.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.534+0000 7f32c6ffd700 1 -- 172.21.15.8:0/3388236054 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7661 (secure 0 0 0) 0x7f32c809ab60 con 0x7f32d0106ba0 2023-10-06T23:11:03.536 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:03.536 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-06T23:11:03.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32bc0a14d0 msgr2=0x7f32bc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:03.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32bc0a14d0 0x7f32bc0a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00ac50 tx=0x7f32cc00a380 comp rx=0 tx=0).stop 2023-10-06T23:11:03.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 msgr2=0x7f32d019e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:03.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 0x7f32d019e0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f32c800d010 tx=0x7f32c800bcc0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 shutdown_connections 2023-10-06T23:11:03.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32bc0a14d0 0x7f32bc0a3990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32d0106ba0 0x7f32d019e0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32d0101940 0x7f32d0196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 --2- 172.21.15.8:0/3388236054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32d0104270 0x7f32d0197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:03.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 >> 172.21.15.8:0/3388236054 conn(0x7f32d00fb310 msgr2=0x7f32d0102650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:03.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 shutdown_connections 2023-10-06T23:11:03.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:03.537+0000 7f32d7dff700 1 -- 172.21.15.8:0/3388236054 wait complete. 2023-10-06T23:11:03.542 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 10 2023-10-06T23:11:04.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:04 smithi008 ceph-mon[98532]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:04.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:04 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3388236054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:04.194 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:11:04 smithi008 systemd[1]: Starting Ceph mds.g for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:11:04.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:04 smithi156 ceph-mon[102862]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:04.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:04 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3388236054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:04.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:04 smithi190 ceph-mon[102658]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:04.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:04 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3388236054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:04.927 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:11:04 smithi008 podman[148599]: 2023-10-06T23:11:05.395 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:11:05 smithi008 bash[148599]: 247e7c3ea7804c15468b027005504c3ad612a2ffdc5a802d6165c005e7d9f635 2023-10-06T23:11:05.395 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:11:05 smithi008 ceph-mds[148639]: -- 172.21.15.8:0/3197673781 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5653bb5c51e0 con 0x5653bb59b000 2023-10-06T23:11:05.395 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:11:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-g[148615]: starting mds.g at 2023-10-06T23:11:05.396 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:11:05 smithi008 systemd[1]: Started Ceph mds.g for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:11:05.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:11:05.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3235659263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 msgr2=0x7f4dd4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:05.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3235659263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 0x7f4dd4109350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009990 tx=0x7f4dcc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:05.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3235659263 shutdown_connections 2023-10-06T23:11:05.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3235659263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 0x7f4dd4109350 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:05.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3235659263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dd4100e90 0x7f4dd41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:05.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3235659263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd4102070 0x7f4dd41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:05.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3235659263 >> 172.21.15.8:0/3235659263 conn(0x7f4dd40fc430 msgr2=0x7f4dd40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:05.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3235659263 shutdown_connections 2023-10-06T23:11:05.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.796+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3235659263 wait complete. 2023-10-06T23:11:05.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.797+0000 7f4ddbdff700 1 Processor -- start 2023-10-06T23:11:05.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.797+0000 7f4ddbdff700 1 -- start start 2023-10-06T23:11:05.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.797+0000 7f4ddbdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dd4100e90 0x7f4dd4198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:05.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.797+0000 7f4ddbdff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd4102070 0x7f4dd41991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:05.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.797+0000 7f4ddbdff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 0x7f4dd41a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:05.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.797+0000 7f4ddbdff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a0800 con 0x7f4dd4102a30 2023-10-06T23:11:05.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.797+0000 7f4ddbdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a0970 con 0x7f4dd4100e90 2023-10-06T23:11:05.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.797+0000 7f4ddbdff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a0b30 con 0x7f4dd4102070 2023-10-06T23:11:05.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 0x7f4dd41a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:05.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dd9b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dd4100e90 0x7f4dd4198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:05.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 0x7f4dd41a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33962/0 (socket says 172.21.15.8:33962) 2023-10-06T23:11:05.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 -- 172.21.15.8:0/3576940659 learned_addr learned my addr 172.21.15.8:0/3576940659 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:05.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dd939a700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd4102070 0x7f4dd41991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:05.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 -- 172.21.15.8:0/3576940659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd4102070 msgr2=0x7f4dd41991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:05.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd4102070 0x7f4dd41991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:05.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 -- 172.21.15.8:0/3576940659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dd4100e90 msgr2=0x7f4dd4198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:05.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dd4100e90 0x7f4dd4198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:05.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 -- 172.21.15.8:0/3576940659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0095f0 con 0x7f4dd4102a30 2023-10-06T23:11:05.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.798+0000 7f4dda39c700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 0x7f4dd41a0230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc004730 tx=0x7f4dcc004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:05.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.799+0000 7f4dd2ffd700 1 -- 172.21.15.8:0/3576940659 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc01d070 con 0x7f4dd4102a30 2023-10-06T23:11:05.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.799+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd41a0db0 con 0x7f4dd4102a30 2023-10-06T23:11:05.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.799+0000 7f4dd2ffd700 1 -- 172.21.15.8:0/3576940659 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dcc00be30 con 0x7f4dd4102a30 2023-10-06T23:11:05.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.799+0000 7f4dd2ffd700 1 -- 172.21.15.8:0/3576940659 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc005290 con 0x7f4dd4102a30 2023-10-06T23:11:05.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.799+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd41a11d0 con 0x7f4dd4102a30 2023-10-06T23:11:05.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.800+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd410c600 con 0x7f4dd4102a30 2023-10-06T23:11:05.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.802+0000 7f4dd2ffd700 1 -- 172.21.15.8:0/3576940659 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4dcc0049d0 con 0x7f4dd4102a30 2023-10-06T23:11:05.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.803+0000 7f4dd2ffd700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4dbc0a14d0 0x7f4dbc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:05.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.803+0000 7f4dd2ffd700 1 -- 172.21.15.8:0/3576940659 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4dcc0cdd00 con 0x7f4dd4102a30 2023-10-06T23:11:05.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.804+0000 7f4dd9b9b700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4dbc0a14d0 0x7f4dbc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:05.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.804+0000 7f4dd9b9b700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4dbc0a14d0 0x7f4dbc0a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4199b60 tx=0x7f4dc40091c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:05.805+0000 7f4dd2ffd700 1 -- 172.21.15.8:0/3576940659 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4dcc0977f0 con 0x7f4dd4102a30 2023-10-06T23:11:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.097+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dd41a13c0 con 0x7f4dd4102a30 2023-10-06T23:11:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.097+0000 7f4dd2ffd700 1 -- 172.21.15.8:0/3576940659 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8450 (secure 0 0 0) 0x7f4dcc09ae10 con 0x7f4dd4102a30 2023-10-06T23:11:06.100 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:06.101 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-06T23:11:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4dbc0a14d0 msgr2=0x7f4dbc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4dbc0a14d0 0x7f4dbc0a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4199b60 tx=0x7f4dc40091c0 comp rx=0 tx=0).stop 2023-10-06T23:11:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 msgr2=0x7f4dd41a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 0x7f4dd41a0230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc004730 tx=0x7f4dcc004760 comp rx=0 tx=0).stop 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 shutdown_connections 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4dbc0a14d0 0x7f4dbc0a3990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4dd4102a30 0x7f4dd41a0230 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dd4100e90 0x7f4dd4198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 --2- 172.21.15.8:0/3576940659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd4102070 0x7f4dd41991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 >> 172.21.15.8:0/3576940659 conn(0x7f4dd40fc430 msgr2=0x7f4dd40fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 shutdown_connections 2023-10-06T23:11:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:06.100+0000 7f4ddbdff700 1 -- 172.21.15.8:0/3576940659 wait complete. 2023-10-06T23:11:06.104 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 11 2023-10-06T23:11:06.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:06 smithi008 ceph-mon[98532]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:06.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:06 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:06 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:06 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:06 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:06.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:06 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:06.305 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:06 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:06.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:06 smithi156 ceph-mon[102862]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:06.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:06 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:06 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:06 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:06 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:06.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:06 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:06.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:06 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:06.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:06 smithi190 ceph-mon[102658]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:06.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:06 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:06 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:06 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:06.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:06 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:06.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:06 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:06.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:06 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:07.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:07 smithi008 ceph-mon[98532]: Deploying daemon mds.a on smithi008 2023-10-06T23:11:07.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:07 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.8:6838/1169721104,v1:172.21.15.8:6839/1169721104] up:boot 2023-10-06T23:11:07.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:07 smithi008 ceph-mon[98532]: fsmap 10 up:standby 2023-10-06T23:11:07.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:07 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-06T23:11:07.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:07 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3576940659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:07.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:07 smithi156 ceph-mon[102862]: Deploying daemon mds.a on smithi008 2023-10-06T23:11:07.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:07 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.8:6838/1169721104,v1:172.21.15.8:6839/1169721104] up:boot 2023-10-06T23:11:07.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:07 smithi156 ceph-mon[102862]: fsmap 10 up:standby 2023-10-06T23:11:07.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:07 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-06T23:11:07.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:07 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3576940659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:07.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:07 smithi190 ceph-mon[102658]: Deploying daemon mds.a on smithi008 2023-10-06T23:11:07.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:07 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.8:6838/1169721104,v1:172.21.15.8:6839/1169721104] up:boot 2023-10-06T23:11:07.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:07 smithi190 ceph-mon[102658]: fsmap 10 up:standby 2023-10-06T23:11:07.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:07 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-06T23:11:07.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:07 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3576940659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:07.587 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:11:07 smithi008 systemd[1]: Starting Ceph mds.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:11:08.123 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:11:08.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/651814877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e4101f40 msgr2=0x7fb2e41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:08.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/651814877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e4101f40 0x7fb2e41023a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80099c0 tx=0x7fb2d8009cd0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/651814877 shutdown_connections 2023-10-06T23:11:08.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/651814877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e41028e0 0x7fb2e4109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/651814877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4100d50 0x7fb2e4101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/651814877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e4101f40 0x7fb2e41023a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/651814877 >> 172.21.15.8:0/651814877 conn(0x7fb2e40fc2e0 msgr2=0x7fb2e40fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/651814877 shutdown_connections 2023-10-06T23:11:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.341+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/651814877 wait complete. 2023-10-06T23:11:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.342+0000 7fb2e8f9d700 1 Processor -- start 2023-10-06T23:11:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.342+0000 7fb2e8f9d700 1 -- start start 2023-10-06T23:11:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.342+0000 7fb2e8f9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e4100d50 0x7fb2e4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.342+0000 7fb2e8f9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4101f40 0x7fb2e4198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.342+0000 7fb2e8f9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e41028e0 0x7fb2e41a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.342+0000 7fb2e8f9d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41a05e0 con 0x7fb2e41028e0 2023-10-06T23:11:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.342+0000 7fb2e8f9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41a0720 con 0x7fb2e4101f40 2023-10-06T23:11:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.342+0000 7fb2e8f9d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41a08b0 con 0x7fb2e4100d50 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e41028e0 0x7fb2e41a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e41028e0 0x7fb2e41a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33974/0 (socket says 172.21.15.8:33974) 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4101f40 0x7fb2e4198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 -- 172.21.15.8:0/792581119 learned_addr learned my addr 172.21.15.8:0/792581119 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e37fe700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e4100d50 0x7fb2e4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 -- 172.21.15.8:0/792581119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e4100d50 msgr2=0x7fb2e4198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e4100d50 0x7fb2e4198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 -- 172.21.15.8:0/792581119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4101f40 msgr2=0x7fb2e4198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4101f40 0x7fb2e4198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 -- 172.21.15.8:0/792581119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80095f0 con 0x7fb2e41028e0 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.343+0000 7fb2e3fff700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e41028e0 0x7fb2e41a0010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007ee0 tx=0x7fb2dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.344+0000 7fb2e0ff9700 1 -- 172.21.15.8:0/792581119 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00dd20 con 0x7fb2e41028e0 2023-10-06T23:11:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.344+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e41a0b90 con 0x7fb2e41028e0 2023-10-06T23:11:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.344+0000 7fb2e0ff9700 1 -- 172.21.15.8:0/792581119 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2dc00f040 con 0x7fb2e41028e0 2023-10-06T23:11:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.344+0000 7fb2e0ff9700 1 -- 172.21.15.8:0/792581119 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc004750 con 0x7fb2e41028e0 2023-10-06T23:11:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.344+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e41a10a0 con 0x7fb2e41028e0 2023-10-06T23:11:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.345+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e410c460 con 0x7fb2e41028e0 2023-10-06T23:11:08.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:08 smithi156 ceph-mon[102862]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.347+0000 7fb2e0ff9700 1 -- 172.21.15.8:0/792581119 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb2dc003a00 con 0x7fb2e41028e0 2023-10-06T23:11:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.348+0000 7fb2e0ff9700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb2cc0a1570 0x7fb2cc0a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:08.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.349+0000 7fb2e0ff9700 1 -- 172.21.15.8:0/792581119 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb2dc0cc1c0 con 0x7fb2e41028e0 2023-10-06T23:11:08.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.349+0000 7fb2e37fe700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb2cc0a1570 0x7fb2cc0a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:08.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.349+0000 7fb2e37fe700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb2cc0a1570 0x7fb2cc0a3a30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4101da0 tx=0x7fb2d400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:08.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.353+0000 7fb2e0ff9700 1 -- 172.21.15.8:0/792581119 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2dc04f100 con 0x7fb2e41028e0 2023-10-06T23:11:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:08 smithi008 ceph-mon[98532]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:08.396 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:11:08 smithi008 podman[148987]: 2023-10-06T23:11:08.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:08 smithi190 ceph-mon[102658]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:08.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.625+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2e41a1230 con 0x7fb2e41028e0 2023-10-06T23:11:08.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.625+0000 7fb2e0ff9700 1 -- 172.21.15.8:0/792581119 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8450 (secure 0 0 0) 0x7fb2dc095c20 con 0x7fb2e41028e0 2023-10-06T23:11:08.627 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:08.628 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-06T23:11:08.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb2cc0a1570 msgr2=0x7fb2cc0a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:08.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb2cc0a1570 0x7fb2cc0a3a30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4101da0 tx=0x7fb2d400b410 comp rx=0 tx=0).stop 2023-10-06T23:11:08.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e41028e0 msgr2=0x7fb2e41a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:08.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e41028e0 0x7fb2e41a0010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007ee0 tx=0x7fb2dc00d3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 shutdown_connections 2023-10-06T23:11:08.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb2cc0a1570 0x7fb2cc0a3a30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2e41028e0 0x7fb2e41a0010 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e4100d50 0x7fb2e4198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 --2- 172.21.15.8:0/792581119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2e4101f40 0x7fb2e4198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:08.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 >> 172.21.15.8:0/792581119 conn(0x7fb2e40fc2e0 msgr2=0x7fb2e40fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:08.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 shutdown_connections 2023-10-06T23:11:08.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:08.628+0000 7fb2e8f9d700 1 -- 172.21.15.8:0/792581119 wait complete. 2023-10-06T23:11:08.631 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 11 2023-10-06T23:11:08.895 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:11:08 smithi008 ceph-mds[149070]: -- 172.21.15.8:0/3081414677 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5623d22111e0 con 0x5623d21e6c00 2023-10-06T23:11:08.895 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:11:08 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-a[149014]: starting mds.a at 2023-10-06T23:11:08.895 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:11:08 smithi008 bash[148987]: aa7f265a2331a2c989a0915518a6f87474e00e125e4297017a224962909a2525 2023-10-06T23:11:08.896 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:11:08 smithi008 systemd[1]: Started Ceph mds.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:11:09.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: Deploying daemon mds.b on smithi156 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/792581119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.8:6840/686934069,v1:172.21.15.8:6841/686934069] up:boot 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: fsmap 11 up:standby 2023-10-06T23:11:09.789 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:09 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-06T23:11:09.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: Deploying daemon mds.b on smithi156 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/792581119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.8:6840/686934069,v1:172.21.15.8:6841/686934069] up:boot 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: fsmap 11 up:standby 2023-10-06T23:11:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:09 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-06T23:11:09.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: Deploying daemon mds.b on smithi156 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/792581119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.8:6840/686934069,v1:172.21.15.8:6841/686934069] up:boot 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: fsmap 11 up:standby 2023-10-06T23:11:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:09 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-06T23:11:10.650 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:11:10.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 -- 172.21.15.8:0/4290570736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 msgr2=0x7f3904109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 --2- 172.21.15.8:0/4290570736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 0x7f3904109340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00b0a0 tx=0x7f38fc00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 -- 172.21.15.8:0/4290570736 shutdown_connections 2023-10-06T23:11:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 --2- 172.21.15.8:0/4290570736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 0x7f3904109340 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 --2- 172.21.15.8:0/4290570736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3904100e80 0x7f39041012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 --2- 172.21.15.8:0/4290570736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904102060 0x7f39041024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 -- 172.21.15.8:0/4290570736 >> 172.21.15.8:0/4290570736 conn(0x7f39040fc420 msgr2=0x7f39040fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 -- 172.21.15.8:0/4290570736 shutdown_connections 2023-10-06T23:11:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.863+0000 7f390a1ff700 1 -- 172.21.15.8:0/4290570736 wait complete. 2023-10-06T23:11:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.864+0000 7f390a1ff700 1 Processor -- start 2023-10-06T23:11:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.864+0000 7f390a1ff700 1 -- start start 2023-10-06T23:11:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f390a1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3904100e80 0x7f3904074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f390a1ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904102060 0x7f39040732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f390a1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 0x7f39040737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f390a1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904073f80 con 0x7f3904102a20 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f390a1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040740f0 con 0x7f3904100e80 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f390a1ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39041a0bd0 con 0x7f3904102060 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f39037fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3904100e80 0x7f3904074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f3903fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 0x7f39040737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f39037fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3904100e80 0x7f3904074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42384/0 (socket says 172.21.15.8:42384) 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f39037fe700 1 -- 172.21.15.8:0/2600274073 learned_addr learned my addr 172.21.15.8:0/2600274073 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f3902ffd700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904102060 0x7f39040732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f3903fff700 1 -- 172.21.15.8:0/2600274073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904102060 msgr2=0x7f39040732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f3903fff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904102060 0x7f39040732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f3903fff700 1 -- 172.21.15.8:0/2600274073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3904100e80 msgr2=0x7f3904074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f3903fff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3904100e80 0x7f3904074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.865+0000 7f3903fff700 1 -- 172.21.15.8:0/2600274073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009d00 con 0x7f3904102a20 2023-10-06T23:11:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.866+0000 7f3903fff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 0x7f39040737e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00b070 tx=0x7f38fc00bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.866+0000 7f3900ff9700 1 -- 172.21.15.8:0/2600274073 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00e040 con 0x7f3904102a20 2023-10-06T23:11:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.866+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39041a0e50 con 0x7f3904102a20 2023-10-06T23:11:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.866+0000 7f3900ff9700 1 -- 172.21.15.8:0/2600274073 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38fc009480 con 0x7f3904102a20 2023-10-06T23:11:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.866+0000 7f3900ff9700 1 -- 172.21.15.8:0/2600274073 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0052a0 con 0x7f3904102a20 2023-10-06T23:11:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.866+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39041a1210 con 0x7f3904102a20 2023-10-06T23:11:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.867+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3904108440 con 0x7f3904102a20 2023-10-06T23:11:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.869+0000 7f3900ff9700 1 -- 172.21.15.8:0/2600274073 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f38fc005400 con 0x7f3904102a20 2023-10-06T23:11:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.870+0000 7f3900ff9700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f38ec0a14d0 0x7f38ec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.871+0000 7f3900ff9700 1 -- 172.21.15.8:0/2600274073 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f38fc0cd930 con 0x7f3904102a20 2023-10-06T23:11:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.871+0000 7f39037fe700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f38ec0a14d0 0x7f38ec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:10.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.871+0000 7f39037fe700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f38ec0a14d0 0x7f38ec0a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38f4007cf0 tx=0x7f38f4007480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:10.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:10.874+0000 7f3900ff9700 1 -- 172.21.15.8:0/2600274073 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38fc097420 con 0x7f3904102a20 2023-10-06T23:11:11.099 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:11:10 smithi156 systemd[1]: Starting Ceph mds.b for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:11:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.136+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f390410c5a0 con 0x7f3904102a20 2023-10-06T23:11:11.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.137+0000 7f3900ff9700 1 -- 172.21.15.8:0/2600274073 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9236 (secure 0 0 0) 0x7f38fc09aa40 con 0x7f3904102a20 2023-10-06T23:11:11.139 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:11.139 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-06T23:11:11.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f38ec0a14d0 msgr2=0x7f38ec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:11.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f38ec0a14d0 0x7f38ec0a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38f4007cf0 tx=0x7f38f4007480 comp rx=0 tx=0).stop 2023-10-06T23:11:11.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 msgr2=0x7f39040737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 0x7f39040737e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00b070 tx=0x7f38fc00bcc0 comp rx=0 tx=0).stop 2023-10-06T23:11:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 shutdown_connections 2023-10-06T23:11:11.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f38ec0a14d0 0x7f38ec0a3990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:11.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3904102a20 0x7f39040737e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:11.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3904100e80 0x7f3904074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:11.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 --2- 172.21.15.8:0/2600274073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904102060 0x7f39040732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:11.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 >> 172.21.15.8:0/2600274073 conn(0x7f39040fc420 msgr2=0x7f3904105580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:11.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 shutdown_connections 2023-10-06T23:11:11.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:11.139+0000 7f390a1ff700 1 -- 172.21.15.8:0/2600274073 wait complete. 2023-10-06T23:11:11.146 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 12 2023-10-06T23:11:11.569 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:11:11 smithi156 podman[139349]: 2023-10-06T23:11:11.849 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:11:11 smithi156 bash[139349]: f5a762b1f49e1f7b94c2816a3b3e055501694c2a6777bf39adfb91b56157d70d 2023-10-06T23:11:11.849 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-mds[139389]: -- 172.21.15.156:0/4083184793 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b2806ab1e0 con 0x55b280680800 2023-10-06T23:11:11.849 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-b[139365]: starting mds.b at 2023-10-06T23:11:11.849 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:11:11 smithi156 systemd[1]: Started Ceph mds.b for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:11:12.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-mon[102862]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:12.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2600274073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:12.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:11 smithi008 ceph-mon[98532]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:11 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2600274073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:11 smithi190 ceph-mon[102658]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:11 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2600274073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:13.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:11:13.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:13 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] up:boot 2023-10-06T23:11:13.360 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:13 smithi156 ceph-mon[102862]: fsmap 12 up:standby 2023-10-06T23:11:13.360 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-06T23:11:13.361 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:13 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 -- 172.21.15.8:0/2696901261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8074ef0 msgr2=0x7f74e8073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 --2- 172.21.15.8:0/2696901261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8074ef0 0x7f74e8073340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009990 tx=0x7f74e4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 -- 172.21.15.8:0/2696901261 shutdown_connections 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 --2- 172.21.15.8:0/2696901261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74e8108db0 0x7f74e810b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 --2- 172.21.15.8:0/2696901261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8074ef0 0x7f74e8073340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 --2- 172.21.15.8:0/2696901261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e8073910 0x7f74e8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 -- 172.21.15.8:0/2696901261 >> 172.21.15.8:0/2696901261 conn(0x7f74e80fc420 msgr2=0x7f74e80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 -- 172.21.15.8:0/2696901261 shutdown_connections 2023-10-06T23:11:13.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.378+0000 7f74f07ff700 1 -- 172.21.15.8:0/2696901261 wait complete. 2023-10-06T23:11:13.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.380+0000 7f74f07ff700 1 Processor -- start 2023-10-06T23:11:13.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.380+0000 7f74f07ff700 1 -- start start 2023-10-06T23:11:13.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.380+0000 7f74f07ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8073910 0x7f74e8198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:13.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.380+0000 7f74f07ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e8074ef0 0x7f74e81991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:13.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74f07ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74e8108db0 0x7f74e81a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:13.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74f07ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81a0820 con 0x7f74e8108db0 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74f07ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81a0990 con 0x7f74e8073910 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74f07ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81a0b50 con 0x7f74e8074ef0 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74ee59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8073910 0x7f74e8198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74ee59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8073910 0x7f74e8198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42416/0 (socket says 172.21.15.8:42416) 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74ee59b700 1 -- 172.21.15.8:0/3579844272 learned_addr learned my addr 172.21.15.8:0/3579844272 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74eed9c700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74e8108db0 0x7f74e81a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74edd9a700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e8074ef0 0x7f74e81991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74ee59b700 1 -- 172.21.15.8:0/3579844272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e8074ef0 msgr2=0x7f74e81991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74ee59b700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e8074ef0 0x7f74e81991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74ee59b700 1 -- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74e8108db0 msgr2=0x7f74e81a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74ee59b700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74e8108db0 0x7f74e81a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.381+0000 7f74ee59b700 1 -- 172.21.15.8:0/3579844272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e40095f0 con 0x7f74e8073910 2023-10-06T23:11:13.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.382+0000 7f74ee59b700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8073910 0x7f74e8198cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74e40059d0 tx=0x7f74e40047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:13.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.382+0000 7f74df7fe700 1 -- 172.21.15.8:0/3579844272 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e401d070 con 0x7f74e8073910 2023-10-06T23:11:13.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.382+0000 7f74df7fe700 1 -- 172.21.15.8:0/3579844272 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74e400bdb0 con 0x7f74e8073910 2023-10-06T23:11:13.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.382+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e81a0dd0 con 0x7f74e8073910 2023-10-06T23:11:13.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.382+0000 7f74df7fe700 1 -- 172.21.15.8:0/3579844272 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400fd90 con 0x7f74e8073910 2023-10-06T23:11:13.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.382+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e81a11d0 con 0x7f74e8073910 2023-10-06T23:11:13.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.383+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e8107460 con 0x7f74e8073910 2023-10-06T23:11:13.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.385+0000 7f74df7fe700 1 -- 172.21.15.8:0/3579844272 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f74e400f560 con 0x7f74e8073910 2023-10-06T23:11:13.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.387+0000 7f74df7fe700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74d40a14d0 0x7f74d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:13.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.387+0000 7f74df7fe700 1 -- 172.21.15.8:0/3579844272 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f74e40cdc80 con 0x7f74e8073910 2023-10-06T23:11:13.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.387+0000 7f74edd9a700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74d40a14d0 0x7f74d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:13.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.387+0000 7f74edd9a700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74d40a14d0 0x7f74d40a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74e819a1b0 tx=0x7f74d8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:13.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:13 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] up:boot 2023-10-06T23:11:13.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:13 smithi008 ceph-mon[98532]: fsmap 12 up:standby 2023-10-06T23:11:13.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-06T23:11:13.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:13 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:11:13.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.394+0000 7f74df7fe700 1 -- 172.21.15.8:0/3579844272 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f74e4097770 con 0x7f74e8073910 2023-10-06T23:11:13.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:13 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] up:boot 2023-10-06T23:11:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:13 smithi190 ceph-mon[102658]: fsmap 12 up:standby 2023-10-06T23:11:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-06T23:11:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:13 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:11:13.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.673+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74e802d1b0 con 0x7f74e8073910 2023-10-06T23:11:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.674+0000 7f74df7fe700 1 -- 172.21.15.8:0/3579844272 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10031 (secure 0 0 0) 0x7f74e409ad90 con 0x7f74e8073910 2023-10-06T23:11:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:13.677 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24506,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-06T23:11:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74d40a14d0 msgr2=0x7f74d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:13.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74d40a14d0 0x7f74d40a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74e819a1b0 tx=0x7f74d8009260 comp rx=0 tx=0).stop 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8073910 msgr2=0x7f74e8198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8073910 0x7f74e8198cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74e40059d0 tx=0x7f74e40047b0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 shutdown_connections 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74d40a14d0 0x7f74d40a3990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74e8108db0 0x7f74e81a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74e8073910 0x7f74e8198cb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 --2- 172.21.15.8:0/3579844272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e8074ef0 0x7f74e81991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 >> 172.21.15.8:0/3579844272 conn(0x7f74e80fc420 msgr2=0x7f74e80fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 shutdown_connections 2023-10-06T23:11:13.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.677+0000 7f74f07ff700 1 -- 172.21.15.8:0/3579844272 wait complete. 2023-10-06T23:11:13.681 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 13 2023-10-06T23:11:13.699 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:11:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 -- 172.21.15.8:0/3750976231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c100eb0 msgr2=0x7f328c1012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 --2- 172.21.15.8:0/3750976231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c100eb0 0x7f328c1012d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3288009990 tx=0x7f3288009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 -- 172.21.15.8:0/3750976231 shutdown_connections 2023-10-06T23:11:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 --2- 172.21.15.8:0/3750976231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c100eb0 0x7f328c1012d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 --2- 172.21.15.8:0/3750976231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f328c102a50 0x7f328c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 --2- 172.21.15.8:0/3750976231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f328c102090 0x7f328c102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 -- 172.21.15.8:0/3750976231 >> 172.21.15.8:0/3750976231 conn(0x7f328c0fc470 msgr2=0x7f328c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:13.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 -- 172.21.15.8:0/3750976231 shutdown_connections 2023-10-06T23:11:13.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.913+0000 7f32947ff700 1 -- 172.21.15.8:0/3750976231 wait complete. 2023-10-06T23:11:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.914+0000 7f32947ff700 1 Processor -- start 2023-10-06T23:11:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.914+0000 7f32947ff700 1 -- start start 2023-10-06T23:11:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.914+0000 7f32947ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f328c100eb0 0x7f328c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.914+0000 7f32947ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c102090 0x7f328c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f32947ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f328c102a50 0x7f328c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f32947ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c073f80 con 0x7f328c102090 2023-10-06T23:11:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f32947ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0740f0 con 0x7f328c100eb0 2023-10-06T23:11:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f32947ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c1a0b60 con 0x7f328c102a50 2023-10-06T23:11:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3291d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c102090 0x7f328c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f329259b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f328c100eb0 0x7f328c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3291d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c102090 0x7f328c0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49384/0 (socket says 172.21.15.8:49384) 2023-10-06T23:11:13.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f329259b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f328c100eb0 0x7f328c074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42428/0 (socket says 172.21.15.8:42428) 2023-10-06T23:11:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3291d9a700 1 -- 172.21.15.8:0/2655549398 learned_addr learned my addr 172.21.15.8:0/2655549398 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3292d9c700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f328c102a50 0x7f328c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3291d9a700 1 -- 172.21.15.8:0/2655549398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f328c102a50 msgr2=0x7f328c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3291d9a700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f328c102a50 0x7f328c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3291d9a700 1 -- 172.21.15.8:0/2655549398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f328c100eb0 msgr2=0x7f328c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3291d9a700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f328c100eb0 0x7f328c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3291d9a700 1 -- 172.21.15.8:0/2655549398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32880095f0 con 0x7f328c102090 2023-10-06T23:11:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.915+0000 7f3292d9c700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f328c102a50 0x7f328c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:11:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.916+0000 7f3291d9a700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c102090 0x7f328c0732a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f327c00d980 tx=0x7f327c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.916+0000 7f32837fe700 1 -- 172.21.15.8:0/2655549398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c004020 con 0x7f328c102090 2023-10-06T23:11:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.916+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c1a0e40 con 0x7f328c102090 2023-10-06T23:11:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.916+0000 7f32837fe700 1 -- 172.21.15.8:0/2655549398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f327c00f690 con 0x7f328c102090 2023-10-06T23:11:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.916+0000 7f32837fe700 1 -- 172.21.15.8:0/2655549398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0039e0 con 0x7f328c102090 2023-10-06T23:11:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.916+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c1a1310 con 0x7f328c102090 2023-10-06T23:11:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.917+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c107eb0 con 0x7f328c102090 2023-10-06T23:11:13.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.919+0000 7f32837fe700 1 -- 172.21.15.8:0/2655549398 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f327c00f800 con 0x7f328c102090 2023-10-06T23:11:13.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.922+0000 7f32837fe700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32780a1550 0x7f32780a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:13.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.922+0000 7f32837fe700 1 -- 172.21.15.8:0/2655549398 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f327c0cc460 con 0x7f328c102090 2023-10-06T23:11:13.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.922+0000 7f329259b700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32780a1550 0x7f32780a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:13.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.923+0000 7f329259b700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32780a1550 0x7f32780a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f32880098e0 tx=0x7f328800b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:13.925+0000 7f32837fe700 1 -- 172.21.15.8:0/2655549398 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f327c095ec0 con 0x7f328c102090 2023-10-06T23:11:14.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.149+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f328c10c620 con 0x7f328c102090 2023-10-06T23:11:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.150+0000 7f32837fe700 1 -- 172.21.15.8:0/2655549398 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f327c0994e0 con 0x7f328c102090 2023-10-06T23:11:14.152 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:14.153 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":82,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:10:21.885807+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:11:14.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32780a1550 msgr2=0x7f32780a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32780a1550 0x7f32780a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f32880098e0 tx=0x7f328800b260 comp rx=0 tx=0).stop 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c102090 msgr2=0x7f328c0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c102090 0x7f328c0732a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f327c00d980 tx=0x7f327c00dc90 comp rx=0 tx=0).stop 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 shutdown_connections 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f32780a1550 0x7f32780a3a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f328c102a50 0x7f328c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f328c100eb0 0x7f328c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 --2- 172.21.15.8:0/2655549398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f328c102090 0x7f328c0732a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 >> 172.21.15.8:0/2655549398 conn(0x7f328c0fc470 msgr2=0x7f328c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 shutdown_connections 2023-10-06T23:11:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.153+0000 7f32947ff700 1 -- 172.21.15.8:0/2655549398 wait complete. 2023-10-06T23:11:14.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:11:14.179 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:11:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:14 smithi156 ceph-mon[102862]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:14 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3579844272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:14 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:14 smithi008 ceph-mon[98532]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:14 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3579844272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:14 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:14.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 -- 172.21.15.8:0/101826036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8100e90 msgr2=0x7f5bd81012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 --2- 172.21.15.8:0/101826036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8100e90 0x7f5bd81012b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009990 tx=0x7f5bd4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 -- 172.21.15.8:0/101826036 shutdown_connections 2023-10-06T23:11:14.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 --2- 172.21.15.8:0/101826036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8100e90 0x7f5bd81012b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 --2- 172.21.15.8:0/101826036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd8102a30 0x7f5bd8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 --2- 172.21.15.8:0/101826036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bd8102070 0x7f5bd81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 -- 172.21.15.8:0/101826036 >> 172.21.15.8:0/101826036 conn(0x7f5bd80fc430 msgr2=0x7f5bd80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:14.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 -- 172.21.15.8:0/101826036 shutdown_connections 2023-10-06T23:11:14.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.409+0000 7f5be05ff700 1 -- 172.21.15.8:0/101826036 wait complete. 2023-10-06T23:11:14.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.410+0000 7f5be05ff700 1 Processor -- start 2023-10-06T23:11:14.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.410+0000 7f5be05ff700 1 -- start start 2023-10-06T23:11:14.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5be05ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd8100e90 0x7f5bd8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5be05ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bd8102070 0x7f5bd8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5be05ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8102a30 0x7f5bd81a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5be05ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81a0940 con 0x7f5bd8102a30 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5be05ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81a0a80 con 0x7f5bd8100e90 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5be05ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81a0c10 con 0x7f5bd8102070 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bdeb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8102a30 0x7f5bd81a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bdeb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8102a30 0x7f5bd81a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49408/0 (socket says 172.21.15.8:49408) 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bdeb9c700 1 -- 172.21.15.8:0/4116197585 learned_addr learned my addr 172.21.15.8:0/4116197585 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bddb9a700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bd8102070 0x7f5bd8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bde39b700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd8100e90 0x7f5bd8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:14.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bdeb9c700 1 -- 172.21.15.8:0/4116197585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bd8102070 msgr2=0x7f5bd8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bdeb9c700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bd8102070 0x7f5bd8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bdeb9c700 1 -- 172.21.15.8:0/4116197585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd8100e90 msgr2=0x7f5bd8198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bdeb9c700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd8100e90 0x7f5bd8198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.411+0000 7f5bdeb9c700 1 -- 172.21.15.8:0/4116197585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd40095f0 con 0x7f5bd8102a30 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.412+0000 7f5bdeb9c700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8102a30 0x7f5bd81a0370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000ef30 tx=0x7f5bd000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.412+0000 7f5bcf7fe700 1 -- 172.21.15.8:0/4116197585 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0018070 con 0x7f5bd8102a30 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.412+0000 7f5bcf7fe700 1 -- 172.21.15.8:0/4116197585 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bd000f040 con 0x7f5bd8102a30 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.412+0000 7f5bcf7fe700 1 -- 172.21.15.8:0/4116197585 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000cbc0 con 0x7f5bd8102a30 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.412+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd81a0e90 con 0x7f5bd8102a30 2023-10-06T23:11:14.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.412+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd81a12c0 con 0x7f5bd8102a30 2023-10-06T23:11:14.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.413+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd810c5b0 con 0x7f5bd8102a30 2023-10-06T23:11:14.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.415+0000 7f5bcf7fe700 1 -- 172.21.15.8:0/4116197585 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5bd000cd80 con 0x7f5bd8102a30 2023-10-06T23:11:14.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.416+0000 7f5bcf7fe700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5bc40a1500 0x7f5bc40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:14.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.417+0000 7f5bcf7fe700 1 -- 172.21.15.8:0/4116197585 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5bd00cc840 con 0x7f5bd8102a30 2023-10-06T23:11:14.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.417+0000 7f5bde39b700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5bc40a1500 0x7f5bc40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:14.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.417+0000 7f5bde39b700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5bc40a1500 0x7f5bc40a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4005910 tx=0x7f5bd4005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:14.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.418+0000 7f5bcf7fe700 1 -- 172.21.15.8:0/4116197585 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5bd0096330 con 0x7f5bd8102a30 2023-10-06T23:11:14.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:14 smithi190 ceph-mon[102658]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:14 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3579844272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:14 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:14.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.644+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bd81a14b0 con 0x7f5bd8102a30 2023-10-06T23:11:14.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.645+0000 7f5bcf7fe700 1 -- 172.21.15.8:0/4116197585 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bd0099950 con 0x7f5bd8102a30 2023-10-06T23:11:14.648 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:11:14.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5bc40a1500 msgr2=0x7f5bc40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5bc40a1500 0x7f5bc40a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4005910 tx=0x7f5bd4005960 comp rx=0 tx=0).stop 2023-10-06T23:11:14.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8102a30 msgr2=0x7f5bd81a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8102a30 0x7f5bd81a0370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000ef30 tx=0x7f5bd000c3a0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 shutdown_connections 2023-10-06T23:11:14.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5bc40a1500 0x7f5bc40a39c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd8102a30 0x7f5bd81a0370 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd8100e90 0x7f5bd8198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 --2- 172.21.15.8:0/4116197585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bd8102070 0x7f5bd8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 >> 172.21.15.8:0/4116197585 conn(0x7f5bd80fc430 msgr2=0x7f5bd80730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:14.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 shutdown_connections 2023-10-06T23:11:14.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.647+0000 7f5be05ff700 1 -- 172.21.15.8:0/4116197585 wait complete. 2023-10-06T23:11:14.668 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T23:11:14.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 -- 172.21.15.8:0/1762400589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984100ea0 msgr2=0x7f59841012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 --2- 172.21.15.8:0/1762400589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984100ea0 0x7f59841012c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5978009990 tx=0x7f5978009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 -- 172.21.15.8:0/1762400589 shutdown_connections 2023-10-06T23:11:14.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 --2- 172.21.15.8:0/1762400589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984100ea0 0x7f59841012c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 --2- 172.21.15.8:0/1762400589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5984102a40 0x7f5984109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 --2- 172.21.15.8:0/1762400589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5984102080 0x7f5984102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 -- 172.21.15.8:0/1762400589 >> 172.21.15.8:0/1762400589 conn(0x7f59840fc420 msgr2=0x7f59840fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:14.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 -- 172.21.15.8:0/1762400589 shutdown_connections 2023-10-06T23:11:14.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.876+0000 7f598adff700 1 -- 172.21.15.8:0/1762400589 wait complete. 2023-10-06T23:11:14.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.877+0000 7f598adff700 1 Processor -- start 2023-10-06T23:11:14.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f598adff700 1 -- start start 2023-10-06T23:11:14.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f598adff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5984100ea0 0x7f5984196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:14.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f598adff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5984102080 0x7f5984196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:14.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f598adff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984102a40 0x7f598419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:14.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f598adff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598419e5b0 con 0x7f5984102a40 2023-10-06T23:11:14.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f598adff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598419e6f0 con 0x7f5984100ea0 2023-10-06T23:11:14.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f598adff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598419e880 con 0x7f5984102080 2023-10-06T23:11:14.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f5988b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5984100ea0 0x7f5984196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:14.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f598939c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984102a40 0x7f598419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f5983fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5984102080 0x7f5984196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f5988b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5984100ea0 0x7f5984196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42474/0 (socket says 172.21.15.8:42474) 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.878+0000 7f5988b9b700 1 -- 172.21.15.8:0/2908614989 learned_addr learned my addr 172.21.15.8:0/2908614989 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f598939c700 1 -- 172.21.15.8:0/2908614989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5984102080 msgr2=0x7f5984196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f598939c700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5984102080 0x7f5984196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f598939c700 1 -- 172.21.15.8:0/2908614989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5984100ea0 msgr2=0x7f5984196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f598939c700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5984100ea0 0x7f5984196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f598939c700 1 -- 172.21.15.8:0/2908614989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780095f0 con 0x7f5984102a40 2023-10-06T23:11:14.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f598939c700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984102a40 0x7f598419dfe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f597c007f10 tx=0x7f597c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:14.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f5981ffb700 1 -- 172.21.15.8:0/2908614989 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c004db0 con 0x7f5984102a40 2023-10-06T23:11:14.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f5981ffb700 1 -- 172.21.15.8:0/2908614989 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f597c00f040 con 0x7f5984102a40 2023-10-06T23:11:14.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598419eb60 con 0x7f5984102a40 2023-10-06T23:11:14.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f5981ffb700 1 -- 172.21.15.8:0/2908614989 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c005960 con 0x7f5984102a40 2023-10-06T23:11:14.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.879+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598419f070 con 0x7f5984102a40 2023-10-06T23:11:14.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.880+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598410c5c0 con 0x7f5984102a40 2023-10-06T23:11:14.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.883+0000 7f5981ffb700 1 -- 172.21.15.8:0/2908614989 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f597c00db20 con 0x7f5984102a40 2023-10-06T23:11:14.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.884+0000 7f5981ffb700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f59740a1550 0x7f59740a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:14.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.884+0000 7f5981ffb700 1 -- 172.21.15.8:0/2908614989 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f597c0cc8f0 con 0x7f5984102a40 2023-10-06T23:11:14.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.884+0000 7f5988b9b700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f59740a1550 0x7f59740a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:14.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.885+0000 7f5988b9b700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f59740a1550 0x7f59740a3a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f597800b5c0 tx=0x7f5978005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:14.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:14.886+0000 7f5981ffb700 1 -- 172.21.15.8:0/2908614989 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f597c096350 con 0x7f5984102a40 2023-10-06T23:11:15.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.112+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f598410c7b0 con 0x7f5984102a40 2023-10-06T23:11:15.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.113+0000 7f5981ffb700 1 -- 172.21.15.8:0/2908614989 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f597c023060 con 0x7f5984102a40 2023-10-06T23:11:15.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:15.116 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-10-06T23:11:15.116 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:11:15.116 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-10-06T23:11:15.116 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-10-06T23:11:15.116 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:11:15.116 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-10-06T23:11:15.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f59740a1550 msgr2=0x7f59740a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:15.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f59740a1550 0x7f59740a3a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f597800b5c0 tx=0x7f5978005960 comp rx=0 tx=0).stop 2023-10-06T23:11:15.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984102a40 msgr2=0x7f598419dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:15.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984102a40 0x7f598419dfe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f597c007f10 tx=0x7f597c00d3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 shutdown_connections 2023-10-06T23:11:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f59740a1550 0x7f59740a3a10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5984102a40 0x7f598419dfe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5984100ea0 0x7f5984196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 --2- 172.21.15.8:0/2908614989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5984102080 0x7f5984196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 >> 172.21.15.8:0/2908614989 conn(0x7f59840fc420 msgr2=0x7f59840fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:15.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 shutdown_connections 2023-10-06T23:11:15.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.116+0000 7f598adff700 1 -- 172.21.15.8:0/2908614989 wait complete. 2023-10-06T23:11:15.139 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T23:11:15.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T23:11:15.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:15 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2655549398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:15.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:15 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4116197585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.361+0000 7f3e699ff700 1 -- 172.21.15.8:0/3439122143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64100ea0 msgr2=0x7f3e641012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.361+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3439122143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64100ea0 0x7f3e641012c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009990 tx=0x7f3e54009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.361+0000 7f3e699ff700 1 -- 172.21.15.8:0/3439122143 shutdown_connections 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.361+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3439122143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64100ea0 0x7f3e641012c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.361+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3439122143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e64102a40 0x7f3e64109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.361+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3439122143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e64102080 0x7f3e64102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.361+0000 7f3e699ff700 1 -- 172.21.15.8:0/3439122143 >> 172.21.15.8:0/3439122143 conn(0x7f3e640fc460 msgr2=0x7f3e640fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.361+0000 7f3e699ff700 1 -- 172.21.15.8:0/3439122143 shutdown_connections 2023-10-06T23:11:15.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.362+0000 7f3e699ff700 1 -- 172.21.15.8:0/3439122143 wait complete. 2023-10-06T23:11:15.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e699ff700 1 Processor -- start 2023-10-06T23:11:15.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e699ff700 1 -- start start 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e699ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e64100ea0 0x7f3e64074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e699ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e64102080 0x7f3e640732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e699ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64102a40 0x7f3e640737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e699ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64073f80 con 0x7f3e64102a40 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e699ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640740f0 con 0x7f3e64100ea0 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e699ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641a0c60 con 0x7f3e64102080 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64102a40 0x7f3e640737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.363+0000 7f3e627fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e64102080 0x7f3e640732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e627fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e64102080 0x7f3e640732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:56720/0 (socket says 172.21.15.8:56720) 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e627fc700 1 -- 172.21.15.8:0/3951161568 learned_addr learned my addr 172.21.15.8:0/3951161568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:15.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64102a40 0x7f3e640737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49460/0 (socket says 172.21.15.8:49460) 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e62ffd700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e64100ea0 0x7f3e64074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e637fe700 1 -- 172.21.15.8:0/3951161568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e64102080 msgr2=0x7f3e640732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e637fe700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e64102080 0x7f3e640732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e637fe700 1 -- 172.21.15.8:0/3951161568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e64100ea0 msgr2=0x7f3e64074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e637fe700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e64100ea0 0x7f3e64074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e637fe700 1 -- 172.21.15.8:0/3951161568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540095f0 con 0x7f3e64102a40 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e62ffd700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e64100ea0 0x7f3e64074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e637fe700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64102a40 0x7f3e640737e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00efc0 tx=0x7f3e5c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.364+0000 7f3e689fd700 1 -- 172.21.15.8:0/3951161568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c018070 con 0x7f3e64102a40 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.365+0000 7f3e689fd700 1 -- 172.21.15.8:0/3951161568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e5c00f040 con 0x7f3e64102a40 2023-10-06T23:11:15.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.365+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e641a0ee0 con 0x7f3e64102a40 2023-10-06T23:11:15.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.365+0000 7f3e689fd700 1 -- 172.21.15.8:0/3951161568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00cba0 con 0x7f3e64102a40 2023-10-06T23:11:15.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.365+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e641a1310 con 0x7f3e64102a40 2023-10-06T23:11:15.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.366+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e64108610 con 0x7f3e64102a40 2023-10-06T23:11:15.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.368+0000 7f3e689fd700 1 -- 172.21.15.8:0/3951161568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3e5c003a00 con 0x7f3e64102a40 2023-10-06T23:11:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.369+0000 7f3e689fd700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e4c0a1480 0x7f3e4c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:15.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.369+0000 7f3e689fd700 1 -- 172.21.15.8:0/3951161568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3e5c0cc340 con 0x7f3e64102a40 2023-10-06T23:11:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.369+0000 7f3e62ffd700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e4c0a1480 0x7f3e4c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:15.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.370+0000 7f3e62ffd700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e4c0a1480 0x7f3e4c0a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005910 tx=0x7f3e5400b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:15.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.373+0000 7f3e689fd700 1 -- 172.21.15.8:0/3951161568 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e5c095e30 con 0x7f3e64102a40 2023-10-06T23:11:15.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:15 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2655549398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:15.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:15 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4116197585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:11:15.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:15 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2655549398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:15.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:15 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4116197585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:11:15.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:15.618+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3e6410c610 con 0x7f3e64102a40 2023-10-06T23:11:16.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.181+0000 7f3e689fd700 1 -- 172.21.15.8:0/3951161568 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3e5c099450 con 0x7f3e64102a40 2023-10-06T23:11:16.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e4c0a1480 msgr2=0x7f3e4c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:16.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e4c0a1480 0x7f3e4c0a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005910 tx=0x7f3e5400b260 comp rx=0 tx=0).stop 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64102a40 msgr2=0x7f3e640737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64102a40 0x7f3e640737e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00efc0 tx=0x7f3e5c00c3a0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 shutdown_connections 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3e4c0a1480 0x7f3e4c0a3940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e64102a40 0x7f3e640737e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e64100ea0 0x7f3e64074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 --2- 172.21.15.8:0/3951161568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e64102080 0x7f3e640732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 >> 172.21.15.8:0/3951161568 conn(0x7f3e640fc460 msgr2=0x7f3e64105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 shutdown_connections 2023-10-06T23:11:16.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.184+0000 7f3e699ff700 1 -- 172.21.15.8:0/3951161568 wait complete. 2023-10-06T23:11:16.189 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-10-06T23:11:16.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T23:11:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:16 smithi008 ceph-mon[98532]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:16.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:16 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2908614989' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-06T23:11:16.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.423+0000 7f7471dff700 1 -- 172.21.15.8:0/2401802866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746c074ef0 msgr2=0x7f746c073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:16.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.423+0000 7f7471dff700 1 --2- 172.21.15.8:0/2401802866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746c074ef0 0x7f746c073340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f745c009990 tx=0x7f745c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.423+0000 7f7471dff700 1 -- 172.21.15.8:0/2401802866 shutdown_connections 2023-10-06T23:11:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.423+0000 7f7471dff700 1 --2- 172.21.15.8:0/2401802866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f746c108da0 0x7f746c10b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.423+0000 7f7471dff700 1 --2- 172.21.15.8:0/2401802866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746c074ef0 0x7f746c073340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.423+0000 7f7471dff700 1 --2- 172.21.15.8:0/2401802866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f746c073910 0x7f746c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.424+0000 7f7471dff700 1 -- 172.21.15.8:0/2401802866 >> 172.21.15.8:0/2401802866 conn(0x7f746c0fc430 msgr2=0x7f746c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.424+0000 7f7471dff700 1 -- 172.21.15.8:0/2401802866 shutdown_connections 2023-10-06T23:11:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.424+0000 7f7471dff700 1 -- 172.21.15.8:0/2401802866 wait complete. 2023-10-06T23:11:16.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.425+0000 7f7471dff700 1 Processor -- start 2023-10-06T23:11:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.425+0000 7f7471dff700 1 -- start start 2023-10-06T23:11:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f7471dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f746c073910 0x7f746c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f7471dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746c074ef0 0x7f746c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f7471dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f746c108da0 0x7f746c1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f7471dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c1a08d0 con 0x7f746c073910 2023-10-06T23:11:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f7471dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c1a0a10 con 0x7f746c074ef0 2023-10-06T23:11:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f7471dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c1a0ba0 con 0x7f746c108da0 2023-10-06T23:11:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f74637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f746c073910 0x7f746c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f74637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f746c073910 0x7f746c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49476/0 (socket says 172.21.15.8:49476) 2023-10-06T23:11:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f74637fe700 1 -- 172.21.15.8:0/2316714777 learned_addr learned my addr 172.21.15.8:0/2316714777 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f746b7fe700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746c074ef0 0x7f746c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f746bfff700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f746c108da0 0x7f746c1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f74637fe700 1 -- 172.21.15.8:0/2316714777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f746c108da0 msgr2=0x7f746c1a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f74637fe700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f746c108da0 0x7f746c1a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.426+0000 7f74637fe700 1 -- 172.21.15.8:0/2316714777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746c074ef0 msgr2=0x7f746c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.427+0000 7f74637fe700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746c074ef0 0x7f746c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.427+0000 7f74637fe700 1 -- 172.21.15.8:0/2316714777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c0095f0 con 0x7f746c073910 2023-10-06T23:11:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.427+0000 7f74637fe700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f746c073910 0x7f746c198d50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f745c005910 tx=0x7f745c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.427+0000 7f74697fa700 1 -- 172.21.15.8:0/2316714777 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c01d070 con 0x7f746c073910 2023-10-06T23:11:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.427+0000 7f74697fa700 1 -- 172.21.15.8:0/2316714777 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f745c00be70 con 0x7f746c073910 2023-10-06T23:11:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.427+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746c1a0e20 con 0x7f746c073910 2023-10-06T23:11:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.427+0000 7f74697fa700 1 -- 172.21.15.8:0/2316714777 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c022e60 con 0x7f746c073910 2023-10-06T23:11:16.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.427+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c1a1190 con 0x7f746c073910 2023-10-06T23:11:16.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.429+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c107450 con 0x7f746c073910 2023-10-06T23:11:16.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.431+0000 7f74697fa700 1 -- 172.21.15.8:0/2316714777 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f745c022600 con 0x7f746c073910 2023-10-06T23:11:16.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.432+0000 7f74697fa700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74580a1480 0x7f74580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:16.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.432+0000 7f74697fa700 1 -- 172.21.15.8:0/2316714777 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f745c0cde30 con 0x7f746c073910 2023-10-06T23:11:16.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.432+0000 7f746b7fe700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74580a1480 0x7f74580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:16.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.433+0000 7f746b7fe700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74580a1480 0x7f74580a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f746c074c10 tx=0x7f7454009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:16.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.437+0000 7f74697fa700 1 -- 172.21.15.8:0/2316714777 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f745c05d100 con 0x7f746c073910 2023-10-06T23:11:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:16 smithi190 ceph-mon[102658]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:16 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2908614989' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-06T23:11:16.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:16 smithi156 ceph-mon[102862]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:16.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:16 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2908614989' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-06T23:11:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:16.714+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f746c10e7d0 con 0x7f746c073910 2023-10-06T23:11:17.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.236+0000 7f74697fa700 1 -- 172.21.15.8:0/2316714777 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7f745c0977b0 con 0x7f746c073910 2023-10-06T23:11:17.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.240+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74580a1480 msgr2=0x7f74580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:17.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.240+0000 7f7471dff700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74580a1480 0x7f74580a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f746c074c10 tx=0x7f7454009260 comp rx=0 tx=0).stop 2023-10-06T23:11:17.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.240+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f746c073910 msgr2=0x7f746c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:17.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.240+0000 7f7471dff700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f746c073910 0x7f746c198d50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f745c005910 tx=0x7f745c005740 comp rx=0 tx=0).stop 2023-10-06T23:11:17.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.241+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 shutdown_connections 2023-10-06T23:11:17.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.241+0000 7f7471dff700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f74580a1480 0x7f74580a3940 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f746c074c10 tx=0x7f7454009260 comp rx=0 tx=0).stop 2023-10-06T23:11:17.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.241+0000 7f7471dff700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f746c073910 0x7f746c198d50 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f745c005910 tx=0x7f745c005740 comp rx=0 tx=0).stop 2023-10-06T23:11:17.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.241+0000 7f7471dff700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f746c108da0 0x7f746c1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:17.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.241+0000 7f7471dff700 1 --2- 172.21.15.8:0/2316714777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746c074ef0 0x7f746c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:17.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.241+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 >> 172.21.15.8:0/2316714777 conn(0x7f746c0fc430 msgr2=0x7f746c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:17.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.245+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 shutdown_connections 2023-10-06T23:11:17.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.249+0000 7f7471dff700 1 -- 172.21.15.8:0/2316714777 wait complete. 2023-10-06T23:11:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-10-06T23:11:17.283 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T23:11:17.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 -- 172.21.15.8:0/1224694300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 msgr2=0x7f4a28109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/1224694300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 0x7f4a28109360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000b0a0 tx=0x7f4a2000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 -- 172.21.15.8:0/1224694300 shutdown_connections 2023-10-06T23:11:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/1224694300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 0x7f4a28109360 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/1224694300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a28100ea0 0x7f4a281012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/1224694300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a28102080 0x7f4a28102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 -- 172.21.15.8:0/1224694300 >> 172.21.15.8:0/1224694300 conn(0x7f4a280fc460 msgr2=0x7f4a280fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 -- 172.21.15.8:0/1224694300 shutdown_connections 2023-10-06T23:11:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.493+0000 7f4a2fdff700 1 -- 172.21.15.8:0/1224694300 wait complete. 2023-10-06T23:11:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.495+0000 7f4a2fdff700 1 Processor -- start 2023-10-06T23:11:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.495+0000 7f4a2fdff700 1 -- start start 2023-10-06T23:11:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.495+0000 7f4a2fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a28100ea0 0x7f4a28196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.495+0000 7f4a2fdff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a28102080 0x7f4a28197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.495+0000 7f4a2fdff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 0x7f4a2819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.495+0000 7f4a2fdff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2819e760 con 0x7f4a28102a40 2023-10-06T23:11:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.495+0000 7f4a2fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2819e8a0 con 0x7f4a28100ea0 2023-10-06T23:11:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.495+0000 7f4a2fdff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2819ea30 con 0x7f4a28102080 2023-10-06T23:11:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a28100ea0 0x7f4a28196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2e39c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 0x7f4a2819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a28100ea0 0x7f4a28196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42524/0 (socket says 172.21.15.8:42524) 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2db9b700 1 -- 172.21.15.8:0/3626728318 learned_addr learned my addr 172.21.15.8:0/3626728318 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2d39a700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a28102080 0x7f4a28197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2e39c700 1 -- 172.21.15.8:0/3626728318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a28102080 msgr2=0x7f4a28197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2e39c700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a28102080 0x7f4a28197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2e39c700 1 -- 172.21.15.8:0/3626728318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a28100ea0 msgr2=0x7f4a28196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2e39c700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a28100ea0 0x7f4a28196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2e39c700 1 -- 172.21.15.8:0/3626728318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009520 con 0x7f4a28102a40 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2d39a700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a28102080 0x7f4a28197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2db9b700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a28100ea0 0x7f4a28196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a2e39c700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 0x7f4a2819e190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000b070 tx=0x7f4a2000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.496+0000 7f4a1effd700 1 -- 172.21.15.8:0/3626728318 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000e040 con 0x7f4a28102a40 2023-10-06T23:11:17.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.497+0000 7f4a1effd700 1 -- 172.21.15.8:0/3626728318 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a20003c00 con 0x7f4a28102a40 2023-10-06T23:11:17.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.497+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a20009d00 con 0x7f4a28102a40 2023-10-06T23:11:17.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.497+0000 7f4a1effd700 1 -- 172.21.15.8:0/3626728318 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a200052a0 con 0x7f4a28102a40 2023-10-06T23:11:17.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.497+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2819ef40 con 0x7f4a28102a40 2023-10-06T23:11:17.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.498+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2810c630 con 0x7f4a28102a40 2023-10-06T23:11:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.501+0000 7f4a1effd700 1 -- 172.21.15.8:0/3626728318 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4a20005400 con 0x7f4a28102a40 2023-10-06T23:11:17.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.504+0000 7f4a1effd700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4a140a1480 0x7f4a140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:17.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.504+0000 7f4a1effd700 1 -- 172.21.15.8:0/3626728318 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f4a200cdfe0 con 0x7f4a28102a40 2023-10-06T23:11:17.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.504+0000 7f4a2db9b700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4a140a1480 0x7f4a140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:17.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.504+0000 7f4a2db9b700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4a140a1480 0x7f4a140a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4a24005950 tx=0x7f4a24009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:17.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.506+0000 7f4a1effd700 1 -- 172.21.15.8:0/3626728318 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4a20097840 con 0x7f4a28102a40 2023-10-06T23:11:17.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3951161568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-06T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3951161568' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-06T23:11:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:17 smithi156 ceph-mon[102862]: osdmap e83: 12 total, 12 up, 12 in 2023-10-06T23:11:17.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3951161568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-06T23:11:17.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3951161568' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-06T23:11:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:17 smithi008 ceph-mon[98532]: osdmap e83: 12 total, 12 up, 12 in 2023-10-06T23:11:17.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3951161568' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-06T23:11:17.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:17.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3951161568' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-06T23:11:17.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:17 smithi190 ceph-mon[102658]: osdmap e83: 12 total, 12 up, 12 in 2023-10-06T23:11:17.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:17.781+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4a28107e70 con 0x7f4a28102a40 2023-10-06T23:11:18.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.285+0000 7f4a1effd700 1 -- 172.21.15.8:0/3626728318 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4a2009ae60 con 0x7f4a28102a40 2023-10-06T23:11:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4a140a1480 msgr2=0x7f4a140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4a140a1480 0x7f4a140a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4a24005950 tx=0x7f4a24009260 comp rx=0 tx=0).stop 2023-10-06T23:11:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 msgr2=0x7f4a2819e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:18.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 0x7f4a2819e190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000b070 tx=0x7f4a2000bab0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 shutdown_connections 2023-10-06T23:11:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4a140a1480 0x7f4a140a3940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a28102a40 0x7f4a2819e190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a28100ea0 0x7f4a28196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 --2- 172.21.15.8:0/3626728318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a28102080 0x7f4a28197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 >> 172.21.15.8:0/3626728318 conn(0x7f4a280fc460 msgr2=0x7f4a280fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:18.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.288+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 shutdown_connections 2023-10-06T23:11:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.289+0000 7f4a2fdff700 1 -- 172.21.15.8:0/3626728318 wait complete. 2023-10-06T23:11:18.292 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2023-10-06T23:11:18.314 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:11:18.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/1548009127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4101a10 msgr2=0x7fa0e4103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:18.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/1548009127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4101a10 0x7fa0e4103e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009990 tx=0x7fa0e0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/1548009127 shutdown_connections 2023-10-06T23:11:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/1548009127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4106c70 0x7fa0e4109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/1548009127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4101a10 0x7fa0e4103e00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/1548009127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0e4104340 0x7fa0e4106730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/1548009127 >> 172.21.15.8:0/1548009127 conn(0x7fa0e40fb340 msgr2=0x7fa0e40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/1548009127 shutdown_connections 2023-10-06T23:11:18.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.524+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/1548009127 wait complete. 2023-10-06T23:11:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.525+0000 7fa0ec7ff700 1 Processor -- start 2023-10-06T23:11:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.525+0000 7fa0ec7ff700 1 -- start start 2023-10-06T23:11:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ec7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4101a10 0x7fa0e4101380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ec7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4104340 0x7fa0e40ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ec7ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0e4106c70 0x7fa0e40fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ec7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41006a0 con 0x7fa0e4101a10 2023-10-06T23:11:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ec7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4100810 con 0x7fa0e4104340 2023-10-06T23:11:18.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ec7ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41a0b00 con 0x7fa0e4106c70 2023-10-06T23:11:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ea59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4101a10 0x7fa0e4101380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0e9d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4104340 0x7fa0e40ff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0e9d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4104340 0x7fa0e40ff9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42550/0 (socket says 172.21.15.8:42550) 2023-10-06T23:11:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0e9d9a700 1 -- 172.21.15.8:0/3412808084 learned_addr learned my addr 172.21.15.8:0/3412808084 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ead9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0e4106c70 0x7fa0e40fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:18.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.526+0000 7fa0ea59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4101a10 0x7fa0e4101380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49520/0 (socket says 172.21.15.8:49520) 2023-10-06T23:11:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0e9d9a700 1 -- 172.21.15.8:0/3412808084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0e4106c70 msgr2=0x7fa0e40fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0e9d9a700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0e4106c70 0x7fa0e40fff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0e9d9a700 1 -- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4101a10 msgr2=0x7fa0e4101380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0e9d9a700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4101a10 0x7fa0e4101380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0e9d9a700 1 -- 172.21.15.8:0/3412808084 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00095f0 con 0x7fa0e4104340 2023-10-06T23:11:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0ea59b700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4101a10 0x7fa0e4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:11:18.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0e9d9a700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4104340 0x7fa0e40ff9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400d950 tx=0x7fa0d400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0db7fe700 1 -- 172.21.15.8:0/3412808084 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400f890 con 0x7fa0e4104340 2023-10-06T23:11:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0db7fe700 1 -- 172.21.15.8:0/3412808084 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0d400fe80 con 0x7fa0e4104340 2023-10-06T23:11:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e41a0de0 con 0x7fa0e4104340 2023-10-06T23:11:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.527+0000 7fa0db7fe700 1 -- 172.21.15.8:0/3412808084 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400e3b0 con 0x7fa0e4104340 2023-10-06T23:11:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.528+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e41a1260 con 0x7fa0e4104340 2023-10-06T23:11:18.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.529+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e410c5b0 con 0x7fa0e4104340 2023-10-06T23:11:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.533+0000 7fa0db7fe700 1 -- 172.21.15.8:0/3412808084 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa0d4010460 con 0x7fa0e4104340 2023-10-06T23:11:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.534+0000 7fa0db7fe700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0d00a14d0 0x7fa0d00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.534+0000 7fa0db7fe700 1 -- 172.21.15.8:0/3412808084 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa0d40cccb0 con 0x7fa0e4104340 2023-10-06T23:11:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.534+0000 7fa0ea59b700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0d00a14d0 0x7fa0d00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:18.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.535+0000 7fa0ea59b700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0d00a14d0 0x7fa0d00a3990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0006010 tx=0x7fa0e000b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:18.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.538+0000 7fa0db7fe700 1 -- 172.21.15.8:0/3412808084 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa0d4096460 con 0x7fa0e4104340 2023-10-06T23:11:18.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2316714777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-06T23:11:18.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: pgmap v297: 33 pgs: 7 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:18.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:18.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2316714777' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-06T23:11:18.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: osdmap e84: 12 total, 12 up, 12 in 2023-10-06T23:11:18.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:11:18.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:18.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T23:11:18.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:11:18.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3626728318' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-06T23:11:18.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:18 smithi156 ceph-mon[102862]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-06T23:11:18.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2316714777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-06T23:11:18.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: pgmap v297: 33 pgs: 7 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:18.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:18.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2316714777' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-06T23:11:18.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: osdmap e84: 12 total, 12 up, 12 in 2023-10-06T23:11:18.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:11:18.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:18.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T23:11:18.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:11:18.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3626728318' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-06T23:11:18.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:18 smithi008 ceph-mon[98532]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-06T23:11:18.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2316714777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-06T23:11:18.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: pgmap v297: 33 pgs: 7 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-06T23:11:18.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:18.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2316714777' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-06T23:11:18.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: osdmap e84: 12 total, 12 up, 12 in 2023-10-06T23:11:18.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:11:18.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:18.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T23:11:18.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:11:18.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3626728318' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-06T23:11:18.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:18 smithi190 ceph-mon[102658]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-06T23:11:18.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.765+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0e41a1480 con 0x7fa0e4104340 2023-10-06T23:11:18.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.767+0000 7fa0db7fe700 1 -- 172.21.15.8:0/3412808084 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22073 (secure 0 0 0) 0x7fa0d4020090 con 0x7fa0e4104340 2023-10-06T23:11:18.770 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:18.770 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":85,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:17.784021+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:11:18.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0d00a14d0 msgr2=0x7fa0d00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0d00a14d0 0x7fa0d00a3990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0006010 tx=0x7fa0e000b260 comp rx=0 tx=0).stop 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4104340 msgr2=0x7fa0e40ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4104340 0x7fa0e40ff9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400d950 tx=0x7fa0d400dc60 comp rx=0 tx=0).stop 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 shutdown_connections 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0d00a14d0 0x7fa0d00a3990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0e4101a10 0x7fa0e4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0e4106c70 0x7fa0e40fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 --2- 172.21.15.8:0/3412808084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e4104340 0x7fa0e40ff9c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 >> 172.21.15.8:0/3412808084 conn(0x7fa0e40fb340 msgr2=0x7fa0e4102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:18.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 shutdown_connections 2023-10-06T23:11:18.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:18.770+0000 7fa0ec7ff700 1 -- 172.21.15.8:0/3412808084 wait complete. 2023-10-06T23:11:18.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:11:19.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.009+0000 7f855fdff700 1 -- 172.21.15.8:0/1091314717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558103130 msgr2=0x7f8558103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:19.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.009+0000 7f855fdff700 1 --2- 172.21.15.8:0/1091314717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558103130 0x7f8558103550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85540099c0 tx=0x7f8554009cd0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.009+0000 7f855fdff700 1 -- 172.21.15.8:0/1091314717 shutdown_connections 2023-10-06T23:11:19.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.009+0000 7f855fdff700 1 --2- 172.21.15.8:0/1091314717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558103130 0x7f8558103550 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.009+0000 7f855fdff700 1 --2- 172.21.15.8:0/1091314717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8558104cc0 0x7f855810b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.009+0000 7f855fdff700 1 --2- 172.21.15.8:0/1091314717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8558104320 0x7f8558104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.009+0000 7f855fdff700 1 -- 172.21.15.8:0/1091314717 >> 172.21.15.8:0/1091314717 conn(0x7f85580fe6a0 msgr2=0x7f8558100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:19.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.010+0000 7f855fdff700 1 -- 172.21.15.8:0/1091314717 shutdown_connections 2023-10-06T23:11:19.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.010+0000 7f855fdff700 1 -- 172.21.15.8:0/1091314717 wait complete. 2023-10-06T23:11:19.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855fdff700 1 Processor -- start 2023-10-06T23:11:19.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855fdff700 1 -- start start 2023-10-06T23:11:19.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855fdff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8558103130 0x7f8558198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:19.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8558104320 0x7f8558199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:19.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855fdff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558104cc0 0x7f85581a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:19.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855fdff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85581a0850 con 0x7f8558104cc0 2023-10-06T23:11:19.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85581a09c0 con 0x7f8558104320 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855fdff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85581a0b80 con 0x7f8558103130 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.011+0000 7f855e39c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558104cc0 0x7f85581a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855d39a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8558104320 0x7f8558199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855db9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8558103130 0x7f8558198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855d39a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8558104320 0x7f8558199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42574/0 (socket says 172.21.15.8:42574) 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855db9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8558103130 0x7f8558198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:56788/0 (socket says 172.21.15.8:56788) 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855d39a700 1 -- 172.21.15.8:0/3989592530 learned_addr learned my addr 172.21.15.8:0/3989592530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855db9b700 1 -- 172.21.15.8:0/3989592530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8558104320 msgr2=0x7f8558199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855db9b700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8558104320 0x7f8558199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855db9b700 1 -- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558104cc0 msgr2=0x7f85581a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855db9b700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558104cc0 0x7f85581a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855db9b700 1 -- 172.21.15.8:0/3989592530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540095f0 con 0x7f8558103130 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855e39c700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558104cc0 0x7f85581a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.012+0000 7f855db9b700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8558103130 0x7f8558198d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f85540098e0 tx=0x7f855400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.013+0000 7f854effd700 1 -- 172.21.15.8:0/3989592530 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855401d070 con 0x7f8558103130 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.013+0000 7f854effd700 1 -- 172.21.15.8:0/3989592530 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f855400fdc0 con 0x7f8558103130 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.013+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85581a0e00 con 0x7f8558103130 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.013+0000 7f854effd700 1 -- 172.21.15.8:0/3989592530 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554004a70 con 0x7f8558103130 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.013+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85581a11d0 con 0x7f8558103130 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.014+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855810e840 con 0x7f8558103130 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.016+0000 7f854effd700 1 -- 172.21.15.8:0/3989592530 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8554004bf0 con 0x7f8558103130 2023-10-06T23:11:19.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.017+0000 7f854effd700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f85440a14d0 0x7f85440a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:19.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.017+0000 7f854effd700 1 -- 172.21.15.8:0/3989592530 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f85540cd930 con 0x7f8558103130 2023-10-06T23:11:19.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.017+0000 7f855d39a700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f85440a14d0 0x7f85440a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:19.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.018+0000 7f855d39a700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f85440a14d0 0x7f85440a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8548005950 tx=0x7f854800b500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:19.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.021+0000 7f854effd700 1 -- 172.21.15.8:0/3989592530 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f85540970d0 con 0x7f8558103130 2023-10-06T23:11:19.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.248+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f855810a030 con 0x7f8558103130 2023-10-06T23:11:19.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.251+0000 7f854effd700 1 -- 172.21.15.8:0/3989592530 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22060 (secure 0 0 0) 0x7f855409a6f0 con 0x7f8558103130 2023-10-06T23:11:19.253 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:19.253 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:19.241355+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:11:19.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.252+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f85440a14d0 msgr2=0x7f85440a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:19.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.252+0000 7f855fdff700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f85440a14d0 0x7f85440a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8548005950 tx=0x7f854800b500 comp rx=0 tx=0).stop 2023-10-06T23:11:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.252+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8558103130 msgr2=0x7f8558198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.252+0000 7f855fdff700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8558103130 0x7f8558198d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f85540098e0 tx=0x7f855400fa00 comp rx=0 tx=0).stop 2023-10-06T23:11:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.253+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 shutdown_connections 2023-10-06T23:11:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.253+0000 7f855fdff700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f85440a14d0 0x7f85440a3990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.253+0000 7f855fdff700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8558104cc0 0x7f85581a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.253+0000 7f855fdff700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8558103130 0x7f8558198d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.253+0000 7f855fdff700 1 --2- 172.21.15.8:0/3989592530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8558104320 0x7f8558199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.253+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 >> 172.21.15.8:0/3989592530 conn(0x7f85580fe6a0 msgr2=0x7f8558100920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:19.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.253+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 shutdown_connections 2023-10-06T23:11:19.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.253+0000 7f855fdff700 1 -- 172.21.15.8:0/3989592530 wait complete. 2023-10-06T23:11:19.274 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 -- 172.21.15.8:0/504682768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00100ea0 msgr2=0x7fdf001012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 --2- 172.21.15.8:0/504682768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00100ea0 0x7fdf001012c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009990 tx=0x7fdefc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 -- 172.21.15.8:0/504682768 shutdown_connections 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 --2- 172.21.15.8:0/504682768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf00102a40 0x7fdf00109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 --2- 172.21.15.8:0/504682768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00100ea0 0x7fdf001012c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 --2- 172.21.15.8:0/504682768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00102080 0x7fdf00102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 -- 172.21.15.8:0/504682768 >> 172.21.15.8:0/504682768 conn(0x7fdf000fc460 msgr2=0x7fdf000fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 -- 172.21.15.8:0/504682768 shutdown_connections 2023-10-06T23:11:19.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.491+0000 7fdf087ff700 1 -- 172.21.15.8:0/504682768 wait complete. 2023-10-06T23:11:19.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.493+0000 7fdf087ff700 1 Processor -- start 2023-10-06T23:11:19.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.493+0000 7fdf087ff700 1 -- start start 2023-10-06T23:11:19.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.493+0000 7fdf087ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf00100ea0 0x7fdf00074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:19.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.493+0000 7fdf087ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00102080 0x7fdf000732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:19.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.493+0000 7fdf087ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00102a40 0x7fdf000737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:19.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.493+0000 7fdf087ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00073f80 con 0x7fdf00102080 2023-10-06T23:11:19.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.493+0000 7fdf087ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000740f0 con 0x7fdf00102a40 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.493+0000 7fdf087ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf001a0bd0 con 0x7fdf00100ea0 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00102080 0x7fdf000732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf0659b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf00100ea0 0x7fdf00074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00102080 0x7fdf000732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49574/0 (socket says 172.21.15.8:49574) 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 -- 172.21.15.8:0/2693170497 learned_addr learned my addr 172.21.15.8:0/2693170497 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf06d9c700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00102a40 0x7fdf000737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 -- 172.21.15.8:0/2693170497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf00100ea0 msgr2=0x7fdf00074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf00100ea0 0x7fdf00074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 -- 172.21.15.8:0/2693170497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00102a40 msgr2=0x7fdf000737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:19.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00102a40 0x7fdf000737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:19.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 -- 172.21.15.8:0/2693170497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0095f0 con 0x7fdf00102080 2023-10-06T23:11:19.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf06d9c700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00102a40 0x7fdf000737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:11:19.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.494+0000 7fdf05d9a700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00102080 0x7fdf000732a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e970 tx=0x7fdef000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:19.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.495+0000 7fdef77fe700 1 -- 172.21.15.8:0/2693170497 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0009790 con 0x7fdf00102080 2023-10-06T23:11:19.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.495+0000 7fdef77fe700 1 -- 172.21.15.8:0/2693170497 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdef000c7e0 con 0x7fdf00102080 2023-10-06T23:11:19.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.495+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf001a0eb0 con 0x7fdf00102080 2023-10-06T23:11:19.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.495+0000 7fdef77fe700 1 -- 172.21.15.8:0/2693170497 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0003bd0 con 0x7fdf00102080 2023-10-06T23:11:19.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.495+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf001a1330 con 0x7fdf00102080 2023-10-06T23:11:19.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.496+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0010c610 con 0x7fdf00102080 2023-10-06T23:11:19.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.498+0000 7fdef77fe700 1 -- 172.21.15.8:0/2693170497 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdef000c950 con 0x7fdf00102080 2023-10-06T23:11:19.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.500+0000 7fdef77fe700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdeec0a1480 0x7fdeec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:19.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.500+0000 7fdef77fe700 1 -- 172.21.15.8:0/2693170497 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdef0014070 con 0x7fdf00102080 2023-10-06T23:11:19.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.500+0000 7fdf0659b700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdeec0a1480 0x7fdeec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:19.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.501+0000 7fdf0659b700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdeec0a1480 0x7fdeec0a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdefc005910 tx=0x7fdefc00b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:19.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.505+0000 7fdef77fe700 1 -- 172.21.15.8:0/2693170497 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdef0096540 con 0x7fdf00102080 2023-10-06T23:11:19.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:19 smithi156 ceph-mon[102862]: osdmap e85: 12 total, 12 up, 12 in 2023-10-06T23:11:19.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:19 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3626728318' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-06T23:11:19.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:19 smithi156 ceph-mon[102862]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-06T23:11:19.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:19 smithi156 ceph-mon[102862]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-06T23:11:19.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:19 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3412808084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:19.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:19 smithi156 ceph-mon[102862]: pgmap v300: 97 pgs: 12 creating+peering, 30 active+clean, 55 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-10-06T23:11:19.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:19 smithi008 ceph-mon[98532]: osdmap e85: 12 total, 12 up, 12 in 2023-10-06T23:11:19.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:19 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3626728318' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-06T23:11:19.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:19 smithi008 ceph-mon[98532]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-06T23:11:19.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:19 smithi008 ceph-mon[98532]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-06T23:11:19.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:19 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3412808084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:19.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:19 smithi008 ceph-mon[98532]: pgmap v300: 97 pgs: 12 creating+peering, 30 active+clean, 55 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-10-06T23:11:19.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:19 smithi190 ceph-mon[102658]: osdmap e85: 12 total, 12 up, 12 in 2023-10-06T23:11:19.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:19 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3626728318' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-06T23:11:19.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:19 smithi190 ceph-mon[102658]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-06T23:11:19.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:19 smithi190 ceph-mon[102658]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-06T23:11:19.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:19 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3412808084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:19.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:19 smithi190 ceph-mon[102658]: pgmap v300: 97 pgs: 12 creating+peering, 30 active+clean, 55 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-10-06T23:11:19.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:19.784+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf00107f70 con 0x7fdf00102080 2023-10-06T23:11:20.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.297+0000 7fdef77fe700 1 -- 172.21.15.8:0/2693170497 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdef0099b60 con 0x7fdf00102080 2023-10-06T23:11:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdeec0a1480 msgr2=0x7fdeec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdeec0a1480 0x7fdeec0a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdefc005910 tx=0x7fdefc00b260 comp rx=0 tx=0).stop 2023-10-06T23:11:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00102080 msgr2=0x7fdf000732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00102080 0x7fdf000732a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e970 tx=0x7fdef000ec80 comp rx=0 tx=0).stop 2023-10-06T23:11:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 shutdown_connections 2023-10-06T23:11:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdeec0a1480 0x7fdeec0a3940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf00102a40 0x7fdf000737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf00100ea0 0x7fdf00074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 --2- 172.21.15.8:0/2693170497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00102080 0x7fdf000732a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 >> 172.21.15.8:0/2693170497 conn(0x7fdf000fc460 msgr2=0x7fdf000fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:20.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 shutdown_connections 2023-10-06T23:11:20.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.300+0000 7fdf087ff700 1 -- 172.21.15.8:0/2693170497 wait complete. 2023-10-06T23:11:20.320 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True} 2023-10-06T23:11:20.320 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-06T23:11:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.531+0000 7f6c359ff700 1 -- 172.21.15.8:0/3407871945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30100f40 msgr2=0x7f6c30101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.531+0000 7f6c359ff700 1 --2- 172.21.15.8:0/3407871945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30100f40 0x7f6c30101360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009990 tx=0x7f6c20009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.532+0000 7f6c359ff700 1 -- 172.21.15.8:0/3407871945 shutdown_connections 2023-10-06T23:11:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.532+0000 7f6c359ff700 1 --2- 172.21.15.8:0/3407871945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30100f40 0x7f6c30101360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.532+0000 7f6c359ff700 1 --2- 172.21.15.8:0/3407871945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c30102a50 0x7f6c30109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.532+0000 7f6c359ff700 1 --2- 172.21.15.8:0/3407871945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c30102090 0x7f6c30102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.532+0000 7f6c359ff700 1 -- 172.21.15.8:0/3407871945 >> 172.21.15.8:0/3407871945 conn(0x7f6c300fc4d0 msgr2=0x7f6c300fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.532+0000 7f6c359ff700 1 -- 172.21.15.8:0/3407871945 shutdown_connections 2023-10-06T23:11:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.532+0000 7f6c359ff700 1 -- 172.21.15.8:0/3407871945 wait complete. 2023-10-06T23:11:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.533+0000 7f6c359ff700 1 Processor -- start 2023-10-06T23:11:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.533+0000 7f6c359ff700 1 -- start start 2023-10-06T23:11:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c359ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c30100f40 0x7f6c30196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c359ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30102090 0x7f6c30197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c359ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c30102a50 0x7f6c3019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c359ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3019e6d0 con 0x7f6c30102090 2023-10-06T23:11:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c359ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3019e810 con 0x7f6c30102a50 2023-10-06T23:11:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c359ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3019e9a0 con 0x7f6c30100f40 2023-10-06T23:11:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c2e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30102090 0x7f6c30197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c2effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c30100f40 0x7f6c30196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c2effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c30100f40 0x7f6c30196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:33202/0 (socket says 172.21.15.8:33202) 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c2effd700 1 -- 172.21.15.8:0/1432499850 learned_addr learned my addr 172.21.15.8:0/1432499850 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.534+0000 7f6c2f7fe700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c30102a50 0x7f6c3019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c2effd700 1 -- 172.21.15.8:0/1432499850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c30102a50 msgr2=0x7f6c3019e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c2effd700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c30102a50 0x7f6c3019e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c2effd700 1 -- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30102090 msgr2=0x7f6c30197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c2effd700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30102090 0x7f6c30197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c2effd700 1 -- 172.21.15.8:0/1432499850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200095f0 con 0x7f6c30100f40 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c2e7fc700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30102090 0x7f6c30197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:11:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c2effd700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c30100f40 0x7f6c30196b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c20005910 tx=0x7f6c20005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c349fd700 1 -- 172.21.15.8:0/1432499850 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2001d070 con 0x7f6c30100f40 2023-10-06T23:11:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c349fd700 1 -- 172.21.15.8:0/1432499850 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c2000be10 con 0x7f6c30100f40 2023-10-06T23:11:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3019ec20 con 0x7f6c30100f40 2023-10-06T23:11:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c349fd700 1 -- 172.21.15.8:0/1432499850 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20022e00 con 0x7f6c30100f40 2023-10-06T23:11:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.535+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3019f0a0 con 0x7f6c30100f40 2023-10-06T23:11:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.536+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3010c5d0 con 0x7f6c30100f40 2023-10-06T23:11:20.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.538+0000 7f6c349fd700 1 -- 172.21.15.8:0/1432499850 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6c2000b980 con 0x7f6c30100f40 2023-10-06T23:11:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.540+0000 7f6c349fd700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c180a1500 0x7f6c180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.540+0000 7f6c349fd700 1 -- 172.21.15.8:0/1432499850 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6c200ce810 con 0x7f6c30100f40 2023-10-06T23:11:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.540+0000 7f6c2e7fc700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c180a1500 0x7f6c180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.540+0000 7f6c2e7fc700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c180a1500 0x7f6c180a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c24011490 tx=0x7f6c24009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.543+0000 7f6c349fd700 1 -- 172.21.15.8:0/1432499850 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c20097fb0 con 0x7f6c30100f40 2023-10-06T23:11:20.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:20 smithi156 ceph-mon[102862]: osdmap e86: 12 total, 12 up, 12 in 2023-10-06T23:11:20.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:20 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3989592530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:20.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:20 smithi156 ceph-mon[102862]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-06T23:11:20.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:20 smithi156 ceph-mon[102862]: Cluster is now healthy 2023-10-06T23:11:20.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:20 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] up:active 2023-10-06T23:11:20.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:20 smithi156 ceph-mon[102862]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:20.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:20 smithi156 ceph-mon[102862]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:20.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:20 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2693170497' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-06T23:11:20.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:20 smithi008 ceph-mon[98532]: osdmap e86: 12 total, 12 up, 12 in 2023-10-06T23:11:20.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:20 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3989592530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:20.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:20 smithi008 ceph-mon[98532]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-06T23:11:20.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:20 smithi008 ceph-mon[98532]: Cluster is now healthy 2023-10-06T23:11:20.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:20 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] up:active 2023-10-06T23:11:20.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:20 smithi008 ceph-mon[98532]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:20.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:20 smithi008 ceph-mon[98532]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:20.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:20 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2693170497' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-06T23:11:20.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:20 smithi190 ceph-mon[102658]: osdmap e86: 12 total, 12 up, 12 in 2023-10-06T23:11:20.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:20 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3989592530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:20.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:20 smithi190 ceph-mon[102658]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-06T23:11:20.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:20 smithi190 ceph-mon[102658]: Cluster is now healthy 2023-10-06T23:11:20.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:20 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] up:active 2023-10-06T23:11:20.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:20 smithi190 ceph-mon[102658]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:20.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:20 smithi190 ceph-mon[102658]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:20.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:20 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2693170497' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-06T23:11:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:20.810+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f6c30107f00 con 0x7f6c30100f40 2023-10-06T23:11:21.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.305+0000 7f6c349fd700 1 -- 172.21.15.8:0/1432499850 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f6c200270b0 con 0x7f6c30100f40 2023-10-06T23:11:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c180a1500 msgr2=0x7f6c180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c180a1500 0x7f6c180a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c24011490 tx=0x7f6c24009260 comp rx=0 tx=0).stop 2023-10-06T23:11:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c30100f40 msgr2=0x7f6c30196b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c30100f40 0x7f6c30196b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c20005910 tx=0x7f6c20005740 comp rx=0 tx=0).stop 2023-10-06T23:11:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 shutdown_connections 2023-10-06T23:11:21.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c180a1500 0x7f6c180a39c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c30102a50 0x7f6c3019e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c30100f40 0x7f6c30196b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 --2- 172.21.15.8:0/1432499850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c30102090 0x7f6c30197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 >> 172.21.15.8:0/1432499850 conn(0x7f6c300fc4d0 msgr2=0x7f6c300fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:21.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 shutdown_connections 2023-10-06T23:11:21.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.308+0000 7f6c359ff700 1 -- 172.21.15.8:0/1432499850 wait complete. 2023-10-06T23:11:21.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-06T23:11:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.544+0000 7eff24bff700 1 -- 172.21.15.8:0/1178376621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102070 msgr2=0x7eff201024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.544+0000 7eff24bff700 1 --2- 172.21.15.8:0/1178376621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102070 0x7eff201024f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff14009990 tx=0x7eff14009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.544+0000 7eff24bff700 1 -- 172.21.15.8:0/1178376621 shutdown_connections 2023-10-06T23:11:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.544+0000 7eff24bff700 1 --2- 172.21.15.8:0/1178376621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff20102a30 0x7eff20109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.544+0000 7eff24bff700 1 --2- 172.21.15.8:0/1178376621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff20100e90 0x7eff201012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.544+0000 7eff24bff700 1 --2- 172.21.15.8:0/1178376621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102070 0x7eff201024f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.544+0000 7eff24bff700 1 -- 172.21.15.8:0/1178376621 >> 172.21.15.8:0/1178376621 conn(0x7eff200fc430 msgr2=0x7eff200fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.544+0000 7eff24bff700 1 -- 172.21.15.8:0/1178376621 shutdown_connections 2023-10-06T23:11:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.545+0000 7eff24bff700 1 -- 172.21.15.8:0/1178376621 wait complete. 2023-10-06T23:11:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.546+0000 7eff24bff700 1 Processor -- start 2023-10-06T23:11:21.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.546+0000 7eff24bff700 1 -- start start 2023-10-06T23:11:21.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff24bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff20100e90 0x7eff20074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:21.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff24bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff20102070 0x7eff200732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:21.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff24bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102a30 0x7eff200737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:21.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff24bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff20073f80 con 0x7eff20102a30 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff24bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200740f0 con 0x7eff20102070 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff24bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff201a0ad0 con 0x7eff20100e90 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff1ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102a30 0x7eff200737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff1ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102a30 0x7eff200737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57096/0 (socket says 172.21.15.8:57096) 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff1ed9d700 1 -- 172.21.15.8:0/1860985533 learned_addr learned my addr 172.21.15.8:0/1860985533 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff1dd9b700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff20102070 0x7eff200732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.547+0000 7eff1e59c700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff20100e90 0x7eff20074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff1ed9d700 1 -- 172.21.15.8:0/1860985533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff20100e90 msgr2=0x7eff20074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff1ed9d700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff20100e90 0x7eff20074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff1ed9d700 1 -- 172.21.15.8:0/1860985533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff20102070 msgr2=0x7eff200732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:21.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff1ed9d700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff20102070 0x7eff200732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:21.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff1ed9d700 1 -- 172.21.15.8:0/1860985533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140095f0 con 0x7eff20102a30 2023-10-06T23:11:21.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff1ed9d700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102a30 0x7eff200737e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7eff18007d70 tx=0x7eff1800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:21.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff0f7fe700 1 -- 172.21.15.8:0/1860985533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800ac90 con 0x7eff20102a30 2023-10-06T23:11:21.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff201a0db0 con 0x7eff20102a30 2023-10-06T23:11:21.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff0f7fe700 1 -- 172.21.15.8:0/1860985533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff1800adf0 con 0x7eff20102a30 2023-10-06T23:11:21.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff0f7fe700 1 -- 172.21.15.8:0/1860985533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180115e0 con 0x7eff20102a30 2023-10-06T23:11:21.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.548+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff201a1210 con 0x7eff20102a30 2023-10-06T23:11:21.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.549+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2010c600 con 0x7eff20102a30 2023-10-06T23:11:21.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.551+0000 7eff0f7fe700 1 -- 172.21.15.8:0/1860985533 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7eff18012420 con 0x7eff20102a30 2023-10-06T23:11:21.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.553+0000 7eff0f7fe700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff080a1480 0x7eff080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:21.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.553+0000 7eff0f7fe700 1 -- 172.21.15.8:0/1860985533 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7eff180cce20 con 0x7eff20102a30 2023-10-06T23:11:21.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.553+0000 7eff1e59c700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff080a1480 0x7eff080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:21.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.554+0000 7eff1e59c700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff080a1480 0x7eff080a3940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff20101be0 tx=0x7eff1000a3b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:21.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.557+0000 7eff0f7fe700 1 -- 172.21.15.8:0/1860985533 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7eff18096530 con 0x7eff20102a30 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2693170497' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1432499850' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: pgmap v302: 97 pgs: 12 creating+peering, 73 active+clean, 12 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:21.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:11:21.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:21 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2693170497' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-06T23:11:21.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1432499850' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: pgmap v302: 97 pgs: 12 creating+peering, 73 active+clean, 12 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:21.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:11:21.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:21 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2693170497' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-06T23:11:21.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:21.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1432499850' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-06T23:11:21.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-06T23:11:21.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: pgmap v302: 97 pgs: 12 creating+peering, 73 active+clean, 12 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2023-10-06T23:11:21.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:11:21.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:11:21.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:21 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:11:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:21.816+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7eff20107e60 con 0x7eff20102a30 2023-10-06T23:11:22.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.233+0000 7eff0f7fe700 1 -- 172.21.15.8:0/1860985533 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7eff18099b50 con 0x7eff20102a30 2023-10-06T23:11:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff080a1480 msgr2=0x7eff080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff080a1480 0x7eff080a3940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff20101be0 tx=0x7eff1000a3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102a30 msgr2=0x7eff200737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102a30 0x7eff200737e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7eff18007d70 tx=0x7eff1800a340 comp rx=0 tx=0).stop 2023-10-06T23:11:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 shutdown_connections 2023-10-06T23:11:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff080a1480 0x7eff080a3940 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff20102a30 0x7eff200737e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff20100e90 0x7eff20074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 --2- 172.21.15.8:0/1860985533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff20102070 0x7eff200732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.236+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 >> 172.21.15.8:0/1860985533 conn(0x7eff200fc430 msgr2=0x7eff200fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:22.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.237+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 shutdown_connections 2023-10-06T23:11:22.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.237+0000 7eff24bff700 1 -- 172.21.15.8:0/1860985533 wait complete. 2023-10-06T23:11:22.262 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-06T23:11:22.306 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-b[139365]: 2023-10-06T23:11:22.007+0000 7f873bcef700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T23:11:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 -- 172.21.15.8:0/3619927340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102a30 msgr2=0x7fb024109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/3619927340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102a30 0x7fb024109350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00b0a0 tx=0x7fb01c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 -- 172.21.15.8:0/3619927340 shutdown_connections 2023-10-06T23:11:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/3619927340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102a30 0x7fb024109350 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/3619927340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb024100e90 0x7fb0241012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/3619927340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb024102070 0x7fb0241024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 -- 172.21.15.8:0/3619927340 >> 172.21.15.8:0/3619927340 conn(0x7fb0240fc430 msgr2=0x7fb0240fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 -- 172.21.15.8:0/3619927340 shutdown_connections 2023-10-06T23:11:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.469+0000 7fb02a3ff700 1 -- 172.21.15.8:0/3619927340 wait complete. 2023-10-06T23:11:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.470+0000 7fb02a3ff700 1 Processor -- start 2023-10-06T23:11:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.470+0000 7fb02a3ff700 1 -- start start 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb02a3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb024100e90 0x7fb024196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb02a3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102070 0x7fb024197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb02a3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb024102a30 0x7fb02419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb02a3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02419e760 con 0x7fb024102070 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb02a3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02419e8d0 con 0x7fb024100e90 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb02a3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02419ea90 con 0x7fb024102a30 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102070 0x7fb024197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102070 0x7fb024197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57112/0 (socket says 172.21.15.8:57112) 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb0237fe700 1 -- 172.21.15.8:0/1566008995 learned_addr learned my addr 172.21.15.8:0/1566008995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb02899c700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb024102a30 0x7fb02419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb023fff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb024100e90 0x7fb024196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb0237fe700 1 -- 172.21.15.8:0/1566008995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb024102a30 msgr2=0x7fb02419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb0237fe700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb024102a30 0x7fb02419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb0237fe700 1 -- 172.21.15.8:0/1566008995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb024100e90 msgr2=0x7fb024196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb0237fe700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb024100e90 0x7fb024196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb0237fe700 1 -- 172.21.15.8:0/1566008995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c009d00 con 0x7fb024102070 2023-10-06T23:11:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.471+0000 7fb02899c700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb024102a30 0x7fb02419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.472+0000 7fb0237fe700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102070 0x7fb024197160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb01800e970 tx=0x7fb01800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.472+0000 7fb0217fa700 1 -- 172.21.15.8:0/1566008995 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018009790 con 0x7fb024102070 2023-10-06T23:11:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.472+0000 7fb0217fa700 1 -- 172.21.15.8:0/1566008995 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0180044b0 con 0x7fb024102070 2023-10-06T23:11:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.472+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02419ed70 con 0x7fb024102070 2023-10-06T23:11:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.472+0000 7fb0217fa700 1 -- 172.21.15.8:0/1566008995 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018003dd0 con 0x7fb024102070 2023-10-06T23:11:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.472+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02419f210 con 0x7fb024102070 2023-10-06T23:11:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.473+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb024107ec0 con 0x7fb024102070 2023-10-06T23:11:22.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.475+0000 7fb0217fa700 1 -- 172.21.15.8:0/1566008995 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb018003f30 con 0x7fb024102070 2023-10-06T23:11:22.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.476+0000 7fb0217fa700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb00c0a1500 0x7fb00c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:22.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.476+0000 7fb0217fa700 1 -- 172.21.15.8:0/1566008995 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb018014070 con 0x7fb024102070 2023-10-06T23:11:22.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.477+0000 7fb023fff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb00c0a1500 0x7fb00c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:22.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.477+0000 7fb023fff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb00c0a1500 0x7fb00c0a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb014005950 tx=0x7fb0140058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:22.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.481+0000 7fb0217fa700 1 -- 172.21.15.8:0/1566008995 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb0180965c0 con 0x7fb024102070 2023-10-06T23:11:22.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-06T23:11:22.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-10-06T23:11:22.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1860985533' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1860985533' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] up:active 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: Cluster is now healthy 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-10-06T23:11:22.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-10-06T23:11:22.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:22 smithi156 ceph-mon[102862]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-06T23:11:22.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-06T23:11:22.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1860985533' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1860985533' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] up:active 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: Cluster is now healthy 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-10-06T23:11:22.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-10-06T23:11:22.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:22 smithi008 ceph-mon[98532]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1860985533' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1860985533' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] up:active 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-06T23:11:22.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-06T23:11:22.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: Cluster is now healthy 2023-10-06T23:11:22.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-10-06T23:11:22.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-10-06T23:11:22.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:22 smithi190 ceph-mon[102658]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-10-06T23:11:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:22.741+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fb02402d090 con 0x7fb024102070 2023-10-06T23:11:23.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.240+0000 7fb0217fa700 1 -- 172.21.15.8:0/1566008995 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb018099be0 con 0x7fb024102070 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb00c0a1500 msgr2=0x7fb00c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb00c0a1500 0x7fb00c0a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb014005950 tx=0x7fb0140058e0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102070 msgr2=0x7fb024197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102070 0x7fb024197160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb01800e970 tx=0x7fb01800ed30 comp rx=0 tx=0).stop 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 shutdown_connections 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb00c0a1500 0x7fb00c0a39c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb024102a30 0x7fb02419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb024100e90 0x7fb024196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 --2- 172.21.15.8:0/1566008995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb024102070 0x7fb024197160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.243+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 >> 172.21.15.8:0/1566008995 conn(0x7fb0240fc430 msgr2=0x7fb0240fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.244+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 shutdown_connections 2023-10-06T23:11:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.244+0000 7fb02a3ff700 1 -- 172.21.15.8:0/1566008995 wait complete. 2023-10-06T23:11:23.265 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-06T23:11:23.265 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:11:23.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 -- 172.21.15.8:0/3594606309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 msgr2=0x7ff8b8109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/3594606309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 0x7ff8b8109360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000b0a0 tx=0x7ff8b000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 -- 172.21.15.8:0/3594606309 shutdown_connections 2023-10-06T23:11:23.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/3594606309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 0x7ff8b8109360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/3594606309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b8100ea0 0x7ff8b81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/3594606309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b8102080 0x7ff8b8102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 -- 172.21.15.8:0/3594606309 >> 172.21.15.8:0/3594606309 conn(0x7ff8b80fc420 msgr2=0x7ff8b80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:23.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 -- 172.21.15.8:0/3594606309 shutdown_connections 2023-10-06T23:11:23.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.469+0000 7ff8bcfff700 1 -- 172.21.15.8:0/3594606309 wait complete. 2023-10-06T23:11:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8bcfff700 1 Processor -- start 2023-10-06T23:11:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8bcfff700 1 -- start start 2023-10-06T23:11:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8bcfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b8100ea0 0x7ff8b8198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8bcfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b8102080 0x7ff8b8199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8bcfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 0x7ff8b81a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8bcfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b81a09c0 con 0x7ff8b8102a40 2023-10-06T23:11:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8bcfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b81a0b00 con 0x7ff8b8100ea0 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8bcfff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b81a0c90 con 0x7ff8b8102080 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8b6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 0x7ff8b81a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8b6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 0x7ff8b81a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57142/0 (socket says 172.21.15.8:57142) 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.470+0000 7ff8b6d9d700 1 -- 172.21.15.8:0/4267064857 learned_addr learned my addr 172.21.15.8:0/4267064857 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8ae59c700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b8100ea0 0x7ff8b8198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8b6d9d700 1 -- 172.21.15.8:0/4267064857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b8102080 msgr2=0x7ff8b8199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8b6d9d700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b8102080 0x7ff8b8199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8b6d9d700 1 -- 172.21.15.8:0/4267064857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b8100ea0 msgr2=0x7ff8b8198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8b6d9d700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b8100ea0 0x7ff8b8198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8b6d9d700 1 -- 172.21.15.8:0/4267064857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0009d00 con 0x7ff8b8102a40 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8ae59c700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b8100ea0 0x7ff8b8198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:11:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8b6d9d700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 0x7ff8b81a03f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000b070 tx=0x7ff8b0004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8affff700 1 -- 172.21.15.8:0/4267064857 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000e040 con 0x7ff8b8102a40 2023-10-06T23:11:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8affff700 1 -- 172.21.15.8:0/4267064857 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8b0003e90 con 0x7ff8b8102a40 2023-10-06T23:11:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b81a0f10 con 0x7ff8b8102a40 2023-10-06T23:11:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8affff700 1 -- 172.21.15.8:0/4267064857 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0004020 con 0x7ff8b8102a40 2023-10-06T23:11:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.471+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b81a1390 con 0x7ff8b8102a40 2023-10-06T23:11:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.473+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b8193400 con 0x7ff8b8102a40 2023-10-06T23:11:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.474+0000 7ff8affff700 1 -- 172.21.15.8:0/4267064857 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff8b001b660 con 0x7ff8b8102a40 2023-10-06T23:11:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.476+0000 7ff8affff700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff8a40a1550 0x7ff8a40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.476+0000 7ff8affff700 1 -- 172.21.15.8:0/4267064857 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff8b00ce2a0 con 0x7ff8b8102a40 2023-10-06T23:11:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.476+0000 7ff8ae59c700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff8a40a1550 0x7ff8a40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.477+0000 7ff8ae59c700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff8a40a1550 0x7ff8a40a3a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8005fd0 tx=0x7ff8a8005f00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.480+0000 7ff8affff700 1 -- 172.21.15.8:0/4267064857 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff8b0097a40 con 0x7ff8b8102a40 2023-10-06T23:11:23.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:23 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1566008995' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-06T23:11:23.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:23 smithi156 ceph-mon[102862]: pgmap v303: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.8 KiB/s wr, 9 op/s 2023-10-06T23:11:23.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:23 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1566008995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-06T23:11:23.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:23 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] up:active 2023-10-06T23:11:23.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:23 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-06T23:11:23.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:23 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:11:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:23 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1566008995' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-06T23:11:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:23 smithi008 ceph-mon[98532]: pgmap v303: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.8 KiB/s wr, 9 op/s 2023-10-06T23:11:23.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:23 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1566008995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-06T23:11:23.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:23 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] up:active 2023-10-06T23:11:23.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:23 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-06T23:11:23.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:23 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:11:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:23 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1566008995' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-06T23:11:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:23 smithi190 ceph-mon[102658]: pgmap v303: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.8 KiB/s wr, 9 op/s 2023-10-06T23:11:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:23 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1566008995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-06T23:11:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:23 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] up:active 2023-10-06T23:11:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:23 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-06T23:11:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:23 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:11:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.736+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8b810c610 con 0x7ff8b8102a40 2023-10-06T23:11:23.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.737+0000 7ff8affff700 1 -- 172.21.15.8:0/4267064857 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11306 (secure 0 0 0) 0x7ff8b009b060 con 0x7ff8b8102a40 2023-10-06T23:11:23.738 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:23.738 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:11:23.244586+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.739+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff8a40a1550 msgr2=0x7ff8a40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.739+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff8a40a1550 0x7ff8a40a3a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8005fd0 tx=0x7ff8a8005f00 comp rx=0 tx=0).stop 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.739+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 msgr2=0x7ff8b81a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.739+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 0x7ff8b81a03f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000b070 tx=0x7ff8b0004d30 comp rx=0 tx=0).stop 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.739+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 shutdown_connections 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.739+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff8a40a1550 0x7ff8a40a3a10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.739+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8b8102a40 0x7ff8b81a03f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.740+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b8100ea0 0x7ff8b8198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.740+0000 7ff8bcfff700 1 --2- 172.21.15.8:0/4267064857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b8102080 0x7ff8b8199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.740+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 >> 172.21.15.8:0/4267064857 conn(0x7ff8b80fc420 msgr2=0x7ff8b81079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:23.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.740+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 shutdown_connections 2023-10-06T23:11:23.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.740+0000 7ff8bcfff700 1 -- 172.21.15.8:0/4267064857 wait complete. 2023-10-06T23:11:23.742 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:11:23.760 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:11:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 -- 172.21.15.8:0/2311203622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 msgr2=0x7f42a4102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 --2- 172.21.15.8:0/2311203622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 0x7f42a4102500 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4298009990 tx=0x7f4298009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 -- 172.21.15.8:0/2311203622 shutdown_connections 2023-10-06T23:11:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 --2- 172.21.15.8:0/2311203622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a4102a40 0x7f42a4109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 --2- 172.21.15.8:0/2311203622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a4100ea0 0x7f42a41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 --2- 172.21.15.8:0/2311203622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 0x7f42a4102500 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 -- 172.21.15.8:0/2311203622 >> 172.21.15.8:0/2311203622 conn(0x7f42a40fc420 msgr2=0x7f42a40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:23.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 -- 172.21.15.8:0/2311203622 shutdown_connections 2023-10-06T23:11:23.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.962+0000 7f42a8dff700 1 -- 172.21.15.8:0/2311203622 wait complete. 2023-10-06T23:11:23.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.963+0000 7f42a8dff700 1 Processor -- start 2023-10-06T23:11:23.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.963+0000 7f42a8dff700 1 -- start start 2023-10-06T23:11:23.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a8dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a4100ea0 0x7f42a4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:23.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a8dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 0x7f42a40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a8dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a4102a40 0x7f42a40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a8dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a4073f80 con 0x7f42a4102080 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a8dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40740f0 con 0x7f42a4100ea0 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a8dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a41a0c10 con 0x7f42a4102a40 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 0x7f42a40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 0x7f42a40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57164/0 (socket says 172.21.15.8:57164) 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a1d9b700 1 -- 172.21.15.8:0/1940433083 learned_addr learned my addr 172.21.15.8:0/1940433083 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a2d9d700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a4102a40 0x7f42a40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.964+0000 7f42a259c700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a4100ea0 0x7f42a4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:23.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a1d9b700 1 -- 172.21.15.8:0/1940433083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a4102a40 msgr2=0x7f42a40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a1d9b700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a4102a40 0x7f42a40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a1d9b700 1 -- 172.21.15.8:0/1940433083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a4100ea0 msgr2=0x7f42a4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a1d9b700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a4100ea0 0x7f42a4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a1d9b700 1 -- 172.21.15.8:0/1940433083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980095f0 con 0x7f42a4102080 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a259c700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a4100ea0 0x7f42a4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a1d9b700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 0x7f42a40732a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f42980095c0 tx=0x7f4298005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42937fe700 1 -- 172.21.15.8:0/1940433083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429801d070 con 0x7f42a4102080 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42937fe700 1 -- 172.21.15.8:0/1940433083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4298004000 con 0x7f42a4102080 2023-10-06T23:11:23.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a41a0e90 con 0x7f42a4102080 2023-10-06T23:11:23.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42937fe700 1 -- 172.21.15.8:0/1940433083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298022bd0 con 0x7f42a4102080 2023-10-06T23:11:23.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.965+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a41a1200 con 0x7f42a4102080 2023-10-06T23:11:23.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.966+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a410c610 con 0x7f42a4102080 2023-10-06T23:11:23.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.968+0000 7f42937fe700 1 -- 172.21.15.8:0/1940433083 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4298003b70 con 0x7f42a4102080 2023-10-06T23:11:23.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.970+0000 7f42937fe700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f428c0a14d0 0x7f428c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:23.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.970+0000 7f42937fe700 1 -- 172.21.15.8:0/1940433083 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f42980ce240 con 0x7f42a4102080 2023-10-06T23:11:23.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.970+0000 7f42a259c700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f428c0a14d0 0x7f428c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:23.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.971+0000 7f42a259c700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f428c0a14d0 0x7f428c0a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f42a4101bf0 tx=0x7f429400b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:23.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:23.973+0000 7f42937fe700 1 -- 172.21.15.8:0/1940433083 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f42980979e0 con 0x7f42a4102080 2023-10-06T23:11:24.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.187+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42a4107f00 con 0x7f42a4102080 2023-10-06T23:11:24.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.189+0000 7f42937fe700 1 -- 172.21.15.8:0/1940433083 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22060 (secure 0 0 0) 0x7f429809b000 con 0x7f42a4102080 2023-10-06T23:11:24.191 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:24.191 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:19.241355+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:11:24.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f428c0a14d0 msgr2=0x7f428c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f428c0a14d0 0x7f428c0a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f42a4101bf0 tx=0x7f429400b5f0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 msgr2=0x7f42a40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 0x7f42a40732a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f42980095c0 tx=0x7f4298005740 comp rx=0 tx=0).stop 2023-10-06T23:11:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 shutdown_connections 2023-10-06T23:11:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f428c0a14d0 0x7f428c0a3990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a4102a40 0x7f42a40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42a4100ea0 0x7f42a4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 --2- 172.21.15.8:0/1940433083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a4102080 0x7f42a40732a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.191+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 >> 172.21.15.8:0/1940433083 conn(0x7f42a40fc420 msgr2=0x7f42a40fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.192+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 shutdown_connections 2023-10-06T23:11:24.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.192+0000 7f42a8dff700 1 -- 172.21.15.8:0/1940433083 wait complete. 2023-10-06T23:11:24.212 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T23:11:24.212 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T23:11:24.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 -- 172.21.15.8:0/2515801109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102a40 msgr2=0x7f4468109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 --2- 172.21.15.8:0/2515801109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102a40 0x7f4468109360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f446000b0a0 tx=0x7f446000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 -- 172.21.15.8:0/2515801109 shutdown_connections 2023-10-06T23:11:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 --2- 172.21.15.8:0/2515801109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102a40 0x7f4468109360 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 --2- 172.21.15.8:0/2515801109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4468100ea0 0x7f44681012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 --2- 172.21.15.8:0/2515801109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4468102080 0x7f4468102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 -- 172.21.15.8:0/2515801109 >> 172.21.15.8:0/2515801109 conn(0x7f44680fc420 msgr2=0x7f44680fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 -- 172.21.15.8:0/2515801109 shutdown_connections 2023-10-06T23:11:24.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.417+0000 7f44701ff700 1 -- 172.21.15.8:0/2515801109 wait complete. 2023-10-06T23:11:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.418+0000 7f44701ff700 1 Processor -- start 2023-10-06T23:11:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.418+0000 7f44701ff700 1 -- start start 2023-10-06T23:11:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f44701ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4468100ea0 0x7f4468074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f44701ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102080 0x7f44680732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f44701ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4468102a40 0x7f44680737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f44701ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4468073f80 con 0x7f4468102080 2023-10-06T23:11:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f44701ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680740f0 con 0x7f4468102a40 2023-10-06T23:11:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f44701ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44681a0c00 con 0x7f4468100ea0 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446d79a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102080 0x7f44680732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446d79a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102080 0x7f44680732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57184/0 (socket says 172.21.15.8:57184) 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446d79a700 1 -- 172.21.15.8:0/2599501207 learned_addr learned my addr 172.21.15.8:0/2599501207 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446d79a700 1 -- 172.21.15.8:0/2599501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4468100ea0 msgr2=0x7f4468074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446df9b700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4468100ea0 0x7f4468074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446d79a700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4468100ea0 0x7f4468074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446d79a700 1 -- 172.21.15.8:0/2599501207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4468102a40 msgr2=0x7f44680737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446e79c700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4468102a40 0x7f44680737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446d79a700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4468102a40 0x7f44680737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446d79a700 1 -- 172.21.15.8:0/2599501207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4460009d00 con 0x7f4468102080 2023-10-06T23:11:24.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446df9b700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4468100ea0 0x7f4468074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:11:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.419+0000 7f446e79c700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4468102a40 0x7f44680737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:11:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.420+0000 7f446d79a700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102080 0x7f44680732a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f445800e970 tx=0x7f445800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.420+0000 7f445effd700 1 -- 172.21.15.8:0/2599501207 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458009790 con 0x7f4468102080 2023-10-06T23:11:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.420+0000 7f445effd700 1 -- 172.21.15.8:0/2599501207 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44580044b0 con 0x7f4468102080 2023-10-06T23:11:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.420+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44681a0ee0 con 0x7f4468102080 2023-10-06T23:11:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.420+0000 7f445effd700 1 -- 172.21.15.8:0/2599501207 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458003dd0 con 0x7f4468102080 2023-10-06T23:11:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.420+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44681a13b0 con 0x7f4468102080 2023-10-06T23:11:24.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.421+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446810c5c0 con 0x7f4468102080 2023-10-06T23:11:24.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.425+0000 7f445effd700 1 -- 172.21.15.8:0/2599501207 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4458004000 con 0x7f4468102080 2023-10-06T23:11:24.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.426+0000 7f445effd700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44540a1550 0x7f44540a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:24.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.426+0000 7f445effd700 1 -- 172.21.15.8:0/2599501207 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4458014070 con 0x7f4468102080 2023-10-06T23:11:24.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.426+0000 7f446df9b700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44540a1550 0x7f44540a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:24.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.427+0000 7f446df9b700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44540a1550 0x7f44540a3a10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4464005fd0 tx=0x7f4464005f00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.428+0000 7f445effd700 1 -- 172.21.15.8:0/2599501207 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f44580966d0 con 0x7f4468102080 2023-10-06T23:11:24.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:24 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4267064857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:24.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:24 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1940433083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:24.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.635+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44680612f0 con 0x7f44540a1550 2023-10-06T23:11:24.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:24 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4267064857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:24.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:24 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1940433083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:24.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.648+0000 7f445effd700 1 -- 172.21.15.8:0/2599501207 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+333594 (secure 0 0 0) 0x7f44680612f0 con 0x7f44540a1550 2023-10-06T23:11:24.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.652+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44540a1550 msgr2=0x7f44540a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.652+0000 7f44701ff700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44540a1550 0x7f44540a3a10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4464005fd0 tx=0x7f4464005f00 comp rx=0 tx=0).stop 2023-10-06T23:11:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.652+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102080 msgr2=0x7f44680732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.652+0000 7f44701ff700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102080 0x7f44680732a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f445800e970 tx=0x7f445800ed30 comp rx=0 tx=0).stop 2023-10-06T23:11:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.653+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 shutdown_connections 2023-10-06T23:11:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.653+0000 7f44701ff700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44540a1550 0x7f44540a3a10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.653+0000 7f44701ff700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4468102a40 0x7f44680737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.653+0000 7f44701ff700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4468100ea0 0x7f4468074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.653+0000 7f44701ff700 1 --2- 172.21.15.8:0/2599501207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4468102080 0x7f44680732a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.653+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 >> 172.21.15.8:0/2599501207 conn(0x7f44680fc420 msgr2=0x7f44680fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:24.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.653+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 shutdown_connections 2023-10-06T23:11:24.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.653+0000 7f44701ff700 1 -- 172.21.15.8:0/2599501207 wait complete. 2023-10-06T23:11:24.658 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T23:11:24.673 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2023-10-06T23:11:22.943182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593982,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":131,"num_read_kb":113,"num_write":234,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335236,"kb_used_data":10964,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606588,"statfs":{"total":1151940427776,"available":1151597146112,"internally_reserved":0,"allocated":11227136,"data_stored":7021608,"data_compressed":107433,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3614,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001464"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250074+0000","last_change":"2023-10-06T23:11:18.264036+0000","last_active":"2023-10-06T23:11:19.250074+0000","last_peered":"2023-10-06T23:11:19.250074+0000","last_clean":"2023-10-06T23:11:19.250074+0000","last_became_active":"2023-10-06T23:11:18.261784+0000","last_became_peered":"2023-10-06T23:11:18.261784+0000","last_unstale":"2023-10-06T23:11:19.250074+0000","last_undegraded":"2023-10-06T23:11:19.250074+0000","last_fullsized":"2023-10-06T23:11:19.250074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:57.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.407006+0000","last_change":"2023-10-06T23:11:18.265181+0000","last_active":"2023-10-06T23:11:19.407006+0000","last_peered":"2023-10-06T23:11:19.407006+0000","last_clean":"2023-10-06T23:11:19.407006+0000","last_became_active":"2023-10-06T23:11:18.264881+0000","last_became_peered":"2023-10-06T23:11:18.264881+0000","last_unstale":"2023-10-06T23:11:19.407006+0000","last_undegraded":"2023-10-06T23:11:19.407006+0000","last_fullsized":"2023-10-06T23:11:19.407006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:17.852643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406952+0000","last_change":"2023-10-06T23:11:18.264321+0000","last_active":"2023-10-06T23:11:19.406952+0000","last_peered":"2023-10-06T23:11:19.406952+0000","last_clean":"2023-10-06T23:11:19.406952+0000","last_became_active":"2023-10-06T23:11:18.263997+0000","last_became_peered":"2023-10-06T23:11:18.263997+0000","last_unstale":"2023-10-06T23:11:19.406952+0000","last_undegraded":"2023-10-06T23:11:19.406952+0000","last_fullsized":"2023-10-06T23:11:19.406952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:41.888419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778118+0000","last_change":"2023-10-06T23:11:18.270871+0000","last_active":"2023-10-06T23:11:19.778118+0000","last_peered":"2023-10-06T23:11:19.778118+0000","last_clean":"2023-10-06T23:11:19.778118+0000","last_became_active":"2023-10-06T23:11:18.270288+0000","last_became_peered":"2023-10-06T23:11:18.270288+0000","last_unstale":"2023-10-06T23:11:19.778118+0000","last_undegraded":"2023-10-06T23:11:19.778118+0000","last_fullsized":"2023-10-06T23:11:19.778118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:02:48.819640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342180+0000","last_change":"2023-10-06T23:11:18.261001+0000","last_active":"2023-10-06T23:11:19.342180+0000","last_peered":"2023-10-06T23:11:19.342180+0000","last_clean":"2023-10-06T23:11:19.342180+0000","last_became_active":"2023-10-06T23:11:18.260661+0000","last_became_peered":"2023-10-06T23:11:18.260661+0000","last_unstale":"2023-10-06T23:11:19.342180+0000","last_undegraded":"2023-10-06T23:11:19.342180+0000","last_fullsized":"2023-10-06T23:11:19.342180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:42.382235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777663+0000","last_change":"2023-10-06T23:11:18.263613+0000","last_active":"2023-10-06T23:11:19.777663+0000","last_peered":"2023-10-06T23:11:19.777663+0000","last_clean":"2023-10-06T23:11:19.777663+0000","last_became_active":"2023-10-06T23:11:18.263304+0000","last_became_peered":"2023-10-06T23:11:18.263304+0000","last_unstale":"2023-10-06T23:11:19.777663+0000","last_undegraded":"2023-10-06T23:11:19.777663+0000","last_fullsized":"2023-10-06T23:11:19.777663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:20:12.108788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.272302+0000","last_change":"2023-10-06T23:11:18.263968+0000","last_active":"2023-10-06T23:11:18.272302+0000","last_peered":"2023-10-06T23:11:18.272302+0000","last_clean":"2023-10-06T23:11:18.272302+0000","last_became_active":"2023-10-06T23:11:18.263634+0000","last_became_peered":"2023-10-06T23:11:18.263634+0000","last_unstale":"2023-10-06T23:11:18.272302+0000","last_undegraded":"2023-10-06T23:11:18.272302+0000","last_fullsized":"2023-10-06T23:11:18.272302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:52:20.411780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.271098+0000","last_change":"2023-10-06T23:11:18.268945+0000","last_active":"2023-10-06T23:11:18.271098+0000","last_peered":"2023-10-06T23:11:18.271098+0000","last_clean":"2023-10-06T23:11:18.271098+0000","last_became_active":"2023-10-06T23:11:18.268598+0000","last_became_peered":"2023-10-06T23:11:18.268598+0000","last_unstale":"2023-10-06T23:11:18.271098+0000","last_undegraded":"2023-10-06T23:11:18.271098+0000","last_fullsized":"2023-10-06T23:11:18.271098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:52:59.123236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673233+0000","last_change":"2023-10-06T23:11:18.261872+0000","last_active":"2023-10-06T23:11:19.673233+0000","last_peered":"2023-10-06T23:11:19.673233+0000","last_clean":"2023-10-06T23:11:19.673233+0000","last_became_active":"2023-10-06T23:11:18.261583+0000","last_became_peered":"2023-10-06T23:11:18.261583+0000","last_unstale":"2023-10-06T23:11:19.673233+0000","last_undegraded":"2023-10-06T23:11:19.673233+0000","last_fullsized":"2023-10-06T23:11:19.673233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:50:54.145738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778263+0000","last_change":"2023-10-06T23:11:18.263675+0000","last_active":"2023-10-06T23:11:19.778263+0000","last_peered":"2023-10-06T23:11:19.778263+0000","last_clean":"2023-10-06T23:11:19.778263+0000","last_became_active":"2023-10-06T23:11:18.263389+0000","last_became_peered":"2023-10-06T23:11:18.263389+0000","last_unstale":"2023-10-06T23:11:19.778263+0000","last_undegraded":"2023-10-06T23:11:19.778263+0000","last_fullsized":"2023-10-06T23:11:19.778263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:03:36.466351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.272379+0000","last_change":"2023-10-06T23:11:18.266565+0000","last_active":"2023-10-06T23:11:18.272379+0000","last_peered":"2023-10-06T23:11:18.272379+0000","last_clean":"2023-10-06T23:11:18.272379+0000","last_became_active":"2023-10-06T23:11:18.266290+0000","last_became_peered":"2023-10-06T23:11:18.266290+0000","last_unstale":"2023-10-06T23:11:18.272379+0000","last_undegraded":"2023-10-06T23:11:18.272379+0000","last_fullsized":"2023-10-06T23:11:18.272379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:10:40.292680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778093+0000","last_change":"2023-10-06T23:11:18.266849+0000","last_active":"2023-10-06T23:11:19.778093+0000","last_peered":"2023-10-06T23:11:19.778093+0000","last_clean":"2023-10-06T23:11:19.778093+0000","last_became_active":"2023-10-06T23:11:18.266517+0000","last_became_peered":"2023-10-06T23:11:18.266517+0000","last_unstale":"2023-10-06T23:11:19.778093+0000","last_undegraded":"2023-10-06T23:11:19.778093+0000","last_fullsized":"2023-10-06T23:11:19.778093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:25:31.988065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.271311+0000","last_change":"2023-10-06T23:11:18.270336+0000","last_active":"2023-10-06T23:11:18.271311+0000","last_peered":"2023-10-06T23:11:18.271311+0000","last_clean":"2023-10-06T23:11:18.271311+0000","last_became_active":"2023-10-06T23:11:18.269969+0000","last_became_peered":"2023-10-06T23:11:18.269969+0000","last_unstale":"2023-10-06T23:11:18.271311+0000","last_undegraded":"2023-10-06T23:11:18.271311+0000","last_fullsized":"2023-10-06T23:11:18.271311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:41:09.869374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406618+0000","last_change":"2023-10-06T23:11:18.264549+0000","last_active":"2023-10-06T23:11:19.406618+0000","last_peered":"2023-10-06T23:11:19.406618+0000","last_clean":"2023-10-06T23:11:19.406618+0000","last_became_active":"2023-10-06T23:11:18.263446+0000","last_became_peered":"2023-10-06T23:11:18.263446+0000","last_unstale":"2023-10-06T23:11:19.406618+0000","last_undegraded":"2023-10-06T23:11:19.406618+0000","last_fullsized":"2023-10-06T23:11:19.406618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:21:57.009374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406480+0000","last_change":"2023-10-06T23:11:18.262470+0000","last_active":"2023-10-06T23:11:19.406480+0000","last_peered":"2023-10-06T23:11:19.406480+0000","last_clean":"2023-10-06T23:11:19.406480+0000","last_became_active":"2023-10-06T23:11:18.262134+0000","last_became_peered":"2023-10-06T23:11:18.262134+0000","last_unstale":"2023-10-06T23:11:19.406480+0000","last_undegraded":"2023-10-06T23:11:19.406480+0000","last_fullsized":"2023-10-06T23:11:19.406480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:09:26.745107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.672722+0000","last_change":"2023-10-06T23:11:18.260657+0000","last_active":"2023-10-06T23:11:19.672722+0000","last_peered":"2023-10-06T23:11:19.672722+0000","last_clean":"2023-10-06T23:11:19.672722+0000","last_became_active":"2023-10-06T23:11:18.260343+0000","last_became_peered":"2023-10-06T23:11:18.260343+0000","last_unstale":"2023-10-06T23:11:19.672722+0000","last_undegraded":"2023-10-06T23:11:19.672722+0000","last_fullsized":"2023-10-06T23:11:19.672722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:46:24.199333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250179+0000","last_change":"2023-10-06T23:11:18.262071+0000","last_active":"2023-10-06T23:11:19.250179+0000","last_peered":"2023-10-06T23:11:19.250179+0000","last_clean":"2023-10-06T23:11:19.250179+0000","last_became_active":"2023-10-06T23:11:18.261348+0000","last_became_peered":"2023-10-06T23:11:18.261348+0000","last_unstale":"2023-10-06T23:11:19.250179+0000","last_undegraded":"2023-10-06T23:11:19.250179+0000","last_fullsized":"2023-10-06T23:11:19.250179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:57:54.957156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.270270+0000","last_change":"2023-10-06T23:11:18.266593+0000","last_active":"2023-10-06T23:11:18.270270+0000","last_peered":"2023-10-06T23:11:18.270270+0000","last_clean":"2023-10-06T23:11:18.270270+0000","last_became_active":"2023-10-06T23:11:18.266293+0000","last_became_peered":"2023-10-06T23:11:18.266293+0000","last_unstale":"2023-10-06T23:11:18.270270+0000","last_undegraded":"2023-10-06T23:11:18.270270+0000","last_fullsized":"2023-10-06T23:11:18.270270+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:11:32.915423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777587+0000","last_change":"2023-10-06T23:11:18.264871+0000","last_active":"2023-10-06T23:11:19.777587+0000","last_peered":"2023-10-06T23:11:19.777587+0000","last_clean":"2023-10-06T23:11:19.777587+0000","last_became_active":"2023-10-06T23:11:18.264451+0000","last_became_peered":"2023-10-06T23:11:18.264451+0000","last_unstale":"2023-10-06T23:11:19.777587+0000","last_undegraded":"2023-10-06T23:11:19.777587+0000","last_fullsized":"2023-10-06T23:11:19.777587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:40:00.581508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.303012+0000","last_change":"2023-10-06T23:11:17.255867+0000","last_active":"2023-10-06T23:11:18.303012+0000","last_peered":"2023-10-06T23:11:18.303012+0000","last_clean":"2023-10-06T23:11:18.303012+0000","last_became_active":"2023-10-06T23:11:17.255463+0000","last_became_peered":"2023-10-06T23:11:17.255463+0000","last_unstale":"2023-10-06T23:11:18.303012+0000","last_undegraded":"2023-10-06T23:11:18.303012+0000","last_fullsized":"2023-10-06T23:11:18.303012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:21:29.493049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.264690+0000","last_change":"2023-10-06T23:11:18.262575+0000","last_active":"2023-10-06T23:11:18.264690+0000","last_peered":"2023-10-06T23:11:18.264690+0000","last_clean":"2023-10-06T23:11:18.264690+0000","last_became_active":"2023-10-06T23:11:18.262266+0000","last_became_peered":"2023-10-06T23:11:18.262266+0000","last_unstale":"2023-10-06T23:11:18.264690+0000","last_undegraded":"2023-10-06T23:11:18.264690+0000","last_fullsized":"2023-10-06T23:11:18.264690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:26:44.752664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.299186+0000","last_change":"2023-10-06T23:11:17.259061+0000","last_active":"2023-10-06T23:11:18.299186+0000","last_peered":"2023-10-06T23:11:18.299186+0000","last_clean":"2023-10-06T23:11:18.299186+0000","last_became_active":"2023-10-06T23:11:17.258624+0000","last_became_peered":"2023-10-06T23:11:17.258624+0000","last_unstale":"2023-10-06T23:11:18.299186+0000","last_undegraded":"2023-10-06T23:11:18.299186+0000","last_fullsized":"2023-10-06T23:11:18.299186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:28.121405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406866+0000","last_change":"2023-10-06T23:11:18.263840+0000","last_active":"2023-10-06T23:11:19.406866+0000","last_peered":"2023-10-06T23:11:19.406866+0000","last_clean":"2023-10-06T23:11:19.406866+0000","last_became_active":"2023-10-06T23:11:18.263454+0000","last_became_peered":"2023-10-06T23:11:18.263454+0000","last_unstale":"2023-10-06T23:11:19.406866+0000","last_undegraded":"2023-10-06T23:11:19.406866+0000","last_fullsized":"2023-10-06T23:11:19.406866+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:49.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342603+0000","last_change":"2023-10-06T23:11:17.259742+0000","last_active":"2023-10-06T23:11:19.342603+0000","last_peered":"2023-10-06T23:11:19.342603+0000","last_clean":"2023-10-06T23:11:19.342603+0000","last_became_active":"2023-10-06T23:11:17.259109+0000","last_became_peered":"2023-10-06T23:11:17.259109+0000","last_unstale":"2023-10-06T23:11:19.342603+0000","last_undegraded":"2023-10-06T23:11:19.342603+0000","last_fullsized":"2023-10-06T23:11:19.342603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:18:04.695629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.672828+0000","last_change":"2023-10-06T23:11:18.274068+0000","last_active":"2023-10-06T23:11:19.672828+0000","last_peered":"2023-10-06T23:11:19.672828+0000","last_clean":"2023-10-06T23:11:19.672828+0000","last_became_active":"2023-10-06T23:11:18.273692+0000","last_became_peered":"2023-10-06T23:11:18.273692+0000","last_unstale":"2023-10-06T23:11:19.672828+0000","last_undegraded":"2023-10-06T23:11:19.672828+0000","last_fullsized":"2023-10-06T23:11:19.672828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:57:07.735915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342496+0000","last_change":"2023-10-06T23:11:17.260046+0000","last_active":"2023-10-06T23:11:19.342496+0000","last_peered":"2023-10-06T23:11:19.342496+0000","last_clean":"2023-10-06T23:11:19.342496+0000","last_became_active":"2023-10-06T23:11:17.259638+0000","last_became_peered":"2023-10-06T23:11:17.259638+0000","last_unstale":"2023-10-06T23:11:19.342496+0000","last_undegraded":"2023-10-06T23:11:19.342496+0000","last_fullsized":"2023-10-06T23:11:19.342496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:21.660072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778137+0000","last_change":"2023-10-06T23:11:18.264328+0000","last_active":"2023-10-06T23:11:19.778137+0000","last_peered":"2023-10-06T23:11:19.778137+0000","last_clean":"2023-10-06T23:11:19.778137+0000","last_became_active":"2023-10-06T23:11:18.263554+0000","last_became_peered":"2023-10-06T23:11:18.263554+0000","last_unstale":"2023-10-06T23:11:19.778137+0000","last_undegraded":"2023-10-06T23:11:19.778137+0000","last_fullsized":"2023-10-06T23:11:19.778137+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:44:02.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:22.244310+0000","last_change":"2023-10-06T23:11:17.265538+0000","last_active":"2023-10-06T23:11:22.244310+0000","last_peered":"2023-10-06T23:11:22.244310+0000","last_clean":"2023-10-06T23:11:22.244310+0000","last_became_active":"2023-10-06T23:11:17.265044+0000","last_became_peered":"2023-10-06T23:11:17.265044+0000","last_unstale":"2023-10-06T23:11:22.244310+0000","last_undegraded":"2023-10-06T23:11:22.244310+0000","last_fullsized":"2023-10-06T23:11:22.244310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:51.220961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342326+0000","last_change":"2023-10-06T23:11:18.257044+0000","last_active":"2023-10-06T23:11:19.342326+0000","last_peered":"2023-10-06T23:11:19.342326+0000","last_clean":"2023-10-06T23:11:19.342326+0000","last_became_active":"2023-10-06T23:11:18.256711+0000","last_became_peered":"2023-10-06T23:11:18.256711+0000","last_unstale":"2023-10-06T23:11:19.342326+0000","last_undegraded":"2023-10-06T23:11:19.342326+0000","last_fullsized":"2023-10-06T23:11:19.342326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:40:25.441143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777481+0000","last_change":"2023-10-06T23:11:17.262062+0000","last_active":"2023-10-06T23:11:19.777481+0000","last_peered":"2023-10-06T23:11:19.777481+0000","last_clean":"2023-10-06T23:11:19.777481+0000","last_became_active":"2023-10-06T23:11:17.261618+0000","last_became_peered":"2023-10-06T23:11:17.261618+0000","last_unstale":"2023-10-06T23:11:19.777481+0000","last_undegraded":"2023-10-06T23:11:19.777481+0000","last_fullsized":"2023-10-06T23:11:19.777481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:59:33.544470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778132+0000","last_change":"2023-10-06T23:11:18.263242+0000","last_active":"2023-10-06T23:11:19.778132+0000","last_peered":"2023-10-06T23:11:19.778132+0000","last_clean":"2023-10-06T23:11:19.778132+0000","last_became_active":"2023-10-06T23:11:18.262684+0000","last_became_peered":"2023-10-06T23:11:18.262684+0000","last_unstale":"2023-10-06T23:11:19.778132+0000","last_undegraded":"2023-10-06T23:11:19.778132+0000","last_fullsized":"2023-10-06T23:11:19.778132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:30:04.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.254423+0000","last_change":"2023-10-06T23:11:17.254042+0000","last_active":"2023-10-06T23:11:18.254423+0000","last_peered":"2023-10-06T23:11:18.254423+0000","last_clean":"2023-10-06T23:11:18.254423+0000","last_became_active":"2023-10-06T23:11:17.253704+0000","last_became_peered":"2023-10-06T23:11:17.253704+0000","last_unstale":"2023-10-06T23:11:18.254423+0000","last_undegraded":"2023-10-06T23:11:18.254423+0000","last_fullsized":"2023-10-06T23:11:18.254423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:44.179814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.261683+0000","last_change":"2023-10-06T23:11:18.259161+0000","last_active":"2023-10-06T23:11:18.261683+0000","last_peered":"2023-10-06T23:11:18.261683+0000","last_clean":"2023-10-06T23:11:18.261683+0000","last_became_active":"2023-10-06T23:11:18.258747+0000","last_became_peered":"2023-10-06T23:11:18.258747+0000","last_unstale":"2023-10-06T23:11:18.261683+0000","last_undegraded":"2023-10-06T23:11:18.261683+0000","last_fullsized":"2023-10-06T23:11:18.261683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:59:20.805900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777767+0000","last_change":"2023-10-06T23:11:17.266278+0000","last_active":"2023-10-06T23:11:19.777767+0000","last_peered":"2023-10-06T23:11:19.777767+0000","last_clean":"2023-10-06T23:11:19.777767+0000","last_became_active":"2023-10-06T23:11:17.265174+0000","last_became_peered":"2023-10-06T23:11:17.265174+0000","last_unstale":"2023-10-06T23:11:19.777767+0000","last_undegraded":"2023-10-06T23:11:19.777767+0000","last_fullsized":"2023-10-06T23:11:19.777767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:51.203566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.261407+0000","last_change":"2023-10-06T23:11:18.259699+0000","last_active":"2023-10-06T23:11:18.261407+0000","last_peered":"2023-10-06T23:11:18.261407+0000","last_clean":"2023-10-06T23:11:18.261407+0000","last_became_active":"2023-10-06T23:11:18.259395+0000","last_became_peered":"2023-10-06T23:11:18.259395+0000","last_unstale":"2023-10-06T23:11:18.261407+0000","last_undegraded":"2023-10-06T23:11:18.261407+0000","last_fullsized":"2023-10-06T23:11:18.261407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:16:45.695732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777760+0000","last_change":"2023-10-06T23:11:17.259592+0000","last_active":"2023-10-06T23:11:19.777760+0000","last_peered":"2023-10-06T23:11:19.777760+0000","last_clean":"2023-10-06T23:11:19.777760+0000","last_became_active":"2023-10-06T23:11:17.259254+0000","last_became_peered":"2023-10-06T23:11:17.259254+0000","last_unstale":"2023-10-06T23:11:19.777760+0000","last_undegraded":"2023-10-06T23:11:19.777760+0000","last_fullsized":"2023-10-06T23:11:19.777760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:31.633620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673163+0000","last_change":"2023-10-06T23:11:18.271568+0000","last_active":"2023-10-06T23:11:19.673163+0000","last_peered":"2023-10-06T23:11:19.673163+0000","last_clean":"2023-10-06T23:11:19.673163+0000","last_became_active":"2023-10-06T23:11:18.271248+0000","last_became_peered":"2023-10-06T23:11:18.271248+0000","last_unstale":"2023-10-06T23:11:19.673163+0000","last_undegraded":"2023-10-06T23:11:19.673163+0000","last_fullsized":"2023-10-06T23:11:19.673163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:30.138803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.249102+0000","last_change":"2023-10-06T23:11:17.257823+0000","last_active":"2023-10-06T23:11:18.249102+0000","last_peered":"2023-10-06T23:11:18.249102+0000","last_clean":"2023-10-06T23:11:18.249102+0000","last_became_active":"2023-10-06T23:11:17.257426+0000","last_became_peered":"2023-10-06T23:11:17.257426+0000","last_unstale":"2023-10-06T23:11:18.249102+0000","last_undegraded":"2023-10-06T23:11:18.249102+0000","last_fullsized":"2023-10-06T23:11:18.249102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:27:17.158360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406831+0000","last_change":"2023-10-06T23:11:18.260555+0000","last_active":"2023-10-06T23:11:19.406831+0000","last_peered":"2023-10-06T23:11:19.406831+0000","last_clean":"2023-10-06T23:11:19.406831+0000","last_became_active":"2023-10-06T23:11:18.260236+0000","last_became_peered":"2023-10-06T23:11:18.260236+0000","last_unstale":"2023-10-06T23:11:19.406831+0000","last_undegraded":"2023-10-06T23:11:19.406831+0000","last_fullsized":"2023-10-06T23:11:19.406831+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:51.499668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.318742+0000","last_change":"2023-10-06T23:11:17.267686+0000","last_active":"2023-10-06T23:11:21.318742+0000","last_peered":"2023-10-06T23:11:21.318742+0000","last_clean":"2023-10-06T23:11:21.318742+0000","last_became_active":"2023-10-06T23:11:17.267322+0000","last_became_peered":"2023-10-06T23:11:17.267322+0000","last_unstale":"2023-10-06T23:11:21.318742+0000","last_undegraded":"2023-10-06T23:11:21.318742+0000","last_fullsized":"2023-10-06T23:11:21.318742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:48:40.755898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.672974+0000","last_change":"2023-10-06T23:11:18.257382+0000","last_active":"2023-10-06T23:11:19.672974+0000","last_peered":"2023-10-06T23:11:19.672974+0000","last_clean":"2023-10-06T23:11:19.672974+0000","last_became_active":"2023-10-06T23:11:18.256572+0000","last_became_peered":"2023-10-06T23:11:18.256572+0000","last_unstale":"2023-10-06T23:11:19.672974+0000","last_undegraded":"2023-10-06T23:11:19.672974+0000","last_fullsized":"2023-10-06T23:11:19.672974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:43.631813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777530+0000","last_change":"2023-10-06T23:11:17.257340+0000","last_active":"2023-10-06T23:11:19.777530+0000","last_peered":"2023-10-06T23:11:19.777530+0000","last_clean":"2023-10-06T23:11:19.777530+0000","last_became_active":"2023-10-06T23:11:17.256973+0000","last_became_peered":"2023-10-06T23:11:17.256973+0000","last_unstale":"2023-10-06T23:11:19.777530+0000","last_undegraded":"2023-10-06T23:11:19.777530+0000","last_fullsized":"2023-10-06T23:11:19.777530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:35.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342485+0000","last_change":"2023-10-06T23:11:18.258928+0000","last_active":"2023-10-06T23:11:19.342485+0000","last_peered":"2023-10-06T23:11:19.342485+0000","last_clean":"2023-10-06T23:11:19.342485+0000","last_became_active":"2023-10-06T23:11:18.258572+0000","last_became_peered":"2023-10-06T23:11:18.258572+0000","last_unstale":"2023-10-06T23:11:19.342485+0000","last_undegraded":"2023-10-06T23:11:19.342485+0000","last_fullsized":"2023-10-06T23:11:19.342485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:51.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.318974+0000","last_change":"2023-10-06T23:11:17.260955+0000","last_active":"2023-10-06T23:11:21.318974+0000","last_peered":"2023-10-06T23:11:21.318974+0000","last_clean":"2023-10-06T23:11:21.318974+0000","last_became_active":"2023-10-06T23:11:17.260565+0000","last_became_peered":"2023-10-06T23:11:17.260565+0000","last_unstale":"2023-10-06T23:11:21.318974+0000","last_undegraded":"2023-10-06T23:11:21.318974+0000","last_fullsized":"2023-10-06T23:11:21.318974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:14:51.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.271101+0000","last_change":"2023-10-06T23:11:18.266857+0000","last_active":"2023-10-06T23:11:18.271101+0000","last_peered":"2023-10-06T23:11:18.271101+0000","last_clean":"2023-10-06T23:11:18.271101+0000","last_became_active":"2023-10-06T23:11:18.266476+0000","last_became_peered":"2023-10-06T23:11:18.266476+0000","last_unstale":"2023-10-06T23:11:18.271101+0000","last_undegraded":"2023-10-06T23:11:18.271101+0000","last_fullsized":"2023-10-06T23:11:18.271101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:20:07.592647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.319711+0000","last_change":"2023-10-06T23:11:17.265672+0000","last_active":"2023-10-06T23:11:21.319711+0000","last_peered":"2023-10-06T23:11:21.319711+0000","last_clean":"2023-10-06T23:11:21.319711+0000","last_became_active":"2023-10-06T23:11:17.265329+0000","last_became_peered":"2023-10-06T23:11:17.265329+0000","last_unstale":"2023-10-06T23:11:21.319711+0000","last_undegraded":"2023-10-06T23:11:21.319711+0000","last_fullsized":"2023-10-06T23:11:21.319711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:43.159919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.272107+0000","last_change":"2023-10-06T23:11:18.269427+0000","last_active":"2023-10-06T23:11:18.272107+0000","last_peered":"2023-10-06T23:11:18.272107+0000","last_clean":"2023-10-06T23:11:18.272107+0000","last_became_active":"2023-10-06T23:11:18.269115+0000","last_became_peered":"2023-10-06T23:11:18.269115+0000","last_unstale":"2023-10-06T23:11:18.272107+0000","last_undegraded":"2023-10-06T23:11:18.272107+0000","last_fullsized":"2023-10-06T23:11:18.272107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:28:29.950697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.253057+0000","last_change":"2023-10-06T23:11:17.252599+0000","last_active":"2023-10-06T23:11:18.253057+0000","last_peered":"2023-10-06T23:11:18.253057+0000","last_clean":"2023-10-06T23:11:18.253057+0000","last_became_active":"2023-10-06T23:11:17.251893+0000","last_became_peered":"2023-10-06T23:11:17.251893+0000","last_unstale":"2023-10-06T23:11:18.253057+0000","last_undegraded":"2023-10-06T23:11:18.253057+0000","last_fullsized":"2023-10-06T23:11:18.253057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:24:10.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.272874+0000","last_change":"2023-10-06T23:11:18.269026+0000","last_active":"2023-10-06T23:11:18.272874+0000","last_peered":"2023-10-06T23:11:18.272874+0000","last_clean":"2023-10-06T23:11:18.272874+0000","last_became_active":"2023-10-06T23:11:18.268701+0000","last_became_peered":"2023-10-06T23:11:18.268701+0000","last_unstale":"2023-10-06T23:11:18.272874+0000","last_undegraded":"2023-10-06T23:11:18.272874+0000","last_fullsized":"2023-10-06T23:11:18.272874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:32.302877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342144+0000","last_change":"2023-10-06T23:11:17.255323+0000","last_active":"2023-10-06T23:11:19.342144+0000","last_peered":"2023-10-06T23:11:19.342144+0000","last_clean":"2023-10-06T23:11:19.342144+0000","last_became_active":"2023-10-06T23:11:17.254975+0000","last_became_peered":"2023-10-06T23:11:17.254975+0000","last_unstale":"2023-10-06T23:11:19.342144+0000","last_undegraded":"2023-10-06T23:11:19.342144+0000","last_fullsized":"2023-10-06T23:11:19.342144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:41:35.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777759+0000","last_change":"2023-10-06T23:11:18.263290+0000","last_active":"2023-10-06T23:11:19.777759+0000","last_peered":"2023-10-06T23:11:19.777759+0000","last_clean":"2023-10-06T23:11:19.777759+0000","last_became_active":"2023-10-06T23:11:18.262680+0000","last_became_peered":"2023-10-06T23:11:18.262680+0000","last_unstale":"2023-10-06T23:11:19.777759+0000","last_undegraded":"2023-10-06T23:11:19.777759+0000","last_fullsized":"2023-10-06T23:11:19.777759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:43:12.249803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342329+0000","last_change":"2023-10-06T23:11:17.258778+0000","last_active":"2023-10-06T23:11:19.342329+0000","last_peered":"2023-10-06T23:11:19.342329+0000","last_clean":"2023-10-06T23:11:19.342329+0000","last_became_active":"2023-10-06T23:11:17.258283+0000","last_became_peered":"2023-10-06T23:11:17.258283+0000","last_unstale":"2023-10-06T23:11:19.342329+0000","last_undegraded":"2023-10-06T23:11:19.342329+0000","last_fullsized":"2023-10-06T23:11:19.342329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:19:06.107491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250005+0000","last_change":"2023-10-06T23:11:18.263844+0000","last_active":"2023-10-06T23:11:19.250005+0000","last_peered":"2023-10-06T23:11:19.250005+0000","last_clean":"2023-10-06T23:11:19.250005+0000","last_became_active":"2023-10-06T23:11:18.260856+0000","last_became_peered":"2023-10-06T23:11:18.260856+0000","last_unstale":"2023-10-06T23:11:19.250005+0000","last_undegraded":"2023-10-06T23:11:19.250005+0000","last_fullsized":"2023-10-06T23:11:19.250005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:35:45.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.242666+0000","last_change":"2023-10-06T23:11:17.258175+0000","last_active":"2023-10-06T23:11:18.242666+0000","last_peered":"2023-10-06T23:11:18.242666+0000","last_clean":"2023-10-06T23:11:18.242666+0000","last_became_active":"2023-10-06T23:11:17.257780+0000","last_became_peered":"2023-10-06T23:11:17.257780+0000","last_unstale":"2023-10-06T23:11:18.242666+0000","last_undegraded":"2023-10-06T23:11:18.242666+0000","last_fullsized":"2023-10-06T23:11:18.242666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:19:51.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777705+0000","last_change":"2023-10-06T23:11:18.267837+0000","last_active":"2023-10-06T23:11:19.777705+0000","last_peered":"2023-10-06T23:11:19.777705+0000","last_clean":"2023-10-06T23:11:19.777705+0000","last_became_active":"2023-10-06T23:11:18.267535+0000","last_became_peered":"2023-10-06T23:11:18.267535+0000","last_unstale":"2023-10-06T23:11:19.777705+0000","last_undegraded":"2023-10-06T23:11:19.777705+0000","last_fullsized":"2023-10-06T23:11:19.777705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:08.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.250392+0000","last_change":"2023-10-06T23:11:17.261075+0000","last_active":"2023-10-06T23:11:18.250392+0000","last_peered":"2023-10-06T23:11:18.250392+0000","last_clean":"2023-10-06T23:11:18.250392+0000","last_became_active":"2023-10-06T23:11:17.260456+0000","last_became_peered":"2023-10-06T23:11:17.260456+0000","last_unstale":"2023-10-06T23:11:18.250392+0000","last_undegraded":"2023-10-06T23:11:18.250392+0000","last_fullsized":"2023-10-06T23:11:18.250392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:00:25.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778082+0000","last_change":"2023-10-06T23:11:18.265347+0000","last_active":"2023-10-06T23:11:19.778082+0000","last_peered":"2023-10-06T23:11:19.778082+0000","last_clean":"2023-10-06T23:11:19.778082+0000","last_became_active":"2023-10-06T23:11:18.265034+0000","last_became_peered":"2023-10-06T23:11:18.265034+0000","last_unstale":"2023-10-06T23:11:19.778082+0000","last_undegraded":"2023-10-06T23:11:19.778082+0000","last_fullsized":"2023-10-06T23:11:19.778082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:32:44.253022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778183+0000","last_change":"2023-10-06T23:11:18.263990+0000","last_active":"2023-10-06T23:11:19.778183+0000","last_peered":"2023-10-06T23:11:19.778183+0000","last_clean":"2023-10-06T23:11:19.778183+0000","last_became_active":"2023-10-06T23:11:18.262760+0000","last_became_peered":"2023-10-06T23:11:18.262760+0000","last_unstale":"2023-10-06T23:11:19.778183+0000","last_undegraded":"2023-10-06T23:11:19.778183+0000","last_fullsized":"2023-10-06T23:11:19.778183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:48:51.754187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.254282+0000","last_change":"2023-10-06T23:11:17.263187+0000","last_active":"2023-10-06T23:11:18.254282+0000","last_peered":"2023-10-06T23:11:18.254282+0000","last_clean":"2023-10-06T23:11:18.254282+0000","last_became_active":"2023-10-06T23:11:17.262770+0000","last_became_peered":"2023-10-06T23:11:17.262770+0000","last_unstale":"2023-10-06T23:11:18.254282+0000","last_undegraded":"2023-10-06T23:11:18.254282+0000","last_fullsized":"2023-10-06T23:11:18.254282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:27.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.265081+0000","last_change":"2023-10-06T23:11:18.264305+0000","last_active":"2023-10-06T23:11:18.265081+0000","last_peered":"2023-10-06T23:11:18.265081+0000","last_clean":"2023-10-06T23:11:18.265081+0000","last_became_active":"2023-10-06T23:11:18.263964+0000","last_became_peered":"2023-10-06T23:11:18.263964+0000","last_unstale":"2023-10-06T23:11:18.265081+0000","last_undegraded":"2023-10-06T23:11:18.265081+0000","last_fullsized":"2023-10-06T23:11:18.265081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:55:19.260077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.249100+0000","last_change":"2023-10-06T23:11:17.249832+0000","last_active":"2023-10-06T23:11:18.249100+0000","last_peered":"2023-10-06T23:11:18.249100+0000","last_clean":"2023-10-06T23:11:18.249100+0000","last_became_active":"2023-10-06T23:11:17.249425+0000","last_became_peered":"2023-10-06T23:11:17.249425+0000","last_unstale":"2023-10-06T23:11:18.249100+0000","last_undegraded":"2023-10-06T23:11:18.249100+0000","last_fullsized":"2023-10-06T23:11:18.249100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:02:49.349981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":309,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-06T23:11:17.251301+0000","last_change":"2023-10-06T23:09:57.868881+0000","last_active":"2023-10-06T23:11:17.251301+0000","last_peered":"2023-10-06T23:11:17.251301+0000","last_clean":"2023-10-06T23:11:17.251301+0000","last_became_active":"2023-10-06T23:09:57.868450+0000","last_became_peered":"2023-10-06T23:09:57.868450+0000","last_unstale":"2023-10-06T23:11:17.251301+0000","last_undegraded":"2023-10-06T23:11:17.251301+0000","last_fullsized":"2023-10-06T23:11:17.251301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_clean_scrub_stamp":"2023-10-06T23:06:23.790096+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:39:38.741355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.270916+0000","last_change":"2023-10-06T23:11:18.265244+0000","last_active":"2023-10-06T23:11:18.270916+0000","last_peered":"2023-10-06T23:11:18.270916+0000","last_clean":"2023-10-06T23:11:18.270916+0000","last_became_active":"2023-10-06T23:11:18.264907+0000","last_became_peered":"2023-10-06T23:11:18.264907+0000","last_unstale":"2023-10-06T23:11:18.270916+0000","last_undegraded":"2023-10-06T23:11:18.270916+0000","last_fullsized":"2023-10-06T23:11:18.270916+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:45:39.088966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.249073+0000","last_change":"2023-10-06T23:11:17.259610+0000","last_active":"2023-10-06T23:11:18.249073+0000","last_peered":"2023-10-06T23:11:18.249073+0000","last_clean":"2023-10-06T23:11:18.249073+0000","last_became_active":"2023-10-06T23:11:17.259314+0000","last_became_peered":"2023-10-06T23:11:17.259314+0000","last_unstale":"2023-10-06T23:11:18.249073+0000","last_undegraded":"2023-10-06T23:11:18.249073+0000","last_fullsized":"2023-10-06T23:11:18.249073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:48.131199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342564+0000","last_change":"2023-10-06T23:11:17.259466+0000","last_active":"2023-10-06T23:11:19.342564+0000","last_peered":"2023-10-06T23:11:19.342564+0000","last_clean":"2023-10-06T23:11:19.342564+0000","last_became_active":"2023-10-06T23:11:17.258974+0000","last_became_peered":"2023-10-06T23:11:17.258974+0000","last_unstale":"2023-10-06T23:11:19.342564+0000","last_undegraded":"2023-10-06T23:11:19.342564+0000","last_fullsized":"2023-10-06T23:11:19.342564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:37:53.610578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.263157+0000","last_change":"2023-10-06T23:11:18.259562+0000","last_active":"2023-10-06T23:11:18.263157+0000","last_peered":"2023-10-06T23:11:18.263157+0000","last_clean":"2023-10-06T23:11:18.263157+0000","last_became_active":"2023-10-06T23:11:18.259188+0000","last_became_peered":"2023-10-06T23:11:18.259188+0000","last_unstale":"2023-10-06T23:11:18.263157+0000","last_undegraded":"2023-10-06T23:11:18.263157+0000","last_fullsized":"2023-10-06T23:11:18.263157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:16:06.495936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.242865+0000","last_change":"2023-10-06T23:11:17.260888+0000","last_active":"2023-10-06T23:11:18.242865+0000","last_peered":"2023-10-06T23:11:18.242865+0000","last_clean":"2023-10-06T23:11:18.242865+0000","last_became_active":"2023-10-06T23:11:17.260563+0000","last_became_peered":"2023-10-06T23:11:17.260563+0000","last_unstale":"2023-10-06T23:11:18.242865+0000","last_undegraded":"2023-10-06T23:11:18.242865+0000","last_fullsized":"2023-10-06T23:11:18.242865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:43.087389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.262403+0000","last_change":"2023-10-06T23:11:18.261401+0000","last_active":"2023-10-06T23:11:18.262403+0000","last_peered":"2023-10-06T23:11:18.262403+0000","last_clean":"2023-10-06T23:11:18.262403+0000","last_became_active":"2023-10-06T23:11:18.261037+0000","last_became_peered":"2023-10-06T23:11:18.261037+0000","last_unstale":"2023-10-06T23:11:18.262403+0000","last_undegraded":"2023-10-06T23:11:18.262403+0000","last_fullsized":"2023-10-06T23:11:18.262403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:52:46.724756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.302546+0000","last_change":"2023-10-06T23:11:17.264907+0000","last_active":"2023-10-06T23:11:18.302546+0000","last_peered":"2023-10-06T23:11:18.302546+0000","last_clean":"2023-10-06T23:11:18.302546+0000","last_became_active":"2023-10-06T23:11:17.264426+0000","last_became_peered":"2023-10-06T23:11:17.264426+0000","last_unstale":"2023-10-06T23:11:18.302546+0000","last_undegraded":"2023-10-06T23:11:18.302546+0000","last_fullsized":"2023-10-06T23:11:18.302546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:21.330048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406995+0000","last_change":"2023-10-06T23:11:18.259337+0000","last_active":"2023-10-06T23:11:19.406995+0000","last_peered":"2023-10-06T23:11:19.406995+0000","last_clean":"2023-10-06T23:11:19.406995+0000","last_became_active":"2023-10-06T23:11:18.259008+0000","last_became_peered":"2023-10-06T23:11:18.259008+0000","last_unstale":"2023-10-06T23:11:19.406995+0000","last_undegraded":"2023-10-06T23:11:19.406995+0000","last_fullsized":"2023-10-06T23:11:19.406995+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:28.845368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.320097+0000","last_change":"2023-10-06T23:11:17.267695+0000","last_active":"2023-10-06T23:11:21.320097+0000","last_peered":"2023-10-06T23:11:21.320097+0000","last_clean":"2023-10-06T23:11:21.320097+0000","last_became_active":"2023-10-06T23:11:17.267292+0000","last_became_peered":"2023-10-06T23:11:17.267292+0000","last_unstale":"2023-10-06T23:11:21.320097+0000","last_undegraded":"2023-10-06T23:11:21.320097+0000","last_fullsized":"2023-10-06T23:11:21.320097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:36:54.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342275+0000","last_change":"2023-10-06T23:11:18.260012+0000","last_active":"2023-10-06T23:11:19.342275+0000","last_peered":"2023-10-06T23:11:19.342275+0000","last_clean":"2023-10-06T23:11:19.342275+0000","last_became_active":"2023-10-06T23:11:18.259684+0000","last_became_peered":"2023-10-06T23:11:18.259684+0000","last_unstale":"2023-10-06T23:11:19.342275+0000","last_undegraded":"2023-10-06T23:11:19.342275+0000","last_fullsized":"2023-10-06T23:11:19.342275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:46:08.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.249096+0000","last_change":"2023-10-06T23:11:17.264262+0000","last_active":"2023-10-06T23:11:18.249096+0000","last_peered":"2023-10-06T23:11:18.249096+0000","last_clean":"2023-10-06T23:11:18.249096+0000","last_became_active":"2023-10-06T23:11:17.263922+0000","last_became_peered":"2023-10-06T23:11:17.263922+0000","last_unstale":"2023-10-06T23:11:18.249096+0000","last_undegraded":"2023-10-06T23:11:18.249096+0000","last_fullsized":"2023-10-06T23:11:18.249096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:00:14.045943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249731+0000","last_change":"2023-10-06T23:11:18.260908+0000","last_active":"2023-10-06T23:11:19.249731+0000","last_peered":"2023-10-06T23:11:19.249731+0000","last_clean":"2023-10-06T23:11:19.249731+0000","last_became_active":"2023-10-06T23:11:18.260459+0000","last_became_peered":"2023-10-06T23:11:18.260459+0000","last_unstale":"2023-10-06T23:11:19.249731+0000","last_undegraded":"2023-10-06T23:11:19.249731+0000","last_fullsized":"2023-10-06T23:11:19.249731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:51.570508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.249174+0000","last_change":"2023-10-06T23:11:17.262559+0000","last_active":"2023-10-06T23:11:18.249174+0000","last_peered":"2023-10-06T23:11:18.249174+0000","last_clean":"2023-10-06T23:11:18.249174+0000","last_became_active":"2023-10-06T23:11:17.262062+0000","last_became_peered":"2023-10-06T23:11:17.262062+0000","last_unstale":"2023-10-06T23:11:18.249174+0000","last_undegraded":"2023-10-06T23:11:18.249174+0000","last_fullsized":"2023-10-06T23:11:18.249174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:03.751385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.271292+0000","last_change":"2023-10-06T23:11:18.269813+0000","last_active":"2023-10-06T23:11:18.271292+0000","last_peered":"2023-10-06T23:11:18.271292+0000","last_clean":"2023-10-06T23:11:18.271292+0000","last_became_active":"2023-10-06T23:11:18.269506+0000","last_became_peered":"2023-10-06T23:11:18.269506+0000","last_unstale":"2023-10-06T23:11:18.271292+0000","last_undegraded":"2023-10-06T23:11:18.271292+0000","last_fullsized":"2023-10-06T23:11:18.271292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:08:14.081624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342275+0000","last_change":"2023-10-06T23:11:17.253040+0000","last_active":"2023-10-06T23:11:19.342275+0000","last_peered":"2023-10-06T23:11:19.342275+0000","last_clean":"2023-10-06T23:11:19.342275+0000","last_became_active":"2023-10-06T23:11:17.252596+0000","last_became_peered":"2023-10-06T23:11:17.252596+0000","last_unstale":"2023-10-06T23:11:19.342275+0000","last_undegraded":"2023-10-06T23:11:19.342275+0000","last_fullsized":"2023-10-06T23:11:19.342275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:39:30.721464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.272480+0000","last_change":"2023-10-06T23:11:18.267465+0000","last_active":"2023-10-06T23:11:18.272480+0000","last_peered":"2023-10-06T23:11:18.272480+0000","last_clean":"2023-10-06T23:11:18.272480+0000","last_became_active":"2023-10-06T23:11:18.267164+0000","last_became_peered":"2023-10-06T23:11:18.267164+0000","last_unstale":"2023-10-06T23:11:18.272480+0000","last_undegraded":"2023-10-06T23:11:18.272480+0000","last_fullsized":"2023-10-06T23:11:18.272480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:51:34.985856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.248351+0000","last_change":"2023-10-06T23:11:17.267653+0000","last_active":"2023-10-06T23:11:18.248351+0000","last_peered":"2023-10-06T23:11:18.248351+0000","last_clean":"2023-10-06T23:11:18.248351+0000","last_became_active":"2023-10-06T23:11:17.267264+0000","last_became_peered":"2023-10-06T23:11:17.267264+0000","last_unstale":"2023-10-06T23:11:18.248351+0000","last_undegraded":"2023-10-06T23:11:18.248351+0000","last_fullsized":"2023-10-06T23:11:18.248351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:45:57.242383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.272361+0000","last_change":"2023-10-06T23:11:18.264869+0000","last_active":"2023-10-06T23:11:18.272361+0000","last_peered":"2023-10-06T23:11:18.272361+0000","last_clean":"2023-10-06T23:11:18.272361+0000","last_became_active":"2023-10-06T23:11:18.264549+0000","last_became_peered":"2023-10-06T23:11:18.264549+0000","last_unstale":"2023-10-06T23:11:18.272361+0000","last_undegraded":"2023-10-06T23:11:18.272361+0000","last_fullsized":"2023-10-06T23:11:18.272361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:01:13.950107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777884+0000","last_change":"2023-10-06T23:11:17.263806+0000","last_active":"2023-10-06T23:11:19.777884+0000","last_peered":"2023-10-06T23:11:19.777884+0000","last_clean":"2023-10-06T23:11:19.777884+0000","last_became_active":"2023-10-06T23:11:17.263499+0000","last_became_peered":"2023-10-06T23:11:17.263499+0000","last_unstale":"2023-10-06T23:11:19.777884+0000","last_undegraded":"2023-10-06T23:11:19.777884+0000","last_fullsized":"2023-10-06T23:11:19.777884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:26.191338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.271999+0000","last_change":"2023-10-06T23:11:18.264691+0000","last_active":"2023-10-06T23:11:18.271999+0000","last_peered":"2023-10-06T23:11:18.271999+0000","last_clean":"2023-10-06T23:11:18.271999+0000","last_became_active":"2023-10-06T23:11:18.264286+0000","last_became_peered":"2023-10-06T23:11:18.264286+0000","last_unstale":"2023-10-06T23:11:18.271999+0000","last_undegraded":"2023-10-06T23:11:18.271999+0000","last_fullsized":"2023-10-06T23:11:18.271999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:57:35.548827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.252057+0000","last_change":"2023-10-06T23:11:17.263123+0000","last_active":"2023-10-06T23:11:18.252057+0000","last_peered":"2023-10-06T23:11:18.252057+0000","last_clean":"2023-10-06T23:11:18.252057+0000","last_became_active":"2023-10-06T23:11:17.262730+0000","last_became_peered":"2023-10-06T23:11:17.262730+0000","last_unstale":"2023-10-06T23:11:18.252057+0000","last_undegraded":"2023-10-06T23:11:18.252057+0000","last_fullsized":"2023-10-06T23:11:18.252057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:28.145916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.272675+0000","last_change":"2023-10-06T23:11:18.265822+0000","last_active":"2023-10-06T23:11:18.272675+0000","last_peered":"2023-10-06T23:11:18.272675+0000","last_clean":"2023-10-06T23:11:18.272675+0000","last_became_active":"2023-10-06T23:11:18.265457+0000","last_became_peered":"2023-10-06T23:11:18.265457+0000","last_unstale":"2023-10-06T23:11:18.272675+0000","last_undegraded":"2023-10-06T23:11:18.272675+0000","last_fullsized":"2023-10-06T23:11:18.272675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:29:48.601233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249793+0000","last_change":"2023-10-06T23:11:18.267305+0000","last_active":"2023-10-06T23:11:19.249793+0000","last_peered":"2023-10-06T23:11:19.249793+0000","last_clean":"2023-10-06T23:11:19.249793+0000","last_became_active":"2023-10-06T23:11:18.266975+0000","last_became_peered":"2023-10-06T23:11:18.266975+0000","last_unstale":"2023-10-06T23:11:19.249793+0000","last_undegraded":"2023-10-06T23:11:19.249793+0000","last_fullsized":"2023-10-06T23:11:19.249793+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777207+0000","last_change":"2023-10-06T23:11:18.262045+0000","last_active":"2023-10-06T23:11:19.777207+0000","last_peered":"2023-10-06T23:11:19.777207+0000","last_clean":"2023-10-06T23:11:19.777207+0000","last_became_active":"2023-10-06T23:11:18.261662+0000","last_became_peered":"2023-10-06T23:11:18.261662+0000","last_unstale":"2023-10-06T23:11:19.777207+0000","last_undegraded":"2023-10-06T23:11:19.777207+0000","last_fullsized":"2023-10-06T23:11:19.777207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:56:06.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777156+0000","last_change":"2023-10-06T23:11:18.259540+0000","last_active":"2023-10-06T23:11:19.777156+0000","last_peered":"2023-10-06T23:11:19.777156+0000","last_clean":"2023-10-06T23:11:19.777156+0000","last_became_active":"2023-10-06T23:11:18.259234+0000","last_became_peered":"2023-10-06T23:11:18.259234+0000","last_unstale":"2023-10-06T23:11:19.777156+0000","last_undegraded":"2023-10-06T23:11:19.777156+0000","last_fullsized":"2023-10-06T23:11:19.777156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:47:15.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406699+0000","last_change":"2023-10-06T23:11:18.266295+0000","last_active":"2023-10-06T23:11:19.406699+0000","last_peered":"2023-10-06T23:11:19.406699+0000","last_clean":"2023-10-06T23:11:19.406699+0000","last_became_active":"2023-10-06T23:11:18.265991+0000","last_became_peered":"2023-10-06T23:11:18.265991+0000","last_unstale":"2023-10-06T23:11:19.406699+0000","last_undegraded":"2023-10-06T23:11:19.406699+0000","last_fullsized":"2023-10-06T23:11:19.406699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:34:43.165643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.271071+0000","last_change":"2023-10-06T23:11:18.266239+0000","last_active":"2023-10-06T23:11:18.271071+0000","last_peered":"2023-10-06T23:11:18.271071+0000","last_clean":"2023-10-06T23:11:18.271071+0000","last_became_active":"2023-10-06T23:11:18.265849+0000","last_became_peered":"2023-10-06T23:11:18.265849+0000","last_unstale":"2023-10-06T23:11:18.271071+0000","last_undegraded":"2023-10-06T23:11:18.271071+0000","last_fullsized":"2023-10-06T23:11:18.271071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:32:59.611547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249918+0000","last_change":"2023-10-06T23:11:18.260885+0000","last_active":"2023-10-06T23:11:19.249918+0000","last_peered":"2023-10-06T23:11:19.249918+0000","last_clean":"2023-10-06T23:11:19.249918+0000","last_became_active":"2023-10-06T23:11:18.260567+0000","last_became_peered":"2023-10-06T23:11:18.260567+0000","last_unstale":"2023-10-06T23:11:19.249918+0000","last_undegraded":"2023-10-06T23:11:19.249918+0000","last_fullsized":"2023-10-06T23:11:19.249918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:36.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778153+0000","last_change":"2023-10-06T23:11:18.257105+0000","last_active":"2023-10-06T23:11:19.778153+0000","last_peered":"2023-10-06T23:11:19.778153+0000","last_clean":"2023-10-06T23:11:19.778153+0000","last_became_active":"2023-10-06T23:11:18.256816+0000","last_became_peered":"2023-10-06T23:11:18.256816+0000","last_unstale":"2023-10-06T23:11:19.778153+0000","last_undegraded":"2023-10-06T23:11:19.778153+0000","last_fullsized":"2023-10-06T23:11:19.778153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:07.749678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.261623+0000","last_change":"2023-10-06T23:11:18.260383+0000","last_active":"2023-10-06T23:11:18.261623+0000","last_peered":"2023-10-06T23:11:18.261623+0000","last_clean":"2023-10-06T23:11:18.261623+0000","last_became_active":"2023-10-06T23:11:18.260010+0000","last_became_peered":"2023-10-06T23:11:18.260010+0000","last_unstale":"2023-10-06T23:11:18.261623+0000","last_undegraded":"2023-10-06T23:11:18.261623+0000","last_fullsized":"2023-10-06T23:11:18.261623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:52.709338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777876+0000","last_change":"2023-10-06T23:11:18.261948+0000","last_active":"2023-10-06T23:11:19.777876+0000","last_peered":"2023-10-06T23:11:19.777876+0000","last_clean":"2023-10-06T23:11:19.777876+0000","last_became_active":"2023-10-06T23:11:18.261605+0000","last_became_peered":"2023-10-06T23:11:18.261605+0000","last_unstale":"2023-10-06T23:11:19.777876+0000","last_undegraded":"2023-10-06T23:11:19.777876+0000","last_fullsized":"2023-10-06T23:11:19.777876+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:10:59.720181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.261780+0000","last_change":"2023-10-06T23:11:18.261123+0000","last_active":"2023-10-06T23:11:18.261780+0000","last_peered":"2023-10-06T23:11:18.261780+0000","last_clean":"2023-10-06T23:11:18.261780+0000","last_became_active":"2023-10-06T23:11:18.260754+0000","last_became_peered":"2023-10-06T23:11:18.260754+0000","last_unstale":"2023-10-06T23:11:18.261780+0000","last_undegraded":"2023-10-06T23:11:18.261780+0000","last_fullsized":"2023-10-06T23:11:18.261780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:58:55.679684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673024+0000","last_change":"2023-10-06T23:11:18.261021+0000","last_active":"2023-10-06T23:11:19.673024+0000","last_peered":"2023-10-06T23:11:19.673024+0000","last_clean":"2023-10-06T23:11:19.673024+0000","last_became_active":"2023-10-06T23:11:18.260613+0000","last_became_peered":"2023-10-06T23:11:18.260613+0000","last_unstale":"2023-10-06T23:11:19.673024+0000","last_undegraded":"2023-10-06T23:11:19.673024+0000","last_fullsized":"2023-10-06T23:11:19.673024+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:31:28.443342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.271031+0000","last_change":"2023-10-06T23:11:18.266771+0000","last_active":"2023-10-06T23:11:18.271031+0000","last_peered":"2023-10-06T23:11:18.271031+0000","last_clean":"2023-10-06T23:11:18.271031+0000","last_became_active":"2023-10-06T23:11:18.266434+0000","last_became_peered":"2023-10-06T23:11:18.266434+0000","last_unstale":"2023-10-06T23:11:18.271031+0000","last_undegraded":"2023-10-06T23:11:18.271031+0000","last_fullsized":"2023-10-06T23:11:18.271031+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:19:40.472456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249751+0000","last_change":"2023-10-06T23:11:18.265674+0000","last_active":"2023-10-06T23:11:19.249751+0000","last_peered":"2023-10-06T23:11:19.249751+0000","last_clean":"2023-10-06T23:11:19.249751+0000","last_became_active":"2023-10-06T23:11:18.265323+0000","last_became_peered":"2023-10-06T23:11:18.265323+0000","last_unstale":"2023-10-06T23:11:19.249751+0000","last_undegraded":"2023-10-06T23:11:19.249751+0000","last_fullsized":"2023-10-06T23:11:19.249751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:15.281707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281556,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3614,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":9146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":1033534,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.623}]},{"osd":6,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.196},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.397}]},{"osd":7,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.70799999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.466}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":423713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.377},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.502},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.65700000000000003}]},{"osd":4,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.747}]},{"osd":7,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.68999999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.97499999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:10:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.80700000000000005}]}]},{"osd":8,"up_from":60,"seq":257698037790,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":441633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73999999999999999,"15min":0.75900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89000000000000001,"5min":1.383,"15min":1.383},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.5,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92100000000000004,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1870000000000001,"5min":1.272,"15min":1.272},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.76700000000000002,"15min":0.79400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88600000000000001,"5min":1.351,"15min":1.351},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.72299999999999998,"15min":0.751},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84499999999999997,"5min":1.248,"15min":1.248},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.75700000000000001,"15min":0.78600000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98199999999999998,"5min":1.05,"15min":1.05},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.298,"5min":1.327,"15min":1.327},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.92900000000000005,"15min":0.95899999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1379999999999999,"5min":1.343,"15min":1.343},"last":0.749}]},{"osd":7,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91000000000000003,"15min":0.92800000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1060000000000001,"5min":1.399,"15min":1.399},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.90300000000000002,"15min":0.92500000000000004},"min":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.61499999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92100000000000004}]},{"osd":10,"last update":"Fri Oct 6 23:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.86199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":1023409,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93700000000000006,"5min":1.04,"15min":1.04},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.093,"5min":1.329,"15min":1.329},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":1.149,"15min":1.149},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97699999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.432},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93700000000000006,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.93700000000000006,"5min":1.244,"15min":1.244},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.69799999999999995,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0509999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81499999999999995,"15min":0.80800000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.127,"5min":1.26,"15min":1.26},"last":0.79200000000000004}]},{"osd":8,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0049999999999999,"5min":1.02,"15min":1.02},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.64100000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.167},"last":0.81499999999999995}]},{"osd":9,"last update":"Fri Oct 6 23:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.755}]},{"osd":10,"last update":"Fri Oct 6 23:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66900000000000004}]}]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":423713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46300000000000002,"15min":0.443},"min":{"1min":0.39900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71099999999999997,"15min":0.68799999999999994},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.109,"15min":1.109},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69699999999999995,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98599999999999999,"5min":1.01,"15min":1.01},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94799999999999995,"5min":1.054,"15min":1.054},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42999999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82599999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.628,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1299999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94699999999999995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.79500000000000004},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1299999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 23:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80600000000000005,"15min":0.80400000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1819999999999999,"5min":1.24,"15min":1.24},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.74199999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.198,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.83699999999999997}]},{"osd":8,"last update":"Fri Oct 6 23:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.85999999999999999,"15min":0.84399999999999997},"min":{"1min":0.69399999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1559999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.753},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.78600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1459999999999999,"5min":1.222,"15min":1.222},"last":0.77000000000000002}]},{"osd":9,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82599999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.79900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":442972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61499999999999999,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Oct 6 23:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":1.141},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.67200000000000004,"15min":0.66400000000000003},"min":{"1min":0.49199999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":0.93899999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.94799999999999995}]},{"osd":4,"last update":"Fri Oct 6 23:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Oct 6 23:10:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46999999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.196},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.60199999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":1.026}]},{"osd":6,"last update":"Fri Oct 6 23:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.006}]},{"osd":7,"last update":"Fri Oct 6 23:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":1.492},{"interface":"front","average":{"1min":0.751,"5min":0.70999999999999996,"15min":0.70299999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.4139999999999999}]},{"osd":8,"last update":"Fri Oct 6 23:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.68799999999999994,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.3280000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.109},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":1.258}]},{"osd":10,"last update":"Fri Oct 6 23:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.3600000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.4390000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":441450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 23:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.028,"5min":1.091,"15min":1.091},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47699999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.87},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Oct 6 23:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99099999999999999,"5min":0.995,"15min":0.995},"last":0.754},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66600000000000004,"15min":0.63500000000000001},"min":{"1min":0.45400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.998,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Oct 6 23:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":1.02,"15min":1.02},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90300000000000002,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.073,"5min":1.085,"15min":1.085},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.75700000000000001,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1259999999999999,"5min":1.226,"15min":1.226},"last":0.92100000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.59699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.81399999999999995,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70299999999999996}]},{"osd":8,"last update":"Fri Oct 6 23:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.63100000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1220000000000001,"5min":1.296,"15min":1.296},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.55300000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.1299999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.071},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.84899999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:10:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.202}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":443006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0009999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.45700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1319999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.81699999999999995}]},{"osd":1,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.438,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.012,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2430000000000001,"5min":1.746,"15min":1.746},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.44800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.454,"15min":1.454},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71099999999999997,"15min":0.69499999999999995},"min":{"1min":0.51500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3700000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 23:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.96199999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91500000000000004,"5min":1.53,"15min":1.53},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Oct 6 23:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.38500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.46999999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.72799999999999998,"15min":0.69399999999999995},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.03,"5min":1.169,"15min":1.169},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.59899999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.018,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 23:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.54400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75}]},{"osd":8,"last update":"Fri Oct 6 23:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.095,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0800000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.57499999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.60599999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":432563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.432,"15min":0.39100000000000001},"min":{"1min":0.34100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.437,"15min":0.40500000000000003},"min":{"1min":0.36299999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68799999999999994,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.65100000000000002,"15min":0.627},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.68600000000000005,"15min":0.66300000000000003},"min":{"1min":0.55500000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.47999999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":1.155,"15min":1.155},"last":0.624},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68300000000000005,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.042,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":1.048}]},{"osd":4,"last update":"Fri Oct 6 23:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.68999999999999995,"15min":0.64900000000000002},"min":{"1min":0.51800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.202,"15min":1.202},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.68899999999999995,"15min":0.66300000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.048,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.745,"15min":0.72399999999999998},"min":{"1min":0.59699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0860000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.748,"15min":0.71499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67900000000000005,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Oct 6 23:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82499999999999996,"15min":0.82299999999999995},"min":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.079,"5min":1.103,"15min":1.103},"last":0.94599999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.66900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.008,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0009999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.028},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":1.133}]},{"osd":10,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.875},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.0680000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":441382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.45600000000000002},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.44900000000000001},"min":{"1min":0.34499999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.437}]},{"osd":2,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80800000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.66400000000000003,"15min":0.64600000000000002},"min":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.67000000000000004,"15min":0.628},"min":{"1min":0.58399999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.55600000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71099999999999997,"15min":0.69499999999999995},"min":{"1min":0.47099999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77700000000000002,"15min":0.753},"min":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0449999999999999,"5min":1.161,"15min":1.161},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.78200000000000003,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.54200000000000004}]},{"osd":8,"last update":"Fri Oct 6 23:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.68999999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.86299999999999999,"15min":0.84499999999999997},"min":{"1min":0.66800000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1719999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.76000000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.64200000000000002}]},{"osd":10,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.627},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":5,"up_from":39,"seq":167503724589,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":1032873,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.032,"5min":1.153,"15min":1.153},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.0169999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.36299999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.79600000000000004,"5min":0.879,"15min":0.879},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94099999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.57499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91600000000000004,"5min":1.143,"15min":1.143},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.46100000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.077,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Oct 6 23:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.59599999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.871},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.85799999999999998}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97399999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.755},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.89300000000000002}]},{"osd":9,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.93000000000000005}]},{"osd":10,"last update":"Fri Oct 6 23:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.94799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T23:11:24.682 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T23:11:24.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:24 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4267064857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:11:24.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:24 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1940433083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:24.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 -- 172.21.15.8:0/2590215185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c102080 msgr2=0x7f6d3c102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2590215185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c102080 0x7f6d3c102500 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009990 tx=0x7f6d2c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 -- 172.21.15.8:0/2590215185 shutdown_connections 2023-10-06T23:11:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2590215185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d3c102a40 0x7f6d3c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2590215185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d3c100ea0 0x7f6d3c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2590215185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c102080 0x7f6d3c102500 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 -- 172.21.15.8:0/2590215185 >> 172.21.15.8:0/2590215185 conn(0x7f6d3c0fc420 msgr2=0x7f6d3c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 -- 172.21.15.8:0/2590215185 shutdown_connections 2023-10-06T23:11:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.915+0000 7f6d443ff700 1 -- 172.21.15.8:0/2590215185 wait complete. 2023-10-06T23:11:24.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.917+0000 7f6d443ff700 1 Processor -- start 2023-10-06T23:11:24.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.917+0000 7f6d443ff700 1 -- start start 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.917+0000 7f6d443ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c100ea0 0x7f6d3c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.917+0000 7f6d443ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d3c102080 0x7f6d3c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.917+0000 7f6d443ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d3c102a40 0x7f6d3c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.917+0000 7f6d443ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c19e6e0 con 0x7f6d3c100ea0 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.917+0000 7f6d443ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c19e820 con 0x7f6d3c102a40 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.917+0000 7f6d443ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c19e9b0 con 0x7f6d3c102080 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c100ea0 0x7f6d3c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c100ea0 0x7f6d3c196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57200/0 (socket says 172.21.15.8:57200) 2023-10-06T23:11:24.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 -- 172.21.15.8:0/2372398323 learned_addr learned my addr 172.21.15.8:0/2372398323 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4299c700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d3c102a40 0x7f6d3c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4199a700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d3c102080 0x7f6d3c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 -- 172.21.15.8:0/2372398323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d3c102080 msgr2=0x7f6d3c1970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d3c102080 0x7f6d3c1970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 -- 172.21.15.8:0/2372398323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d3c102a40 msgr2=0x7f6d3c19e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d3c102a40 0x7f6d3c19e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 -- 172.21.15.8:0/2372398323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0095f0 con 0x7f6d3c100ea0 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.918+0000 7f6d4219b700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c100ea0 0x7f6d3c196b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800d980 tx=0x7f6d3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.919+0000 7f6d337fe700 1 -- 172.21.15.8:0/2372398323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38004020 con 0x7f6d3c100ea0 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.919+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c19ec90 con 0x7f6d3c100ea0 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.919+0000 7f6d337fe700 1 -- 172.21.15.8:0/2372398323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d38009730 con 0x7f6d3c100ea0 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.919+0000 7f6d337fe700 1 -- 172.21.15.8:0/2372398323 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d380039c0 con 0x7f6d3c100ea0 2023-10-06T23:11:24.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.919+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c19f1a0 con 0x7f6d3c100ea0 2023-10-06T23:11:24.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.920+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c10c610 con 0x7f6d3c100ea0 2023-10-06T23:11:24.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.922+0000 7f6d337fe700 1 -- 172.21.15.8:0/2372398323 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6d380098a0 con 0x7f6d3c100ea0 2023-10-06T23:11:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.923+0000 7f6d337fe700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6d280a14d0 0x7f6d280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.923+0000 7f6d337fe700 1 -- 172.21.15.8:0/2372398323 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6d380cc8a0 con 0x7f6d3c100ea0 2023-10-06T23:11:24.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.923+0000 7f6d4199a700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6d280a14d0 0x7f6d280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:24.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.924+0000 7f6d4199a700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6d280a14d0 0x7f6d280a3990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00b5c0 tx=0x7f6d2c005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:24.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:24.927+0000 7f6d337fe700 1 -- 172.21.15.8:0/2372398323 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6d38096050 con 0x7f6d3c100ea0 2023-10-06T23:11:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.134+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d3c0612f0 con 0x7f6d280a14d0 2023-10-06T23:11:25.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.144+0000 7f6d337fe700 1 -- 172.21.15.8:0/2372398323 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334119 (secure 0 0 0) 0x7f6d3c0612f0 con 0x7f6d280a14d0 2023-10-06T23:11:25.150 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:25.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6d280a14d0 msgr2=0x7f6d280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:25.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6d280a14d0 0x7f6d280a3990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00b5c0 tx=0x7f6d2c005fb0 comp rx=0 tx=0).stop 2023-10-06T23:11:25.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c100ea0 msgr2=0x7f6d3c196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:25.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c100ea0 0x7f6d3c196b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800d980 tx=0x7f6d3800dc90 comp rx=0 tx=0).stop 2023-10-06T23:11:25.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 shutdown_connections 2023-10-06T23:11:25.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6d280a14d0 0x7f6d280a3990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:25.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d3c100ea0 0x7f6d3c196b60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:25.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d3c102a40 0x7f6d3c19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:25.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 --2- 172.21.15.8:0/2372398323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d3c102080 0x7f6d3c1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:25.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.149+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 >> 172.21.15.8:0/2372398323 conn(0x7f6d3c0fc420 msgr2=0x7f6d3c0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:25.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.150+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 shutdown_connections 2023-10-06T23:11:25.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:25.150+0000 7f6d443ff700 1 -- 172.21.15.8:0/2372398323 wait complete. 2023-10-06T23:11:25.154 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T23:11:25.169 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-10-06T23:11:24.943664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594162,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":133,"num_read_kb":115,"num_write":264,"num_write_kb":2957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":266,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335328,"kb_used_data":11080,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606496,"statfs":{"total":1151940427776,"available":1151597051904,"internally_reserved":0,"allocated":11345920,"data_stored":7076340,"data_compressed":107433,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3794,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.704584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250074+0000","last_change":"2023-10-06T23:11:18.264036+0000","last_active":"2023-10-06T23:11:19.250074+0000","last_peered":"2023-10-06T23:11:19.250074+0000","last_clean":"2023-10-06T23:11:19.250074+0000","last_became_active":"2023-10-06T23:11:18.261784+0000","last_became_peered":"2023-10-06T23:11:18.261784+0000","last_unstale":"2023-10-06T23:11:19.250074+0000","last_undegraded":"2023-10-06T23:11:19.250074+0000","last_fullsized":"2023-10-06T23:11:19.250074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:57.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.407006+0000","last_change":"2023-10-06T23:11:18.265181+0000","last_active":"2023-10-06T23:11:19.407006+0000","last_peered":"2023-10-06T23:11:19.407006+0000","last_clean":"2023-10-06T23:11:19.407006+0000","last_became_active":"2023-10-06T23:11:18.264881+0000","last_became_peered":"2023-10-06T23:11:18.264881+0000","last_unstale":"2023-10-06T23:11:19.407006+0000","last_undegraded":"2023-10-06T23:11:19.407006+0000","last_fullsized":"2023-10-06T23:11:19.407006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:17.852643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406952+0000","last_change":"2023-10-06T23:11:18.264321+0000","last_active":"2023-10-06T23:11:19.406952+0000","last_peered":"2023-10-06T23:11:19.406952+0000","last_clean":"2023-10-06T23:11:19.406952+0000","last_became_active":"2023-10-06T23:11:18.263997+0000","last_became_peered":"2023-10-06T23:11:18.263997+0000","last_unstale":"2023-10-06T23:11:19.406952+0000","last_undegraded":"2023-10-06T23:11:19.406952+0000","last_fullsized":"2023-10-06T23:11:19.406952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:41.888419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778118+0000","last_change":"2023-10-06T23:11:18.270871+0000","last_active":"2023-10-06T23:11:19.778118+0000","last_peered":"2023-10-06T23:11:19.778118+0000","last_clean":"2023-10-06T23:11:19.778118+0000","last_became_active":"2023-10-06T23:11:18.270288+0000","last_became_peered":"2023-10-06T23:11:18.270288+0000","last_unstale":"2023-10-06T23:11:19.778118+0000","last_undegraded":"2023-10-06T23:11:19.778118+0000","last_fullsized":"2023-10-06T23:11:19.778118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:02:48.819640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342180+0000","last_change":"2023-10-06T23:11:18.261001+0000","last_active":"2023-10-06T23:11:19.342180+0000","last_peered":"2023-10-06T23:11:19.342180+0000","last_clean":"2023-10-06T23:11:19.342180+0000","last_became_active":"2023-10-06T23:11:18.260661+0000","last_became_peered":"2023-10-06T23:11:18.260661+0000","last_unstale":"2023-10-06T23:11:19.342180+0000","last_undegraded":"2023-10-06T23:11:19.342180+0000","last_fullsized":"2023-10-06T23:11:19.342180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:42.382235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777663+0000","last_change":"2023-10-06T23:11:18.263613+0000","last_active":"2023-10-06T23:11:19.777663+0000","last_peered":"2023-10-06T23:11:19.777663+0000","last_clean":"2023-10-06T23:11:19.777663+0000","last_became_active":"2023-10-06T23:11:18.263304+0000","last_became_peered":"2023-10-06T23:11:18.263304+0000","last_unstale":"2023-10-06T23:11:19.777663+0000","last_undegraded":"2023-10-06T23:11:19.777663+0000","last_fullsized":"2023-10-06T23:11:19.777663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:20:12.108788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673108+0000","last_change":"2023-10-06T23:11:18.263968+0000","last_active":"2023-10-06T23:11:19.673108+0000","last_peered":"2023-10-06T23:11:19.673108+0000","last_clean":"2023-10-06T23:11:19.673108+0000","last_became_active":"2023-10-06T23:11:18.263634+0000","last_became_peered":"2023-10-06T23:11:18.263634+0000","last_unstale":"2023-10-06T23:11:19.673108+0000","last_undegraded":"2023-10-06T23:11:19.673108+0000","last_fullsized":"2023-10-06T23:11:19.673108+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:18:23.856232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249697+0000","last_change":"2023-10-06T23:11:18.268945+0000","last_active":"2023-10-06T23:11:19.249697+0000","last_peered":"2023-10-06T23:11:19.249697+0000","last_clean":"2023-10-06T23:11:19.249697+0000","last_became_active":"2023-10-06T23:11:18.268598+0000","last_became_peered":"2023-10-06T23:11:18.268598+0000","last_unstale":"2023-10-06T23:11:19.249697+0000","last_undegraded":"2023-10-06T23:11:19.249697+0000","last_fullsized":"2023-10-06T23:11:19.249697+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:09:21.238230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673233+0000","last_change":"2023-10-06T23:11:18.261872+0000","last_active":"2023-10-06T23:11:19.673233+0000","last_peered":"2023-10-06T23:11:19.673233+0000","last_clean":"2023-10-06T23:11:19.673233+0000","last_became_active":"2023-10-06T23:11:18.261583+0000","last_became_peered":"2023-10-06T23:11:18.261583+0000","last_unstale":"2023-10-06T23:11:19.673233+0000","last_undegraded":"2023-10-06T23:11:19.673233+0000","last_fullsized":"2023-10-06T23:11:19.673233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:50:54.145738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778263+0000","last_change":"2023-10-06T23:11:18.263675+0000","last_active":"2023-10-06T23:11:19.778263+0000","last_peered":"2023-10-06T23:11:19.778263+0000","last_clean":"2023-10-06T23:11:19.778263+0000","last_became_active":"2023-10-06T23:11:18.263389+0000","last_became_peered":"2023-10-06T23:11:18.263389+0000","last_unstale":"2023-10-06T23:11:19.778263+0000","last_undegraded":"2023-10-06T23:11:19.778263+0000","last_fullsized":"2023-10-06T23:11:19.778263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:03:36.466351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673465+0000","last_change":"2023-10-06T23:11:18.266565+0000","last_active":"2023-10-06T23:11:19.673465+0000","last_peered":"2023-10-06T23:11:19.673465+0000","last_clean":"2023-10-06T23:11:19.673465+0000","last_became_active":"2023-10-06T23:11:18.266290+0000","last_became_peered":"2023-10-06T23:11:18.266290+0000","last_unstale":"2023-10-06T23:11:19.673465+0000","last_undegraded":"2023-10-06T23:11:19.673465+0000","last_fullsized":"2023-10-06T23:11:19.673465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:45:07.828100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778093+0000","last_change":"2023-10-06T23:11:18.266849+0000","last_active":"2023-10-06T23:11:19.778093+0000","last_peered":"2023-10-06T23:11:19.778093+0000","last_clean":"2023-10-06T23:11:19.778093+0000","last_became_active":"2023-10-06T23:11:18.266517+0000","last_became_peered":"2023-10-06T23:11:18.266517+0000","last_unstale":"2023-10-06T23:11:19.778093+0000","last_undegraded":"2023-10-06T23:11:19.778093+0000","last_fullsized":"2023-10-06T23:11:19.778093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:25:31.988065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249807+0000","last_change":"2023-10-06T23:11:18.270336+0000","last_active":"2023-10-06T23:11:19.249807+0000","last_peered":"2023-10-06T23:11:19.249807+0000","last_clean":"2023-10-06T23:11:19.249807+0000","last_became_active":"2023-10-06T23:11:18.269969+0000","last_became_peered":"2023-10-06T23:11:18.269969+0000","last_unstale":"2023-10-06T23:11:19.249807+0000","last_undegraded":"2023-10-06T23:11:19.249807+0000","last_fullsized":"2023-10-06T23:11:19.249807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:25.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406618+0000","last_change":"2023-10-06T23:11:18.264549+0000","last_active":"2023-10-06T23:11:19.406618+0000","last_peered":"2023-10-06T23:11:19.406618+0000","last_clean":"2023-10-06T23:11:19.406618+0000","last_became_active":"2023-10-06T23:11:18.263446+0000","last_became_peered":"2023-10-06T23:11:18.263446+0000","last_unstale":"2023-10-06T23:11:19.406618+0000","last_undegraded":"2023-10-06T23:11:19.406618+0000","last_fullsized":"2023-10-06T23:11:19.406618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:21:57.009374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406480+0000","last_change":"2023-10-06T23:11:18.262470+0000","last_active":"2023-10-06T23:11:19.406480+0000","last_peered":"2023-10-06T23:11:19.406480+0000","last_clean":"2023-10-06T23:11:19.406480+0000","last_became_active":"2023-10-06T23:11:18.262134+0000","last_became_peered":"2023-10-06T23:11:18.262134+0000","last_unstale":"2023-10-06T23:11:19.406480+0000","last_undegraded":"2023-10-06T23:11:19.406480+0000","last_fullsized":"2023-10-06T23:11:19.406480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:09:26.745107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.672722+0000","last_change":"2023-10-06T23:11:18.260657+0000","last_active":"2023-10-06T23:11:19.672722+0000","last_peered":"2023-10-06T23:11:19.672722+0000","last_clean":"2023-10-06T23:11:19.672722+0000","last_became_active":"2023-10-06T23:11:18.260343+0000","last_became_peered":"2023-10-06T23:11:18.260343+0000","last_unstale":"2023-10-06T23:11:19.672722+0000","last_undegraded":"2023-10-06T23:11:19.672722+0000","last_fullsized":"2023-10-06T23:11:19.672722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:46:24.199333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250179+0000","last_change":"2023-10-06T23:11:18.262071+0000","last_active":"2023-10-06T23:11:19.250179+0000","last_peered":"2023-10-06T23:11:19.250179+0000","last_clean":"2023-10-06T23:11:19.250179+0000","last_became_active":"2023-10-06T23:11:18.261348+0000","last_became_peered":"2023-10-06T23:11:18.261348+0000","last_unstale":"2023-10-06T23:11:19.250179+0000","last_undegraded":"2023-10-06T23:11:19.250179+0000","last_fullsized":"2023-10-06T23:11:19.250179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:57:54.957156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777717+0000","last_change":"2023-10-06T23:11:18.266593+0000","last_active":"2023-10-06T23:11:19.777717+0000","last_peered":"2023-10-06T23:11:19.777717+0000","last_clean":"2023-10-06T23:11:19.777717+0000","last_became_active":"2023-10-06T23:11:18.266293+0000","last_became_peered":"2023-10-06T23:11:18.266293+0000","last_unstale":"2023-10-06T23:11:19.777717+0000","last_undegraded":"2023-10-06T23:11:19.777717+0000","last_fullsized":"2023-10-06T23:11:19.777717+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:03:45.130437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777587+0000","last_change":"2023-10-06T23:11:18.264871+0000","last_active":"2023-10-06T23:11:19.777587+0000","last_peered":"2023-10-06T23:11:19.777587+0000","last_clean":"2023-10-06T23:11:19.777587+0000","last_became_active":"2023-10-06T23:11:18.264451+0000","last_became_peered":"2023-10-06T23:11:18.264451+0000","last_unstale":"2023-10-06T23:11:19.777587+0000","last_undegraded":"2023-10-06T23:11:19.777587+0000","last_fullsized":"2023-10-06T23:11:19.777587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:40:00.581508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:22.253607+0000","last_change":"2023-10-06T23:11:17.255867+0000","last_active":"2023-10-06T23:11:22.253607+0000","last_peered":"2023-10-06T23:11:22.253607+0000","last_clean":"2023-10-06T23:11:22.253607+0000","last_became_active":"2023-10-06T23:11:17.255463+0000","last_became_peered":"2023-10-06T23:11:17.255463+0000","last_unstale":"2023-10-06T23:11:22.253607+0000","last_undegraded":"2023-10-06T23:11:22.253607+0000","last_fullsized":"2023-10-06T23:11:22.253607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:21:29.493049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250293+0000","last_change":"2023-10-06T23:11:18.262575+0000","last_active":"2023-10-06T23:11:19.250293+0000","last_peered":"2023-10-06T23:11:19.250293+0000","last_clean":"2023-10-06T23:11:19.250293+0000","last_became_active":"2023-10-06T23:11:18.262266+0000","last_became_peered":"2023-10-06T23:11:18.262266+0000","last_unstale":"2023-10-06T23:11:19.250293+0000","last_undegraded":"2023-10-06T23:11:19.250293+0000","last_fullsized":"2023-10-06T23:11:19.250293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:37:10.870786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250487+0000","last_change":"2023-10-06T23:11:17.259061+0000","last_active":"2023-10-06T23:11:19.250487+0000","last_peered":"2023-10-06T23:11:19.250487+0000","last_clean":"2023-10-06T23:11:19.250487+0000","last_became_active":"2023-10-06T23:11:17.258624+0000","last_became_peered":"2023-10-06T23:11:17.258624+0000","last_unstale":"2023-10-06T23:11:19.250487+0000","last_undegraded":"2023-10-06T23:11:19.250487+0000","last_fullsized":"2023-10-06T23:11:19.250487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:28.121405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406866+0000","last_change":"2023-10-06T23:11:18.263840+0000","last_active":"2023-10-06T23:11:19.406866+0000","last_peered":"2023-10-06T23:11:19.406866+0000","last_clean":"2023-10-06T23:11:19.406866+0000","last_became_active":"2023-10-06T23:11:18.263454+0000","last_became_peered":"2023-10-06T23:11:18.263454+0000","last_unstale":"2023-10-06T23:11:19.406866+0000","last_undegraded":"2023-10-06T23:11:19.406866+0000","last_fullsized":"2023-10-06T23:11:19.406866+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:49.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342603+0000","last_change":"2023-10-06T23:11:17.259742+0000","last_active":"2023-10-06T23:11:19.342603+0000","last_peered":"2023-10-06T23:11:19.342603+0000","last_clean":"2023-10-06T23:11:19.342603+0000","last_became_active":"2023-10-06T23:11:17.259109+0000","last_became_peered":"2023-10-06T23:11:17.259109+0000","last_unstale":"2023-10-06T23:11:19.342603+0000","last_undegraded":"2023-10-06T23:11:19.342603+0000","last_fullsized":"2023-10-06T23:11:19.342603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:18:04.695629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.672828+0000","last_change":"2023-10-06T23:11:18.274068+0000","last_active":"2023-10-06T23:11:19.672828+0000","last_peered":"2023-10-06T23:11:19.672828+0000","last_clean":"2023-10-06T23:11:19.672828+0000","last_became_active":"2023-10-06T23:11:18.273692+0000","last_became_peered":"2023-10-06T23:11:18.273692+0000","last_unstale":"2023-10-06T23:11:19.672828+0000","last_undegraded":"2023-10-06T23:11:19.672828+0000","last_fullsized":"2023-10-06T23:11:19.672828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:57:07.735915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342496+0000","last_change":"2023-10-06T23:11:17.260046+0000","last_active":"2023-10-06T23:11:19.342496+0000","last_peered":"2023-10-06T23:11:19.342496+0000","last_clean":"2023-10-06T23:11:19.342496+0000","last_became_active":"2023-10-06T23:11:17.259638+0000","last_became_peered":"2023-10-06T23:11:17.259638+0000","last_unstale":"2023-10-06T23:11:19.342496+0000","last_undegraded":"2023-10-06T23:11:19.342496+0000","last_fullsized":"2023-10-06T23:11:19.342496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:21.660072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778137+0000","last_change":"2023-10-06T23:11:18.264328+0000","last_active":"2023-10-06T23:11:19.778137+0000","last_peered":"2023-10-06T23:11:19.778137+0000","last_clean":"2023-10-06T23:11:19.778137+0000","last_became_active":"2023-10-06T23:11:18.263554+0000","last_became_peered":"2023-10-06T23:11:18.263554+0000","last_unstale":"2023-10-06T23:11:19.778137+0000","last_undegraded":"2023-10-06T23:11:19.778137+0000","last_fullsized":"2023-10-06T23:11:19.778137+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:44:02.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:22.244310+0000","last_change":"2023-10-06T23:11:17.265538+0000","last_active":"2023-10-06T23:11:22.244310+0000","last_peered":"2023-10-06T23:11:22.244310+0000","last_clean":"2023-10-06T23:11:22.244310+0000","last_became_active":"2023-10-06T23:11:17.265044+0000","last_became_peered":"2023-10-06T23:11:17.265044+0000","last_unstale":"2023-10-06T23:11:22.244310+0000","last_undegraded":"2023-10-06T23:11:22.244310+0000","last_fullsized":"2023-10-06T23:11:22.244310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:51.220961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342326+0000","last_change":"2023-10-06T23:11:18.257044+0000","last_active":"2023-10-06T23:11:19.342326+0000","last_peered":"2023-10-06T23:11:19.342326+0000","last_clean":"2023-10-06T23:11:19.342326+0000","last_became_active":"2023-10-06T23:11:18.256711+0000","last_became_peered":"2023-10-06T23:11:18.256711+0000","last_unstale":"2023-10-06T23:11:19.342326+0000","last_undegraded":"2023-10-06T23:11:19.342326+0000","last_fullsized":"2023-10-06T23:11:19.342326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:40:25.441143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777481+0000","last_change":"2023-10-06T23:11:17.262062+0000","last_active":"2023-10-06T23:11:19.777481+0000","last_peered":"2023-10-06T23:11:19.777481+0000","last_clean":"2023-10-06T23:11:19.777481+0000","last_became_active":"2023-10-06T23:11:17.261618+0000","last_became_peered":"2023-10-06T23:11:17.261618+0000","last_unstale":"2023-10-06T23:11:19.777481+0000","last_undegraded":"2023-10-06T23:11:19.777481+0000","last_fullsized":"2023-10-06T23:11:19.777481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:59:33.544470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778132+0000","last_change":"2023-10-06T23:11:18.263242+0000","last_active":"2023-10-06T23:11:19.778132+0000","last_peered":"2023-10-06T23:11:19.778132+0000","last_clean":"2023-10-06T23:11:19.778132+0000","last_became_active":"2023-10-06T23:11:18.262684+0000","last_became_peered":"2023-10-06T23:11:18.262684+0000","last_unstale":"2023-10-06T23:11:19.778132+0000","last_undegraded":"2023-10-06T23:11:19.778132+0000","last_fullsized":"2023-10-06T23:11:19.778132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:30:04.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:22.252843+0000","last_change":"2023-10-06T23:11:17.254042+0000","last_active":"2023-10-06T23:11:22.252843+0000","last_peered":"2023-10-06T23:11:22.252843+0000","last_clean":"2023-10-06T23:11:22.252843+0000","last_became_active":"2023-10-06T23:11:17.253704+0000","last_became_peered":"2023-10-06T23:11:17.253704+0000","last_unstale":"2023-10-06T23:11:22.252843+0000","last_undegraded":"2023-10-06T23:11:22.252843+0000","last_fullsized":"2023-10-06T23:11:22.252843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:44.179814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249542+0000","last_change":"2023-10-06T23:11:18.259161+0000","last_active":"2023-10-06T23:11:19.249542+0000","last_peered":"2023-10-06T23:11:19.249542+0000","last_clean":"2023-10-06T23:11:19.249542+0000","last_became_active":"2023-10-06T23:11:18.258747+0000","last_became_peered":"2023-10-06T23:11:18.258747+0000","last_unstale":"2023-10-06T23:11:19.249542+0000","last_undegraded":"2023-10-06T23:11:19.249542+0000","last_fullsized":"2023-10-06T23:11:19.249542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:55:38.340988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777767+0000","last_change":"2023-10-06T23:11:17.266278+0000","last_active":"2023-10-06T23:11:19.777767+0000","last_peered":"2023-10-06T23:11:19.777767+0000","last_clean":"2023-10-06T23:11:19.777767+0000","last_became_active":"2023-10-06T23:11:17.265174+0000","last_became_peered":"2023-10-06T23:11:17.265174+0000","last_unstale":"2023-10-06T23:11:19.777767+0000","last_undegraded":"2023-10-06T23:11:19.777767+0000","last_fullsized":"2023-10-06T23:11:19.777767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:51.203566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777537+0000","last_change":"2023-10-06T23:11:18.259699+0000","last_active":"2023-10-06T23:11:19.777537+0000","last_peered":"2023-10-06T23:11:19.777537+0000","last_clean":"2023-10-06T23:11:19.777537+0000","last_became_active":"2023-10-06T23:11:18.259395+0000","last_became_peered":"2023-10-06T23:11:18.259395+0000","last_unstale":"2023-10-06T23:11:19.777537+0000","last_undegraded":"2023-10-06T23:11:19.777537+0000","last_fullsized":"2023-10-06T23:11:19.777537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:32:37.830092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777760+0000","last_change":"2023-10-06T23:11:17.259592+0000","last_active":"2023-10-06T23:11:19.777760+0000","last_peered":"2023-10-06T23:11:19.777760+0000","last_clean":"2023-10-06T23:11:19.777760+0000","last_became_active":"2023-10-06T23:11:17.259254+0000","last_became_peered":"2023-10-06T23:11:17.259254+0000","last_unstale":"2023-10-06T23:11:19.777760+0000","last_undegraded":"2023-10-06T23:11:19.777760+0000","last_fullsized":"2023-10-06T23:11:19.777760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:31.633620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673163+0000","last_change":"2023-10-06T23:11:18.271568+0000","last_active":"2023-10-06T23:11:19.673163+0000","last_peered":"2023-10-06T23:11:19.673163+0000","last_clean":"2023-10-06T23:11:19.673163+0000","last_became_active":"2023-10-06T23:11:18.271248+0000","last_became_peered":"2023-10-06T23:11:18.271248+0000","last_unstale":"2023-10-06T23:11:19.673163+0000","last_undegraded":"2023-10-06T23:11:19.673163+0000","last_fullsized":"2023-10-06T23:11:19.673163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:30.138803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.319048+0000","last_change":"2023-10-06T23:11:17.257823+0000","last_active":"2023-10-06T23:11:21.319048+0000","last_peered":"2023-10-06T23:11:21.319048+0000","last_clean":"2023-10-06T23:11:21.319048+0000","last_became_active":"2023-10-06T23:11:17.257426+0000","last_became_peered":"2023-10-06T23:11:17.257426+0000","last_unstale":"2023-10-06T23:11:21.319048+0000","last_undegraded":"2023-10-06T23:11:21.319048+0000","last_fullsized":"2023-10-06T23:11:21.319048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:27:17.158360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406831+0000","last_change":"2023-10-06T23:11:18.260555+0000","last_active":"2023-10-06T23:11:19.406831+0000","last_peered":"2023-10-06T23:11:19.406831+0000","last_clean":"2023-10-06T23:11:19.406831+0000","last_became_active":"2023-10-06T23:11:18.260236+0000","last_became_peered":"2023-10-06T23:11:18.260236+0000","last_unstale":"2023-10-06T23:11:19.406831+0000","last_undegraded":"2023-10-06T23:11:19.406831+0000","last_fullsized":"2023-10-06T23:11:19.406831+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:51.499668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.318742+0000","last_change":"2023-10-06T23:11:17.267686+0000","last_active":"2023-10-06T23:11:21.318742+0000","last_peered":"2023-10-06T23:11:21.318742+0000","last_clean":"2023-10-06T23:11:21.318742+0000","last_became_active":"2023-10-06T23:11:17.267322+0000","last_became_peered":"2023-10-06T23:11:17.267322+0000","last_unstale":"2023-10-06T23:11:21.318742+0000","last_undegraded":"2023-10-06T23:11:21.318742+0000","last_fullsized":"2023-10-06T23:11:21.318742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:48:40.755898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.672974+0000","last_change":"2023-10-06T23:11:18.257382+0000","last_active":"2023-10-06T23:11:19.672974+0000","last_peered":"2023-10-06T23:11:19.672974+0000","last_clean":"2023-10-06T23:11:19.672974+0000","last_became_active":"2023-10-06T23:11:18.256572+0000","last_became_peered":"2023-10-06T23:11:18.256572+0000","last_unstale":"2023-10-06T23:11:19.672974+0000","last_undegraded":"2023-10-06T23:11:19.672974+0000","last_fullsized":"2023-10-06T23:11:19.672974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:43.631813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777530+0000","last_change":"2023-10-06T23:11:17.257340+0000","last_active":"2023-10-06T23:11:19.777530+0000","last_peered":"2023-10-06T23:11:19.777530+0000","last_clean":"2023-10-06T23:11:19.777530+0000","last_became_active":"2023-10-06T23:11:17.256973+0000","last_became_peered":"2023-10-06T23:11:17.256973+0000","last_unstale":"2023-10-06T23:11:19.777530+0000","last_undegraded":"2023-10-06T23:11:19.777530+0000","last_fullsized":"2023-10-06T23:11:19.777530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:35.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342485+0000","last_change":"2023-10-06T23:11:18.258928+0000","last_active":"2023-10-06T23:11:19.342485+0000","last_peered":"2023-10-06T23:11:19.342485+0000","last_clean":"2023-10-06T23:11:19.342485+0000","last_became_active":"2023-10-06T23:11:18.258572+0000","last_became_peered":"2023-10-06T23:11:18.258572+0000","last_unstale":"2023-10-06T23:11:19.342485+0000","last_undegraded":"2023-10-06T23:11:19.342485+0000","last_fullsized":"2023-10-06T23:11:19.342485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:51.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.318974+0000","last_change":"2023-10-06T23:11:17.260955+0000","last_active":"2023-10-06T23:11:21.318974+0000","last_peered":"2023-10-06T23:11:21.318974+0000","last_clean":"2023-10-06T23:11:21.318974+0000","last_became_active":"2023-10-06T23:11:17.260565+0000","last_became_peered":"2023-10-06T23:11:17.260565+0000","last_unstale":"2023-10-06T23:11:21.318974+0000","last_undegraded":"2023-10-06T23:11:21.318974+0000","last_fullsized":"2023-10-06T23:11:21.318974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:14:51.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250262+0000","last_change":"2023-10-06T23:11:18.266857+0000","last_active":"2023-10-06T23:11:19.250262+0000","last_peered":"2023-10-06T23:11:19.250262+0000","last_clean":"2023-10-06T23:11:19.250262+0000","last_became_active":"2023-10-06T23:11:18.266476+0000","last_became_peered":"2023-10-06T23:11:18.266476+0000","last_unstale":"2023-10-06T23:11:19.250262+0000","last_undegraded":"2023-10-06T23:11:19.250262+0000","last_fullsized":"2023-10-06T23:11:19.250262+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:26.131492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.319711+0000","last_change":"2023-10-06T23:11:17.265672+0000","last_active":"2023-10-06T23:11:21.319711+0000","last_peered":"2023-10-06T23:11:21.319711+0000","last_clean":"2023-10-06T23:11:21.319711+0000","last_became_active":"2023-10-06T23:11:17.265329+0000","last_became_peered":"2023-10-06T23:11:17.265329+0000","last_unstale":"2023-10-06T23:11:21.319711+0000","last_undegraded":"2023-10-06T23:11:21.319711+0000","last_fullsized":"2023-10-06T23:11:21.319711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:43.159919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673541+0000","last_change":"2023-10-06T23:11:18.269427+0000","last_active":"2023-10-06T23:11:19.673541+0000","last_peered":"2023-10-06T23:11:19.673541+0000","last_clean":"2023-10-06T23:11:19.673541+0000","last_became_active":"2023-10-06T23:11:18.269115+0000","last_became_peered":"2023-10-06T23:11:18.269115+0000","last_unstale":"2023-10-06T23:11:19.673541+0000","last_undegraded":"2023-10-06T23:11:19.673541+0000","last_fullsized":"2023-10-06T23:11:19.673541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:12.598526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.253057+0000","last_change":"2023-10-06T23:11:17.252599+0000","last_active":"2023-10-06T23:11:18.253057+0000","last_peered":"2023-10-06T23:11:18.253057+0000","last_clean":"2023-10-06T23:11:18.253057+0000","last_became_active":"2023-10-06T23:11:17.251893+0000","last_became_peered":"2023-10-06T23:11:17.251893+0000","last_unstale":"2023-10-06T23:11:18.253057+0000","last_undegraded":"2023-10-06T23:11:18.253057+0000","last_fullsized":"2023-10-06T23:11:18.253057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:24:10.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673309+0000","last_change":"2023-10-06T23:11:18.269026+0000","last_active":"2023-10-06T23:11:19.673309+0000","last_peered":"2023-10-06T23:11:19.673309+0000","last_clean":"2023-10-06T23:11:19.673309+0000","last_became_active":"2023-10-06T23:11:18.268701+0000","last_became_peered":"2023-10-06T23:11:18.268701+0000","last_unstale":"2023-10-06T23:11:19.673309+0000","last_undegraded":"2023-10-06T23:11:19.673309+0000","last_fullsized":"2023-10-06T23:11:19.673309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:03:25.903664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'8","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342144+0000","last_change":"2023-10-06T23:11:17.255323+0000","last_active":"2023-10-06T23:11:19.342144+0000","last_peered":"2023-10-06T23:11:19.342144+0000","last_clean":"2023-10-06T23:11:19.342144+0000","last_became_active":"2023-10-06T23:11:17.254975+0000","last_became_peered":"2023-10-06T23:11:17.254975+0000","last_unstale":"2023-10-06T23:11:19.342144+0000","last_undegraded":"2023-10-06T23:11:19.342144+0000","last_fullsized":"2023-10-06T23:11:19.342144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:41:35.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777759+0000","last_change":"2023-10-06T23:11:18.263290+0000","last_active":"2023-10-06T23:11:19.777759+0000","last_peered":"2023-10-06T23:11:19.777759+0000","last_clean":"2023-10-06T23:11:19.777759+0000","last_became_active":"2023-10-06T23:11:18.262680+0000","last_became_peered":"2023-10-06T23:11:18.262680+0000","last_unstale":"2023-10-06T23:11:19.777759+0000","last_undegraded":"2023-10-06T23:11:19.777759+0000","last_fullsized":"2023-10-06T23:11:19.777759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:43:12.249803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342329+0000","last_change":"2023-10-06T23:11:17.258778+0000","last_active":"2023-10-06T23:11:19.342329+0000","last_peered":"2023-10-06T23:11:19.342329+0000","last_clean":"2023-10-06T23:11:19.342329+0000","last_became_active":"2023-10-06T23:11:17.258283+0000","last_became_peered":"2023-10-06T23:11:17.258283+0000","last_unstale":"2023-10-06T23:11:19.342329+0000","last_undegraded":"2023-10-06T23:11:19.342329+0000","last_fullsized":"2023-10-06T23:11:19.342329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:19:06.107491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250005+0000","last_change":"2023-10-06T23:11:18.263844+0000","last_active":"2023-10-06T23:11:19.250005+0000","last_peered":"2023-10-06T23:11:19.250005+0000","last_clean":"2023-10-06T23:11:19.250005+0000","last_became_active":"2023-10-06T23:11:18.260856+0000","last_became_peered":"2023-10-06T23:11:18.260856+0000","last_unstale":"2023-10-06T23:11:19.250005+0000","last_undegraded":"2023-10-06T23:11:19.250005+0000","last_fullsized":"2023-10-06T23:11:19.250005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:35:45.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.409763+0000","last_change":"2023-10-06T23:11:17.258175+0000","last_active":"2023-10-06T23:11:18.409763+0000","last_peered":"2023-10-06T23:11:18.409763+0000","last_clean":"2023-10-06T23:11:18.409763+0000","last_became_active":"2023-10-06T23:11:17.257780+0000","last_became_peered":"2023-10-06T23:11:17.257780+0000","last_unstale":"2023-10-06T23:11:18.409763+0000","last_undegraded":"2023-10-06T23:11:18.409763+0000","last_fullsized":"2023-10-06T23:11:18.409763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:19:51.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777705+0000","last_change":"2023-10-06T23:11:18.267837+0000","last_active":"2023-10-06T23:11:19.777705+0000","last_peered":"2023-10-06T23:11:19.777705+0000","last_clean":"2023-10-06T23:11:19.777705+0000","last_became_active":"2023-10-06T23:11:18.267535+0000","last_became_peered":"2023-10-06T23:11:18.267535+0000","last_unstale":"2023-10-06T23:11:19.777705+0000","last_undegraded":"2023-10-06T23:11:19.777705+0000","last_fullsized":"2023-10-06T23:11:19.777705+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:08.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673194+0000","last_change":"2023-10-06T23:11:17.261075+0000","last_active":"2023-10-06T23:11:19.673194+0000","last_peered":"2023-10-06T23:11:19.673194+0000","last_clean":"2023-10-06T23:11:19.673194+0000","last_became_active":"2023-10-06T23:11:17.260456+0000","last_became_peered":"2023-10-06T23:11:17.260456+0000","last_unstale":"2023-10-06T23:11:19.673194+0000","last_undegraded":"2023-10-06T23:11:19.673194+0000","last_fullsized":"2023-10-06T23:11:19.673194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:00:25.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778082+0000","last_change":"2023-10-06T23:11:18.265347+0000","last_active":"2023-10-06T23:11:19.778082+0000","last_peered":"2023-10-06T23:11:19.778082+0000","last_clean":"2023-10-06T23:11:19.778082+0000","last_became_active":"2023-10-06T23:11:18.265034+0000","last_became_peered":"2023-10-06T23:11:18.265034+0000","last_unstale":"2023-10-06T23:11:19.778082+0000","last_undegraded":"2023-10-06T23:11:19.778082+0000","last_fullsized":"2023-10-06T23:11:19.778082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:32:44.253022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778183+0000","last_change":"2023-10-06T23:11:18.263990+0000","last_active":"2023-10-06T23:11:19.778183+0000","last_peered":"2023-10-06T23:11:19.778183+0000","last_clean":"2023-10-06T23:11:19.778183+0000","last_became_active":"2023-10-06T23:11:18.262760+0000","last_became_peered":"2023-10-06T23:11:18.262760+0000","last_unstale":"2023-10-06T23:11:19.778183+0000","last_undegraded":"2023-10-06T23:11:19.778183+0000","last_fullsized":"2023-10-06T23:11:19.778183+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:48:51.754187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:22.253957+0000","last_change":"2023-10-06T23:11:17.263187+0000","last_active":"2023-10-06T23:11:22.253957+0000","last_peered":"2023-10-06T23:11:22.253957+0000","last_clean":"2023-10-06T23:11:22.253957+0000","last_became_active":"2023-10-06T23:11:17.262770+0000","last_became_peered":"2023-10-06T23:11:17.262770+0000","last_unstale":"2023-10-06T23:11:22.253957+0000","last_undegraded":"2023-10-06T23:11:22.253957+0000","last_fullsized":"2023-10-06T23:11:22.253957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:27.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249682+0000","last_change":"2023-10-06T23:11:18.264305+0000","last_active":"2023-10-06T23:11:19.249682+0000","last_peered":"2023-10-06T23:11:19.249682+0000","last_clean":"2023-10-06T23:11:19.249682+0000","last_became_active":"2023-10-06T23:11:18.263964+0000","last_became_peered":"2023-10-06T23:11:18.263964+0000","last_unstale":"2023-10-06T23:11:19.249682+0000","last_undegraded":"2023-10-06T23:11:19.249682+0000","last_fullsized":"2023-10-06T23:11:19.249682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:11.855254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.249100+0000","last_change":"2023-10-06T23:11:17.249832+0000","last_active":"2023-10-06T23:11:18.249100+0000","last_peered":"2023-10-06T23:11:18.249100+0000","last_clean":"2023-10-06T23:11:18.249100+0000","last_became_active":"2023-10-06T23:11:17.249425+0000","last_became_peered":"2023-10-06T23:11:17.249425+0000","last_unstale":"2023-10-06T23:11:18.249100+0000","last_undegraded":"2023-10-06T23:11:18.249100+0000","last_fullsized":"2023-10-06T23:11:18.249100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:02:49.349981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":310,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.248933+0000","last_change":"2023-10-06T23:09:57.868881+0000","last_active":"2023-10-06T23:11:18.248933+0000","last_peered":"2023-10-06T23:11:18.248933+0000","last_clean":"2023-10-06T23:11:18.248933+0000","last_became_active":"2023-10-06T23:09:57.868450+0000","last_became_peered":"2023-10-06T23:09:57.868450+0000","last_unstale":"2023-10-06T23:11:18.248933+0000","last_undegraded":"2023-10-06T23:11:18.248933+0000","last_fullsized":"2023-10-06T23:11:18.248933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_clean_scrub_stamp":"2023-10-06T23:06:23.790096+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:39:38.741355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249280+0000","last_change":"2023-10-06T23:11:18.265244+0000","last_active":"2023-10-06T23:11:19.249280+0000","last_peered":"2023-10-06T23:11:19.249280+0000","last_clean":"2023-10-06T23:11:19.249280+0000","last_became_active":"2023-10-06T23:11:18.264907+0000","last_became_peered":"2023-10-06T23:11:18.264907+0000","last_unstale":"2023-10-06T23:11:19.249280+0000","last_undegraded":"2023-10-06T23:11:19.249280+0000","last_fullsized":"2023-10-06T23:11:19.249280+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:18:21.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:22.250148+0000","last_change":"2023-10-06T23:11:17.259610+0000","last_active":"2023-10-06T23:11:22.250148+0000","last_peered":"2023-10-06T23:11:22.250148+0000","last_clean":"2023-10-06T23:11:22.250148+0000","last_became_active":"2023-10-06T23:11:17.259314+0000","last_became_peered":"2023-10-06T23:11:17.259314+0000","last_unstale":"2023-10-06T23:11:22.250148+0000","last_undegraded":"2023-10-06T23:11:22.250148+0000","last_fullsized":"2023-10-06T23:11:22.250148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:48.131199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342564+0000","last_change":"2023-10-06T23:11:17.259466+0000","last_active":"2023-10-06T23:11:19.342564+0000","last_peered":"2023-10-06T23:11:19.342564+0000","last_clean":"2023-10-06T23:11:19.342564+0000","last_became_active":"2023-10-06T23:11:17.258974+0000","last_became_peered":"2023-10-06T23:11:17.258974+0000","last_unstale":"2023-10-06T23:11:19.342564+0000","last_undegraded":"2023-10-06T23:11:19.342564+0000","last_fullsized":"2023-10-06T23:11:19.342564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:37:53.610578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249895+0000","last_change":"2023-10-06T23:11:18.259562+0000","last_active":"2023-10-06T23:11:19.249895+0000","last_peered":"2023-10-06T23:11:19.249895+0000","last_clean":"2023-10-06T23:11:19.249895+0000","last_became_active":"2023-10-06T23:11:18.259188+0000","last_became_peered":"2023-10-06T23:11:18.259188+0000","last_unstale":"2023-10-06T23:11:19.249895+0000","last_undegraded":"2023-10-06T23:11:19.249895+0000","last_fullsized":"2023-10-06T23:11:19.249895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:19.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:22.252380+0000","last_change":"2023-10-06T23:11:17.260888+0000","last_active":"2023-10-06T23:11:22.252380+0000","last_peered":"2023-10-06T23:11:22.252380+0000","last_clean":"2023-10-06T23:11:22.252380+0000","last_became_active":"2023-10-06T23:11:17.260563+0000","last_became_peered":"2023-10-06T23:11:17.260563+0000","last_unstale":"2023-10-06T23:11:22.252380+0000","last_undegraded":"2023-10-06T23:11:22.252380+0000","last_fullsized":"2023-10-06T23:11:22.252380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:43.087389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249932+0000","last_change":"2023-10-06T23:11:18.261401+0000","last_active":"2023-10-06T23:11:19.249932+0000","last_peered":"2023-10-06T23:11:19.249932+0000","last_clean":"2023-10-06T23:11:19.249932+0000","last_became_active":"2023-10-06T23:11:18.261037+0000","last_became_peered":"2023-10-06T23:11:18.261037+0000","last_unstale":"2023-10-06T23:11:19.249932+0000","last_undegraded":"2023-10-06T23:11:19.249932+0000","last_fullsized":"2023-10-06T23:11:19.249932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:53.298980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.302546+0000","last_change":"2023-10-06T23:11:17.264907+0000","last_active":"2023-10-06T23:11:18.302546+0000","last_peered":"2023-10-06T23:11:18.302546+0000","last_clean":"2023-10-06T23:11:18.302546+0000","last_became_active":"2023-10-06T23:11:17.264426+0000","last_became_peered":"2023-10-06T23:11:17.264426+0000","last_unstale":"2023-10-06T23:11:18.302546+0000","last_undegraded":"2023-10-06T23:11:18.302546+0000","last_fullsized":"2023-10-06T23:11:18.302546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:21.330048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406995+0000","last_change":"2023-10-06T23:11:18.259337+0000","last_active":"2023-10-06T23:11:19.406995+0000","last_peered":"2023-10-06T23:11:19.406995+0000","last_clean":"2023-10-06T23:11:19.406995+0000","last_became_active":"2023-10-06T23:11:18.259008+0000","last_became_peered":"2023-10-06T23:11:18.259008+0000","last_unstale":"2023-10-06T23:11:19.406995+0000","last_undegraded":"2023-10-06T23:11:19.406995+0000","last_fullsized":"2023-10-06T23:11:19.406995+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:28.845368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.320097+0000","last_change":"2023-10-06T23:11:17.267695+0000","last_active":"2023-10-06T23:11:21.320097+0000","last_peered":"2023-10-06T23:11:21.320097+0000","last_clean":"2023-10-06T23:11:21.320097+0000","last_became_active":"2023-10-06T23:11:17.267292+0000","last_became_peered":"2023-10-06T23:11:17.267292+0000","last_unstale":"2023-10-06T23:11:21.320097+0000","last_undegraded":"2023-10-06T23:11:21.320097+0000","last_fullsized":"2023-10-06T23:11:21.320097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:36:54.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342275+0000","last_change":"2023-10-06T23:11:18.260012+0000","last_active":"2023-10-06T23:11:19.342275+0000","last_peered":"2023-10-06T23:11:19.342275+0000","last_clean":"2023-10-06T23:11:19.342275+0000","last_became_active":"2023-10-06T23:11:18.259684+0000","last_became_peered":"2023-10-06T23:11:18.259684+0000","last_unstale":"2023-10-06T23:11:19.342275+0000","last_undegraded":"2023-10-06T23:11:19.342275+0000","last_fullsized":"2023-10-06T23:11:19.342275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:46:08.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:21.319587+0000","last_change":"2023-10-06T23:11:17.264262+0000","last_active":"2023-10-06T23:11:21.319587+0000","last_peered":"2023-10-06T23:11:21.319587+0000","last_clean":"2023-10-06T23:11:21.319587+0000","last_became_active":"2023-10-06T23:11:17.263922+0000","last_became_peered":"2023-10-06T23:11:17.263922+0000","last_unstale":"2023-10-06T23:11:21.319587+0000","last_undegraded":"2023-10-06T23:11:21.319587+0000","last_fullsized":"2023-10-06T23:11:21.319587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:00:14.045943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249731+0000","last_change":"2023-10-06T23:11:18.260908+0000","last_active":"2023-10-06T23:11:19.249731+0000","last_peered":"2023-10-06T23:11:19.249731+0000","last_clean":"2023-10-06T23:11:19.249731+0000","last_became_active":"2023-10-06T23:11:18.260459+0000","last_became_peered":"2023-10-06T23:11:18.260459+0000","last_unstale":"2023-10-06T23:11:19.249731+0000","last_undegraded":"2023-10-06T23:11:19.249731+0000","last_fullsized":"2023-10-06T23:11:19.249731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:51.570508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.249174+0000","last_change":"2023-10-06T23:11:17.262559+0000","last_active":"2023-10-06T23:11:18.249174+0000","last_peered":"2023-10-06T23:11:18.249174+0000","last_clean":"2023-10-06T23:11:18.249174+0000","last_became_active":"2023-10-06T23:11:17.262062+0000","last_became_peered":"2023-10-06T23:11:17.262062+0000","last_unstale":"2023-10-06T23:11:18.249174+0000","last_undegraded":"2023-10-06T23:11:18.249174+0000","last_fullsized":"2023-10-06T23:11:18.249174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:03.751385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.250108+0000","last_change":"2023-10-06T23:11:18.269813+0000","last_active":"2023-10-06T23:11:19.250108+0000","last_peered":"2023-10-06T23:11:19.250108+0000","last_clean":"2023-10-06T23:11:19.250108+0000","last_became_active":"2023-10-06T23:11:18.269506+0000","last_became_peered":"2023-10-06T23:11:18.269506+0000","last_unstale":"2023-10-06T23:11:19.250108+0000","last_undegraded":"2023-10-06T23:11:19.250108+0000","last_fullsized":"2023-10-06T23:11:19.250108+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:43:21.635237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.342275+0000","last_change":"2023-10-06T23:11:17.253040+0000","last_active":"2023-10-06T23:11:19.342275+0000","last_peered":"2023-10-06T23:11:19.342275+0000","last_clean":"2023-10-06T23:11:19.342275+0000","last_became_active":"2023-10-06T23:11:17.252596+0000","last_became_peered":"2023-10-06T23:11:17.252596+0000","last_unstale":"2023-10-06T23:11:19.342275+0000","last_undegraded":"2023-10-06T23:11:19.342275+0000","last_fullsized":"2023-10-06T23:11:19.342275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:39:30.721464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673313+0000","last_change":"2023-10-06T23:11:18.267465+0000","last_active":"2023-10-06T23:11:19.673313+0000","last_peered":"2023-10-06T23:11:19.673313+0000","last_clean":"2023-10-06T23:11:19.673313+0000","last_became_active":"2023-10-06T23:11:18.267164+0000","last_became_peered":"2023-10-06T23:11:18.267164+0000","last_unstale":"2023-10-06T23:11:19.673313+0000","last_undegraded":"2023-10-06T23:11:19.673313+0000","last_fullsized":"2023-10-06T23:11:19.673313+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:16.747117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.248351+0000","last_change":"2023-10-06T23:11:17.267653+0000","last_active":"2023-10-06T23:11:18.248351+0000","last_peered":"2023-10-06T23:11:18.248351+0000","last_clean":"2023-10-06T23:11:18.248351+0000","last_became_active":"2023-10-06T23:11:17.267264+0000","last_became_peered":"2023-10-06T23:11:17.267264+0000","last_unstale":"2023-10-06T23:11:18.248351+0000","last_undegraded":"2023-10-06T23:11:18.248351+0000","last_fullsized":"2023-10-06T23:11:18.248351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:45:57.242383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673588+0000","last_change":"2023-10-06T23:11:18.264869+0000","last_active":"2023-10-06T23:11:19.673588+0000","last_peered":"2023-10-06T23:11:19.673588+0000","last_clean":"2023-10-06T23:11:19.673588+0000","last_became_active":"2023-10-06T23:11:18.264549+0000","last_became_peered":"2023-10-06T23:11:18.264549+0000","last_unstale":"2023-10-06T23:11:19.673588+0000","last_undegraded":"2023-10-06T23:11:19.673588+0000","last_fullsized":"2023-10-06T23:11:19.673588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:00:35.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777884+0000","last_change":"2023-10-06T23:11:17.263806+0000","last_active":"2023-10-06T23:11:19.777884+0000","last_peered":"2023-10-06T23:11:19.777884+0000","last_clean":"2023-10-06T23:11:19.777884+0000","last_became_active":"2023-10-06T23:11:17.263499+0000","last_became_peered":"2023-10-06T23:11:17.263499+0000","last_unstale":"2023-10-06T23:11:19.777884+0000","last_undegraded":"2023-10-06T23:11:19.777884+0000","last_fullsized":"2023-10-06T23:11:19.777884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:26.191338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673238+0000","last_change":"2023-10-06T23:11:18.264691+0000","last_active":"2023-10-06T23:11:19.673238+0000","last_peered":"2023-10-06T23:11:19.673238+0000","last_clean":"2023-10-06T23:11:19.673238+0000","last_became_active":"2023-10-06T23:11:18.264286+0000","last_became_peered":"2023-10-06T23:11:18.264286+0000","last_unstale":"2023-10-06T23:11:19.673238+0000","last_undegraded":"2023-10-06T23:11:19.673238+0000","last_fullsized":"2023-10-06T23:11:19.673238+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:35:23.728707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-06T23:11:18.299921+0000","last_change":"2023-10-06T23:11:17.263123+0000","last_active":"2023-10-06T23:11:18.299921+0000","last_peered":"2023-10-06T23:11:18.299921+0000","last_clean":"2023-10-06T23:11:18.299921+0000","last_became_active":"2023-10-06T23:11:17.262730+0000","last_became_peered":"2023-10-06T23:11:17.262730+0000","last_unstale":"2023-10-06T23:11:18.299921+0000","last_undegraded":"2023-10-06T23:11:18.299921+0000","last_fullsized":"2023-10-06T23:11:18.299921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:43:28.145916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673440+0000","last_change":"2023-10-06T23:11:18.265822+0000","last_active":"2023-10-06T23:11:19.673440+0000","last_peered":"2023-10-06T23:11:19.673440+0000","last_clean":"2023-10-06T23:11:19.673440+0000","last_became_active":"2023-10-06T23:11:18.265457+0000","last_became_peered":"2023-10-06T23:11:18.265457+0000","last_unstale":"2023-10-06T23:11:19.673440+0000","last_undegraded":"2023-10-06T23:11:19.673440+0000","last_fullsized":"2023-10-06T23:11:19.673440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:09.132431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249793+0000","last_change":"2023-10-06T23:11:18.267305+0000","last_active":"2023-10-06T23:11:19.249793+0000","last_peered":"2023-10-06T23:11:19.249793+0000","last_clean":"2023-10-06T23:11:19.249793+0000","last_became_active":"2023-10-06T23:11:18.266975+0000","last_became_peered":"2023-10-06T23:11:18.266975+0000","last_unstale":"2023-10-06T23:11:19.249793+0000","last_undegraded":"2023-10-06T23:11:19.249793+0000","last_fullsized":"2023-10-06T23:11:19.249793+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777207+0000","last_change":"2023-10-06T23:11:18.262045+0000","last_active":"2023-10-06T23:11:19.777207+0000","last_peered":"2023-10-06T23:11:19.777207+0000","last_clean":"2023-10-06T23:11:19.777207+0000","last_became_active":"2023-10-06T23:11:18.261662+0000","last_became_peered":"2023-10-06T23:11:18.261662+0000","last_unstale":"2023-10-06T23:11:19.777207+0000","last_undegraded":"2023-10-06T23:11:19.777207+0000","last_fullsized":"2023-10-06T23:11:19.777207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:56:06.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777156+0000","last_change":"2023-10-06T23:11:18.259540+0000","last_active":"2023-10-06T23:11:19.777156+0000","last_peered":"2023-10-06T23:11:19.777156+0000","last_clean":"2023-10-06T23:11:19.777156+0000","last_became_active":"2023-10-06T23:11:18.259234+0000","last_became_peered":"2023-10-06T23:11:18.259234+0000","last_unstale":"2023-10-06T23:11:19.777156+0000","last_undegraded":"2023-10-06T23:11:19.777156+0000","last_fullsized":"2023-10-06T23:11:19.777156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:47:15.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.406699+0000","last_change":"2023-10-06T23:11:18.266295+0000","last_active":"2023-10-06T23:11:19.406699+0000","last_peered":"2023-10-06T23:11:19.406699+0000","last_clean":"2023-10-06T23:11:19.406699+0000","last_became_active":"2023-10-06T23:11:18.265991+0000","last_became_peered":"2023-10-06T23:11:18.265991+0000","last_unstale":"2023-10-06T23:11:19.406699+0000","last_undegraded":"2023-10-06T23:11:19.406699+0000","last_fullsized":"2023-10-06T23:11:19.406699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:34:43.165643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249910+0000","last_change":"2023-10-06T23:11:18.266239+0000","last_active":"2023-10-06T23:11:19.249910+0000","last_peered":"2023-10-06T23:11:19.249910+0000","last_clean":"2023-10-06T23:11:19.249910+0000","last_became_active":"2023-10-06T23:11:18.265849+0000","last_became_peered":"2023-10-06T23:11:18.265849+0000","last_unstale":"2023-10-06T23:11:19.249910+0000","last_undegraded":"2023-10-06T23:11:19.249910+0000","last_fullsized":"2023-10-06T23:11:19.249910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:47.219459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249918+0000","last_change":"2023-10-06T23:11:18.260885+0000","last_active":"2023-10-06T23:11:19.249918+0000","last_peered":"2023-10-06T23:11:19.249918+0000","last_clean":"2023-10-06T23:11:19.249918+0000","last_became_active":"2023-10-06T23:11:18.260567+0000","last_became_peered":"2023-10-06T23:11:18.260567+0000","last_unstale":"2023-10-06T23:11:19.249918+0000","last_undegraded":"2023-10-06T23:11:19.249918+0000","last_fullsized":"2023-10-06T23:11:19.249918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:36.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.778153+0000","last_change":"2023-10-06T23:11:18.257105+0000","last_active":"2023-10-06T23:11:19.778153+0000","last_peered":"2023-10-06T23:11:19.778153+0000","last_clean":"2023-10-06T23:11:19.778153+0000","last_became_active":"2023-10-06T23:11:18.256816+0000","last_became_peered":"2023-10-06T23:11:18.256816+0000","last_unstale":"2023-10-06T23:11:19.778153+0000","last_undegraded":"2023-10-06T23:11:19.778153+0000","last_fullsized":"2023-10-06T23:11:19.778153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:07.749678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249771+0000","last_change":"2023-10-06T23:11:18.260383+0000","last_active":"2023-10-06T23:11:19.249771+0000","last_peered":"2023-10-06T23:11:19.249771+0000","last_clean":"2023-10-06T23:11:19.249771+0000","last_became_active":"2023-10-06T23:11:18.260010+0000","last_became_peered":"2023-10-06T23:11:18.260010+0000","last_unstale":"2023-10-06T23:11:19.249771+0000","last_undegraded":"2023-10-06T23:11:19.249771+0000","last_fullsized":"2023-10-06T23:11:19.249771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:25.014895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.777876+0000","last_change":"2023-10-06T23:11:18.261948+0000","last_active":"2023-10-06T23:11:19.777876+0000","last_peered":"2023-10-06T23:11:19.777876+0000","last_clean":"2023-10-06T23:11:19.777876+0000","last_became_active":"2023-10-06T23:11:18.261605+0000","last_became_peered":"2023-10-06T23:11:18.261605+0000","last_unstale":"2023-10-06T23:11:19.777876+0000","last_undegraded":"2023-10-06T23:11:19.777876+0000","last_fullsized":"2023-10-06T23:11:19.777876+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:10:59.720181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249738+0000","last_change":"2023-10-06T23:11:18.261123+0000","last_active":"2023-10-06T23:11:19.249738+0000","last_peered":"2023-10-06T23:11:19.249738+0000","last_clean":"2023-10-06T23:11:19.249738+0000","last_became_active":"2023-10-06T23:11:18.260754+0000","last_became_peered":"2023-10-06T23:11:18.260754+0000","last_unstale":"2023-10-06T23:11:19.249738+0000","last_undegraded":"2023-10-06T23:11:19.249738+0000","last_fullsized":"2023-10-06T23:11:19.249738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:04:25.335790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.673024+0000","last_change":"2023-10-06T23:11:18.261021+0000","last_active":"2023-10-06T23:11:19.673024+0000","last_peered":"2023-10-06T23:11:19.673024+0000","last_clean":"2023-10-06T23:11:19.673024+0000","last_became_active":"2023-10-06T23:11:18.260613+0000","last_became_peered":"2023-10-06T23:11:18.260613+0000","last_unstale":"2023-10-06T23:11:19.673024+0000","last_undegraded":"2023-10-06T23:11:19.673024+0000","last_fullsized":"2023-10-06T23:11:19.673024+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:31:28.443342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249657+0000","last_change":"2023-10-06T23:11:18.266771+0000","last_active":"2023-10-06T23:11:19.249657+0000","last_peered":"2023-10-06T23:11:19.249657+0000","last_clean":"2023-10-06T23:11:19.249657+0000","last_became_active":"2023-10-06T23:11:18.266434+0000","last_became_peered":"2023-10-06T23:11:18.266434+0000","last_unstale":"2023-10-06T23:11:19.249657+0000","last_undegraded":"2023-10-06T23:11:19.249657+0000","last_fullsized":"2023-10-06T23:11:19.249657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:59:53.056671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-06T23:11:19.249751+0000","last_change":"2023-10-06T23:11:18.265674+0000","last_active":"2023-10-06T23:11:19.249751+0000","last_peered":"2023-10-06T23:11:19.249751+0000","last_clean":"2023-10-06T23:11:19.249751+0000","last_became_active":"2023-10-06T23:11:18.265323+0000","last_became_peered":"2023-10-06T23:11:18.265323+0000","last_unstale":"2023-10-06T23:11:19.249751+0000","last_undegraded":"2023-10-06T23:11:19.249751+0000","last_fullsized":"2023-10-06T23:11:19.249751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:15.281707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281556,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3794,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":1033534,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.623}]},{"osd":6,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.196},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.397}]},{"osd":7,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.70799999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.466}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":9,"up_from":68,"seq":292057776153,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":442178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.437}]},{"osd":4,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.149,"5min":2.149,"15min":2.149},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.73599999999999999}]},{"osd":8,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.76200000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:10:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.83199999999999996}]}]},{"osd":8,"up_from":60,"seq":257698037790,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":441633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73999999999999999,"15min":0.75900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89000000000000001,"5min":1.383,"15min":1.383},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.5,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92100000000000004,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1870000000000001,"5min":1.272,"15min":1.272},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.76700000000000002,"15min":0.79400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88600000000000001,"5min":1.351,"15min":1.351},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.72299999999999998,"15min":0.751},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84499999999999997,"5min":1.248,"15min":1.248},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.75700000000000001,"15min":0.78600000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98199999999999998,"5min":1.05,"15min":1.05},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.298,"5min":1.327,"15min":1.327},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.92900000000000005,"15min":0.95899999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1379999999999999,"5min":1.343,"15min":1.343},"last":0.749}]},{"osd":7,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.91000000000000003,"15min":0.92800000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1060000000000001,"5min":1.399,"15min":1.399},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.90300000000000002,"15min":0.92500000000000004},"min":{"1min":0.59899999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.61499999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92100000000000004}]},{"osd":10,"last update":"Fri Oct 6 23:10:55 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.86199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":1033189,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93700000000000006,"5min":1.04,"15min":1.04},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.093,"5min":1.329,"15min":1.329},"last":0.623},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":1.149,"15min":1.149},"last":0.64000000000000001}]},{"osd":4,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97699999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93700000000000006,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.93700000000000006,"5min":1.244,"15min":1.244},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.69799999999999995,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0509999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81499999999999995,"15min":0.80800000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.127,"5min":1.26,"15min":1.26},"last":0.80300000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:11:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0049999999999999,"5min":1.02,"15min":1.02},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.64100000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0509999999999999,"5min":1.167,"15min":1.167},"last":0.83699999999999997}]},{"osd":9,"last update":"Fri Oct 6 23:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.748}]},{"osd":10,"last update":"Fri Oct 6 23:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.87},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.77000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":6,"up_from":47,"seq":201863462953,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":441450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46300000000000002,"15min":0.443},"min":{"1min":0.39900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71099999999999997,"15min":0.68799999999999994},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.109,"15min":1.109},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69699999999999995,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98599999999999999,"5min":1.01,"15min":1.01},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94799999999999995,"5min":1.054,"15min":1.054},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42999999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82599999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.628,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1299999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94699999999999995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.79500000000000004},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1299999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 23:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80600000000000005,"15min":0.80400000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1819999999999999,"5min":1.24,"15min":1.24},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.74199999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.198,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.014}]},{"osd":8,"last update":"Fri Oct 6 23:11:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.85999999999999999,"15min":0.84399999999999997},"min":{"1min":0.69399999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1559999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.78600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1459999999999999,"5min":1.222,"15min":1.222},"last":0.96599999999999997}]},{"osd":9,"last update":"Fri Oct 6 23:10:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.056},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.73899999999999999}]},{"osd":10,"last update":"Fri Oct 6 23:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.95399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":442972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61499999999999999,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Oct 6 23:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":1.141},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.67200000000000004,"15min":0.66400000000000003},"min":{"1min":0.49199999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.44,"5min":0.436,"15min":0.436},"max":{"1min":0.93899999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.94799999999999995}]},{"osd":4,"last update":"Fri Oct 6 23:10:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Oct 6 23:10:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46999999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.196},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.60199999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":1.026}]},{"osd":6,"last update":"Fri Oct 6 23:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.006}]},{"osd":7,"last update":"Fri Oct 6 23:10:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":1.492},{"interface":"front","average":{"1min":0.751,"5min":0.70999999999999996,"15min":0.70299999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.4139999999999999}]},{"osd":8,"last update":"Fri Oct 6 23:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.68799999999999994,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.3280000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.109},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":1.258}]},{"osd":10,"last update":"Fri Oct 6 23:10:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.3600000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.4390000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":441450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 23:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.028,"5min":1.091,"15min":1.091},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47699999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.87},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.46000000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Oct 6 23:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99099999999999999,"5min":0.995,"15min":0.995},"last":0.754},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66600000000000004,"15min":0.63500000000000001},"min":{"1min":0.45400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.998,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Oct 6 23:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":1.02,"15min":1.02},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.5,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90300000000000002,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.073,"5min":1.085,"15min":1.085},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.75700000000000001,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1259999999999999,"5min":1.226,"15min":1.226},"last":0.92100000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.59699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.81399999999999995,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70299999999999996}]},{"osd":8,"last update":"Fri Oct 6 23:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.63100000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1220000000000001,"5min":1.296,"15min":1.296},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.55300000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.1299999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.071},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.84899999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:10:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.202}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":443006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0009999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.45700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1319999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.81699999999999995}]},{"osd":1,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.438,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.012,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2430000000000001,"5min":1.746,"15min":1.746},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.44800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.454,"15min":1.454},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71099999999999997,"15min":0.69499999999999995},"min":{"1min":0.51500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3700000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 23:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.96199999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91500000000000004,"5min":1.53,"15min":1.53},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Oct 6 23:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.38500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.46999999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.72799999999999998,"15min":0.69399999999999995},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.03,"5min":1.169,"15min":1.169},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.59899999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.018,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 23:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.54400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75}]},{"osd":8,"last update":"Fri Oct 6 23:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.095,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0800000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.57499999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.60599999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.432,"15min":0.39100000000000001},"min":{"1min":0.34100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.437,"15min":0.40500000000000003},"min":{"1min":0.36299999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68799999999999994,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.65100000000000002,"15min":0.627},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.68600000000000005,"15min":0.66300000000000003},"min":{"1min":0.55500000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.877}]},{"osd":2,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.47999999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":1.155,"15min":1.155},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68300000000000005,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.042,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Oct 6 23:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.68999999999999995,"15min":0.64900000000000002},"min":{"1min":0.51800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.202,"15min":1.202},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.68899999999999995,"15min":0.66300000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.048,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri Oct 6 23:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.745,"15min":0.72399999999999998},"min":{"1min":0.59699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0860000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.747},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.748,"15min":0.71499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67900000000000005,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82499999999999996,"15min":0.82299999999999995},"min":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.079,"5min":1.103,"15min":1.103},"last":0.85599999999999998}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.66900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.008,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0009999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81599999999999995}]},{"osd":10,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.98499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":441382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.45600000000000002},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.499},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.44900000000000001},"min":{"1min":0.34499999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.437}]},{"osd":2,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.497,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80800000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.66400000000000003,"15min":0.64600000000000002},"min":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.67000000000000004,"15min":0.628},"min":{"1min":0.58399999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.55600000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71099999999999997,"15min":0.69499999999999995},"min":{"1min":0.47099999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77700000000000002,"15min":0.753},"min":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0449999999999999,"5min":1.161,"15min":1.161},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66900000000000004,"15min":0.66600000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.78200000000000003,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.54200000000000004}]},{"osd":8,"last update":"Fri Oct 6 23:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.68999999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.86299999999999999,"15min":0.84499999999999997},"min":{"1min":0.66800000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1719999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.76000000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.64200000000000002}]},{"osd":10,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.627},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":5,"up_from":39,"seq":167503724589,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":1032873,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59099999999999997,"15min":0.57799999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":1.032,"5min":1.153,"15min":1.153},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.0169999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.36299999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.79600000000000004,"5min":0.879,"15min":0.879},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94099999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.57499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91600000000000004,"5min":1.143,"15min":1.143},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.46100000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.077,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Oct 6 23:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.59599999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.871},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.85799999999999998}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97399999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.755},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.89300000000000002}]},{"osd":9,"last update":"Fri Oct 6 23:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.93000000000000005}]},{"osd":10,"last update":"Fri Oct 6 23:10:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.94799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T23:11:25.179 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T23:11:25.179 INFO:tasks.cephadm:Setting up client nodes... 2023-10-06T23:11:25.179 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-06T23:11:25.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:25 smithi156 ceph-mon[102862]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:11:25.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:25 smithi156 ceph-mon[102862]: pgmap v304: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 797 B/s rd, 2.5 KiB/s wr, 11 op/s 2023-10-06T23:11:25.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:25 smithi008 ceph-mon[98532]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:11:25.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:25 smithi008 ceph-mon[98532]: pgmap v304: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 797 B/s rd, 2.5 KiB/s wr, 11 op/s 2023-10-06T23:11:25.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:25 smithi190 ceph-mon[102658]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:11:25.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:25 smithi190 ceph-mon[102658]: pgmap v304: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 797 B/s rd, 2.5 KiB/s wr, 11 op/s 2023-10-06T23:11:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:26.594 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:26 smithi008 ceph-mon[98532]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:11:26.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:26 smithi156 ceph-mon[102862]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:11:26.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:26 smithi190 ceph-mon[102658]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:11:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.499+0000 7fd8565d1700 1 -- 172.21.15.8:0/3907087860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850102b50 msgr2=0x7fd850109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.499+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3907087860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850102b50 0x7fd850109400 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd84800b0d0 tx=0x7fd84800b3e0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.500+0000 7fd8565d1700 1 -- 172.21.15.8:0/3907087860 shutdown_connections 2023-10-06T23:11:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.500+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3907087860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd850102b50 0x7fd850109400 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.500+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3907087860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd850100fb0 0x7fd8501013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.500+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3907087860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8501021b0 0x7fd850102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.500+0000 7fd8565d1700 1 -- 172.21.15.8:0/3907087860 >> 172.21.15.8:0/3907087860 conn(0x7fd8500fc570 msgr2=0x7fd8500fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.500+0000 7fd8565d1700 1 -- 172.21.15.8:0/3907087860 shutdown_connections 2023-10-06T23:11:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.500+0000 7fd8565d1700 1 -- 172.21.15.8:0/3907087860 wait complete. 2023-10-06T23:11:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.501+0000 7fd8565d1700 1 Processor -- start 2023-10-06T23:11:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.501+0000 7fd8565d1700 1 -- start start 2023-10-06T23:11:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.501+0000 7fd8565d1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd850100fb0 0x7fd850198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.501+0000 7fd8565d1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8501021b0 0x7fd850199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:27.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.501+0000 7fd8565d1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd850102b50 0x7fd8501a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.501+0000 7fd8565d1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501a09c0 con 0x7fd8501021b0 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.501+0000 7fd8565d1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501a0b00 con 0x7fd850100fb0 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.501+0000 7fd8565d1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501a0c90 con 0x7fd850102b50 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8501021b0 0x7fd850199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8501021b0 0x7fd850199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57218/0 (socket says 172.21.15.8:57218) 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 -- 172.21.15.8:0/3744244368 learned_addr learned my addr 172.21.15.8:0/3744244368 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd854b6e700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd850102b50 0x7fd8501a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84ffff700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd850100fb0 0x7fd850198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 -- 172.21.15.8:0/3744244368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd850102b50 msgr2=0x7fd8501a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd850102b50 0x7fd8501a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 -- 172.21.15.8:0/3744244368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd850100fb0 msgr2=0x7fd850198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd850100fb0 0x7fd850198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 -- 172.21.15.8:0/3744244368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848009d00 con 0x7fd8501021b0 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84ffff700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd850100fb0 0x7fd850198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.502+0000 7fd84f7fe700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8501021b0 0x7fd850199370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd84400e9d0 tx=0x7fd84400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.503+0000 7fd84d7fa700 1 -- 172.21.15.8:0/3744244368 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844009790 con 0x7fd8501021b0 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.503+0000 7fd84d7fa700 1 -- 172.21.15.8:0/3744244368 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd84400cbd0 con 0x7fd8501021b0 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.503+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8501a0f70 con 0x7fd8501021b0 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.503+0000 7fd84d7fa700 1 -- 172.21.15.8:0/3744244368 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844018680 con 0x7fd8501021b0 2023-10-06T23:11:27.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.503+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8501a13e0 con 0x7fd8501021b0 2023-10-06T23:11:27.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.504+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd850193450 con 0x7fd8501021b0 2023-10-06T23:11:27.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.506+0000 7fd84d7fa700 1 -- 172.21.15.8:0/3744244368 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd84400cd40 con 0x7fd8501021b0 2023-10-06T23:11:27.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.507+0000 7fd84d7fa700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8380a1480 0x7fd8380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:27.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.507+0000 7fd84d7fa700 1 -- 172.21.15.8:0/3744244368 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd844014070 con 0x7fd8501021b0 2023-10-06T23:11:27.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.507+0000 7fd84ffff700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8380a1480 0x7fd8380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:27.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.508+0000 7fd84ffff700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8380a1480 0x7fd8380a3940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd850102010 tx=0x7fd84000b670 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:27.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.512+0000 7fd84d7fa700 1 -- 172.21.15.8:0/3744244368 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd844052100 con 0x7fd8501021b0 2023-10-06T23:11:27.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:27 smithi156 ceph-mon[102862]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.4 KiB/s wr, 18 op/s 2023-10-06T23:11:27.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:27 smithi008 ceph-mon[98532]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.4 KiB/s wr, 18 op/s 2023-10-06T23:11:27.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:27 smithi190 ceph-mon[102658]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.4 KiB/s wr, 18 op/s 2023-10-06T23:11:27.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.806+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd85002cf70 con 0x7fd8501021b0 2023-10-06T23:11:27.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.808+0000 7fd84d7fa700 1 -- 172.21.15.8:0/3744244368 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd844099fd0 con 0x7fd8501021b0 2023-10-06T23:11:27.809 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-10-06T23:11:27.810 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQAflCBl0mgeMBAAwAQcqyer/QtByb/i4HCfig== 2023-10-06T23:11:27.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8380a1480 msgr2=0x7fd8380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:27.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8380a1480 0x7fd8380a3940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd850102010 tx=0x7fd84000b670 comp rx=0 tx=0).stop 2023-10-06T23:11:27.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8501021b0 msgr2=0x7fd850199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:27.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8501021b0 0x7fd850199370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd84400e9d0 tx=0x7fd84400ece0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 shutdown_connections 2023-10-06T23:11:27.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8380a1480 0x7fd8380a3940 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd850102b50 0x7fd8501a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd850100fb0 0x7fd850198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 --2- 172.21.15.8:0/3744244368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8501021b0 0x7fd850199370 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:27.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 >> 172.21.15.8:0/3744244368 conn(0x7fd8500fc570 msgr2=0x7fd850107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:27.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 shutdown_connections 2023-10-06T23:11:27.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:27.811+0000 7fd8565d1700 1 -- 172.21.15.8:0/3744244368 wait complete. 2023-10-06T23:11:28.323 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:11:28.323 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-06T23:11:28.324 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T23:11:28.426 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T23:11:28.426 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-06T23:11:28.426 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-06T23:11:28.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:28 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3744244368' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-06T23:11:28.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:28 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3744244368' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-06T23:11:28.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:28 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3744244368' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-06T23:11:28.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:28 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3744244368' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-06T23:11:28.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:28 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3744244368' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-06T23:11:28.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:28 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3744244368' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-06T23:11:29.204 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:29.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:29 smithi156 ceph-mon[102862]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2023-10-06T23:11:29.605 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:29 smithi008 ceph-mon[98532]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2023-10-06T23:11:29.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:29 smithi190 ceph-mon[102658]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2023-10-06T23:11:30.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.756+0000 7f179a860700 1 -- 172.21.15.8:0/744805889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 msgr2=0x7f1794107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:30.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.756+0000 7f179a860700 1 --2- 172.21.15.8:0/744805889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 0x7f1794107370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f17840099c0 tx=0x7f1784009cd0 comp rx=0 tx=0).stop 2023-10-06T23:11:30.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.757+0000 7f179a860700 1 -- 172.21.15.8:0/744805889 shutdown_connections 2023-10-06T23:11:30.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.757+0000 7f179a860700 1 --2- 172.21.15.8:0/744805889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 0x7f1794107370 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:30.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.757+0000 7f179a860700 1 --2- 172.21.15.8:0/744805889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1794101940 0x7f179410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:30.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.757+0000 7f179a860700 1 --2- 172.21.15.8:0/744805889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1794100f80 0x7f1794101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:30.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.757+0000 7f179a860700 1 -- 172.21.15.8:0/744805889 >> 172.21.15.8:0/744805889 conn(0x7f17940780a0 msgr2=0x7f17940784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:30.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.757+0000 7f179a860700 1 -- 172.21.15.8:0/744805889 shutdown_connections 2023-10-06T23:11:30.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.757+0000 7f179a860700 1 -- 172.21.15.8:0/744805889 wait complete. 2023-10-06T23:11:30.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.758+0000 7f179a860700 1 Processor -- start 2023-10-06T23:11:30.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.758+0000 7f179a860700 1 -- start start 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.758+0000 7f179a860700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1794100f80 0x7f1794196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.758+0000 7f179a860700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1794101940 0x7f1794197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.758+0000 7f179a860700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 0x7f179419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.758+0000 7f179a860700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179419bed0 con 0x7f1794106f90 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.758+0000 7f179a860700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179419c040 con 0x7f1794101940 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.758+0000 7f179a860700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179419c200 con 0x7f1794100f80 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 0x7f179419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 0x7f179419b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35518/0 (socket says 172.21.15.8:35518) 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 -- 172.21.15.8:0/471141840 learned_addr learned my addr 172.21.15.8:0/471141840 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:30.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f17937fe700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1794101940 0x7f1794197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1793fff700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1794100f80 0x7f1794196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 -- 172.21.15.8:0/471141840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1794100f80 msgr2=0x7f1794196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1794100f80 0x7f1794196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 -- 172.21.15.8:0/471141840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1794101940 msgr2=0x7f1794197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1794101940 0x7f1794197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 -- 172.21.15.8:0/471141840 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840095f0 con 0x7f1794106f90 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.759+0000 7f1798dfd700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 0x7f179419b8c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f178c00efc0 tx=0x7f178c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.760+0000 7f17917fa700 1 -- 172.21.15.8:0/471141840 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c018070 con 0x7f1794106f90 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.760+0000 7f17917fa700 1 -- 172.21.15.8:0/471141840 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f178c00f040 con 0x7f1794106f90 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.760+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179419c480 con 0x7f1794106f90 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.760+0000 7f17917fa700 1 -- 172.21.15.8:0/471141840 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c00cbb0 con 0x7f1794106f90 2023-10-06T23:11:30.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.760+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17941a3d40 con 0x7f1794106f90 2023-10-06T23:11:30.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.761+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179404ebb0 con 0x7f1794106f90 2023-10-06T23:11:30.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.763+0000 7f17917fa700 1 -- 172.21.15.8:0/471141840 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f178c00cd50 con 0x7f1794106f90 2023-10-06T23:11:30.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.764+0000 7f17917fa700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f177c0a1500 0x7f177c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:30.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.764+0000 7f17917fa700 1 -- 172.21.15.8:0/471141840 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f178c0cc590 con 0x7f1794106f90 2023-10-06T23:11:30.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.765+0000 7f1793fff700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f177c0a1500 0x7f177c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:30.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.765+0000 7f1793fff700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f177c0a1500 0x7f177c0a39c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f178401a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:30.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:30.768+0000 7f17917fa700 1 -- 172.21.15.8:0/471141840 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f178c095d30 con 0x7f1794106f90 2023-10-06T23:11:31.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.038+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1794110f30 con 0x7f1794106f90 2023-10-06T23:11:31.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.044+0000 7f17917fa700 1 -- 172.21.15.8:0/471141840 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v16) v1 ==== 74+0+260310 (secure 0 0 0) 0x7f178c099350 con 0x7f1794106f90 2023-10-06T23:11:31.048 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:31.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f177c0a1500 msgr2=0x7f177c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f177c0a1500 0x7f177c0a39c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f178401a040 comp rx=0 tx=0).stop 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 msgr2=0x7f179419b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 0x7f179419b8c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f178c00efc0 tx=0x7f178c00c3a0 comp rx=0 tx=0).stop 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 shutdown_connections 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f177c0a1500 0x7f177c0a39c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1794106f90 0x7f179419b8c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1794100f80 0x7f1794196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 --2- 172.21.15.8:0/471141840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1794101940 0x7f1794197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.048+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 >> 172.21.15.8:0/471141840 conn(0x7f17940780a0 msgr2=0x7f17940ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.049+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 shutdown_connections 2023-10-06T23:11:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:31.049+0000 7f179a860700 1 -- 172.21.15.8:0/471141840 wait complete. 2023-10-06T23:11:31.585 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":3959613712},{"type":"v1","addr":"172.21.15.8:6801","nonce":3959613712}]},"active_addr":"172.21.15.8:6801/3959613712","active_change":"2023-10-06T23:03:48.853371+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14220,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24106,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.8:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":699473775}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":691108914}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":2960809242}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":1263711010}]}]} 2023-10-06T23:11:31.592 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-06T23:11:31.592 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-06T23:11:31.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-06T23:11:32.329 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:32.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:32 smithi156 ceph-mon[102862]: pgmap v307: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.2 KiB/s wr, 15 op/s 2023-10-06T23:11:32.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:32 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/471141840' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-06T23:11:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:31 smithi008 ceph-mon[98532]: pgmap v307: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.2 KiB/s wr, 15 op/s 2023-10-06T23:11:32.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:31 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/471141840' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-06T23:11:32.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:32 smithi190 ceph-mon[102658]: pgmap v307: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.2 KiB/s wr, 15 op/s 2023-10-06T23:11:32.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:32 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/471141840' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-06T23:11:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:33 smithi156 ceph-mon[102862]: pgmap v308: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2023-10-06T23:11:33.622 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:33 smithi008 ceph-mon[98532]: pgmap v308: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2023-10-06T23:11:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:33 smithi190 ceph-mon[102658]: pgmap v308: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2023-10-06T23:11:33.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.880+0000 7f0291fc0700 1 -- 172.21.15.8:0/737506076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c106f90 msgr2=0x7f028c107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:33.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.880+0000 7f0291fc0700 1 --2- 172.21.15.8:0/737506076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c106f90 0x7f028c107370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f027c0099c0 tx=0x7f027c009cd0 comp rx=0 tx=0).stop 2023-10-06T23:11:33.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.880+0000 7f0291fc0700 1 -- 172.21.15.8:0/737506076 shutdown_connections 2023-10-06T23:11:33.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.880+0000 7f0291fc0700 1 --2- 172.21.15.8:0/737506076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c106f90 0x7f028c107370 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:33.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.880+0000 7f0291fc0700 1 --2- 172.21.15.8:0/737506076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f028c101940 0x7f028c10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:33.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.880+0000 7f0291fc0700 1 --2- 172.21.15.8:0/737506076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c100f80 0x7f028c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:33.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.880+0000 7f0291fc0700 1 -- 172.21.15.8:0/737506076 >> 172.21.15.8:0/737506076 conn(0x7f028c0780a0 msgr2=0x7f028c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:33.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.881+0000 7f0291fc0700 1 -- 172.21.15.8:0/737506076 shutdown_connections 2023-10-06T23:11:33.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.881+0000 7f0291fc0700 1 -- 172.21.15.8:0/737506076 wait complete. 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.881+0000 7f0291fc0700 1 Processor -- start 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f0291fc0700 1 -- start start 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f0291fc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c100f80 0x7f028c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f0291fc0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c101940 0x7f028c199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f0291fc0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f028c106f90 0x7f028c19da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f0291fc0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c19e090 con 0x7f028c100f80 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f0291fc0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c19e200 con 0x7f028c101940 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f0291fc0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c19e3c0 con 0x7f028c106f90 2023-10-06T23:11:33.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f028b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c100f80 0x7f028c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f028b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c100f80 0x7f028c1990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35546/0 (socket says 172.21.15.8:35546) 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f028b7fe700 1 -- 172.21.15.8:0/4101605069 learned_addr learned my addr 172.21.15.8:0/4101605069 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f028affd700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c101940 0x7f028c199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.882+0000 7f028bfff700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f028c106f90 0x7f028c19da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f028b7fe700 1 -- 172.21.15.8:0/4101605069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f028c106f90 msgr2=0x7f028c19da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f028b7fe700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f028c106f90 0x7f028c19da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f028b7fe700 1 -- 172.21.15.8:0/4101605069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c101940 msgr2=0x7f028c199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f028b7fe700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c101940 0x7f028c199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:33.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f028b7fe700 1 -- 172.21.15.8:0/4101605069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0095f0 con 0x7f028c100f80 2023-10-06T23:11:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f028b7fe700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c100f80 0x7f028c1990d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f027c009f50 tx=0x7f027c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f0288ff9700 1 -- 172.21.15.8:0/4101605069 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c01d070 con 0x7f028c100f80 2023-10-06T23:11:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f0288ff9700 1 -- 172.21.15.8:0/4101605069 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f027c003ec0 con 0x7f028c100f80 2023-10-06T23:11:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c19e640 con 0x7f028c100f80 2023-10-06T23:11:33.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.883+0000 7f0288ff9700 1 -- 172.21.15.8:0/4101605069 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c022a80 con 0x7f028c100f80 2023-10-06T23:11:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.884+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c1a5f00 con 0x7f028c100f80 2023-10-06T23:11:33.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.885+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028c04ebb0 con 0x7f028c100f80 2023-10-06T23:11:33.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.887+0000 7f0288ff9700 1 -- 172.21.15.8:0/4101605069 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f027c004030 con 0x7f028c100f80 2023-10-06T23:11:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.888+0000 7f0288ff9700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02740a1500 0x7f02740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.888+0000 7f0288ff9700 1 -- 172.21.15.8:0/4101605069 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f027c0ce1d0 con 0x7f028c100f80 2023-10-06T23:11:33.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.888+0000 7f028affd700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02740a1500 0x7f02740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.889+0000 7f028affd700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02740a1500 0x7f02740a39c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f028c19a6f0 tx=0x7f028000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:33.890+0000 7f0288ff9700 1 -- 172.21.15.8:0/4101605069 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f027c097970 con 0x7f028c100f80 2023-10-06T23:11:34.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.098+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f028c110d50 con 0x7f028c100f80 2023-10-06T23:11:34.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.100+0000 7f0288ff9700 1 -- 172.21.15.8:0/4101605069 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22060 (secure 0 0 0) 0x7f027c09af90 con 0x7f028c100f80 2023-10-06T23:11:34.102 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:34.102 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:19.241355+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:11:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.102+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02740a1500 msgr2=0x7f02740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.102+0000 7f0291fc0700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02740a1500 0x7f02740a39c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f028c19a6f0 tx=0x7f028000b410 comp rx=0 tx=0).stop 2023-10-06T23:11:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.102+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c100f80 msgr2=0x7f028c1990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.102+0000 7f0291fc0700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c100f80 0x7f028c1990d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f027c009f50 tx=0x7f027c005740 comp rx=0 tx=0).stop 2023-10-06T23:11:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.103+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 shutdown_connections 2023-10-06T23:11:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.103+0000 7f0291fc0700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02740a1500 0x7f02740a39c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:34.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.103+0000 7f0291fc0700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f028c100f80 0x7f028c1990d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.103+0000 7f0291fc0700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f028c106f90 0x7f028c19da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.103+0000 7f0291fc0700 1 --2- 172.21.15.8:0/4101605069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f028c101940 0x7f028c199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.103+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 >> 172.21.15.8:0/4101605069 conn(0x7f028c0780a0 msgr2=0x7f028c073230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.103+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 shutdown_connections 2023-10-06T23:11:34.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:34.103+0000 7f0291fc0700 1 -- 172.21.15.8:0/4101605069 wait complete. 2023-10-06T23:11:34.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:34 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4101605069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:34.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:34 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4101605069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:34.608 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-06T23:11:34.608 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-06T23:11:34.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:34 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4101605069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:35.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:35 smithi156 ceph-mon[102862]: pgmap v309: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-06T23:11:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:35 smithi008 ceph-mon[98532]: pgmap v309: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-06T23:11:35.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:35 smithi190 ceph-mon[102658]: pgmap v309: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/1382374993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 msgr2=0x7ff8a4101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/1382374993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 0x7ff8a4101400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff8980099c0 tx=0x7ff898009cd0 comp rx=0 tx=0).stop 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/1382374993 shutdown_connections 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/1382374993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8a4101940 0x7ff8a410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/1382374993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8a4106f90 0x7ff8a4107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/1382374993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 0x7ff8a4101400 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/1382374993 >> 172.21.15.8:0/1382374993 conn(0x7ff8a40780a0 msgr2=0x7ff8a40784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/1382374993 shutdown_connections 2023-10-06T23:11:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.946+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/1382374993 wait complete. 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.947+0000 7ff8a9b6b700 1 Processor -- start 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.947+0000 7ff8a9b6b700 1 -- start start 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a9b6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 0x7ff8a40731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a9b6b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8a4101940 0x7ff8a40736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a9b6b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8a4106f90 0x7ff8a4073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a9b6b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a41a5340 con 0x7ff8a4100f80 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a9b6b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a41a54b0 con 0x7ff8a4101940 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a9b6b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a41a5670 con 0x7ff8a4106f90 2023-10-06T23:11:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 0x7ff8a40731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 0x7ff8a40731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35570/0 (socket says 172.21.15.8:35570) 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3582997568 learned_addr learned my addr 172.21.15.8:0/3582997568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.948+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8a4106f90 0x7ff8a4073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8a4101940 0x7ff8a40736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3582997568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8a4106f90 msgr2=0x7ff8a4073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8a4106f90 0x7ff8a4073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3582997568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8a4101940 msgr2=0x7ff8a40736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8a4101940 0x7ff8a40736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a37fe700 1 -- 172.21.15.8:0/3582997568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8980095f0 con 0x7ff8a4100f80 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a3fff700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8a4106f90 0x7ff8a4073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:36.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8a4101940 0x7ff8a40736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:11:36.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a37fe700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 0x7ff8a40731b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff89400d950 tx=0x7ff89400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:36.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a0ff9700 1 -- 172.21.15.8:0/3582997568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894009b40 con 0x7ff8a4100f80 2023-10-06T23:11:36.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a0ff9700 1 -- 172.21.15.8:0/3582997568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff894009ca0 con 0x7ff8a4100f80 2023-10-06T23:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a41a5950 con 0x7ff8a4100f80 2023-10-06T23:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a0ff9700 1 -- 172.21.15.8:0/3582997568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400f620 con 0x7ff8a4100f80 2023-10-06T23:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.949+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a41a5ea0 con 0x7ff8a4100f80 2023-10-06T23:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.950+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a404ebb0 con 0x7ff8a4100f80 2023-10-06T23:11:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.952+0000 7ff8a0ff9700 1 -- 172.21.15.8:0/3582997568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff894010460 con 0x7ff8a4100f80 2023-10-06T23:11:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.954+0000 7ff8a0ff9700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff88c0a1500 0x7ff88c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.954+0000 7ff8a0ff9700 1 -- 172.21.15.8:0/3582997568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff8940ccf20 con 0x7ff8a4100f80 2023-10-06T23:11:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.954+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff88c0a1500 0x7ff88c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.954+0000 7ff8a2ffd700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff88c0a1500 0x7ff88c0a39c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff898006010 tx=0x7ff898000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:36.957+0000 7ff8a0ff9700 1 -- 172.21.15.8:0/3582997568 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff894096630 con 0x7ff8a4100f80 2023-10-06T23:11:37.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.169+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8a40746e0 con 0x7ff8a4100f80 2023-10-06T23:11:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.171+0000 7ff8a0ff9700 1 -- 172.21.15.8:0/3582997568 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22060 (secure 0 0 0) 0x7ff894099c50 con 0x7ff8a4100f80 2023-10-06T23:11:37.173 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:11:37.173 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:19.241355+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:11:37.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff88c0a1500 msgr2=0x7ff88c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff88c0a1500 0x7ff88c0a39c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff898006010 tx=0x7ff898000bc0 comp rx=0 tx=0).stop 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 msgr2=0x7ff8a40731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 0x7ff8a40731b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff89400d950 tx=0x7ff89400dd10 comp rx=0 tx=0).stop 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 shutdown_connections 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff88c0a1500 0x7ff88c0a39c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8a4100f80 0x7ff8a40731b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8a4106f90 0x7ff8a4073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 --2- 172.21.15.8:0/3582997568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8a4101940 0x7ff8a40736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.173+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 >> 172.21.15.8:0/3582997568 conn(0x7ff8a40780a0 msgr2=0x7ff8a40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.174+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 shutdown_connections 2023-10-06T23:11:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:37.174+0000 7ff8a9b6b700 1 -- 172.21.15.8:0/3582997568 wait complete. 2023-10-06T23:11:37.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-06T23:11:37.731 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-06T23:11:37.731 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-06T23:11:37.731 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-06T23:11:37.732 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-06T23:11:37.732 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-06T23:11:37.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-06T23:11:37.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-06T23:11:37.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-06T23:11:37.734 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-06T23:11:37.734 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-06T23:11:37.735 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-06T23:11:38.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:38 smithi156 ceph-mon[102862]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2023-10-06T23:11:38.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:38 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3582997568' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:38.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:38 smithi008 ceph-mon[98532]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2023-10-06T23:11:38.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:38 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3582997568' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:38 smithi190 ceph-mon[102658]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2023-10-06T23:11:38.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:38 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3582997568' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:11:39.581 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:39.801 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:40.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:40 smithi008 ceph-mon[98532]: pgmap v311: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-06T23:11:40.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:40 smithi156 ceph-mon[102862]: pgmap v311: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-06T23:11:40.368 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:40 smithi190 ceph-mon[102658]: pgmap v311: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-06T23:11:40.461 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:40.870 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:41.532 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:41.777 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:41.880 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:41.905 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:42.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:42 smithi008 ceph-mon[98532]: pgmap v312: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2023-10-06T23:11:42.466 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:42 smithi190 ceph-mon[102658]: pgmap v312: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2023-10-06T23:11:42.466 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:42 smithi156 ceph-mon[102862]: pgmap v312: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2023-10-06T23:11:43.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:43 smithi008 ceph-mon[98532]: pgmap v313: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-06T23:11:43.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:43 smithi156 ceph-mon[102862]: pgmap v313: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-06T23:11:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:43 smithi190 ceph-mon[102658]: pgmap v313: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-06T23:11:44.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.610+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3254499593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0101950 msgr2=0x7fe7c01059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.610+0000 7fe7c55eb700 1 --2- 172.21.15.8:0/3254499593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0101950 0x7fe7c01059a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009990 tx=0x7fe7b4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.611+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3254499593 shutdown_connections 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.611+0000 7fe7c55eb700 1 --2- 172.21.15.8:0/3254499593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c0106080 0x7fe7c010dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.611+0000 7fe7c55eb700 1 --2- 172.21.15.8:0/3254499593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0100fa0 0x7fe7c0101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.611+0000 7fe7c55eb700 1 --2- 172.21.15.8:0/3254499593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0101950 0x7fe7c01059a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.611+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3254499593 >> 172.21.15.8:0/3254499593 conn(0x7fe7c00fc8b0 msgr2=0x7fe7c00fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.611+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3254499593 shutdown_connections 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.611+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3254499593 wait complete. 2023-10-06T23:11:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.612+0000 7fe7c55eb700 1 Processor -- start 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.612+0000 7fe7c55eb700 1 -- start start 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.612+0000 7fe7c55eb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0100fa0 0x7fe7c0198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.612+0000 7fe7c55eb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c0101950 0x7fe7c01994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.612+0000 7fe7c55eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0106080 0x7fe7c019d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.612+0000 7fe7c55eb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c019df50 con 0x7fe7c0106080 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.612+0000 7fe7c55eb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c019e0c0 con 0x7fe7c0100fa0 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.612+0000 7fe7c55eb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c019e280 con 0x7fe7c0101950 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0106080 0x7fe7c019d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0106080 0x7fe7c019d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36866/0 (socket says 172.21.15.8:36866) 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 -- 172.21.15.8:0/3141090728 learned_addr learned my addr 172.21.15.8:0/3141090728 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7bffff700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0100fa0 0x7fe7c0198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7bf7fe700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c0101950 0x7fe7c01994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 -- 172.21.15.8:0/3141090728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c0101950 msgr2=0x7fe7c01994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7c0101950 0x7fe7c01994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 -- 172.21.15.8:0/3141090728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0100fa0 msgr2=0x7fe7c0198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0100fa0 0x7fe7c0198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 -- 172.21.15.8:0/3141090728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40095f0 con 0x7fe7c0106080 2023-10-06T23:11:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7bffff700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0100fa0 0x7fe7c0198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.613+0000 7fe7c4dea700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0106080 0x7fe7c019d940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8007d70 tx=0x7fe7b800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.614+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800ad40 con 0x7fe7c0106080 2023-10-06T23:11:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.614+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7b80128b0 con 0x7fe7c0106080 2023-10-06T23:11:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.614+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c019e560 con 0x7fe7c0106080 2023-10-06T23:11:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.614+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b80116b0 con 0x7fe7c0106080 2023-10-06T23:11:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.614+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c01a5dc0 con 0x7fe7c0106080 2023-10-06T23:11:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.615+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7c0110da0 con 0x7fe7c0106080 2023-10-06T23:11:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.617+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe7b8012a20 con 0x7fe7c0106080 2023-10-06T23:11:44.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.618+0000 7fe7bd7fa700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7a80a1500 0x7fe7a80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:44.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.618+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe7b80cd420 con 0x7fe7c0106080 2023-10-06T23:11:44.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.618+0000 7fe7bffff700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7a80a1500 0x7fe7a80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.619+0000 7fe7bd7fa700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] conn(0x7fe7a80aace0 0x7fe7a80ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.619+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 --> [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7a80ad7b0 con 0x7fe7a80aace0 2023-10-06T23:11:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.619+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7b80cd790 con 0x7fe7c0106080 2023-10-06T23:11:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.619+0000 7fe7bffff700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7a80a1500 0x7fe7a80a39c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000bc10 tx=0x7fe7b000b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.619+0000 7fe7bf7fe700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] conn(0x7fe7a80aace0 0x7fe7a80ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:44.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.620+0000 7fe7bf7fe700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] conn(0x7fe7a80aace0 0x7fe7a80ad100 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:44.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.620+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 <== osd.0 v2:172.21.15.8:6802/36091553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe7a80ad7b0 con 0x7fe7a80aace0 2023-10-06T23:11:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.643+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 --> [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7c004f400 con 0x7fe7a80aace0 2023-10-06T23:11:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.643+0000 7fe7bd7fa700 1 -- 172.21.15.8:0/3141090728 <== osd.0 v2:172.21.15.8:6802/36091553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7c004f400 con 0x7fe7a80aace0 2023-10-06T23:11:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] conn(0x7fe7a80aace0 msgr2=0x7fe7a80ad100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] conn(0x7fe7a80aace0 0x7fe7a80ad100 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7a80a1500 msgr2=0x7fe7a80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:44.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7a80a1500 0x7fe7a80a39c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000bc10 tx=0x7fe7b000b5f0 comp rx=0 tx=0).stop 2023-10-06T23:11:44.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0106080 msgr2=0x7fe7c019d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:44.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 --2- 172.21.15.8:0/3141090728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c0106080 0x7fe7c019d940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8007d70 tx=0x7fe7b800a340 comp rx=0 tx=0).stop 2023-10-06T23:11:44.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c4dea700 1 -- 172.21.15.8:0/3141090728 reap_dead start 2023-10-06T23:11:44.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 shutdown_connections 2023-10-06T23:11:44.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 >> 172.21.15.8:0/3141090728 conn(0x7fe7c00fc8b0 msgr2=0x7fe7c00fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:44.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 shutdown_connections 2023-10-06T23:11:44.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:44.644+0000 7fe7c55eb700 1 -- 172.21.15.8:0/3141090728 wait complete. 2023-10-06T23:11:46.060 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:46 smithi008 ceph-mon[98532]: pgmap v314: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.115+0000 7fd96a27e700 1 -- 172.21.15.8:0/417985141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 msgr2=0x7fd964107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.115+0000 7fd96a27e700 1 --2- 172.21.15.8:0/417985141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 0x7fd964107370 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd9540099c0 tx=0x7fd954009cd0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.115+0000 7fd96a27e700 1 -- 172.21.15.8:0/417985141 shutdown_connections 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.115+0000 7fd96a27e700 1 --2- 172.21.15.8:0/417985141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 0x7fd964107370 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.115+0000 7fd96a27e700 1 --2- 172.21.15.8:0/417985141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd964101940 0x7fd96410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.115+0000 7fd96a27e700 1 --2- 172.21.15.8:0/417985141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964100f80 0x7fd964101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.115+0000 7fd96a27e700 1 -- 172.21.15.8:0/417985141 >> 172.21.15.8:0/417985141 conn(0x7fd9640780a0 msgr2=0x7fd9640784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.116+0000 7fd96a27e700 1 -- 172.21.15.8:0/417985141 shutdown_connections 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.116+0000 7fd96a27e700 1 -- 172.21.15.8:0/417985141 wait complete. 2023-10-06T23:11:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.116+0000 7fd96a27e700 1 Processor -- start 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96a27e700 1 -- start start 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96a27e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd964100f80 0x7fd964197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96a27e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964101940 0x7fd9641975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96a27e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 0x7fd96419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96a27e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96419bfa0 con 0x7fd964106f90 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96a27e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96419c110 con 0x7fd964101940 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96a27e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96419c2d0 con 0x7fd964100f80 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96881b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 0x7fd96419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96881b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 0x7fd96419b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36880/0 (socket says 172.21.15.8:36880) 2023-10-06T23:11:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.117+0000 7fd96881b700 1 -- 172.21.15.8:0/724976509 learned_addr learned my addr 172.21.15.8:0/724976509 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd963fff700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd964100f80 0x7fd964197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd9637fe700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964101940 0x7fd9641975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd96881b700 1 -- 172.21.15.8:0/724976509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd964100f80 msgr2=0x7fd964197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd96881b700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd964100f80 0x7fd964197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd96881b700 1 -- 172.21.15.8:0/724976509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964101940 msgr2=0x7fd9641975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd96881b700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964101940 0x7fd9641975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd96881b700 1 -- 172.21.15.8:0/724976509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540095f0 con 0x7fd964106f90 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd9637fe700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd964101940 0x7fd9641975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd96881b700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 0x7fd96419b990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00b9e0 tx=0x7fd95c00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00d8e0 con 0x7fd964106f90 2023-10-06T23:11:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd95c015420 con 0x7fd964106f90 2023-10-06T23:11:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96419c5b0 con 0x7fd964106f90 2023-10-06T23:11:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c014630 con 0x7fd964106f90 2023-10-06T23:11:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.118+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9641a3e10 con 0x7fd964106f90 2023-10-06T23:11:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.119+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd964111110 con 0x7fd964106f90 2023-10-06T23:11:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.121+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd95c015590 con 0x7fd964106f90 2023-10-06T23:11:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.123+0000 7fd9617fa700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd94c0a1500 0x7fd94c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.123+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd95c011070 con 0x7fd964106f90 2023-10-06T23:11:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.123+0000 7fd963fff700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd94c0a1500 0x7fd94c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.123+0000 7fd9617fa700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] conn(0x7fd94c0aace0 0x7fd94c0ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.123+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 --> [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd94c0ad7b0 con 0x7fd94c0aace0 2023-10-06T23:11:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.123+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95c0cceb0 con 0x7fd964106f90 2023-10-06T23:11:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.124+0000 7fd9637fe700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] conn(0x7fd94c0aace0 0x7fd94c0ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.124+0000 7fd963fff700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd94c0a1500 0x7fd94c0a39c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd954000c00 tx=0x7fd954009f10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.124+0000 7fd9637fe700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] conn(0x7fd94c0aace0 0x7fd94c0ad100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.125+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 <== osd.6 v2:172.21.15.8:6818/1054185701 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd94c0ad7b0 con 0x7fd94c0aace0 2023-10-06T23:11:46.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.144+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 --> [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd96404ebb0 con 0x7fd94c0aace0 2023-10-06T23:11:46.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.145+0000 7fd9617fa700 1 -- 172.21.15.8:0/724976509 <== osd.6 v2:172.21.15.8:6818/1054185701 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd96404ebb0 con 0x7fd94c0aace0 2023-10-06T23:11:46.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.145+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] conn(0x7fd94c0aace0 msgr2=0x7fd94c0ad100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.145+0000 7fd96a27e700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] conn(0x7fd94c0aace0 0x7fd94c0ad100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.145+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd94c0a1500 msgr2=0x7fd94c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.145+0000 7fd96a27e700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd94c0a1500 0x7fd94c0a39c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd954000c00 tx=0x7fd954009f10 comp rx=0 tx=0).stop 2023-10-06T23:11:46.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.145+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 msgr2=0x7fd96419b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.145+0000 7fd96a27e700 1 --2- 172.21.15.8:0/724976509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964106f90 0x7fd96419b990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00b9e0 tx=0x7fd95c00bcf0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.145+0000 7fd96881b700 1 -- 172.21.15.8:0/724976509 reap_dead start 2023-10-06T23:11:46.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.146+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 shutdown_connections 2023-10-06T23:11:46.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.146+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 >> 172.21.15.8:0/724976509 conn(0x7fd9640780a0 msgr2=0x7fd9640ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:46.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.146+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 shutdown_connections 2023-10-06T23:11:46.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.146+0000 7fd96a27e700 1 -- 172.21.15.8:0/724976509 wait complete. 2023-10-06T23:11:46.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:46 smithi156 ceph-mon[102862]: pgmap v314: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:11:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:46 smithi190 ceph-mon[102658]: pgmap v314: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:11:46.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 -- 172.21.15.8:0/1309897903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4808101950 msgr2=0x7f48081059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 --2- 172.21.15.8:0/1309897903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4808101950 0x7f48081059a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009990 tx=0x7f47f4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 -- 172.21.15.8:0/1309897903 shutdown_connections 2023-10-06T23:11:46.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 --2- 172.21.15.8:0/1309897903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4808106080 0x7f480810dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 --2- 172.21.15.8:0/1309897903 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4808100fa0 0x7f4808101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 --2- 172.21.15.8:0/1309897903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4808101950 0x7f48081059a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 -- 172.21.15.8:0/1309897903 >> 172.21.15.8:0/1309897903 conn(0x7f48080fc8b0 msgr2=0x7f48080fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 -- 172.21.15.8:0/1309897903 shutdown_connections 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.566+0000 7f480db0e700 1 -- 172.21.15.8:0/1309897903 wait complete. 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.567+0000 7f480db0e700 1 Processor -- start 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.567+0000 7f480db0e700 1 -- start start 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480db0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4808100fa0 0x7f48081a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480db0e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4808101950 0x7f48081a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480db0e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4808106080 0x7f480810c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480db0e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480810d140 con 0x7f4808101950 2023-10-06T23:11:46.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480db0e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480810d2b0 con 0x7f4808100fa0 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480db0e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480810d470 con 0x7f4808106080 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480cb0c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4808100fa0 0x7f48081a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480cb0c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4808100fa0 0x7f48081a20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35008/0 (socket says 172.21.15.8:35008) 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.568+0000 7f480cb0c700 1 -- 172.21.15.8:0/3757400870 learned_addr learned my addr 172.21.15.8:0/3757400870 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.569+0000 7f480d30d700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4808106080 0x7f480810c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.569+0000 7f480cb0c700 1 -- 172.21.15.8:0/3757400870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4808106080 msgr2=0x7f480810c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.569+0000 7f480cb0c700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4808106080 0x7f480810c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.569+0000 7f480cb0c700 1 -- 172.21.15.8:0/3757400870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4808101950 msgr2=0x7f48081a25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.569+0000 7f480cb0c700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4808101950 0x7f48081a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.569+0000 7f480cb0c700 1 -- 172.21.15.8:0/3757400870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40095f0 con 0x7f4808100fa0 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.569+0000 7f480cb0c700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4808100fa0 0x7f48081a20b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00e9a0 tx=0x7f47fc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:46.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.571+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc009790 con 0x7f4808100fa0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.571+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47fc00cbd0 con 0x7f4808100fa0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.571+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc018680 con 0x7f4808100fa0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.571+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480810d6f0 con 0x7f4808100fa0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.571+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48081aa1b0 con 0x7f4808100fa0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.572+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4808110e30 con 0x7f4808100fa0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.575+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f47fc00cd40 con 0x7f4808100fa0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.578+0000 7f4805ffb700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47f80a15d0 0x7f47f80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.578+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f47fc014070 con 0x7f4808100fa0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.578+0000 7f4807fff700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47f80a15d0 0x7f47f80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.578+0000 7f4805ffb700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] conn(0x7f47f80aadb0 0x7f47f80ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.578+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 --> [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47f80ad880 con 0x7f47f80aadb0 2023-10-06T23:11:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.578+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47fc0cd450 con 0x7f4808100fa0 2023-10-06T23:11:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.579+0000 7f4807fff700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47f80a15d0 0x7f47f80a3a90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005910 tx=0x7f47f4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.579+0000 7f480d30d700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] conn(0x7f47f80aadb0 0x7f47f80ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.580+0000 7f480d30d700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] conn(0x7f47f80aadb0 0x7f47f80ad1d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.581+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 <== osd.1 v2:172.21.15.156:6800/2428171530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f47f80ad880 con 0x7f47f80aadb0 2023-10-06T23:11:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.599+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 --> [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f480804f400 con 0x7f47f80aadb0 2023-10-06T23:11:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.600+0000 7f4805ffb700 1 -- 172.21.15.8:0/3757400870 <== osd.1 v2:172.21.15.156:6800/2428171530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f480804f400 con 0x7f47f80aadb0 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.600+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 >> [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] conn(0x7f47f80aadb0 msgr2=0x7f47f80ad1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.600+0000 7f480db0e700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] conn(0x7f47f80aadb0 0x7f47f80ad1d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.600+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47f80a15d0 msgr2=0x7f47f80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.600+0000 7f480db0e700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47f80a15d0 0x7f47f80a3a90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005910 tx=0x7f47f4005fb0 comp rx=0 tx=0).stop 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.600+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4808100fa0 msgr2=0x7f48081a20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.600+0000 7f480db0e700 1 --2- 172.21.15.8:0/3757400870 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4808100fa0 0x7f48081a20b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00e9a0 tx=0x7f47fc00ed60 comp rx=0 tx=0).stop 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.600+0000 7f480d30d700 1 -- 172.21.15.8:0/3757400870 reap_dead start 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.601+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 shutdown_connections 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.601+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 >> 172.21.15.8:0/3757400870 conn(0x7f48080fc8b0 msgr2=0x7f48080fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.601+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 shutdown_connections 2023-10-06T23:11:46.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.601+0000 7f480db0e700 1 -- 172.21.15.8:0/3757400870 wait complete. 2023-10-06T23:11:46.785 INFO:teuthology.orchestra.run.smithi008.stdout:34359738444 2023-10-06T23:11:46.785 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-06T23:11:47.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 -- 172.21.15.8:0/4113314467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 msgr2=0x7f9828102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 --2- 172.21.15.8:0/4113314467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 0x7f9828102490 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9818009990 tx=0x7f9818009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 -- 172.21.15.8:0/4113314467 shutdown_connections 2023-10-06T23:11:47.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 --2- 172.21.15.8:0/4113314467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 0x7f9828102490 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 --2- 172.21.15.8:0/4113314467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f982810b4e0 0x7f982810d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 --2- 172.21.15.8:0/4113314467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98281029d0 0x7f982810aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 -- 172.21.15.8:0/4113314467 >> 172.21.15.8:0/4113314467 conn(0x7f98280fb920 msgr2=0x7f98280fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:47.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 -- 172.21.15.8:0/4113314467 shutdown_connections 2023-10-06T23:11:47.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.489+0000 7f982e9c3700 1 -- 172.21.15.8:0/4113314467 wait complete. 2023-10-06T23:11:47.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.490+0000 7f982e9c3700 1 Processor -- start 2023-10-06T23:11:47.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.490+0000 7f982e9c3700 1 -- start start 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f982e9c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 0x7f98281991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f982e9c3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98281029d0 0x7f9828199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f982e9c3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f982810b4e0 0x7f982819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f982e9c3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982819e1a0 con 0x7f98281020b0 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f982e9c3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982819e310 con 0x7f982810b4e0 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f982e9c3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982819e4d0 con 0x7f98281029d0 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f9827fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 0x7f98281991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f9827fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 0x7f98281991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36936/0 (socket says 172.21.15.8:36936) 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f9827fff700 1 -- 172.21.15.8:0/3850323376 learned_addr learned my addr 172.21.15.8:0/3850323376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f98277fe700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98281029d0 0x7f9828199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f982cf60700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f982810b4e0 0x7f982819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f9827fff700 1 -- 172.21.15.8:0/3850323376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98281029d0 msgr2=0x7f9828199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f9827fff700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98281029d0 0x7f9828199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f9827fff700 1 -- 172.21.15.8:0/3850323376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f982810b4e0 msgr2=0x7f982819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f9827fff700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f982810b4e0 0x7f982819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.491+0000 7f9827fff700 1 -- 172.21.15.8:0/3850323376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180095f0 con 0x7f98281020b0 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.492+0000 7f9827fff700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 0x7f98281991e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9818005910 tx=0x7f9818009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.492+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981801d070 con 0x7f98281020b0 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.492+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9818003ec0 con 0x7f98281020b0 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.492+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800fb50 con 0x7f98281020b0 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.492+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982819e750 con 0x7f98281020b0 2023-10-06T23:11:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.492+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98281a5e40 con 0x7f98281020b0 2023-10-06T23:11:47.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.493+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98281110a0 con 0x7f98281020b0 2023-10-06T23:11:47.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.495+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f981800fd50 con 0x7f98281020b0 2023-10-06T23:11:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.497+0000 7f98257fa700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f98100a1480 0x7f98100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.497+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f98180cdfe0 con 0x7f98281020b0 2023-10-06T23:11:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.497+0000 7f98277fe700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f98100a1480 0x7f98100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.497+0000 7f98257fa700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] conn(0x7f98100aac60 0x7f98100ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.497+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 --> [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98100ad730 con 0x7f98100aac60 2023-10-06T23:11:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.497+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98180ce3f0 con 0x7f98281020b0 2023-10-06T23:11:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.497+0000 7f98277fe700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f98100a1480 0x7f98100a3940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f982819a800 tx=0x7f981c00b360 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:47.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.498+0000 7f982cf60700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] conn(0x7f98100aac60 0x7f98100ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.498+0000 7f982cf60700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] conn(0x7f98100aac60 0x7f98100ad080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:47.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.499+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 <== osd.7 v2:172.21.15.156:6816/3888485282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f98100ad730 con 0x7f98100aac60 2023-10-06T23:11:47.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.516+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 --> [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f982804ebb0 con 0x7f98100aac60 2023-10-06T23:11:47.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f98257fa700 1 -- 172.21.15.8:0/3850323376 <== osd.7 v2:172.21.15.156:6816/3888485282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f982804ebb0 con 0x7f98100aac60 2023-10-06T23:11:47.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 >> [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] conn(0x7f98100aac60 msgr2=0x7f98100ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f982e9c3700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] conn(0x7f98100aac60 0x7f98100ad080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f98100a1480 msgr2=0x7f98100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f982e9c3700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f98100a1480 0x7f98100a3940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f982819a800 tx=0x7f981c00b360 comp rx=0 tx=0).stop 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 msgr2=0x7f98281991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f982e9c3700 1 --2- 172.21.15.8:0/3850323376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98281020b0 0x7f98281991e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9818005910 tx=0x7f9818009580 comp rx=0 tx=0).stop 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f982cf60700 1 -- 172.21.15.8:0/3850323376 reap_dead start 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.517+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 shutdown_connections 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.518+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 >> 172.21.15.8:0/3850323376 conn(0x7f98280fb920 msgr2=0x7f982810d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.518+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 shutdown_connections 2023-10-06T23:11:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:47.518+0000 7f982e9c3700 1 -- 172.21.15.8:0/3850323376 wait complete. 2023-10-06T23:11:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.869+0000 7f4701972700 1 -- 172.21.15.8:0/500264607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46fc100f80 msgr2=0x7f46fc101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.869+0000 7f4701972700 1 --2- 172.21.15.8:0/500264607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46fc100f80 0x7f46fc101400 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46f00099c0 tx=0x7f46f0009cd0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.869+0000 7f4701972700 1 -- 172.21.15.8:0/500264607 shutdown_connections 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.869+0000 7f4701972700 1 --2- 172.21.15.8:0/500264607 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46fc101940 0x7f46fc10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.869+0000 7f4701972700 1 --2- 172.21.15.8:0/500264607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46fc106f90 0x7f46fc107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.869+0000 7f4701972700 1 --2- 172.21.15.8:0/500264607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46fc100f80 0x7f46fc101400 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.869+0000 7f4701972700 1 -- 172.21.15.8:0/500264607 >> 172.21.15.8:0/500264607 conn(0x7f46fc0780a0 msgr2=0x7f46fc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.869+0000 7f4701972700 1 -- 172.21.15.8:0/500264607 shutdown_connections 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.870+0000 7f4701972700 1 -- 172.21.15.8:0/500264607 wait complete. 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.871+0000 7f4701972700 1 Processor -- start 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.871+0000 7f4701972700 1 -- start start 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.871+0000 7f4701972700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46fc100f80 0x7f46fc10c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.871+0000 7f4701972700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46fc101940 0x7f46fc10cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.871+0000 7f4701972700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46fc106f90 0x7f46fc1b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.871+0000 7f4701972700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc10d820 con 0x7f46fc101940 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.871+0000 7f4701972700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1b2110 con 0x7f46fc106f90 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.871+0000 7f4701972700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1b2280 con 0x7f46fc100f80 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46fc106f90 0x7f46fc1b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46fc106f90 0x7f46fc1b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35022/0 (socket says 172.21.15.8:35022) 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fb7fe700 1 -- 172.21.15.8:0/403154008 learned_addr learned my addr 172.21.15.8:0/403154008 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fa7fc700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46fc101940 0x7f46fc10cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46faffd700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46fc100f80 0x7f46fc10c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fb7fe700 1 -- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46fc100f80 msgr2=0x7f46fc10c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fb7fe700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46fc100f80 0x7f46fc10c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fb7fe700 1 -- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46fc101940 msgr2=0x7f46fc10cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fb7fe700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46fc101940 0x7f46fc10cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fb7fe700 1 -- 172.21.15.8:0/403154008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec009520 con 0x7f46fc106f90 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46faffd700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46fc100f80 0x7f46fc10c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.872+0000 7f46fa7fc700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46fc101940 0x7f46fc10cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.873+0000 7f46fb7fe700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46fc106f90 0x7f46fc1b1bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007f10 tx=0x7f46f400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.873+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4017070 con 0x7f46fc106f90 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.873+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46f400f040 con 0x7f46fc106f90 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.873+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4005710 con 0x7f46fc106f90 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.873+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f00095f0 con 0x7f46fc106f90 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.873+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc1b2880 con 0x7f46fc106f90 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.874+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46fc04ebb0 con 0x7f46fc106f90 2023-10-06T23:11:47.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.879+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f46f4005870 con 0x7f46fc106f90 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.881+0000 7f4700970700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f46e40a1500 0x7f46e40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.882+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f46f40cc970 con 0x7f46fc106f90 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.882+0000 7f4700970700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] conn(0x7f46e40aacd0 0x7f46e40ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.882+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 --> [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46e40ad7a0 con 0x7f46e40aacd0 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.882+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46f40ccdc0 con 0x7f46fc106f90 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.882+0000 7f46faffd700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f46e40a1500 0x7f46e40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.883+0000 7f46fa7fc700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] conn(0x7f46e40aacd0 0x7f46e40ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.883+0000 7f46faffd700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f46e40a1500 0x7f46e40a39c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009e40 tx=0x7f46ec009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.883+0000 7f46fa7fc700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] conn(0x7f46e40aacd0 0x7f46e40ad0f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:47.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.884+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 <== osd.2 v2:172.21.15.190:6800/2202331729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f46e40ad7a0 con 0x7f46e40aacd0 2023-10-06T23:11:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.905+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 --> [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46fc111050 con 0x7f46e40aacd0 2023-10-06T23:11:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4700970700 1 -- 172.21.15.8:0/403154008 <== osd.2 v2:172.21.15.190:6800/2202331729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46f000ba90 con 0x7f46e40aacd0 2023-10-06T23:11:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] conn(0x7f46e40aacd0 msgr2=0x7f46e40ad0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4701972700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] conn(0x7f46e40aacd0 0x7f46e40ad0f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f46e40a1500 msgr2=0x7f46e40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4701972700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f46e40a1500 0x7f46e40a39c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009e40 tx=0x7f46ec009260 comp rx=0 tx=0).stop 2023-10-06T23:11:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46fc106f90 msgr2=0x7f46fc1b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:47.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4701972700 1 --2- 172.21.15.8:0/403154008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46fc106f90 0x7f46fc1b1bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007f10 tx=0x7f46f400d3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:47.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f46fb7fe700 1 -- 172.21.15.8:0/403154008 reap_dead start 2023-10-06T23:11:47.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 shutdown_connections 2023-10-06T23:11:47.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.907+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 >> 172.21.15.8:0/403154008 conn(0x7f46fc0780a0 msgr2=0x7f46fc102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:47.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.908+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 shutdown_connections 2023-10-06T23:11:47.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:46.908+0000 7f4701972700 1 -- 172.21.15.8:0/403154008 wait complete. 2023-10-06T23:11:48.084 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:48 smithi008 ceph-mon[98532]: pgmap v315: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-10-06T23:11:48.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:48 smithi156 ceph-mon[102862]: pgmap v315: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-10-06T23:11:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.251+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2357211497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101b30 msgr2=0x7fb5b0105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.251+0000 7fb5b4c6f700 1 --2- 172.21.15.8:0/2357211497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101b30 0x7fb5b0105b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009990 tx=0x7fb5a4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.252+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2357211497 shutdown_connections 2023-10-06T23:11:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.252+0000 7fb5b4c6f700 1 --2- 172.21.15.8:0/2357211497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b0106260 0x7fb5b010de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.252+0000 7fb5b4c6f700 1 --2- 172.21.15.8:0/2357211497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5b0101180 0x7fb5b0101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.252+0000 7fb5b4c6f700 1 --2- 172.21.15.8:0/2357211497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101b30 0x7fb5b0105b80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.252+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2357211497 >> 172.21.15.8:0/2357211497 conn(0x7fb5b00fc9d0 msgr2=0x7fb5b00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.252+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2357211497 shutdown_connections 2023-10-06T23:11:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.252+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2357211497 wait complete. 2023-10-06T23:11:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.253+0000 7fb5b4c6f700 1 Processor -- start 2023-10-06T23:11:48.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.254+0000 7fb5b4c6f700 1 -- start start 2023-10-06T23:11:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.254+0000 7fb5b4c6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101180 0x7fb5b00731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.254+0000 7fb5b4c6f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5b0101b30 0x7fb5b00736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5b4c6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b0106260 0x7fb5b0073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5b4c6f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b01a53c0 con 0x7fb5b0101180 2023-10-06T23:11:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5b4c6f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b01a5530 con 0x7fb5b0106260 2023-10-06T23:11:48.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5b4c6f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b01a56f0 con 0x7fb5b0101b30 2023-10-06T23:11:48.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101180 0x7fb5b00731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101180 0x7fb5b00731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36958/0 (socket says 172.21.15.8:36958) 2023-10-06T23:11:48.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 -- 172.21.15.8:0/2445746948 learned_addr learned my addr 172.21.15.8:0/2445746948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:48.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5add9b700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5b0101b30 0x7fb5b00736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5aed9d700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b0106260 0x7fb5b0073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 -- 172.21.15.8:0/2445746948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5b0101b30 msgr2=0x7fb5b00736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5b0101b30 0x7fb5b00736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 -- 172.21.15.8:0/2445746948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b0106260 msgr2=0x7fb5b0073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b0106260 0x7fb5b0073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 -- 172.21.15.8:0/2445746948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a40095f0 con 0x7fb5b0101180 2023-10-06T23:11:48.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5aed9d700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b0106260 0x7fb5b0073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:11:48.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.255+0000 7fb5ae59c700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101180 0x7fb5b00731b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000d950 tx=0x7fb5a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:48.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.256+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0009940 con 0x7fb5b0101180 2023-10-06T23:11:48.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.256+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b01a59d0 con 0x7fb5b0101180 2023-10-06T23:11:48.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.256+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5a0010460 con 0x7fb5b0101180 2023-10-06T23:11:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.256+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000f620 con 0x7fb5b0101180 2023-10-06T23:11:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.256+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b01a5ea0 con 0x7fb5b0101180 2023-10-06T23:11:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.257+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5b0111010 con 0x7fb5b0101180 2023-10-06T23:11:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.260+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb5a00105d0 con 0x7fb5b0101180 2023-10-06T23:11:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.262+0000 7fb59f7fe700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5980a1480 0x7fb5980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.262+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb5a00ccfd0 con 0x7fb5b0101180 2023-10-06T23:11:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.262+0000 7fb5add9b700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5980a1480 0x7fb5980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.263+0000 7fb59f7fe700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] conn(0x7fb5980aac60 0x7fb5980ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.263+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 --> [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5980ad730 con 0x7fb5980aac60 2023-10-06T23:11:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.263+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5a00cd340 con 0x7fb5b0101180 2023-10-06T23:11:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.263+0000 7fb5add9b700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5980a1480 0x7fb5980a3940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400b5c0 tx=0x7fb5a4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.263+0000 7fb5aed9d700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] conn(0x7fb5980aac60 0x7fb5980ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.264+0000 7fb5aed9d700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] conn(0x7fb5980aac60 0x7fb5980ad080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.265+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 <== osd.5 v2:172.21.15.190:6808/2047362324 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb5980ad730 con 0x7fb5980aac60 2023-10-06T23:11:48.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.290+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 --> [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5b004ebb0 con 0x7fb5980aac60 2023-10-06T23:11:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.290+0000 7fb59f7fe700 1 -- 172.21.15.8:0/2445746948 <== osd.5 v2:172.21.15.190:6808/2047362324 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb5b004ebb0 con 0x7fb5980aac60 2023-10-06T23:11:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 >> [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] conn(0x7fb5980aac60 msgr2=0x7fb5980ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] conn(0x7fb5980aac60 0x7fb5980ad080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5980a1480 msgr2=0x7fb5980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5980a1480 0x7fb5980a3940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400b5c0 tx=0x7fb5a4005fb0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101180 msgr2=0x7fb5b00731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 --2- 172.21.15.8:0/2445746948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5b0101180 0x7fb5b00731b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000d950 tx=0x7fb5a000dc60 comp rx=0 tx=0).stop 2023-10-06T23:11:48.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5aed9d700 1 -- 172.21.15.8:0/2445746948 reap_dead start 2023-10-06T23:11:48.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 shutdown_connections 2023-10-06T23:11:48.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 >> 172.21.15.8:0/2445746948 conn(0x7fb5b00fc9d0 msgr2=0x7fb5b00fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:48.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 shutdown_connections 2023-10-06T23:11:48.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.291+0000 7fb5b4c6f700 1 -- 172.21.15.8:0/2445746948 wait complete. 2023-10-06T23:11:48.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:48 smithi190 ceph-mon[102658]: pgmap v315: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-10-06T23:11:48.445 INFO:teuthology.orchestra.run.smithi008.stdout:55834574920 2023-10-06T23:11:48.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-06T23:11:48.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 -- 172.21.15.8:0/2775499381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300695b0 msgr2=0x7f2530105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 --2- 172.21.15.8:0/2775499381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300695b0 0x7f2530105b80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2524009990 tx=0x7f2524009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 -- 172.21.15.8:0/2775499381 shutdown_connections 2023-10-06T23:11:48.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 --2- 172.21.15.8:0/2775499381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25301062b0 0x7f253010de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 --2- 172.21.15.8:0/2775499381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2530068c00 0x7f2530068fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 --2- 172.21.15.8:0/2775499381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300695b0 0x7f2530105b80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 -- 172.21.15.8:0/2775499381 >> 172.21.15.8:0/2775499381 conn(0x7f2530075e00 msgr2=0x7f2530076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:48.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 -- 172.21.15.8:0/2775499381 shutdown_connections 2023-10-06T23:11:48.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.860+0000 7f2534a8a700 1 -- 172.21.15.8:0/2775499381 wait complete. 2023-10-06T23:11:48.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.861+0000 7f2534a8a700 1 Processor -- start 2023-10-06T23:11:48.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f2534a8a700 1 -- start start 2023-10-06T23:11:48.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f2534a8a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2530068c00 0x7f25300fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f2534a8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300695b0 0x7f2530100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f2534a8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301062b0 0x7f25301009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f2534a8a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301a5430 con 0x7f25301062b0 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f2534a8a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301a55a0 con 0x7f25300695b0 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f2534a8a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301a5760 con 0x7f2530068c00 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f252ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301062b0 0x7f25301009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f252e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2530068c00 0x7f25300fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f252e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2530068c00 0x7f25300fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45672/0 (socket says 172.21.15.8:45672) 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f252e59c700 1 -- 172.21.15.8:0/3792035910 learned_addr learned my addr 172.21.15.8:0/3792035910 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.862+0000 7f252ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301062b0 0x7f25301009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36978/0 (socket says 172.21.15.8:36978) 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f252dd9b700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300695b0 0x7f2530100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f252ed9d700 1 -- 172.21.15.8:0/3792035910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2530068c00 msgr2=0x7f25300fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f252ed9d700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2530068c00 0x7f25300fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f252ed9d700 1 -- 172.21.15.8:0/3792035910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300695b0 msgr2=0x7f2530100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f252ed9d700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25300695b0 0x7f2530100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f252ed9d700 1 -- 172.21.15.8:0/3792035910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25240095f0 con 0x7f25301062b0 2023-10-06T23:11:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f252ed9d700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301062b0 0x7f25301009f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2528007f10 tx=0x7f252800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800ddd0 con 0x7f25301062b0 2023-10-06T23:11:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f252800f040 con 0x7f25301062b0 2023-10-06T23:11:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.863+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528004380 con 0x7f25301062b0 2023-10-06T23:11:48.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.864+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25301a5a40 con 0x7f25301062b0 2023-10-06T23:11:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.864+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25301a5ec0 con 0x7f25301062b0 2023-10-06T23:11:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.864+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2530111010 con 0x7f25301062b0 2023-10-06T23:11:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.867+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2528003a00 con 0x7f25301062b0 2023-10-06T23:11:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.868+0000 7f251f7fe700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25180a1500 0x7f25180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.869+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f25280cd170 con 0x7f25301062b0 2023-10-06T23:11:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.869+0000 7f252e59c700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25180a1500 0x7f25180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.869+0000 7f251f7fe700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] conn(0x7f25180aace0 0x7f25180ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.869+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 --> [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25180ad7b0 con 0x7f25180aace0 2023-10-06T23:11:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.869+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25280cd5c0 con 0x7f25301062b0 2023-10-06T23:11:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.869+0000 7f252e59c700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25180a1500 0x7f25180a39c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2520005950 tx=0x7f2520004080 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.870+0000 7f252dd9b700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] conn(0x7f25180aace0 0x7f25180ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.870+0000 7f252dd9b700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] conn(0x7f25180aace0 0x7f25180ad100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.871+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 <== osd.4 v2:172.21.15.156:6808/2478764015 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f25180ad7b0 con 0x7f25180aace0 2023-10-06T23:11:48.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.891+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 --> [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f253004ebb0 con 0x7f25180aace0 2023-10-06T23:11:48.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f251f7fe700 1 -- 172.21.15.8:0/3792035910 <== osd.4 v2:172.21.15.156:6808/2478764015 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f253004ebb0 con 0x7f25180aace0 2023-10-06T23:11:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 >> [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] conn(0x7f25180aace0 msgr2=0x7f25180ad100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f2534a8a700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] conn(0x7f25180aace0 0x7f25180ad100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25180a1500 msgr2=0x7f25180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f2534a8a700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25180a1500 0x7f25180a39c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2520005950 tx=0x7f2520004080 comp rx=0 tx=0).stop 2023-10-06T23:11:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301062b0 msgr2=0x7f25301009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f2534a8a700 1 --2- 172.21.15.8:0/3792035910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301062b0 0x7f25301009f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2528007f10 tx=0x7f252800d3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f252ed9d700 1 -- 172.21.15.8:0/3792035910 reap_dead start 2023-10-06T23:11:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 shutdown_connections 2023-10-06T23:11:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.892+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 >> 172.21.15.8:0/3792035910 conn(0x7f2530075e00 msgr2=0x7f25300ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.893+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 shutdown_connections 2023-10-06T23:11:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:48.893+0000 7f2534a8a700 1 -- 172.21.15.8:0/3792035910 wait complete. 2023-10-06T23:11:48.960 INFO:teuthology.orchestra.run.smithi008.stdout:77309411395 2023-10-06T23:11:48.960 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-06T23:11:49.334 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-06T23:11:49.335 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2023-10-06T23:11:49.335 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-06T23:11:49.335 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-10-06T23:11:49.335 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-06T23:11:49.335 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-06T23:11:49.335 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-06T23:11:49.335 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2023-10-06T23:11:49.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-06T23:11:49.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2023-10-06T23:11:49.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-06T23:11:49.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-10-06T23:11:49.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-06T23:11:49.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-06T23:11:49.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-06T23:11:49.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2023-10-06T23:11:49.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-06T23:11:49.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2023-10-06T23:11:49.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-06T23:11:49.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-10-06T23:11:49.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-06T23:11:49.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-06T23:11:49.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-06T23:11:49.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2023-10-06T23:11:49.446 INFO:teuthology.orchestra.run.smithi008.stdout:201863462958 2023-10-06T23:11:49.446 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-06T23:11:50.340 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: pgmap v316: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:11:50.340 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-06T23:11:50.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2023-10-06T23:11:50.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-06T23:11:50.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-10-06T23:11:50.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-06T23:11:50.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-06T23:11:50.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-06T23:11:50.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2023-10-06T23:11:50.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:50 smithi008 ceph-mon[98532]: osdmap e87: 12 total, 12 up, 12 in 2023-10-06T23:11:50.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: pgmap v316: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2023-10-06T23:11:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:50 smithi156 ceph-mon[102862]: osdmap e87: 12 total, 12 up, 12 in 2023-10-06T23:11:50.415 INFO:teuthology.orchestra.run.smithi008.stdout:223338299432 2023-10-06T23:11:50.416 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-06T23:11:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: pgmap v316: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2023-10-06T23:11:50.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:50 smithi190 ceph-mon[102658]: osdmap e87: 12 total, 12 up, 12 in 2023-10-06T23:11:51.170 INFO:teuthology.orchestra.run.smithi008.stdout:167503724595 2023-10-06T23:11:51.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-06T23:11:51.239 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:51 smithi008 ceph-mon[98532]: osdmap e88: 12 total, 12 up, 12 in 2023-10-06T23:11:51.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 -- 172.21.15.8:0/3313335503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 msgr2=0x7effd010fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 --2- 172.21.15.8:0/3313335503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 0x7effd010fe00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7effc800b0a0 tx=0x7effc800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 -- 172.21.15.8:0/3313335503 shutdown_connections 2023-10-06T23:11:51.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 --2- 172.21.15.8:0/3313335503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 0x7effd010fe00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 --2- 172.21.15.8:0/3313335503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effd00689a0 0x7effd0068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 --2- 172.21.15.8:0/3313335503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd00692c0 0x7effd010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 -- 172.21.15.8:0/3313335503 >> 172.21.15.8:0/3313335503 conn(0x7effd0075e00 msgr2=0x7effd0076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 -- 172.21.15.8:0/3313335503 shutdown_connections 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.926+0000 7effd8393700 1 -- 172.21.15.8:0/3313335503 wait complete. 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.927+0000 7effd8393700 1 Processor -- start 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.927+0000 7effd8393700 1 -- start start 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd8393700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effd00689a0 0x7effd0199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd8393700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd00692c0 0x7effd0199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd8393700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 0x7effd019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd8393700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd019e1e0 con 0x7effd010da10 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd8393700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd019e350 con 0x7effd00689a0 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd8393700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd019e510 con 0x7effd00692c0 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd6930700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 0x7effd019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd6930700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 0x7effd019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42320/0 (socket says 172.21.15.8:42320) 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd6930700 1 -- 172.21.15.8:0/4284917568 learned_addr learned my addr 172.21.15.8:0/4284917568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd612f700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effd00689a0 0x7effd0199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd592e700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd00692c0 0x7effd0199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd6930700 1 -- 172.21.15.8:0/4284917568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd00692c0 msgr2=0x7effd0199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd6930700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd00692c0 0x7effd0199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd6930700 1 -- 172.21.15.8:0/4284917568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effd00689a0 msgr2=0x7effd0199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd6930700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effd00689a0 0x7effd0199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.928+0000 7effd6930700 1 -- 172.21.15.8:0/4284917568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8009d00 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.929+0000 7effd6930700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 0x7effd019dbd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7effc800d010 tx=0x7effc800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.929+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc800e040 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.929+0000 7effd8393700 1 -- 172.21.15.8:0/4284917568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd019e790 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.929+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effc8003e10 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.929+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80052a0 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.929+0000 7effd8393700 1 -- 172.21.15.8:0/4284917568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd01a6050 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.930+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effb8000fc0 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.933+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7effc801d480 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.934+0000 7effc77fe700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7effbc0a1500 0x7effbc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.935+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7effc80ce4f0 con 0x7effd010da10 2023-10-06T23:11:51.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.935+0000 7effd612f700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7effbc0a1500 0x7effbc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.935+0000 7effc77fe700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] conn(0x7effbc0aaf10 0x7effbc0ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.935+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 --> [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effbc0ada80 con 0x7effbc0aaf10 2023-10-06T23:11:51.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.935+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7effc80ce860 con 0x7effd010da10 2023-10-06T23:11:51.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.935+0000 7effd592e700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] conn(0x7effbc0aaf10 0x7effbc0ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.935+0000 7effd612f700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7effbc0a1500 0x7effbc0a39c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7effcc009c60 tx=0x7effcc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:51.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.936+0000 7effd592e700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] conn(0x7effbc0aaf10 0x7effbc0ad3b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:51.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.937+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 <== osd.9 v2:172.21.15.8:6826/3250757826 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7effbc0ada80 con 0x7effbc0aaf10 2023-10-06T23:11:51.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.954+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 --> [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7effb8002cb0 con 0x7effbc0aaf10 2023-10-06T23:11:51.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc77fe700 1 -- 172.21.15.8:0/4284917568 <== osd.9 v2:172.21.15.8:6826/3250757826 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7effb8002cb0 con 0x7effbc0aaf10 2023-10-06T23:11:51.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] conn(0x7effbc0aaf10 msgr2=0x7effbc0ad3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc57fa700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] conn(0x7effbc0aaf10 0x7effbc0ad3b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7effbc0a1500 msgr2=0x7effbc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc57fa700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7effbc0a1500 0x7effbc0a39c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7effcc009c60 tx=0x7effcc009260 comp rx=0 tx=0).stop 2023-10-06T23:11:51.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 msgr2=0x7effd019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc57fa700 1 --2- 172.21.15.8:0/4284917568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd010da10 0x7effd019dbd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7effc800d010 tx=0x7effc800bce0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effd6930700 1 -- 172.21.15.8:0/4284917568 reap_dead start 2023-10-06T23:11:51.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 shutdown_connections 2023-10-06T23:11:51.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.955+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 >> 172.21.15.8:0/4284917568 conn(0x7effd0075e00 msgr2=0x7effd010ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:51.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.956+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 shutdown_connections 2023-10-06T23:11:51.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:50.956+0000 7effc57fa700 1 -- 172.21.15.8:0/4284917568 wait complete. 2023-10-06T23:11:51.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:51 smithi156 ceph-mon[102862]: osdmap e88: 12 total, 12 up, 12 in 2023-10-06T23:11:51.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:51 smithi190 ceph-mon[102658]: osdmap e88: 12 total, 12 up, 12 in 2023-10-06T23:11:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 -- 172.21.15.8:0/429068120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 msgr2=0x7fc0ec101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 --2- 172.21.15.8:0/429068120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 0x7fc0ec101400 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0099c0 tx=0x7fc0dc009cd0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 -- 172.21.15.8:0/429068120 shutdown_connections 2023-10-06T23:11:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 --2- 172.21.15.8:0/429068120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0ec101940 0x7fc0ec10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 --2- 172.21.15.8:0/429068120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0ec106f90 0x7fc0ec107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 --2- 172.21.15.8:0/429068120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 0x7fc0ec101400 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 -- 172.21.15.8:0/429068120 >> 172.21.15.8:0/429068120 conn(0x7fc0ec0780a0 msgr2=0x7fc0ec0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:51.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 -- 172.21.15.8:0/429068120 shutdown_connections 2023-10-06T23:11:51.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.640+0000 7fc0f44a0700 1 -- 172.21.15.8:0/429068120 wait complete. 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.641+0000 7fc0f44a0700 1 Processor -- start 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.641+0000 7fc0f44a0700 1 -- start start 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f44a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 0x7fc0ec196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f44a0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0ec101940 0x7fc0ec197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f44a0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0ec106f90 0x7fc0ec19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f44a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec19bec0 con 0x7fc0ec100f80 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f44a0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec19c030 con 0x7fc0ec106f90 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f44a0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec19c1f0 con 0x7fc0ec101940 2023-10-06T23:11:51.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f223c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 0x7fc0ec196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f223c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 0x7fc0ec196f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42338/0 (socket says 172.21.15.8:42338) 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f223c700 1 -- 172.21.15.8:0/2648594657 learned_addr learned my addr 172.21.15.8:0/2648594657 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.642+0000 7fc0f1a3b700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0ec101940 0x7fc0ec197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f2a3d700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0ec106f90 0x7fc0ec19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f223c700 1 -- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0ec101940 msgr2=0x7fc0ec197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f223c700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0ec101940 0x7fc0ec197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f223c700 1 -- 172.21.15.8:0/2648594657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0ec106f90 msgr2=0x7fc0ec19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f223c700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0ec106f90 0x7fc0ec19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f223c700 1 -- 172.21.15.8:0/2648594657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0095f0 con 0x7fc0ec100f80 2023-10-06T23:11:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f1a3b700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0ec101940 0x7fc0ec197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f223c700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 0x7fc0ec196f00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800d950 tx=0x7fc0e800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8009b40 con 0x7fc0ec100f80 2023-10-06T23:11:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ec19c4d0 con 0x7fc0ec100f80 2023-10-06T23:11:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0e8009ca0 con 0x7fc0ec100f80 2023-10-06T23:11:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e800f620 con 0x7fc0ec100f80 2023-10-06T23:11:51.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.643+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ec1a3d30 con 0x7fc0ec100f80 2023-10-06T23:11:51.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.644+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0ec04ebb0 con 0x7fc0ec100f80 2023-10-06T23:11:51.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.647+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc0e8010460 con 0x7fc0ec100f80 2023-10-06T23:11:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.648+0000 7fc0e37fe700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc0d80a1480 0x7fc0d80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.648+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc0e80cd160 con 0x7fc0ec100f80 2023-10-06T23:11:51.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.648+0000 7fc0f1a3b700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc0d80a1480 0x7fc0d80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.649+0000 7fc0e37fe700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] conn(0x7fc0d80aafc0 0x7fc0d80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:51.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.649+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 --> [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0d80adb30 con 0x7fc0d80aafc0 2023-10-06T23:11:51.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.649+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0e80cd4d0 con 0x7fc0ec100f80 2023-10-06T23:11:51.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.649+0000 7fc0f1a3b700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc0d80a1480 0x7fc0d80a3940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec198520 tx=0x7fc0dc005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.649+0000 7fc0f2a3d700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] conn(0x7fc0d80aafc0 0x7fc0d80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:51.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.650+0000 7fc0f2a3d700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] conn(0x7fc0d80aafc0 0x7fc0d80ad460 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:51.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.651+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 <== osd.8 v2:172.21.15.190:6816/1600949484 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc0d80adb30 con 0x7fc0d80aafc0 2023-10-06T23:11:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.671+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 --> [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc0ec111000 con 0x7fc0d80aafc0 2023-10-06T23:11:51.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0e37fe700 1 -- 172.21.15.8:0/2648594657 <== osd.8 v2:172.21.15.190:6816/1600949484 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc0e4009900 con 0x7fc0d80aafc0 2023-10-06T23:11:51.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] conn(0x7fc0d80aafc0 msgr2=0x7fc0d80ad460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f44a0700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] conn(0x7fc0d80aafc0 0x7fc0d80ad460 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc0d80a1480 msgr2=0x7fc0d80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f44a0700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc0d80a1480 0x7fc0d80a3940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec198520 tx=0x7fc0dc005fb0 comp rx=0 tx=0).stop 2023-10-06T23:11:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 msgr2=0x7fc0ec196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f44a0700 1 --2- 172.21.15.8:0/2648594657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0ec100f80 0x7fc0ec196f00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800d950 tx=0x7fc0e800dd10 comp rx=0 tx=0).stop 2023-10-06T23:11:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f2a3d700 1 -- 172.21.15.8:0/2648594657 reap_dead start 2023-10-06T23:11:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 shutdown_connections 2023-10-06T23:11:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.672+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 >> 172.21.15.8:0/2648594657 conn(0x7fc0ec0780a0 msgr2=0x7fc0ec0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.673+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 shutdown_connections 2023-10-06T23:11:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:51.673+0000 7fc0f44a0700 1 -- 172.21.15.8:0/2648594657 wait complete. 2023-10-06T23:11:51.895 INFO:teuthology.orchestra.run.smithi008.stdout:146028888122 2023-10-06T23:11:51.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-06T23:11:52.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.033+0000 7f3055ee4700 1 -- 172.21.15.8:0/3791300005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3050111bc0 msgr2=0x7f3050113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.033+0000 7f3055ee4700 1 --2- 172.21.15.8:0/3791300005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3050111bc0 0x7f3050113fb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f304800b0a0 tx=0x7f304800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.034+0000 7f3055ee4700 1 -- 172.21.15.8:0/3791300005 shutdown_connections 2023-10-06T23:11:52.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.034+0000 7f3055ee4700 1 --2- 172.21.15.8:0/3791300005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3050111bc0 0x7f3050113fb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.034+0000 7f3055ee4700 1 --2- 172.21.15.8:0/3791300005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3050074ef0 0x7f30500730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.034+0000 7f3055ee4700 1 --2- 172.21.15.8:0/3791300005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3050073620 0x7f3050073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.034+0000 7f3055ee4700 1 -- 172.21.15.8:0/3791300005 >> 172.21.15.8:0/3791300005 conn(0x7f30500780a0 msgr2=0x7f30500784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:52.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.034+0000 7f3055ee4700 1 -- 172.21.15.8:0/3791300005 shutdown_connections 2023-10-06T23:11:52.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.034+0000 7f3055ee4700 1 -- 172.21.15.8:0/3791300005 wait complete. 2023-10-06T23:11:52.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.035+0000 7f3055ee4700 1 Processor -- start 2023-10-06T23:11:52.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.036+0000 7f3055ee4700 1 -- start start 2023-10-06T23:11:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.036+0000 7f3055ee4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3050073620 0x7f305019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.036+0000 7f3055ee4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3050074ef0 0x7f305019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.037+0000 7f3055ee4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3050111bc0 0x7f30501a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.037+0000 7f3055ee4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501a2580 con 0x7f3050073620 2023-10-06T23:11:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.037+0000 7f3055ee4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501a26f0 con 0x7f3050074ef0 2023-10-06T23:11:52.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.037+0000 7f3055ee4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501a28b0 con 0x7f3050111bc0 2023-10-06T23:11:52.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.037+0000 7f304effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3050074ef0 0x7f305019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.037+0000 7f304effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3050074ef0 0x7f305019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57360/0 (socket says 172.21.15.8:57360) 2023-10-06T23:11:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.037+0000 7f304effd700 1 -- 172.21.15.8:0/2156403741 learned_addr learned my addr 172.21.15.8:0/2156403741 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.038+0000 7f304ffff700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3050111bc0 0x7f30501a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.038+0000 7f304ffff700 1 -- 172.21.15.8:0/2156403741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3050074ef0 msgr2=0x7f305019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.038+0000 7f304ffff700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3050074ef0 0x7f305019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.038+0000 7f304ffff700 1 -- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3050073620 msgr2=0x7f305019d630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T23:11:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.038+0000 7f304ffff700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3050073620 0x7f305019d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.038+0000 7f304ffff700 1 -- 172.21.15.8:0/2156403741 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3048009d00 con 0x7f3050111bc0 2023-10-06T23:11:52.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.039+0000 7f304ffff700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3050111bc0 0x7f30501a1f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f30500740c0 tx=0x7f3048008e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.039+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800e040 con 0x7f3050111bc0 2023-10-06T23:11:52.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.039+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f304801d470 con 0x7f3050111bc0 2023-10-06T23:11:52.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.039+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30501a2b30 con 0x7f3050111bc0 2023-10-06T23:11:52.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.039+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480052c0 con 0x7f3050111bc0 2023-10-06T23:11:52.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.039+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30501aa3f0 con 0x7f3050111bc0 2023-10-06T23:11:52.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.041+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f305004ebb0 con 0x7f3050111bc0 2023-10-06T23:11:52.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.045+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3048005420 con 0x7f3050111bc0 2023-10-06T23:11:52.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.047+0000 7f304cff9700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30380a1650 0x7f30380a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.047+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f30480ce7f0 con 0x7f3050111bc0 2023-10-06T23:11:52.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.047+0000 7f304cff9700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] conn(0x7f30380ab190 0x7f30380ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.047+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 --> [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30380add00 con 0x7f30380ab190 2023-10-06T23:11:52.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.047+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30480ceba0 con 0x7f3050111bc0 2023-10-06T23:11:52.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.048+0000 7f304f7fe700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30380a1650 0x7f30380a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.048+0000 7f304f7fe700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30380a1650 0x7f30380a3b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3040009a70 tx=0x7f3040009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.049+0000 7f304effd700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] conn(0x7f30380ab190 0x7f30380ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.050+0000 7f304effd700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] conn(0x7f30380ab190 0x7f30380ad630 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.052+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 <== osd.3 v2:172.21.15.8:6810/322809496 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f30380add00 con 0x7f30380ab190 2023-10-06T23:11:52.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.084+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 --> [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30501175b0 con 0x7f30380ab190 2023-10-06T23:11:52.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.085+0000 7f304cff9700 1 -- 172.21.15.8:0/2156403741 <== osd.3 v2:172.21.15.8:6810/322809496 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3044009e90 con 0x7f30380ab190 2023-10-06T23:11:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.086+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] conn(0x7f30380ab190 msgr2=0x7f30380ad630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.086+0000 7f3055ee4700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] conn(0x7f30380ab190 0x7f30380ad630 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.087+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30380a1650 msgr2=0x7f30380a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.087+0000 7f3055ee4700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30380a1650 0x7f30380a3b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3040009a70 tx=0x7f3040009260 comp rx=0 tx=0).stop 2023-10-06T23:11:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.087+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3050111bc0 msgr2=0x7f30501a1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.087+0000 7f3055ee4700 1 --2- 172.21.15.8:0/2156403741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3050111bc0 0x7f30501a1f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f30500740c0 tx=0x7f3048008e50 comp rx=0 tx=0).stop 2023-10-06T23:11:52.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.089+0000 7f304ffff700 1 -- 172.21.15.8:0/2156403741 reap_dead start 2023-10-06T23:11:52.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.089+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 shutdown_connections 2023-10-06T23:11:52.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.089+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 >> 172.21.15.8:0/2156403741 conn(0x7f30500780a0 msgr2=0x7f3050110760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:52.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.089+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 shutdown_connections 2023-10-06T23:11:52.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.089+0000 7f3055ee4700 1 -- 172.21.15.8:0/2156403741 wait complete. 2023-10-06T23:11:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 -- 172.21.15.8:0/1047104238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29040692c0 msgr2=0x7f290410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 --2- 172.21.15.8:0/1047104238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29040692c0 0x7f290410d4d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009990 tx=0x7f28f8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 -- 172.21.15.8:0/1047104238 shutdown_connections 2023-10-06T23:11:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 --2- 172.21.15.8:0/1047104238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f290410da10 0x7f290410fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 --2- 172.21.15.8:0/1047104238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29040689a0 0x7f2904068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 --2- 172.21.15.8:0/1047104238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29040692c0 0x7f290410d4d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 -- 172.21.15.8:0/1047104238 >> 172.21.15.8:0/1047104238 conn(0x7f2904075e00 msgr2=0x7f2904076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 -- 172.21.15.8:0/1047104238 shutdown_connections 2023-10-06T23:11:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.287+0000 7f2909931700 1 -- 172.21.15.8:0/1047104238 wait complete. 2023-10-06T23:11:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.288+0000 7f2909931700 1 Processor -- start 2023-10-06T23:11:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.288+0000 7f2909931700 1 -- start start 2023-10-06T23:11:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2909931700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29040689a0 0x7f2904199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2909931700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29040692c0 0x7f2904199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2909931700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290410da10 0x7f290419daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2909931700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290419e100 con 0x7f290410da10 2023-10-06T23:11:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2909931700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290419e270 con 0x7f29040692c0 2023-10-06T23:11:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2909931700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290419e430 con 0x7f29040689a0 2023-10-06T23:11:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2902ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29040689a0 0x7f2904199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2902ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29040689a0 0x7f2904199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60546/0 (socket says 172.21.15.8:60546) 2023-10-06T23:11:52.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f2902ffd700 1 -- 172.21.15.8:0/3322801987 learned_addr learned my addr 172.21.15.8:0/3322801987 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f29037fe700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290410da10 0x7f290419daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.289+0000 7f29027fc700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29040692c0 0x7f2904199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f2902ffd700 1 -- 172.21.15.8:0/3322801987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29040692c0 msgr2=0x7f2904199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f2902ffd700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29040692c0 0x7f2904199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f2902ffd700 1 -- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290410da10 msgr2=0x7f290419daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f2902ffd700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290410da10 0x7f290419daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f2902ffd700 1 -- 172.21.15.8:0/3322801987 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80095f0 con 0x7f29040689a0 2023-10-06T23:11:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f29037fe700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f290410da10 0x7f290419daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:11:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f2902ffd700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29040689a0 0x7f2904199140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f28f400e9a0 tx=0x7f28f400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4009790 con 0x7f29040689a0 2023-10-06T23:11:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28f400cbd0 con 0x7f29040689a0 2023-10-06T23:11:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290419e710 con 0x7f29040689a0 2023-10-06T23:11:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.290+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4018680 con 0x7f29040689a0 2023-10-06T23:11:52.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.291+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29041a5f70 con 0x7f29040689a0 2023-10-06T23:11:52.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.291+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2904113240 con 0x7f29040689a0 2023-10-06T23:11:52.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.294+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f28f400cd40 con 0x7f29040689a0 2023-10-06T23:11:52.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.295+0000 7f290892f700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f28ec0a1500 0x7f28ec0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.295+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f28f4014070 con 0x7f29040689a0 2023-10-06T23:11:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.296+0000 7f290892f700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] conn(0x7f28ec0ab040 0x7f28ec0ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.296+0000 7f29027fc700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f28ec0a1500 0x7f28ec0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.296+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 --> [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28ec0adbb0 con 0x7f28ec0ab040 2023-10-06T23:11:52.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.296+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28f40cd170 con 0x7f29040689a0 2023-10-06T23:11:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.296+0000 7f29037fe700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] conn(0x7f28ec0ab040 0x7f28ec0ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.297+0000 7f29027fc700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f28ec0a1500 0x7f28ec0a39c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28f8006010 tx=0x7f28f800b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.297+0000 7f29037fe700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] conn(0x7f28ec0ab040 0x7f28ec0ad4e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.298+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 <== osd.10 v2:172.21.15.156:6824/3857289859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f28ec0adbb0 con 0x7f28ec0ab040 2023-10-06T23:11:52.316 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:52 smithi008 ceph-mon[98532]: pgmap v319: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:52.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.315+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 --> [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f290404ebb0 con 0x7f28ec0ab040 2023-10-06T23:11:52.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.316+0000 7f290892f700 1 -- 172.21.15.8:0/3322801987 <== osd.10 v2:172.21.15.156:6824/3857289859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f290404ebb0 con 0x7f28ec0ab040 2023-10-06T23:11:52.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.316+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 >> [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] conn(0x7f28ec0ab040 msgr2=0x7f28ec0ad4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.316+0000 7f2909931700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] conn(0x7f28ec0ab040 0x7f28ec0ad4e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.316+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f28ec0a1500 msgr2=0x7f28ec0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.316+0000 7f2909931700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f28ec0a1500 0x7f28ec0a39c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28f8006010 tx=0x7f28f800b260 comp rx=0 tx=0).stop 2023-10-06T23:11:52.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.316+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29040689a0 msgr2=0x7f2904199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.316+0000 7f2909931700 1 --2- 172.21.15.8:0/3322801987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29040689a0 0x7f2904199140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f28f400e9a0 tx=0x7f28f400ed60 comp rx=0 tx=0).stop 2023-10-06T23:11:52.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.317+0000 7f29037fe700 1 -- 172.21.15.8:0/3322801987 reap_dead start 2023-10-06T23:11:52.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.317+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 shutdown_connections 2023-10-06T23:11:52.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.317+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 >> 172.21.15.8:0/3322801987 conn(0x7f2904075e00 msgr2=0x7f290410eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:52.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.317+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 shutdown_connections 2023-10-06T23:11:52.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.317+0000 7f2909931700 1 -- 172.21.15.8:0/3322801987 wait complete. 2023-10-06T23:11:52.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:52 smithi156 ceph-mon[102862]: pgmap v319: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 -- 172.21.15.8:0/904706225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3444101940 msgr2=0x7f344410ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 --2- 172.21.15.8:0/904706225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3444101940 0x7f344410ddb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f343c009fc0 tx=0x7f343c00b330 comp rx=0 tx=0).stop 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 -- 172.21.15.8:0/904706225 shutdown_connections 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 --2- 172.21.15.8:0/904706225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3444101940 0x7f344410ddb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 --2- 172.21.15.8:0/904706225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3444106f90 0x7f3444107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 --2- 172.21.15.8:0/904706225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3444100f80 0x7f3444101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 -- 172.21.15.8:0/904706225 >> 172.21.15.8:0/904706225 conn(0x7f34440780a0 msgr2=0x7f34440784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 -- 172.21.15.8:0/904706225 shutdown_connections 2023-10-06T23:11:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.350+0000 7f344af44700 1 -- 172.21.15.8:0/904706225 wait complete. 2023-10-06T23:11:52.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.352+0000 7f344af44700 1 Processor -- start 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.352+0000 7f344af44700 1 -- start start 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.352+0000 7f344af44700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3444100f80 0x7f34441991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.352+0000 7f344af44700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3444101940 0x7f34441996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.352+0000 7f344af44700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3444106f90 0x7f344419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.352+0000 7f344af44700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344419e160 con 0x7f3444106f90 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.352+0000 7f344af44700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344419e2d0 con 0x7f3444101940 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.352+0000 7f344af44700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344419e490 con 0x7f3444100f80 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3444106f90 0x7f344419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3444106f90 0x7f344419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42402/0 (socket says 172.21.15.8:42402) 2023-10-06T23:11:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 -- 172.21.15.8:0/208967150 learned_addr learned my addr 172.21.15.8:0/208967150 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f3443fff700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3444101940 0x7f34441996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f3448ce0700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3444100f80 0x7f34441991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 -- 172.21.15.8:0/208967150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3444100f80 msgr2=0x7f34441991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3444100f80 0x7f34441991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 -- 172.21.15.8:0/208967150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3444101940 msgr2=0x7f34441996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3444101940 0x7f34441996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 -- 172.21.15.8:0/208967150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009520 con 0x7f3444106f90 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.353+0000 7f34494e1700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3444106f90 0x7f344419db50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f343c008a70 tx=0x7f343c008aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.354+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c00e040 con 0x7f3444106f90 2023-10-06T23:11:52.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.354+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c009c40 con 0x7f3444106f90 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.354+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f343c00bbf0 con 0x7f3444106f90 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.354+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0052a0 con 0x7f3444106f90 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.354+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34441a5e00 con 0x7f3444106f90 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.355+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f344404ebb0 con 0x7f3444106f90 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.358+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f343c01d470 con 0x7f3444106f90 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.359+0000 7f3441ffb700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f34340a1500 0x7f34340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.359+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f343c0ce710 con 0x7f3444106f90 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.359+0000 7f3448ce0700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f34340a1500 0x7f34340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.359+0000 7f3441ffb700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] conn(0x7f34340ab040 0x7f34340ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.359+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 --> [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34340adbb0 con 0x7f34340ab040 2023-10-06T23:11:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.360+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f343c0cea80 con 0x7f3444106f90 2023-10-06T23:11:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.360+0000 7f3448ce0700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f34340a1500 0x7f34340a39c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3438005950 tx=0x7f34380058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.360+0000 7f3443fff700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] conn(0x7f34340ab040 0x7f34340ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.361+0000 7f3443fff700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] conn(0x7f34340ab040 0x7f34340ad4e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:52.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.362+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 <== osd.11 v2:172.21.15.190:6824/2460808720 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f34340adbb0 con 0x7f34340ab040 2023-10-06T23:11:52.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.379+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 --> [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3444111000 con 0x7f34340ab040 2023-10-06T23:11:52.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.380+0000 7f3441ffb700 1 -- 172.21.15.8:0/208967150 <== osd.11 v2:172.21.15.190:6824/2460808720 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3430009ed0 con 0x7f34340ab040 2023-10-06T23:11:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.380+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 >> [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] conn(0x7f34340ab040 msgr2=0x7f34340ad4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.380+0000 7f344af44700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] conn(0x7f34340ab040 0x7f34340ad4e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.380+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f34340a1500 msgr2=0x7f34340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.380+0000 7f344af44700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f34340a1500 0x7f34340a39c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3438005950 tx=0x7f34380058e0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.380+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3444106f90 msgr2=0x7f344419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.380+0000 7f344af44700 1 --2- 172.21.15.8:0/208967150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3444106f90 0x7f344419db50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f343c008a70 tx=0x7f343c008aa0 comp rx=0 tx=0).stop 2023-10-06T23:11:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.380+0000 7f34494e1700 1 -- 172.21.15.8:0/208967150 reap_dead start 2023-10-06T23:11:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.381+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 shutdown_connections 2023-10-06T23:11:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.381+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 >> 172.21.15.8:0/208967150 conn(0x7f34440780a0 msgr2=0x7f34440731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.381+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 shutdown_connections 2023-10-06T23:11:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:52.381+0000 7f344af44700 1 -- 172.21.15.8:0/208967150 wait complete. 2023-10-06T23:11:52.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:52 smithi190 ceph-mon[102658]: pgmap v319: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:52.783 INFO:teuthology.orchestra.run.smithi008.stdout:111669149758 2023-10-06T23:11:52.784 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-06T23:11:53.149 INFO:teuthology.orchestra.run.smithi008.stdout:313532612634 2023-10-06T23:11:53.149 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-06T23:11:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:53 smithi156 ceph-mon[102862]: pgmap v320: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:53 smithi008 ceph-mon[98532]: pgmap v320: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:53 smithi190 ceph-mon[102658]: pgmap v320: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:53.804 INFO:teuthology.orchestra.run.smithi008.stdout:257698037797 2023-10-06T23:11:53.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-06T23:11:54.040 INFO:teuthology.orchestra.run.smithi008.stdout:347892350997 2023-10-06T23:11:54.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-06T23:11:54.078 INFO:teuthology.orchestra.run.smithi008.stdout:292057776159 2023-10-06T23:11:54.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-06T23:11:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:54.398 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:54.614 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:54.616 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:54.616 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:54.712 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:56.123 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:56 smithi008 ceph-mon[98532]: pgmap v321: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:56.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:56 smithi156 ceph-mon[102862]: pgmap v321: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:56 smithi190 ceph-mon[102658]: pgmap v321: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:58.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:11:58 smithi008 ceph-mon[98532]: pgmap v322: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:58.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:11:58 smithi156 ceph-mon[102862]: pgmap v322: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:58.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:11:58 smithi190 ceph-mon[102658]: pgmap v322: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 5 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:11:58.868 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:11:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.434+0000 7f5e204fe700 1 -- 172.21.15.8:0/1393564113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e180730e0 msgr2=0x7f5e180734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.434+0000 7f5e204fe700 1 --2- 172.21.15.8:0/1393564113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e180730e0 0x7f5e180734c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009990 tx=0x7f5e14009ca0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.434+0000 7f5e204fe700 1 -- 172.21.15.8:0/1393564113 shutdown_connections 2023-10-06T23:11:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.434+0000 7f5e204fe700 1 --2- 172.21.15.8:0/1393564113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e180730e0 0x7f5e180734c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.434+0000 7f5e204fe700 1 --2- 172.21.15.8:0/1393564113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e1810d930 0x7f5e1810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.434+0000 7f5e204fe700 1 --2- 172.21.15.8:0/1393564113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e18073a00 0x7f5e1810d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.434+0000 7f5e204fe700 1 -- 172.21.15.8:0/1393564113 >> 172.21.15.8:0/1393564113 conn(0x7f5e180780a0 msgr2=0x7f5e180784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.435+0000 7f5e204fe700 1 -- 172.21.15.8:0/1393564113 shutdown_connections 2023-10-06T23:11:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.435+0000 7f5e204fe700 1 -- 172.21.15.8:0/1393564113 wait complete. 2023-10-06T23:11:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.436+0000 7f5e204fe700 1 Processor -- start 2023-10-06T23:11:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.436+0000 7f5e204fe700 1 -- start start 2023-10-06T23:11:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.436+0000 7f5e204fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e180730e0 0x7f5e181991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.436+0000 7f5e204fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e18073a00 0x7f5e18199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e204fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e1810d930 0x7f5e1819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e204fe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1819e180 con 0x7f5e1810d930 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e204fe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1819e2f0 con 0x7f5e18073a00 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e204fe700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1819e4b0 con 0x7f5e180730e0 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1ea9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e1810d930 0x7f5e1819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1ea9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e1810d930 0x7f5e1819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42414/0 (socket says 172.21.15.8:42414) 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1ea9b700 1 -- 172.21.15.8:0/3704907367 learned_addr learned my addr 172.21.15.8:0/3704907367 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1da99700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e18073a00 0x7f5e18199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1ea9b700 1 -- 172.21.15.8:0/3704907367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e180730e0 msgr2=0x7f5e181991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1ea9b700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e180730e0 0x7f5e181991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1ea9b700 1 -- 172.21.15.8:0/3704907367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e18073a00 msgr2=0x7f5e18199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1ea9b700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e18073a00 0x7f5e18199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.437+0000 7f5e1ea9b700 1 -- 172.21.15.8:0/3704907367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e140095f0 con 0x7f5e1810d930 2023-10-06T23:11:59.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.438+0000 7f5e1ea9b700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e1810d930 0x7f5e1819db70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000ef90 tx=0x7f5e1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:59.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.438+0000 7f5e0f7fe700 1 -- 172.21.15.8:0/3704907367 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10018070 con 0x7f5e1810d930 2023-10-06T23:11:59.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.438+0000 7f5e0f7fe700 1 -- 172.21.15.8:0/3704907367 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e1000f040 con 0x7f5e1810d930 2023-10-06T23:11:59.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.438+0000 7f5e0f7fe700 1 -- 172.21.15.8:0/3704907367 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10003e00 con 0x7f5e1810d930 2023-10-06T23:11:59.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.438+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1819e730 con 0x7f5e1810d930 2023-10-06T23:11:59.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.438+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e181a5ff0 con 0x7f5e1810d930 2023-10-06T23:11:59.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.440+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1804ebb0 con 0x7f5e1810d930 2023-10-06T23:11:59.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.442+0000 7f5e0f7fe700 1 -- 172.21.15.8:0/3704907367 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5e1000ca20 con 0x7f5e1810d930 2023-10-06T23:11:59.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.443+0000 7f5e0f7fe700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5e040a15d0 0x7f5e040a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.443+0000 7f5e0f7fe700 1 -- 172.21.15.8:0/3704907367 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5e100cc780 con 0x7f5e1810d930 2023-10-06T23:11:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.444+0000 7f5e1e29a700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5e040a15d0 0x7f5e040a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.444+0000 7f5e1e29a700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5e040a15d0 0x7f5e040a3a90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005910 tx=0x7f5e14005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:59.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.448+0000 7f5e0f7fe700 1 -- 172.21.15.8:0/3704907367 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5e10095e20 con 0x7f5e1810d930 2023-10-06T23:11:59.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.690+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e18113090 con 0x7f5e1810d930 2023-10-06T23:11:59.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.691+0000 7f5e0f7fe700 1 -- 172.21.15.8:0/3704907367 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e10099440 con 0x7f5e1810d930 2023-10-06T23:11:59.693 INFO:teuthology.orchestra.run.smithi008.stdout:34359738447 2023-10-06T23:11:59.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5e040a15d0 msgr2=0x7f5e040a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5e040a15d0 0x7f5e040a3a90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e14005910 tx=0x7f5e14005fb0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e1810d930 msgr2=0x7f5e1819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e1810d930 0x7f5e1819db70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000ef90 tx=0x7f5e1000c3a0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 shutdown_connections 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5e040a15d0 0x7f5e040a3a90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e1810d930 0x7f5e1819db70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e180730e0 0x7f5e181991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 --2- 172.21.15.8:0/3704907367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e18073a00 0x7f5e18199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 >> 172.21.15.8:0/3704907367 conn(0x7f5e180780a0 msgr2=0x7f5e180fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:59.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.693+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 shutdown_connections 2023-10-06T23:11:59.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.694+0000 7f5e204fe700 1 -- 172.21.15.8:0/3704907367 wait complete. 2023-10-06T23:11:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.823+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/81541401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 msgr2=0x7fc3c00689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.823+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/81541401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 0x7fc3c00689a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0098f0 tx=0x7fc3bc009c00 comp rx=0 tx=0).stop 2023-10-06T23:11:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.823+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/81541401 shutdown_connections 2023-10-06T23:11:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.823+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/81541401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c0103960 0x7fc3c0103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.823+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/81541401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 0x7fc3c00689a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.823+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/81541401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c0068ee0 0x7fc3c0069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.823+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/81541401 >> 172.21.15.8:0/81541401 conn(0x7fc3c0075e00 msgr2=0x7fc3c0076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.823+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/81541401 shutdown_connections 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.824+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/81541401 wait complete. 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.825+0000 7fc3c7ad0700 1 Processor -- start 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.825+0000 7fc3c7ad0700 1 -- start start 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.826+0000 7fc3c7ad0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c0068ee0 0x7fc3c019d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.826+0000 7fc3c7ad0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c0103960 0x7fc3c019dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.826+0000 7fc3c7ad0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 0x7fc3c01a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.826+0000 7fc3c7ad0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01a24a0 con 0x7fc3c0068ee0 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.826+0000 7fc3c7ad0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01a2610 con 0x7fc3c0103960 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.826+0000 7fc3c7ad0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01a27d0 con 0x7fc3c0105ef0 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c606d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 0x7fc3c01a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c586c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c0068ee0 0x7fc3c019d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c606d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 0x7fc3c01a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42128/0 (socket says 172.21.15.8:42128) 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c606d700 1 -- 172.21.15.8:0/2187826674 learned_addr learned my addr 172.21.15.8:0/2187826674 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c506b700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c0103960 0x7fc3c019dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c606d700 1 -- 172.21.15.8:0/2187826674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c0103960 msgr2=0x7fc3c019dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c606d700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c0103960 0x7fc3c019dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c606d700 1 -- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c0068ee0 msgr2=0x7fc3c019d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c606d700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c0068ee0 0x7fc3c019d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.827+0000 7fc3c606d700 1 -- 172.21.15.8:0/2187826674 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc009520 con 0x7fc3c0105ef0 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.828+0000 7fc3c606d700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 0x7fc3c01a1e90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c110 tx=0x7fc3b800c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.828+0000 7fc3b6ffd700 1 -- 172.21.15.8:0/2187826674 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8017070 con 0x7fc3c0105ef0 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.828+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c01a2a50 con 0x7fc3c0105ef0 2023-10-06T23:11:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.828+0000 7fc3b6ffd700 1 -- 172.21.15.8:0/2187826674 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3b800e050 con 0x7fc3c0105ef0 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.828+0000 7fc3b6ffd700 1 -- 172.21.15.8:0/2187826674 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8007820 con 0x7fc3c0105ef0 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.828+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c01aa310 con 0x7fc3c0105ef0 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.830+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c004ebb0 con 0x7fc3c0105ef0 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.832+0000 7fc3b6ffd700 1 -- 172.21.15.8:0/2187826674 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc3b800ca20 con 0x7fc3c0105ef0 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.833+0000 7fc3b6ffd700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3ac0a1500 0x7fc3ac0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.833+0000 7fc3b6ffd700 1 -- 172.21.15.8:0/2187826674 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc3b80cc220 con 0x7fc3c0105ef0 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.833+0000 7fc3c586c700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3ac0a1500 0x7fc3ac0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.834+0000 7fc3c586c700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3ac0a1500 0x7fc3ac0a39c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0098c0 tx=0x7fc3bc019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:59.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.837+0000 7fc3b6ffd700 1 -- 172.21.15.8:0/2187826674 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc3b8095830 con 0x7fc3c0105ef0 2023-10-06T23:11:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.975+0000 7f72c0bb8700 1 -- 172.21.15.8:0/73050139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 msgr2=0x7f72bc110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.975+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/73050139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 0x7f72bc110030 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72b400b0a0 tx=0x7f72b400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.975+0000 7f72c0bb8700 1 -- 172.21.15.8:0/73050139 shutdown_connections 2023-10-06T23:11:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.975+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/73050139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 0x7f72bc110030 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.975+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/73050139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc103380 0x7f72bc103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.975+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/73050139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72bc103d30 0x7f72bc107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.975+0000 7f72c0bb8700 1 -- 172.21.15.8:0/73050139 >> 172.21.15.8:0/73050139 conn(0x7f72bc0fec10 msgr2=0x7f72bc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:11:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.976+0000 7f72c0bb8700 1 -- 172.21.15.8:0/73050139 shutdown_connections 2023-10-06T23:11:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.976+0000 7f72c0bb8700 1 -- 172.21.15.8:0/73050139 wait complete. 2023-10-06T23:11:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.977+0000 7f72c0bb8700 1 Processor -- start 2023-10-06T23:11:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.977+0000 7f72c0bb8700 1 -- start start 2023-10-06T23:11:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.977+0000 7f72c0bb8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc103380 0x7f72bc199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.977+0000 7f72c0bb8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72bc103d30 0x7f72bc199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.977+0000 7f72c0bb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 0x7f72bc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.977+0000 7f72c0bb8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc19e200 con 0x7f72bc108460 2023-10-06T23:11:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.977+0000 7f72c0bb8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc19e370 con 0x7f72bc103380 2023-10-06T23:11:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.977+0000 7f72c0bb8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc19e530 con 0x7f72bc103d30 2023-10-06T23:11:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 0x7f72bc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 0x7f72bc19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47416/0 (socket says 172.21.15.8:47416) 2023-10-06T23:11:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 -- 172.21.15.8:0/2800912079 learned_addr learned my addr 172.21.15.8:0/2800912079 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:11:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72b9d9b700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72bc103d30 0x7f72bc199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72ba59c700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc103380 0x7f72bc199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 -- 172.21.15.8:0/2800912079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72bc103d30 msgr2=0x7f72bc199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72bc103d30 0x7f72bc199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 -- 172.21.15.8:0/2800912079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc103380 msgr2=0x7f72bc199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:11:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc103380 0x7f72bc199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:11:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 -- 172.21.15.8:0/2800912079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4009d00 con 0x7f72bc108460 2023-10-06T23:11:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.978+0000 7f72bad9d700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 0x7f72bc19dbf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f72b400b070 tx=0x7f72b400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.979+0000 7f72ab7fe700 1 -- 172.21.15.8:0/2800912079 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400e040 con 0x7f72bc108460 2023-10-06T23:11:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.979+0000 7f72ab7fe700 1 -- 172.21.15.8:0/2800912079 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72b4003e10 con 0x7f72bc108460 2023-10-06T23:11:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.979+0000 7f72ab7fe700 1 -- 172.21.15.8:0/2800912079 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b401dea0 con 0x7f72bc108460 2023-10-06T23:11:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.979+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc19e7b0 con 0x7f72bc108460 2023-10-06T23:11:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.979+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc1a6070 con 0x7f72bc108460 2023-10-06T23:11:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.980+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc04ebb0 con 0x7f72bc108460 2023-10-06T23:11:59.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.982+0000 7f72ab7fe700 1 -- 172.21.15.8:0/2800912079 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f72b401d480 con 0x7f72bc108460 2023-10-06T23:11:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.983+0000 7f72ab7fe700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f72a40a1500 0x7f72a40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:11:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.984+0000 7f72ab7fe700 1 -- 172.21.15.8:0/2800912079 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f72b40cdff0 con 0x7f72bc108460 2023-10-06T23:11:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.984+0000 7f72ba59c700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f72a40a1500 0x7f72a40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:11:59.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.984+0000 7f72ba59c700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f72a40a1500 0x7f72a40a39c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009c60 tx=0x7f72ac009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:11:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:11:59.986+0000 7f72ab7fe700 1 -- 172.21.15.8:0/2800912079 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f72b4097690 con 0x7f72bc108460 2023-10-06T23:11:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:00.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.094+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc3c01173b0 con 0x7fc3c0105ef0 2023-10-06T23:12:00.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.094+0000 7fc3b6ffd700 1 -- 172.21.15.8:0/2187826674 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3b800ccd0 con 0x7fc3c0105ef0 2023-10-06T23:12:00.096 INFO:teuthology.orchestra.run.smithi008.stdout:146028888124 2023-10-06T23:12:00.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3ac0a1500 msgr2=0x7fc3ac0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:00.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3ac0a1500 0x7fc3ac0a39c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0098c0 tx=0x7fc3bc019040 comp rx=0 tx=0).stop 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 msgr2=0x7fc3c01a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 0x7fc3c01a1e90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c110 tx=0x7fc3b800c420 comp rx=0 tx=0).stop 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 shutdown_connections 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3ac0a1500 0x7fc3ac0a39c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c0068ee0 0x7fc3c019d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3c0105ef0 0x7fc3c01a1e90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 --2- 172.21.15.8:0/2187826674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3c0103960 0x7fc3c019dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 >> 172.21.15.8:0/2187826674 conn(0x7fc3c0075e00 msgr2=0x7fc3c00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 shutdown_connections 2023-10-06T23:12:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.097+0000 7fc3c7ad0700 1 -- 172.21.15.8:0/2187826674 wait complete. 2023-10-06T23:12:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:00.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.264+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f72bc112ff0 con 0x7f72bc108460 2023-10-06T23:12:00.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.264+0000 7f72ab7fe700 1 -- 172.21.15.8:0/2800912079 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f72b409acb0 con 0x7f72bc108460 2023-10-06T23:12:00.266 INFO:teuthology.orchestra.run.smithi008.stdout:313532612635 2023-10-06T23:12:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f72a40a1500 msgr2=0x7f72a40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f72a40a1500 0x7f72a40a39c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009c60 tx=0x7f72ac009260 comp rx=0 tx=0).stop 2023-10-06T23:12:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 msgr2=0x7f72bc19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:00.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 0x7f72bc19dbf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f72b400b070 tx=0x7f72b400bce0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 shutdown_connections 2023-10-06T23:12:00.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f72a40a1500 0x7f72a40a39c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72bc108460 0x7f72bc19dbf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f72bc103380 0x7f72bc199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 --2- 172.21.15.8:0/2800912079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72bc103d30 0x7f72bc199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:00.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 >> 172.21.15.8:0/2800912079 conn(0x7f72bc0fec10 msgr2=0x7f72bc0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:00.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 shutdown_connections 2023-10-06T23:12:00.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.267+0000 7f72c0bb8700 1 -- 172.21.15.8:0/2800912079 wait complete. 2023-10-06T23:12:00.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:00 smithi008 ceph-mon[98532]: pgmap v323: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:12:00.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:00 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3704907367' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-06T23:12:00.344 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:00.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:00 smithi156 ceph-mon[102862]: pgmap v323: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:12:00.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:00 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3704907367' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-06T23:12:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:00 smithi190 ceph-mon[102658]: pgmap v323: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-10-06T23:12:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:00 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3704907367' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-06T23:12:01.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2187826674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-06T23:12:01.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2800912079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-06T23:12:01.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/832226554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-06T23:12:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- 172.21.15.8:0/2805867338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 msgr2=0x7f7518107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 --2- 172.21.15.8:0/2805867338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 0x7f7518107370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75080099c0 tx=0x7f7508009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- 172.21.15.8:0/2805867338 shutdown_connections 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 --2- 172.21.15.8:0/2805867338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 0x7f7518107370 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 --2- 172.21.15.8:0/2805867338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7518101940 0x7f751810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 --2- 172.21.15.8:0/2805867338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7518100f80 0x7f7518101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- 172.21.15.8:0/2805867338 >> 172.21.15.8:0/2805867338 conn(0x7f75180780a0 msgr2=0x7f75180784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- 172.21.15.8:0/2805867338 shutdown_connections 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- 172.21.15.8:0/2805867338 wait complete. 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 Processor -- start 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- start start 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7518100f80 0x7f75181990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7518101940 0x7f7518199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 0x7f751819da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751819e0a0 con 0x7f7518106f90 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751819e210 con 0x7f7518100f80 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751819e3d0 con 0x7f7518101940 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 0x7f751819da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f7516d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7518100f80 0x7f75181990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 0x7f751819da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47442/0 (socket says 172.21.15.8:47442) 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 -- 172.21.15.8:0/832226554 learned_addr learned my addr 172.21.15.8:0/832226554 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751659c700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7518101940 0x7f7518199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 -- 172.21.15.8:0/832226554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7518101940 msgr2=0x7f7518199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7518101940 0x7f7518199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 -- 172.21.15.8:0/832226554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7518100f80 msgr2=0x7f75181990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7518100f80 0x7f75181990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 -- 172.21.15.8:0/832226554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080095f0 con 0x7f7518106f90 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751759e700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 0x7f751819da90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7510007f10 tx=0x7f751000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f74fffff700 1 -- 172.21.15.8:0/832226554 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510017070 con 0x7f7518106f90 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f74fffff700 1 -- 172.21.15.8:0/832226554 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f751000f040 con 0x7f7518106f90 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751819e6b0 con 0x7f7518106f90 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f74fffff700 1 -- 172.21.15.8:0/832226554 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510005570 con 0x7f7518106f90 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75181a5f10 con 0x7f7518106f90 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.461+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751819e8d0 con 0x7f7518106f90 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.468+0000 7f74fffff700 1 -- 172.21.15.8:0/832226554 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f751000db20 con 0x7f7518106f90 2023-10-06T23:12:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.468+0000 7f74fffff700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75000a1480 0x7f75000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:01.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.468+0000 7f74fffff700 1 -- 172.21.15.8:0/832226554 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f75100cca10 con 0x7f7518106f90 2023-10-06T23:12:01.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.468+0000 7f7516d9d700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75000a1480 0x7f75000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:01.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.468+0000 7f7516d9d700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75000a1480 0x7f75000a3940 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7508000c00 tx=0x7f7508009f10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:01.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.468+0000 7f74fffff700 1 -- 172.21.15.8:0/832226554 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7510096080 con 0x7f7518106f90 2023-10-06T23:12:01.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.690+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f751819a440 con 0x7f7518106f90 2023-10-06T23:12:01.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.691+0000 7f74fffff700 1 -- 172.21.15.8:0/832226554 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f751819a440 con 0x7f7518106f90 2023-10-06T23:12:01.152 INFO:teuthology.orchestra.run.smithi008.stdout:223338299434 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75000a1480 msgr2=0x7f75000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75000a1480 0x7f75000a3940 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7508000c00 tx=0x7f7508009f10 comp rx=0 tx=0).stop 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 msgr2=0x7f751819da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 0x7f751819da90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7510007f10 tx=0x7f751000d3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 shutdown_connections 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75000a1480 0x7f75000a3940 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7518106f90 0x7f751819da90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7518100f80 0x7f75181990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 --2- 172.21.15.8:0/832226554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7518101940 0x7f7518199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 >> 172.21.15.8:0/832226554 conn(0x7f75180780a0 msgr2=0x7f751810c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:01.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 shutdown_connections 2023-10-06T23:12:01.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:00.693+0000 7f751d1b8700 1 -- 172.21.15.8:0/832226554 wait complete. 2023-10-06T23:12:01.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2187826674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-06T23:12:01.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2800912079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-06T23:12:01.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/832226554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-06T23:12:01.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2187826674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-06T23:12:01.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2800912079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-06T23:12:01.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/832226554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-06T23:12:01.954 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738447 for osd.0 2023-10-06T23:12:01.955 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:02.109 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612634 got 313532612635 for osd.10 2023-10-06T23:12:02.109 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:02.291 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:02 smithi008 ceph-mon[98532]: pgmap v324: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-10-06T23:12:02.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:02 smithi156 ceph-mon[102862]: pgmap v324: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-10-06T23:12:02.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:02 smithi190 ceph-mon[102658]: pgmap v324: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-10-06T23:12:03.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.034+0000 7fc61314b700 1 -- 172.21.15.8:0/3151286409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 msgr2=0x7fc60c101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.034+0000 7fc61314b700 1 --2- 172.21.15.8:0/3151286409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 0x7fc60c101400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80099c0 tx=0x7fc5f8009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.034+0000 7fc61314b700 1 -- 172.21.15.8:0/3151286409 shutdown_connections 2023-10-06T23:12:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.035+0000 7fc61314b700 1 --2- 172.21.15.8:0/3151286409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c101940 0x7fc60c10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.035+0000 7fc61314b700 1 --2- 172.21.15.8:0/3151286409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc60c106f90 0x7fc60c107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.035+0000 7fc61314b700 1 --2- 172.21.15.8:0/3151286409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 0x7fc60c101400 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.035+0000 7fc61314b700 1 -- 172.21.15.8:0/3151286409 >> 172.21.15.8:0/3151286409 conn(0x7fc60c0780a0 msgr2=0x7fc60c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.035+0000 7fc61314b700 1 -- 172.21.15.8:0/3151286409 shutdown_connections 2023-10-06T23:12:03.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.035+0000 7fc61314b700 1 -- 172.21.15.8:0/3151286409 wait complete. 2023-10-06T23:12:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc61314b700 1 Processor -- start 2023-10-06T23:12:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc61314b700 1 -- start start 2023-10-06T23:12:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc61314b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 0x7fc60c0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc61314b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c101940 0x7fc60c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc61314b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc60c106f90 0x7fc60c1a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc61314b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c073fe0 con 0x7fc60c100f80 2023-10-06T23:12:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc61314b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c1a55c0 con 0x7fc60c106f90 2023-10-06T23:12:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc61314b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c1a5730 con 0x7fc60c101940 2023-10-06T23:12:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc610ee7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 0x7fc60c0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:03.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc610ee7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 0x7fc60c0731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47456/0 (socket says 172.21.15.8:47456) 2023-10-06T23:12:03.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc610ee7700 1 -- 172.21.15.8:0/3333318348 learned_addr learned my addr 172.21.15.8:0/3333318348 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:03.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.036+0000 7fc60bfff700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c101940 0x7fc60c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:03.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc6116e8700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc60c106f90 0x7fc60c1a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:03.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc610ee7700 1 -- 172.21.15.8:0/3333318348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c101940 msgr2=0x7fc60c0736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc610ee7700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c101940 0x7fc60c0736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc610ee7700 1 -- 172.21.15.8:0/3333318348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc60c106f90 msgr2=0x7fc60c1a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc610ee7700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc60c106f90 0x7fc60c1a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc610ee7700 1 -- 172.21.15.8:0/3333318348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f80095f0 con 0x7fc60c100f80 2023-10-06T23:12:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc6116e8700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc60c106f90 0x7fc60c1a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc610ee7700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 0x7fc60c0731b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c9b0 tx=0x7fc60000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc609ffb700 1 -- 172.21.15.8:0/3333318348 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600007b00 con 0x7fc60c100f80 2023-10-06T23:12:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc609ffb700 1 -- 172.21.15.8:0/3333318348 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc600007c60 con 0x7fc60c100f80 2023-10-06T23:12:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc609ffb700 1 -- 172.21.15.8:0/3333318348 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600018660 con 0x7fc60c100f80 2023-10-06T23:12:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.037+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c1a59b0 con 0x7fc60c100f80 2023-10-06T23:12:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.038+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c1a5e30 con 0x7fc60c100f80 2023-10-06T23:12:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.039+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60c04ebb0 con 0x7fc60c100f80 2023-10-06T23:12:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.041+0000 7fc609ffb700 1 -- 172.21.15.8:0/3333318348 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc60000f450 con 0x7fc60c100f80 2023-10-06T23:12:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.042+0000 7fc609ffb700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5fc0a1480 0x7fc5fc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.042+0000 7fc609ffb700 1 -- 172.21.15.8:0/3333318348 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc6000ccf50 con 0x7fc60c100f80 2023-10-06T23:12:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.042+0000 7fc60bfff700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5fc0a1480 0x7fc5fc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.043+0000 7fc60bfff700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5fc0a1480 0x7fc5fc0a3940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8006010 tx=0x7fc5f8009f10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.045+0000 7fc609ffb700 1 -- 172.21.15.8:0/3333318348 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc6000965f0 con 0x7fc60c100f80 2023-10-06T23:12:03.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.265+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc60c110e50 con 0x7fc60c100f80 2023-10-06T23:12:03.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.266+0000 7fc609ffb700 1 -- 172.21.15.8:0/3333318348 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc60000fe60 con 0x7fc60c100f80 2023-10-06T23:12:03.267 INFO:teuthology.orchestra.run.smithi008.stdout:77309411398 2023-10-06T23:12:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5fc0a1480 msgr2=0x7fc5fc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5fc0a1480 0x7fc5fc0a3940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8006010 tx=0x7fc5f8009f10 comp rx=0 tx=0).stop 2023-10-06T23:12:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 msgr2=0x7fc60c0731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 0x7fc60c0731b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c9b0 tx=0x7fc60000ccc0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 shutdown_connections 2023-10-06T23:12:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5fc0a1480 0x7fc5fc0a3940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc60c100f80 0x7fc60c0731b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc60c106f90 0x7fc60c1a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 --2- 172.21.15.8:0/3333318348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c101940 0x7fc60c0736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.270+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 >> 172.21.15.8:0/3333318348 conn(0x7fc60c0780a0 msgr2=0x7fc60c0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:03.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.271+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 shutdown_connections 2023-10-06T23:12:03.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.272+0000 7fc61314b700 1 -- 172.21.15.8:0/3333318348 wait complete. 2023-10-06T23:12:03.307 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888122 got 146028888124 for osd.4 2023-10-06T23:12:03.307 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:03.543 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:03 smithi008 ceph-mon[98532]: pgmap v325: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2023-10-06T23:12:03.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:03 smithi156 ceph-mon[102862]: pgmap v325: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.602+0000 7f994721a700 1 -- 172.21.15.8:0/3011969469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 msgr2=0x7f99400730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.602+0000 7f994721a700 1 --2- 172.21.15.8:0/3011969469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 0x7f99400730e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9934009990 tx=0x7f9934009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.602+0000 7f994721a700 1 -- 172.21.15.8:0/3011969469 shutdown_connections 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.602+0000 7f994721a700 1 --2- 172.21.15.8:0/3011969469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 0x7f99400730e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.602+0000 7f994721a700 1 --2- 172.21.15.8:0/3011969469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9940111bc0 0x7f9940113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.602+0000 7f994721a700 1 --2- 172.21.15.8:0/3011969469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9940073620 0x7f9940073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.602+0000 7f994721a700 1 -- 172.21.15.8:0/3011969469 >> 172.21.15.8:0/3011969469 conn(0x7f99400780a0 msgr2=0x7f99400784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.603+0000 7f994721a700 1 -- 172.21.15.8:0/3011969469 shutdown_connections 2023-10-06T23:12:03.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.603+0000 7f994721a700 1 -- 172.21.15.8:0/3011969469 wait complete. 2023-10-06T23:12:03.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.604+0000 7f994721a700 1 Processor -- start 2023-10-06T23:12:03.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.604+0000 7f994721a700 1 -- start start 2023-10-06T23:12:03.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.604+0000 7f994721a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9940073620 0x7f994010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:03.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.604+0000 7f994721a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 0x7f994010d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:03.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f994721a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9940111bc0 0x7f9940105e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:03.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f994721a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9940106600 con 0x7f9940074ef0 2023-10-06T23:12:03.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f994721a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9940106770 con 0x7f9940111bc0 2023-10-06T23:12:03.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f994721a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9940106930 con 0x7f9940073620 2023-10-06T23:12:03.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f993ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 0x7f994010d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:03.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f99457b7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9940111bc0 0x7f9940105e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:03.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f99457b7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9940111bc0 0x7f9940105e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42552/0 (socket says 172.21.15.8:42552) 2023-10-06T23:12:03.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f99457b7700 1 -- 172.21.15.8:0/2143369667 learned_addr learned my addr 172.21.15.8:0/2143369667 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f9944fb6700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9940073620 0x7f994010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f99457b7700 1 -- 172.21.15.8:0/2143369667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9940073620 msgr2=0x7f994010ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f99457b7700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9940073620 0x7f994010ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f99457b7700 1 -- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 msgr2=0x7f994010d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f99457b7700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 0x7f994010d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f99457b7700 1 -- 172.21.15.8:0/2143369667 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340095f0 con 0x7f9940111bc0 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f9944fb6700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9940073620 0x7f994010ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.605+0000 7f993ffff700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 0x7f994010d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.606+0000 7f99457b7700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9940111bc0 0x7f9940105e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f993800ef90 tx=0x7f993800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.606+0000 7f993dffb700 1 -- 172.21.15.8:0/2143369667 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938018070 con 0x7f9940111bc0 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.606+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9940106bb0 con 0x7f9940111bc0 2023-10-06T23:12:03.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.606+0000 7f993dffb700 1 -- 172.21.15.8:0/2143369667 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f993800f040 con 0x7f9940111bc0 2023-10-06T23:12:03.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.606+0000 7f993dffb700 1 -- 172.21.15.8:0/2143369667 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993800cc50 con 0x7f9940111bc0 2023-10-06T23:12:03.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.606+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994010abd0 con 0x7f9940111bc0 2023-10-06T23:12:03.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.607+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994004ebb0 con 0x7f9940111bc0 2023-10-06T23:12:03.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.609+0000 7f993dffb700 1 -- 172.21.15.8:0/2143369667 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9938003a00 con 0x7f9940111bc0 2023-10-06T23:12:03.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.611+0000 7f993dffb700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99300a1480 0x7f99300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:03.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.611+0000 7f993dffb700 1 -- 172.21.15.8:0/2143369667 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f99380cd190 con 0x7f9940111bc0 2023-10-06T23:12:03.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.611+0000 7f9944fb6700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99300a1480 0x7f99300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:03.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.612+0000 7f9944fb6700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99300a1480 0x7f99300a3940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9934006010 tx=0x7f9934005940 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:03.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.614+0000 7f993dffb700 1 -- 172.21.15.8:0/2143369667 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9938096830 con 0x7f9940111bc0 2023-10-06T23:12:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:03 smithi190 ceph-mon[102658]: pgmap v325: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2023-10-06T23:12:03.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.835+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f99401073b0 con 0x7f9940111bc0 2023-10-06T23:12:03.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.835+0000 7f993dffb700 1 -- 172.21.15.8:0/2143369667 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9938099e50 con 0x7f9940111bc0 2023-10-06T23:12:03.837 INFO:teuthology.orchestra.run.smithi008.stdout:201863462961 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99300a1480 msgr2=0x7f99300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99300a1480 0x7f99300a3940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9934006010 tx=0x7f9934005940 comp rx=0 tx=0).stop 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9940111bc0 msgr2=0x7f9940105e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9940111bc0 0x7f9940105e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f993800ef90 tx=0x7f993800c3a0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 shutdown_connections 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99300a1480 0x7f99300a3940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9940111bc0 0x7f9940105e80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9940073620 0x7f994010ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 --2- 172.21.15.8:0/2143369667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9940074ef0 0x7f994010d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.838+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 >> 172.21.15.8:0/2143369667 conn(0x7f99400780a0 msgr2=0x7f9940110440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:03.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.839+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 shutdown_connections 2023-10-06T23:12:03.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:03.839+0000 7f994721a700 1 -- 172.21.15.8:0/2143369667 wait complete. 2023-10-06T23:12:04.204 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299432 got 223338299434 for osd.7 2023-10-06T23:12:04.204 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:04.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:04 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3333318348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-06T23:12:04.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:04 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2143369667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-06T23:12:04.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:04 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3333318348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-06T23:12:04.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:04 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2143369667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-06T23:12:04.625 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411398 for osd.2 2023-10-06T23:12:04.626 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:04.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:04 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3333318348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-06T23:12:04.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:04 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2143369667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-06T23:12:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 -- 172.21.15.8:0/3496404157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8105ef0 msgr2=0x7fa5f80689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/3496404157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8105ef0 0x7fa5f80689a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009990 tx=0x7fa5e8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 -- 172.21.15.8:0/3496404157 shutdown_connections 2023-10-06T23:12:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/3496404157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8105ef0 0x7fa5f80689a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/3496404157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5f8103960 0x7fa5f8103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/3496404157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5f8068ee0 0x7fa5f8069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 -- 172.21.15.8:0/3496404157 >> 172.21.15.8:0/3496404157 conn(0x7fa5f8075e00 msgr2=0x7fa5f8076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 -- 172.21.15.8:0/3496404157 shutdown_connections 2023-10-06T23:12:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.825+0000 7fa5fe01e700 1 -- 172.21.15.8:0/3496404157 wait complete. 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.826+0000 7fa5fe01e700 1 Processor -- start 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5fe01e700 1 -- start start 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5fe01e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5f8068ee0 0x7fa5f819d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5fe01e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8103960 0x7fa5f819d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5fe01e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5f8105ef0 0x7fa5f81a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5fe01e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81a2420 con 0x7fa5f8103960 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5fe01e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81a2590 con 0x7fa5f8068ee0 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5fe01e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81a2750 con 0x7fa5f8105ef0 2023-10-06T23:12:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5f6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8103960 0x7fa5f819d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5f6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8103960 0x7fa5f819d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47488/0 (socket says 172.21.15.8:47488) 2023-10-06T23:12:04.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.827+0000 7fa5f6ffd700 1 -- 172.21.15.8:0/2234256185 learned_addr learned my addr 172.21.15.8:0/2234256185 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:04.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f77fe700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5f8068ee0 0x7fa5f819d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f7fff700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5f8105ef0 0x7fa5f81a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f6ffd700 1 -- 172.21.15.8:0/2234256185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5f8105ef0 msgr2=0x7fa5f81a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f6ffd700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5f8105ef0 0x7fa5f81a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f6ffd700 1 -- 172.21.15.8:0/2234256185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5f8068ee0 msgr2=0x7fa5f819d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f6ffd700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5f8068ee0 0x7fa5f819d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f6ffd700 1 -- 172.21.15.8:0/2234256185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80095f0 con 0x7fa5f8103960 2023-10-06T23:12:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f77fe700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5f8068ee0 0x7fa5f819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.828+0000 7fa5f6ffd700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8103960 0x7fa5f819d9a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00e9a0 tx=0x7fa5ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.829+0000 7fa5f4ff9700 1 -- 172.21.15.8:0/2234256185 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec009790 con 0x7fa5f8103960 2023-10-06T23:12:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.829+0000 7fa5f4ff9700 1 -- 172.21.15.8:0/2234256185 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5ec010430 con 0x7fa5f8103960 2023-10-06T23:12:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.829+0000 7fa5f4ff9700 1 -- 172.21.15.8:0/2234256185 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00cea0 con 0x7fa5f8103960 2023-10-06T23:12:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.829+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f81a2a30 con 0x7fa5f8103960 2023-10-06T23:12:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.829+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f81aa290 con 0x7fa5f8103960 2023-10-06T23:12:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.830+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f804ebb0 con 0x7fa5f8103960 2023-10-06T23:12:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.832+0000 7fa5f4ff9700 1 -- 172.21.15.8:0/2234256185 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa5ec0105a0 con 0x7fa5f8103960 2023-10-06T23:12:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.835+0000 7fa5f4ff9700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa5e00a1500 0x7fa5e00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.835+0000 7fa5f4ff9700 1 -- 172.21.15.8:0/2234256185 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa5ec014070 con 0x7fa5f8103960 2023-10-06T23:12:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.835+0000 7fa5f77fe700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa5e00a1500 0x7fa5e00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.836+0000 7fa5f77fe700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa5e00a1500 0x7fa5e00a39c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8006010 tx=0x7fa5e800b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.838+0000 7fa5f4ff9700 1 -- 172.21.15.8:0/2234256185 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa5ec096320 con 0x7fa5f8103960 2023-10-06T23:12:04.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 -- 172.21.15.8:0/1972692177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8044100430 msgr2=0x7f804410d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 --2- 172.21.15.8:0/1972692177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8044100430 0x7f804410d0f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8034009990 tx=0x7f8034009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 -- 172.21.15.8:0/1972692177 shutdown_connections 2023-10-06T23:12:04.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 --2- 172.21.15.8:0/1972692177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f804410d630 0x7f804410fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 --2- 172.21.15.8:0/1972692177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80440ffa80 0x7f80440ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 --2- 172.21.15.8:0/1972692177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8044100430 0x7f804410d0f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 -- 172.21.15.8:0/1972692177 >> 172.21.15.8:0/1972692177 conn(0x7f80440fb760 msgr2=0x7f80440fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:04.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 -- 172.21.15.8:0/1972692177 shutdown_connections 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.877+0000 7f804a6c9700 1 -- 172.21.15.8:0/1972692177 wait complete. 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.878+0000 7f804a6c9700 1 Processor -- start 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.878+0000 7f804a6c9700 1 -- start start 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.878+0000 7f804a6c9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80440ffa80 0x7f8044198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f804a6c9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8044100430 0x7f8044199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f804a6c9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f804410d630 0x7f804419d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f804a6c9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419df10 con 0x7f8044100430 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f804a6c9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419e080 con 0x7f804410d630 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f804a6c9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419e240 con 0x7f80440ffa80 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f80496c7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80440ffa80 0x7f8044198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f80496c7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80440ffa80 0x7f8044198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42254/0 (socket says 172.21.15.8:42254) 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f80496c7700 1 -- 172.21.15.8:0/939853301 learned_addr learned my addr 172.21.15.8:0/939853301 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f8049ec8700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f804410d630 0x7f804419d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.879+0000 7f8048ec6700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8044100430 0x7f8044199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f80496c7700 1 -- 172.21.15.8:0/939853301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f804410d630 msgr2=0x7f804419d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f80496c7700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f804410d630 0x7f804419d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f80496c7700 1 -- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8044100430 msgr2=0x7f8044199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f80496c7700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8044100430 0x7f8044199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f80496c7700 1 -- 172.21.15.8:0/939853301 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340095f0 con 0x7f80440ffa80 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f80496c7700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80440ffa80 0x7f8044198f50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f804000d980 tx=0x7f804000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f803a7fc700 1 -- 172.21.15.8:0/939853301 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8040004220 con 0x7f80440ffa80 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804419e520 con 0x7f80440ffa80 2023-10-06T23:12:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f803a7fc700 1 -- 172.21.15.8:0/939853301 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8040007640 con 0x7f80440ffa80 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f803a7fc700 1 -- 172.21.15.8:0/939853301 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8040005660 con 0x7f80440ffa80 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.880+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80441a5d80 con 0x7f80440ffa80 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.881+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8044108850 con 0x7f80440ffa80 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.884+0000 7f803a7fc700 1 -- 172.21.15.8:0/939853301 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8040004750 con 0x7f80440ffa80 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.885+0000 7f803a7fc700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80300a1500 0x7f80300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.885+0000 7f803a7fc700 1 -- 172.21.15.8:0/939853301 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f80400ccf30 con 0x7f80440ffa80 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.885+0000 7f8048ec6700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80300a1500 0x7f80300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.886+0000 7f8048ec6700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80300a1500 0x7f80300a39c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f80340059d0 tx=0x7f8034005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.887+0000 7f803a7fc700 1 -- 172.21.15.8:0/939853301 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f80400fa100 con 0x7f80440ffa80 2023-10-06T23:12:04.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.964+0000 7f8f4196f700 1 -- 172.21.15.8:0/4004183377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c069c10 msgr2=0x7f8f3c10ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.964+0000 7f8f4196f700 1 --2- 172.21.15.8:0/4004183377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c069c10 0x7f8f3c10ddc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400b0a0 tx=0x7f8f3400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.965+0000 7f8f4196f700 1 -- 172.21.15.8:0/4004183377 shutdown_connections 2023-10-06T23:12:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.965+0000 7f8f4196f700 1 --2- 172.21.15.8:0/4004183377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f3c106f80 0x7f8f3c107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.965+0000 7f8f4196f700 1 --2- 172.21.15.8:0/4004183377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c069c10 0x7f8f3c10ddc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.965+0000 7f8f4196f700 1 --2- 172.21.15.8:0/4004183377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c069270 0x7f8f3c0696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.965+0000 7f8f4196f700 1 -- 172.21.15.8:0/4004183377 >> 172.21.15.8:0/4004183377 conn(0x7f8f3c076dc0 msgr2=0x7f8f3c0771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.966+0000 7f8f4196f700 1 -- 172.21.15.8:0/4004183377 shutdown_connections 2023-10-06T23:12:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.966+0000 7f8f4196f700 1 -- 172.21.15.8:0/4004183377 wait complete. 2023-10-06T23:12:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.967+0000 7f8f4196f700 1 Processor -- start 2023-10-06T23:12:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.967+0000 7f8f4196f700 1 -- start start 2023-10-06T23:12:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.968+0000 7f8f4196f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c069270 0x7f8f3c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.968+0000 7f8f4196f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f3c069c10 0x7f8f3c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.968+0000 7f8f4196f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c106f80 0x7f8f3c19dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.968+0000 7f8f4196f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c19e2c0 con 0x7f8f3c069c10 2023-10-06T23:12:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.968+0000 7f8f4196f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c19e430 con 0x7f8f3c069270 2023-10-06T23:12:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.968+0000 7f8f4196f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c19e5f0 con 0x7f8f3c106f80 2023-10-06T23:12:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c069270 0x7f8f3c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c069270 0x7f8f3c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42604/0 (socket says 172.21.15.8:42604) 2023-10-06T23:12:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3affd700 1 -- 172.21.15.8:0/1419999140 learned_addr learned my addr 172.21.15.8:0/1419999140 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3b7fe700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c106f80 0x7f8f3c19dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3b7fe700 1 -- 172.21.15.8:0/1419999140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c069270 msgr2=0x7f8f3c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3b7fe700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c069270 0x7f8f3c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3b7fe700 1 -- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f3c069c10 msgr2=0x7f8f3c199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3b7fe700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f3c069c10 0x7f8f3c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.969+0000 7f8f3b7fe700 1 -- 172.21.15.8:0/1419999140 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34009d00 con 0x7f8f3c106f80 2023-10-06T23:12:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.971+0000 7f8f3b7fe700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c106f80 0x7f8f3c19dcb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009fd0 tx=0x7f8f3400bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.972+0000 7f8f4096d700 1 -- 172.21.15.8:0/1419999140 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400e040 con 0x7f8f3c106f80 2023-10-06T23:12:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.972+0000 7f8f4096d700 1 -- 172.21.15.8:0/1419999140 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f34003e10 con 0x7f8f3c106f80 2023-10-06T23:12:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.972+0000 7f8f4096d700 1 -- 172.21.15.8:0/1419999140 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34005280 con 0x7f8f3c106f80 2023-10-06T23:12:04.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.972+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c19e870 con 0x7f8f3c106f80 2023-10-06T23:12:04.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.972+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c06a8d0 con 0x7f8f3c106f80 2023-10-06T23:12:04.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.974+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c04ebb0 con 0x7f8f3c106f80 2023-10-06T23:12:04.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.977+0000 7f8f4096d700 1 -- 172.21.15.8:0/1419999140 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8f3401da10 con 0x7f8f3c106f80 2023-10-06T23:12:04.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.979+0000 7f8f4096d700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8f240a1500 0x7f8f240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:04.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.979+0000 7f8f4096d700 1 -- 172.21.15.8:0/1419999140 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8f340cdff0 con 0x7f8f3c106f80 2023-10-06T23:12:04.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.979+0000 7f8f3affd700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8f240a1500 0x7f8f240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:04.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.980+0000 7f8f4096d700 1 -- 172.21.15.8:0/1419999140 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8f3409b160 con 0x7f8f3c106f80 2023-10-06T23:12:04.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:04.980+0000 7f8f3affd700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8f240a1500 0x7f8f240a39c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0098f0 tx=0x7f8f2c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:05.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.083+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa5f819e7c0 con 0x7fa5f8103960 2023-10-06T23:12:05.120 INFO:teuthology.orchestra.run.smithi008.stdout:55834574923 2023-10-06T23:12:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.084+0000 7fa5f4ff9700 1 -- 172.21.15.8:0/2234256185 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5ec099940 con 0x7fa5f8103960 2023-10-06T23:12:05.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa5e00a1500 msgr2=0x7fa5e00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa5e00a1500 0x7fa5e00a39c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8006010 tx=0x7fa5e800b260 comp rx=0 tx=0).stop 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8103960 msgr2=0x7fa5f819d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8103960 0x7fa5f819d9a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00e9a0 tx=0x7fa5ec00ecb0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 shutdown_connections 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa5e00a1500 0x7fa5e00a39c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa5f8105ef0 0x7fa5f81a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5f8068ee0 0x7fa5f819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 --2- 172.21.15.8:0/2234256185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5f8103960 0x7fa5f819d9a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.086+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 >> 172.21.15.8:0/2234256185 conn(0x7fa5f8075e00 msgr2=0x7fa5f80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:05.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.087+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 shutdown_connections 2023-10-06T23:12:05.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.087+0000 7fa5fe01e700 1 -- 172.21.15.8:0/2234256185 wait complete. 2023-10-06T23:12:05.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.156+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f804404f400 con 0x7f80440ffa80 2023-10-06T23:12:05.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.157+0000 7f803a7fc700 1 -- 172.21.15.8:0/939853301 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8040016070 con 0x7f80440ffa80 2023-10-06T23:12:05.158 INFO:teuthology.orchestra.run.smithi008.stdout:257698037799 2023-10-06T23:12:05.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80300a1500 msgr2=0x7f80300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:05.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80300a1500 0x7f80300a39c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f80340059d0 tx=0x7f8034005960 comp rx=0 tx=0).stop 2023-10-06T23:12:05.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80440ffa80 msgr2=0x7f8044198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:05.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80440ffa80 0x7f8044198f50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f804000d980 tx=0x7f804000dc90 comp rx=0 tx=0).stop 2023-10-06T23:12:05.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 shutdown_connections 2023-10-06T23:12:05.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f80300a1500 0x7f80300a39c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f804410d630 0x7f804419d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80440ffa80 0x7f8044198f50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 --2- 172.21.15.8:0/939853301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8044100430 0x7f8044199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.159+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 >> 172.21.15.8:0/939853301 conn(0x7f80440fb760 msgr2=0x7f804410e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:05.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.160+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 shutdown_connections 2023-10-06T23:12:05.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.160+0000 7f804a6c9700 1 -- 172.21.15.8:0/939853301 wait complete. 2023-10-06T23:12:05.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.241+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8f3c110d30 con 0x7f8f3c106f80 2023-10-06T23:12:05.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.242+0000 7f8f4096d700 1 -- 172.21.15.8:0/1419999140 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f3409acf0 con 0x7f8f3c106f80 2023-10-06T23:12:05.244 INFO:teuthology.orchestra.run.smithi008.stdout:167503724598 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8f240a1500 msgr2=0x7f8f240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8f240a1500 0x7f8f240a39c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0098f0 tx=0x7f8f2c008040 comp rx=0 tx=0).stop 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c106f80 msgr2=0x7f8f3c19dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c106f80 0x7f8f3c19dcb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009fd0 tx=0x7f8f3400bd90 comp rx=0 tx=0).stop 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 shutdown_connections 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8f240a1500 0x7f8f240a39c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f3c106f80 0x7f8f3c19dcb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c069270 0x7f8f3c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 --2- 172.21.15.8:0/1419999140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f3c069c10 0x7f8f3c199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 >> 172.21.15.8:0/1419999140 conn(0x7f8f3c076dc0 msgr2=0x7f8f3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 shutdown_connections 2023-10-06T23:12:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.245+0000 7f8f4196f700 1 -- 172.21.15.8:0/1419999140 wait complete. 2023-10-06T23:12:05.521 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:05 smithi008 ceph-mon[98532]: pgmap v326: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2023-10-06T23:12:05.521 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:05 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2234256185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-06T23:12:05.521 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:05 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/939853301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-06T23:12:05.521 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:05 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1419999140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-06T23:12:05.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:05 smithi156 ceph-mon[102862]: pgmap v326: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2023-10-06T23:12:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:05 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2234256185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-06T23:12:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:05 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/939853301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-06T23:12:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:05 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1419999140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-06T23:12:05.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:05 smithi190 ceph-mon[102658]: pgmap v326: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2023-10-06T23:12:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:05 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2234256185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-06T23:12:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:05 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/939853301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-06T23:12:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:05 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1419999140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 -- 172.21.15.8:0/3596734503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec100f80 msgr2=0x7fbdec101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 --2- 172.21.15.8:0/3596734503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec100f80 0x7fbdec101400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbde00099c0 tx=0x7fbde0009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 -- 172.21.15.8:0/3596734503 shutdown_connections 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 --2- 172.21.15.8:0/3596734503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdec101940 0x7fbdec10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 --2- 172.21.15.8:0/3596734503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdec106f90 0x7fbdec107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 --2- 172.21.15.8:0/3596734503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec100f80 0x7fbdec101400 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 -- 172.21.15.8:0/3596734503 >> 172.21.15.8:0/3596734503 conn(0x7fbdec0780a0 msgr2=0x7fbdec0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 -- 172.21.15.8:0/3596734503 shutdown_connections 2023-10-06T23:12:06.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.974+0000 7fbdf0995700 1 -- 172.21.15.8:0/3596734503 wait complete. 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.975+0000 7fbdf0995700 1 Processor -- start 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.975+0000 7fbdf0995700 1 -- start start 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdf0995700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdec100f80 0x7fbdec1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdf0995700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdec101940 0x7fbdec199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdf0995700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec106f90 0x7fbdec19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdf0995700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec19e1a0 con 0x7fbdec106f90 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdf0995700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec19e310 con 0x7fbdec101940 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdf0995700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec19e4d0 con 0x7fbdec100f80 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec106f90 0x7fbdec19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec106f90 0x7fbdec19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47526/0 (socket says 172.21.15.8:47526) 2023-10-06T23:12:06.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdead9d700 1 -- 172.21.15.8:0/1980074077 learned_addr learned my addr 172.21.15.8:0/1980074077 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdea59c700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdec100f80 0x7fbdec1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdead9d700 1 -- 172.21.15.8:0/1980074077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdec100f80 msgr2=0x7fbdec1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdead9d700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdec100f80 0x7fbdec1991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbde9d9b700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdec101940 0x7fbdec199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdead9d700 1 -- 172.21.15.8:0/1980074077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdec101940 msgr2=0x7fbdec199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdead9d700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdec101940 0x7fbdec199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbdead9d700 1 -- 172.21.15.8:0/1980074077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00095f0 con 0x7fbdec106f90 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.976+0000 7fbde9d9b700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdec101940 0x7fbdec199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.977+0000 7fbdead9d700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec106f90 0x7fbdec19db90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbde4007f10 tx=0x7fbde400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.977+0000 7fbddb7fe700 1 -- 172.21.15.8:0/1980074077 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4017070 con 0x7fbdec106f90 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.977+0000 7fbddb7fe700 1 -- 172.21.15.8:0/1980074077 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbde400f040 con 0x7fbdec106f90 2023-10-06T23:12:06.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.977+0000 7fbddb7fe700 1 -- 172.21.15.8:0/1980074077 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4005710 con 0x7fbdec106f90 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.977+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec19e7b0 con 0x7fbdec106f90 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.977+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec1a6010 con 0x7fbdec106f90 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.978+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec04ebb0 con 0x7fbdec106f90 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.980+0000 7fbddb7fe700 1 -- 172.21.15.8:0/1980074077 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbde4005870 con 0x7fbdec106f90 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.981+0000 7fbddb7fe700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbdd40a1500 0x7fbdd40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.982+0000 7fbddb7fe700 1 -- 172.21.15.8:0/1980074077 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbde40cc480 con 0x7fbdec106f90 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.982+0000 7fbdea59c700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbdd40a1500 0x7fbdd40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.982+0000 7fbdea59c700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbdd40a1500 0x7fbdd40a39c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009bd0 tx=0x7fbddc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:06.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:05.986+0000 7fbddb7fe700 1 -- 172.21.15.8:0/1980074077 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbde4095a90 con 0x7fbdec106f90 2023-10-06T23:12:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.203+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fbdec110e90 con 0x7fbdec106f90 2023-10-06T23:12:06.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.203+0000 7fbddb7fe700 1 -- 172.21.15.8:0/1980074077 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fbde40990b0 con 0x7fbdec106f90 2023-10-06T23:12:06.205 INFO:teuthology.orchestra.run.smithi008.stdout:347892350999 2023-10-06T23:12:06.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbdd40a1500 msgr2=0x7fbdd40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbdd40a1500 0x7fbdd40a39c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009bd0 tx=0x7fbddc009260 comp rx=0 tx=0).stop 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec106f90 msgr2=0x7fbdec19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec106f90 0x7fbdec19db90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbde4007f10 tx=0x7fbde400d3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 shutdown_connections 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbdd40a1500 0x7fbdd40a39c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdec106f90 0x7fbdec19db90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdec100f80 0x7fbdec1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 --2- 172.21.15.8:0/1980074077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdec101940 0x7fbdec199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 >> 172.21.15.8:0/1980074077 conn(0x7fbdec0780a0 msgr2=0x7fbdec10c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 shutdown_connections 2023-10-06T23:12:06.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:06.206+0000 7fbdf0995700 1 -- 172.21.15.8:0/1980074077 wait complete. 2023-10-06T23:12:06.592 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:06 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1980074077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-06T23:12:06.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:06 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1980074077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-06T23:12:06.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:06 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1980074077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-06T23:12:06.694 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724595 got 167503724598 for osd.5 2023-10-06T23:12:06.694 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:06.695 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037797 got 257698037799 for osd.8 2023-10-06T23:12:06.695 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:06.901 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574923 for osd.1 2023-10-06T23:12:06.902 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:07.331 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462958 got 201863462961 for osd.6 2023-10-06T23:12:07.331 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:07.454 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350997 got 347892350999 for osd.11 2023-10-06T23:12:07.454 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:07.539 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:07 smithi008 ceph-mon[98532]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:12:07.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:07 smithi156 ceph-mon[102862]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:12:07.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:07 smithi190 ceph-mon[102658]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:12:07.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 -- 172.21.15.8:0/480876072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118073620 msgr2=0x7fa118073a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:07.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 --2- 172.21.15.8:0/480876072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118073620 0x7fa118073a80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa108009990 tx=0x7fa108009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 -- 172.21.15.8:0/480876072 shutdown_connections 2023-10-06T23:12:07.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 --2- 172.21.15.8:0/480876072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118111bc0 0x7fa118113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 --2- 172.21.15.8:0/480876072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa118074ef0 0x7fa1180730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 --2- 172.21.15.8:0/480876072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118073620 0x7fa118073a80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 -- 172.21.15.8:0/480876072 >> 172.21.15.8:0/480876072 conn(0x7fa1180780a0 msgr2=0x7fa1180784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:07.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 -- 172.21.15.8:0/480876072 shutdown_connections 2023-10-06T23:12:07.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.762+0000 7fa11fa82700 1 -- 172.21.15.8:0/480876072 wait complete. 2023-10-06T23:12:07.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.763+0000 7fa11fa82700 1 Processor -- start 2023-10-06T23:12:07.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.763+0000 7fa11fa82700 1 -- start start 2023-10-06T23:12:07.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11fa82700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa118073620 0x7fa11819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:07.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11fa82700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118074ef0 0x7fa11819db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:07.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11fa82700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118111bc0 0x7fa1181a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:07.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11fa82700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1181a2580 con 0x7fa118074ef0 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11fa82700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1181a26f0 con 0x7fa118073620 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11fa82700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1181a28b0 con 0x7fa118111bc0 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11d01d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118074ef0 0x7fa11819db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11d01d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118074ef0 0x7fa11819db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47540/0 (socket says 172.21.15.8:47540) 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11d01d700 1 -- 172.21.15.8:0/1591215572 learned_addr learned my addr 172.21.15.8:0/1591215572 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.764+0000 7fa11d81e700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa118073620 0x7fa11819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa11e01f700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118111bc0 0x7fa1181a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa11d01d700 1 -- 172.21.15.8:0/1591215572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118111bc0 msgr2=0x7fa1181a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:07.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa11d01d700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118111bc0 0x7fa1181a1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa11d01d700 1 -- 172.21.15.8:0/1591215572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa118073620 msgr2=0x7fa11819d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:07.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa11d01d700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa118073620 0x7fa11819d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa11d01d700 1 -- 172.21.15.8:0/1591215572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080095f0 con 0x7fa118074ef0 2023-10-06T23:12:07.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa11d01d700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118074ef0 0x7fa11819db00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa108006010 tx=0x7fa108004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:07.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa10effd700 1 -- 172.21.15.8:0/1591215572 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10801d070 con 0x7fa118074ef0 2023-10-06T23:12:07.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa10effd700 1 -- 172.21.15.8:0/1591215572 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa108004000 con 0x7fa118074ef0 2023-10-06T23:12:07.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1181a2b30 con 0x7fa118074ef0 2023-10-06T23:12:07.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.765+0000 7fa10effd700 1 -- 172.21.15.8:0/1591215572 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108022b50 con 0x7fa118074ef0 2023-10-06T23:12:07.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.766+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1181aa3f0 con 0x7fa118074ef0 2023-10-06T23:12:07.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.766+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11804ebb0 con 0x7fa118074ef0 2023-10-06T23:12:07.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.769+0000 7fa10effd700 1 -- 172.21.15.8:0/1591215572 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa108003b70 con 0x7fa118074ef0 2023-10-06T23:12:07.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.770+0000 7fa10effd700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1040a1480 0x7fa1040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:07.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.770+0000 7fa10effd700 1 -- 172.21.15.8:0/1591215572 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa1080ceb70 con 0x7fa118074ef0 2023-10-06T23:12:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.770+0000 7fa11d81e700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1040a1480 0x7fa1040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:07.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.771+0000 7fa11d81e700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1040a1480 0x7fa1040a3940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa114005950 tx=0x7fa11400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.773+0000 7fa10effd700 1 -- 172.21.15.8:0/1591215572 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa108098210 con 0x7fa118074ef0 2023-10-06T23:12:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 -- 172.21.15.8:0/1536882230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37940692c0 msgr2=0x7f379410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 --2- 172.21.15.8:0/1536882230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37940692c0 0x7f379410d4d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3784009990 tx=0x7f3784009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 -- 172.21.15.8:0/1536882230 shutdown_connections 2023-10-06T23:12:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 --2- 172.21.15.8:0/1536882230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f379410da10 0x7f379410fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 --2- 172.21.15.8:0/1536882230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37940689a0 0x7f3794068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 --2- 172.21.15.8:0/1536882230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f37940692c0 0x7f379410d4d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 -- 172.21.15.8:0/1536882230 >> 172.21.15.8:0/1536882230 conn(0x7f3794075e00 msgr2=0x7f3794076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 -- 172.21.15.8:0/1536882230 shutdown_connections 2023-10-06T23:12:07.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.866+0000 7f379c160700 1 -- 172.21.15.8:0/1536882230 wait complete. 2023-10-06T23:12:07.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.867+0000 7f379c160700 1 Processor -- start 2023-10-06T23:12:07.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.867+0000 7f379c160700 1 -- start start 2023-10-06T23:12:07.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379c160700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37940689a0 0x7f3794199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:07.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379c160700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940692c0 0x7f3794199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379c160700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f379410da10 0x7f379419dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379c160700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379419e0e0 con 0x7f379410da10 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379c160700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379419e250 con 0x7f37940689a0 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379c160700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379419e410 con 0x7f37940692c0 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379a6fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f379410da10 0x7f379419dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379a6fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f379410da10 0x7f379419dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47556/0 (socket says 172.21.15.8:47556) 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f379a6fd700 1 -- 172.21.15.8:0/1802639845 learned_addr learned my addr 172.21.15.8:0/1802639845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f3799efc700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37940689a0 0x7f3794199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.868+0000 7f37996fb700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940692c0 0x7f3794199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:07.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f379a6fd700 1 -- 172.21.15.8:0/1802639845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940692c0 msgr2=0x7f3794199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:07.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f379a6fd700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940692c0 0x7f3794199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f379a6fd700 1 -- 172.21.15.8:0/1802639845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37940689a0 msgr2=0x7f3794199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:07.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f379a6fd700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37940689a0 0x7f3794199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:07.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f379a6fd700 1 -- 172.21.15.8:0/1802639845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840095f0 con 0x7f379410da10 2023-10-06T23:12:07.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f3799efc700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37940689a0 0x7f3794199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:07.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f379a6fd700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f379410da10 0x7f379419dad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f378c0094f0 tx=0x7f378c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:07.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f378affd700 1 -- 172.21.15.8:0/1802639845 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c004db0 con 0x7f379410da10 2023-10-06T23:12:07.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.869+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379419e6f0 con 0x7f379410da10 2023-10-06T23:12:07.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.870+0000 7f378affd700 1 -- 172.21.15.8:0/1802639845 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f378c00f040 con 0x7f379410da10 2023-10-06T23:12:07.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.870+0000 7f378affd700 1 -- 172.21.15.8:0/1802639845 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0058b0 con 0x7f379410da10 2023-10-06T23:12:07.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.870+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37941a5f50 con 0x7f379410da10 2023-10-06T23:12:07.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.871+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379404ebb0 con 0x7f379410da10 2023-10-06T23:12:07.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.875+0000 7f378affd700 1 -- 172.21.15.8:0/1802639845 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f378c00db20 con 0x7f379410da10 2023-10-06T23:12:07.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.877+0000 7f378affd700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f37800a1480 0x7f37800a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:07.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.877+0000 7f378affd700 1 -- 172.21.15.8:0/1802639845 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f378c0cce10 con 0x7f379410da10 2023-10-06T23:12:07.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.877+0000 7f3799efc700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f37800a1480 0x7f37800a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:07.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.878+0000 7f378affd700 1 -- 172.21.15.8:0/1802639845 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f378c096420 con 0x7f379410da10 2023-10-06T23:12:07.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:07.878+0000 7f3799efc700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f37800a1480 0x7f37800a3940 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3790007fd0 tx=0x7f37900073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.001+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fa118117350 con 0x7fa118074ef0 2023-10-06T23:12:08.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.001+0000 7fa10effd700 1 -- 172.21.15.8:0/1591215572 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa10809b830 con 0x7fa118074ef0 2023-10-06T23:12:08.003 INFO:teuthology.orchestra.run.smithi008.stdout:292057776162 2023-10-06T23:12:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1040a1480 msgr2=0x7fa1040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:08.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1040a1480 0x7fa1040a3940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa114005950 tx=0x7fa11400b410 comp rx=0 tx=0).stop 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118074ef0 msgr2=0x7fa11819db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118074ef0 0x7fa11819db00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa108006010 tx=0x7fa108004730 comp rx=0 tx=0).stop 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 shutdown_connections 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1040a1480 0x7fa1040a3940 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118111bc0 0x7fa1181a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa118073620 0x7fa11819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 --2- 172.21.15.8:0/1591215572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa118074ef0 0x7fa11819db00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 >> 172.21.15.8:0/1591215572 conn(0x7fa1180780a0 msgr2=0x7fa118110720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 shutdown_connections 2023-10-06T23:12:08.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.004+0000 7fa11fa82700 1 -- 172.21.15.8:0/1591215572 wait complete. 2023-10-06T23:12:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.127+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3794113060 con 0x7f379410da10 2023-10-06T23:12:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.128+0000 7f378affd700 1 -- 172.21.15.8:0/1802639845 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f378c023020 con 0x7f379410da10 2023-10-06T23:12:08.129 INFO:teuthology.orchestra.run.smithi008.stdout:111669149761 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f37800a1480 msgr2=0x7f37800a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f37800a1480 0x7f37800a3940 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3790007fd0 tx=0x7f37900073d0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f379410da10 msgr2=0x7f379419dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f379410da10 0x7f379419dad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f378c0094f0 tx=0x7f378c00d3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 shutdown_connections 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f37800a1480 0x7f37800a3940 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f379410da10 0x7f379419dad0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37940689a0 0x7f3794199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 --2- 172.21.15.8:0/1802639845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940692c0 0x7f3794199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 >> 172.21.15.8:0/1802639845 conn(0x7f3794075e00 msgr2=0x7f379410ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 shutdown_connections 2023-10-06T23:12:08.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:08.130+0000 7f379c160700 1 -- 172.21.15.8:0/1802639845 wait complete. 2023-10-06T23:12:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:08 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1591215572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-06T23:12:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:08 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1802639845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-06T23:12:08.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:08 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1591215572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-06T23:12:08.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:08 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1802639845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-06T23:12:08.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:08 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1591215572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-06T23:12:08.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:08 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1802639845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-06T23:12:08.841 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149758 got 111669149761 for osd.3 2023-10-06T23:12:08.842 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:08.852 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776159 got 292057776162 for osd.9 2023-10-06T23:12:08.852 DEBUG:teuthology.parallel:result is None 2023-10-06T23:12:08.852 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-06T23:12:08.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-06T23:12:09.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:09 smithi156 ceph-mon[102862]: pgmap v328: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:09.639 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:09.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:09 smithi008 ceph-mon[98532]: pgmap v328: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:09.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:09 smithi190 ceph-mon[102658]: pgmap v328: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.185+0000 7f8a2e850700 1 -- 172.21.15.8:0/396968306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28106f90 msgr2=0x7f8a28107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.185+0000 7f8a2e850700 1 --2- 172.21.15.8:0/396968306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28106f90 0x7f8a28107370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8a180099c0 tx=0x7f8a18009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.185+0000 7f8a2e850700 1 -- 172.21.15.8:0/396968306 shutdown_connections 2023-10-06T23:12:11.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.185+0000 7f8a2e850700 1 --2- 172.21.15.8:0/396968306 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28106f90 0x7f8a28107370 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.185+0000 7f8a2e850700 1 --2- 172.21.15.8:0/396968306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a28101940 0x7f8a2810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.185+0000 7f8a2e850700 1 --2- 172.21.15.8:0/396968306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a28100f80 0x7f8a28101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.185+0000 7f8a2e850700 1 -- 172.21.15.8:0/396968306 >> 172.21.15.8:0/396968306 conn(0x7f8a280780a0 msgr2=0x7f8a280784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:11.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.186+0000 7f8a2e850700 1 -- 172.21.15.8:0/396968306 shutdown_connections 2023-10-06T23:12:11.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.186+0000 7f8a2e850700 1 -- 172.21.15.8:0/396968306 wait complete. 2023-10-06T23:12:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a2e850700 1 Processor -- start 2023-10-06T23:12:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a2e850700 1 -- start start 2023-10-06T23:12:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a2e850700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a28100f80 0x7f8a280731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a2e850700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28101940 0x7f8a280736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a2e850700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a28106f90 0x7f8a28073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a2e850700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a281a52f0 con 0x7f8a28101940 2023-10-06T23:12:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a2e850700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a281a5460 con 0x7f8a28106f90 2023-10-06T23:12:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a2e850700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a281a5620 con 0x7f8a28100f80 2023-10-06T23:12:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.187+0000 7f8a277fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28101940 0x7f8a280736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a277fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28101940 0x7f8a280736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32874/0 (socket says 172.21.15.8:32874) 2023-10-06T23:12:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a277fe700 1 -- 172.21.15.8:0/2577610279 learned_addr learned my addr 172.21.15.8:0/2577610279 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a27fff700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a28100f80 0x7f8a280731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a2cded700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a28106f90 0x7f8a28073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a277fe700 1 -- 172.21.15.8:0/2577610279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a28100f80 msgr2=0x7f8a280731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a277fe700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a28100f80 0x7f8a280731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a277fe700 1 -- 172.21.15.8:0/2577610279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a28106f90 msgr2=0x7f8a28073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a277fe700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a28106f90 0x7f8a28073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a277fe700 1 -- 172.21.15.8:0/2577610279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a180095f0 con 0x7f8a28101940 2023-10-06T23:12:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a2cded700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a28106f90 0x7f8a28073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a277fe700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28101940 0x7f8a280736f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00d950 tx=0x7f8a1c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a257fa700 1 -- 172.21.15.8:0/2577610279 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c009940 con 0x7f8a28101940 2023-10-06T23:12:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a281a5900 con 0x7f8a28101940 2023-10-06T23:12:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a257fa700 1 -- 172.21.15.8:0/2577610279 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1c010460 con 0x7f8a28101940 2023-10-06T23:12:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.188+0000 7f8a257fa700 1 -- 172.21.15.8:0/2577610279 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00f620 con 0x7f8a28101940 2023-10-06T23:12:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.189+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a281a5e50 con 0x7f8a28101940 2023-10-06T23:12:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.190+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2804ebb0 con 0x7f8a28101940 2023-10-06T23:12:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.192+0000 7f8a257fa700 1 -- 172.21.15.8:0/2577610279 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8a1c0105d0 con 0x7f8a28101940 2023-10-06T23:12:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.193+0000 7f8a257fa700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a100a1480 0x7f8a100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.193+0000 7f8a257fa700 1 -- 172.21.15.8:0/2577610279 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8a1c0ccb70 con 0x7f8a28101940 2023-10-06T23:12:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.193+0000 7f8a27fff700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a100a1480 0x7f8a100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.194+0000 7f8a27fff700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a100a1480 0x7f8a100a3940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8a18000c00 tx=0x7f8a18009f10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.197+0000 7f8a257fa700 1 -- 172.21.15.8:0/2577610279 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8a1c096180 con 0x7f8a28101940 2023-10-06T23:12:11.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.404+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a28110f50 con 0x7f8a100a1480 2023-10-06T23:12:11.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.416+0000 7f8a257fa700 1 -- 172.21.15.8:0/2577610279 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339194 (secure 0 0 0) 0x7f8a28110f50 con 0x7f8a100a1480 2023-10-06T23:12:11.422 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a100a1480 msgr2=0x7f8a100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a100a1480 0x7f8a100a3940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8a18000c00 tx=0x7f8a18009f10 comp rx=0 tx=0).stop 2023-10-06T23:12:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28101940 msgr2=0x7f8a280736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28101940 0x7f8a280736f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00d950 tx=0x7f8a1c00dc60 comp rx=0 tx=0).stop 2023-10-06T23:12:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 shutdown_connections 2023-10-06T23:12:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a100a1480 0x7f8a100a3940 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a28106f90 0x7f8a28073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a28100f80 0x7f8a280731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 --2- 172.21.15.8:0/2577610279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a28101940 0x7f8a280736f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 >> 172.21.15.8:0/2577610279 conn(0x7f8a280780a0 msgr2=0x7f8a280ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 shutdown_connections 2023-10-06T23:12:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:11.421+0000 7f8a2e850700 1 -- 172.21.15.8:0/2577610279 wait complete. 2023-10-06T23:12:11.427 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T23:12:11.925 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2023-10-06T23:12:10.955450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":425,"num_read_kb":270,"num_write":306,"num_write_kb":2976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180780,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":246,"ondisk_log_size":246,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335716,"kb_used_data":11456,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606108,"statfs":{"total":1151940427776,"available":1151596654592,"internally_reserved":0,"allocated":11730944,"data_stored":7289582,"data_compressed":107433,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002896"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030740+0000","last_change":"2023-10-06T23:11:18.264036+0000","last_active":"2023-10-06T23:11:49.030740+0000","last_peered":"2023-10-06T23:11:49.030740+0000","last_clean":"2023-10-06T23:11:49.030740+0000","last_became_active":"2023-10-06T23:11:18.261784+0000","last_became_peered":"2023-10-06T23:11:18.261784+0000","last_unstale":"2023-10-06T23:11:49.030740+0000","last_undegraded":"2023-10-06T23:11:49.030740+0000","last_fullsized":"2023-10-06T23:11:49.030740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:57.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026996+0000","last_change":"2023-10-06T23:11:18.265181+0000","last_active":"2023-10-06T23:11:49.026996+0000","last_peered":"2023-10-06T23:11:49.026996+0000","last_clean":"2023-10-06T23:11:49.026996+0000","last_became_active":"2023-10-06T23:11:18.264881+0000","last_became_peered":"2023-10-06T23:11:18.264881+0000","last_unstale":"2023-10-06T23:11:49.026996+0000","last_undegraded":"2023-10-06T23:11:49.026996+0000","last_fullsized":"2023-10-06T23:11:49.026996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:17.852643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026807+0000","last_change":"2023-10-06T23:11:18.264321+0000","last_active":"2023-10-06T23:11:49.026807+0000","last_peered":"2023-10-06T23:11:49.026807+0000","last_clean":"2023-10-06T23:11:49.026807+0000","last_became_active":"2023-10-06T23:11:18.263997+0000","last_became_peered":"2023-10-06T23:11:18.263997+0000","last_unstale":"2023-10-06T23:11:49.026807+0000","last_undegraded":"2023-10-06T23:11:49.026807+0000","last_fullsized":"2023-10-06T23:11:49.026807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:41.888419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030300+0000","last_change":"2023-10-06T23:11:18.270871+0000","last_active":"2023-10-06T23:11:49.030300+0000","last_peered":"2023-10-06T23:11:49.030300+0000","last_clean":"2023-10-06T23:11:49.030300+0000","last_became_active":"2023-10-06T23:11:18.270288+0000","last_became_peered":"2023-10-06T23:11:18.270288+0000","last_unstale":"2023-10-06T23:11:49.030300+0000","last_undegraded":"2023-10-06T23:11:49.030300+0000","last_fullsized":"2023-10-06T23:11:49.030300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:02:48.819640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032624+0000","last_change":"2023-10-06T23:11:18.261001+0000","last_active":"2023-10-06T23:11:49.032624+0000","last_peered":"2023-10-06T23:11:49.032624+0000","last_clean":"2023-10-06T23:11:49.032624+0000","last_became_active":"2023-10-06T23:11:18.260661+0000","last_became_peered":"2023-10-06T23:11:18.260661+0000","last_unstale":"2023-10-06T23:11:49.032624+0000","last_undegraded":"2023-10-06T23:11:49.032624+0000","last_fullsized":"2023-10-06T23:11:49.032624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:42.382235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.036376+0000","last_change":"2023-10-06T23:11:50.036376+0000","last_active":"2023-10-06T23:11:50.036376+0000","last_peered":"2023-10-06T23:11:50.036376+0000","last_clean":"2023-10-06T23:11:50.036376+0000","last_became_active":"2023-10-06T23:11:50.035945+0000","last_became_peered":"2023-10-06T23:11:50.035945+0000","last_unstale":"2023-10-06T23:11:50.036376+0000","last_undegraded":"2023-10-06T23:11:50.036376+0000","last_fullsized":"2023-10-06T23:11:50.036376+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:50:33.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036114+0000","last_change":"2023-10-06T23:11:18.263968+0000","last_active":"2023-10-06T23:11:49.036114+0000","last_peered":"2023-10-06T23:11:49.036114+0000","last_clean":"2023-10-06T23:11:49.036114+0000","last_became_active":"2023-10-06T23:11:18.263634+0000","last_became_peered":"2023-10-06T23:11:18.263634+0000","last_unstale":"2023-10-06T23:11:49.036114+0000","last_undegraded":"2023-10-06T23:11:49.036114+0000","last_fullsized":"2023-10-06T23:11:49.036114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:18:23.856232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035537+0000","last_change":"2023-10-06T23:11:18.268945+0000","last_active":"2023-10-06T23:11:49.035537+0000","last_peered":"2023-10-06T23:11:49.035537+0000","last_clean":"2023-10-06T23:11:49.035537+0000","last_became_active":"2023-10-06T23:11:18.268598+0000","last_became_peered":"2023-10-06T23:11:18.268598+0000","last_unstale":"2023-10-06T23:11:49.035537+0000","last_undegraded":"2023-10-06T23:11:49.035537+0000","last_fullsized":"2023-10-06T23:11:49.035537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:09:21.238230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042773+0000","last_change":"2023-10-06T23:11:18.261872+0000","last_active":"2023-10-06T23:11:49.042773+0000","last_peered":"2023-10-06T23:11:49.042773+0000","last_clean":"2023-10-06T23:11:49.042773+0000","last_became_active":"2023-10-06T23:11:18.261583+0000","last_became_peered":"2023-10-06T23:11:18.261583+0000","last_unstale":"2023-10-06T23:11:49.042773+0000","last_undegraded":"2023-10-06T23:11:49.042773+0000","last_fullsized":"2023-10-06T23:11:49.042773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:50:54.145738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039796+0000","last_change":"2023-10-06T23:11:50.039796+0000","last_active":"2023-10-06T23:11:50.039796+0000","last_peered":"2023-10-06T23:11:50.039796+0000","last_clean":"2023-10-06T23:11:50.039796+0000","last_became_active":"2023-10-06T23:11:50.039420+0000","last_became_peered":"2023-10-06T23:11:50.039420+0000","last_unstale":"2023-10-06T23:11:50.039796+0000","last_undegraded":"2023-10-06T23:11:50.039796+0000","last_fullsized":"2023-10-06T23:11:50.039796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:28.641948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036360+0000","last_change":"2023-10-06T23:11:18.266565+0000","last_active":"2023-10-06T23:11:49.036360+0000","last_peered":"2023-10-06T23:11:49.036360+0000","last_clean":"2023-10-06T23:11:49.036360+0000","last_became_active":"2023-10-06T23:11:18.266290+0000","last_became_peered":"2023-10-06T23:11:18.266290+0000","last_unstale":"2023-10-06T23:11:49.036360+0000","last_undegraded":"2023-10-06T23:11:49.036360+0000","last_fullsized":"2023-10-06T23:11:49.036360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:45:07.828100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030127+0000","last_change":"2023-10-06T23:11:18.266849+0000","last_active":"2023-10-06T23:11:49.030127+0000","last_peered":"2023-10-06T23:11:49.030127+0000","last_clean":"2023-10-06T23:11:49.030127+0000","last_became_active":"2023-10-06T23:11:18.266517+0000","last_became_peered":"2023-10-06T23:11:18.266517+0000","last_unstale":"2023-10-06T23:11:49.030127+0000","last_undegraded":"2023-10-06T23:11:49.030127+0000","last_fullsized":"2023-10-06T23:11:49.030127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:25:31.988065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031565+0000","last_change":"2023-10-06T23:11:18.270336+0000","last_active":"2023-10-06T23:11:49.031565+0000","last_peered":"2023-10-06T23:11:49.031565+0000","last_clean":"2023-10-06T23:11:49.031565+0000","last_became_active":"2023-10-06T23:11:18.269969+0000","last_became_peered":"2023-10-06T23:11:18.269969+0000","last_unstale":"2023-10-06T23:11:49.031565+0000","last_undegraded":"2023-10-06T23:11:49.031565+0000","last_fullsized":"2023-10-06T23:11:49.031565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:25.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026121+0000","last_change":"2023-10-06T23:11:18.264549+0000","last_active":"2023-10-06T23:11:49.026121+0000","last_peered":"2023-10-06T23:11:49.026121+0000","last_clean":"2023-10-06T23:11:49.026121+0000","last_became_active":"2023-10-06T23:11:18.263446+0000","last_became_peered":"2023-10-06T23:11:18.263446+0000","last_unstale":"2023-10-06T23:11:49.026121+0000","last_undegraded":"2023-10-06T23:11:49.026121+0000","last_fullsized":"2023-10-06T23:11:49.026121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:21:57.009374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026364+0000","last_change":"2023-10-06T23:11:18.262470+0000","last_active":"2023-10-06T23:11:49.026364+0000","last_peered":"2023-10-06T23:11:49.026364+0000","last_clean":"2023-10-06T23:11:49.026364+0000","last_became_active":"2023-10-06T23:11:18.262134+0000","last_became_peered":"2023-10-06T23:11:18.262134+0000","last_unstale":"2023-10-06T23:11:49.026364+0000","last_undegraded":"2023-10-06T23:11:49.026364+0000","last_fullsized":"2023-10-06T23:11:49.026364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:09:26.745107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042326+0000","last_change":"2023-10-06T23:11:18.260657+0000","last_active":"2023-10-06T23:11:49.042326+0000","last_peered":"2023-10-06T23:11:49.042326+0000","last_clean":"2023-10-06T23:11:49.042326+0000","last_became_active":"2023-10-06T23:11:18.260343+0000","last_became_peered":"2023-10-06T23:11:18.260343+0000","last_unstale":"2023-10-06T23:11:49.042326+0000","last_undegraded":"2023-10-06T23:11:49.042326+0000","last_fullsized":"2023-10-06T23:11:49.042326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:46:24.199333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030882+0000","last_change":"2023-10-06T23:11:18.262071+0000","last_active":"2023-10-06T23:11:49.030882+0000","last_peered":"2023-10-06T23:11:49.030882+0000","last_clean":"2023-10-06T23:11:49.030882+0000","last_became_active":"2023-10-06T23:11:18.261348+0000","last_became_peered":"2023-10-06T23:11:18.261348+0000","last_unstale":"2023-10-06T23:11:49.030882+0000","last_undegraded":"2023-10-06T23:11:49.030882+0000","last_fullsized":"2023-10-06T23:11:49.030882+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:57:54.957156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033065+0000","last_change":"2023-10-06T23:11:18.266593+0000","last_active":"2023-10-06T23:11:49.033065+0000","last_peered":"2023-10-06T23:11:49.033065+0000","last_clean":"2023-10-06T23:11:49.033065+0000","last_became_active":"2023-10-06T23:11:18.266293+0000","last_became_peered":"2023-10-06T23:11:18.266293+0000","last_unstale":"2023-10-06T23:11:49.033065+0000","last_undegraded":"2023-10-06T23:11:49.033065+0000","last_fullsized":"2023-10-06T23:11:49.033065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:03:45.130437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037218+0000","last_change":"2023-10-06T23:11:18.264871+0000","last_active":"2023-10-06T23:11:49.037218+0000","last_peered":"2023-10-06T23:11:49.037218+0000","last_clean":"2023-10-06T23:11:49.037218+0000","last_became_active":"2023-10-06T23:11:18.264451+0000","last_became_peered":"2023-10-06T23:11:18.264451+0000","last_unstale":"2023-10-06T23:11:49.037218+0000","last_undegraded":"2023-10-06T23:11:49.037218+0000","last_fullsized":"2023-10-06T23:11:49.037218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:40:00.581508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033336+0000","last_change":"2023-10-06T23:11:17.255867+0000","last_active":"2023-10-06T23:11:49.033336+0000","last_peered":"2023-10-06T23:11:49.033336+0000","last_clean":"2023-10-06T23:11:49.033336+0000","last_became_active":"2023-10-06T23:11:17.255463+0000","last_became_peered":"2023-10-06T23:11:17.255463+0000","last_unstale":"2023-10-06T23:11:49.033336+0000","last_undegraded":"2023-10-06T23:11:49.033336+0000","last_fullsized":"2023-10-06T23:11:49.033336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:21:29.493049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037811+0000","last_change":"2023-10-06T23:11:18.262575+0000","last_active":"2023-10-06T23:11:49.037811+0000","last_peered":"2023-10-06T23:11:49.037811+0000","last_clean":"2023-10-06T23:11:49.037811+0000","last_became_active":"2023-10-06T23:11:18.262266+0000","last_became_peered":"2023-10-06T23:11:18.262266+0000","last_unstale":"2023-10-06T23:11:49.037811+0000","last_undegraded":"2023-10-06T23:11:49.037811+0000","last_fullsized":"2023-10-06T23:11:49.037811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:37:10.870786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037989+0000","last_change":"2023-10-06T23:11:17.259061+0000","last_active":"2023-10-06T23:11:49.037989+0000","last_peered":"2023-10-06T23:11:49.037989+0000","last_clean":"2023-10-06T23:11:49.037989+0000","last_became_active":"2023-10-06T23:11:17.258624+0000","last_became_peered":"2023-10-06T23:11:17.258624+0000","last_unstale":"2023-10-06T23:11:49.037989+0000","last_undegraded":"2023-10-06T23:11:49.037989+0000","last_fullsized":"2023-10-06T23:11:49.037989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:28.121405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027230+0000","last_change":"2023-10-06T23:11:18.263840+0000","last_active":"2023-10-06T23:11:49.027230+0000","last_peered":"2023-10-06T23:11:49.027230+0000","last_clean":"2023-10-06T23:11:49.027230+0000","last_became_active":"2023-10-06T23:11:18.263454+0000","last_became_peered":"2023-10-06T23:11:18.263454+0000","last_unstale":"2023-10-06T23:11:49.027230+0000","last_undegraded":"2023-10-06T23:11:49.027230+0000","last_fullsized":"2023-10-06T23:11:49.027230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:49.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.044245+0000","last_change":"2023-10-06T23:11:50.044245+0000","last_active":"2023-10-06T23:11:50.044245+0000","last_peered":"2023-10-06T23:11:50.044245+0000","last_clean":"2023-10-06T23:11:50.044245+0000","last_became_active":"2023-10-06T23:11:50.038493+0000","last_became_peered":"2023-10-06T23:11:50.038493+0000","last_unstale":"2023-10-06T23:11:50.044245+0000","last_undegraded":"2023-10-06T23:11:50.044245+0000","last_fullsized":"2023-10-06T23:11:50.044245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:19.463617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042312+0000","last_change":"2023-10-06T23:11:18.274068+0000","last_active":"2023-10-06T23:11:49.042312+0000","last_peered":"2023-10-06T23:11:49.042312+0000","last_clean":"2023-10-06T23:11:49.042312+0000","last_became_active":"2023-10-06T23:11:18.273692+0000","last_became_peered":"2023-10-06T23:11:18.273692+0000","last_unstale":"2023-10-06T23:11:49.042312+0000","last_undegraded":"2023-10-06T23:11:49.042312+0000","last_fullsized":"2023-10-06T23:11:49.042312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:57:07.735915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032982+0000","last_change":"2023-10-06T23:11:17.260046+0000","last_active":"2023-10-06T23:11:49.032982+0000","last_peered":"2023-10-06T23:11:49.032982+0000","last_clean":"2023-10-06T23:11:49.032982+0000","last_became_active":"2023-10-06T23:11:17.259638+0000","last_became_peered":"2023-10-06T23:11:17.259638+0000","last_unstale":"2023-10-06T23:11:49.032982+0000","last_undegraded":"2023-10-06T23:11:49.032982+0000","last_fullsized":"2023-10-06T23:11:49.032982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:21.660072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035736+0000","last_change":"2023-10-06T23:11:18.264328+0000","last_active":"2023-10-06T23:11:49.035736+0000","last_peered":"2023-10-06T23:11:49.035736+0000","last_clean":"2023-10-06T23:11:49.035736+0000","last_became_active":"2023-10-06T23:11:18.263554+0000","last_became_peered":"2023-10-06T23:11:18.263554+0000","last_unstale":"2023-10-06T23:11:49.035736+0000","last_undegraded":"2023-10-06T23:11:49.035736+0000","last_fullsized":"2023-10-06T23:11:49.035736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:44:02.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:06.322246+0000","last_change":"2023-10-06T23:11:17.265538+0000","last_active":"2023-10-06T23:12:06.322246+0000","last_peered":"2023-10-06T23:12:06.322246+0000","last_clean":"2023-10-06T23:12:06.322246+0000","last_became_active":"2023-10-06T23:11:17.265044+0000","last_became_peered":"2023-10-06T23:11:17.265044+0000","last_unstale":"2023-10-06T23:12:06.322246+0000","last_undegraded":"2023-10-06T23:12:06.322246+0000","last_fullsized":"2023-10-06T23:12:06.322246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:51.220961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032801+0000","last_change":"2023-10-06T23:11:18.257044+0000","last_active":"2023-10-06T23:11:49.032801+0000","last_peered":"2023-10-06T23:11:49.032801+0000","last_clean":"2023-10-06T23:11:49.032801+0000","last_became_active":"2023-10-06T23:11:18.256711+0000","last_became_peered":"2023-10-06T23:11:18.256711+0000","last_unstale":"2023-10-06T23:11:49.032801+0000","last_undegraded":"2023-10-06T23:11:49.032801+0000","last_fullsized":"2023-10-06T23:11:49.032801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:40:25.441143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032501+0000","last_change":"2023-10-06T23:11:17.262062+0000","last_active":"2023-10-06T23:11:49.032501+0000","last_peered":"2023-10-06T23:11:49.032501+0000","last_clean":"2023-10-06T23:11:49.032501+0000","last_became_active":"2023-10-06T23:11:17.261618+0000","last_became_peered":"2023-10-06T23:11:17.261618+0000","last_unstale":"2023-10-06T23:11:49.032501+0000","last_undegraded":"2023-10-06T23:11:49.032501+0000","last_fullsized":"2023-10-06T23:11:49.032501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:59:33.544470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034757+0000","last_change":"2023-10-06T23:11:18.263242+0000","last_active":"2023-10-06T23:11:49.034757+0000","last_peered":"2023-10-06T23:11:49.034757+0000","last_clean":"2023-10-06T23:11:49.034757+0000","last_became_active":"2023-10-06T23:11:18.262684+0000","last_became_peered":"2023-10-06T23:11:18.262684+0000","last_unstale":"2023-10-06T23:11:49.034757+0000","last_undegraded":"2023-10-06T23:11:49.034757+0000","last_fullsized":"2023-10-06T23:11:49.034757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:30:04.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032315+0000","last_change":"2023-10-06T23:11:17.254042+0000","last_active":"2023-10-06T23:11:49.032315+0000","last_peered":"2023-10-06T23:11:49.032315+0000","last_clean":"2023-10-06T23:11:49.032315+0000","last_became_active":"2023-10-06T23:11:17.253704+0000","last_became_peered":"2023-10-06T23:11:17.253704+0000","last_unstale":"2023-10-06T23:11:49.032315+0000","last_undegraded":"2023-10-06T23:11:49.032315+0000","last_fullsized":"2023-10-06T23:11:49.032315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:44.179814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035458+0000","last_change":"2023-10-06T23:11:18.259161+0000","last_active":"2023-10-06T23:11:49.035458+0000","last_peered":"2023-10-06T23:11:49.035458+0000","last_clean":"2023-10-06T23:11:49.035458+0000","last_became_active":"2023-10-06T23:11:18.258747+0000","last_became_peered":"2023-10-06T23:11:18.258747+0000","last_unstale":"2023-10-06T23:11:49.035458+0000","last_undegraded":"2023-10-06T23:11:49.035458+0000","last_fullsized":"2023-10-06T23:11:49.035458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:55:38.340988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034650+0000","last_change":"2023-10-06T23:11:17.266278+0000","last_active":"2023-10-06T23:11:49.034650+0000","last_peered":"2023-10-06T23:11:49.034650+0000","last_clean":"2023-10-06T23:11:49.034650+0000","last_became_active":"2023-10-06T23:11:17.265174+0000","last_became_peered":"2023-10-06T23:11:17.265174+0000","last_unstale":"2023-10-06T23:11:49.034650+0000","last_undegraded":"2023-10-06T23:11:49.034650+0000","last_fullsized":"2023-10-06T23:11:49.034650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:51.203566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032078+0000","last_change":"2023-10-06T23:11:18.259699+0000","last_active":"2023-10-06T23:11:49.032078+0000","last_peered":"2023-10-06T23:11:49.032078+0000","last_clean":"2023-10-06T23:11:49.032078+0000","last_became_active":"2023-10-06T23:11:18.259395+0000","last_became_peered":"2023-10-06T23:11:18.259395+0000","last_unstale":"2023-10-06T23:11:49.032078+0000","last_undegraded":"2023-10-06T23:11:49.032078+0000","last_fullsized":"2023-10-06T23:11:49.032078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:32:37.830092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:08.324935+0000","last_change":"2023-10-06T23:11:17.259592+0000","last_active":"2023-10-06T23:12:08.324935+0000","last_peered":"2023-10-06T23:12:08.324935+0000","last_clean":"2023-10-06T23:12:08.324935+0000","last_became_active":"2023-10-06T23:11:17.259254+0000","last_became_peered":"2023-10-06T23:11:17.259254+0000","last_unstale":"2023-10-06T23:12:08.324935+0000","last_undegraded":"2023-10-06T23:12:08.324935+0000","last_fullsized":"2023-10-06T23:12:08.324935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:31.633620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042667+0000","last_change":"2023-10-06T23:11:18.271568+0000","last_active":"2023-10-06T23:11:49.042667+0000","last_peered":"2023-10-06T23:11:49.042667+0000","last_clean":"2023-10-06T23:11:49.042667+0000","last_became_active":"2023-10-06T23:11:18.271248+0000","last_became_peered":"2023-10-06T23:11:18.271248+0000","last_unstale":"2023-10-06T23:11:49.042667+0000","last_undegraded":"2023-10-06T23:11:49.042667+0000","last_fullsized":"2023-10-06T23:11:49.042667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:30.138803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036265+0000","last_change":"2023-10-06T23:11:17.257823+0000","last_active":"2023-10-06T23:11:49.036265+0000","last_peered":"2023-10-06T23:11:49.036265+0000","last_clean":"2023-10-06T23:11:49.036265+0000","last_became_active":"2023-10-06T23:11:17.257426+0000","last_became_peered":"2023-10-06T23:11:17.257426+0000","last_unstale":"2023-10-06T23:11:49.036265+0000","last_undegraded":"2023-10-06T23:11:49.036265+0000","last_fullsized":"2023-10-06T23:11:49.036265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:27:17.158360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027188+0000","last_change":"2023-10-06T23:11:18.260555+0000","last_active":"2023-10-06T23:11:49.027188+0000","last_peered":"2023-10-06T23:11:49.027188+0000","last_clean":"2023-10-06T23:11:49.027188+0000","last_became_active":"2023-10-06T23:11:18.260236+0000","last_became_peered":"2023-10-06T23:11:18.260236+0000","last_unstale":"2023-10-06T23:11:49.027188+0000","last_undegraded":"2023-10-06T23:11:49.027188+0000","last_fullsized":"2023-10-06T23:11:49.027188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:51.499668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035946+0000","last_change":"2023-10-06T23:11:17.267686+0000","last_active":"2023-10-06T23:11:49.035946+0000","last_peered":"2023-10-06T23:11:49.035946+0000","last_clean":"2023-10-06T23:11:49.035946+0000","last_became_active":"2023-10-06T23:11:17.267322+0000","last_became_peered":"2023-10-06T23:11:17.267322+0000","last_unstale":"2023-10-06T23:11:49.035946+0000","last_undegraded":"2023-10-06T23:11:49.035946+0000","last_fullsized":"2023-10-06T23:11:49.035946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:48:40.755898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042418+0000","last_change":"2023-10-06T23:11:18.257382+0000","last_active":"2023-10-06T23:11:49.042418+0000","last_peered":"2023-10-06T23:11:49.042418+0000","last_clean":"2023-10-06T23:11:49.042418+0000","last_became_active":"2023-10-06T23:11:18.256572+0000","last_became_peered":"2023-10-06T23:11:18.256572+0000","last_unstale":"2023-10-06T23:11:49.042418+0000","last_undegraded":"2023-10-06T23:11:49.042418+0000","last_fullsized":"2023-10-06T23:11:49.042418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:43.631813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'8","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:10.305860+0000","last_change":"2023-10-06T23:11:17.257340+0000","last_active":"2023-10-06T23:12:10.305860+0000","last_peered":"2023-10-06T23:12:10.305860+0000","last_clean":"2023-10-06T23:12:10.305860+0000","last_became_active":"2023-10-06T23:11:17.256973+0000","last_became_peered":"2023-10-06T23:11:17.256973+0000","last_unstale":"2023-10-06T23:12:10.305860+0000","last_undegraded":"2023-10-06T23:12:10.305860+0000","last_fullsized":"2023-10-06T23:12:10.305860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:35.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":51,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033409+0000","last_change":"2023-10-06T23:11:18.258928+0000","last_active":"2023-10-06T23:11:49.033409+0000","last_peered":"2023-10-06T23:11:49.033409+0000","last_clean":"2023-10-06T23:11:49.033409+0000","last_became_active":"2023-10-06T23:11:18.258572+0000","last_became_peered":"2023-10-06T23:11:18.258572+0000","last_unstale":"2023-10-06T23:11:49.033409+0000","last_undegraded":"2023-10-06T23:11:49.033409+0000","last_fullsized":"2023-10-06T23:11:49.033409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:51.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037051+0000","last_change":"2023-10-06T23:11:17.260955+0000","last_active":"2023-10-06T23:11:49.037051+0000","last_peered":"2023-10-06T23:11:49.037051+0000","last_clean":"2023-10-06T23:11:49.037051+0000","last_became_active":"2023-10-06T23:11:17.260565+0000","last_became_peered":"2023-10-06T23:11:17.260565+0000","last_unstale":"2023-10-06T23:11:49.037051+0000","last_undegraded":"2023-10-06T23:11:49.037051+0000","last_fullsized":"2023-10-06T23:11:49.037051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:14:51.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031110+0000","last_change":"2023-10-06T23:11:18.266857+0000","last_active":"2023-10-06T23:11:49.031110+0000","last_peered":"2023-10-06T23:11:49.031110+0000","last_clean":"2023-10-06T23:11:49.031110+0000","last_became_active":"2023-10-06T23:11:18.266476+0000","last_became_peered":"2023-10-06T23:11:18.266476+0000","last_unstale":"2023-10-06T23:11:49.031110+0000","last_undegraded":"2023-10-06T23:11:49.031110+0000","last_fullsized":"2023-10-06T23:11:49.031110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:26.131492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035426+0000","last_change":"2023-10-06T23:11:17.265672+0000","last_active":"2023-10-06T23:11:49.035426+0000","last_peered":"2023-10-06T23:11:49.035426+0000","last_clean":"2023-10-06T23:11:49.035426+0000","last_became_active":"2023-10-06T23:11:17.265329+0000","last_became_peered":"2023-10-06T23:11:17.265329+0000","last_unstale":"2023-10-06T23:11:49.035426+0000","last_undegraded":"2023-10-06T23:11:49.035426+0000","last_fullsized":"2023-10-06T23:11:49.035426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:43.159919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036115+0000","last_change":"2023-10-06T23:11:18.269427+0000","last_active":"2023-10-06T23:11:49.036115+0000","last_peered":"2023-10-06T23:11:49.036115+0000","last_clean":"2023-10-06T23:11:49.036115+0000","last_became_active":"2023-10-06T23:11:18.269115+0000","last_became_peered":"2023-10-06T23:11:18.269115+0000","last_unstale":"2023-10-06T23:11:49.036115+0000","last_undegraded":"2023-10-06T23:11:49.036115+0000","last_fullsized":"2023-10-06T23:11:49.036115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:12.598526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:04.324222+0000","last_change":"2023-10-06T23:11:17.252599+0000","last_active":"2023-10-06T23:12:04.324222+0000","last_peered":"2023-10-06T23:12:04.324222+0000","last_clean":"2023-10-06T23:12:04.324222+0000","last_became_active":"2023-10-06T23:11:17.251893+0000","last_became_peered":"2023-10-06T23:11:17.251893+0000","last_unstale":"2023-10-06T23:12:04.324222+0000","last_undegraded":"2023-10-06T23:12:04.324222+0000","last_fullsized":"2023-10-06T23:12:04.324222+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:24:10.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035840+0000","last_change":"2023-10-06T23:11:18.269026+0000","last_active":"2023-10-06T23:11:49.035840+0000","last_peered":"2023-10-06T23:11:49.035840+0000","last_clean":"2023-10-06T23:11:49.035840+0000","last_became_active":"2023-10-06T23:11:18.268701+0000","last_became_peered":"2023-10-06T23:11:18.268701+0000","last_unstale":"2023-10-06T23:11:49.035840+0000","last_undegraded":"2023-10-06T23:11:49.035840+0000","last_fullsized":"2023-10-06T23:11:49.035840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:03:25.903664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032636+0000","last_change":"2023-10-06T23:11:17.255323+0000","last_active":"2023-10-06T23:11:49.032636+0000","last_peered":"2023-10-06T23:11:49.032636+0000","last_clean":"2023-10-06T23:11:49.032636+0000","last_became_active":"2023-10-06T23:11:17.254975+0000","last_became_peered":"2023-10-06T23:11:17.254975+0000","last_unstale":"2023-10-06T23:11:49.032636+0000","last_undegraded":"2023-10-06T23:11:49.032636+0000","last_fullsized":"2023-10-06T23:11:49.032636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:41:35.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035228+0000","last_change":"2023-10-06T23:11:18.263290+0000","last_active":"2023-10-06T23:11:49.035228+0000","last_peered":"2023-10-06T23:11:49.035228+0000","last_clean":"2023-10-06T23:11:49.035228+0000","last_became_active":"2023-10-06T23:11:18.262680+0000","last_became_peered":"2023-10-06T23:11:18.262680+0000","last_unstale":"2023-10-06T23:11:49.035228+0000","last_undegraded":"2023-10-06T23:11:49.035228+0000","last_fullsized":"2023-10-06T23:11:49.035228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:43:12.249803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.048876+0000","last_change":"2023-10-06T23:11:50.048453+0000","last_active":"2023-10-06T23:11:50.048876+0000","last_peered":"2023-10-06T23:11:50.048876+0000","last_clean":"2023-10-06T23:11:50.048876+0000","last_became_active":"2023-10-06T23:11:50.035200+0000","last_became_peered":"2023-10-06T23:11:50.035200+0000","last_unstale":"2023-10-06T23:11:50.048876+0000","last_undegraded":"2023-10-06T23:11:50.048876+0000","last_fullsized":"2023-10-06T23:11:50.048876+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:31:21.791916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.032715+0000","last_change":"2023-10-06T23:11:50.032715+0000","last_active":"2023-10-06T23:11:50.032715+0000","last_peered":"2023-10-06T23:11:50.032715+0000","last_clean":"2023-10-06T23:11:50.032715+0000","last_became_active":"2023-10-06T23:11:50.032326+0000","last_became_peered":"2023-10-06T23:11:50.032326+0000","last_unstale":"2023-10-06T23:11:50.032715+0000","last_undegraded":"2023-10-06T23:11:50.032715+0000","last_fullsized":"2023-10-06T23:11:50.032715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:26:25.453692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032907+0000","last_change":"2023-10-06T23:11:17.258175+0000","last_active":"2023-10-06T23:11:49.032907+0000","last_peered":"2023-10-06T23:11:49.032907+0000","last_clean":"2023-10-06T23:11:49.032907+0000","last_became_active":"2023-10-06T23:11:17.257780+0000","last_became_peered":"2023-10-06T23:11:17.257780+0000","last_unstale":"2023-10-06T23:11:49.032907+0000","last_undegraded":"2023-10-06T23:11:49.032907+0000","last_fullsized":"2023-10-06T23:11:49.032907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:19:51.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033026+0000","last_change":"2023-10-06T23:11:18.267837+0000","last_active":"2023-10-06T23:11:49.033026+0000","last_peered":"2023-10-06T23:11:49.033026+0000","last_clean":"2023-10-06T23:11:49.033026+0000","last_became_active":"2023-10-06T23:11:18.267535+0000","last_became_peered":"2023-10-06T23:11:18.267535+0000","last_unstale":"2023-10-06T23:11:49.033026+0000","last_undegraded":"2023-10-06T23:11:49.033026+0000","last_fullsized":"2023-10-06T23:11:49.033026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:08.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036029+0000","last_change":"2023-10-06T23:11:17.261075+0000","last_active":"2023-10-06T23:11:49.036029+0000","last_peered":"2023-10-06T23:11:49.036029+0000","last_clean":"2023-10-06T23:11:49.036029+0000","last_became_active":"2023-10-06T23:11:17.260456+0000","last_became_peered":"2023-10-06T23:11:17.260456+0000","last_unstale":"2023-10-06T23:11:49.036029+0000","last_undegraded":"2023-10-06T23:11:49.036029+0000","last_fullsized":"2023-10-06T23:11:49.036029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:00:25.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032760+0000","last_change":"2023-10-06T23:11:18.265347+0000","last_active":"2023-10-06T23:11:49.032760+0000","last_peered":"2023-10-06T23:11:49.032760+0000","last_clean":"2023-10-06T23:11:49.032760+0000","last_became_active":"2023-10-06T23:11:18.265034+0000","last_became_peered":"2023-10-06T23:11:18.265034+0000","last_unstale":"2023-10-06T23:11:49.032760+0000","last_undegraded":"2023-10-06T23:11:49.032760+0000","last_fullsized":"2023-10-06T23:11:49.032760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:32:44.253022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034992+0000","last_change":"2023-10-06T23:11:18.263990+0000","last_active":"2023-10-06T23:11:49.034992+0000","last_peered":"2023-10-06T23:11:49.034992+0000","last_clean":"2023-10-06T23:11:49.034992+0000","last_became_active":"2023-10-06T23:11:18.262760+0000","last_became_peered":"2023-10-06T23:11:18.262760+0000","last_unstale":"2023-10-06T23:11:49.034992+0000","last_undegraded":"2023-10-06T23:11:49.034992+0000","last_fullsized":"2023-10-06T23:11:49.034992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:48:51.754187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:06.326573+0000","last_change":"2023-10-06T23:11:17.263187+0000","last_active":"2023-10-06T23:12:06.326573+0000","last_peered":"2023-10-06T23:12:06.326573+0000","last_clean":"2023-10-06T23:12:06.326573+0000","last_became_active":"2023-10-06T23:11:17.262770+0000","last_became_peered":"2023-10-06T23:11:17.262770+0000","last_unstale":"2023-10-06T23:12:06.326573+0000","last_undegraded":"2023-10-06T23:12:06.326573+0000","last_fullsized":"2023-10-06T23:12:06.326573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:27.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036248+0000","last_change":"2023-10-06T23:11:18.264305+0000","last_active":"2023-10-06T23:11:49.036248+0000","last_peered":"2023-10-06T23:11:49.036248+0000","last_clean":"2023-10-06T23:11:49.036248+0000","last_became_active":"2023-10-06T23:11:18.263964+0000","last_became_peered":"2023-10-06T23:11:18.263964+0000","last_unstale":"2023-10-06T23:11:49.036248+0000","last_undegraded":"2023-10-06T23:11:49.036248+0000","last_fullsized":"2023-10-06T23:11:49.036248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:11.855254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030137+0000","last_change":"2023-10-06T23:11:17.249832+0000","last_active":"2023-10-06T23:11:49.030137+0000","last_peered":"2023-10-06T23:11:49.030137+0000","last_clean":"2023-10-06T23:11:49.030137+0000","last_became_active":"2023-10-06T23:11:17.249425+0000","last_became_peered":"2023-10-06T23:11:17.249425+0000","last_unstale":"2023-10-06T23:11:49.030137+0000","last_undegraded":"2023-10-06T23:11:49.030137+0000","last_fullsized":"2023-10-06T23:11:49.030137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:02:49.349981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":312,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036114+0000","last_change":"2023-10-06T23:09:57.868881+0000","last_active":"2023-10-06T23:11:49.036114+0000","last_peered":"2023-10-06T23:11:49.036114+0000","last_clean":"2023-10-06T23:11:49.036114+0000","last_became_active":"2023-10-06T23:09:57.868450+0000","last_became_peered":"2023-10-06T23:09:57.868450+0000","last_unstale":"2023-10-06T23:11:49.036114+0000","last_undegraded":"2023-10-06T23:11:49.036114+0000","last_fullsized":"2023-10-06T23:11:49.036114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_clean_scrub_stamp":"2023-10-06T23:06:23.790096+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:39:38.741355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039829+0000","last_change":"2023-10-06T23:11:50.039829+0000","last_active":"2023-10-06T23:11:50.039829+0000","last_peered":"2023-10-06T23:11:50.039829+0000","last_clean":"2023-10-06T23:11:50.039829+0000","last_became_active":"2023-10-06T23:11:50.039403+0000","last_became_peered":"2023-10-06T23:11:50.039403+0000","last_unstale":"2023-10-06T23:11:50.039829+0000","last_undegraded":"2023-10-06T23:11:50.039829+0000","last_fullsized":"2023-10-06T23:11:50.039829+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:33.599164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036051+0000","last_change":"2023-10-06T23:11:17.259610+0000","last_active":"2023-10-06T23:11:49.036051+0000","last_peered":"2023-10-06T23:11:49.036051+0000","last_clean":"2023-10-06T23:11:49.036051+0000","last_became_active":"2023-10-06T23:11:17.259314+0000","last_became_peered":"2023-10-06T23:11:17.259314+0000","last_unstale":"2023-10-06T23:11:49.036051+0000","last_undegraded":"2023-10-06T23:11:49.036051+0000","last_fullsized":"2023-10-06T23:11:49.036051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:48.131199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.040322+0000","last_change":"2023-10-06T23:11:50.039550+0000","last_active":"2023-10-06T23:11:50.040322+0000","last_peered":"2023-10-06T23:11:50.040322+0000","last_clean":"2023-10-06T23:11:50.040322+0000","last_became_active":"2023-10-06T23:11:50.033804+0000","last_became_peered":"2023-10-06T23:11:50.033804+0000","last_unstale":"2023-10-06T23:11:50.040322+0000","last_undegraded":"2023-10-06T23:11:50.040322+0000","last_fullsized":"2023-10-06T23:11:50.040322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:06.172652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031729+0000","last_change":"2023-10-06T23:11:18.259562+0000","last_active":"2023-10-06T23:11:49.031729+0000","last_peered":"2023-10-06T23:11:49.031729+0000","last_clean":"2023-10-06T23:11:49.031729+0000","last_became_active":"2023-10-06T23:11:18.259188+0000","last_became_peered":"2023-10-06T23:11:18.259188+0000","last_unstale":"2023-10-06T23:11:49.031729+0000","last_undegraded":"2023-10-06T23:11:49.031729+0000","last_fullsized":"2023-10-06T23:11:49.031729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:19.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033164+0000","last_change":"2023-10-06T23:11:17.260888+0000","last_active":"2023-10-06T23:11:49.033164+0000","last_peered":"2023-10-06T23:11:49.033164+0000","last_clean":"2023-10-06T23:11:49.033164+0000","last_became_active":"2023-10-06T23:11:17.260563+0000","last_became_peered":"2023-10-06T23:11:17.260563+0000","last_unstale":"2023-10-06T23:11:49.033164+0000","last_undegraded":"2023-10-06T23:11:49.033164+0000","last_fullsized":"2023-10-06T23:11:49.033164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:43.087389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036989+0000","last_change":"2023-10-06T23:11:18.261401+0000","last_active":"2023-10-06T23:11:49.036989+0000","last_peered":"2023-10-06T23:11:49.036989+0000","last_clean":"2023-10-06T23:11:49.036989+0000","last_became_active":"2023-10-06T23:11:18.261037+0000","last_became_peered":"2023-10-06T23:11:18.261037+0000","last_unstale":"2023-10-06T23:11:49.036989+0000","last_undegraded":"2023-10-06T23:11:49.036989+0000","last_fullsized":"2023-10-06T23:11:49.036989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:53.298980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030447+0000","last_change":"2023-10-06T23:11:17.264907+0000","last_active":"2023-10-06T23:11:49.030447+0000","last_peered":"2023-10-06T23:11:49.030447+0000","last_clean":"2023-10-06T23:11:49.030447+0000","last_became_active":"2023-10-06T23:11:17.264426+0000","last_became_peered":"2023-10-06T23:11:17.264426+0000","last_unstale":"2023-10-06T23:11:49.030447+0000","last_undegraded":"2023-10-06T23:11:49.030447+0000","last_fullsized":"2023-10-06T23:11:49.030447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:21.330048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027045+0000","last_change":"2023-10-06T23:11:18.259337+0000","last_active":"2023-10-06T23:11:49.027045+0000","last_peered":"2023-10-06T23:11:49.027045+0000","last_clean":"2023-10-06T23:11:49.027045+0000","last_became_active":"2023-10-06T23:11:18.259008+0000","last_became_peered":"2023-10-06T23:11:18.259008+0000","last_unstale":"2023-10-06T23:11:49.027045+0000","last_undegraded":"2023-10-06T23:11:49.027045+0000","last_fullsized":"2023-10-06T23:11:49.027045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:28.845368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042510+0000","last_change":"2023-10-06T23:11:17.267695+0000","last_active":"2023-10-06T23:11:49.042510+0000","last_peered":"2023-10-06T23:11:49.042510+0000","last_clean":"2023-10-06T23:11:49.042510+0000","last_became_active":"2023-10-06T23:11:17.267292+0000","last_became_peered":"2023-10-06T23:11:17.267292+0000","last_unstale":"2023-10-06T23:11:49.042510+0000","last_undegraded":"2023-10-06T23:11:49.042510+0000","last_fullsized":"2023-10-06T23:11:49.042510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:36:54.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032536+0000","last_change":"2023-10-06T23:11:18.260012+0000","last_active":"2023-10-06T23:11:49.032536+0000","last_peered":"2023-10-06T23:11:49.032536+0000","last_clean":"2023-10-06T23:11:49.032536+0000","last_became_active":"2023-10-06T23:11:18.259684+0000","last_became_peered":"2023-10-06T23:11:18.259684+0000","last_unstale":"2023-10-06T23:11:49.032536+0000","last_undegraded":"2023-10-06T23:11:49.032536+0000","last_fullsized":"2023-10-06T23:11:49.032536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:46:08.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035791+0000","last_change":"2023-10-06T23:11:17.264262+0000","last_active":"2023-10-06T23:11:49.035791+0000","last_peered":"2023-10-06T23:11:49.035791+0000","last_clean":"2023-10-06T23:11:49.035791+0000","last_became_active":"2023-10-06T23:11:17.263922+0000","last_became_peered":"2023-10-06T23:11:17.263922+0000","last_unstale":"2023-10-06T23:11:49.035791+0000","last_undegraded":"2023-10-06T23:11:49.035791+0000","last_fullsized":"2023-10-06T23:11:49.035791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:00:14.045943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029509+0000","last_change":"2023-10-06T23:11:18.260908+0000","last_active":"2023-10-06T23:11:49.029509+0000","last_peered":"2023-10-06T23:11:49.029509+0000","last_clean":"2023-10-06T23:11:49.029509+0000","last_became_active":"2023-10-06T23:11:18.260459+0000","last_became_peered":"2023-10-06T23:11:18.260459+0000","last_unstale":"2023-10-06T23:11:49.029509+0000","last_undegraded":"2023-10-06T23:11:49.029509+0000","last_fullsized":"2023-10-06T23:11:49.029509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:51.570508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036705+0000","last_change":"2023-10-06T23:11:17.262559+0000","last_active":"2023-10-06T23:11:49.036705+0000","last_peered":"2023-10-06T23:11:49.036705+0000","last_clean":"2023-10-06T23:11:49.036705+0000","last_became_active":"2023-10-06T23:11:17.262062+0000","last_became_peered":"2023-10-06T23:11:17.262062+0000","last_unstale":"2023-10-06T23:11:49.036705+0000","last_undegraded":"2023-10-06T23:11:49.036705+0000","last_fullsized":"2023-10-06T23:11:49.036705+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:03.751385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036526+0000","last_change":"2023-10-06T23:11:18.269813+0000","last_active":"2023-10-06T23:11:49.036526+0000","last_peered":"2023-10-06T23:11:49.036526+0000","last_clean":"2023-10-06T23:11:49.036526+0000","last_became_active":"2023-10-06T23:11:18.269506+0000","last_became_peered":"2023-10-06T23:11:18.269506+0000","last_unstale":"2023-10-06T23:11:49.036526+0000","last_undegraded":"2023-10-06T23:11:49.036526+0000","last_fullsized":"2023-10-06T23:11:49.036526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:43:21.635237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032699+0000","last_change":"2023-10-06T23:11:17.253040+0000","last_active":"2023-10-06T23:11:49.032699+0000","last_peered":"2023-10-06T23:11:49.032699+0000","last_clean":"2023-10-06T23:11:49.032699+0000","last_became_active":"2023-10-06T23:11:17.252596+0000","last_became_peered":"2023-10-06T23:11:17.252596+0000","last_unstale":"2023-10-06T23:11:49.032699+0000","last_undegraded":"2023-10-06T23:11:49.032699+0000","last_fullsized":"2023-10-06T23:11:49.032699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:39:30.721464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036362+0000","last_change":"2023-10-06T23:11:18.267465+0000","last_active":"2023-10-06T23:11:49.036362+0000","last_peered":"2023-10-06T23:11:49.036362+0000","last_clean":"2023-10-06T23:11:49.036362+0000","last_became_active":"2023-10-06T23:11:18.267164+0000","last_became_peered":"2023-10-06T23:11:18.267164+0000","last_unstale":"2023-10-06T23:11:49.036362+0000","last_undegraded":"2023-10-06T23:11:49.036362+0000","last_fullsized":"2023-10-06T23:11:49.036362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:16.747117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037242+0000","last_change":"2023-10-06T23:11:17.267653+0000","last_active":"2023-10-06T23:11:49.037242+0000","last_peered":"2023-10-06T23:11:49.037242+0000","last_clean":"2023-10-06T23:11:49.037242+0000","last_became_active":"2023-10-06T23:11:17.267264+0000","last_became_peered":"2023-10-06T23:11:17.267264+0000","last_unstale":"2023-10-06T23:11:49.037242+0000","last_undegraded":"2023-10-06T23:11:49.037242+0000","last_fullsized":"2023-10-06T23:11:49.037242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:45:57.242383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036468+0000","last_change":"2023-10-06T23:11:18.264869+0000","last_active":"2023-10-06T23:11:49.036468+0000","last_peered":"2023-10-06T23:11:49.036468+0000","last_clean":"2023-10-06T23:11:49.036468+0000","last_became_active":"2023-10-06T23:11:18.264549+0000","last_became_peered":"2023-10-06T23:11:18.264549+0000","last_unstale":"2023-10-06T23:11:49.036468+0000","last_undegraded":"2023-10-06T23:11:49.036468+0000","last_fullsized":"2023-10-06T23:11:49.036468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:00:35.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035779+0000","last_change":"2023-10-06T23:11:17.263806+0000","last_active":"2023-10-06T23:11:49.035779+0000","last_peered":"2023-10-06T23:11:49.035779+0000","last_clean":"2023-10-06T23:11:49.035779+0000","last_became_active":"2023-10-06T23:11:17.263499+0000","last_became_peered":"2023-10-06T23:11:17.263499+0000","last_unstale":"2023-10-06T23:11:49.035779+0000","last_undegraded":"2023-10-06T23:11:49.035779+0000","last_fullsized":"2023-10-06T23:11:49.035779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:26.191338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036159+0000","last_change":"2023-10-06T23:11:18.264691+0000","last_active":"2023-10-06T23:11:49.036159+0000","last_peered":"2023-10-06T23:11:49.036159+0000","last_clean":"2023-10-06T23:11:49.036159+0000","last_became_active":"2023-10-06T23:11:18.264286+0000","last_became_peered":"2023-10-06T23:11:18.264286+0000","last_unstale":"2023-10-06T23:11:49.036159+0000","last_undegraded":"2023-10-06T23:11:49.036159+0000","last_fullsized":"2023-10-06T23:11:49.036159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:35:23.728707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.401402+0000","last_change":"2023-10-06T23:11:50.401402+0000","last_active":"2023-10-06T23:11:50.401402+0000","last_peered":"2023-10-06T23:11:50.401402+0000","last_clean":"2023-10-06T23:11:50.401402+0000","last_became_active":"2023-10-06T23:11:50.397772+0000","last_became_peered":"2023-10-06T23:11:50.397772+0000","last_unstale":"2023-10-06T23:11:50.401402+0000","last_undegraded":"2023-10-06T23:11:50.401402+0000","last_fullsized":"2023-10-06T23:11:50.401402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:33.727845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036474+0000","last_change":"2023-10-06T23:11:18.265822+0000","last_active":"2023-10-06T23:11:49.036474+0000","last_peered":"2023-10-06T23:11:49.036474+0000","last_clean":"2023-10-06T23:11:49.036474+0000","last_became_active":"2023-10-06T23:11:18.265457+0000","last_became_peered":"2023-10-06T23:11:18.265457+0000","last_unstale":"2023-10-06T23:11:49.036474+0000","last_undegraded":"2023-10-06T23:11:49.036474+0000","last_fullsized":"2023-10-06T23:11:49.036474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:09.132431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029634+0000","last_change":"2023-10-06T23:11:18.267305+0000","last_active":"2023-10-06T23:11:49.029634+0000","last_peered":"2023-10-06T23:11:49.029634+0000","last_clean":"2023-10-06T23:11:49.029634+0000","last_became_active":"2023-10-06T23:11:18.266975+0000","last_became_peered":"2023-10-06T23:11:18.266975+0000","last_unstale":"2023-10-06T23:11:49.029634+0000","last_undegraded":"2023-10-06T23:11:49.029634+0000","last_fullsized":"2023-10-06T23:11:49.029634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036823+0000","last_change":"2023-10-06T23:11:18.262045+0000","last_active":"2023-10-06T23:11:49.036823+0000","last_peered":"2023-10-06T23:11:49.036823+0000","last_clean":"2023-10-06T23:11:49.036823+0000","last_became_active":"2023-10-06T23:11:18.261662+0000","last_became_peered":"2023-10-06T23:11:18.261662+0000","last_unstale":"2023-10-06T23:11:49.036823+0000","last_undegraded":"2023-10-06T23:11:49.036823+0000","last_fullsized":"2023-10-06T23:11:49.036823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:56:06.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036972+0000","last_change":"2023-10-06T23:11:18.259540+0000","last_active":"2023-10-06T23:11:49.036972+0000","last_peered":"2023-10-06T23:11:49.036972+0000","last_clean":"2023-10-06T23:11:49.036972+0000","last_became_active":"2023-10-06T23:11:18.259234+0000","last_became_peered":"2023-10-06T23:11:18.259234+0000","last_unstale":"2023-10-06T23:11:49.036972+0000","last_undegraded":"2023-10-06T23:11:49.036972+0000","last_fullsized":"2023-10-06T23:11:49.036972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:47:15.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026670+0000","last_change":"2023-10-06T23:11:18.266295+0000","last_active":"2023-10-06T23:11:49.026670+0000","last_peered":"2023-10-06T23:11:49.026670+0000","last_clean":"2023-10-06T23:11:49.026670+0000","last_became_active":"2023-10-06T23:11:18.265991+0000","last_became_peered":"2023-10-06T23:11:18.265991+0000","last_unstale":"2023-10-06T23:11:49.026670+0000","last_undegraded":"2023-10-06T23:11:49.026670+0000","last_fullsized":"2023-10-06T23:11:49.026670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:34:43.165643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031833+0000","last_change":"2023-10-06T23:11:18.266239+0000","last_active":"2023-10-06T23:11:49.031833+0000","last_peered":"2023-10-06T23:11:49.031833+0000","last_clean":"2023-10-06T23:11:49.031833+0000","last_became_active":"2023-10-06T23:11:18.265849+0000","last_became_peered":"2023-10-06T23:11:18.265849+0000","last_unstale":"2023-10-06T23:11:49.031833+0000","last_undegraded":"2023-10-06T23:11:49.031833+0000","last_fullsized":"2023-10-06T23:11:49.031833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:47.219459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030522+0000","last_change":"2023-10-06T23:11:18.260885+0000","last_active":"2023-10-06T23:11:49.030522+0000","last_peered":"2023-10-06T23:11:49.030522+0000","last_clean":"2023-10-06T23:11:49.030522+0000","last_became_active":"2023-10-06T23:11:18.260567+0000","last_became_peered":"2023-10-06T23:11:18.260567+0000","last_unstale":"2023-10-06T23:11:49.030522+0000","last_undegraded":"2023-10-06T23:11:49.030522+0000","last_fullsized":"2023-10-06T23:11:49.030522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:36.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037629+0000","last_change":"2023-10-06T23:11:18.257105+0000","last_active":"2023-10-06T23:11:49.037629+0000","last_peered":"2023-10-06T23:11:49.037629+0000","last_clean":"2023-10-06T23:11:49.037629+0000","last_became_active":"2023-10-06T23:11:18.256816+0000","last_became_peered":"2023-10-06T23:11:18.256816+0000","last_unstale":"2023-10-06T23:11:49.037629+0000","last_undegraded":"2023-10-06T23:11:49.037629+0000","last_fullsized":"2023-10-06T23:11:49.037629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:07.749678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036911+0000","last_change":"2023-10-06T23:11:18.260383+0000","last_active":"2023-10-06T23:11:49.036911+0000","last_peered":"2023-10-06T23:11:49.036911+0000","last_clean":"2023-10-06T23:11:49.036911+0000","last_became_active":"2023-10-06T23:11:18.260010+0000","last_became_peered":"2023-10-06T23:11:18.260010+0000","last_unstale":"2023-10-06T23:11:49.036911+0000","last_undegraded":"2023-10-06T23:11:49.036911+0000","last_fullsized":"2023-10-06T23:11:49.036911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:25.014895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034750+0000","last_change":"2023-10-06T23:11:18.261948+0000","last_active":"2023-10-06T23:11:49.034750+0000","last_peered":"2023-10-06T23:11:49.034750+0000","last_clean":"2023-10-06T23:11:49.034750+0000","last_became_active":"2023-10-06T23:11:18.261605+0000","last_became_peered":"2023-10-06T23:11:18.261605+0000","last_unstale":"2023-10-06T23:11:49.034750+0000","last_undegraded":"2023-10-06T23:11:49.034750+0000","last_fullsized":"2023-10-06T23:11:49.034750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:10:59.720181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035691+0000","last_change":"2023-10-06T23:11:18.261123+0000","last_active":"2023-10-06T23:11:49.035691+0000","last_peered":"2023-10-06T23:11:49.035691+0000","last_clean":"2023-10-06T23:11:49.035691+0000","last_became_active":"2023-10-06T23:11:18.260754+0000","last_became_peered":"2023-10-06T23:11:18.260754+0000","last_unstale":"2023-10-06T23:11:49.035691+0000","last_undegraded":"2023-10-06T23:11:49.035691+0000","last_fullsized":"2023-10-06T23:11:49.035691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:04:25.335790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042589+0000","last_change":"2023-10-06T23:11:18.261021+0000","last_active":"2023-10-06T23:11:49.042589+0000","last_peered":"2023-10-06T23:11:49.042589+0000","last_clean":"2023-10-06T23:11:49.042589+0000","last_became_active":"2023-10-06T23:11:18.260613+0000","last_became_peered":"2023-10-06T23:11:18.260613+0000","last_unstale":"2023-10-06T23:11:49.042589+0000","last_undegraded":"2023-10-06T23:11:49.042589+0000","last_fullsized":"2023-10-06T23:11:49.042589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:31:28.443342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031481+0000","last_change":"2023-10-06T23:11:18.266771+0000","last_active":"2023-10-06T23:11:49.031481+0000","last_peered":"2023-10-06T23:11:49.031481+0000","last_clean":"2023-10-06T23:11:49.031481+0000","last_became_active":"2023-10-06T23:11:18.266434+0000","last_became_peered":"2023-10-06T23:11:18.266434+0000","last_unstale":"2023-10-06T23:11:49.031481+0000","last_undegraded":"2023-10-06T23:11:49.031481+0000","last_fullsized":"2023-10-06T23:11:49.031481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:59:53.056671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029587+0000","last_change":"2023-10-06T23:11:18.265674+0000","last_active":"2023-10-06T23:11:49.029587+0000","last_peered":"2023-10-06T23:11:49.029587+0000","last_clean":"2023-10-06T23:11:49.029587+0000","last_became_active":"2023-10-06T23:11:18.265323+0000","last_became_peered":"2023-10-06T23:11:18.265323+0000","last_unstale":"2023-10-06T23:11:49.029587+0000","last_undegraded":"2023-10-06T23:11:49.029587+0000","last_fullsized":"2023-10-06T23:11:49.029587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:15.281707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281556,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":299,"num_read_kb":161,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":44,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":15666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":459304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.7559999999999998,"5min":3.7559999999999998,"15min":3.7559999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.585,"5min":5.585,"15min":5.585},"last":0.67100000000000004}]},{"osd":1,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":5.3390000000000004,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":3.7090000000000001,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.8090000000000002,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":5.4009999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":5.9640000000000004,"5min":5.9640000000000004,"15min":5.9640000000000004},"last":0.86299999999999999}]},{"osd":7,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.21,"5min":4.21,"15min":4.21},"last":0.83999999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":9,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":5.5190000000000001,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":0.999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.2690000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.0900000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":0.95799999999999996}]}]},{"osd":10,"up_from":73,"seq":313532612638,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1052236,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.79900000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.70199999999999996,"15min":0.68700000000000006},"min":{"1min":0.52400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96199999999999997,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.86799999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61099999999999999}]},{"osd":3,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.85899999999999999,"15min":0.82199999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":8.2669999999999995,"5min":8.2669999999999995,"15min":8.2669999999999995},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78300000000000003,"5min":1.004,"15min":1.004},"last":0.63},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89400000000000002,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.05,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.91300000000000003},"min":{"1min":0.61099999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0960000000000001,"5min":1.228,"15min":1.228},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0129999999999999,"15min":0.98399999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":7.9539999999999997,"5min":7.9539999999999997,"15min":7.9539999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90400000000000003,"15min":0.91300000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4690000000000001,"5min":1.625,"15min":1.625},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":0.97999999999999998},"min":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0109999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0009999999999999,"15min":1.0169999999999999},"min":{"1min":0.70399999999999996,"5min":0.628,"15min":0.628},"max":{"1min":1.1299999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.88600000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.0009999999999999,"15min":1.016},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.371,"5min":1.391,"15min":1.391},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.1240000000000001,"15min":1.0980000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":8.1799999999999997,"5min":8.1799999999999997,"15min":8.1799999999999997},"last":0.91000000000000003}]},{"osd":11,"last update":"Fri Oct 6 23:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.86899999999999999}]}]},{"osd":9,"up_from":68,"seq":292057776163,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":459496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70899999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73899999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":1.4199999999999999}]},{"osd":1,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.82299999999999995,"15min":0.84099999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.92400000000000004,"5min":1.167,"15min":1.167},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0069999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1759999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.998,"5min":1.222,"15min":1.222},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96299999999999997,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.24}]},{"osd":3,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.212},{"interface":"front","average":{"1min":0.627,"5min":0.72299999999999998,"15min":0.73899999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.153,"15min":1.153},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.90000000000000002,"15min":0.92000000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0800000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.323},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.056,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.93000000000000005,"15min":0.95599999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.117,"5min":2.109,"15min":2.109},"last":1.264},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.92400000000000004,"15min":0.94699999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1639999999999999,"5min":1.359,"15min":1.359},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.86199999999999999,"15min":0.88600000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.177,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.94499999999999995,"15min":0.96399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1419999999999999,"5min":1.738,"15min":1.738},"last":1.133}]},{"osd":7,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":1.0069999999999999,"15min":1.0349999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1759999999999999,"5min":2.149,"15min":2.149},"last":1.383},{"interface":"front","average":{"1min":0.88,"5min":1.0189999999999999,"15min":1.042},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.2450000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.038}]},{"osd":8,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.0229999999999999,"15min":1.042},"min":{"1min":0.70799999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2030000000000001,"5min":1.778,"15min":1.778},"last":1.284},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.01,"15min":1.03},"min":{"1min":0.75,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.244,"5min":1.698,"15min":1.698},"last":1.335}]},{"osd":10,"last update":"Fri Oct 6 23:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.0389999999999999},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1240000000000001,"5min":1.417,"15min":1.417},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1,"15min":1.016},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.1799999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.3640000000000001}]}]},{"osd":8,"up_from":60,"seq":257698037801,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":459041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.71599999999999997,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.435,"15min":0.435},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.024,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.99199999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":1.272,"15min":1.272},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.96499999999999997,"5min":1.196,"15min":1.196},"last":0.749}]},{"osd":3,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.79000000000000004},"min":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.3799999999999999,"5min":3.3799999999999999,"15min":3.3799999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75,"15min":0.751},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.125,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.01}]},{"osd":5,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.748},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.073,"5min":1.248,"15min":1.248},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98299999999999998,"5min":1.05,"15min":1.05},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.67700000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1719999999999999,"5min":1.399,"15min":1.399},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88800000000000001,"15min":0.92000000000000004},"min":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.115,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91500000000000004}]},{"osd":9,"last update":"Fri Oct 6 23:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1439999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.042,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.76900000000000002}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.70099999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.145,"5min":1.304,"15min":1.304},"last":1.03},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.88600000000000001,"15min":0.875},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.155,"5min":1.242,"15min":1.242},"last":0.93300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":1050507,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79600000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.016,"5min":1.04,"15min":1.04},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.54200000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.92700000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.77700000000000002,"15min":0.72699999999999998},"min":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.7789999999999999,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71499999999999997,"15min":0.70999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.113,"5min":1.149,"15min":1.149},"last":0.76100000000000001}]},{"osd":4,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88100000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.91200000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.55000000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.087,"5min":1.244,"15min":1.244},"last":0.877},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0600000000000001}]},{"osd":6,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82899999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.006,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1120000000000001,"5min":1.26,"15min":1.26},"last":0.86299999999999999}]},{"osd":8,"last update":"Fri Oct 6 23:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.61899999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.871,"15min":0.85399999999999998},"min":{"1min":0.70499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.008}]},{"osd":9,"last update":"Fri Oct 6 23:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.61099999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.68400000000000005}]},{"osd":10,"last update":"Fri Oct 6 23:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.93600000000000005,"15min":0.93200000000000005},"min":{"1min":0.68799999999999994,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.179,"5min":1.2,"15min":1.2},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88600000000000001,"15min":0.88400000000000001},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462963,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":458768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46300000000000002,"15min":0.443},"min":{"1min":0.39900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71099999999999997,"15min":0.68799999999999994},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.109,"15min":1.109},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69699999999999995,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98599999999999999,"5min":1.01,"15min":1.01},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94799999999999995,"5min":1.054,"15min":1.054},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42999999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82599999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.628,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1299999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94699999999999995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.79500000000000004},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1299999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Oct 6 23:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.83799999999999997,"15min":0.81399999999999995},"min":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":3.915,"5min":3.915,"15min":3.915},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.875,"15min":0.85999999999999999},"min":{"1min":0.746,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.81599999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.89000000000000001,"15min":0.85399999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.93300000000000005}]},{"osd":9,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89900000000000002,"15min":0.90500000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.879},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88800000000000001,"15min":0.89300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1950000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.73899999999999999}]},{"osd":10,"last update":"Fri Oct 6 23:11:59 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.018,"15min":1.014},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":460290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61499999999999999,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Oct 6 23:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Oct 6 23:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69299999999999995,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68899999999999995,"15min":0.68000000000000005},"min":{"1min":0.495,"5min":0.436,"15min":0.436},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 23:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.436,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.58999999999999997,"15min":0.57199999999999995},"min":{"1min":0.40799999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.73299999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.50600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.76300000000000001,"15min":0.71499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.98299999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.875}]},{"osd":7,"last update":"Fri Oct 6 23:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.73399999999999999,"15min":0.70599999999999996},"min":{"1min":0.47999999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.82999999999999996}]},{"osd":8,"last update":"Fri Oct 6 23:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.68799999999999994,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.95499999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.84599999999999997,"15min":0.83199999999999996},"min":{"1min":0.64500000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.80600000000000005}]},{"osd":10,"last update":"Fri Oct 6 23:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91000000000000003,"15min":0.90000000000000002},"min":{"1min":0.623,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3600000000000001,"5min":1.706,"15min":1.706},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92900000000000005,"15min":0.92100000000000004},"min":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0269999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":460156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.61299999999999999},"min":{"1min":0.42599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.091,"15min":1.091},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.63600000000000001},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 23:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.66900000000000004,"15min":0.63400000000000001},"min":{"1min":0.50700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.58299999999999996,"5min":0.377,"15min":0.377},"max":{"1min":0.995,"5min":1.014,"15min":1.014},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Oct 6 23:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Oct 6 23:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99099999999999999,"5min":0.995,"15min":0.995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66600000000000004,"15min":0.63500000000000001},"min":{"1min":0.45400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.998,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71599999999999997,"15min":0.70099999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.73299999999999998,"15min":0.70099999999999996},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0129999999999999,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Oct 6 23:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.073,"5min":1.085,"15min":1.085},"last":0.434},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.75700000000000001,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1259999999999999,"5min":1.226,"15min":1.226},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.59699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.81399999999999995,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70299999999999996}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.25,"5min":1.296,"15min":1.296},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.68400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.71399999999999997}]},{"osd":9,"last update":"Fri Oct 6 23:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.55100000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.88100000000000001,"15min":0.89500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.149,"5min":1.325,"15min":1.325},"last":0.496}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85999999999999999,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92500000000000004,"15min":0.92300000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.202,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.55100000000000005}]},{"osd":11,"last update":"Fri Oct 6 23:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.80800000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":461640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.91600000000000004,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.621,"15min":0.59499999999999997},"min":{"1min":0.38700000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.77900000000000003}]},{"osd":1,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.625},"min":{"1min":0.48099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.876,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":1.746,"15min":1.746},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.95799999999999996,"5min":1.454,"15min":1.454},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.70099999999999996},"min":{"1min":0.50900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.995,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Oct 6 23:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.96199999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91500000000000004,"5min":1.53,"15min":1.53},"last":0.83499999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96199999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.504},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58799999999999997,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.72799999999999998,"15min":0.69399999999999995},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.03,"5min":1.169,"15min":1.169},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.59899999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.018,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.877}]},{"osd":7,"last update":"Fri Oct 6 23:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.54400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75}]},{"osd":8,"last update":"Fri Oct 6 23:11:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.095,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0800000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.95799999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.879,"15min":0.88200000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.135,"5min":1.155,"15min":1.155},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0600000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.75800000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.93400000000000005},"min":{"1min":0.72699999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.155,"5min":1.333,"15min":1.333},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93600000000000005,"15min":0.94399999999999995},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.169,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.92700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":458631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.40200000000000002},"min":{"1min":0.40699999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92700000000000005,"5min":1.03,"15min":1.03},"last":0.443},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.41699999999999998},"min":{"1min":0.38900000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.67800000000000005,"15min":0.63600000000000001},"min":{"1min":0.55400000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.79300000000000004,"15min":0.69899999999999995},"min":{"1min":0.57399999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":9.3989999999999991,"5min":9.3989999999999991,"15min":9.3989999999999991},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.71499999999999997,"15min":0.65900000000000003},"min":{"1min":0.47199999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.3769999999999998,"5min":4.3769999999999998,"15min":4.3769999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70699999999999996,"15min":0.67000000000000004},"min":{"1min":0.59699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.048,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.91300000000000003}]},{"osd":4,"last update":"Fri Oct 6 23:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.65200000000000002},"min":{"1min":0.57699999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79500000000000004,"5min":1.202,"15min":1.202},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 23:11:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":0.85299999999999998,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":9.3379999999999992,"5min":9.3379999999999992,"15min":9.3379999999999992},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.004,"5min":0.80900000000000005,"15min":0.73499999999999999},"min":{"1min":0.52600000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.4279999999999999,"5min":4.4279999999999999,"15min":4.4279999999999999},"last":0.90200000000000002}]},{"osd":6,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67900000000000005,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 23:11:42 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":0.91300000000000003,"15min":0.85199999999999998},"min":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":9.4779999999999998,"5min":9.4779999999999998,"15min":9.4779999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.84499999999999997,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.5019999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":0.63700000000000001}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.66900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.008,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0009999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.878,"15min":0.88},"min":{"1min":0.66000000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.101,"5min":1.169,"15min":1.169},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.871,"5min":0.84299999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75600000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.026,"15min":0.97799999999999998},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":9.516,"5min":9.516,"15min":9.516},"last":0.872},{"interface":"front","average":{"1min":1.083,"5min":0.998,"15min":0.98399999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.71499999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888126,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":459322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.502,"15min":0.46600000000000003},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.501,"15min":0.45900000000000002},"min":{"1min":0.41099999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Oct 6 23:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.58699999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70499999999999996,"15min":0.69699999999999995},"min":{"1min":0.60399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68799999999999994,"15min":0.65400000000000003},"min":{"1min":0.54300000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94599999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.71399999999999997,"15min":0.64200000000000002},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0920000000000001,"5min":1.141,"15min":1.141},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.74099999999999999,"15min":0.70499999999999996},"min":{"1min":0.56499999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.746}]},{"osd":6,"last update":"Fri Oct 6 23:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77700000000000002,"15min":0.753},"min":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0449999999999999,"5min":1.161,"15min":1.161},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Oct 6 23:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.432,"15min":0.432},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.79700000000000004,"15min":0.77300000000000002},"min":{"1min":0.54200000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0740000000000001,"5min":1.083,"15min":1.083},"last":0.86099999999999999}]},{"osd":8,"last update":"Fri Oct 6 23:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.68999999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.86299999999999999,"15min":0.84499999999999997},"min":{"1min":0.66800000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1719999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.88600000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96699999999999997,"15min":0.96899999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1890000000000001,"5min":1.22,"15min":1.22},"last":1.0049999999999999}]},{"osd":10,"last update":"Fri Oct 6 23:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.96699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":5,"up_from":39,"seq":167503724599,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1050191,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.46300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84399999999999997,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.64000000000000001},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.88500000000000001,"5min":1.153,"15min":1.153},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.503,"15min":0.48899999999999999},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77400000000000002,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.78200000000000003,"5min":0.879,"15min":0.879},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68600000000000005},"min":{"1min":0.58299999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.68799999999999994},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1659999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88500000000000001}]},{"osd":6,"last update":"Fri Oct 6 23:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.59599999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.73399999999999999,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.872}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97399999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.748},"min":{"1min":0.46200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.72299999999999998}]},{"osd":9,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.83999999999999997,"15min":0.83599999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81200000000000006,"15min":0.81100000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.70899999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.88200000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.85099999999999998,"15min":0.83899999999999997},"min":{"1min":0.61599999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T23:12:11.936 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-06T23:12:12.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:12 smithi156 ceph-mon[102862]: pgmap v329: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:12 smithi008 ceph-mon[98532]: pgmap v329: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:12.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:12 smithi190 ceph-mon[102658]: pgmap v329: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:12.674 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:13.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:13 smithi008 ceph-mon[98532]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:12:13.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:13 smithi156 ceph-mon[102862]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:12:13.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:13 smithi190 ceph-mon[102658]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:12:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.287+0000 7f55abb4c700 1 -- 172.21.15.8:0/3877166802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 msgr2=0x7f55a410ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.287+0000 7f55abb4c700 1 --2- 172.21.15.8:0/3877166802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 0x7f55a410ddb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f559c00b0d0 tx=0x7f559c00b3e0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.287+0000 7f55abb4c700 1 -- 172.21.15.8:0/3877166802 shutdown_connections 2023-10-06T23:12:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.287+0000 7f55abb4c700 1 --2- 172.21.15.8:0/3877166802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 0x7f55a410ddb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.287+0000 7f55abb4c700 1 --2- 172.21.15.8:0/3877166802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4106f90 0x7f55a4107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.287+0000 7f55abb4c700 1 --2- 172.21.15.8:0/3877166802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a4100f80 0x7f55a4101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.287+0000 7f55abb4c700 1 -- 172.21.15.8:0/3877166802 >> 172.21.15.8:0/3877166802 conn(0x7f55a40780a0 msgr2=0x7f55a40784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:14.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.288+0000 7f55abb4c700 1 -- 172.21.15.8:0/3877166802 shutdown_connections 2023-10-06T23:12:14.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.288+0000 7f55abb4c700 1 -- 172.21.15.8:0/3877166802 wait complete. 2023-10-06T23:12:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55abb4c700 1 Processor -- start 2023-10-06T23:12:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55abb4c700 1 -- start start 2023-10-06T23:12:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55abb4c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4100f80 0x7f55a40731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55abb4c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 0x7f55a40736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55abb4c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a4106f90 0x7f55a4073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55abb4c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41a5500 con 0x7f55a4101940 2023-10-06T23:12:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55abb4c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41a5670 con 0x7f55a4106f90 2023-10-06T23:12:14.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55abb4c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41a5830 con 0x7f55a4100f80 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55a90e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 0x7f55a40736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55a90e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 0x7f55a40736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32902/0 (socket says 172.21.15.8:32902) 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.289+0000 7f55a90e7700 1 -- 172.21.15.8:0/1254675956 learned_addr learned my addr 172.21.15.8:0/1254675956 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55a98e8700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4100f80 0x7f55a40731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55aa0e9700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a4106f90 0x7f55a4073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55a90e7700 1 -- 172.21.15.8:0/1254675956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4100f80 msgr2=0x7f55a40731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55a90e7700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4100f80 0x7f55a40731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55a90e7700 1 -- 172.21.15.8:0/1254675956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a4106f90 msgr2=0x7f55a4073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55a90e7700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a4106f90 0x7f55a4073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55a90e7700 1 -- 172.21.15.8:0/1254675956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c009d00 con 0x7f55a4101940 2023-10-06T23:12:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55a90e7700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 0x7f55a40736f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f559400d980 tx=0x7f559400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f559affd700 1 -- 172.21.15.8:0/1254675956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400bb60 con 0x7f55a4101940 2023-10-06T23:12:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f559affd700 1 -- 172.21.15.8:0/1254675956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5594007640 con 0x7f55a4101940 2023-10-06T23:12:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f559affd700 1 -- 172.21.15.8:0/1254675956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594004d60 con 0x7f55a4101940 2023-10-06T23:12:14.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.290+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a41a5b10 con 0x7f55a4101940 2023-10-06T23:12:14.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.291+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a41a5fc0 con 0x7f55a4101940 2023-10-06T23:12:14.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.291+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a404ebb0 con 0x7f55a4101940 2023-10-06T23:12:14.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.293+0000 7f559affd700 1 -- 172.21.15.8:0/1254675956 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5594004020 con 0x7f55a4101940 2023-10-06T23:12:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.295+0000 7f559affd700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55900a1500 0x7f55900a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:14.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.295+0000 7f559affd700 1 -- 172.21.15.8:0/1254675956 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f55940ccb60 con 0x7f55a4101940 2023-10-06T23:12:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.295+0000 7f55a98e8700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55900a1500 0x7f55900a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.296+0000 7f55a98e8700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55900a1500 0x7f55900a39c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f55a0005950 tx=0x7f55a00058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.299+0000 7f559affd700 1 -- 172.21.15.8:0/1254675956 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5594096170 con 0x7f55a4101940 2023-10-06T23:12:14.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:14 smithi156 ceph-mon[102862]: pgmap v330: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-10-06T23:12:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:14 smithi008 ceph-mon[98532]: pgmap v330: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-10-06T23:12:14.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:14 smithi190 ceph-mon[102658]: pgmap v330: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-10-06T23:12:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.504+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55a4111050 con 0x7f55900a1500 2023-10-06T23:12:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.515+0000 7f559affd700 1 -- 172.21.15.8:0/1254675956 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339240 (secure 0 0 0) 0x7f55a000b360 con 0x7f55900a1500 2023-10-06T23:12:14.524 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55900a1500 msgr2=0x7f55900a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55900a1500 0x7f55900a39c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f55a0005950 tx=0x7f55a00058e0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 msgr2=0x7f55a40736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:14.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 0x7f55a40736f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f559400d980 tx=0x7f559400dd40 comp rx=0 tx=0).stop 2023-10-06T23:12:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 shutdown_connections 2023-10-06T23:12:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55900a1500 0x7f55900a39c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a4106f90 0x7f55a4073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55a4100f80 0x7f55a40731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 --2- 172.21.15.8:0/1254675956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55a4101940 0x7f55a40736f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 >> 172.21.15.8:0/1254675956 conn(0x7f55a40780a0 msgr2=0x7f55a4104cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 shutdown_connections 2023-10-06T23:12:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:14.521+0000 7f55abb4c700 1 -- 172.21.15.8:0/1254675956 wait complete. 2023-10-06T23:12:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T23:12:15.056 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2023-10-06T23:12:12.956039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":435,"num_read_kb":270,"num_write":306,"num_write_kb":2976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180780,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":246,"ondisk_log_size":246,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335716,"kb_used_data":11456,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606108,"statfs":{"total":1151940427776,"available":1151596654592,"internally_reserved":0,"allocated":11730944,"data_stored":7289582,"data_compressed":107433,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":29,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003019"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030740+0000","last_change":"2023-10-06T23:11:18.264036+0000","last_active":"2023-10-06T23:11:49.030740+0000","last_peered":"2023-10-06T23:11:49.030740+0000","last_clean":"2023-10-06T23:11:49.030740+0000","last_became_active":"2023-10-06T23:11:18.261784+0000","last_became_peered":"2023-10-06T23:11:18.261784+0000","last_unstale":"2023-10-06T23:11:49.030740+0000","last_undegraded":"2023-10-06T23:11:49.030740+0000","last_fullsized":"2023-10-06T23:11:49.030740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:57.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026996+0000","last_change":"2023-10-06T23:11:18.265181+0000","last_active":"2023-10-06T23:11:49.026996+0000","last_peered":"2023-10-06T23:11:49.026996+0000","last_clean":"2023-10-06T23:11:49.026996+0000","last_became_active":"2023-10-06T23:11:18.264881+0000","last_became_peered":"2023-10-06T23:11:18.264881+0000","last_unstale":"2023-10-06T23:11:49.026996+0000","last_undegraded":"2023-10-06T23:11:49.026996+0000","last_fullsized":"2023-10-06T23:11:49.026996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:17.852643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026807+0000","last_change":"2023-10-06T23:11:18.264321+0000","last_active":"2023-10-06T23:11:49.026807+0000","last_peered":"2023-10-06T23:11:49.026807+0000","last_clean":"2023-10-06T23:11:49.026807+0000","last_became_active":"2023-10-06T23:11:18.263997+0000","last_became_peered":"2023-10-06T23:11:18.263997+0000","last_unstale":"2023-10-06T23:11:49.026807+0000","last_undegraded":"2023-10-06T23:11:49.026807+0000","last_fullsized":"2023-10-06T23:11:49.026807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:41.888419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030300+0000","last_change":"2023-10-06T23:11:18.270871+0000","last_active":"2023-10-06T23:11:49.030300+0000","last_peered":"2023-10-06T23:11:49.030300+0000","last_clean":"2023-10-06T23:11:49.030300+0000","last_became_active":"2023-10-06T23:11:18.270288+0000","last_became_peered":"2023-10-06T23:11:18.270288+0000","last_unstale":"2023-10-06T23:11:49.030300+0000","last_undegraded":"2023-10-06T23:11:49.030300+0000","last_fullsized":"2023-10-06T23:11:49.030300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:02:48.819640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032624+0000","last_change":"2023-10-06T23:11:18.261001+0000","last_active":"2023-10-06T23:11:49.032624+0000","last_peered":"2023-10-06T23:11:49.032624+0000","last_clean":"2023-10-06T23:11:49.032624+0000","last_became_active":"2023-10-06T23:11:18.260661+0000","last_became_peered":"2023-10-06T23:11:18.260661+0000","last_unstale":"2023-10-06T23:11:49.032624+0000","last_undegraded":"2023-10-06T23:11:49.032624+0000","last_fullsized":"2023-10-06T23:11:49.032624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:42.382235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.036376+0000","last_change":"2023-10-06T23:11:50.036376+0000","last_active":"2023-10-06T23:11:50.036376+0000","last_peered":"2023-10-06T23:11:50.036376+0000","last_clean":"2023-10-06T23:11:50.036376+0000","last_became_active":"2023-10-06T23:11:50.035945+0000","last_became_peered":"2023-10-06T23:11:50.035945+0000","last_unstale":"2023-10-06T23:11:50.036376+0000","last_undegraded":"2023-10-06T23:11:50.036376+0000","last_fullsized":"2023-10-06T23:11:50.036376+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:50:33.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036114+0000","last_change":"2023-10-06T23:11:18.263968+0000","last_active":"2023-10-06T23:11:49.036114+0000","last_peered":"2023-10-06T23:11:49.036114+0000","last_clean":"2023-10-06T23:11:49.036114+0000","last_became_active":"2023-10-06T23:11:18.263634+0000","last_became_peered":"2023-10-06T23:11:18.263634+0000","last_unstale":"2023-10-06T23:11:49.036114+0000","last_undegraded":"2023-10-06T23:11:49.036114+0000","last_fullsized":"2023-10-06T23:11:49.036114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:18:23.856232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035537+0000","last_change":"2023-10-06T23:11:18.268945+0000","last_active":"2023-10-06T23:11:49.035537+0000","last_peered":"2023-10-06T23:11:49.035537+0000","last_clean":"2023-10-06T23:11:49.035537+0000","last_became_active":"2023-10-06T23:11:18.268598+0000","last_became_peered":"2023-10-06T23:11:18.268598+0000","last_unstale":"2023-10-06T23:11:49.035537+0000","last_undegraded":"2023-10-06T23:11:49.035537+0000","last_fullsized":"2023-10-06T23:11:49.035537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:09:21.238230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042773+0000","last_change":"2023-10-06T23:11:18.261872+0000","last_active":"2023-10-06T23:11:49.042773+0000","last_peered":"2023-10-06T23:11:49.042773+0000","last_clean":"2023-10-06T23:11:49.042773+0000","last_became_active":"2023-10-06T23:11:18.261583+0000","last_became_peered":"2023-10-06T23:11:18.261583+0000","last_unstale":"2023-10-06T23:11:49.042773+0000","last_undegraded":"2023-10-06T23:11:49.042773+0000","last_fullsized":"2023-10-06T23:11:49.042773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:50:54.145738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039796+0000","last_change":"2023-10-06T23:11:50.039796+0000","last_active":"2023-10-06T23:11:50.039796+0000","last_peered":"2023-10-06T23:11:50.039796+0000","last_clean":"2023-10-06T23:11:50.039796+0000","last_became_active":"2023-10-06T23:11:50.039420+0000","last_became_peered":"2023-10-06T23:11:50.039420+0000","last_unstale":"2023-10-06T23:11:50.039796+0000","last_undegraded":"2023-10-06T23:11:50.039796+0000","last_fullsized":"2023-10-06T23:11:50.039796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:28.641948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036360+0000","last_change":"2023-10-06T23:11:18.266565+0000","last_active":"2023-10-06T23:11:49.036360+0000","last_peered":"2023-10-06T23:11:49.036360+0000","last_clean":"2023-10-06T23:11:49.036360+0000","last_became_active":"2023-10-06T23:11:18.266290+0000","last_became_peered":"2023-10-06T23:11:18.266290+0000","last_unstale":"2023-10-06T23:11:49.036360+0000","last_undegraded":"2023-10-06T23:11:49.036360+0000","last_fullsized":"2023-10-06T23:11:49.036360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:45:07.828100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030127+0000","last_change":"2023-10-06T23:11:18.266849+0000","last_active":"2023-10-06T23:11:49.030127+0000","last_peered":"2023-10-06T23:11:49.030127+0000","last_clean":"2023-10-06T23:11:49.030127+0000","last_became_active":"2023-10-06T23:11:18.266517+0000","last_became_peered":"2023-10-06T23:11:18.266517+0000","last_unstale":"2023-10-06T23:11:49.030127+0000","last_undegraded":"2023-10-06T23:11:49.030127+0000","last_fullsized":"2023-10-06T23:11:49.030127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:25:31.988065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031565+0000","last_change":"2023-10-06T23:11:18.270336+0000","last_active":"2023-10-06T23:11:49.031565+0000","last_peered":"2023-10-06T23:11:49.031565+0000","last_clean":"2023-10-06T23:11:49.031565+0000","last_became_active":"2023-10-06T23:11:18.269969+0000","last_became_peered":"2023-10-06T23:11:18.269969+0000","last_unstale":"2023-10-06T23:11:49.031565+0000","last_undegraded":"2023-10-06T23:11:49.031565+0000","last_fullsized":"2023-10-06T23:11:49.031565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:25.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026121+0000","last_change":"2023-10-06T23:11:18.264549+0000","last_active":"2023-10-06T23:11:49.026121+0000","last_peered":"2023-10-06T23:11:49.026121+0000","last_clean":"2023-10-06T23:11:49.026121+0000","last_became_active":"2023-10-06T23:11:18.263446+0000","last_became_peered":"2023-10-06T23:11:18.263446+0000","last_unstale":"2023-10-06T23:11:49.026121+0000","last_undegraded":"2023-10-06T23:11:49.026121+0000","last_fullsized":"2023-10-06T23:11:49.026121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:21:57.009374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026364+0000","last_change":"2023-10-06T23:11:18.262470+0000","last_active":"2023-10-06T23:11:49.026364+0000","last_peered":"2023-10-06T23:11:49.026364+0000","last_clean":"2023-10-06T23:11:49.026364+0000","last_became_active":"2023-10-06T23:11:18.262134+0000","last_became_peered":"2023-10-06T23:11:18.262134+0000","last_unstale":"2023-10-06T23:11:49.026364+0000","last_undegraded":"2023-10-06T23:11:49.026364+0000","last_fullsized":"2023-10-06T23:11:49.026364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:09:26.745107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042326+0000","last_change":"2023-10-06T23:11:18.260657+0000","last_active":"2023-10-06T23:11:49.042326+0000","last_peered":"2023-10-06T23:11:49.042326+0000","last_clean":"2023-10-06T23:11:49.042326+0000","last_became_active":"2023-10-06T23:11:18.260343+0000","last_became_peered":"2023-10-06T23:11:18.260343+0000","last_unstale":"2023-10-06T23:11:49.042326+0000","last_undegraded":"2023-10-06T23:11:49.042326+0000","last_fullsized":"2023-10-06T23:11:49.042326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:46:24.199333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030882+0000","last_change":"2023-10-06T23:11:18.262071+0000","last_active":"2023-10-06T23:11:49.030882+0000","last_peered":"2023-10-06T23:11:49.030882+0000","last_clean":"2023-10-06T23:11:49.030882+0000","last_became_active":"2023-10-06T23:11:18.261348+0000","last_became_peered":"2023-10-06T23:11:18.261348+0000","last_unstale":"2023-10-06T23:11:49.030882+0000","last_undegraded":"2023-10-06T23:11:49.030882+0000","last_fullsized":"2023-10-06T23:11:49.030882+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:57:54.957156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033065+0000","last_change":"2023-10-06T23:11:18.266593+0000","last_active":"2023-10-06T23:11:49.033065+0000","last_peered":"2023-10-06T23:11:49.033065+0000","last_clean":"2023-10-06T23:11:49.033065+0000","last_became_active":"2023-10-06T23:11:18.266293+0000","last_became_peered":"2023-10-06T23:11:18.266293+0000","last_unstale":"2023-10-06T23:11:49.033065+0000","last_undegraded":"2023-10-06T23:11:49.033065+0000","last_fullsized":"2023-10-06T23:11:49.033065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:03:45.130437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037218+0000","last_change":"2023-10-06T23:11:18.264871+0000","last_active":"2023-10-06T23:11:49.037218+0000","last_peered":"2023-10-06T23:11:49.037218+0000","last_clean":"2023-10-06T23:11:49.037218+0000","last_became_active":"2023-10-06T23:11:18.264451+0000","last_became_peered":"2023-10-06T23:11:18.264451+0000","last_unstale":"2023-10-06T23:11:49.037218+0000","last_undegraded":"2023-10-06T23:11:49.037218+0000","last_fullsized":"2023-10-06T23:11:49.037218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:40:00.581508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033336+0000","last_change":"2023-10-06T23:11:17.255867+0000","last_active":"2023-10-06T23:11:49.033336+0000","last_peered":"2023-10-06T23:11:49.033336+0000","last_clean":"2023-10-06T23:11:49.033336+0000","last_became_active":"2023-10-06T23:11:17.255463+0000","last_became_peered":"2023-10-06T23:11:17.255463+0000","last_unstale":"2023-10-06T23:11:49.033336+0000","last_undegraded":"2023-10-06T23:11:49.033336+0000","last_fullsized":"2023-10-06T23:11:49.033336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:21:29.493049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037811+0000","last_change":"2023-10-06T23:11:18.262575+0000","last_active":"2023-10-06T23:11:49.037811+0000","last_peered":"2023-10-06T23:11:49.037811+0000","last_clean":"2023-10-06T23:11:49.037811+0000","last_became_active":"2023-10-06T23:11:18.262266+0000","last_became_peered":"2023-10-06T23:11:18.262266+0000","last_unstale":"2023-10-06T23:11:49.037811+0000","last_undegraded":"2023-10-06T23:11:49.037811+0000","last_fullsized":"2023-10-06T23:11:49.037811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:37:10.870786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037989+0000","last_change":"2023-10-06T23:11:17.259061+0000","last_active":"2023-10-06T23:11:49.037989+0000","last_peered":"2023-10-06T23:11:49.037989+0000","last_clean":"2023-10-06T23:11:49.037989+0000","last_became_active":"2023-10-06T23:11:17.258624+0000","last_became_peered":"2023-10-06T23:11:17.258624+0000","last_unstale":"2023-10-06T23:11:49.037989+0000","last_undegraded":"2023-10-06T23:11:49.037989+0000","last_fullsized":"2023-10-06T23:11:49.037989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:28.121405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027230+0000","last_change":"2023-10-06T23:11:18.263840+0000","last_active":"2023-10-06T23:11:49.027230+0000","last_peered":"2023-10-06T23:11:49.027230+0000","last_clean":"2023-10-06T23:11:49.027230+0000","last_became_active":"2023-10-06T23:11:18.263454+0000","last_became_peered":"2023-10-06T23:11:18.263454+0000","last_unstale":"2023-10-06T23:11:49.027230+0000","last_undegraded":"2023-10-06T23:11:49.027230+0000","last_fullsized":"2023-10-06T23:11:49.027230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:49.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.044245+0000","last_change":"2023-10-06T23:11:50.044245+0000","last_active":"2023-10-06T23:11:50.044245+0000","last_peered":"2023-10-06T23:11:50.044245+0000","last_clean":"2023-10-06T23:11:50.044245+0000","last_became_active":"2023-10-06T23:11:50.038493+0000","last_became_peered":"2023-10-06T23:11:50.038493+0000","last_unstale":"2023-10-06T23:11:50.044245+0000","last_undegraded":"2023-10-06T23:11:50.044245+0000","last_fullsized":"2023-10-06T23:11:50.044245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:19.463617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042312+0000","last_change":"2023-10-06T23:11:18.274068+0000","last_active":"2023-10-06T23:11:49.042312+0000","last_peered":"2023-10-06T23:11:49.042312+0000","last_clean":"2023-10-06T23:11:49.042312+0000","last_became_active":"2023-10-06T23:11:18.273692+0000","last_became_peered":"2023-10-06T23:11:18.273692+0000","last_unstale":"2023-10-06T23:11:49.042312+0000","last_undegraded":"2023-10-06T23:11:49.042312+0000","last_fullsized":"2023-10-06T23:11:49.042312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:57:07.735915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032982+0000","last_change":"2023-10-06T23:11:17.260046+0000","last_active":"2023-10-06T23:11:49.032982+0000","last_peered":"2023-10-06T23:11:49.032982+0000","last_clean":"2023-10-06T23:11:49.032982+0000","last_became_active":"2023-10-06T23:11:17.259638+0000","last_became_peered":"2023-10-06T23:11:17.259638+0000","last_unstale":"2023-10-06T23:11:49.032982+0000","last_undegraded":"2023-10-06T23:11:49.032982+0000","last_fullsized":"2023-10-06T23:11:49.032982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:21.660072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035736+0000","last_change":"2023-10-06T23:11:18.264328+0000","last_active":"2023-10-06T23:11:49.035736+0000","last_peered":"2023-10-06T23:11:49.035736+0000","last_clean":"2023-10-06T23:11:49.035736+0000","last_became_active":"2023-10-06T23:11:18.263554+0000","last_became_peered":"2023-10-06T23:11:18.263554+0000","last_unstale":"2023-10-06T23:11:49.035736+0000","last_undegraded":"2023-10-06T23:11:49.035736+0000","last_fullsized":"2023-10-06T23:11:49.035736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:44:02.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:11.331089+0000","last_change":"2023-10-06T23:11:17.265538+0000","last_active":"2023-10-06T23:12:11.331089+0000","last_peered":"2023-10-06T23:12:11.331089+0000","last_clean":"2023-10-06T23:12:11.331089+0000","last_became_active":"2023-10-06T23:11:17.265044+0000","last_became_peered":"2023-10-06T23:11:17.265044+0000","last_unstale":"2023-10-06T23:12:11.331089+0000","last_undegraded":"2023-10-06T23:12:11.331089+0000","last_fullsized":"2023-10-06T23:12:11.331089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:51.220961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032801+0000","last_change":"2023-10-06T23:11:18.257044+0000","last_active":"2023-10-06T23:11:49.032801+0000","last_peered":"2023-10-06T23:11:49.032801+0000","last_clean":"2023-10-06T23:11:49.032801+0000","last_became_active":"2023-10-06T23:11:18.256711+0000","last_became_peered":"2023-10-06T23:11:18.256711+0000","last_unstale":"2023-10-06T23:11:49.032801+0000","last_undegraded":"2023-10-06T23:11:49.032801+0000","last_fullsized":"2023-10-06T23:11:49.032801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:40:25.441143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032501+0000","last_change":"2023-10-06T23:11:17.262062+0000","last_active":"2023-10-06T23:11:49.032501+0000","last_peered":"2023-10-06T23:11:49.032501+0000","last_clean":"2023-10-06T23:11:49.032501+0000","last_became_active":"2023-10-06T23:11:17.261618+0000","last_became_peered":"2023-10-06T23:11:17.261618+0000","last_unstale":"2023-10-06T23:11:49.032501+0000","last_undegraded":"2023-10-06T23:11:49.032501+0000","last_fullsized":"2023-10-06T23:11:49.032501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:59:33.544470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034757+0000","last_change":"2023-10-06T23:11:18.263242+0000","last_active":"2023-10-06T23:11:49.034757+0000","last_peered":"2023-10-06T23:11:49.034757+0000","last_clean":"2023-10-06T23:11:49.034757+0000","last_became_active":"2023-10-06T23:11:18.262684+0000","last_became_peered":"2023-10-06T23:11:18.262684+0000","last_unstale":"2023-10-06T23:11:49.034757+0000","last_undegraded":"2023-10-06T23:11:49.034757+0000","last_fullsized":"2023-10-06T23:11:49.034757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:30:04.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032315+0000","last_change":"2023-10-06T23:11:17.254042+0000","last_active":"2023-10-06T23:11:49.032315+0000","last_peered":"2023-10-06T23:11:49.032315+0000","last_clean":"2023-10-06T23:11:49.032315+0000","last_became_active":"2023-10-06T23:11:17.253704+0000","last_became_peered":"2023-10-06T23:11:17.253704+0000","last_unstale":"2023-10-06T23:11:49.032315+0000","last_undegraded":"2023-10-06T23:11:49.032315+0000","last_fullsized":"2023-10-06T23:11:49.032315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:44.179814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035458+0000","last_change":"2023-10-06T23:11:18.259161+0000","last_active":"2023-10-06T23:11:49.035458+0000","last_peered":"2023-10-06T23:11:49.035458+0000","last_clean":"2023-10-06T23:11:49.035458+0000","last_became_active":"2023-10-06T23:11:18.258747+0000","last_became_peered":"2023-10-06T23:11:18.258747+0000","last_unstale":"2023-10-06T23:11:49.035458+0000","last_undegraded":"2023-10-06T23:11:49.035458+0000","last_fullsized":"2023-10-06T23:11:49.035458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:55:38.340988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034650+0000","last_change":"2023-10-06T23:11:17.266278+0000","last_active":"2023-10-06T23:11:49.034650+0000","last_peered":"2023-10-06T23:11:49.034650+0000","last_clean":"2023-10-06T23:11:49.034650+0000","last_became_active":"2023-10-06T23:11:17.265174+0000","last_became_peered":"2023-10-06T23:11:17.265174+0000","last_unstale":"2023-10-06T23:11:49.034650+0000","last_undegraded":"2023-10-06T23:11:49.034650+0000","last_fullsized":"2023-10-06T23:11:49.034650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:51.203566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032078+0000","last_change":"2023-10-06T23:11:18.259699+0000","last_active":"2023-10-06T23:11:49.032078+0000","last_peered":"2023-10-06T23:11:49.032078+0000","last_clean":"2023-10-06T23:11:49.032078+0000","last_became_active":"2023-10-06T23:11:18.259395+0000","last_became_peered":"2023-10-06T23:11:18.259395+0000","last_unstale":"2023-10-06T23:11:49.032078+0000","last_undegraded":"2023-10-06T23:11:49.032078+0000","last_fullsized":"2023-10-06T23:11:49.032078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:32:37.830092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:08.324935+0000","last_change":"2023-10-06T23:11:17.259592+0000","last_active":"2023-10-06T23:12:08.324935+0000","last_peered":"2023-10-06T23:12:08.324935+0000","last_clean":"2023-10-06T23:12:08.324935+0000","last_became_active":"2023-10-06T23:11:17.259254+0000","last_became_peered":"2023-10-06T23:11:17.259254+0000","last_unstale":"2023-10-06T23:12:08.324935+0000","last_undegraded":"2023-10-06T23:12:08.324935+0000","last_fullsized":"2023-10-06T23:12:08.324935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:31.633620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042667+0000","last_change":"2023-10-06T23:11:18.271568+0000","last_active":"2023-10-06T23:11:49.042667+0000","last_peered":"2023-10-06T23:11:49.042667+0000","last_clean":"2023-10-06T23:11:49.042667+0000","last_became_active":"2023-10-06T23:11:18.271248+0000","last_became_peered":"2023-10-06T23:11:18.271248+0000","last_unstale":"2023-10-06T23:11:49.042667+0000","last_undegraded":"2023-10-06T23:11:49.042667+0000","last_fullsized":"2023-10-06T23:11:49.042667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:30.138803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036265+0000","last_change":"2023-10-06T23:11:17.257823+0000","last_active":"2023-10-06T23:11:49.036265+0000","last_peered":"2023-10-06T23:11:49.036265+0000","last_clean":"2023-10-06T23:11:49.036265+0000","last_became_active":"2023-10-06T23:11:17.257426+0000","last_became_peered":"2023-10-06T23:11:17.257426+0000","last_unstale":"2023-10-06T23:11:49.036265+0000","last_undegraded":"2023-10-06T23:11:49.036265+0000","last_fullsized":"2023-10-06T23:11:49.036265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:27:17.158360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027188+0000","last_change":"2023-10-06T23:11:18.260555+0000","last_active":"2023-10-06T23:11:49.027188+0000","last_peered":"2023-10-06T23:11:49.027188+0000","last_clean":"2023-10-06T23:11:49.027188+0000","last_became_active":"2023-10-06T23:11:18.260236+0000","last_became_peered":"2023-10-06T23:11:18.260236+0000","last_unstale":"2023-10-06T23:11:49.027188+0000","last_undegraded":"2023-10-06T23:11:49.027188+0000","last_fullsized":"2023-10-06T23:11:49.027188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:51.499668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035946+0000","last_change":"2023-10-06T23:11:17.267686+0000","last_active":"2023-10-06T23:11:49.035946+0000","last_peered":"2023-10-06T23:11:49.035946+0000","last_clean":"2023-10-06T23:11:49.035946+0000","last_became_active":"2023-10-06T23:11:17.267322+0000","last_became_peered":"2023-10-06T23:11:17.267322+0000","last_unstale":"2023-10-06T23:11:49.035946+0000","last_undegraded":"2023-10-06T23:11:49.035946+0000","last_fullsized":"2023-10-06T23:11:49.035946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:48:40.755898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042418+0000","last_change":"2023-10-06T23:11:18.257382+0000","last_active":"2023-10-06T23:11:49.042418+0000","last_peered":"2023-10-06T23:11:49.042418+0000","last_clean":"2023-10-06T23:11:49.042418+0000","last_became_active":"2023-10-06T23:11:18.256572+0000","last_became_peered":"2023-10-06T23:11:18.256572+0000","last_unstale":"2023-10-06T23:11:49.042418+0000","last_undegraded":"2023-10-06T23:11:49.042418+0000","last_fullsized":"2023-10-06T23:11:49.042418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:43.631813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'8","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:10.305860+0000","last_change":"2023-10-06T23:11:17.257340+0000","last_active":"2023-10-06T23:12:10.305860+0000","last_peered":"2023-10-06T23:12:10.305860+0000","last_clean":"2023-10-06T23:12:10.305860+0000","last_became_active":"2023-10-06T23:11:17.256973+0000","last_became_peered":"2023-10-06T23:11:17.256973+0000","last_unstale":"2023-10-06T23:12:10.305860+0000","last_undegraded":"2023-10-06T23:12:10.305860+0000","last_fullsized":"2023-10-06T23:12:10.305860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:35.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":51,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033409+0000","last_change":"2023-10-06T23:11:18.258928+0000","last_active":"2023-10-06T23:11:49.033409+0000","last_peered":"2023-10-06T23:11:49.033409+0000","last_clean":"2023-10-06T23:11:49.033409+0000","last_became_active":"2023-10-06T23:11:18.258572+0000","last_became_peered":"2023-10-06T23:11:18.258572+0000","last_unstale":"2023-10-06T23:11:49.033409+0000","last_undegraded":"2023-10-06T23:11:49.033409+0000","last_fullsized":"2023-10-06T23:11:49.033409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:51.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037051+0000","last_change":"2023-10-06T23:11:17.260955+0000","last_active":"2023-10-06T23:11:49.037051+0000","last_peered":"2023-10-06T23:11:49.037051+0000","last_clean":"2023-10-06T23:11:49.037051+0000","last_became_active":"2023-10-06T23:11:17.260565+0000","last_became_peered":"2023-10-06T23:11:17.260565+0000","last_unstale":"2023-10-06T23:11:49.037051+0000","last_undegraded":"2023-10-06T23:11:49.037051+0000","last_fullsized":"2023-10-06T23:11:49.037051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:14:51.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031110+0000","last_change":"2023-10-06T23:11:18.266857+0000","last_active":"2023-10-06T23:11:49.031110+0000","last_peered":"2023-10-06T23:11:49.031110+0000","last_clean":"2023-10-06T23:11:49.031110+0000","last_became_active":"2023-10-06T23:11:18.266476+0000","last_became_peered":"2023-10-06T23:11:18.266476+0000","last_unstale":"2023-10-06T23:11:49.031110+0000","last_undegraded":"2023-10-06T23:11:49.031110+0000","last_fullsized":"2023-10-06T23:11:49.031110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:26.131492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035426+0000","last_change":"2023-10-06T23:11:17.265672+0000","last_active":"2023-10-06T23:11:49.035426+0000","last_peered":"2023-10-06T23:11:49.035426+0000","last_clean":"2023-10-06T23:11:49.035426+0000","last_became_active":"2023-10-06T23:11:17.265329+0000","last_became_peered":"2023-10-06T23:11:17.265329+0000","last_unstale":"2023-10-06T23:11:49.035426+0000","last_undegraded":"2023-10-06T23:11:49.035426+0000","last_fullsized":"2023-10-06T23:11:49.035426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:43.159919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036115+0000","last_change":"2023-10-06T23:11:18.269427+0000","last_active":"2023-10-06T23:11:49.036115+0000","last_peered":"2023-10-06T23:11:49.036115+0000","last_clean":"2023-10-06T23:11:49.036115+0000","last_became_active":"2023-10-06T23:11:18.269115+0000","last_became_peered":"2023-10-06T23:11:18.269115+0000","last_unstale":"2023-10-06T23:11:49.036115+0000","last_undegraded":"2023-10-06T23:11:49.036115+0000","last_fullsized":"2023-10-06T23:11:49.036115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:12.598526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:09.331821+0000","last_change":"2023-10-06T23:11:17.252599+0000","last_active":"2023-10-06T23:12:09.331821+0000","last_peered":"2023-10-06T23:12:09.331821+0000","last_clean":"2023-10-06T23:12:09.331821+0000","last_became_active":"2023-10-06T23:11:17.251893+0000","last_became_peered":"2023-10-06T23:11:17.251893+0000","last_unstale":"2023-10-06T23:12:09.331821+0000","last_undegraded":"2023-10-06T23:12:09.331821+0000","last_fullsized":"2023-10-06T23:12:09.331821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:24:10.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035840+0000","last_change":"2023-10-06T23:11:18.269026+0000","last_active":"2023-10-06T23:11:49.035840+0000","last_peered":"2023-10-06T23:11:49.035840+0000","last_clean":"2023-10-06T23:11:49.035840+0000","last_became_active":"2023-10-06T23:11:18.268701+0000","last_became_peered":"2023-10-06T23:11:18.268701+0000","last_unstale":"2023-10-06T23:11:49.035840+0000","last_undegraded":"2023-10-06T23:11:49.035840+0000","last_fullsized":"2023-10-06T23:11:49.035840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:03:25.903664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032636+0000","last_change":"2023-10-06T23:11:17.255323+0000","last_active":"2023-10-06T23:11:49.032636+0000","last_peered":"2023-10-06T23:11:49.032636+0000","last_clean":"2023-10-06T23:11:49.032636+0000","last_became_active":"2023-10-06T23:11:17.254975+0000","last_became_peered":"2023-10-06T23:11:17.254975+0000","last_unstale":"2023-10-06T23:11:49.032636+0000","last_undegraded":"2023-10-06T23:11:49.032636+0000","last_fullsized":"2023-10-06T23:11:49.032636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:41:35.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035228+0000","last_change":"2023-10-06T23:11:18.263290+0000","last_active":"2023-10-06T23:11:49.035228+0000","last_peered":"2023-10-06T23:11:49.035228+0000","last_clean":"2023-10-06T23:11:49.035228+0000","last_became_active":"2023-10-06T23:11:18.262680+0000","last_became_peered":"2023-10-06T23:11:18.262680+0000","last_unstale":"2023-10-06T23:11:49.035228+0000","last_undegraded":"2023-10-06T23:11:49.035228+0000","last_fullsized":"2023-10-06T23:11:49.035228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:43:12.249803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.048876+0000","last_change":"2023-10-06T23:11:50.048453+0000","last_active":"2023-10-06T23:11:50.048876+0000","last_peered":"2023-10-06T23:11:50.048876+0000","last_clean":"2023-10-06T23:11:50.048876+0000","last_became_active":"2023-10-06T23:11:50.035200+0000","last_became_peered":"2023-10-06T23:11:50.035200+0000","last_unstale":"2023-10-06T23:11:50.048876+0000","last_undegraded":"2023-10-06T23:11:50.048876+0000","last_fullsized":"2023-10-06T23:11:50.048876+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:31:21.791916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.032715+0000","last_change":"2023-10-06T23:11:50.032715+0000","last_active":"2023-10-06T23:11:50.032715+0000","last_peered":"2023-10-06T23:11:50.032715+0000","last_clean":"2023-10-06T23:11:50.032715+0000","last_became_active":"2023-10-06T23:11:50.032326+0000","last_became_peered":"2023-10-06T23:11:50.032326+0000","last_unstale":"2023-10-06T23:11:50.032715+0000","last_undegraded":"2023-10-06T23:11:50.032715+0000","last_fullsized":"2023-10-06T23:11:50.032715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:26:25.453692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032907+0000","last_change":"2023-10-06T23:11:17.258175+0000","last_active":"2023-10-06T23:11:49.032907+0000","last_peered":"2023-10-06T23:11:49.032907+0000","last_clean":"2023-10-06T23:11:49.032907+0000","last_became_active":"2023-10-06T23:11:17.257780+0000","last_became_peered":"2023-10-06T23:11:17.257780+0000","last_unstale":"2023-10-06T23:11:49.032907+0000","last_undegraded":"2023-10-06T23:11:49.032907+0000","last_fullsized":"2023-10-06T23:11:49.032907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:19:51.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033026+0000","last_change":"2023-10-06T23:11:18.267837+0000","last_active":"2023-10-06T23:11:49.033026+0000","last_peered":"2023-10-06T23:11:49.033026+0000","last_clean":"2023-10-06T23:11:49.033026+0000","last_became_active":"2023-10-06T23:11:18.267535+0000","last_became_peered":"2023-10-06T23:11:18.267535+0000","last_unstale":"2023-10-06T23:11:49.033026+0000","last_undegraded":"2023-10-06T23:11:49.033026+0000","last_fullsized":"2023-10-06T23:11:49.033026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:08.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036029+0000","last_change":"2023-10-06T23:11:17.261075+0000","last_active":"2023-10-06T23:11:49.036029+0000","last_peered":"2023-10-06T23:11:49.036029+0000","last_clean":"2023-10-06T23:11:49.036029+0000","last_became_active":"2023-10-06T23:11:17.260456+0000","last_became_peered":"2023-10-06T23:11:17.260456+0000","last_unstale":"2023-10-06T23:11:49.036029+0000","last_undegraded":"2023-10-06T23:11:49.036029+0000","last_fullsized":"2023-10-06T23:11:49.036029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:00:25.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032760+0000","last_change":"2023-10-06T23:11:18.265347+0000","last_active":"2023-10-06T23:11:49.032760+0000","last_peered":"2023-10-06T23:11:49.032760+0000","last_clean":"2023-10-06T23:11:49.032760+0000","last_became_active":"2023-10-06T23:11:18.265034+0000","last_became_peered":"2023-10-06T23:11:18.265034+0000","last_unstale":"2023-10-06T23:11:49.032760+0000","last_undegraded":"2023-10-06T23:11:49.032760+0000","last_fullsized":"2023-10-06T23:11:49.032760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:32:44.253022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034992+0000","last_change":"2023-10-06T23:11:18.263990+0000","last_active":"2023-10-06T23:11:49.034992+0000","last_peered":"2023-10-06T23:11:49.034992+0000","last_clean":"2023-10-06T23:11:49.034992+0000","last_became_active":"2023-10-06T23:11:18.262760+0000","last_became_peered":"2023-10-06T23:11:18.262760+0000","last_unstale":"2023-10-06T23:11:49.034992+0000","last_undegraded":"2023-10-06T23:11:49.034992+0000","last_fullsized":"2023-10-06T23:11:49.034992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:48:51.754187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:06.326573+0000","last_change":"2023-10-06T23:11:17.263187+0000","last_active":"2023-10-06T23:12:06.326573+0000","last_peered":"2023-10-06T23:12:06.326573+0000","last_clean":"2023-10-06T23:12:06.326573+0000","last_became_active":"2023-10-06T23:11:17.262770+0000","last_became_peered":"2023-10-06T23:11:17.262770+0000","last_unstale":"2023-10-06T23:12:06.326573+0000","last_undegraded":"2023-10-06T23:12:06.326573+0000","last_fullsized":"2023-10-06T23:12:06.326573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:27.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036248+0000","last_change":"2023-10-06T23:11:18.264305+0000","last_active":"2023-10-06T23:11:49.036248+0000","last_peered":"2023-10-06T23:11:49.036248+0000","last_clean":"2023-10-06T23:11:49.036248+0000","last_became_active":"2023-10-06T23:11:18.263964+0000","last_became_peered":"2023-10-06T23:11:18.263964+0000","last_unstale":"2023-10-06T23:11:49.036248+0000","last_undegraded":"2023-10-06T23:11:49.036248+0000","last_fullsized":"2023-10-06T23:11:49.036248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:11.855254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030137+0000","last_change":"2023-10-06T23:11:17.249832+0000","last_active":"2023-10-06T23:11:49.030137+0000","last_peered":"2023-10-06T23:11:49.030137+0000","last_clean":"2023-10-06T23:11:49.030137+0000","last_became_active":"2023-10-06T23:11:17.249425+0000","last_became_peered":"2023-10-06T23:11:17.249425+0000","last_unstale":"2023-10-06T23:11:49.030137+0000","last_undegraded":"2023-10-06T23:11:49.030137+0000","last_fullsized":"2023-10-06T23:11:49.030137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:02:49.349981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":312,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036114+0000","last_change":"2023-10-06T23:09:57.868881+0000","last_active":"2023-10-06T23:11:49.036114+0000","last_peered":"2023-10-06T23:11:49.036114+0000","last_clean":"2023-10-06T23:11:49.036114+0000","last_became_active":"2023-10-06T23:09:57.868450+0000","last_became_peered":"2023-10-06T23:09:57.868450+0000","last_unstale":"2023-10-06T23:11:49.036114+0000","last_undegraded":"2023-10-06T23:11:49.036114+0000","last_fullsized":"2023-10-06T23:11:49.036114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_clean_scrub_stamp":"2023-10-06T23:06:23.790096+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:39:38.741355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039829+0000","last_change":"2023-10-06T23:11:50.039829+0000","last_active":"2023-10-06T23:11:50.039829+0000","last_peered":"2023-10-06T23:11:50.039829+0000","last_clean":"2023-10-06T23:11:50.039829+0000","last_became_active":"2023-10-06T23:11:50.039403+0000","last_became_peered":"2023-10-06T23:11:50.039403+0000","last_unstale":"2023-10-06T23:11:50.039829+0000","last_undegraded":"2023-10-06T23:11:50.039829+0000","last_fullsized":"2023-10-06T23:11:50.039829+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:33.599164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036051+0000","last_change":"2023-10-06T23:11:17.259610+0000","last_active":"2023-10-06T23:11:49.036051+0000","last_peered":"2023-10-06T23:11:49.036051+0000","last_clean":"2023-10-06T23:11:49.036051+0000","last_became_active":"2023-10-06T23:11:17.259314+0000","last_became_peered":"2023-10-06T23:11:17.259314+0000","last_unstale":"2023-10-06T23:11:49.036051+0000","last_undegraded":"2023-10-06T23:11:49.036051+0000","last_fullsized":"2023-10-06T23:11:49.036051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:48.131199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.040322+0000","last_change":"2023-10-06T23:11:50.039550+0000","last_active":"2023-10-06T23:11:50.040322+0000","last_peered":"2023-10-06T23:11:50.040322+0000","last_clean":"2023-10-06T23:11:50.040322+0000","last_became_active":"2023-10-06T23:11:50.033804+0000","last_became_peered":"2023-10-06T23:11:50.033804+0000","last_unstale":"2023-10-06T23:11:50.040322+0000","last_undegraded":"2023-10-06T23:11:50.040322+0000","last_fullsized":"2023-10-06T23:11:50.040322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:06.172652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031729+0000","last_change":"2023-10-06T23:11:18.259562+0000","last_active":"2023-10-06T23:11:49.031729+0000","last_peered":"2023-10-06T23:11:49.031729+0000","last_clean":"2023-10-06T23:11:49.031729+0000","last_became_active":"2023-10-06T23:11:18.259188+0000","last_became_peered":"2023-10-06T23:11:18.259188+0000","last_unstale":"2023-10-06T23:11:49.031729+0000","last_undegraded":"2023-10-06T23:11:49.031729+0000","last_fullsized":"2023-10-06T23:11:49.031729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:19.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033164+0000","last_change":"2023-10-06T23:11:17.260888+0000","last_active":"2023-10-06T23:11:49.033164+0000","last_peered":"2023-10-06T23:11:49.033164+0000","last_clean":"2023-10-06T23:11:49.033164+0000","last_became_active":"2023-10-06T23:11:17.260563+0000","last_became_peered":"2023-10-06T23:11:17.260563+0000","last_unstale":"2023-10-06T23:11:49.033164+0000","last_undegraded":"2023-10-06T23:11:49.033164+0000","last_fullsized":"2023-10-06T23:11:49.033164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:43.087389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036989+0000","last_change":"2023-10-06T23:11:18.261401+0000","last_active":"2023-10-06T23:11:49.036989+0000","last_peered":"2023-10-06T23:11:49.036989+0000","last_clean":"2023-10-06T23:11:49.036989+0000","last_became_active":"2023-10-06T23:11:18.261037+0000","last_became_peered":"2023-10-06T23:11:18.261037+0000","last_unstale":"2023-10-06T23:11:49.036989+0000","last_undegraded":"2023-10-06T23:11:49.036989+0000","last_fullsized":"2023-10-06T23:11:49.036989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:53.298980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030447+0000","last_change":"2023-10-06T23:11:17.264907+0000","last_active":"2023-10-06T23:11:49.030447+0000","last_peered":"2023-10-06T23:11:49.030447+0000","last_clean":"2023-10-06T23:11:49.030447+0000","last_became_active":"2023-10-06T23:11:17.264426+0000","last_became_peered":"2023-10-06T23:11:17.264426+0000","last_unstale":"2023-10-06T23:11:49.030447+0000","last_undegraded":"2023-10-06T23:11:49.030447+0000","last_fullsized":"2023-10-06T23:11:49.030447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:21.330048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027045+0000","last_change":"2023-10-06T23:11:18.259337+0000","last_active":"2023-10-06T23:11:49.027045+0000","last_peered":"2023-10-06T23:11:49.027045+0000","last_clean":"2023-10-06T23:11:49.027045+0000","last_became_active":"2023-10-06T23:11:18.259008+0000","last_became_peered":"2023-10-06T23:11:18.259008+0000","last_unstale":"2023-10-06T23:11:49.027045+0000","last_undegraded":"2023-10-06T23:11:49.027045+0000","last_fullsized":"2023-10-06T23:11:49.027045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:28.845368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042510+0000","last_change":"2023-10-06T23:11:17.267695+0000","last_active":"2023-10-06T23:11:49.042510+0000","last_peered":"2023-10-06T23:11:49.042510+0000","last_clean":"2023-10-06T23:11:49.042510+0000","last_became_active":"2023-10-06T23:11:17.267292+0000","last_became_peered":"2023-10-06T23:11:17.267292+0000","last_unstale":"2023-10-06T23:11:49.042510+0000","last_undegraded":"2023-10-06T23:11:49.042510+0000","last_fullsized":"2023-10-06T23:11:49.042510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:36:54.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032536+0000","last_change":"2023-10-06T23:11:18.260012+0000","last_active":"2023-10-06T23:11:49.032536+0000","last_peered":"2023-10-06T23:11:49.032536+0000","last_clean":"2023-10-06T23:11:49.032536+0000","last_became_active":"2023-10-06T23:11:18.259684+0000","last_became_peered":"2023-10-06T23:11:18.259684+0000","last_unstale":"2023-10-06T23:11:49.032536+0000","last_undegraded":"2023-10-06T23:11:49.032536+0000","last_fullsized":"2023-10-06T23:11:49.032536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:46:08.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035791+0000","last_change":"2023-10-06T23:11:17.264262+0000","last_active":"2023-10-06T23:11:49.035791+0000","last_peered":"2023-10-06T23:11:49.035791+0000","last_clean":"2023-10-06T23:11:49.035791+0000","last_became_active":"2023-10-06T23:11:17.263922+0000","last_became_peered":"2023-10-06T23:11:17.263922+0000","last_unstale":"2023-10-06T23:11:49.035791+0000","last_undegraded":"2023-10-06T23:11:49.035791+0000","last_fullsized":"2023-10-06T23:11:49.035791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:00:14.045943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029509+0000","last_change":"2023-10-06T23:11:18.260908+0000","last_active":"2023-10-06T23:11:49.029509+0000","last_peered":"2023-10-06T23:11:49.029509+0000","last_clean":"2023-10-06T23:11:49.029509+0000","last_became_active":"2023-10-06T23:11:18.260459+0000","last_became_peered":"2023-10-06T23:11:18.260459+0000","last_unstale":"2023-10-06T23:11:49.029509+0000","last_undegraded":"2023-10-06T23:11:49.029509+0000","last_fullsized":"2023-10-06T23:11:49.029509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:51.570508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036705+0000","last_change":"2023-10-06T23:11:17.262559+0000","last_active":"2023-10-06T23:11:49.036705+0000","last_peered":"2023-10-06T23:11:49.036705+0000","last_clean":"2023-10-06T23:11:49.036705+0000","last_became_active":"2023-10-06T23:11:17.262062+0000","last_became_peered":"2023-10-06T23:11:17.262062+0000","last_unstale":"2023-10-06T23:11:49.036705+0000","last_undegraded":"2023-10-06T23:11:49.036705+0000","last_fullsized":"2023-10-06T23:11:49.036705+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:03.751385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036526+0000","last_change":"2023-10-06T23:11:18.269813+0000","last_active":"2023-10-06T23:11:49.036526+0000","last_peered":"2023-10-06T23:11:49.036526+0000","last_clean":"2023-10-06T23:11:49.036526+0000","last_became_active":"2023-10-06T23:11:18.269506+0000","last_became_peered":"2023-10-06T23:11:18.269506+0000","last_unstale":"2023-10-06T23:11:49.036526+0000","last_undegraded":"2023-10-06T23:11:49.036526+0000","last_fullsized":"2023-10-06T23:11:49.036526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:43:21.635237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032699+0000","last_change":"2023-10-06T23:11:17.253040+0000","last_active":"2023-10-06T23:11:49.032699+0000","last_peered":"2023-10-06T23:11:49.032699+0000","last_clean":"2023-10-06T23:11:49.032699+0000","last_became_active":"2023-10-06T23:11:17.252596+0000","last_became_peered":"2023-10-06T23:11:17.252596+0000","last_unstale":"2023-10-06T23:11:49.032699+0000","last_undegraded":"2023-10-06T23:11:49.032699+0000","last_fullsized":"2023-10-06T23:11:49.032699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:39:30.721464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036362+0000","last_change":"2023-10-06T23:11:18.267465+0000","last_active":"2023-10-06T23:11:49.036362+0000","last_peered":"2023-10-06T23:11:49.036362+0000","last_clean":"2023-10-06T23:11:49.036362+0000","last_became_active":"2023-10-06T23:11:18.267164+0000","last_became_peered":"2023-10-06T23:11:18.267164+0000","last_unstale":"2023-10-06T23:11:49.036362+0000","last_undegraded":"2023-10-06T23:11:49.036362+0000","last_fullsized":"2023-10-06T23:11:49.036362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:16.747117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037242+0000","last_change":"2023-10-06T23:11:17.267653+0000","last_active":"2023-10-06T23:11:49.037242+0000","last_peered":"2023-10-06T23:11:49.037242+0000","last_clean":"2023-10-06T23:11:49.037242+0000","last_became_active":"2023-10-06T23:11:17.267264+0000","last_became_peered":"2023-10-06T23:11:17.267264+0000","last_unstale":"2023-10-06T23:11:49.037242+0000","last_undegraded":"2023-10-06T23:11:49.037242+0000","last_fullsized":"2023-10-06T23:11:49.037242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:45:57.242383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036468+0000","last_change":"2023-10-06T23:11:18.264869+0000","last_active":"2023-10-06T23:11:49.036468+0000","last_peered":"2023-10-06T23:11:49.036468+0000","last_clean":"2023-10-06T23:11:49.036468+0000","last_became_active":"2023-10-06T23:11:18.264549+0000","last_became_peered":"2023-10-06T23:11:18.264549+0000","last_unstale":"2023-10-06T23:11:49.036468+0000","last_undegraded":"2023-10-06T23:11:49.036468+0000","last_fullsized":"2023-10-06T23:11:49.036468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:00:35.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035779+0000","last_change":"2023-10-06T23:11:17.263806+0000","last_active":"2023-10-06T23:11:49.035779+0000","last_peered":"2023-10-06T23:11:49.035779+0000","last_clean":"2023-10-06T23:11:49.035779+0000","last_became_active":"2023-10-06T23:11:17.263499+0000","last_became_peered":"2023-10-06T23:11:17.263499+0000","last_unstale":"2023-10-06T23:11:49.035779+0000","last_undegraded":"2023-10-06T23:11:49.035779+0000","last_fullsized":"2023-10-06T23:11:49.035779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:26.191338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036159+0000","last_change":"2023-10-06T23:11:18.264691+0000","last_active":"2023-10-06T23:11:49.036159+0000","last_peered":"2023-10-06T23:11:49.036159+0000","last_clean":"2023-10-06T23:11:49.036159+0000","last_became_active":"2023-10-06T23:11:18.264286+0000","last_became_peered":"2023-10-06T23:11:18.264286+0000","last_unstale":"2023-10-06T23:11:49.036159+0000","last_undegraded":"2023-10-06T23:11:49.036159+0000","last_fullsized":"2023-10-06T23:11:49.036159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:35:23.728707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.401402+0000","last_change":"2023-10-06T23:11:50.401402+0000","last_active":"2023-10-06T23:11:50.401402+0000","last_peered":"2023-10-06T23:11:50.401402+0000","last_clean":"2023-10-06T23:11:50.401402+0000","last_became_active":"2023-10-06T23:11:50.397772+0000","last_became_peered":"2023-10-06T23:11:50.397772+0000","last_unstale":"2023-10-06T23:11:50.401402+0000","last_undegraded":"2023-10-06T23:11:50.401402+0000","last_fullsized":"2023-10-06T23:11:50.401402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:33.727845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036474+0000","last_change":"2023-10-06T23:11:18.265822+0000","last_active":"2023-10-06T23:11:49.036474+0000","last_peered":"2023-10-06T23:11:49.036474+0000","last_clean":"2023-10-06T23:11:49.036474+0000","last_became_active":"2023-10-06T23:11:18.265457+0000","last_became_peered":"2023-10-06T23:11:18.265457+0000","last_unstale":"2023-10-06T23:11:49.036474+0000","last_undegraded":"2023-10-06T23:11:49.036474+0000","last_fullsized":"2023-10-06T23:11:49.036474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:09.132431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029634+0000","last_change":"2023-10-06T23:11:18.267305+0000","last_active":"2023-10-06T23:11:49.029634+0000","last_peered":"2023-10-06T23:11:49.029634+0000","last_clean":"2023-10-06T23:11:49.029634+0000","last_became_active":"2023-10-06T23:11:18.266975+0000","last_became_peered":"2023-10-06T23:11:18.266975+0000","last_unstale":"2023-10-06T23:11:49.029634+0000","last_undegraded":"2023-10-06T23:11:49.029634+0000","last_fullsized":"2023-10-06T23:11:49.029634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036823+0000","last_change":"2023-10-06T23:11:18.262045+0000","last_active":"2023-10-06T23:11:49.036823+0000","last_peered":"2023-10-06T23:11:49.036823+0000","last_clean":"2023-10-06T23:11:49.036823+0000","last_became_active":"2023-10-06T23:11:18.261662+0000","last_became_peered":"2023-10-06T23:11:18.261662+0000","last_unstale":"2023-10-06T23:11:49.036823+0000","last_undegraded":"2023-10-06T23:11:49.036823+0000","last_fullsized":"2023-10-06T23:11:49.036823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:56:06.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036972+0000","last_change":"2023-10-06T23:11:18.259540+0000","last_active":"2023-10-06T23:11:49.036972+0000","last_peered":"2023-10-06T23:11:49.036972+0000","last_clean":"2023-10-06T23:11:49.036972+0000","last_became_active":"2023-10-06T23:11:18.259234+0000","last_became_peered":"2023-10-06T23:11:18.259234+0000","last_unstale":"2023-10-06T23:11:49.036972+0000","last_undegraded":"2023-10-06T23:11:49.036972+0000","last_fullsized":"2023-10-06T23:11:49.036972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:47:15.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026670+0000","last_change":"2023-10-06T23:11:18.266295+0000","last_active":"2023-10-06T23:11:49.026670+0000","last_peered":"2023-10-06T23:11:49.026670+0000","last_clean":"2023-10-06T23:11:49.026670+0000","last_became_active":"2023-10-06T23:11:18.265991+0000","last_became_peered":"2023-10-06T23:11:18.265991+0000","last_unstale":"2023-10-06T23:11:49.026670+0000","last_undegraded":"2023-10-06T23:11:49.026670+0000","last_fullsized":"2023-10-06T23:11:49.026670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:34:43.165643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031833+0000","last_change":"2023-10-06T23:11:18.266239+0000","last_active":"2023-10-06T23:11:49.031833+0000","last_peered":"2023-10-06T23:11:49.031833+0000","last_clean":"2023-10-06T23:11:49.031833+0000","last_became_active":"2023-10-06T23:11:18.265849+0000","last_became_peered":"2023-10-06T23:11:18.265849+0000","last_unstale":"2023-10-06T23:11:49.031833+0000","last_undegraded":"2023-10-06T23:11:49.031833+0000","last_fullsized":"2023-10-06T23:11:49.031833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:47.219459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030522+0000","last_change":"2023-10-06T23:11:18.260885+0000","last_active":"2023-10-06T23:11:49.030522+0000","last_peered":"2023-10-06T23:11:49.030522+0000","last_clean":"2023-10-06T23:11:49.030522+0000","last_became_active":"2023-10-06T23:11:18.260567+0000","last_became_peered":"2023-10-06T23:11:18.260567+0000","last_unstale":"2023-10-06T23:11:49.030522+0000","last_undegraded":"2023-10-06T23:11:49.030522+0000","last_fullsized":"2023-10-06T23:11:49.030522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:36.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037629+0000","last_change":"2023-10-06T23:11:18.257105+0000","last_active":"2023-10-06T23:11:49.037629+0000","last_peered":"2023-10-06T23:11:49.037629+0000","last_clean":"2023-10-06T23:11:49.037629+0000","last_became_active":"2023-10-06T23:11:18.256816+0000","last_became_peered":"2023-10-06T23:11:18.256816+0000","last_unstale":"2023-10-06T23:11:49.037629+0000","last_undegraded":"2023-10-06T23:11:49.037629+0000","last_fullsized":"2023-10-06T23:11:49.037629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:07.749678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036911+0000","last_change":"2023-10-06T23:11:18.260383+0000","last_active":"2023-10-06T23:11:49.036911+0000","last_peered":"2023-10-06T23:11:49.036911+0000","last_clean":"2023-10-06T23:11:49.036911+0000","last_became_active":"2023-10-06T23:11:18.260010+0000","last_became_peered":"2023-10-06T23:11:18.260010+0000","last_unstale":"2023-10-06T23:11:49.036911+0000","last_undegraded":"2023-10-06T23:11:49.036911+0000","last_fullsized":"2023-10-06T23:11:49.036911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:25.014895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034750+0000","last_change":"2023-10-06T23:11:18.261948+0000","last_active":"2023-10-06T23:11:49.034750+0000","last_peered":"2023-10-06T23:11:49.034750+0000","last_clean":"2023-10-06T23:11:49.034750+0000","last_became_active":"2023-10-06T23:11:18.261605+0000","last_became_peered":"2023-10-06T23:11:18.261605+0000","last_unstale":"2023-10-06T23:11:49.034750+0000","last_undegraded":"2023-10-06T23:11:49.034750+0000","last_fullsized":"2023-10-06T23:11:49.034750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:10:59.720181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035691+0000","last_change":"2023-10-06T23:11:18.261123+0000","last_active":"2023-10-06T23:11:49.035691+0000","last_peered":"2023-10-06T23:11:49.035691+0000","last_clean":"2023-10-06T23:11:49.035691+0000","last_became_active":"2023-10-06T23:11:18.260754+0000","last_became_peered":"2023-10-06T23:11:18.260754+0000","last_unstale":"2023-10-06T23:11:49.035691+0000","last_undegraded":"2023-10-06T23:11:49.035691+0000","last_fullsized":"2023-10-06T23:11:49.035691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:04:25.335790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042589+0000","last_change":"2023-10-06T23:11:18.261021+0000","last_active":"2023-10-06T23:11:49.042589+0000","last_peered":"2023-10-06T23:11:49.042589+0000","last_clean":"2023-10-06T23:11:49.042589+0000","last_became_active":"2023-10-06T23:11:18.260613+0000","last_became_peered":"2023-10-06T23:11:18.260613+0000","last_unstale":"2023-10-06T23:11:49.042589+0000","last_undegraded":"2023-10-06T23:11:49.042589+0000","last_fullsized":"2023-10-06T23:11:49.042589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:31:28.443342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031481+0000","last_change":"2023-10-06T23:11:18.266771+0000","last_active":"2023-10-06T23:11:49.031481+0000","last_peered":"2023-10-06T23:11:49.031481+0000","last_clean":"2023-10-06T23:11:49.031481+0000","last_became_active":"2023-10-06T23:11:18.266434+0000","last_became_peered":"2023-10-06T23:11:18.266434+0000","last_unstale":"2023-10-06T23:11:49.031481+0000","last_undegraded":"2023-10-06T23:11:49.031481+0000","last_fullsized":"2023-10-06T23:11:49.031481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:59:53.056671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029587+0000","last_change":"2023-10-06T23:11:18.265674+0000","last_active":"2023-10-06T23:11:49.029587+0000","last_peered":"2023-10-06T23:11:49.029587+0000","last_clean":"2023-10-06T23:11:49.029587+0000","last_became_active":"2023-10-06T23:11:18.265323+0000","last_became_peered":"2023-10-06T23:11:18.265323+0000","last_unstale":"2023-10-06T23:11:49.029587+0000","last_undegraded":"2023-10-06T23:11:49.029587+0000","last_fullsized":"2023-10-06T23:11:49.029587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:15.281707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281556,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":309,"num_read_kb":161,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":44,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":15666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":459304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.7559999999999998,"5min":3.7559999999999998,"15min":3.7559999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.585,"5min":5.585,"15min":5.585},"last":0.67100000000000004}]},{"osd":1,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.4689999999999999,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":5.3390000000000004,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":3.7090000000000001,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.8090000000000002,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.80900000000000005}]},{"osd":6,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":5.4009999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":5.9640000000000004,"5min":5.9640000000000004,"15min":5.9640000000000004},"last":0.86299999999999999}]},{"osd":7,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.3500000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.21,"5min":4.21,"15min":4.21},"last":0.83999999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":9,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":5.5190000000000001,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":0.999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.2690000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.0900000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:11:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":0.95799999999999996}]}]},{"osd":10,"up_from":73,"seq":313532612638,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1052236,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.79900000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.70199999999999996,"15min":0.68700000000000006},"min":{"1min":0.52400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96199999999999997,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.86799999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61099999999999999}]},{"osd":3,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.85899999999999999,"15min":0.82199999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":8.2669999999999995,"5min":8.2669999999999995,"15min":8.2669999999999995},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78300000000000003,"5min":1.004,"15min":1.004},"last":0.63},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89400000000000002,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.05,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.91300000000000003},"min":{"1min":0.61099999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0960000000000001,"5min":1.228,"15min":1.228},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.0129999999999999,"15min":0.98399999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":7.9539999999999997,"5min":7.9539999999999997,"15min":7.9539999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90400000000000003,"15min":0.91300000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4690000000000001,"5min":1.625,"15min":1.625},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.96199999999999997,"15min":0.97999999999999998},"min":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0109999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0009999999999999,"15min":1.0169999999999999},"min":{"1min":0.70399999999999996,"5min":0.628,"15min":0.628},"max":{"1min":1.1299999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.88600000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.0009999999999999,"15min":1.016},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.371,"5min":1.391,"15min":1.391},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.1240000000000001,"15min":1.0980000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":8.1799999999999997,"5min":8.1799999999999997,"15min":8.1799999999999997},"last":0.91000000000000003}]},{"osd":11,"last update":"Fri Oct 6 23:11:25 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.86899999999999999}]}]},{"osd":9,"up_from":68,"seq":292057776163,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":459496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70899999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73899999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":1.4199999999999999}]},{"osd":1,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.82299999999999995,"15min":0.84099999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.92400000000000004,"5min":1.167,"15min":1.167},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0069999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1759999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.998,"5min":1.222,"15min":1.222},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96299999999999997,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.24}]},{"osd":3,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.212},{"interface":"front","average":{"1min":0.627,"5min":0.72299999999999998,"15min":0.73899999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.153,"15min":1.153},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.90000000000000002,"15min":0.92000000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0800000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.323},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.92500000000000004,"15min":0.94999999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.056,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.93000000000000005,"15min":0.95599999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.117,"5min":2.109,"15min":2.109},"last":1.264},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.92400000000000004,"15min":0.94699999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1639999999999999,"5min":1.359,"15min":1.359},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.86199999999999999,"15min":0.88600000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.177,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.94499999999999995,"15min":0.96399999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1419999999999999,"5min":1.738,"15min":1.738},"last":1.133}]},{"osd":7,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":1.0069999999999999,"15min":1.0349999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1759999999999999,"5min":2.149,"15min":2.149},"last":1.383},{"interface":"front","average":{"1min":0.88,"5min":1.0189999999999999,"15min":1.042},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.2450000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.038}]},{"osd":8,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.0229999999999999,"15min":1.042},"min":{"1min":0.70799999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2030000000000001,"5min":1.778,"15min":1.778},"last":1.284},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.01,"15min":1.03},"min":{"1min":0.75,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.244,"5min":1.698,"15min":1.698},"last":1.335}]},{"osd":10,"last update":"Fri Oct 6 23:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.0389999999999999},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1240000000000001,"5min":1.417,"15min":1.417},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1,"15min":1.016},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.1799999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.3640000000000001}]}]},{"osd":8,"up_from":60,"seq":257698037801,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":459041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.71599999999999997,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.435,"15min":0.435},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.024,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.99199999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":1.272,"15min":1.272},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.96499999999999997,"5min":1.196,"15min":1.196},"last":0.749}]},{"osd":3,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.79000000000000004},"min":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.3799999999999999,"5min":3.3799999999999999,"15min":3.3799999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75,"15min":0.751},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.125,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.01}]},{"osd":5,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.748},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.073,"5min":1.248,"15min":1.248},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98299999999999998,"5min":1.05,"15min":1.05},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.67700000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1719999999999999,"5min":1.399,"15min":1.399},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88800000000000001,"15min":0.92000000000000004},"min":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.115,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91500000000000004}]},{"osd":9,"last update":"Fri Oct 6 23:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.92800000000000005,"15min":0.93999999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1439999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.042,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.76900000000000002}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.70099999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.145,"5min":1.304,"15min":1.304},"last":1.03},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.88600000000000001,"15min":0.875},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.155,"5min":1.242,"15min":1.242},"last":0.93300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":1050507,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79600000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.016,"5min":1.04,"15min":1.04},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.54200000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.92700000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.77700000000000002,"15min":0.72699999999999998},"min":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.7789999999999999,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71499999999999997,"15min":0.70999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.113,"5min":1.149,"15min":1.149},"last":0.76100000000000001}]},{"osd":4,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88100000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.91200000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.55000000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.087,"5min":1.244,"15min":1.244},"last":0.877},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0600000000000001}]},{"osd":6,"last update":"Fri Oct 6 23:11:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82899999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.006,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.55700000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1120000000000001,"5min":1.26,"15min":1.26},"last":0.86299999999999999}]},{"osd":8,"last update":"Fri Oct 6 23:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.61899999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.871,"15min":0.85399999999999998},"min":{"1min":0.70499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.008}]},{"osd":9,"last update":"Fri Oct 6 23:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.61099999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.68400000000000005}]},{"osd":10,"last update":"Fri Oct 6 23:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.93600000000000005,"15min":0.93200000000000005},"min":{"1min":0.68799999999999994,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.179,"5min":1.2,"15min":1.2},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88600000000000001,"15min":0.88400000000000001},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462963,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":458768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46300000000000002,"15min":0.443},"min":{"1min":0.39900000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.627,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71099999999999997,"15min":0.68799999999999994},"min":{"1min":0.50700000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.109,"15min":1.109},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69699999999999995,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98599999999999999,"5min":1.01,"15min":1.01},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94799999999999995,"5min":1.054,"15min":1.054},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42999999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83699999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.63400000000000001,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82599999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.628,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76800000000000002,"15min":0.76300000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1299999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94699999999999995,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.79500000000000004},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1299999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Oct 6 23:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.83799999999999997,"15min":0.81399999999999995},"min":{"1min":0.61199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":3.915,"5min":3.915,"15min":3.915},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.875,"15min":0.85999999999999999},"min":{"1min":0.746,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.81599999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.89000000000000001,"15min":0.85399999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.93300000000000005}]},{"osd":9,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89900000000000002,"15min":0.90500000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.879},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88800000000000001,"15min":0.89300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1950000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.73899999999999999}]},{"osd":10,"last update":"Fri Oct 6 23:11:59 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.018,"15min":1.014},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":460290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61499999999999999,"15min":0.58099999999999996},"min":{"1min":0.46899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Oct 6 23:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Oct 6 23:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69299999999999995,"15min":0.67100000000000004},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68899999999999995,"15min":0.68000000000000005},"min":{"1min":0.495,"5min":0.436,"15min":0.436},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 23:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.436,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.58999999999999997,"15min":0.57199999999999995},"min":{"1min":0.40799999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.70899999999999996,"15min":0.66900000000000004},"min":{"1min":0.50600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.76300000000000001,"15min":0.71499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Oct 6 23:11:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76800000000000002,"15min":0.76100000000000001},"min":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77800000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.73399999999999999,"15min":0.70599999999999996},"min":{"1min":0.47999999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.55000000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.78600000000000003}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.83399999999999996,"15min":0.80000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2410000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.87},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.78100000000000003,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3280000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.71199999999999997}]},{"osd":9,"last update":"Fri Oct 6 23:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.84599999999999997,"15min":0.83199999999999996},"min":{"1min":0.64500000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.76200000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91000000000000003,"15min":0.90000000000000002},"min":{"1min":0.623,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3600000000000001,"5min":1.706,"15min":1.706},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92900000000000005,"15min":0.92100000000000004},"min":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0529999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":460156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.61299999999999999},"min":{"1min":0.42599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.091,"15min":1.091},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.63600000000000001},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 23:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.66900000000000004,"15min":0.63400000000000001},"min":{"1min":0.50700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.58299999999999996,"5min":0.377,"15min":0.377},"max":{"1min":0.995,"5min":1.014,"15min":1.014},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Oct 6 23:09:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Oct 6 23:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.504,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99099999999999999,"5min":0.995,"15min":0.995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66600000000000004,"15min":0.63500000000000001},"min":{"1min":0.45400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.998,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71599999999999997,"15min":0.70099999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.73299999999999998,"15min":0.70099999999999996},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0129999999999999,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Oct 6 23:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.073,"5min":1.085,"15min":1.085},"last":0.434},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.75700000000000001,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1259999999999999,"5min":1.226,"15min":1.226},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.59699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.81399999999999995,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70299999999999996}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.25,"5min":1.296,"15min":1.296},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.68400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.71399999999999997}]},{"osd":9,"last update":"Fri Oct 6 23:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.55100000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.88100000000000001,"15min":0.89500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.149,"5min":1.325,"15min":1.325},"last":0.496}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85999999999999999,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92500000000000004,"15min":0.92300000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.202,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.55100000000000005}]},{"osd":11,"last update":"Fri Oct 6 23:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.80800000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":461640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.91600000000000004,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.621,"15min":0.59499999999999997},"min":{"1min":0.38700000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.754}]},{"osd":1,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.625},"min":{"1min":0.48099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.876,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.65800000000000003},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":1.746,"15min":1.746},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Oct 6 23:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65900000000000003,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.95799999999999996,"5min":1.454,"15min":1.454},"last":0.87},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72799999999999998,"15min":0.70099999999999996},"min":{"1min":0.50900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.995,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Oct 6 23:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.96199999999999997,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91500000000000004,"5min":1.53,"15min":1.53},"last":0.95799999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96199999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.505},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58799999999999997,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.72799999999999998,"15min":0.69399999999999995},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.03,"5min":1.169,"15min":1.169},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.59899999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.018,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.91900000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.54400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75}]},{"osd":8,"last update":"Fri Oct 6 23:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.65500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0800000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82499999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0629999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.84999999999999998}]},{"osd":9,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.879,"15min":0.88200000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.135,"5min":1.155,"15min":1.155},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0600000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.94599999999999995}]},{"osd":10,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.93400000000000005},"min":{"1min":0.72699999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.155,"5min":1.333,"15min":1.333},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.93600000000000005,"15min":0.94399999999999995},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.169,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.98699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":458631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.40200000000000002},"min":{"1min":0.40699999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92700000000000005,"5min":1.03,"15min":1.03},"last":0.443},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.41699999999999998},"min":{"1min":0.38900000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.67800000000000005,"15min":0.63600000000000001},"min":{"1min":0.55400000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.79300000000000004,"15min":0.69899999999999995},"min":{"1min":0.57399999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":9.3989999999999991,"5min":9.3989999999999991,"15min":9.3989999999999991},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.71499999999999997,"15min":0.65900000000000003},"min":{"1min":0.47199999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.3769999999999998,"5min":4.3769999999999998,"15min":4.3769999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70699999999999996,"15min":0.67000000000000004},"min":{"1min":0.59699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.048,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.91300000000000003}]},{"osd":4,"last update":"Fri Oct 6 23:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.65200000000000002},"min":{"1min":0.57699999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79500000000000004,"5min":1.202,"15min":1.202},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 23:11:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":0.85299999999999998,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":9.3379999999999992,"5min":9.3379999999999992,"15min":9.3379999999999992},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.004,"5min":0.80900000000000005,"15min":0.73499999999999999},"min":{"1min":0.52600000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.4279999999999999,"5min":4.4279999999999999,"15min":4.4279999999999999},"last":0.90200000000000002}]},{"osd":6,"last update":"Fri Oct 6 23:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67900000000000005,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 23:11:42 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":0.91300000000000003,"15min":0.85199999999999998},"min":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":9.4779999999999998,"5min":9.4779999999999998,"15min":9.4779999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.84499999999999997,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.5019999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":0.63700000000000001}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.66900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.008,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0009999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.878,"15min":0.88},"min":{"1min":0.66000000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.101,"5min":1.169,"15min":1.169},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.871,"5min":0.84299999999999997,"15min":0.83899999999999997},"min":{"1min":0.61799999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75600000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.026,"15min":0.97799999999999998},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":9.516,"5min":9.516,"15min":9.516},"last":0.872},{"interface":"front","average":{"1min":1.083,"5min":0.998,"15min":0.98399999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.71499999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":459322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.502,"15min":0.46600000000000003},"min":{"1min":0.38400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.501,"15min":0.45900000000000002},"min":{"1min":0.41099999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Oct 6 23:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.58699999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70499999999999996,"15min":0.69699999999999995},"min":{"1min":0.60399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:11:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.68799999999999994,"15min":0.65400000000000003},"min":{"1min":0.54300000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94599999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.71399999999999997,"15min":0.64200000000000002},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0920000000000001,"5min":1.141,"15min":1.141},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71299999999999997,"15min":0.69199999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.74099999999999999,"15min":0.70499999999999996},"min":{"1min":0.56499999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Oct 6 23:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.77700000000000002,"15min":0.753},"min":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0449999999999999,"5min":1.161,"15min":1.161},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Oct 6 23:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.501,"5min":0.432,"15min":0.432},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.79700000000000004,"15min":0.77300000000000002},"min":{"1min":0.54200000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0740000000000001,"5min":1.083,"15min":1.083},"last":0.94799999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.90900000000000003,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0920000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.90500000000000003}]},{"osd":9,"last update":"Fri Oct 6 23:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96699999999999997,"15min":0.96899999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1890000000000001,"5min":1.22,"15min":1.22},"last":1.0720000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.752},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.0960000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]},{"osd":5,"up_from":39,"seq":167503724600,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1050191,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.46300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84399999999999997,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.64000000000000001},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.88500000000000001,"5min":1.153,"15min":1.153},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64400000000000002,"15min":0.625},"min":{"1min":0.49299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.81200000000000006,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.503,"15min":0.48899999999999999},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77400000000000002,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.78200000000000003,"5min":0.879,"15min":0.879},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.44700000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.879,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.499}]},{"osd":4,"last update":"Fri Oct 6 23:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68600000000000005},"min":{"1min":0.58299999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.68799999999999994},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1659999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.76500000000000001}]},{"osd":6,"last update":"Fri Oct 6 23:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.59599999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:11:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.73399999999999999,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.75}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.879,"5min":0.77700000000000002,"15min":0.75700000000000001},"min":{"1min":0.52500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.78700000000000003}]},{"osd":9,"last update":"Fri Oct 6 23:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.83999999999999997,"15min":0.83599999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81200000000000006,"15min":0.81100000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63400000000000001}]},{"osd":10,"last update":"Fri Oct 6 23:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.88200000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.85099999999999998,"15min":0.83899999999999997},"min":{"1min":0.61599999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":1.012}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T23:12:15.065 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-06T23:12:15.065 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T23:12:15.065 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-06T23:12:15.065 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-06T23:12:15.803 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:16.332 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:16 smithi008 ceph-mon[98532]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:12:16.332 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:16 smithi008 ceph-mon[98532]: pgmap v331: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:16.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:16 smithi156 ceph-mon[102862]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:12:16.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:16 smithi156 ceph-mon[102862]: pgmap v331: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:16 smithi190 ceph-mon[102658]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:12:16.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:16 smithi190 ceph-mon[102658]: pgmap v331: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 -- 172.21.15.8:0/3882194729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660101940 msgr2=0x7fd66010ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 --2- 172.21.15.8:0/3882194729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660101940 0x7fd66010ddb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b0d0 tx=0x7fd65800b3e0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 -- 172.21.15.8:0/3882194729 shutdown_connections 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 --2- 172.21.15.8:0/3882194729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660101940 0x7fd66010ddb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 --2- 172.21.15.8:0/3882194729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd660106f90 0x7fd660107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 --2- 172.21.15.8:0/3882194729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd660100f80 0x7fd660101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 -- 172.21.15.8:0/3882194729 >> 172.21.15.8:0/3882194729 conn(0x7fd6600780a0 msgr2=0x7fd6600784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 -- 172.21.15.8:0/3882194729 shutdown_connections 2023-10-06T23:12:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.259+0000 7fd66611c700 1 -- 172.21.15.8:0/3882194729 wait complete. 2023-10-06T23:12:17.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.260+0000 7fd66611c700 1 Processor -- start 2023-10-06T23:12:17.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.260+0000 7fd66611c700 1 -- start start 2023-10-06T23:12:17.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd66611c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660100f80 0x7fd6601991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd66611c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd660101940 0x7fd660199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd66611c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd660106f90 0x7fd66019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd66611c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66019e1a0 con 0x7fd660100f80 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd66611c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66019e310 con 0x7fd660106f90 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd66611c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66019e4d0 con 0x7fd660101940 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd65f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660100f80 0x7fd6601991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd65f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660100f80 0x7fd6601991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32916/0 (socket says 172.21.15.8:32916) 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd65f7fe700 1 -- 172.21.15.8:0/1590571249 learned_addr learned my addr 172.21.15.8:0/1590571249 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd65effd700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd660101940 0x7fd660199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.261+0000 7fd65ffff700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd660106f90 0x7fd66019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:17.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65f7fe700 1 -- 172.21.15.8:0/1590571249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd660101940 msgr2=0x7fd660199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65f7fe700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd660101940 0x7fd660199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65f7fe700 1 -- 172.21.15.8:0/1590571249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd660106f90 msgr2=0x7fd66019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65f7fe700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd660106f90 0x7fd66019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65f7fe700 1 -- 172.21.15.8:0/1590571249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd658009d00 con 0x7fd660100f80 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65f7fe700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660100f80 0x7fd6601991e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd65000d950 tx=0x7fd65000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65cff9700 1 -- 172.21.15.8:0/1590571249 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65000f890 con 0x7fd660100f80 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66019e7b0 con 0x7fd660100f80 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65cff9700 1 -- 172.21.15.8:0/1590571249 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd65000fe80 con 0x7fd660100f80 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd65cff9700 1 -- 172.21.15.8:0/1590571249 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65000e3b0 con 0x7fd660100f80 2023-10-06T23:12:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.262+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6601a6010 con 0x7fd660100f80 2023-10-06T23:12:17.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.263+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66004ebb0 con 0x7fd660100f80 2023-10-06T23:12:17.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.265+0000 7fd65cff9700 1 -- 172.21.15.8:0/1590571249 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd650010460 con 0x7fd660100f80 2023-10-06T23:12:17.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.266+0000 7fd65cff9700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd6480a1480 0x7fd6480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:17.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.267+0000 7fd65cff9700 1 -- 172.21.15.8:0/1590571249 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd6500ccae0 con 0x7fd660100f80 2023-10-06T23:12:17.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.267+0000 7fd65effd700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd6480a1480 0x7fd6480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:17.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.267+0000 7fd65effd700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd6480a1480 0x7fd6480a3940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd66019a800 tx=0x7fd65400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:17.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.271+0000 7fd65cff9700 1 -- 172.21.15.8:0/1590571249 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6500960f0 con 0x7fd660100f80 2023-10-06T23:12:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.527+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd66019a540 con 0x7fd660100f80 2023-10-06T23:12:17.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.528+0000 7fd65cff9700 1 -- 172.21.15.8:0/1590571249 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd650016040 con 0x7fd660100f80 2023-10-06T23:12:17.529 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:17.529 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T23:12:17.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd6480a1480 msgr2=0x7fd6480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:17.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd6480a1480 0x7fd6480a3940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd66019a800 tx=0x7fd65400b410 comp rx=0 tx=0).stop 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660100f80 msgr2=0x7fd6601991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660100f80 0x7fd6601991e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd65000d950 tx=0x7fd65000dc60 comp rx=0 tx=0).stop 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 shutdown_connections 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd6480a1480 0x7fd6480a3940 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd660100f80 0x7fd6601991e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd660106f90 0x7fd66019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 --2- 172.21.15.8:0/1590571249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd660101940 0x7fd660199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 >> 172.21.15.8:0/1590571249 conn(0x7fd6600780a0 msgr2=0x7fd66010c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 shutdown_connections 2023-10-06T23:12:17.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:17.530+0000 7fd66611c700 1 -- 172.21.15.8:0/1590571249 wait complete. 2023-10-06T23:12:18.086 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-06T23:12:18.087 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:12:18.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.292+0000 7f18e5bff700 1 -- 172.21.15.8:0/1597773977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 msgr2=0x7f18e010b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.292+0000 7f18e5bff700 1 --2- 172.21.15.8:0/1597773977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 0x7f18e010b240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b0a0 tx=0x7f18d800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.293+0000 7f18e5bff700 1 -- 172.21.15.8:0/1597773977 shutdown_connections 2023-10-06T23:12:18.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.293+0000 7f18e5bff700 1 --2- 172.21.15.8:0/1597773977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 0x7f18e010b240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.293+0000 7f18e5bff700 1 --2- 172.21.15.8:0/1597773977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e0074ef0 0x7f18e0073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.293+0000 7f18e5bff700 1 --2- 172.21.15.8:0/1597773977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0073910 0x7f18e0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.293+0000 7f18e5bff700 1 -- 172.21.15.8:0/1597773977 >> 172.21.15.8:0/1597773977 conn(0x7f18e00fc420 msgr2=0x7f18e00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.293+0000 7f18e5bff700 1 -- 172.21.15.8:0/1597773977 shutdown_connections 2023-10-06T23:12:18.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.293+0000 7f18e5bff700 1 -- 172.21.15.8:0/1597773977 wait complete. 2023-10-06T23:12:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.294+0000 7f18e5bff700 1 Processor -- start 2023-10-06T23:12:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.294+0000 7f18e5bff700 1 -- start start 2023-10-06T23:12:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.294+0000 7f18e5bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0073910 0x7f18e0198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.294+0000 7f18e5bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e0074ef0 0x7f18e01992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.294+0000 7f18e5bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 0x7f18e01a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:18.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.294+0000 7f18e5bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01a08e0 con 0x7f18e0108db0 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.294+0000 7f18e5bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01a0a50 con 0x7f18e0073910 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.294+0000 7f18e5bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01a0c10 con 0x7f18e0074ef0 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 0x7f18e01a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 0x7f18e01a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32932/0 (socket says 172.21.15.8:32932) 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 -- 172.21.15.8:0/2522679032 learned_addr learned my addr 172.21.15.8:0/2522679032 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18df7fe700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0073910 0x7f18e0198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18deffd700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e0074ef0 0x7f18e01992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 -- 172.21.15.8:0/2522679032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e0074ef0 msgr2=0x7f18e01992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e0074ef0 0x7f18e01992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 -- 172.21.15.8:0/2522679032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0073910 msgr2=0x7f18e0198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0073910 0x7f18e0198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 -- 172.21.15.8:0/2522679032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8009d00 con 0x7f18e0108db0 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18deffd700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e0074ef0 0x7f18e01992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18df7fe700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0073910 0x7f18e0198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dffff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 0x7f18e01a0310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f18d800d010 tx=0x7f18d800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.295+0000 7f18dcff9700 1 -- 172.21.15.8:0/2522679032 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800e040 con 0x7f18e0108db0 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.296+0000 7f18dcff9700 1 -- 172.21.15.8:0/2522679032 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18d8003e10 con 0x7f18e0108db0 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.296+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e01a0e90 con 0x7f18e0108db0 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.296+0000 7f18dcff9700 1 -- 172.21.15.8:0/2522679032 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80053c0 con 0x7f18e0108db0 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.296+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e01a1250 con 0x7f18e0108db0 2023-10-06T23:12:18.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.297+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0107460 con 0x7f18e0108db0 2023-10-06T23:12:18.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.299+0000 7f18dcff9700 1 -- 172.21.15.8:0/2522679032 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f18d801db10 con 0x7f18e0108db0 2023-10-06T23:12:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.300+0000 7f18dcff9700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f18c80a14d0 0x7f18c80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.301+0000 7f18dcff9700 1 -- 172.21.15.8:0/2522679032 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f18d80ce5c0 con 0x7f18e0108db0 2023-10-06T23:12:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.301+0000 7f18df7fe700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f18c80a14d0 0x7f18c80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.301+0000 7f18df7fe700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f18c80a14d0 0x7f18c80a3990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f18d0005950 tx=0x7f18d00058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.302+0000 7f18dcff9700 1 -- 172.21.15.8:0/2522679032 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f18d8097c60 con 0x7f18e0108db0 2023-10-06T23:12:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:18 smithi156 ceph-mon[102862]: pgmap v332: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:18 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1590571249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-06T23:12:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:18 smithi008 ceph-mon[98532]: pgmap v332: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:18 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1590571249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-06T23:12:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:18 smithi190 ceph-mon[102658]: pgmap v332: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:18.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:18 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1590571249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-06T23:12:18.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.518+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18e010e9e0 con 0x7f18e0108db0 2023-10-06T23:12:18.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.519+0000 7f18dcff9700 1 -- 172.21.15.8:0/2522679032 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7f18d809b280 con 0x7f18e0108db0 2023-10-06T23:12:18.521 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:18.521 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f18c80a14d0 msgr2=0x7f18c80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f18c80a14d0 0x7f18c80a3990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f18d0005950 tx=0x7f18d00058e0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 msgr2=0x7f18e01a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 0x7f18e01a0310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f18d800d010 tx=0x7f18d800bd70 comp rx=0 tx=0).stop 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 shutdown_connections 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f18c80a14d0 0x7f18c80a3990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e0108db0 0x7f18e01a0310 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0073910 0x7f18e0198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 --2- 172.21.15.8:0/2522679032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e0074ef0 0x7f18e01992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 >> 172.21.15.8:0/2522679032 conn(0x7f18e00fc420 msgr2=0x7f18e00fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:18.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 shutdown_connections 2023-10-06T23:12:18.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.522+0000 7f18e5bff700 1 -- 172.21.15.8:0/2522679032 wait complete. 2023-10-06T23:12:18.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:12:18.544 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:12:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 -- 172.21.15.8:0/2523574957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44108da0 msgr2=0x7f5c4410b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/2523574957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44108da0 0x7f5c4410b230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00b0a0 tx=0x7f5c3c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 -- 172.21.15.8:0/2523574957 shutdown_connections 2023-10-06T23:12:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/2523574957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44108da0 0x7f5c4410b230 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/2523574957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c44074ef0 0x7f5c44073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/2523574957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c44073910 0x7f5c44073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 -- 172.21.15.8:0/2523574957 >> 172.21.15.8:0/2523574957 conn(0x7f5c440fc430 msgr2=0x7f5c440fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:18.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 -- 172.21.15.8:0/2523574957 shutdown_connections 2023-10-06T23:12:18.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.749+0000 7f5c4bfff700 1 -- 172.21.15.8:0/2523574957 wait complete. 2023-10-06T23:12:18.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.750+0000 7f5c4bfff700 1 Processor -- start 2023-10-06T23:12:18.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.750+0000 7f5c4bfff700 1 -- start start 2023-10-06T23:12:18.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c44073910 0x7f5c44198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:18.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44074ef0 0x7f5c44199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:18.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c44108da0 0x7f5c441a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:18.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c441a0a50 con 0x7f5c44074ef0 2023-10-06T23:12:18.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4bfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c441a0b90 con 0x7f5c44073910 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4bfff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c441a0d20 con 0x7f5c44108da0 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4959a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44074ef0 0x7f5c44199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4959a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44074ef0 0x7f5c44199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32960/0 (socket says 172.21.15.8:32960) 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4959a700 1 -- 172.21.15.8:0/382014280 learned_addr learned my addr 172.21.15.8:0/382014280 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4a59c700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c44108da0 0x7f5c441a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c49d9b700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c44073910 0x7f5c44198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4959a700 1 -- 172.21.15.8:0/382014280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c44108da0 msgr2=0x7f5c441a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4959a700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c44108da0 0x7f5c441a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4959a700 1 -- 172.21.15.8:0/382014280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c44073910 msgr2=0x7f5c44198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4959a700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c44073910 0x7f5c44198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.751+0000 7f5c4959a700 1 -- 172.21.15.8:0/382014280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c009d00 con 0x7f5c44074ef0 2023-10-06T23:12:18.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.752+0000 7f5c4959a700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44074ef0 0x7f5c44199410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400b500 tx=0x7f5c3400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:18.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.752+0000 7f5c3affd700 1 -- 172.21.15.8:0/382014280 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34011830 con 0x7f5c44074ef0 2023-10-06T23:12:18.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.752+0000 7f5c3affd700 1 -- 172.21.15.8:0/382014280 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c34011e20 con 0x7f5c44074ef0 2023-10-06T23:12:18.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.752+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c441a0fa0 con 0x7f5c44074ef0 2023-10-06T23:12:18.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.752+0000 7f5c3affd700 1 -- 172.21.15.8:0/382014280 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34010cf0 con 0x7f5c44074ef0 2023-10-06T23:12:18.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.752+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c441a14a0 con 0x7f5c44074ef0 2023-10-06T23:12:18.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.753+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c44107450 con 0x7f5c44074ef0 2023-10-06T23:12:18.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.755+0000 7f5c3affd700 1 -- 172.21.15.8:0/382014280 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5c34011990 con 0x7f5c44074ef0 2023-10-06T23:12:18.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.757+0000 7f5c3affd700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c300a1480 0x7f5c300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:18.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.757+0000 7f5c3affd700 1 -- 172.21.15.8:0/382014280 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c340cc710 con 0x7f5c44074ef0 2023-10-06T23:12:18.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.757+0000 7f5c49d9b700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c300a1480 0x7f5c300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:18.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.757+0000 7f5c49d9b700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c300a1480 0x7f5c300a3940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c40005950 tx=0x7f5c4000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:18.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.761+0000 7f5c3affd700 1 -- 172.21.15.8:0/382014280 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c34095d80 con 0x7f5c44074ef0 2023-10-06T23:12:18.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.971+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c4402d270 con 0x7f5c44074ef0 2023-10-06T23:12:18.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.972+0000 7f5c3affd700 1 -- 172.21.15.8:0/382014280 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c340993a0 con 0x7f5c44074ef0 2023-10-06T23:12:18.973 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:12:18.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c300a1480 msgr2=0x7f5c300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c300a1480 0x7f5c300a3940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c40005950 tx=0x7f5c4000b410 comp rx=0 tx=0).stop 2023-10-06T23:12:18.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44074ef0 msgr2=0x7f5c44199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:18.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44074ef0 0x7f5c44199410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400b500 tx=0x7f5c3400b810 comp rx=0 tx=0).stop 2023-10-06T23:12:18.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 shutdown_connections 2023-10-06T23:12:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c300a1480 0x7f5c300a3940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c44108da0 0x7f5c441a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c44073910 0x7f5c44198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 --2- 172.21.15.8:0/382014280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c44074ef0 0x7f5c44199410 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 >> 172.21.15.8:0/382014280 conn(0x7f5c440fc430 msgr2=0x7f5c440fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 shutdown_connections 2023-10-06T23:12:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:18.974+0000 7f5c4bfff700 1 -- 172.21.15.8:0/382014280 wait complete. 2023-10-06T23:12:18.996 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:12:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 -- 172.21.15.8:0/450743072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102a30 msgr2=0x7f109c109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 --2- 172.21.15.8:0/450743072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102a30 0x7f109c109350 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f109400b0a0 tx=0x7f109400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 -- 172.21.15.8:0/450743072 shutdown_connections 2023-10-06T23:12:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 --2- 172.21.15.8:0/450743072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102a30 0x7f109c109350 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 --2- 172.21.15.8:0/450743072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f109c100e90 0x7f109c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 --2- 172.21.15.8:0/450743072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f109c102070 0x7f109c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 -- 172.21.15.8:0/450743072 >> 172.21.15.8:0/450743072 conn(0x7f109c0fc430 msgr2=0x7f109c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:19.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 -- 172.21.15.8:0/450743072 shutdown_connections 2023-10-06T23:12:19.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.202+0000 7f10a3fff700 1 -- 172.21.15.8:0/450743072 wait complete. 2023-10-06T23:12:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.203+0000 7f10a3fff700 1 Processor -- start 2023-10-06T23:12:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.203+0000 7f10a3fff700 1 -- start start 2023-10-06T23:12:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f109c100e90 0x7f109c196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102070 0x7f109c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a3fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f109c102a30 0x7f109c19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a3fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c19e760 con 0x7f109c102070 2023-10-06T23:12:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a3fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c19e8a0 con 0x7f109c100e90 2023-10-06T23:12:19.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a3fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c19ea30 con 0x7f109c102a30 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a159a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102070 0x7f109c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a159a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102070 0x7f109c197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32982/0 (socket says 172.21.15.8:32982) 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a159a700 1 -- 172.21.15.8:0/3461973694 learned_addr learned my addr 172.21.15.8:0/3461973694 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a259c700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f109c102a30 0x7f109c19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a1d9b700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f109c100e90 0x7f109c196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a159a700 1 -- 172.21.15.8:0/3461973694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f109c102a30 msgr2=0x7f109c19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a159a700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f109c102a30 0x7f109c19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a159a700 1 -- 172.21.15.8:0/3461973694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f109c100e90 msgr2=0x7f109c196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a159a700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f109c100e90 0x7f109c196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a159a700 1 -- 172.21.15.8:0/3461973694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094009d00 con 0x7f109c102070 2023-10-06T23:12:19.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a259c700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f109c102a30 0x7f109c19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.204+0000 7f10a1d9b700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f109c100e90 0x7f109c196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.205+0000 7f10a159a700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102070 0x7f109c197120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f108c00d980 tx=0x7f108c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.205+0000 7f1092ffd700 1 -- 172.21.15.8:0/3461973694 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00de60 con 0x7f109c102070 2023-10-06T23:12:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.205+0000 7f1092ffd700 1 -- 172.21.15.8:0/3461973694 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f108c0044b0 con 0x7f109c102070 2023-10-06T23:12:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.205+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c19ed10 con 0x7f109c102070 2023-10-06T23:12:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.205+0000 7f1092ffd700 1 -- 172.21.15.8:0/3461973694 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c003b40 con 0x7f109c102070 2023-10-06T23:12:19.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.205+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c19f210 con 0x7f109c102070 2023-10-06T23:12:19.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.206+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c107e90 con 0x7f109c102070 2023-10-06T23:12:19.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.208+0000 7f1092ffd700 1 -- 172.21.15.8:0/3461973694 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f108c003ca0 con 0x7f109c102070 2023-10-06T23:12:19.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.211+0000 7f1092ffd700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10880a1500 0x7f10880a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.211+0000 7f1092ffd700 1 -- 172.21.15.8:0/3461973694 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f108c0cc9e0 con 0x7f109c102070 2023-10-06T23:12:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.211+0000 7f10a1d9b700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10880a1500 0x7f10880a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:19.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.212+0000 7f10a1d9b700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10880a1500 0x7f10880a39c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f109c101be0 tx=0x7f1098009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:19.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.215+0000 7f1092ffd700 1 -- 172.21.15.8:0/3461973694 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f108c095ff0 con 0x7f109c102070 2023-10-06T23:12:19.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:19 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2522679032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:19.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:19 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/382014280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:19.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:19 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2522679032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:19.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:19 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/382014280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:19.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.428+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f109c0008d0 con 0x7f109c102070 2023-10-06T23:12:19.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.428+0000 7f1092ffd700 1 -- 172.21.15.8:0/3461973694 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f108c009940 con 0x7f109c102070 2023-10-06T23:12:19.430 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:12:19.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10880a1500 msgr2=0x7f10880a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10880a1500 0x7f10880a39c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f109c101be0 tx=0x7f1098009260 comp rx=0 tx=0).stop 2023-10-06T23:12:19.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102070 msgr2=0x7f109c197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102070 0x7f109c197120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f108c00d980 tx=0x7f108c00dd40 comp rx=0 tx=0).stop 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 shutdown_connections 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10880a1500 0x7f10880a39c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f109c102a30 0x7f109c19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f109c100e90 0x7f109c196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 --2- 172.21.15.8:0/3461973694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f109c102070 0x7f109c197120 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 >> 172.21.15.8:0/3461973694 conn(0x7f109c0fc430 msgr2=0x7f109c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 shutdown_connections 2023-10-06T23:12:19.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.431+0000 7f10a3fff700 1 -- 172.21.15.8:0/3461973694 wait complete. 2023-10-06T23:12:19.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:19 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2522679032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:19.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:19 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/382014280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:19.451 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:12:19.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 -- 172.21.15.8:0/1301849725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c102a30 msgr2=0x7f404c109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 --2- 172.21.15.8:0/1301849725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c102a30 0x7f404c109350 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f404400b0a0 tx=0x7f404400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 -- 172.21.15.8:0/1301849725 shutdown_connections 2023-10-06T23:12:19.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 --2- 172.21.15.8:0/1301849725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c102a30 0x7f404c109350 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 --2- 172.21.15.8:0/1301849725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f404c100e90 0x7f404c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 --2- 172.21.15.8:0/1301849725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c102070 0x7f404c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 -- 172.21.15.8:0/1301849725 >> 172.21.15.8:0/1301849725 conn(0x7f404c0fc430 msgr2=0x7f404c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:19.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 -- 172.21.15.8:0/1301849725 shutdown_connections 2023-10-06T23:12:19.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.655+0000 7f40531ff700 1 -- 172.21.15.8:0/1301849725 wait complete. 2023-10-06T23:12:19.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.656+0000 7f40531ff700 1 Processor -- start 2023-10-06T23:12:19.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.656+0000 7f40531ff700 1 -- start start 2023-10-06T23:12:19.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f40531ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c100e90 0x7f404c196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:19.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f40531ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f404c102070 0x7f404c197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f40531ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c102a30 0x7f404c19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f40531ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c19e760 con 0x7f404c100e90 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f40531ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c19e8d0 con 0x7f404c102a30 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f40531ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c19ea90 con 0x7f404c102070 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f4050f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c100e90 0x7f404c196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f4050f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c100e90 0x7f404c196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36358/0 (socket says 172.21.15.8:36358) 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f4050f9b700 1 -- 172.21.15.8:0/327566593 learned_addr learned my addr 172.21.15.8:0/327566593 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f404bfff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f404c102070 0x7f404c197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f405179c700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c102a30 0x7f404c19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f4050f9b700 1 -- 172.21.15.8:0/327566593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f404c102070 msgr2=0x7f404c197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f4050f9b700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f404c102070 0x7f404c197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f4050f9b700 1 -- 172.21.15.8:0/327566593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c102a30 msgr2=0x7f404c19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f4050f9b700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c102a30 0x7f404c19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f4050f9b700 1 -- 172.21.15.8:0/327566593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044009d00 con 0x7f404c100e90 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.657+0000 7f404bfff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f404c102070 0x7f404c197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.658+0000 7f4050f9b700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c100e90 0x7f404c196c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f404000d980 tx=0x7f404000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.658+0000 7f4049ffb700 1 -- 172.21.15.8:0/327566593 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404000de60 con 0x7f404c100e90 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.658+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c19ed70 con 0x7f404c100e90 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.658+0000 7f4049ffb700 1 -- 172.21.15.8:0/327566593 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40400044b0 con 0x7f404c100e90 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.658+0000 7f4049ffb700 1 -- 172.21.15.8:0/327566593 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040003b40 con 0x7f404c100e90 2023-10-06T23:12:19.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.658+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c19f1d0 con 0x7f404c100e90 2023-10-06T23:12:19.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.659+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c107ec0 con 0x7f404c100e90 2023-10-06T23:12:19.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.661+0000 7f4049ffb700 1 -- 172.21.15.8:0/327566593 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4040003ca0 con 0x7f404c100e90 2023-10-06T23:12:19.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.662+0000 7f4049ffb700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f403c0a1480 0x7f403c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:19.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.662+0000 7f4049ffb700 1 -- 172.21.15.8:0/327566593 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f40400cca40 con 0x7f404c100e90 2023-10-06T23:12:19.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.662+0000 7f404bfff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f403c0a1480 0x7f403c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:19.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.663+0000 7f404bfff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f403c0a1480 0x7f403c0a3940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f404c100bb0 tx=0x7f4038009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:19.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.666+0000 7f4049ffb700 1 -- 172.21.15.8:0/327566593 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4040096050 con 0x7f404c100e90 2023-10-06T23:12:19.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.876+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f404c02d020 con 0x7f404c100e90 2023-10-06T23:12:19.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.877+0000 7f4049ffb700 1 -- 172.21.15.8:0/327566593 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4040009940 con 0x7f404c100e90 2023-10-06T23:12:19.878 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:12:19.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.879+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f403c0a1480 msgr2=0x7f403c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.879+0000 7f40531ff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f403c0a1480 0x7f403c0a3940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f404c100bb0 tx=0x7f4038009260 comp rx=0 tx=0).stop 2023-10-06T23:12:19.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c100e90 msgr2=0x7f404c196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:19.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c100e90 0x7f404c196c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f404000d980 tx=0x7f404000dd40 comp rx=0 tx=0).stop 2023-10-06T23:12:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 shutdown_connections 2023-10-06T23:12:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f403c0a1480 0x7f403c0a3940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f404c100e90 0x7f404c196c20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f404c102a30 0x7f404c19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 --2- 172.21.15.8:0/327566593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f404c102070 0x7f404c197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 >> 172.21.15.8:0/327566593 conn(0x7f404c0fc430 msgr2=0x7f404c0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 shutdown_connections 2023-10-06T23:12:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:19.880+0000 7f40531ff700 1 -- 172.21.15.8:0/327566593 wait complete. 2023-10-06T23:12:19.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:12:20.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.103+0000 7f14349ff700 1 -- 172.21.15.8:0/144301589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 msgr2=0x7f14301012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.103+0000 7f14349ff700 1 --2- 172.21.15.8:0/144301589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 0x7f14301012c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1420009990 tx=0x7f1420009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.103+0000 7f14349ff700 1 -- 172.21.15.8:0/144301589 shutdown_connections 2023-10-06T23:12:20.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.103+0000 7f14349ff700 1 --2- 172.21.15.8:0/144301589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 0x7f14301012c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.103+0000 7f14349ff700 1 --2- 172.21.15.8:0/144301589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1430102a40 0x7f1430109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.103+0000 7f14349ff700 1 --2- 172.21.15.8:0/144301589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1430102080 0x7f1430102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.103+0000 7f14349ff700 1 -- 172.21.15.8:0/144301589 >> 172.21.15.8:0/144301589 conn(0x7f14300fc420 msgr2=0x7f14300fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:20.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.104+0000 7f14349ff700 1 -- 172.21.15.8:0/144301589 shutdown_connections 2023-10-06T23:12:20.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.104+0000 7f14349ff700 1 -- 172.21.15.8:0/144301589 wait complete. 2023-10-06T23:12:20.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f14349ff700 1 Processor -- start 2023-10-06T23:12:20.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f14349ff700 1 -- start start 2023-10-06T23:12:20.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f14349ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 0x7f1430198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:20.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f14349ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1430102080 0x7f1430199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:20.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f14349ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1430102a40 0x7f14301a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:20.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f14349ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14301a0830 con 0x7f1430100ea0 2023-10-06T23:12:20.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f14349ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14301a09a0 con 0x7f1430102a40 2023-10-06T23:12:20.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f14349ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14301a0b60 con 0x7f1430102080 2023-10-06T23:12:20.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f142659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 0x7f1430198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:20.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f142659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 0x7f1430198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36370/0 (socket says 172.21.15.8:36370) 2023-10-06T23:12:20.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.105+0000 7f142659c700 1 -- 172.21.15.8:0/200890754 learned_addr learned my addr 172.21.15.8:0/200890754 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:20.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142e59c700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1430102080 0x7f1430199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:20.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142659c700 1 -- 172.21.15.8:0/200890754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1430102080 msgr2=0x7f1430199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142ed9d700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1430102a40 0x7f14301a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:20.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142659c700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1430102080 0x7f1430199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142659c700 1 -- 172.21.15.8:0/200890754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1430102a40 msgr2=0x7f14301a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142659c700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1430102a40 0x7f14301a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142659c700 1 -- 172.21.15.8:0/200890754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200095f0 con 0x7f1430100ea0 2023-10-06T23:12:20.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142ed9d700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1430102a40 0x7f14301a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:20.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f142659c700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 0x7f1430198cf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14200095c0 tx=0x7f1420005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:20.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f1427fff700 1 -- 172.21.15.8:0/200890754 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142001d070 con 0x7f1430100ea0 2023-10-06T23:12:20.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f1427fff700 1 -- 172.21.15.8:0/200890754 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1420004080 con 0x7f1430100ea0 2023-10-06T23:12:20.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14301a0de0 con 0x7f1430100ea0 2023-10-06T23:12:20.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f1427fff700 1 -- 172.21.15.8:0/200890754 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420022cb0 con 0x7f1430100ea0 2023-10-06T23:12:20.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.106+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14301a11b0 con 0x7f1430100ea0 2023-10-06T23:12:20.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.107+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143010c610 con 0x7f1430100ea0 2023-10-06T23:12:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.109+0000 7f1427fff700 1 -- 172.21.15.8:0/200890754 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1420003bf0 con 0x7f1430100ea0 2023-10-06T23:12:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.111+0000 7f1427fff700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f141c0a1550 0x7f141c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.111+0000 7f1427fff700 1 -- 172.21.15.8:0/200890754 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f14200ce350 con 0x7f1430100ea0 2023-10-06T23:12:20.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.111+0000 7f142e59c700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f141c0a1550 0x7f141c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:20.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.111+0000 7f142e59c700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f141c0a1550 0x7f141c0a3a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1430100bc0 tx=0x7f141800b5b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:20.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.115+0000 7f1427fff700 1 -- 172.21.15.8:0/200890754 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1420097a50 con 0x7f1430100ea0 2023-10-06T23:12:20.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:20 smithi156 ceph-mon[102862]: pgmap v333: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:20.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:20 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3461973694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:20.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:20 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/327566593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:20.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.370+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14301a13a0 con 0x7f1430100ea0 2023-10-06T23:12:20.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.371+0000 7f1427fff700 1 -- 172.21.15.8:0/200890754 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f14200041f0 con 0x7f1430100ea0 2023-10-06T23:12:20.372 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:20.372 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:11:23.244586+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:12:20.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f141c0a1550 msgr2=0x7f141c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f141c0a1550 0x7f141c0a3a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1430100bc0 tx=0x7f141800b5b0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 msgr2=0x7f1430198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 0x7f1430198cf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14200095c0 tx=0x7f1420005ef0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 shutdown_connections 2023-10-06T23:12:20.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f141c0a1550 0x7f141c0a3a10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1430100ea0 0x7f1430198cf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1430102a40 0x7f14301a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 --2- 172.21.15.8:0/200890754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1430102080 0x7f1430199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.373+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 >> 172.21.15.8:0/200890754 conn(0x7f14300fc420 msgr2=0x7f14300fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:20.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.374+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 shutdown_connections 2023-10-06T23:12:20.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.374+0000 7f14349ff700 1 -- 172.21.15.8:0/200890754 wait complete. 2023-10-06T23:12:20.377 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:12:20.391 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:20 smithi008 ceph-mon[98532]: pgmap v333: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:20.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:20 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3461973694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:20.392 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:20 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/327566593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:20.394 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:12:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:20 smithi190 ceph-mon[102658]: pgmap v333: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:20.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:20 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3461973694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:20.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:20 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/327566593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.595+0000 7f45063ff700 1 -- 172.21.15.8:0/999112602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500100ea0 msgr2=0x7f45001012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.595+0000 7f45063ff700 1 --2- 172.21.15.8:0/999112602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500100ea0 0x7f45001012c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009990 tx=0x7f44f0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.595+0000 7f45063ff700 1 -- 172.21.15.8:0/999112602 shutdown_connections 2023-10-06T23:12:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.595+0000 7f45063ff700 1 --2- 172.21.15.8:0/999112602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500100ea0 0x7f45001012c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.595+0000 7f45063ff700 1 --2- 172.21.15.8:0/999112602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4500102a40 0x7f4500109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.595+0000 7f45063ff700 1 --2- 172.21.15.8:0/999112602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4500102080 0x7f4500102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.595+0000 7f45063ff700 1 -- 172.21.15.8:0/999112602 >> 172.21.15.8:0/999112602 conn(0x7f45000fc420 msgr2=0x7f45000fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:20.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.595+0000 7f45063ff700 1 -- 172.21.15.8:0/999112602 shutdown_connections 2023-10-06T23:12:20.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.596+0000 7f45063ff700 1 -- 172.21.15.8:0/999112602 wait complete. 2023-10-06T23:12:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.596+0000 7f45063ff700 1 Processor -- start 2023-10-06T23:12:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f45063ff700 1 -- start start 2023-10-06T23:12:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f45063ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4500100ea0 0x7f4500196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f45063ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4500102080 0x7f45001970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f45063ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500102a40 0x7f450019e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f45063ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450019e6f0 con 0x7f4500102a40 2023-10-06T23:12:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f45063ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450019e830 con 0x7f4500102080 2023-10-06T23:12:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f45063ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450019e9c0 con 0x7f4500100ea0 2023-10-06T23:12:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f450499c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500102a40 0x7f450019e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f450499c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500102a40 0x7f450019e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36390/0 (socket says 172.21.15.8:36390) 2023-10-06T23:12:20.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f450499c700 1 -- 172.21.15.8:0/799900755 learned_addr learned my addr 172.21.15.8:0/799900755 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:20.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f44fffff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4500100ea0 0x7f4500196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:20.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f450499c700 1 -- 172.21.15.8:0/799900755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4500100ea0 msgr2=0x7f4500196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f450499c700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4500100ea0 0x7f4500196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f450499c700 1 -- 172.21.15.8:0/799900755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4500102080 msgr2=0x7f45001970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.597+0000 7f450499c700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4500102080 0x7f45001970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.598+0000 7f450499c700 1 -- 172.21.15.8:0/799900755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00095f0 con 0x7f4500102a40 2023-10-06T23:12:20.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.598+0000 7f450499c700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500102a40 0x7f450019e120 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44f8007ee0 tx=0x7f44f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:20.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.598+0000 7f44fd7fa700 1 -- 172.21.15.8:0/799900755 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8017070 con 0x7f4500102a40 2023-10-06T23:12:20.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.598+0000 7f44fd7fa700 1 -- 172.21.15.8:0/799900755 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44f800f040 con 0x7f4500102a40 2023-10-06T23:12:20.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.598+0000 7f44fd7fa700 1 -- 172.21.15.8:0/799900755 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8005710 con 0x7f4500102a40 2023-10-06T23:12:20.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.598+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450019eca0 con 0x7f4500102a40 2023-10-06T23:12:20.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.598+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450019f160 con 0x7f4500102a40 2023-10-06T23:12:20.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.599+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450010c5c0 con 0x7f4500102a40 2023-10-06T23:12:20.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.601+0000 7f44fd7fa700 1 -- 172.21.15.8:0/799900755 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f44f8005870 con 0x7f4500102a40 2023-10-06T23:12:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.602+0000 7f44fd7fa700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44e80a1550 0x7f44e80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.602+0000 7f44fd7fa700 1 -- 172.21.15.8:0/799900755 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f44f80cc520 con 0x7f4500102a40 2023-10-06T23:12:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.603+0000 7f44fffff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44e80a1550 0x7f44e80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:20.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.603+0000 7f44fffff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44e80a1550 0x7f44e80a3a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f44f000b5c0 tx=0x7f44f0005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:20.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.606+0000 7f44fd7fa700 1 -- 172.21.15.8:0/799900755 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f44f8095b30 con 0x7f4500102a40 2023-10-06T23:12:20.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.821+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f450010c800 con 0x7f4500102a40 2023-10-06T23:12:20.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.823+0000 7f44fd7fa700 1 -- 172.21.15.8:0/799900755 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7f44f8099150 con 0x7f4500102a40 2023-10-06T23:12:20.824 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:20.824 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:12:20.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44e80a1550 msgr2=0x7f44e80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44e80a1550 0x7f44e80a3a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f44f000b5c0 tx=0x7f44f0005fb0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500102a40 msgr2=0x7f450019e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500102a40 0x7f450019e120 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44f8007ee0 tx=0x7f44f800d3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 shutdown_connections 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f44e80a1550 0x7f44e80a3a10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4500102a40 0x7f450019e120 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4500100ea0 0x7f4500196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 --2- 172.21.15.8:0/799900755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4500102080 0x7f45001970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 >> 172.21.15.8:0/799900755 conn(0x7f45000fc420 msgr2=0x7f45000fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 shutdown_connections 2023-10-06T23:12:20.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:20.825+0000 7f45063ff700 1 -- 172.21.15.8:0/799900755 wait complete. 2023-10-06T23:12:20.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:12:20.846 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:12:21.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 -- 172.21.15.8:0/3631102388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40102070 msgr2=0x7f5c401024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 --2- 172.21.15.8:0/3631102388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40102070 0x7f5c401024f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009990 tx=0x7f5c30009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 -- 172.21.15.8:0/3631102388 shutdown_connections 2023-10-06T23:12:21.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 --2- 172.21.15.8:0/3631102388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c40102a30 0x7f5c40109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 --2- 172.21.15.8:0/3631102388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c40100e90 0x7f5c401012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 --2- 172.21.15.8:0/3631102388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40102070 0x7f5c401024f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 -- 172.21.15.8:0/3631102388 >> 172.21.15.8:0/3631102388 conn(0x7f5c400fc430 msgr2=0x7f5c400fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:21.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 -- 172.21.15.8:0/3631102388 shutdown_connections 2023-10-06T23:12:21.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.054+0000 7f5c473ff700 1 -- 172.21.15.8:0/3631102388 wait complete. 2023-10-06T23:12:21.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.055+0000 7f5c473ff700 1 Processor -- start 2023-10-06T23:12:21.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.055+0000 7f5c473ff700 1 -- start start 2023-10-06T23:12:21.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.055+0000 7f5c473ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40100e90 0x7f5c40198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c473ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c40102070 0x7f5c401991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c473ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c40102a30 0x7f5c401a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c473ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401a07e0 con 0x7f5c40100e90 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c473ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401a0950 con 0x7f5c40102a30 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c473ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401a0b10 con 0x7f5c40102070 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40100e90 0x7f5c40198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40100e90 0x7f5c40198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36406/0 (socket says 172.21.15.8:36406) 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 -- 172.21.15.8:0/1017509376 learned_addr learned my addr 172.21.15.8:0/1017509376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4499a700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c40102070 0x7f5c401991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4599c700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c40102a30 0x7f5c401a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 -- 172.21.15.8:0/1017509376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c40102070 msgr2=0x7f5c401991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c40102070 0x7f5c401991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 -- 172.21.15.8:0/1017509376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c40102a30 msgr2=0x7f5c401a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c40102a30 0x7f5c401a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 -- 172.21.15.8:0/1017509376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300095f0 con 0x7f5c40100e90 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4599c700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c40102a30 0x7f5c401a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.056+0000 7f5c4519b700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40100e90 0x7f5c40198c70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c990 tx=0x7f5c3c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.057+0000 7f5c367fc700 1 -- 172.21.15.8:0/1017509376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c007b00 con 0x7f5c40100e90 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.057+0000 7f5c367fc700 1 -- 172.21.15.8:0/1017509376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c3c007c60 con 0x7f5c40100e90 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.057+0000 7f5c367fc700 1 -- 172.21.15.8:0/1017509376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c018660 con 0x7f5c40100e90 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.057+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c401a0df0 con 0x7f5c40100e90 2023-10-06T23:12:21.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.057+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c401a1160 con 0x7f5c40100e90 2023-10-06T23:12:21.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.058+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4010c790 con 0x7f5c40100e90 2023-10-06T23:12:21.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.062+0000 7f5c367fc700 1 -- 172.21.15.8:0/1017509376 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5c3c00f450 con 0x7f5c40100e90 2023-10-06T23:12:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.063+0000 7f5c367fc700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c2c0a1500 0x7f5c2c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.063+0000 7f5c367fc700 1 -- 172.21.15.8:0/1017509376 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c3c0cccc0 con 0x7f5c40100e90 2023-10-06T23:12:21.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.063+0000 7f5c4499a700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c2c0a1500 0x7f5c2c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.064+0000 7f5c4499a700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c2c0a1500 0x7f5c2c0a39c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000b5c0 tx=0x7f5c30005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:21.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.065+0000 7f5c367fc700 1 -- 172.21.15.8:0/1017509376 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c3c0963e0 con 0x7f5c40100e90 2023-10-06T23:12:21.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:21 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/200890754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:21.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:21 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/799900755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:21.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.279+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c401a1410 con 0x7f5c40100e90 2023-10-06T23:12:21.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.280+0000 7f5c367fc700 1 -- 172.21.15.8:0/1017509376 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c3c00fe60 con 0x7f5c40100e90 2023-10-06T23:12:21.281 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:12:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c2c0a1500 msgr2=0x7f5c2c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c2c0a1500 0x7f5c2c0a39c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000b5c0 tx=0x7f5c30005fb0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40100e90 msgr2=0x7f5c40198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40100e90 0x7f5c40198c70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c990 tx=0x7f5c3c00cca0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 shutdown_connections 2023-10-06T23:12:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c2c0a1500 0x7f5c2c0a39c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c40100e90 0x7f5c40198c70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c40102a30 0x7f5c401a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 --2- 172.21.15.8:0/1017509376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c40102070 0x7f5c401991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.282+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 >> 172.21.15.8:0/1017509376 conn(0x7f5c400fc430 msgr2=0x7f5c400fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:21.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.283+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 shutdown_connections 2023-10-06T23:12:21.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.283+0000 7f5c473ff700 1 -- 172.21.15.8:0/1017509376 wait complete. 2023-10-06T23:12:21.303 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:12:21.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:21 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/200890754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:21.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:21 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/799900755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:21.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:21 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/200890754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:21.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:21 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/799900755' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:21.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 -- 172.21.15.8:0/1144556123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394100e90 msgr2=0x7ff3941012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1144556123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394100e90 0x7ff3941012b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff390009990 tx=0x7ff390009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 -- 172.21.15.8:0/1144556123 shutdown_connections 2023-10-06T23:12:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1144556123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394100e90 0x7ff3941012b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1144556123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff394102a30 0x7ff394109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1144556123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff394102070 0x7ff3941024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 -- 172.21.15.8:0/1144556123 >> 172.21.15.8:0/1144556123 conn(0x7ff3940fc430 msgr2=0x7ff3940fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 -- 172.21.15.8:0/1144556123 shutdown_connections 2023-10-06T23:12:21.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.509+0000 7ff39bbff700 1 -- 172.21.15.8:0/1144556123 wait complete. 2023-10-06T23:12:21.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.511+0000 7ff39bbff700 1 Processor -- start 2023-10-06T23:12:21.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.511+0000 7ff39bbff700 1 -- start start 2023-10-06T23:12:21.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.511+0000 7ff39bbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff394100e90 0x7ff394074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.511+0000 7ff39bbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102070 0x7ff3940732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.511+0000 7ff39bbff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff394102a30 0x7ff3940737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.511+0000 7ff39bbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394073f80 con 0x7ff394102070 2023-10-06T23:12:21.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.511+0000 7ff39bbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940740f0 con 0x7ff394100e90 2023-10-06T23:12:21.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.511+0000 7ff39bbff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3941a0c10 con 0x7ff394102a30 2023-10-06T23:12:21.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102070 0x7ff3940732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102070 0x7ff3940732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36430/0 (socket says 172.21.15.8:36430) 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 -- 172.21.15.8:0/1242324534 learned_addr learned my addr 172.21.15.8:0/1242324534 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39a19c700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff394102a30 0x7ff3940737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39999b700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff394100e90 0x7ff394074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 -- 172.21.15.8:0/1242324534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff394102a30 msgr2=0x7ff3940737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff394102a30 0x7ff3940737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 -- 172.21.15.8:0/1242324534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff394100e90 msgr2=0x7ff394074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff394100e90 0x7ff394074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 -- 172.21.15.8:0/1242324534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900095f0 con 0x7ff394102070 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff39919a700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102070 0x7ff3940732a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff38400d980 tx=0x7ff38400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:21.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.512+0000 7ff38affd700 1 -- 172.21.15.8:0/1242324534 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400bb60 con 0x7ff394102070 2023-10-06T23:12:21.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.513+0000 7ff38affd700 1 -- 172.21.15.8:0/1242324534 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff384007620 con 0x7ff394102070 2023-10-06T23:12:21.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.513+0000 7ff38affd700 1 -- 172.21.15.8:0/1242324534 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400f3c0 con 0x7ff394102070 2023-10-06T23:12:21.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.513+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3941a0ef0 con 0x7ff394102070 2023-10-06T23:12:21.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.513+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3941a1370 con 0x7ff394102070 2023-10-06T23:12:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.514+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff394108630 con 0x7ff394102070 2023-10-06T23:12:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.516+0000 7ff38affd700 1 -- 172.21.15.8:0/1242324534 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff384010460 con 0x7ff394102070 2023-10-06T23:12:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.517+0000 7ff38affd700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff3800a1500 0x7ff3800a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.517+0000 7ff38affd700 1 -- 172.21.15.8:0/1242324534 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff3840ccfd0 con 0x7ff394102070 2023-10-06T23:12:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.517+0000 7ff39999b700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff3800a1500 0x7ff3800a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.518+0000 7ff39999b700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff3800a1500 0x7ff3800a39c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff39000b5c0 tx=0x7ff390005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:21.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.521+0000 7ff38affd700 1 -- 172.21.15.8:0/1242324534 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff3840965e0 con 0x7ff394102070 2023-10-06T23:12:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.737+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff39402d270 con 0x7ff394102070 2023-10-06T23:12:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.737+0000 7ff38affd700 1 -- 172.21.15.8:0/1242324534 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff384016020 con 0x7ff394102070 2023-10-06T23:12:21.739 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:12:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff3800a1500 msgr2=0x7ff3800a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff3800a1500 0x7ff3800a39c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff39000b5c0 tx=0x7ff390005fb0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102070 msgr2=0x7ff3940732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102070 0x7ff3940732a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff38400d980 tx=0x7ff38400dd40 comp rx=0 tx=0).stop 2023-10-06T23:12:21.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 shutdown_connections 2023-10-06T23:12:21.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff3800a1500 0x7ff3800a39c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff394102a30 0x7ff3940737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff394100e90 0x7ff394074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 --2- 172.21.15.8:0/1242324534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff394102070 0x7ff3940732a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 >> 172.21.15.8:0/1242324534 conn(0x7ff3940fc430 msgr2=0x7ff394105770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 shutdown_connections 2023-10-06T23:12:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.740+0000 7ff39bbff700 1 -- 172.21.15.8:0/1242324534 wait complete. 2023-10-06T23:12:21.761 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 -- 172.21.15.8:0/2152735153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734074ef0 msgr2=0x7f5734073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 --2- 172.21.15.8:0/2152735153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734074ef0 0x7f5734073340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5728009990 tx=0x7f5728009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 -- 172.21.15.8:0/2152735153 shutdown_connections 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 --2- 172.21.15.8:0/2152735153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734074ef0 0x7f5734073340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 --2- 172.21.15.8:0/2152735153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5734108da0 0x7f573410b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 --2- 172.21.15.8:0/2152735153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5734073910 0x7f5734073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 -- 172.21.15.8:0/2152735153 >> 172.21.15.8:0/2152735153 conn(0x7f57340fc430 msgr2=0x7f57340fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 -- 172.21.15.8:0/2152735153 shutdown_connections 2023-10-06T23:12:21.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.978+0000 7f573abff700 1 -- 172.21.15.8:0/2152735153 wait complete. 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.979+0000 7f573abff700 1 Processor -- start 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.979+0000 7f573abff700 1 -- start start 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.979+0000 7f573abff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734073910 0x7f5734198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573abff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5734074ef0 0x7f5734199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573abff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5734108da0 0x7f57341a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573abff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57341a08c0 con 0x7f5734073910 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573abff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57341a0a00 con 0x7f5734074ef0 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573abff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57341a0b90 con 0x7f5734108da0 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734073910 0x7f5734198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734073910 0x7f5734198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36452/0 (socket says 172.21.15.8:36452) 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 -- 172.21.15.8:0/2463743581 learned_addr learned my addr 172.21.15.8:0/2463743581 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f5733fff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5734074ef0 0x7f5734199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573919c700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5734108da0 0x7f57341a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 -- 172.21.15.8:0/2463743581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5734108da0 msgr2=0x7f57341a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5734108da0 0x7f57341a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 -- 172.21.15.8:0/2463743581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5734074ef0 msgr2=0x7f5734199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5734074ef0 0x7f5734199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 -- 172.21.15.8:0/2463743581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280095f0 con 0x7f5734073910 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.980+0000 7f573899b700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734073910 0x7f5734198d40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5728000c00 tx=0x7f5728003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.981+0000 7f5731ffb700 1 -- 172.21.15.8:0/2463743581 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572801d070 con 0x7f5734073910 2023-10-06T23:12:21.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.981+0000 7f5731ffb700 1 -- 172.21.15.8:0/2463743581 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f572800bd70 con 0x7f5734073910 2023-10-06T23:12:21.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.981+0000 7f5731ffb700 1 -- 172.21.15.8:0/2463743581 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728022c20 con 0x7f5734073910 2023-10-06T23:12:21.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.981+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57341a0e10 con 0x7f5734073910 2023-10-06T23:12:21.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.981+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57341a1180 con 0x7f5734073910 2023-10-06T23:12:21.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.982+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5734107450 con 0x7f5734073910 2023-10-06T23:12:21.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.984+0000 7f5731ffb700 1 -- 172.21.15.8:0/2463743581 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5728003e90 con 0x7f5734073910 2023-10-06T23:12:21.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.985+0000 7f5731ffb700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57240a1480 0x7f57240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:21.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.985+0000 7f5731ffb700 1 -- 172.21.15.8:0/2463743581 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57280ce330 con 0x7f5734073910 2023-10-06T23:12:21.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.985+0000 7f5733fff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57240a1480 0x7f57240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:21.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.986+0000 7f5733fff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57240a1480 0x7f57240a3940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5734074c10 tx=0x7f572000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:21.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:21.989+0000 7f5731ffb700 1 -- 172.21.15.8:0/2463743581 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5728097a30 con 0x7f5734073910 2023-10-06T23:12:22.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.210+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f573410e7d0 con 0x7f5734073910 2023-10-06T23:12:22.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.211+0000 7f5731ffb700 1 -- 172.21.15.8:0/2463743581 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f572809b050 con 0x7f5734073910 2023-10-06T23:12:22.212 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57240a1480 msgr2=0x7f57240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57240a1480 0x7f57240a3940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5734074c10 tx=0x7f572000b410 comp rx=0 tx=0).stop 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734073910 msgr2=0x7f5734198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734073910 0x7f5734198d40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5728000c00 tx=0x7f5728003a50 comp rx=0 tx=0).stop 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 shutdown_connections 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57240a1480 0x7f57240a3940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5734073910 0x7f5734198d40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5734108da0 0x7f57341a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 --2- 172.21.15.8:0/2463743581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5734074ef0 0x7f5734199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.213+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 >> 172.21.15.8:0/2463743581 conn(0x7f57340fc430 msgr2=0x7f57340fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.214+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 shutdown_connections 2023-10-06T23:12:22.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.214+0000 7f573abff700 1 -- 172.21.15.8:0/2463743581 wait complete. 2023-10-06T23:12:22.235 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:12:22.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:22 smithi008 ceph-mon[98532]: pgmap v334: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:22.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:22 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1017509376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:22.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:22 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:12:22.312 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:22 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1242324534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:22 smithi156 ceph-mon[102862]: pgmap v334: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:22 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1017509376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:22.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:22 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:12:22.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:22 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1242324534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:22.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:22 smithi190 ceph-mon[102658]: pgmap v334: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:22 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1017509376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:22 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:12:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:22 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1242324534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.457+0000 7f15c2fff700 1 -- 172.21.15.8:0/854837414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 msgr2=0x7f15bc102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.457+0000 7f15c2fff700 1 --2- 172.21.15.8:0/854837414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 0x7f15bc102500 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009990 tx=0x7f15a8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.457+0000 7f15c2fff700 1 -- 172.21.15.8:0/854837414 shutdown_connections 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.457+0000 7f15c2fff700 1 --2- 172.21.15.8:0/854837414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15bc102a40 0x7f15bc109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.457+0000 7f15c2fff700 1 --2- 172.21.15.8:0/854837414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc100ea0 0x7f15bc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.457+0000 7f15c2fff700 1 --2- 172.21.15.8:0/854837414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 0x7f15bc102500 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.457+0000 7f15c2fff700 1 -- 172.21.15.8:0/854837414 >> 172.21.15.8:0/854837414 conn(0x7f15bc0fc420 msgr2=0x7f15bc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.458+0000 7f15c2fff700 1 -- 172.21.15.8:0/854837414 shutdown_connections 2023-10-06T23:12:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.458+0000 7f15c2fff700 1 -- 172.21.15.8:0/854837414 wait complete. 2023-10-06T23:12:22.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c2fff700 1 Processor -- start 2023-10-06T23:12:22.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c2fff700 1 -- start start 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c2fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc100ea0 0x7f15bc074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c2fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 0x7f15bc0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c2fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15bc102a40 0x7f15bc0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c2fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc073f80 con 0x7f15bc102a40 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c2fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0740f0 con 0x7f15bc100ea0 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c2fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1a0ba0 con 0x7f15bc102080 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 0x7f15bc0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c159c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15bc102a40 0x7f15bc0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c0d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc100ea0 0x7f15bc074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c0d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc100ea0 0x7f15bc074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33910/0 (socket says 172.21.15.8:33910) 2023-10-06T23:12:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 0x7f15bc0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40466/0 (socket says 172.21.15.8:40466) 2023-10-06T23:12:22.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.459+0000 7f15c0d9b700 1 -- 172.21.15.8:0/3928587496 learned_addr learned my addr 172.21.15.8:0/3928587496 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15bbfff700 1 -- 172.21.15.8:0/3928587496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc100ea0 msgr2=0x7f15bc074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15bbfff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc100ea0 0x7f15bc074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15bbfff700 1 -- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15bc102a40 msgr2=0x7f15bc0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15bbfff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15bc102a40 0x7f15bc0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15bbfff700 1 -- 172.21.15.8:0/3928587496 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009c40 con 0x7f15bc102080 2023-10-06T23:12:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15c0d9b700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc100ea0 0x7f15bc074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15bbfff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 0x7f15bc0732a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15a8000c00 tx=0x7f15a8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15b9ffb700 1 -- 172.21.15.8:0/3928587496 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a801d070 con 0x7f15bc102080 2023-10-06T23:12:22.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a80095f0 con 0x7f15bc102080 2023-10-06T23:12:22.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15b9ffb700 1 -- 172.21.15.8:0/3928587496 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15a800be30 con 0x7f15bc102080 2023-10-06T23:12:22.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.460+0000 7f15b9ffb700 1 -- 172.21.15.8:0/3928587496 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8022d30 con 0x7f15bc102080 2023-10-06T23:12:22.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.461+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc1a1110 con 0x7f15bc102080 2023-10-06T23:12:22.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.462+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc108570 con 0x7f15bc102080 2023-10-06T23:12:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.464+0000 7f15b9ffb700 1 -- 172.21.15.8:0/3928587496 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f15a8022500 con 0x7f15bc102080 2023-10-06T23:12:22.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.465+0000 7f15b9ffb700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f15ac0a14d0 0x7f15ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:22.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.465+0000 7f15b9ffb700 1 -- 172.21.15.8:0/3928587496 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f15a80ce970 con 0x7f15bc102080 2023-10-06T23:12:22.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.465+0000 7f15c0d9b700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f15ac0a14d0 0x7f15ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:22.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.466+0000 7f15c0d9b700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f15ac0a14d0 0x7f15ac0a3990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f15b0005950 tx=0x7f15b0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:22.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.467+0000 7f15b9ffb700 1 -- 172.21.15.8:0/3928587496 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f15a8098010 con 0x7f15bc102080 2023-10-06T23:12:22.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.762+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15bc02d240 con 0x7f15bc102080 2023-10-06T23:12:22.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.763+0000 7f15b9ffb700 1 -- 172.21.15.8:0/3928587496 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f15a809b630 con 0x7f15bc102080 2023-10-06T23:12:22.765 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:22.765 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:11:23.244586+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f15ac0a14d0 msgr2=0x7f15ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f15ac0a14d0 0x7f15ac0a3990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f15b0005950 tx=0x7f15b0009260 comp rx=0 tx=0).stop 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 msgr2=0x7f15bc0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 0x7f15bc0732a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15a8000c00 tx=0x7f15a8005740 comp rx=0 tx=0).stop 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 shutdown_connections 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f15ac0a14d0 0x7f15ac0a3990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15bc102a40 0x7f15bc0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15bc100ea0 0x7f15bc074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 --2- 172.21.15.8:0/3928587496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15bc102080 0x7f15bc0732a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 >> 172.21.15.8:0/3928587496 conn(0x7f15bc0fc420 msgr2=0x7f15bc1056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:22.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.766+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 shutdown_connections 2023-10-06T23:12:22.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.767+0000 7f15c2fff700 1 -- 172.21.15.8:0/3928587496 wait complete. 2023-10-06T23:12:22.769 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:12:22.786 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:12:22.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 -- 172.21.15.8:0/1310896161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc108db0 msgr2=0x7f7bfc10b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:22.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 --2- 172.21.15.8:0/1310896161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc108db0 0x7f7bfc10b240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400b0a0 tx=0x7f7bf400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:22.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 -- 172.21.15.8:0/1310896161 shutdown_connections 2023-10-06T23:12:22.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 --2- 172.21.15.8:0/1310896161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bfc074ef0 0x7f7bfc073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 --2- 172.21.15.8:0/1310896161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc108db0 0x7f7bfc10b240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 --2- 172.21.15.8:0/1310896161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bfc073910 0x7f7bfc073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 -- 172.21.15.8:0/1310896161 >> 172.21.15.8:0/1310896161 conn(0x7f7bfc0fc420 msgr2=0x7f7bfc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 -- 172.21.15.8:0/1310896161 shutdown_connections 2023-10-06T23:12:23.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.997+0000 7f7c019ff700 1 -- 172.21.15.8:0/1310896161 wait complete. 2023-10-06T23:12:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.998+0000 7f7c019ff700 1 Processor -- start 2023-10-06T23:12:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.998+0000 7f7c019ff700 1 -- start start 2023-10-06T23:12:23.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7c019ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bfc073910 0x7f7bfc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7c019ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc074ef0 0x7f7bfc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7c019ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bfc108db0 0x7f7bfc1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7c019ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc1a08d0 con 0x7f7bfc108db0 2023-10-06T23:12:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7c019ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc1a0a10 con 0x7f7bfc074ef0 2023-10-06T23:12:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7c019ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc1a0ba0 con 0x7f7bfc073910 2023-10-06T23:12:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfaffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bfc073910 0x7f7bfc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:23.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfa7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc074ef0 0x7f7bfc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bfc108db0 0x7f7bfc1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfa7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc074ef0 0x7f7bfc199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33928/0 (socket says 172.21.15.8:33928) 2023-10-06T23:12:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfaffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bfc073910 0x7f7bfc198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40482/0 (socket says 172.21.15.8:40482) 2023-10-06T23:12:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfa7fc700 1 -- 172.21.15.8:0/3260229450 learned_addr learned my addr 172.21.15.8:0/3260229450 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfa7fc700 1 -- 172.21.15.8:0/3260229450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bfc073910 msgr2=0x7f7bfc198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfa7fc700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bfc073910 0x7f7bfc198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfa7fc700 1 -- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bfc108db0 msgr2=0x7f7bfc1a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfa7fc700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bfc108db0 0x7f7bfc1a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfa7fc700 1 -- 172.21.15.8:0/3260229450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4009d00 con 0x7f7bfc074ef0 2023-10-06T23:12:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:22.999+0000 7f7bfb7fe700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bfc108db0 0x7f7bfc1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.000+0000 7f7bfa7fc700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc074ef0 0x7f7bfc199290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000e970 tx=0x7f7bf000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.000+0000 7f7c009fd700 1 -- 172.21.15.8:0/3260229450 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0009790 con 0x7f7bfc074ef0 2023-10-06T23:12:23.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.000+0000 7f7c009fd700 1 -- 172.21.15.8:0/3260229450 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bf000c7e0 con 0x7f7bfc074ef0 2023-10-06T23:12:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.000+0000 7f7c009fd700 1 -- 172.21.15.8:0/3260229450 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0003bd0 con 0x7f7bfc074ef0 2023-10-06T23:12:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.000+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bfc1a0e80 con 0x7f7bfc074ef0 2023-10-06T23:12:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.000+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc1a12b0 con 0x7f7bfc074ef0 2023-10-06T23:12:23.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.001+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bfc107460 con 0x7f7bfc074ef0 2023-10-06T23:12:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.003+0000 7f7c009fd700 1 -- 172.21.15.8:0/3260229450 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7bf000c950 con 0x7f7bfc074ef0 2023-10-06T23:12:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.004+0000 7f7c009fd700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7be40a14d0 0x7f7be40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.004+0000 7f7c009fd700 1 -- 172.21.15.8:0/3260229450 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7bf0014070 con 0x7f7bfc074ef0 2023-10-06T23:12:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.005+0000 7f7bfaffd700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7be40a14d0 0x7f7be40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:23.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.005+0000 7f7bfaffd700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7be40a14d0 0x7f7be40a3990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009c60 tx=0x7f7bec009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:23.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.008+0000 7f7c009fd700 1 -- 172.21.15.8:0/3260229450 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7bf0096500 con 0x7f7bfc074ef0 2023-10-06T23:12:23.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.240+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bfc10e7e0 con 0x7f7bfc074ef0 2023-10-06T23:12:23.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.242+0000 7f7c009fd700 1 -- 172.21.15.8:0/3260229450 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7f7bf0099b20 con 0x7f7bfc074ef0 2023-10-06T23:12:23.243 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:23.243 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:12:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7be40a14d0 msgr2=0x7f7be40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7be40a14d0 0x7f7be40a3990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009c60 tx=0x7f7bec009260 comp rx=0 tx=0).stop 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc074ef0 msgr2=0x7f7bfc199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc074ef0 0x7f7bfc199290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000e970 tx=0x7f7bf000ec80 comp rx=0 tx=0).stop 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 shutdown_connections 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7be40a14d0 0x7f7be40a3990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7bfc108db0 0x7f7bfc1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bfc073910 0x7f7bfc198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 --2- 172.21.15.8:0/3260229450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bfc074ef0 0x7f7bfc199290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 >> 172.21.15.8:0/3260229450 conn(0x7f7bfc0fc420 msgr2=0x7f7bfc0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 shutdown_connections 2023-10-06T23:12:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.244+0000 7f7c019ff700 1 -- 172.21.15.8:0/3260229450 wait complete. 2023-10-06T23:12:23.266 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:12:23.332 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:23 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2463743581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:23.332 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:23 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3928587496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:23.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:23 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2463743581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:23 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3928587496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:23.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:23 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2463743581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:23.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:23 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3928587496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:23.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.483+0000 7fda1dbff700 1 -- 172.21.15.8:0/2553215345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18101940 msgr2=0x7fda18103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.483+0000 7fda1dbff700 1 --2- 172.21.15.8:0/2553215345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18101940 0x7fda18103d30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fda08009990 tx=0x7fda08009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.483+0000 7fda1dbff700 1 -- 172.21.15.8:0/2553215345 shutdown_connections 2023-10-06T23:12:23.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.483+0000 7fda1dbff700 1 --2- 172.21.15.8:0/2553215345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18101940 0x7fda18103d30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.483+0000 7fda1dbff700 1 --2- 172.21.15.8:0/2553215345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda18106ba0 0x7fda18109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.483+0000 7fda1dbff700 1 --2- 172.21.15.8:0/2553215345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda18104270 0x7fda18106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.483+0000 7fda1dbff700 1 -- 172.21.15.8:0/2553215345 >> 172.21.15.8:0/2553215345 conn(0x7fda180fb310 msgr2=0x7fda180fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.484+0000 7fda1dbff700 1 -- 172.21.15.8:0/2553215345 shutdown_connections 2023-10-06T23:12:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.484+0000 7fda1dbff700 1 -- 172.21.15.8:0/2553215345 wait complete. 2023-10-06T23:12:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.485+0000 7fda1dbff700 1 Processor -- start 2023-10-06T23:12:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.485+0000 7fda1dbff700 1 -- start start 2023-10-06T23:12:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.485+0000 7fda1dbff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda18101940 0x7fda18198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.485+0000 7fda1dbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda18104270 0x7fda18199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.485+0000 7fda1dbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18106ba0 0x7fda181a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.485+0000 7fda1dbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda181a0870 con 0x7fda18106ba0 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.485+0000 7fda1dbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda181a09e0 con 0x7fda18104270 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.485+0000 7fda1dbff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda181a0ba0 con 0x7fda18101940 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda177fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda18101940 0x7fda18198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda17fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18106ba0 0x7fda181a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda177fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda18101940 0x7fda18198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40486/0 (socket says 172.21.15.8:40486) 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda177fe700 1 -- 172.21.15.8:0/3990874994 learned_addr learned my addr 172.21.15.8:0/3990874994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda16ffd700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda18104270 0x7fda18199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda17fff700 1 -- 172.21.15.8:0/3990874994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda18101940 msgr2=0x7fda18198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda17fff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda18101940 0x7fda18198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda17fff700 1 -- 172.21.15.8:0/3990874994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda18104270 msgr2=0x7fda18199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda17fff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda18104270 0x7fda18199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda17fff700 1 -- 172.21.15.8:0/3990874994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080095f0 con 0x7fda18106ba0 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda177fe700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda18101940 0x7fda18198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda17fff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18106ba0 0x7fda181a02a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda10007f10 tx=0x7fda1000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.486+0000 7fda14ff9700 1 -- 172.21.15.8:0/3990874994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10009ea0 con 0x7fda18106ba0 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.487+0000 7fda14ff9700 1 -- 172.21.15.8:0/3990874994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda1000f040 con 0x7fda18106ba0 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.487+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda181a0e80 con 0x7fda18106ba0 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.487+0000 7fda14ff9700 1 -- 172.21.15.8:0/3990874994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10004280 con 0x7fda18106ba0 2023-10-06T23:12:23.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.487+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda181a12a0 con 0x7fda18106ba0 2023-10-06T23:12:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.488+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda18108770 con 0x7fda18106ba0 2023-10-06T23:12:23.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.490+0000 7fda14ff9700 1 -- 172.21.15.8:0/3990874994 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fda1000db20 con 0x7fda18106ba0 2023-10-06T23:12:23.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.493+0000 7fda14ff9700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda000a14d0 0x7fda000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:23.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.493+0000 7fda14ff9700 1 -- 172.21.15.8:0/3990874994 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fda100ccff0 con 0x7fda18106ba0 2023-10-06T23:12:23.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.493+0000 7fda177fe700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda000a14d0 0x7fda000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:23.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.494+0000 7fda14ff9700 1 -- 172.21.15.8:0/3990874994 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fda10096640 con 0x7fda18106ba0 2023-10-06T23:12:23.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.494+0000 7fda177fe700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda000a14d0 0x7fda000a3990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda1819a200 tx=0x7fda0800b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:23.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.777+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda1802d270 con 0x7fda18106ba0 2023-10-06T23:12:23.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.777+0000 7fda14ff9700 1 -- 172.21.15.8:0/3990874994 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11306 (secure 0 0 0) 0x7fda10019090 con 0x7fda18106ba0 2023-10-06T23:12:23.779 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:23.780 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:11:23.244586+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:12:23.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda000a14d0 msgr2=0x7fda000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda000a14d0 0x7fda000a3990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda1819a200 tx=0x7fda0800b260 comp rx=0 tx=0).stop 2023-10-06T23:12:23.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18106ba0 msgr2=0x7fda181a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:23.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18106ba0 0x7fda181a02a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda10007f10 tx=0x7fda1000d3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 shutdown_connections 2023-10-06T23:12:23.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda000a14d0 0x7fda000a3990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda18106ba0 0x7fda181a02a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda18101940 0x7fda18198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 --2- 172.21.15.8:0/3990874994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda18104270 0x7fda18199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:23.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 >> 172.21.15.8:0/3990874994 conn(0x7fda180fb310 msgr2=0x7fda181025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:23.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 shutdown_connections 2023-10-06T23:12:23.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:23.780+0000 7fda1dbff700 1 -- 172.21.15.8:0/3990874994 wait complete. 2023-10-06T23:12:23.786 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:12:23.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-06T23:11:17.784448+0000', 'modified': '2023-10-06T23:11:23.244586+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24581, 'mds_1': 24568, 'mds_2': 24526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24506': {'gid': 24506, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6835/3086367655', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6834', 'nonce': 3086367655}, {'type': 'v1', 'addr': '172.21.15.156:6835', 'nonce': 3086367655}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24526': {'gid': 24526, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.190:6835/2542800704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 2542800704}, {'type': 'v1', 'addr': '172.21.15.190:6835', 'nonce': 2542800704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24538': {'gid': 24538, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.190:6837/3967292194', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 3967292194}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 3967292194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6837/2054249175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 2054249175}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 2054249175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.190:6839/730533990', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6838', 'nonce': 730533990}, {'type': 'v1', 'addr': '172.21.15.190:6839', 'nonce': 730533990}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6839/1606000246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 1606000246}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 1606000246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-06T23:12:23.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-06T23:12:23.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-06T23:12:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 -- 172.21.15.8:0/1296969206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc1012b0 msgr2=0x7f9ccc1016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 --2- 172.21.15.8:0/1296969206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc1012b0 0x7f9ccc1016d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009990 tx=0x7f9cbc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 -- 172.21.15.8:0/1296969206 shutdown_connections 2023-10-06T23:12:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 --2- 172.21.15.8:0/1296969206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc1012b0 0x7f9ccc1016d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 --2- 172.21.15.8:0/1296969206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ccc100830 0x7f9ccc1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 --2- 172.21.15.8:0/1296969206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ccc0ffe70 0x7f9ccc1002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 -- 172.21.15.8:0/1296969206 >> 172.21.15.8:0/1296969206 conn(0x7f9ccc0fa900 msgr2=0x7f9ccc0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 -- 172.21.15.8:0/1296969206 shutdown_connections 2023-10-06T23:12:24.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.040+0000 7f9cd139d700 1 -- 172.21.15.8:0/1296969206 wait complete. 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.041+0000 7f9cd139d700 1 Processor -- start 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9cd139d700 1 -- start start 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9cd139d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc0ffe70 0x7f9ccc198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9cd139d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ccc100830 0x7f9ccc198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9cd139d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ccc1012b0 0x7f9ccc1a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9cd139d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1a0600 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9cd139d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1a0740 con 0x7f9ccc1012b0 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9cd139d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1a08d0 con 0x7f9ccc100830 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9ccbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc0ffe70 0x7f9ccc198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9ccbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc0ffe70 0x7f9ccc198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36532/0 (socket says 172.21.15.8:36532) 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9ccbfff700 1 -- 172.21.15.8:0/3072046843 learned_addr learned my addr 172.21.15.8:0/3072046843 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9ccb7fe700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ccc100830 0x7f9ccc198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.042+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ccc1012b0 0x7f9ccc1a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9ccbfff700 1 -- 172.21.15.8:0/3072046843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ccc100830 msgr2=0x7f9ccc198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ccc100830 0x7f9ccc198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9ccbfff700 1 -- 172.21.15.8:0/3072046843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ccc1012b0 msgr2=0x7f9ccc1a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ccc1012b0 0x7f9ccc1a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9ccbfff700 1 -- 172.21.15.8:0/3072046843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc0095f0 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc0ffe70 0x7f9ccc198a80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc005910 tx=0x7f9cbc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9cc97fa700 1 -- 172.21.15.8:0/3072046843 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc01d070 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9cc97fa700 1 -- 172.21.15.8:0/3072046843 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cbc00be70 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9cc97fa700 1 -- 172.21.15.8:0/3072046843 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc022e60 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.043+0000 7f9cd139d700 1 -- 172.21.15.8:0/3072046843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ccc1a0b50 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.044+0000 7f9cd139d700 1 -- 172.21.15.8:0/3072046843 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc1a0f20 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.047+0000 7f9cc97fa700 1 -- 172.21.15.8:0/3072046843 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9cbc022600 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.048+0000 7f9ce5f4db80 1 Processor -- start 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.048+0000 7f9cc97fa700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9cb40a15a0 0x7f9cb40a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.048+0000 7f9ce5f4db80 1 -- start start 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.048+0000 7f9cc97fa700 1 -- 172.21.15.8:0/3072046843 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9cbc0ce030 con 0x7f9ccc0ffe70 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.048+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9cb40a15a0 0x7f9cb40a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff7353c0 0x563aff7357e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 0x563aff736630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff737090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff69d410 con 0x563aff7353c0 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff68ebd0 con 0x563aff736c10 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff68c4f0 con 0x563aff735d20 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff7353c0 0x563aff7357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff7353c0 0x563aff7357e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36542/0 (socket says 172.21.15.8:36542) 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccbfff700 1 -- 172.21.15.8:0/2447094995 learned_addr learned my addr 172.21.15.8:0/2447094995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccb7fe700 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 0x563aff736630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff737090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9cb40a15a0 0x7f9cb40a3a60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400f590 tx=0x7f9cc400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccbfff700 1 -- 172.21.15.8:0/2447094995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 msgr2=0x563aff736630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 0x563aff736630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccbfff700 1 -- 172.21.15.8:0/2447094995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 msgr2=0x563aff737090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff737090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.049+0000 7f9ccbfff700 1 -- 172.21.15.8:0/2447094995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563aff4b2d90 con 0x563aff7353c0 2023-10-06T23:12:24.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.050+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff7353c0 0x563aff7357e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc097e60 tx=0x7f9cbc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb70b66cbc4622 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.050+0000 7f9cb27fc700 1 -- 172.21.15.8:0/2447094995 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc09baf0 con 0x563aff7353c0 2023-10-06T23:12:24.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.050+0000 7f9cb27fc700 1 -- 172.21.15.8:0/2447094995 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cbc0b0070 con 0x563aff7353c0 2023-10-06T23:12:24.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.050+0000 7f9cb27fc700 1 -- 172.21.15.8:0/2447094995 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc09f120 con 0x563aff7353c0 2023-10-06T23:12:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.050+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2447094995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff7353c0 msgr2=0x563aff7357e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.050+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff7353c0 0x563aff7357e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc097e60 tx=0x7f9cbc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2447094995 shutdown_connections 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff7353c0 0x563aff7357e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff737090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2447094995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 0x563aff736630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2447094995 >> 172.21.15.8:0/2447094995 conn(0x563aff6a9210 msgr2=0x563aff730290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2447094995 shutdown_connections 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2447094995 wait complete. 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 -- start start 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.051+0000 7f9ce5f4db80 1 Processor -- start 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff73ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff73f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff746390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff687de0 con 0x563aff735d20 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff6246c0 con 0x563aff736c10 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff624360 con 0x563aff7353c0 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ce5f4db80 10 client.0 _ll_register_callbacks cb 0x563aff4817b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ccb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff73f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ccb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff73f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36552/0 (socket says 172.21.15.8:36552) 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ccb7fe700 1 -- 172.21.15.8:0/1203350438 learned_addr learned my addr 172.21.15.8:0/1203350438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff746390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.052+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff73ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9ccb7fe700 1 -- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 msgr2=0x563aff73ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9ccb7fe700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff73ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9ccb7fe700 1 -- 172.21.15.8:0/1203350438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 msgr2=0x563aff746390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9ccb7fe700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff746390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9ccb7fe700 1 -- 172.21.15.8:0/1203350438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc1a0f20 con 0x563aff735d20 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff73ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff746390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9ccb7fe700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff73f350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00127f0 tx=0x7f9cc0012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f273b7754e084f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9cab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9cab7fe700 1 -- 172.21.15.8:0/1203350438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0017070 con 0x563aff735d20 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/1203350438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563aff728110 con 0x563aff735d20 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9cab7fe700 1 -- 172.21.15.8:0/1203350438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9cc000f500 con 0x563aff735d20 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.053+0000 7f9cab7fe700 1 -- 172.21.15.8:0/1203350438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cc000f6c0 con 0x563aff735d20 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9ce5f4db80 10 client.15051 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:24.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/1203350438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563aff49bc10 con 0x563aff735d20 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9cab7fe700 1 -- 172.21.15.8:0/1203350438 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563aff728110 con 0x563aff735d20 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9cab7fe700 1 -- 172.21.15.8:0/1203350438 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9cc0010720 con 0x563aff735d20 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9ce5f4db80 10 client.15051 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9ce5f4db80 10 client.15051 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9ce5f4db80 20 client.15051 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x563aff74aa40 0x563aff7494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9ce5f4db80 4 client.15051 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.054+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/1203350438 --> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563aff680dc0 con 0x563aff74aa40 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.055+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x563aff74aa40 0x563aff7494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.055+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x563aff74aa40 0x563aff7494f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b05ac86d6ed0ba3d server_cookie=fa8580023b1c1b55 in_seq=0 out_seq=0 2023-10-06T23:12:24.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.055+0000 7f9cab7fe700 10 client.15051 ms_handle_connect on v2:172.21.15.190:6834/2542800704 2023-10-06T23:12:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9cab7fe700 1 -- 172.21.15.8:0/1203350438 <== mds.2 v2:172.21.15.190:6834/2542800704 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563aff680dc0 con 0x563aff74aa40 2023-10-06T23:12:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9cab7fe700 10 client.15051 handle_command_reply: tid=0 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 client.15051 shutdown 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/1203350438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 msgr2=0x563aff73f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff73f350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00127f0 tx=0x7f9cc0012b00 comp rx=0 tx=0).stop 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/1203350438 shutdown_connections 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x563aff74aa40 0x563aff7494f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff746390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9cab7fe700 0 client.15051 ms_handle_reset on v2:172.21.15.190:6834/2542800704 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff73ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/1203350438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff73f350 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.056+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/1203350438 >> 172.21.15.8:0/1203350438 conn(0x563aff6a9210 msgr2=0x563aff7300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.057+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/1203350438 shutdown_connections 2023-10-06T23:12:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.057+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/1203350438 wait complete. 2023-10-06T23:12:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.057+0000 7f9ce5f4db80 20 client.15051 trim_cache size 0 max 16384 2023-10-06T23:12:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.075+0000 7f9ce5f4db80 1 Processor -- start 2023-10-06T23:12:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.075+0000 7f9ce5f4db80 1 -- start start 2023-10-06T23:12:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff7353c0 0x563aff72ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 0x563aff746350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff736c10 0x563aff7300e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff5088d0 con 0x563aff736c10 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff514de0 con 0x563aff7353c0 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff646590 con 0x563aff735d20 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9cd0b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff736c10 0x563aff7300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9ccb7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 0x563aff746350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9cd0b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff736c10 0x563aff7300e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36554/0 (socket says 172.21.15.8:36554) 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9cd0b9c700 1 -- 172.21.15.8:0/4095925007 learned_addr learned my addr 172.21.15.8:0/4095925007 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.076+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/4095925007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff7353c0 0x563aff72ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cd0b9c700 1 -- 172.21.15.8:0/4095925007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 msgr2=0x563aff746350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/4095925007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 0x563aff746350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cd0b9c700 1 -- 172.21.15.8:0/4095925007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff7353c0 msgr2=0x563aff72ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/4095925007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff7353c0 0x563aff72ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cd0b9c700 1 -- 172.21.15.8:0/4095925007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563aff4d9200 con 0x563aff736c10 2023-10-06T23:12:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/4095925007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff736c10 0x563aff7300e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009490 tx=0x7f9cc4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b2197f688b090b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cb2ffd700 1 -- 172.21.15.8:0/4095925007 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400e040 con 0x563aff736c10 2023-10-06T23:12:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cb2ffd700 1 -- 172.21.15.8:0/4095925007 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cc400f040 con 0x563aff736c10 2023-10-06T23:12:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.077+0000 7f9cb2ffd700 1 -- 172.21.15.8:0/4095925007 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc402b660 con 0x563aff736c10 2023-10-06T23:12:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/4095925007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff736c10 msgr2=0x563aff7300e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/4095925007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff736c10 0x563aff7300e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009490 tx=0x7f9cc4014000 comp rx=0 tx=0).stop 2023-10-06T23:12:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/4095925007 shutdown_connections 2023-10-06T23:12:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/4095925007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff736c10 0x563aff7300e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/4095925007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff7353c0 0x563aff72ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/4095925007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff735d20 0x563aff746350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/4095925007 >> 172.21.15.8:0/4095925007 conn(0x563aff6a9210 msgr2=0x563aff72c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/4095925007 shutdown_connections 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/4095925007 wait complete. 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.078+0000 7f9ce5f4db80 1 -- start start 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ce5f4db80 1 Processor -- start 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff740690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff740bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ce5f4db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff745c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff746140 con 0x563aff735d20 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff7462b0 con 0x563aff736c10 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ce5f4db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aff746470 con 0x563aff7353c0 2023-10-06T23:12:24.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ce5f4db80 10 client.0 _ll_register_callbacks cb 0x7f9cc0009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.079+0000 7f9ccb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff740bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccbfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff740690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff740bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36562/0 (socket says 172.21.15.8:36562) 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccb7fe700 1 -- 172.21.15.8:0/2864985341 learned_addr learned my addr 172.21.15.8:0/2864985341 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9cd0b9c700 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff745c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccbfff700 1 -- 172.21.15.8:0/2864985341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 msgr2=0x563aff745c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff745c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccbfff700 1 -- 172.21.15.8:0/2864985341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 msgr2=0x563aff740bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff740bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccbfff700 1 -- 172.21.15.8:0/2864985341 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc4009140 con 0x563aff7353c0 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccb7fe700 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff740bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ccbfff700 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff740690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc09b380 tx=0x7f9cbc09b1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f17d85450998020 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9cab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9cab7fe700 1 -- 172.21.15.8:0/2864985341 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0092b0 con 0x563aff7353c0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2864985341 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9cbc0b0070 con 0x563aff7353c0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.080+0000 7f9cab7fe700 1 -- 172.21.15.8:0/2864985341 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9cbc09b3f0 con 0x563aff7353c0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9cab7fe700 1 -- 172.21.15.8:0/2864985341 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cbc083030 con 0x563aff7353c0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ce5f4db80 10 client.24949 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2864985341 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563aff4b1260 con 0x563aff7353c0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9cab7fe700 1 -- 172.21.15.8:0/2864985341 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cbc0a7020 con 0x563aff7353c0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9cab7fe700 1 -- 172.21.15.8:0/2864985341 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9cbc09a8e0 con 0x563aff7353c0 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ce5f4db80 10 client.24949 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ce5f4db80 10 client.24949 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-06T23:12:24.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ce5f4db80 20 client.24949 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x563aff7a2de0 0x563aff79f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ce5f4db80 4 client.24949 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2864985341 --> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563aff680ae0 con 0x563aff7a2de0 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.081+0000 7f9ccb7fe700 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x563aff7a2de0 0x563aff79f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9cab7fe700 10 client.24949 ms_handle_connect on v2:172.21.15.190:6834/2542800704 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ccb7fe700 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x563aff7a2de0 0x563aff79f2f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7efb9b8c7555a69c server_cookie=8d50f65547771011 in_seq=0 out_seq=0 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9cab7fe700 1 -- 172.21.15.8:0/2864985341 <== mds.2 v2:172.21.15.190:6834/2542800704 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x563aff680ae0 con 0x563aff7a2de0 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9cab7fe700 10 client.24949 handle_command_reply: tid=0 2023-10-06T23:12:24.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 client.24949 shutdown 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2864985341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 msgr2=0x563aff740690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff740690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc09b380 tx=0x7f9cbc09b1c0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2864985341 shutdown_connections 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x563aff7a2de0 0x563aff79f2f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563aff736c10 0x563aff745c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563aff7353c0 0x563aff740690 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 --2- 172.21.15.8:0/2864985341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563aff735d20 0x563aff740bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9cab7fe700 0 client.24949 ms_handle_reset on v2:172.21.15.190:6834/2542800704 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.082+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2864985341 >> 172.21.15.8:0/2864985341 conn(0x563aff6a9210 msgr2=0x563aff73cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2864985341 shutdown_connections 2023-10-06T23:12:24.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9ce5f4db80 1 -- 172.21.15.8:0/2864985341 wait complete. 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9ce5f4db80 20 client.24949 trim_cache size 0 max 16384 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "5a0d88f6-649c-11ee-8db5-212e2dc638e7", 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24526, 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T23:12:24.090 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 61.841783990000003, 2023-10-06T23:12:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2023-10-06T23:12:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2023-10-06T23:12:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2023-10-06T23:12:24.091 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 91.513781905000002 2023-10-06T23:12:24.091 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:12:24.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 -- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9cb40a15a0 msgr2=0x7f9cb40a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9cb40a15a0 0x7f9cb40a3a60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400f590 tx=0x7f9cc400b040 comp rx=0 tx=0).stop 2023-10-06T23:12:24.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 -- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc0ffe70 msgr2=0x7f9ccc198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc0ffe70 0x7f9ccc198a80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc005910 tx=0x7f9cbc005740 comp rx=0 tx=0).stop 2023-10-06T23:12:24.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 -- 172.21.15.8:0/3072046843 shutdown_connections 2023-10-06T23:12:24.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9cb40a15a0 0x7f9cb40a3a60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc0ffe70 0x7f9ccc198a80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ccc1012b0 0x7f9ccc1a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 --2- 172.21.15.8:0/3072046843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ccc100830 0x7f9ccc198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.083+0000 7f9cd139d700 1 -- 172.21.15.8:0/3072046843 >> 172.21.15.8:0/3072046843 conn(0x7f9ccc0fa900 msgr2=0x7f9ccc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.084+0000 7f9cd139d700 1 -- 172.21.15.8:0/3072046843 shutdown_connections 2023-10-06T23:12:24.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.084+0000 7f9cd139d700 1 -- 172.21.15.8:0/3072046843 wait complete. 2023-10-06T23:12:24.101 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:24 smithi008 ceph-mon[98532]: pgmap v335: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-10-06T23:12:24.101 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:24 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3260229450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:24.101 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:24 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3990874994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:24.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-06T23:12:24.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.312+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/2234060451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f68101f50 msgr2=0x7f2f681023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.313+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/2234060451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f68101f50 0x7f2f681023b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009920 tx=0x7f2f5c009c30 comp rx=0 tx=0).stop 2023-10-06T23:12:24.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.313+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/2234060451 shutdown_connections 2023-10-06T23:12:24.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.313+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/2234060451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f681028f0 0x7f2f681091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.313+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/2234060451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68100d60 0x7f2f68101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.313+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/2234060451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f68101f50 0x7f2f681023b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.313+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/2234060451 >> 172.21.15.8:0/2234060451 conn(0x7f2f680fc2f0 msgr2=0x7f2f680fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.313+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/2234060451 shutdown_connections 2023-10-06T23:12:24.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.313+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/2234060451 wait complete. 2023-10-06T23:12:24.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.314+0000 7f2f6cb9d700 1 Processor -- start 2023-10-06T23:12:24.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.314+0000 7f2f6cb9d700 1 -- start start 2023-10-06T23:12:24.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f6cb9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f68100d60 0x7f2f68074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f6cb9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68101f50 0x7f2f680732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f6cb9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f681028f0 0x7f2f680737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f6cb9d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68073f80 con 0x7f2f68100d60 2023-10-06T23:12:24.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f6cb9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680740f0 con 0x7f2f681028f0 2023-10-06T23:12:24.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f6cb9d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f681a0960 con 0x7f2f68101f50 2023-10-06T23:12:24.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f68100d60 0x7f2f68074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f68100d60 0x7f2f68074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36580/0 (socket says 172.21.15.8:36580) 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f677fe700 1 -- 172.21.15.8:0/1174579958 learned_addr learned my addr 172.21.15.8:0/1174579958 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68101f50 0x7f2f680732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.315+0000 7f2f67fff700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f681028f0 0x7f2f680737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f677fe700 1 -- 172.21.15.8:0/1174579958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68101f50 msgr2=0x7f2f680732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f677fe700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68101f50 0x7f2f680732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f677fe700 1 -- 172.21.15.8:0/1174579958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f681028f0 msgr2=0x7f2f680737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f677fe700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f681028f0 0x7f2f680737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f677fe700 1 -- 172.21.15.8:0/1174579958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c009520 con 0x7f2f68100d60 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68101f50 0x7f2f680732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f677fe700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f68100d60 0x7f2f68074c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800e970 tx=0x7f2f5800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f64ff9700 1 -- 172.21.15.8:0/1174579958 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58009790 con 0x7f2f68100d60 2023-10-06T23:12:24.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f64ff9700 1 -- 172.21.15.8:0/1174579958 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f5800c7e0 con 0x7f2f68100d60 2023-10-06T23:12:24.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/1174579958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f681a0c40 con 0x7f2f68100d60 2023-10-06T23:12:24.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f64ff9700 1 -- 172.21.15.8:0/1174579958 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58003bd0 con 0x7f2f68100d60 2023-10-06T23:12:24.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.316+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/1174579958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f681a11a0 con 0x7f2f68100d60 2023-10-06T23:12:24.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.320+0000 7f2f64ff9700 1 -- 172.21.15.8:0/1174579958 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2f5800c950 con 0x7f2f68100d60 2023-10-06T23:12:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.321+0000 7f2f8179db80 1 Processor -- start 2023-10-06T23:12:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.321+0000 7f2f64ff9700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2f500a15a0 0x7f2f500a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.321+0000 7f2f64ff9700 1 -- 172.21.15.8:0/1174579958 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2f58014070 con 0x7f2f68100d60 2023-10-06T23:12:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.321+0000 7f2f8179db80 1 -- start start 2023-10-06T23:12:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.321+0000 7f2f67fff700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2f500a15a0 0x7f2f500a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.321+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52ef17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.321+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef1d20 0x55fa52ef2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.321+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 0x55fa52ef3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f8179db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52e59410 con 0x55fa52ef13c0 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f8179db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52e4abd0 con 0x55fa52ef1d20 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f8179db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52e484f0 con 0x55fa52ef2c10 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52ef17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52ef17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36592/0 (socket says 172.21.15.8:36592) 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 -- 172.21.15.8:0/512579258 learned_addr learned my addr 172.21.15.8:0/512579258 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef1d20 0x55fa52ef2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f67fff700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2f500a15a0 0x7f2f500a3a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2f680752c0 tx=0x7f2f6000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 -- 172.21.15.8:0/512579258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 msgr2=0x55fa52ef3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 0x55fa52ef3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 -- 172.21.15.8:0/512579258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef1d20 msgr2=0x55fa52ef2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef1d20 0x55fa52ef2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 -- 172.21.15.8:0/512579258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa52c6ed90 con 0x55fa52ef13c0 2023-10-06T23:12:24.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef1d20 0x55fa52ef2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.322+0000 7f2f677fe700 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52ef17e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f58096bf0 tx=0x7f2f58003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36673246088f1556 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f4dffb700 1 -- 172.21.15.8:0/512579258 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580b1070 con 0x55fa52ef13c0 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f4dffb700 1 -- 172.21.15.8:0/512579258 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f5809a180 con 0x55fa52ef13c0 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f4dffb700 1 -- 172.21.15.8:0/512579258 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58098520 con 0x55fa52ef13c0 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f8179db80 1 -- 172.21.15.8:0/512579258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 msgr2=0x55fa52ef17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f8179db80 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52ef17e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f58096bf0 tx=0x7f2f58003680 comp rx=0 tx=0).stop 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f8179db80 1 -- 172.21.15.8:0/512579258 shutdown_connections 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f8179db80 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52ef17e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f8179db80 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 0x55fa52ef3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f8179db80 1 --2- 172.21.15.8:0/512579258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef1d20 0x55fa52ef2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.323+0000 7f2f8179db80 1 -- 172.21.15.8:0/512579258 >> 172.21.15.8:0/512579258 conn(0x55fa52e65210 msgr2=0x55fa52eec290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.324+0000 7f2f8179db80 1 -- 172.21.15.8:0/512579258 shutdown_connections 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.324+0000 7f2f8179db80 1 -- 172.21.15.8:0/512579258 wait complete. 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.324+0000 7f2f8179db80 1 -- start start 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.324+0000 7f2f8179db80 1 Processor -- start 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52efb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef1d20 0x55fa52efb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 0x55fa52f027e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f8179db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52e43de0 con 0x55fa52ef1d20 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f8179db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52de06c0 con 0x55fa52ef13c0 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f8179db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52de0360 con 0x55fa52ef2c10 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f8179db80 10 client.0 _ll_register_callbacks cb 0x55fa52c3d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:24.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f66ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef1d20 0x55fa52efb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f66ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef1d20 0x55fa52efb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36596/0 (socket says 172.21.15.8:36596) 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52efb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f66ffd700 1 -- 172.21.15.8:0/1746133039 learned_addr learned my addr 172.21.15.8:0/1746133039 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f67fff700 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 0x55fa52f027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f66ffd700 1 -- 172.21.15.8:0/1746133039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 msgr2=0x55fa52f027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 0x55fa52f027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f66ffd700 1 -- 172.21.15.8:0/1746133039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 msgr2=0x55fa52efb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52efb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.325+0000 7f2f66ffd700 1 -- 172.21.15.8:0/1746133039 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f68109af0 con 0x55fa52ef1d20 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef1d20 0x55fa52efb7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009920 tx=0x7f2f5c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a91bd72e2134b35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1746133039 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c01c040 con 0x55fa52ef1d20 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1746133039 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2f5c005040 con 0x55fa52ef1d20 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f8179db80 1 -- 172.21.15.8:0/1746133039 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa52ee4110 con 0x55fa52ef1d20 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1746133039 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f5c00bec0 con 0x55fa52ef1d20 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f8179db80 10 client.15069 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f8179db80 1 -- 172.21.15.8:0/1746133039 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f2f681a11a0 con 0x55fa52ef1d20 2023-10-06T23:12:24.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.326+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1746133039 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fa52ee4110 con 0x55fa52ef1d20 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.327+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1746133039 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f5c015020 con 0x55fa52ef1d20 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.327+0000 7f2f8179db80 10 client.15069 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.327+0000 7f2f8179db80 10 client.15069 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.327+0000 7f2f8179db80 20 client.15069 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.327+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55fa52f06e60 0x55fa52f05890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.327+0000 7f2f8179db80 4 client.15069 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.327+0000 7f2f8179db80 1 -- 172.21.15.8:0/1746133039 --> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa52e3cdc0 con 0x55fa52f06e60 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.327+0000 7f2f677fe700 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55fa52f06e60 0x55fa52f05890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.328+0000 7f2f677fe700 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55fa52f06e60 0x55fa52f05890 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=539a101680c5865b server_cookie=5faf5d3a656916c in_seq=0 out_seq=0 2023-10-06T23:12:24.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.328+0000 7f2f46ffd700 10 client.15069 ms_handle_connect on v2:172.21.15.190:6838/730533990 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1746133039 <== mds.1 v2:172.21.15.190:6838/730533990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fa52e3cdc0 con 0x55fa52f06e60 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f46ffd700 10 client.15069 handle_command_reply: tid=0 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f8179db80 1 client.15069 shutdown 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f8179db80 1 -- 172.21.15.8:0/1746133039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef1d20 msgr2=0x55fa52efb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef1d20 0x55fa52efb7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009920 tx=0x7f2f5c00b790 comp rx=0 tx=0).stop 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f8179db80 1 -- 172.21.15.8:0/1746133039 shutdown_connections 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55fa52f06e60 0x55fa52f05890 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef2c10 0x55fa52f027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f46ffd700 0 client.15069 ms_handle_reset on v2:172.21.15.190:6838/730533990 2023-10-06T23:12:24.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52efb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.329+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1746133039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef1d20 0x55fa52efb7a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.330+0000 7f2f8179db80 1 -- 172.21.15.8:0/1746133039 >> 172.21.15.8:0/1746133039 conn(0x55fa52e65210 msgr2=0x55fa52eec0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.330+0000 7f2f8179db80 1 -- 172.21.15.8:0/1746133039 shutdown_connections 2023-10-06T23:12:24.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.330+0000 7f2f8179db80 1 -- 172.21.15.8:0/1746133039 wait complete. 2023-10-06T23:12:24.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.330+0000 7f2f8179db80 20 client.15069 trim_cache size 0 max 16384 2023-10-06T23:12:24.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:24 smithi156 ceph-mon[102862]: pgmap v335: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-10-06T23:12:24.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:24 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3260229450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:24.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:24 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3990874994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:24.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f8179db80 1 Processor -- start 2023-10-06T23:12:24.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f8179db80 1 -- start start 2023-10-06T23:12:24.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52ef9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f02770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef2c10 0x55fa52ef9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f8179db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52cc48d0 con 0x55fa52ef2c10 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f8179db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52e3ff00 con 0x55fa52ef13c0 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f8179db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52cd0de0 con 0x55fa52ef1d20 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef2c10 0x55fa52ef9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52ef9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef2c10 0x55fa52ef9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36604/0 (socket says 172.21.15.8:36604) 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f67fff700 1 -- 172.21.15.8:0/752987177 learned_addr learned my addr 172.21.15.8:0/752987177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.353+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f02770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f677fe700 1 -- 172.21.15.8:0/752987177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 msgr2=0x55fa52f02770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f677fe700 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f02770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f677fe700 1 -- 172.21.15.8:0/752987177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef2c10 msgr2=0x55fa52ef9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f677fe700 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef2c10 0x55fa52ef9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f677fe700 1 -- 172.21.15.8:0/752987177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa52c57c10 con 0x55fa52ef13c0 2023-10-06T23:12:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f02770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f67fff700 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef2c10 0x55fa52ef9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f677fe700 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52ef9eb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800cc00 tx=0x7f2f580965f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f29dc440de9465 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f4e7fc700 1 -- 172.21.15.8:0/752987177 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580b6070 con 0x55fa52ef13c0 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f4e7fc700 1 -- 172.21.15.8:0/752987177 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f58082070 con 0x55fa52ef13c0 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.354+0000 7f2f4e7fc700 1 -- 172.21.15.8:0/752987177 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580b1040 con 0x55fa52ef13c0 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 -- 172.21.15.8:0/752987177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 msgr2=0x55fa52ef9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52ef9eb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800cc00 tx=0x7f2f580965f0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 -- 172.21.15.8:0/752987177 shutdown_connections 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef2c10 0x55fa52ef9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef13c0 0x55fa52ef9eb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 --2- 172.21.15.8:0/752987177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f02770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 -- 172.21.15.8:0/752987177 >> 172.21.15.8:0/752987177 conn(0x55fa52e65210 msgr2=0x55fa52ee8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 -- 172.21.15.8:0/752987177 shutdown_connections 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.355+0000 7f2f8179db80 1 -- 172.21.15.8:0/752987177 wait complete. 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.356+0000 7f2f8179db80 1 -- start start 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.356+0000 7f2f8179db80 1 Processor -- start 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52eff730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f01c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f8179db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef2c10 0x55fa52f02290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f8179db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52f029a0 con 0x55fa52ef13c0 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f8179db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52f02b10 con 0x55fa52ef2c10 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f8179db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa52f5a850 con 0x55fa52ef1d20 2023-10-06T23:12:24.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f8179db80 10 client.0 _ll_register_callbacks cb 0x7f2f5c00f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52eff730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f66ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f01c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52eff730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36612/0 (socket says 172.21.15.8:36612) 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f66ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f01c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40596/0 (socket says 172.21.15.8:40596) 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f677fe700 1 -- 172.21.15.8:0/1933754619 learned_addr learned my addr 172.21.15.8:0/1933754619 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f67fff700 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef2c10 0x55fa52f02290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f677fe700 1 -- 172.21.15.8:0/1933754619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 msgr2=0x55fa52f01c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f677fe700 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f01c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f677fe700 1 -- 172.21.15.8:0/1933754619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef2c10 msgr2=0x55fa52f02290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.357+0000 7f2f677fe700 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef2c10 0x55fa52f02290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f677fe700 1 -- 172.21.15.8:0/1933754619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f681a11a0 con 0x55fa52ef13c0 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f01c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f67fff700 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef2c10 0x55fa52f02290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f677fe700 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52eff730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f580cc010 tx=0x7f2f5800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4901153a282e223f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1933754619 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580b6070 con 0x55fa52ef13c0 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1933754619 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2f58098520 con 0x55fa52ef13c0 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f8179db80 1 -- 172.21.15.8:0/1933754619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f5809a180 con 0x55fa52ef13c0 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1933754619 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f580b1070 con 0x55fa52ef13c0 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f8179db80 10 client.15075 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:24.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f8179db80 1 -- 172.21.15.8:0/1933754619 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f2f60009060 con 0x55fa52ef13c0 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.358+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1933754619 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f5809a180 con 0x55fa52ef13c0 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.359+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1933754619 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f58099670 con 0x55fa52ef13c0 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.359+0000 7f2f8179db80 10 client.15075 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.359+0000 7f2f8179db80 10 client.15075 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.359+0000 7f2f8179db80 20 client.15075 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.359+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55fa52f5f540 0x55fa52f5ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.359+0000 7f2f8179db80 4 client.15075 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.359+0000 7f2f8179db80 1 -- 172.21.15.8:0/1933754619 --> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fa52e3cae0 con 0x55fa52f5f540 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.359+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55fa52f5f540 0x55fa52f5ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f66ffd700 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55fa52f5f540 0x55fa52f5ba20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b50ab31acec7020 server_cookie=4fef06e2eb9f7f35 in_seq=0 out_seq=0 2023-10-06T23:12:24.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f46ffd700 10 client.15075 ms_handle_connect on v2:172.21.15.190:6838/730533990 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f46ffd700 1 -- 172.21.15.8:0/1933754619 <== mds.1 v2:172.21.15.190:6838/730533990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55fa52e3cae0 con 0x55fa52f5f540 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f46ffd700 10 client.15075 handle_command_reply: tid=0 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 client.15075 shutdown 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 -- 172.21.15.8:0/1933754619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 msgr2=0x55fa52eff730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52eff730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f580cc010 tx=0x7f2f5800cf50 comp rx=0 tx=0).stop 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 -- 172.21.15.8:0/1933754619 shutdown_connections 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55fa52f5f540 0x55fa52f5ba20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa52ef13c0 0x55fa52eff730 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa52ef2c10 0x55fa52f02290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 --2- 172.21.15.8:0/1933754619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa52ef1d20 0x55fa52f01c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 -- 172.21.15.8:0/1933754619 >> 172.21.15.8:0/1933754619 conn(0x55fa52e65210 msgr2=0x55fa52ef9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f46ffd700 0 client.15075 ms_handle_reset on v2:172.21.15.190:6838/730533990 2023-10-06T23:12:24.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 -- 172.21.15.8:0/1933754619 shutdown_connections 2023-10-06T23:12:24.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.360+0000 7f2f8179db80 1 -- 172.21.15.8:0/1933754619 wait complete. 2023-10-06T23:12:24.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f8179db80 20 client.15075 trim_cache size 0 max 16384 2023-10-06T23:12:24.368 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "5a0d88f6-649c-11ee-8db5-212e2dc638e7", 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24568, 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 63.051470854000002, 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2023-10-06T23:12:24.369 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 82.551197739000003 2023-10-06T23:12:24.370 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:12:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2f500a15a0 msgr2=0x7f2f500a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2f500a15a0 0x7f2f500a3a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2f680752c0 tx=0x7f2f6000b040 comp rx=0 tx=0).stop 2023-10-06T23:12:24.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f68100d60 msgr2=0x7f2f68074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f68100d60 0x7f2f68074c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800e970 tx=0x7f2f5800ec80 comp rx=0 tx=0).stop 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/1174579958 shutdown_connections 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2f500a15a0 0x7f2f500a3a60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f68100d60 0x7f2f68074c60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f681028f0 0x7f2f680737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 --2- 172.21.15.8:0/1174579958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68101f50 0x7f2f680732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/1174579958 >> 172.21.15.8:0/1174579958 conn(0x7f2f680fc2f0 msgr2=0x7f2f680fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.361+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/1174579958 shutdown_connections 2023-10-06T23:12:24.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.362+0000 7f2f6cb9d700 1 -- 172.21.15.8:0/1174579958 wait complete. 2023-10-06T23:12:24.382 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T23:12:24.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:24 smithi190 ceph-mon[102658]: pgmap v335: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-10-06T23:12:24.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:24 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3260229450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:24.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:24 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3990874994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:24.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 -- 172.21.15.8:0/1609459030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 msgr2=0x7f5fc81012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 --2- 172.21.15.8:0/1609459030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 0x7f5fc81012c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009990 tx=0x7f5fb8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 -- 172.21.15.8:0/1609459030 shutdown_connections 2023-10-06T23:12:24.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 --2- 172.21.15.8:0/1609459030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 0x7f5fc81012c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 --2- 172.21.15.8:0/1609459030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fc8102a40 0x7f5fc8109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 --2- 172.21.15.8:0/1609459030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fc8102080 0x7f5fc8102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 -- 172.21.15.8:0/1609459030 >> 172.21.15.8:0/1609459030 conn(0x7f5fc80fc460 msgr2=0x7f5fc80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 -- 172.21.15.8:0/1609459030 shutdown_connections 2023-10-06T23:12:24.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.601+0000 7f5fccfff700 1 -- 172.21.15.8:0/1609459030 wait complete. 2023-10-06T23:12:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.602+0000 7f5fccfff700 1 Processor -- start 2023-10-06T23:12:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.602+0000 7f5fccfff700 1 -- start start 2023-10-06T23:12:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fccfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 0x7f5fc8074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fccfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fc8102080 0x7f5fc80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fccfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fc8102a40 0x7f5fc80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fccfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc8073f80 con 0x7f5fc8100ea0 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fccfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80740f0 con 0x7f5fc8102a40 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fccfff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc81a0c50 con 0x7f5fc8102080 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 0x7f5fc8074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 0x7f5fc8074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36632/0 (socket says 172.21.15.8:36632) 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc659c700 1 -- 172.21.15.8:0/3031484576 learned_addr learned my addr 172.21.15.8:0/3031484576 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fc8102a40 0x7f5fc80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fc8102080 0x7f5fc80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc659c700 1 -- 172.21.15.8:0/3031484576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fc8102080 msgr2=0x7f5fc80732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc659c700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fc8102080 0x7f5fc80732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc659c700 1 -- 172.21.15.8:0/3031484576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fc8102a40 msgr2=0x7f5fc80737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc659c700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fc8102a40 0x7f5fc80737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.603+0000 7f5fc659c700 1 -- 172.21.15.8:0/3031484576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb80095f0 con 0x7f5fc8100ea0 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.604+0000 7f5fc659c700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 0x7f5fc8074c60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8004730 tx=0x7f5fb8004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.604+0000 7f5fb77fe700 1 -- 172.21.15.8:0/3031484576 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb801d070 con 0x7f5fc8100ea0 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.604+0000 7f5fb77fe700 1 -- 172.21.15.8:0/3031484576 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fb8004c90 con 0x7f5fc8100ea0 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.604+0000 7f5fccfff700 1 -- 172.21.15.8:0/3031484576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc81a0ed0 con 0x7f5fc8100ea0 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.604+0000 7f5fb77fe700 1 -- 172.21.15.8:0/3031484576 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8003af0 con 0x7f5fc8100ea0 2023-10-06T23:12:24.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.604+0000 7f5fccfff700 1 -- 172.21.15.8:0/3031484576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc81a1290 con 0x7f5fc8100ea0 2023-10-06T23:12:24.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.608+0000 7f5fb77fe700 1 -- 172.21.15.8:0/3031484576 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5fb8005000 con 0x7f5fc8100ea0 2023-10-06T23:12:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.609+0000 7f5fe0870b80 1 Processor -- start 2023-10-06T23:12:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.609+0000 7f5fe0870b80 1 -- start start 2023-10-06T23:12:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.609+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b703981630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b703982430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703982a10 0x55b703982e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7038e9410 con 0x55b703982a10 2023-10-06T23:12:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7038dabd0 con 0x55b703981b70 2023-10-06T23:12:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7038d84f0 con 0x55b703981210 2023-10-06T23:12:24.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703982a10 0x55b703982e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc6d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b703981630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b703982430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc6d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b703981630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40626/0 (socket says 172.21.15.8:40626) 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/3022647014 learned_addr learned my addr 172.21.15.8:0/3022647014 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/3022647014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 msgr2=0x55b703982430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/3022647014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b703982430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/3022647014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703982a10 msgr2=0x55b703982e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/3022647014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703982a10 0x55b703982e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/3022647014 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7036fed90 con 0x55b703981210 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.610+0000 7f5fb77fe700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5fb00a1500 0x7f5fb00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.611+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/3022647014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b703981630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0003f40 tx=0x7f5fc0009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=537e64714ff0798d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.611+0000 7f5fb77fe700 1 -- 172.21.15.8:0/3031484576 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5fb80cdbf0 con 0x7f5fc8100ea0 2023-10-06T23:12:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.611+0000 7f5fc659c700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5fb00a1500 0x7f5fb00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.611+0000 7f5fb4ff9700 1 -- 172.21.15.8:0/3022647014 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0019070 con 0x55b703981210 2023-10-06T23:12:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.611+0000 7f5fb4ff9700 1 -- 172.21.15.8:0/3022647014 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fc000f040 con 0x55b703981210 2023-10-06T23:12:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.611+0000 7f5fb4ff9700 1 -- 172.21.15.8:0/3022647014 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0007940 con 0x55b703981210 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3022647014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 msgr2=0x55b703981630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/3022647014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b703981630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0003f40 tx=0x7f5fc0009ba0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fc659c700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5fb00a1500 0x7f5fb00a39c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5fb809aee0 tx=0x7f5fb80d15f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3022647014 shutdown_connections 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/3022647014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703982a10 0x55b703982e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/3022647014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b703981630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/3022647014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b703982430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3022647014 >> 172.21.15.8:0/3022647014 conn(0x55b7038f5210 msgr2=0x55b70397c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3022647014 shutdown_connections 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3022647014 wait complete. 2023-10-06T23:12:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.612+0000 7f5fe0870b80 1 -- start start 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.613+0000 7f5fe0870b80 1 Processor -- start 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.613+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b70398afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.613+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981b70 0x55b70398b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.613+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703982a10 0x55b703992520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.613+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7038d3de0 con 0x55b703981b70 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.613+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7038706c0 con 0x55b703982a10 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.613+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b703870360 con 0x55b703981210 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.613+0000 7f5fe0870b80 10 client.0 _ll_register_callbacks cb 0x55b7036cd7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981b70 0x55b70398b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b70398afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b70398afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40628/0 (socket says 172.21.15.8:40628) 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981b70 0x55b70398b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36660/0 (socket says 172.21.15.8:36660) 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/680431495 learned_addr learned my addr 172.21.15.8:0/680431495 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703982a10 0x55b703992520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/680431495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703982a10 msgr2=0x55b703992520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703982a10 0x55b703992520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/680431495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981b70 msgr2=0x55b70398b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981b70 0x55b70398b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/680431495 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc0003b70 con 0x55b703981210 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981b70 0x55b70398b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b70398afa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009510 tx=0x7f5fc0004eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e285ef4104292648 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.614+0000 7f5fadffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:12:24.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.615+0000 7f5fadffb700 1 -- 172.21.15.8:0/680431495 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0019040 con 0x55b703981210 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.615+0000 7f5fe0870b80 1 -- 172.21.15.8:0/680431495 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b703973ec0 con 0x55b703981210 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.615+0000 7f5fadffb700 1 -- 172.21.15.8:0/680431495 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5fc0015680 con 0x55b703981210 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.615+0000 7f5fadffb700 1 -- 172.21.15.8:0/680431495 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fc0015880 con 0x55b703981210 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.615+0000 7f5fe0870b80 10 client.24976 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.615+0000 7f5fe0870b80 1 -- 172.21.15.8:0/680431495 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55b7036e7c10 con 0x55b703981210 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.615+0000 7f5fadffb700 1 -- 172.21.15.8:0/680431495 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b703973ec0 con 0x55b703981210 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.615+0000 7f5fadffb700 1 -- 172.21.15.8:0/680431495 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5fc0020620 con 0x55b703981210 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.616+0000 7f5fe0870b80 10 client.24976 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.616+0000 7f5fe0870b80 10 client.24976 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.616+0000 7f5fe0870b80 20 client.24976 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.616+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b703996a30 0x55b7039955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.616+0000 7f5fe0870b80 4 client.24976 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:12:24.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.616+0000 7f5fe0870b80 1 -- 172.21.15.8:0/680431495 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7038ccdc0 con 0x55b703996a30 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.616+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b703996a30 0x55b7039955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.617+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b703996a30 0x55b7039955d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d647cd08aec7e39 server_cookie=a3139a282b8fbc07 in_seq=0 out_seq=0 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.617+0000 7f5fadffb700 10 client.24976 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fadffb700 1 -- 172.21.15.8:0/680431495 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b7038ccdc0 con 0x55b703996a30 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fadffb700 10 client.24976 handle_command_reply: tid=0 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 client.24976 shutdown 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 -- 172.21.15.8:0/680431495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 msgr2=0x55b70398afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b70398afa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009510 tx=0x7f5fc0004eb0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 -- 172.21.15.8:0/680431495 shutdown_connections 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b703996a30 0x55b7039955d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703982a10 0x55b703992520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703981210 0x55b70398afa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fadffb700 0 client.24976 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/680431495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981b70 0x55b70398b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 -- 172.21.15.8:0/680431495 >> 172.21.15.8:0/680431495 conn(0x55b7038f5210 msgr2=0x55b70397bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 -- 172.21.15.8:0/680431495 shutdown_connections 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.618+0000 7f5fe0870b80 1 -- 172.21.15.8:0/680431495 wait complete. 2023-10-06T23:12:24.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.619+0000 7f5fe0870b80 20 client.24976 trim_cache size 0 max 16384 2023-10-06T23:12:24.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.638+0000 7f5fe0870b80 1 Processor -- start 2023-10-06T23:12:24.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.638+0000 7f5fe0870b80 1 -- start start 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b7039858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b7039924e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 0x55b703985de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7037548d0 con 0x55b703981210 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70398c1c0 con 0x55b703981b70 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70387a4d0 con 0x55b703982a10 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fc6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b7039858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fc6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b7039858a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36674/0 (socket says 172.21.15.8:36674) 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/3601423093 learned_addr learned my addr 172.21.15.8:0/3601423093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b7039924e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.639+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 0x55b703985de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/3601423093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 msgr2=0x55b703985de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 0x55b703985de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/3601423093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 msgr2=0x55b7039924e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b7039924e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/3601423093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b703725200 con 0x55b703981210 2023-10-06T23:12:24.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b7039924e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b7039858a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009f70 tx=0x7f5fc0009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a565e06cf19ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fb57fa700 1 -- 172.21.15.8:0/3601423093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0019030 con 0x55b703981210 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fb57fa700 1 -- 172.21.15.8:0/3601423093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fc00095c0 con 0x55b703981210 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.640+0000 7f5fb57fa700 1 -- 172.21.15.8:0/3601423093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0015480 con 0x55b703981210 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3601423093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 msgr2=0x55b7039858a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b7039858a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009f70 tx=0x7f5fc0009100 comp rx=0 tx=0).stop 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3601423093 shutdown_connections 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b7039858a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 0x55b703985de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/3601423093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b7039924e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3601423093 >> 172.21.15.8:0/3601423093 conn(0x55b7038f5210 msgr2=0x55b703988d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3601423093 shutdown_connections 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 -- 172.21.15.8:0/3601423093 wait complete. 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.641+0000 7f5fe0870b80 1 -- start start 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fe0870b80 1 Processor -- start 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b70398c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b70398cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fe0870b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 0x55b703991ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b703992020 con 0x55b703981210 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b703992190 con 0x55b703981b70 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fe0870b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b703992350 con 0x55b703982a10 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fe0870b80 10 client.0 _ll_register_callbacks cb 0x7f5fc0003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:24.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fc6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b70398c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fc6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b70398c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36684/0 (socket says 172.21.15.8:36684) 2023-10-06T23:12:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fc6d9d700 1 -- 172.21.15.8:0/457023785 learned_addr learned my addr 172.21.15.8:0/457023785 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.642+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b70398cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 0x55b703991ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fc5d9b700 1 -- 172.21.15.8:0/457023785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 msgr2=0x55b703991ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 0x55b703991ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fc5d9b700 1 -- 172.21.15.8:0/457023785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 msgr2=0x55b70398c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b70398c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fc5d9b700 1 -- 172.21.15.8:0/457023785 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc00bc10 con 0x55b703981b70 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b70398c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fc5d9b700 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b70398cc40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55b703997810 tx=0x7f5fbc01df10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fccfc138e3f1daef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fadffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fadffb700 1 -- 172.21.15.8:0/457023785 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc016030 con 0x55b703981b70 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fe0870b80 1 -- 172.21.15.8:0/457023785 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7038ccae0 con 0x55b703981b70 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.643+0000 7f5fadffb700 1 -- 172.21.15.8:0/457023785 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5fbc004a30 con 0x55b703981b70 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fadffb700 1 -- 172.21.15.8:0/457023785 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fbc004570 con 0x55b703981b70 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fe0870b80 10 client.24950 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fe0870b80 1 -- 172.21.15.8:0/457023785 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55b7036e7c10 con 0x55b703981b70 2023-10-06T23:12:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fadffb700 1 -- 172.21.15.8:0/457023785 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b7038ccae0 con 0x55b703981b70 2023-10-06T23:12:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fadffb700 1 -- 172.21.15.8:0/457023785 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5fbc003790 con 0x55b703981b70 2023-10-06T23:12:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fe0870b80 10 client.24950 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fe0870b80 10 client.24950 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T23:12:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fe0870b80 20 client.24950 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b7039ef040 0x55b7039eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fe0870b80 4 client.24950 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-06T23:12:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.644+0000 7f5fe0870b80 1 -- 172.21.15.8:0/457023785 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b70371ff20 con 0x55b7039ef040 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.645+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b7039ef040 0x55b7039eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.645+0000 7f5fc6d9d700 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b7039ef040 0x55b7039eb3e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e35be447be644e84 server_cookie=d7dff5248131f7f9 in_seq=0 out_seq=0 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.645+0000 7f5fadffb700 10 client.24950 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.645+0000 7f5fadffb700 1 -- 172.21.15.8:0/457023785 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55b70371ff20 con 0x55b7039ef040 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.645+0000 7f5fadffb700 10 client.24950 handle_command_reply: tid=0 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.645+0000 7f5fe0870b80 1 client.24950 shutdown 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 -- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 msgr2=0x55b70398cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b70398cc40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55b703997810 tx=0x7f5fbc01df10 comp rx=0 tx=0).stop 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 -- 172.21.15.8:0/457023785 shutdown_connections 2023-10-06T23:12:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b7039ef040 0x55b7039eb3e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b703981210 0x55b70398c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b703982a10 0x55b703991ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fadffb700 0 client.24950 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:12:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 --2- 172.21.15.8:0/457023785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b703981b70 0x55b70398cc40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 -- 172.21.15.8:0/457023785 >> 172.21.15.8:0/457023785 conn(0x55b7038f5210 msgr2=0x55b7039858a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 -- 172.21.15.8:0/457023785 shutdown_connections 2023-10-06T23:12:24.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 1 -- 172.21.15.8:0/457023785 wait complete. 2023-10-06T23:12:24.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.646+0000 7f5fe0870b80 20 client.24950 trim_cache size 0 max 16384 2023-10-06T23:12:24.655 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:12:24.655 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "5a0d88f6-649c-11ee-8db5-212e2dc638e7", 2023-10-06T23:12:24.655 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-06T23:12:24.655 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24581, 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 66.357572895000004, 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 73.063220388999994 2023-10-06T23:12:24.656 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 -- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5fb00a1500 msgr2=0x7f5fb00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5fb00a1500 0x7f5fb00a39c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5fb809aee0 tx=0x7f5fb80d15f0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 -- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 msgr2=0x7f5fc8074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 0x7f5fc8074c60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8004730 tx=0x7f5fb8004760 comp rx=0 tx=0).stop 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 -- 172.21.15.8:0/3031484576 shutdown_connections 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5fb00a1500 0x7f5fb00a39c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc8100ea0 0x7f5fc8074c60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fc8102a40 0x7f5fc80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 --2- 172.21.15.8:0/3031484576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fc8102080 0x7f5fc80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:24.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 -- 172.21.15.8:0/3031484576 >> 172.21.15.8:0/3031484576 conn(0x7f5fc80fc460 msgr2=0x7f5fc8105780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:24.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 -- 172.21.15.8:0/3031484576 shutdown_connections 2023-10-06T23:12:24.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:24.647+0000 7f5fccfff700 1 -- 172.21.15.8:0/3031484576 wait complete. 2023-10-06T23:12:24.668 INFO:tasks.cephadm:Setup complete, yielding 2023-10-06T23:12:24.669 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-06T23:12:24.679 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T23:12:24.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-06T23:12:25.338 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:26 smithi156 ceph-mon[102862]: pgmap v336: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.388 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:26 smithi008 ceph-mon[98532]: pgmap v336: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:26.388 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.388 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.388 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.388 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.388 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.388 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:26 smithi190 ceph-mon[102658]: pgmap v336: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:26.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:26.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 -- 172.21.15.8:0/1145432840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8102b10 msgr2=0x7f82f81093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 --2- 172.21.15.8:0/1145432840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8102b10 0x7f82f81093c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f82f000b0d0 tx=0x7f82f000b3e0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 -- 172.21.15.8:0/1145432840 shutdown_connections 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 --2- 172.21.15.8:0/1145432840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8102b10 0x7f82f81093c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 --2- 172.21.15.8:0/1145432840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8100f70 0x7f82f8101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 --2- 172.21.15.8:0/1145432840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f8102170 0x7f82f81025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 -- 172.21.15.8:0/1145432840 >> 172.21.15.8:0/1145432840 conn(0x7f82f80fc4d0 msgr2=0x7f82f80fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 -- 172.21.15.8:0/1145432840 shutdown_connections 2023-10-06T23:12:27.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.036+0000 7f82fed35700 1 -- 172.21.15.8:0/1145432840 wait complete. 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.037+0000 7f82fed35700 1 Processor -- start 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.037+0000 7f82fed35700 1 -- start start 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fed35700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8100f70 0x7f82f8074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fed35700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f8102170 0x7f82f80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fed35700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8102b10 0x7f82f80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fed35700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8073f60 con 0x7f82f8100f70 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fed35700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80740d0 con 0x7f82f8102170 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fed35700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81a0cc0 con 0x7f82f8102b10 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fcad1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8100f70 0x7f82f8074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fcad1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8100f70 0x7f82f8074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36702/0 (socket says 172.21.15.8:36702) 2023-10-06T23:12:27.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fcad1700 1 -- 172.21.15.8:0/3837321589 learned_addr learned my addr 172.21.15.8:0/3837321589 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:27.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82f7fff700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f8102170 0x7f82f80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:27.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fd2d2700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8102b10 0x7f82f80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:27.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fcad1700 1 -- 172.21.15.8:0/3837321589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8102b10 msgr2=0x7f82f80737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:27.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fcad1700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8102b10 0x7f82f80737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fcad1700 1 -- 172.21.15.8:0/3837321589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f8102170 msgr2=0x7f82f80732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:27.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fcad1700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f8102170 0x7f82f80732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.038+0000 7f82fcad1700 1 -- 172.21.15.8:0/3837321589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0009d00 con 0x7f82f8100f70 2023-10-06T23:12:27.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.039+0000 7f82fcad1700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8100f70 0x7f82f8074c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00e970 tx=0x7f82ec00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:27.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.039+0000 7f82f5ffb700 1 -- 172.21.15.8:0/3837321589 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec009790 con 0x7f82f8100f70 2023-10-06T23:12:27.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.039+0000 7f82f5ffb700 1 -- 172.21.15.8:0/3837321589 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82ec00c7e0 con 0x7f82f8100f70 2023-10-06T23:12:27.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.039+0000 7f82f5ffb700 1 -- 172.21.15.8:0/3837321589 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec003bd0 con 0x7f82f8100f70 2023-10-06T23:12:27.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.039+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f81a0fa0 con 0x7f82f8100f70 2023-10-06T23:12:27.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.039+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f81a1300 con 0x7f82f8100f70 2023-10-06T23:12:27.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.040+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f81085b0 con 0x7f82f8100f70 2023-10-06T23:12:27.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.042+0000 7f82f5ffb700 1 -- 172.21.15.8:0/3837321589 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f82ec00c950 con 0x7f82f8100f70 2023-10-06T23:12:27.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.044+0000 7f82f5ffb700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f82e80a1480 0x7f82e80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:27.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.044+0000 7f82f5ffb700 1 -- 172.21.15.8:0/3837321589 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f82ec014070 con 0x7f82f8100f70 2023-10-06T23:12:27.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.044+0000 7f82f7fff700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f82e80a1480 0x7f82e80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:27.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.045+0000 7f82f7fff700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f82e80a1480 0x7f82e80a3940 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f82e4007be0 tx=0x7f82e40073d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:27.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.050+0000 7f82f5ffb700 1 -- 172.21.15.8:0/3837321589 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f82ec096500 con 0x7f82f8100f70 2023-10-06T23:12:27.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:12:27.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:12:27.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:27.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.279+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82f802d390 con 0x7f82e80a1480 2023-10-06T23:12:27.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.280+0000 7f82f5ffb700 1 -- 172.21.15.8:0/3837321589 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f82f802d390 con 0x7f82e80a1480 2023-10-06T23:12:27.282 INFO:teuthology.orchestra.run.smithi008.stdout:Backend: cephadm 2023-10-06T23:12:27.282 INFO:teuthology.orchestra.run.smithi008.stdout:Available: Yes 2023-10-06T23:12:27.282 INFO:teuthology.orchestra.run.smithi008.stdout:Paused: No 2023-10-06T23:12:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f82e80a1480 msgr2=0x7f82e80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:27.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f82e80a1480 0x7f82e80a3940 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f82e4007be0 tx=0x7f82e40073d0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8100f70 msgr2=0x7f82f8074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8100f70 0x7f82f8074c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00e970 tx=0x7f82ec00ec80 comp rx=0 tx=0).stop 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 shutdown_connections 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f82e80a1480 0x7f82e80a3940 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82f8100f70 0x7f82f8074c50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82f8102b10 0x7f82f80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 --2- 172.21.15.8:0/3837321589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f8102170 0x7f82f80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 >> 172.21.15.8:0/3837321589 conn(0x7f82f80fc4d0 msgr2=0x7f82f81056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 shutdown_connections 2023-10-06T23:12:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:27.283+0000 7f82fed35700 1 -- 172.21.15.8:0/3837321589 wait complete. 2023-10-06T23:12:27.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:12:27.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:12:27.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:27.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:12:27.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:12:27.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:12:27.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-06T23:12:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:28 smithi008 ceph-mon[98532]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:28.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:28 smithi156 ceph-mon[102862]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:28.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:28 smithi190 ceph-mon[102658]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:28.664 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:29.219 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:29 smithi008 ceph-mon[98532]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:29.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:29 smithi156 ceph-mon[102862]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:29.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:29 smithi190 ceph-mon[102658]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:30.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 -- 172.21.15.8:0/313281178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 msgr2=0x7fc3080732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:30.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 --2- 172.21.15.8:0/313281178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 0x7fc3080732c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009990 tx=0x7fc2f8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 -- 172.21.15.8:0/313281178 shutdown_connections 2023-10-06T23:12:30.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 --2- 172.21.15.8:0/313281178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 0x7fc3080732c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 --2- 172.21.15.8:0/313281178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc308108e80 0x7fc30810b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 --2- 172.21.15.8:0/313281178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc308073890 0x7fc308073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 -- 172.21.15.8:0/313281178 >> 172.21.15.8:0/313281178 conn(0x7fc3080fc520 msgr2=0x7fc3080fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:30.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 -- 172.21.15.8:0/313281178 shutdown_connections 2023-10-06T23:12:30.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.202+0000 7fc30e384700 1 -- 172.21.15.8:0/313281178 wait complete. 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.203+0000 7fc30e384700 1 Processor -- start 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.203+0000 7fc30e384700 1 -- start start 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc30e384700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc308073890 0x7fc308198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc30e384700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 0x7fc3081992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc30e384700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc308108e80 0x7fc3081a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc30e384700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3081a08e0 con 0x7fc308074e60 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc30e384700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3081a0a20 con 0x7fc308073890 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc30e384700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3081a0be0 con 0x7fc308108e80 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc3077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 0x7fc3081992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:30.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc3077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 0x7fc3081992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57002/0 (socket says 172.21.15.8:57002) 2023-10-06T23:12:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc3077fe700 1 -- 172.21.15.8:0/3746889711 learned_addr learned my addr 172.21.15.8:0/3746889711 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc307fff700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc308073890 0x7fc308198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.204+0000 7fc30c921700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc308108e80 0x7fc3081a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3077fe700 1 -- 172.21.15.8:0/3746889711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc308108e80 msgr2=0x7fc3081a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3077fe700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc308108e80 0x7fc3081a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3077fe700 1 -- 172.21.15.8:0/3746889711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc308073890 msgr2=0x7fc308198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3077fe700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc308073890 0x7fc308198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3077fe700 1 -- 172.21.15.8:0/3746889711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80095f0 con 0x7fc308074e60 2023-10-06T23:12:30.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3077fe700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 0x7fc3081992d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00d950 tx=0x7fc2fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:30.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3057fa700 1 -- 172.21.15.8:0/3746889711 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00f890 con 0x7fc308074e60 2023-10-06T23:12:30.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3081a0ec0 con 0x7fc308074e60 2023-10-06T23:12:30.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3057fa700 1 -- 172.21.15.8:0/3746889711 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2fc00fe80 con 0x7fc308074e60 2023-10-06T23:12:30.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc3057fa700 1 -- 172.21.15.8:0/3746889711 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00e3b0 con 0x7fc308074e60 2023-10-06T23:12:30.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.205+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3081a12d0 con 0x7fc308074e60 2023-10-06T23:12:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.206+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc308107580 con 0x7fc308074e60 2023-10-06T23:12:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.208+0000 7fc3057fa700 1 -- 172.21.15.8:0/3746889711 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc2fc010460 con 0x7fc308074e60 2023-10-06T23:12:30.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.210+0000 7fc3057fa700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2f00a1480 0x7fc2f00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:30.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.210+0000 7fc3057fa700 1 -- 172.21.15.8:0/3746889711 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc2fc0ccab0 con 0x7fc308074e60 2023-10-06T23:12:30.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.210+0000 7fc307fff700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2f00a1480 0x7fc2f00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.211+0000 7fc307fff700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2f00a1480 0x7fc2f00a3940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80059d0 tx=0x7fc2f8005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.212+0000 7fc3057fa700 1 -- 172.21.15.8:0/3746889711 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc2fc0960c0 con 0x7fc308074e60 2023-10-06T23:12:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:30 smithi156 ceph-mon[102862]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:30 smithi008 ceph-mon[98532]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:30.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.437+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc30810e820 con 0x7fc2f00a1480 2023-10-06T23:12:30.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:30 smithi190 ceph-mon[102658]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-06T23:12:30.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.452+0000 7fc3057fa700 1 -- 172.21.15.8:0/3746889711 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fc30810e820 con 0x7fc2f00a1480 2023-10-06T23:12:30.453 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-06T23:12:30.453 INFO:teuthology.orchestra.run.smithi008.stdout:mds.a smithi008 running (82s) 5s ago 81s 13.4M - 18.0.0-6616-g14d8d032 c754feb42fd5 aa7f265a2331 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.b smithi156 running (79s) 5s ago 78s 18.5M - 18.0.0-6616-g14d8d032 c754feb42fd5 f5a762b1f49e 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.c smithi190 running (95s) 5s ago 94s 16.6M - 18.0.0-6616-g14d8d032 c754feb42fd5 d3bf868a1042 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.d smithi008 running (104s) 5s ago 104s 13.5M - 18.0.0-6616-g14d8d032 c754feb42fd5 0a29e04d79eb 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.e smithi156 running (101s) 5s ago 100s 16.6M - 18.0.0-6616-g14d8d032 c754feb42fd5 9348fa4bd809 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.f smithi190 running (98s) 5s ago 97s 17.1M - 18.0.0-6616-g14d8d032 c754feb42fd5 00fcd9e230eb 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.g smithi008 running (85s) 5s ago 85s 13.4M - 18.0.0-6616-g14d8d032 c754feb42fd5 247e7c3ea780 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.h smithi156 running (92s) 5s ago 91s 16.8M - 18.0.0-6616-g14d8d032 c754feb42fd5 03a9ecf3173e 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.i smithi190 running (88s) 5s ago 88s 17.5M - 18.0.0-6616-g14d8d032 c754feb42fd5 1dc4a75f91ce 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.j smithi008 running (107s) 5s ago 107s 13.5M - 18.0.0-6616-g14d8d032 c754feb42fd5 ee416821a99d 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.k smithi156 running (111s) 5s ago 110s 13.5M - 18.0.0-6616-g14d8d032 c754feb42fd5 9563f2e3a977 2023-10-06T23:12:30.454 INFO:teuthology.orchestra.run.smithi008.stdout:mds.l smithi190 running (114s) 5s ago 113s 13.5M - 18.0.0-6616-g14d8d032 c754feb42fd5 c384209dc6a0 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.x smithi008 *:9283,8765 running (9m) 5s ago 9m 525M - 18.0.0-6616-g14d8d032 c754feb42fd5 93900bbba1cd 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.y smithi156 *:8443,8765 running (7m) 5s ago 7m 452M - 18.0.0-6616-g14d8d032 c754feb42fd5 4470000d0cd8 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.z smithi190 *:8443,8765 running (7m) 5s ago 7m 452M - 18.0.0-6616-g14d8d032 c754feb42fd5 4b8021889986 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:mon.a smithi008 running (9m) 5s ago 9m 95.8M 2048M 18.0.0-6616-g14d8d032 c754feb42fd5 bb6cb7190b82 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:mon.b smithi156 running (7m) 5s ago 7m 62.7M 2048M 18.0.0-6616-g14d8d032 c754feb42fd5 3a841467e4e7 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:mon.c smithi190 running (7m) 5s ago 7m 64.6M 2048M 18.0.0-6616-g14d8d032 c754feb42fd5 3d3bd764b2f0 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (7m) 5s ago 7m 68.3M 4318M 18.0.0-6616-g14d8d032 c754feb42fd5 cb1190bbfeab 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi156 running (6m) 5s ago 6m 74.8M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 057fdaf728d8 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi190 running (6m) 5s ago 6m 71.4M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 19af6240bd3d 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi008 running (5m) 5s ago 5m 62.8M 4318M 18.0.0-6616-g14d8d032 c754feb42fd5 6adbdcfe2b43 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi156 running (5m) 5s ago 5m 61.9M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 cb7c10fc7a4a 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi190 running (4m) 5s ago 4m 64.6M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 caf158cfeec5 2023-10-06T23:12:30.455 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 smithi008 running (4m) 5s ago 4m 58.9M 4318M 18.0.0-6616-g14d8d032 c754feb42fd5 9e45cffca3dc 2023-10-06T23:12:30.456 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 smithi156 running (4m) 5s ago 4m 63.6M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 c04e6e246c11 2023-10-06T23:12:30.456 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 smithi190 running (3m) 5s ago 3m 61.4M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 5c453b14b5d0 2023-10-06T23:12:30.456 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 smithi008 running (3m) 5s ago 3m 55.5M 4318M 18.0.0-6616-g14d8d032 c754feb42fd5 45db738592ee 2023-10-06T23:12:30.456 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 smithi156 running (2m) 5s ago 2m 61.0M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 a4bb1ef22539 2023-10-06T23:12:30.456 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 smithi190 running (2m) 5s ago 2m 53.0M 4316M 18.0.0-6616-g14d8d032 c754feb42fd5 1d47c869f3e5 2023-10-06T23:12:30.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2f00a1480 msgr2=0x7fc2f00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2f00a1480 0x7fc2f00a3940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80059d0 tx=0x7fc2f8005960 comp rx=0 tx=0).stop 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 msgr2=0x7fc3081992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 0x7fc3081992d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00d950 tx=0x7fc2fc00dc60 comp rx=0 tx=0).stop 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 shutdown_connections 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2f00a1480 0x7fc2f00a3940 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc308108e80 0x7fc3081a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc308073890 0x7fc308198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 --2- 172.21.15.8:0/3746889711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc308074e60 0x7fc3081992d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 >> 172.21.15.8:0/3746889711 conn(0x7fc3080fc520 msgr2=0x7fc3080fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 shutdown_connections 2023-10-06T23:12:30.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:30.454+0000 7fc30e384700 1 -- 172.21.15.8:0/3746889711 wait complete. 2023-10-06T23:12:30.944 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-06T23:12:31.689 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:32.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:32 smithi008 ceph-mon[98532]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:32.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:32 smithi008 ceph-mon[98532]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:32.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:32 smithi156 ceph-mon[102862]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:32.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:32 smithi156 ceph-mon[102862]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:32.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:32 smithi190 ceph-mon[102658]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:32.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:32 smithi190 ceph-mon[102658]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-10-06T23:12:33.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 -- 172.21.15.8:0/1320421584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8100f70 msgr2=0x7f1bf8101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 --2- 172.21.15.8:0/1320421584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8100f70 0x7f1bf8101390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1be80099c0 tx=0x7f1be8009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 -- 172.21.15.8:0/1320421584 shutdown_connections 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 --2- 172.21.15.8:0/1320421584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8100f70 0x7f1bf8101390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 --2- 172.21.15.8:0/1320421584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bf8102b10 0x7f1bf81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 --2- 172.21.15.8:0/1320421584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf8102170 0x7f1bf81025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 -- 172.21.15.8:0/1320421584 >> 172.21.15.8:0/1320421584 conn(0x7f1bf80fc4d0 msgr2=0x7f1bf80fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 -- 172.21.15.8:0/1320421584 shutdown_connections 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.192+0000 7f1bfda62700 1 -- 172.21.15.8:0/1320421584 wait complete. 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.193+0000 7f1bfda62700 1 Processor -- start 2023-10-06T23:12:33.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.193+0000 7f1bfda62700 1 -- start start 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bfda62700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bf8100f70 0x7f1bf8074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bfda62700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf8102170 0x7f1bf80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bfda62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8102b10 0x7f1bf80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bfda62700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8073f60 con 0x7f1bf8102b10 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bfda62700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80740d0 con 0x7f1bf8102170 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bfda62700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf81a0c20 con 0x7f1bf8100f70 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bf7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8102b10 0x7f1bf80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bf77fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bf8100f70 0x7f1bf8074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:33.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bf7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8102b10 0x7f1bf80737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57016/0 (socket says 172.21.15.8:57016) 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bf77fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bf8100f70 0x7f1bf8074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45554/0 (socket says 172.21.15.8:45554) 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.194+0000 7f1bf7fff700 1 -- 172.21.15.8:0/3984748063 learned_addr learned my addr 172.21.15.8:0/3984748063 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf6ffd700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf8102170 0x7f1bf80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf7fff700 1 -- 172.21.15.8:0/3984748063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bf8100f70 msgr2=0x7f1bf8074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf7fff700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bf8100f70 0x7f1bf8074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf7fff700 1 -- 172.21.15.8:0/3984748063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf8102170 msgr2=0x7f1bf80732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf7fff700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf8102170 0x7f1bf80732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf7fff700 1 -- 172.21.15.8:0/3984748063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80095f0 con 0x7f1bf8102b10 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf6ffd700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf8102170 0x7f1bf80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf7fff700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8102b10 0x7f1bf80737e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0007ee0 tx=0x7f1bf000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf4ff9700 1 -- 172.21.15.8:0/3984748063 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0017070 con 0x7f1bf8102b10 2023-10-06T23:12:33.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf4ff9700 1 -- 172.21.15.8:0/3984748063 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bf000f040 con 0x7f1bf8102b10 2023-10-06T23:12:33.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf81a0f00 con 0x7f1bf8102b10 2023-10-06T23:12:33.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bf4ff9700 1 -- 172.21.15.8:0/3984748063 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0005710 con 0x7f1bf8102b10 2023-10-06T23:12:33.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.195+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf81a1370 con 0x7f1bf8102b10 2023-10-06T23:12:33.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.196+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf8107f40 con 0x7f1bf8102b10 2023-10-06T23:12:33.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.198+0000 7f1bf4ff9700 1 -- 172.21.15.8:0/3984748063 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1bf0005870 con 0x7f1bf8102b10 2023-10-06T23:12:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.200+0000 7f1bf4ff9700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1be00a1500 0x7f1be00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.200+0000 7f1bf4ff9700 1 -- 172.21.15.8:0/3984748063 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1bf00cc420 con 0x7f1bf8102b10 2023-10-06T23:12:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.200+0000 7f1bf77fe700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1be00a1500 0x7f1be00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.201+0000 7f1bf77fe700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1be00a1500 0x7f1be00a39c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1be8000c00 tx=0x7f1be8009f10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:33.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.204+0000 7f1bf4ff9700 1 -- 172.21.15.8:0/3984748063 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1bf0095a30 con 0x7f1bf8102b10 2023-10-06T23:12:33.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.425+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bf802d2e0 con 0x7f1be00a1500 2023-10-06T23:12:33.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.431+0000 7f1bf4ff9700 1 -- 172.21.15.8:0/3984748063 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f1bf802d2e0 con 0x7f1be00a1500 2023-10-06T23:12:33.433 INFO:teuthology.orchestra.run.smithi008.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-06T23:12:33.433 INFO:teuthology.orchestra.run.smithi008.stdout:mds.all 12/12 8s ago 119s smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2023-10-06T23:12:33.433 INFO:teuthology.orchestra.run.smithi008.stdout:mgr 3/3 8s ago 7m smithi008=x;smithi156=y;smithi190=z;count:3 2023-10-06T23:12:33.433 INFO:teuthology.orchestra.run.smithi008.stdout:mon 3/3 8s ago 8m smithi008:172.21.15.8=a;smithi156:172.21.15.156=b;smithi190:172.21.15.190=c;count:3 2023-10-06T23:12:33.433 INFO:teuthology.orchestra.run.smithi008.stdout:osd 12 8s ago - 2023-10-06T23:12:33.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1be00a1500 msgr2=0x7f1be00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:33.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1be00a1500 0x7f1be00a39c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1be8000c00 tx=0x7f1be8009f10 comp rx=0 tx=0).stop 2023-10-06T23:12:33.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8102b10 msgr2=0x7f1bf80737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:33.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8102b10 0x7f1bf80737e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0007ee0 tx=0x7f1bf000d3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 shutdown_connections 2023-10-06T23:12:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1be00a1500 0x7f1be00a39c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1bf8102b10 0x7f1bf80737e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bf8100f70 0x7f1bf8074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 --2- 172.21.15.8:0/3984748063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf8102170 0x7f1bf80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 >> 172.21.15.8:0/3984748063 conn(0x7f1bf80fc4d0 msgr2=0x7f1bf80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 shutdown_connections 2023-10-06T23:12:33.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:33.434+0000 7f1bfda62700 1 -- 172.21.15.8:0/3984748063 wait complete. 2023-10-06T23:12:33.585 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:33 smithi008 ceph-mon[98532]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:33.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:33 smithi156 ceph-mon[102862]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:33 smithi190 ceph-mon[102658]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:33.967 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-06T23:12:34.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:34 smithi156 ceph-mon[102862]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:34.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:34 smithi008 ceph-mon[98532]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:34.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:34 smithi190 ceph-mon[102658]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:34.704 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:35.530 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:35 smithi008 ceph-mon[98532]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:35.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:35 smithi156 ceph-mon[102862]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:35.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:35 smithi190 ceph-mon[102658]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:36.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 -- 172.21.15.8:0/24976103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 msgr2=0x7fda5c101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:36.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 --2- 172.21.15.8:0/24976103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 0x7fda5c101390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0099c0 tx=0x7fda4c009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 -- 172.21.15.8:0/24976103 shutdown_connections 2023-10-06T23:12:36.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 --2- 172.21.15.8:0/24976103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 0x7fda5c101390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 --2- 172.21.15.8:0/24976103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda5c102b10 0x7fda5c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 --2- 172.21.15.8:0/24976103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda5c102170 0x7fda5c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 -- 172.21.15.8:0/24976103 >> 172.21.15.8:0/24976103 conn(0x7fda5c0fc4d0 msgr2=0x7fda5c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:36.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 -- 172.21.15.8:0/24976103 shutdown_connections 2023-10-06T23:12:36.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.219+0000 7fda60ac8700 1 -- 172.21.15.8:0/24976103 wait complete. 2023-10-06T23:12:36.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.220+0000 7fda60ac8700 1 Processor -- start 2023-10-06T23:12:36.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.220+0000 7fda60ac8700 1 -- start start 2023-10-06T23:12:36.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.220+0000 7fda60ac8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 0x7fda5c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:36.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.220+0000 7fda60ac8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda5c102170 0x7fda5c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.220+0000 7fda60ac8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda5c102b10 0x7fda5c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.220+0000 7fda60ac8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c1a08e0 con 0x7fda5c100f70 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.220+0000 7fda60ac8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c1a0a20 con 0x7fda5c102b10 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.220+0000 7fda60ac8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c1a0bb0 con 0x7fda5c102170 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 0x7fda5c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 0x7fda5c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57038/0 (socket says 172.21.15.8:57038) 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 -- 172.21.15.8:0/3813967100 learned_addr learned my addr 172.21.15.8:0/3813967100 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5ad9d700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda5c102b10 0x7fda5c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda59d9b700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda5c102170 0x7fda5c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 -- 172.21.15.8:0/3813967100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda5c102170 msgr2=0x7fda5c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda5c102170 0x7fda5c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 -- 172.21.15.8:0/3813967100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda5c102b10 msgr2=0x7fda5c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda5c102b10 0x7fda5c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 -- 172.21.15.8:0/3813967100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c0095f0 con 0x7fda5c100f70 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5ad9d700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda5c102b10 0x7fda5c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda59d9b700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda5c102170 0x7fda5c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.221+0000 7fda5a59c700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 0x7fda5c198d50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0098e0 tx=0x7fda4c00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.222+0000 7fda4b7fe700 1 -- 172.21.15.8:0/3813967100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c01d070 con 0x7fda5c100f70 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.222+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c1a0e30 con 0x7fda5c100f70 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.222+0000 7fda4b7fe700 1 -- 172.21.15.8:0/3813967100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda4c0059a0 con 0x7fda5c100f70 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.222+0000 7fda4b7fe700 1 -- 172.21.15.8:0/3813967100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0173f0 con 0x7fda5c100f70 2023-10-06T23:12:36.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.222+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c1a1240 con 0x7fda5c100f70 2023-10-06T23:12:36.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.223+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c10c690 con 0x7fda5c100f70 2023-10-06T23:12:36.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.225+0000 7fda4b7fe700 1 -- 172.21.15.8:0/3813967100 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fda4c022470 con 0x7fda5c100f70 2023-10-06T23:12:36.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.227+0000 7fda4b7fe700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda440a1500 0x7fda440a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:36.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.228+0000 7fda4b7fe700 1 -- 172.21.15.8:0/3813967100 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fda4c0cde60 con 0x7fda5c100f70 2023-10-06T23:12:36.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.228+0000 7fda59d9b700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda440a1500 0x7fda440a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:36.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.228+0000 7fda59d9b700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda440a1500 0x7fda440a39c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda50009be0 tx=0x7fda50009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.231+0000 7fda4b7fe700 1 -- 172.21.15.8:0/3813967100 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fda4c097590 con 0x7fda5c100f70 2023-10-06T23:12:36.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.448+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fda5c108b70 con 0x7fda440a1500 2023-10-06T23:12:36.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.449+0000 7fda4b7fe700 1 -- 172.21.15.8:0/3813967100 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fda5c108b70 con 0x7fda440a1500 2023-10-06T23:12:36.450 INFO:teuthology.orchestra.run.smithi008.stdout:HOST ADDR LABELS STATUS 2023-10-06T23:12:36.451 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 172.21.15.8 2023-10-06T23:12:36.451 INFO:teuthology.orchestra.run.smithi008.stdout:smithi156 172.21.15.156 2023-10-06T23:12:36.451 INFO:teuthology.orchestra.run.smithi008.stdout:smithi190 172.21.15.190 2023-10-06T23:12:36.451 INFO:teuthology.orchestra.run.smithi008.stdout:3 hosts in cluster 2023-10-06T23:12:36.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda440a1500 msgr2=0x7fda440a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:36.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda440a1500 0x7fda440a39c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda50009be0 tx=0x7fda50009260 comp rx=0 tx=0).stop 2023-10-06T23:12:36.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 msgr2=0x7fda5c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:36.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 0x7fda5c198d50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0098e0 tx=0x7fda4c00fab0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 shutdown_connections 2023-10-06T23:12:36.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fda440a1500 0x7fda440a39c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda5c100f70 0x7fda5c198d50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda5c102b10 0x7fda5c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 --2- 172.21.15.8:0/3813967100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda5c102170 0x7fda5c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:36.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.451+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 >> 172.21.15.8:0/3813967100 conn(0x7fda5c0fc4d0 msgr2=0x7fda5c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:36.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.452+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 shutdown_connections 2023-10-06T23:12:36.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:36.452+0000 7fda60ac8700 1 -- 172.21.15.8:0/3813967100 wait complete. 2023-10-06T23:12:36.986 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-06T23:12:37.726 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:38.318 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:38 smithi008 ceph-mon[98532]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:38.318 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:38 smithi008 ceph-mon[98532]: pgmap v342: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:38.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:38 smithi156 ceph-mon[102862]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:38.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:38 smithi156 ceph-mon[102862]: pgmap v342: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:38 smithi190 ceph-mon[102658]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:38.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:38 smithi190 ceph-mon[102658]: pgmap v342: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 -- 172.21.15.8:0/382323729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0102170 msgr2=0x7fc6f01025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 --2- 172.21.15.8:0/382323729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0102170 0x7fc6f01025d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00099c0 tx=0x7fc6e0009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 -- 172.21.15.8:0/382323729 shutdown_connections 2023-10-06T23:12:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 --2- 172.21.15.8:0/382323729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6f0102b10 0x7fc6f01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 --2- 172.21.15.8:0/382323729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0100f70 0x7fc6f0101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 --2- 172.21.15.8:0/382323729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0102170 0x7fc6f01025d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 -- 172.21.15.8:0/382323729 >> 172.21.15.8:0/382323729 conn(0x7fc6f00fc4d0 msgr2=0x7fc6f00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 -- 172.21.15.8:0/382323729 shutdown_connections 2023-10-06T23:12:39.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.267+0000 7fc6f864b700 1 -- 172.21.15.8:0/382323729 wait complete. 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.269+0000 7fc6f864b700 1 Processor -- start 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.269+0000 7fc6f864b700 1 -- start start 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f864b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0100f70 0x7fc6f0074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f864b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102170 0x7fc6f00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f864b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6f0102b10 0x7fc6f00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f864b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0073f60 con 0x7fc6f0100f70 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f864b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00740d0 con 0x7fc6f0102b10 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f864b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01a0bd0 con 0x7fc6f0102170 2023-10-06T23:12:39.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f63e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0100f70 0x7fc6f0074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f63e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0100f70 0x7fc6f0074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57056/0 (socket says 172.21.15.8:57056) 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f63e7700 1 -- 172.21.15.8:0/310556878 learned_addr learned my addr 172.21.15.8:0/310556878 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f5be6700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102170 0x7fc6f00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f6be8700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6f0102b10 0x7fc6f00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f63e7700 1 -- 172.21.15.8:0/310556878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102170 msgr2=0x7fc6f00732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f63e7700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102170 0x7fc6f00732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f63e7700 1 -- 172.21.15.8:0/310556878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6f0102b10 msgr2=0x7fc6f00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f63e7700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6f0102b10 0x7fc6f00737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f63e7700 1 -- 172.21.15.8:0/310556878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e00095f0 con 0x7fc6f0100f70 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.270+0000 7fc6f6be8700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6f0102b10 0x7fc6f00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.271+0000 7fc6f63e7700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0100f70 0x7fc6f0074c50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00d980 tx=0x7fc6ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.271+0000 7fc6e77fe700 1 -- 172.21.15.8:0/310556878 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec004020 con 0x7fc6f0100f70 2023-10-06T23:12:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.271+0000 7fc6e77fe700 1 -- 172.21.15.8:0/310556878 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc6ec009730 con 0x7fc6f0100f70 2023-10-06T23:12:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.271+0000 7fc6e77fe700 1 -- 172.21.15.8:0/310556878 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec003a00 con 0x7fc6f0100f70 2023-10-06T23:12:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.271+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f01a0eb0 con 0x7fc6f0100f70 2023-10-06T23:12:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.271+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f01a12c0 con 0x7fc6f0100f70 2023-10-06T23:12:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.272+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f0108640 con 0x7fc6f0100f70 2023-10-06T23:12:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.274+0000 7fc6e77fe700 1 -- 172.21.15.8:0/310556878 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc6ec0098a0 con 0x7fc6f0100f70 2023-10-06T23:12:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.275+0000 7fc6e77fe700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc6dc0a1500 0x7fc6dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.276+0000 7fc6e77fe700 1 -- 172.21.15.8:0/310556878 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc6ec0cc990 con 0x7fc6f0100f70 2023-10-06T23:12:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.276+0000 7fc6f5be6700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc6dc0a1500 0x7fc6dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.276+0000 7fc6f5be6700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc6dc0a1500 0x7fc6dc0a39c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009f50 tx=0x7fc6e000bfb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.280+0000 7fc6e77fe700 1 -- 172.21.15.8:0/310556878 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc6ec095fa0 con 0x7fc6f0100f70 2023-10-06T23:12:39.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.499+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6f010c620 con 0x7fc6dc0a1500 2023-10-06T23:12:39.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.501+0000 7fc6e77fe700 1 -- 172.21.15.8:0/310556878 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fc6f010c620 con 0x7fc6dc0a1500 2023-10-06T23:12:39.503 INFO:teuthology.orchestra.run.smithi008.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-06T23:12:39.504 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476004A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2023-10-06T23:12:39.504 INFO:teuthology.orchestra.run.smithi008.stdout:smithi156 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB74760040480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-06T23:12:39.504 INFO:teuthology.orchestra.run.smithi008.stdout:smithi190 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT63210012400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc6dc0a1500 msgr2=0x7fc6dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc6dc0a1500 0x7fc6dc0a39c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009f50 tx=0x7fc6e000bfb0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0100f70 msgr2=0x7fc6f0074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0100f70 0x7fc6f0074c50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00d980 tx=0x7fc6ec00dc90 comp rx=0 tx=0).stop 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 shutdown_connections 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc6dc0a1500 0x7fc6dc0a39c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6f0100f70 0x7fc6f0074c50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6f0102b10 0x7fc6f00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 --2- 172.21.15.8:0/310556878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102170 0x7fc6f00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:39.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 >> 172.21.15.8:0/310556878 conn(0x7fc6f00fc4d0 msgr2=0x7fc6f0105780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 shutdown_connections 2023-10-06T23:12:39.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:39.504+0000 7fc6f864b700 1 -- 172.21.15.8:0/310556878 wait complete. 2023-10-06T23:12:40.004 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-06T23:12:40.016 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T23:12:40.016 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-06T23:12:40.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:40 smithi156 ceph-mon[102862]: pgmap v343: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:40.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:40 smithi008 ceph-mon[98532]: pgmap v343: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:40 smithi190 ceph-mon[102658]: pgmap v343: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:40.774 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:41.326 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:41 smithi008 ceph-mon[98532]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:41.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:41 smithi156 ceph-mon[102862]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:41.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:41 smithi190 ceph-mon[102658]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-06T23:12:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.283+0000 7f5483e5b700 1 -- 172.21.15.8:0/3280249912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102b10 msgr2=0x7f547c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.283+0000 7f5483e5b700 1 --2- 172.21.15.8:0/3280249912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102b10 0x7f547c1093c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f547400b0d0 tx=0x7f547400b3e0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.284+0000 7f5483e5b700 1 -- 172.21.15.8:0/3280249912 shutdown_connections 2023-10-06T23:12:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.284+0000 7f5483e5b700 1 --2- 172.21.15.8:0/3280249912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102b10 0x7f547c1093c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.284+0000 7f5483e5b700 1 --2- 172.21.15.8:0/3280249912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f547c100f70 0x7f547c101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.284+0000 7f5483e5b700 1 --2- 172.21.15.8:0/3280249912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f547c102170 0x7f547c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.284+0000 7f5483e5b700 1 -- 172.21.15.8:0/3280249912 >> 172.21.15.8:0/3280249912 conn(0x7f547c0fc4d0 msgr2=0x7f547c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.284+0000 7f5483e5b700 1 -- 172.21.15.8:0/3280249912 shutdown_connections 2023-10-06T23:12:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.284+0000 7f5483e5b700 1 -- 172.21.15.8:0/3280249912 wait complete. 2023-10-06T23:12:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f5483e5b700 1 Processor -- start 2023-10-06T23:12:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f5483e5b700 1 -- start start 2023-10-06T23:12:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f5483e5b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f547c100f70 0x7f547c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f5483e5b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102170 0x7f547c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f5483e5b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f547c102b10 0x7f547c19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f5483e5b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19e700 con 0x7f547c102170 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f5483e5b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19e840 con 0x7f547c100f70 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f5483e5b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c19e9d0 con 0x7f547c102b10 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.285+0000 7f54813f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102170 0x7f547c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54813f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102170 0x7f547c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36562/0 (socket says 172.21.15.8:36562) 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54813f6700 1 -- 172.21.15.8:0/698642685 learned_addr learned my addr 172.21.15.8:0/698642685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f5481bf7700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f547c100f70 0x7f547c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54823f8700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f547c102b10 0x7f547c19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54813f6700 1 -- 172.21.15.8:0/698642685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f547c102b10 msgr2=0x7f547c19e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54813f6700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f547c102b10 0x7f547c19e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54813f6700 1 -- 172.21.15.8:0/698642685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f547c100f70 msgr2=0x7f547c196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54813f6700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f547c100f70 0x7f547c196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54813f6700 1 -- 172.21.15.8:0/698642685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474009d00 con 0x7f547c102170 2023-10-06T23:12:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.286+0000 7f54813f6700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102170 0x7f547c1970b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c9e0 tx=0x7f546c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.287+0000 7f5472ffd700 1 -- 172.21.15.8:0/698642685 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c007ac0 con 0x7f547c102170 2023-10-06T23:12:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.287+0000 7f5472ffd700 1 -- 172.21.15.8:0/698642685 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f546c00ce80 con 0x7f547c102170 2023-10-06T23:12:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.287+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c19ecb0 con 0x7f547c102170 2023-10-06T23:12:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.287+0000 7f5472ffd700 1 -- 172.21.15.8:0/698642685 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c018400 con 0x7f547c102170 2023-10-06T23:12:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.287+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c19f1b0 con 0x7f547c102170 2023-10-06T23:12:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.288+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c10c680 con 0x7f547c102170 2023-10-06T23:12:42.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.290+0000 7f5472ffd700 1 -- 172.21.15.8:0/698642685 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f546c00f450 con 0x7f547c102170 2023-10-06T23:12:42.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.291+0000 7f5472ffd700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f54680a1500 0x7f54680a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.291+0000 7f5472ffd700 1 -- 172.21.15.8:0/698642685 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f546c0ccc10 con 0x7f547c102170 2023-10-06T23:12:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.292+0000 7f5481bf7700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f54680a1500 0x7f54680a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.292+0000 7f5481bf7700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f54680a1500 0x7f54680a39c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f547c101fd0 tx=0x7f547800a3b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:42.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.295+0000 7f5472ffd700 1 -- 172.21.15.8:0/698642685 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f546c096220 con 0x7f547c102170 2023-10-06T23:12:42.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:42 smithi156 ceph-mon[102862]: pgmap v344: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:42 smithi008 ceph-mon[98532]: pgmap v344: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:42 smithi190 ceph-mon[102658]: pgmap v344: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.550+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f547c107d90 con 0x7f547c102170 2023-10-06T23:12:42.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.551+0000 7f5472ffd700 1 -- 172.21.15.8:0/698642685 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2933 (secure 0 0 0) 0x7f546c099840 con 0x7f547c102170 2023-10-06T23:12:42.553 INFO:teuthology.orchestra.run.smithi008.stdout:e23 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 23 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-06T23:11:17.784448+0000 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-06T23:11:23.244586+0000 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-06T23:12:42.554 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 300 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:max_xattr_size 65536 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 3 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1,2 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=24581,1=24568,2=24526} 2023-10-06T23:12:42.555 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:bal_rank_mask -1 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 0 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b{0:24581} state up:active seq 3 addr [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.h{0:24539} state up:standby-replay seq 1 addr [v2:172.21.15.156:6836/2054249175,v1:172.21.15.156:6837/2054249175] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.i{1:24568} state up:active seq 6 addr [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c{1:24538} state up:standby-replay seq 1 addr [v2:172.21.15.190:6836/3967292194,v1:172.21.15.190:6837/3967292194] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.556 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.f{2:24526} state up:active seq 9 addr [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.e{2:24506} state up:standby-replay seq 1 addr [v2:172.21.15.156:6834/3086367655,v1:172.21.15.156:6835/3086367655] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d{-1:14601} state up:standby seq 1 addr [v2:172.21.15.8:6836/3213157438,v1:172.21.15.8:6837/3213157438] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.g{-1:14664} state up:standby seq 1 addr [v2:172.21.15.8:6838/1169721104,v1:172.21.15.8:6839/1169721104] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a{-1:14682} state up:standby seq 1 addr [v2:172.21.15.8:6840/686934069,v1:172.21.15.8:6841/686934069] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.k{-1:24470} state up:standby seq 1 addr [v2:172.21.15.156:6832/865735895,v1:172.21.15.156:6833/865735895] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.l{-1:24472} state up:standby seq 1 addr [v2:172.21.15.190:6832/345838273,v1:172.21.15.190:6833/345838273] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.557 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.j{-1:24485} state up:standby seq 1 addr [v2:172.21.15.8:6834/3180877421,v1:172.21.15.8:6835/3180877421] compat {c=[1],r=[1],i=[fff]}] 2023-10-06T23:12:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f54680a1500 msgr2=0x7f54680a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f54680a1500 0x7f54680a39c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f547c101fd0 tx=0x7f547800a3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102170 msgr2=0x7f547c1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102170 0x7f547c1970b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c9e0 tx=0x7f546c00ccf0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 shutdown_connections 2023-10-06T23:12:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f54680a1500 0x7f54680a39c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f547c102b10 0x7f547c19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f547c100f70 0x7f547c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 --2- 172.21.15.8:0/698642685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f547c102170 0x7f547c1970b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.553+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 >> 172.21.15.8:0/698642685 conn(0x7f547c0fc4d0 msgr2=0x7f547c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.554+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 shutdown_connections 2023-10-06T23:12:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:42.554+0000 7f5483e5b700 1 -- 172.21.15.8:0/698642685 wait complete. 2023-10-06T23:12:42.559 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:12:43.155 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-06T23:12:43.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:43 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/698642685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-06T23:12:43.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:43 smithi008 ceph-mon[98532]: pgmap v345: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:43.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:43 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/698642685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-06T23:12:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:43 smithi156 ceph-mon[102862]: pgmap v345: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:43 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/698642685' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-06T23:12:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:43 smithi190 ceph-mon[102658]: pgmap v345: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 -- 172.21.15.8:0/2624790038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 msgr2=0x7fc40c101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 --2- 172.21.15.8:0/2624790038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 0x7fc40c101390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0099c0 tx=0x7fc3fc009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 -- 172.21.15.8:0/2624790038 shutdown_connections 2023-10-06T23:12:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 --2- 172.21.15.8:0/2624790038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 0x7fc40c101390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 --2- 172.21.15.8:0/2624790038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc40c102b10 0x7fc40c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 --2- 172.21.15.8:0/2624790038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc40c102170 0x7fc40c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 -- 172.21.15.8:0/2624790038 >> 172.21.15.8:0/2624790038 conn(0x7fc40c0fc4d0 msgr2=0x7fc40c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 -- 172.21.15.8:0/2624790038 shutdown_connections 2023-10-06T23:12:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.374+0000 7fc410943700 1 -- 172.21.15.8:0/2624790038 wait complete. 2023-10-06T23:12:45.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.375+0000 7fc410943700 1 Processor -- start 2023-10-06T23:12:45.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.375+0000 7fc410943700 1 -- start start 2023-10-06T23:12:45.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc410943700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 0x7fc40c074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc410943700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc40c102170 0x7fc40c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc410943700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc40c102b10 0x7fc40c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc410943700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c073f60 con 0x7fc40c100f70 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc410943700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0740d0 con 0x7fc40c102b10 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc410943700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c1a0bd0 con 0x7fc40c102170 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 0x7fc40c074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 0x7fc40c074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36582/0 (socket says 172.21.15.8:36582) 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40a59c700 1 -- 172.21.15.8:0/1720671897 learned_addr learned my addr 172.21.15.8:0/1720671897 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc409d9b700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc40c102170 0x7fc40c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40ad9d700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc40c102b10 0x7fc40c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40a59c700 1 -- 172.21.15.8:0/1720671897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc40c102170 msgr2=0x7fc40c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40a59c700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc40c102170 0x7fc40c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40a59c700 1 -- 172.21.15.8:0/1720671897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc40c102b10 msgr2=0x7fc40c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40a59c700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc40c102b10 0x7fc40c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.376+0000 7fc40a59c700 1 -- 172.21.15.8:0/1720671897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0095f0 con 0x7fc40c100f70 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.377+0000 7fc40a59c700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 0x7fc40c074c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0098e0 tx=0x7fc3fc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.377+0000 7fc3fb7fe700 1 -- 172.21.15.8:0/1720671897 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc01d070 con 0x7fc40c100f70 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.377+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c1a0e50 con 0x7fc40c100f70 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.377+0000 7fc3fb7fe700 1 -- 172.21.15.8:0/1720671897 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3fc003f80 con 0x7fc40c100f70 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.377+0000 7fc3fb7fe700 1 -- 172.21.15.8:0/1720671897 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc022c40 con 0x7fc40c100f70 2023-10-06T23:12:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.377+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c1a1200 con 0x7fc40c100f70 2023-10-06T23:12:45.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.378+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c10c670 con 0x7fc40c100f70 2023-10-06T23:12:45.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.380+0000 7fc3fb7fe700 1 -- 172.21.15.8:0/1720671897 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc3fc022470 con 0x7fc40c100f70 2023-10-06T23:12:45.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.382+0000 7fc3fb7fe700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3f40a1480 0x7fc3f40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.383+0000 7fc3fb7fe700 1 -- 172.21.15.8:0/1720671897 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc3fc0ce900 con 0x7fc40c100f70 2023-10-06T23:12:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.383+0000 7fc409d9b700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3f40a1480 0x7fc3f40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:45.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.383+0000 7fc409d9b700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3f40a1480 0x7fc3f40a3940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc400005950 tx=0x7fc40000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:45.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.385+0000 7fc3fb7fe700 1 -- 172.21.15.8:0/1720671897 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc3fc097fa0 con 0x7fc40c100f70 2023-10-06T23:12:45.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.607+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fc40c107f20 con 0x7fc40c100f70 2023-10-06T23:12:45.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.608+0000 7fc3fb7fe700 1 -- 172.21.15.8:0/1720671897 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5253 (secure 0 0 0) 0x7fc3fc09b5c0 con 0x7fc40c100f70 2023-10-06T23:12:45.610 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 88 2023-10-06T23:12:45.610 INFO:teuthology.orchestra.run.smithi008.stdout:fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:12:45.611 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-06T23:02:51.456001+0000 2023-10-06T23:12:45.611 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-06T23:11:50.023175+0000 2023-10-06T23:12:45.611 INFO:teuthology.orchestra.run.smithi008.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-06T23:12:45.611 INFO:teuthology.orchestra.run.smithi008.stdout:crush_version 26 2023-10-06T23:12:45.611 INFO:teuthology.orchestra.run.smithi008.stdout:full_ratio 0.95 2023-10-06T23:12:45.611 INFO:teuthology.orchestra.run.smithi008.stdout:backfillfull_ratio 0.9 2023-10-06T23:12:45.612 INFO:teuthology.orchestra.run.smithi008.stdout:nearfull_ratio 0.85 2023-10-06T23:12:45.612 INFO:teuthology.orchestra.run.smithi008.stdout:require_min_compat_client luminous 2023-10-06T23:12:45.612 INFO:teuthology.orchestra.run.smithi008.stdout:min_compat_client luminous 2023-10-06T23:12:45.612 INFO:teuthology.orchestra.run.smithi008.stdout:require_osd_release reef 2023-10-06T23:12:45.612 INFO:teuthology.orchestra.run.smithi008.stdout:stretch_mode_enabled false 2023-10-06T23:12:45.612 INFO:teuthology.orchestra.run.smithi008.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-06T23:12:45.613 INFO:teuthology.orchestra.run.smithi008.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-06T23:12:45.613 INFO:teuthology.orchestra.run.smithi008.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-10-06T23:12:45.613 INFO:teuthology.orchestra.run.smithi008.stdout:max_osd 12 2023-10-06T23:12:45.613 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6802/36091553,v1:172.21.15.8:6803/36091553] [v2:172.21.15.8:6804/36091553,v1:172.21.15.8:6805/36091553] exists,up 33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa 2023-10-06T23:12:45.613 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6800/2428171530,v1:172.21.15.156:6801/2428171530] [v2:172.21.15.156:6802/2428171530,v1:172.21.15.156:6803/2428171530] exists,up f340f2e0-7165-45d3-9222-f55119169cfc 2023-10-06T23:12:45.613 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6800/2202331729,v1:172.21.15.190:6801/2202331729] [v2:172.21.15.190:6802/2202331729,v1:172.21.15.190:6803/2202331729] exists,up 0986122c-3438-4e4e-bad5-857c27371b25 2023-10-06T23:12:45.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6810/322809496,v1:172.21.15.8:6811/322809496] [v2:172.21.15.8:6812/322809496,v1:172.21.15.8:6813/322809496] exists,up 956d60a4-72e7-4072-8e10-396101b01a36 2023-10-06T23:12:45.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 up in weight 1 up_from 34 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6808/2478764015,v1:172.21.15.156:6809/2478764015] [v2:172.21.15.156:6810/2478764015,v1:172.21.15.156:6811/2478764015] exists,up f7560640-14b6-458a-adfe-dae3821de4fe 2023-10-06T23:12:45.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 up in weight 1 up_from 39 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6808/2047362324,v1:172.21.15.190:6809/2047362324] [v2:172.21.15.190:6810/2047362324,v1:172.21.15.190:6811/2047362324] exists,up 7c9e854b-52ad-4f73-a354-e0ca49b57389 2023-10-06T23:12:45.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 up in weight 1 up_from 47 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6818/1054185701,v1:172.21.15.8:6819/1054185701] [v2:172.21.15.8:6820/1054185701,v1:172.21.15.8:6821/1054185701] exists,up 2d19254b-4665-4044-806b-2db2a15ece1c 2023-10-06T23:12:45.614 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 up in weight 1 up_from 52 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6816/3888485282,v1:172.21.15.156:6817/3888485282] [v2:172.21.15.156:6818/3888485282,v1:172.21.15.156:6819/3888485282] exists,up 0631aa31-44e8-4f3b-8306-b7c9d5a64d02 2023-10-06T23:12:45.615 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 up in weight 1 up_from 60 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6816/1600949484,v1:172.21.15.190:6817/1600949484] [v2:172.21.15.190:6818/1600949484,v1:172.21.15.190:6819/1600949484] exists,up 491859be-3372-46a8-be19-6b70bee94107 2023-10-06T23:12:45.615 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 up in weight 1 up_from 68 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6826/3250757826,v1:172.21.15.8:6827/3250757826] [v2:172.21.15.8:6828/3250757826,v1:172.21.15.8:6829/3250757826] exists,up 4ed52c56-1603-45a4-b9dd-aa6c07d0181c 2023-10-06T23:12:45.615 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 up in weight 1 up_from 73 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6824/3857289859,v1:172.21.15.156:6825/3857289859] [v2:172.21.15.156:6826/3857289859,v1:172.21.15.156:6827/3857289859] exists,up 8f6af790-47f8-4faf-80de-d04e11236910 2023-10-06T23:12:45.615 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6824/2460808720,v1:172.21.15.190:6825/2460808720] [v2:172.21.15.190:6826/2460808720,v1:172.21.15.190:6827/2460808720] exists,up d7d0e66f-912f-4088-bf84-ef021b8a2883 2023-10-06T23:12:45.615 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.5 [8,11] 2023-10-06T23:12:45.615 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.e [2,1] 2023-10-06T23:12:45.616 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.f [8,11] 2023-10-06T23:12:45.616 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.1d [2,4] 2023-10-06T23:12:45.616 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.1 [4,9] 2023-10-06T23:12:45.616 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.e [5,9] 2023-10-06T23:12:45.616 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.36 [4,9] 2023-10-06T23:12:45.616 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.3a [4,8] 2023-10-06T23:12:45.617 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/2416919540 expires 2023-10-07T23:03:48.853244+0000 2023-10-06T23:12:45.617 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/297059453 expires 2023-10-07T23:03:48.853244+0000 2023-10-06T23:12:45.617 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2948074146 expires 2023-10-07T23:03:21.609864+0000 2023-10-06T23:12:45.617 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/2416919540 expires 2023-10-07T23:03:48.853244+0000 2023-10-06T23:12:45.617 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/3650897985 expires 2023-10-07T23:03:21.609864+0000 2023-10-06T23:12:45.617 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2349179296 expires 2023-10-07T23:03:48.853244+0000 2023-10-06T23:12:45.618 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/166376639 expires 2023-10-07T23:03:21.609864+0000 2023-10-06T23:12:45.618 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/166376639 expires 2023-10-07T23:03:21.609864+0000 2023-10-06T23:12:45.618 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2680339710 expires 2023-10-07T23:03:21.609864+0000 2023-10-06T23:12:45.618 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2455618842 expires 2023-10-07T23:03:48.853244+0000 2023-10-06T23:12:45.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.610+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3f40a1480 msgr2=0x7fc3f40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:45.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.610+0000 7fc410943700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3f40a1480 0x7fc3f40a3940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc400005950 tx=0x7fc40000b410 comp rx=0 tx=0).stop 2023-10-06T23:12:45.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.610+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 msgr2=0x7fc40c074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:45.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.610+0000 7fc410943700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 0x7fc40c074c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0098e0 tx=0x7fc3fc009580 comp rx=0 tx=0).stop 2023-10-06T23:12:45.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.611+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 shutdown_connections 2023-10-06T23:12:45.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.611+0000 7fc410943700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3f40a1480 0x7fc3f40a3940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.611+0000 7fc410943700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc40c100f70 0x7fc40c074c50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.611+0000 7fc410943700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc40c102b10 0x7fc40c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.611+0000 7fc410943700 1 --2- 172.21.15.8:0/1720671897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc40c102170 0x7fc40c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:45.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.611+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 >> 172.21.15.8:0/1720671897 conn(0x7fc40c0fc4d0 msgr2=0x7fc40c0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:45.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.611+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 shutdown_connections 2023-10-06T23:12:45.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:45.611+0000 7fc410943700 1 -- 172.21.15.8:0/1720671897 wait complete. 2023-10-06T23:12:46.173 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-06T23:12:46.187 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:12:46.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:46 smithi156 ceph-mon[102862]: pgmap v346: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:46.350 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:46 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1720671897' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-06T23:12:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:46 smithi008 ceph-mon[98532]: pgmap v346: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:46 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1720671897' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-06T23:12:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.394+0000 7f888b7ff700 1 -- 172.21.15.8:0/1679781169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 msgr2=0x7f8884102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.394+0000 7f888b7ff700 1 --2- 172.21.15.8:0/1679781169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 0x7f8884102500 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8874009990 tx=0x7f8874009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.395+0000 7f888b7ff700 1 -- 172.21.15.8:0/1679781169 shutdown_connections 2023-10-06T23:12:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.395+0000 7f888b7ff700 1 --2- 172.21.15.8:0/1679781169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8884102a40 0x7f8884109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.395+0000 7f888b7ff700 1 --2- 172.21.15.8:0/1679781169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8884100ea0 0x7f88841012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.395+0000 7f888b7ff700 1 --2- 172.21.15.8:0/1679781169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 0x7f8884102500 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.395+0000 7f888b7ff700 1 -- 172.21.15.8:0/1679781169 >> 172.21.15.8:0/1679781169 conn(0x7f88840fc420 msgr2=0x7f88840fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.395+0000 7f888b7ff700 1 -- 172.21.15.8:0/1679781169 shutdown_connections 2023-10-06T23:12:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.395+0000 7f888b7ff700 1 -- 172.21.15.8:0/1679781169 wait complete. 2023-10-06T23:12:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.396+0000 7f888b7ff700 1 Processor -- start 2023-10-06T23:12:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.396+0000 7f888b7ff700 1 -- start start 2023-10-06T23:12:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.396+0000 7f888b7ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8884100ea0 0x7f8884196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.396+0000 7f888b7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 0x7f8884197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f888b7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8884102a40 0x7f888419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f888b7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888419e6d0 con 0x7f8884102080 2023-10-06T23:12:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f888b7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888419e810 con 0x7f8884102a40 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f888b7ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888419e9a0 con 0x7f8884100ea0 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 0x7f8884197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 0x7f8884197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36604/0 (socket says 172.21.15.8:36604) 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 -- 172.21.15.8:0/279510685 learned_addr learned my addr 172.21.15.8:0/279510685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8889d9c700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8884102a40 0x7f888419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f888959b700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8884100ea0 0x7f8884196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 -- 172.21.15.8:0/279510685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8884100ea0 msgr2=0x7f8884196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8884100ea0 0x7f8884196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 -- 172.21.15.8:0/279510685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8884102a40 msgr2=0x7f888419e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8884102a40 0x7f888419e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 -- 172.21.15.8:0/279510685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740095f0 con 0x7f8884102080 2023-10-06T23:12:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f888959b700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8884100ea0 0x7f8884196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:46.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.397+0000 7f8888d9a700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 0x7f8884197090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8874004730 tx=0x7f8874005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:46.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.398+0000 7f887a7fc700 1 -- 172.21.15.8:0/279510685 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887401d070 con 0x7f8884102080 2023-10-06T23:12:46.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.398+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888419ec20 con 0x7f8884102080 2023-10-06T23:12:46.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.398+0000 7f887a7fc700 1 -- 172.21.15.8:0/279510685 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8874004ca0 con 0x7f8884102080 2023-10-06T23:12:46.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.398+0000 7f887a7fc700 1 -- 172.21.15.8:0/279510685 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874003d90 con 0x7f8884102080 2023-10-06T23:12:46.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.398+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888419f050 con 0x7f8884102080 2023-10-06T23:12:46.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.399+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88841085e0 con 0x7f8884102080 2023-10-06T23:12:46.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.401+0000 7f887a7fc700 1 -- 172.21.15.8:0/279510685 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8874004810 con 0x7f8884102080 2023-10-06T23:12:46.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.402+0000 7f887a7fc700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f88700a14d0 0x7f88700a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:46.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.402+0000 7f887a7fc700 1 -- 172.21.15.8:0/279510685 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f88740cde60 con 0x7f8884102080 2023-10-06T23:12:46.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.403+0000 7f888959b700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f88700a14d0 0x7f88700a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:46.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.403+0000 7f888959b700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f88700a14d0 0x7f88700a3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8880005fd0 tx=0x7f8880005f00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:46.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.406+0000 7f887a7fc700 1 -- 172.21.15.8:0/279510685 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8874097500 con 0x7f8884102080 2023-10-06T23:12:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:46 smithi190 ceph-mon[102658]: pgmap v346: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:46 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1720671897' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-06T23:12:46.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.619+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f888410c610 con 0x7f8884102080 2023-10-06T23:12:46.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.621+0000 7f887a7fc700 1 -- 172.21.15.8:0/279510685 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7f887409ab20 con 0x7f8884102080 2023-10-06T23:12:46.624 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:12:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f88700a14d0 msgr2=0x7f88700a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f88700a14d0 0x7f88700a3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8880005fd0 tx=0x7f8880005f00 comp rx=0 tx=0).stop 2023-10-06T23:12:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 msgr2=0x7f8884197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 0x7f8884197090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8874004730 tx=0x7f8874005e80 comp rx=0 tx=0).stop 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 shutdown_connections 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f88700a14d0 0x7f88700a3990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8884102a40 0x7f888419e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8884100ea0 0x7f8884196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 --2- 172.21.15.8:0/279510685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8884102080 0x7f8884197090 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 >> 172.21.15.8:0/279510685 conn(0x7f88840fc420 msgr2=0x7f8884105720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 shutdown_connections 2023-10-06T23:12:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.624+0000 7f888b7ff700 1 -- 172.21.15.8:0/279510685 wait complete. 2023-10-06T23:12:46.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:12:46.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:12:46.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 -- 172.21.15.8:0/3273166841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 msgr2=0x7f42781012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:46.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 --2- 172.21.15.8:0/3273166841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 0x7f42781012b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42680098f0 tx=0x7f4268009c00 comp rx=0 tx=0).stop 2023-10-06T23:12:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 -- 172.21.15.8:0/3273166841 shutdown_connections 2023-10-06T23:12:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 --2- 172.21.15.8:0/3273166841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4278102a30 0x7f4278109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 --2- 172.21.15.8:0/3273166841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 0x7f42781012b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 --2- 172.21.15.8:0/3273166841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4278102070 0x7f42781024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 -- 172.21.15.8:0/3273166841 >> 172.21.15.8:0/3273166841 conn(0x7f42780fc430 msgr2=0x7f42780fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 -- 172.21.15.8:0/3273166841 shutdown_connections 2023-10-06T23:12:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.851+0000 7f427e3ff700 1 -- 172.21.15.8:0/3273166841 wait complete. 2023-10-06T23:12:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.852+0000 7f427e3ff700 1 Processor -- start 2023-10-06T23:12:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.852+0000 7f427e3ff700 1 -- start start 2023-10-06T23:12:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.852+0000 7f427e3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 0x7f4278198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.852+0000 7f427e3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4278102070 0x7f4278199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.852+0000 7f427e3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4278102a30 0x7f42781a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.852+0000 7f427e3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42781a0960 con 0x7f4278102a30 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427e3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42781a0aa0 con 0x7f4278102070 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427e3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42781a0c30 con 0x7f4278100e90 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4278102a30 0x7f42781a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4278102a30 0x7f42781a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36622/0 (socket says 172.21.15.8:36622) 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 -- 172.21.15.8:0/338925022 learned_addr learned my addr 172.21.15.8:0/338925022 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f42777fe700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4278102070 0x7f4278199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f4277fff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 0x7f4278198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 -- 172.21.15.8:0/338925022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 msgr2=0x7f4278198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 0x7f4278198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 -- 172.21.15.8:0/338925022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4278102070 msgr2=0x7f4278199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4278102070 0x7f4278199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 -- 172.21.15.8:0/338925022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0095f0 con 0x7f4278102a30 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f4277fff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 0x7f4278198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.853+0000 7f427c99c700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4278102a30 0x7f42781a0390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f427000ef30 tx=0x7f427000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.854+0000 7f42757fa700 1 -- 172.21.15.8:0/338925022 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270018070 con 0x7f4278102a30 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.854+0000 7f42757fa700 1 -- 172.21.15.8:0/338925022 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427000f040 con 0x7f4278102a30 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.854+0000 7f42757fa700 1 -- 172.21.15.8:0/338925022 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000cc70 con 0x7f4278102a30 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.854+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4268009520 con 0x7f4278102a30 2023-10-06T23:12:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.854+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42781a1180 con 0x7f4278102a30 2023-10-06T23:12:46.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.855+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427810c600 con 0x7f4278102a30 2023-10-06T23:12:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.858+0000 7f42757fa700 1 -- 172.21.15.8:0/338925022 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4270003a00 con 0x7f4278102a30 2023-10-06T23:12:46.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.860+0000 7f42757fa700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42600a1500 0x7f42600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:46.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.860+0000 7f42757fa700 1 -- 172.21.15.8:0/338925022 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f42700cce10 con 0x7f4278102a30 2023-10-06T23:12:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.860+0000 7f4277fff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42600a1500 0x7f42600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.861+0000 7f4277fff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42600a1500 0x7f42600a39c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f42680098c0 tx=0x7f4268019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:46.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:46.862+0000 7f42757fa700 1 -- 172.21.15.8:0/338925022 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f42700964b0 con 0x7f4278102a30 2023-10-06T23:12:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.075+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42781a1370 con 0x7f4278102a30 2023-10-06T23:12:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.075+0000 7f42757fa700 1 -- 172.21.15.8:0/338925022 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4270003cb0 con 0x7f4278102a30 2023-10-06T23:12:47.077 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:12:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.077+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42600a1500 msgr2=0x7f42600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.077+0000 7f427e3ff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42600a1500 0x7f42600a39c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f42680098c0 tx=0x7f4268019040 comp rx=0 tx=0).stop 2023-10-06T23:12:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.077+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4278102a30 msgr2=0x7f42781a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.077+0000 7f427e3ff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4278102a30 0x7f42781a0390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f427000ef30 tx=0x7f427000c3a0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.078+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 shutdown_connections 2023-10-06T23:12:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.078+0000 7f427e3ff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42600a1500 0x7f42600a39c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.078+0000 7f427e3ff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4278102a30 0x7f42781a0390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.078+0000 7f427e3ff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4278100e90 0x7f4278198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.078+0000 7f427e3ff700 1 --2- 172.21.15.8:0/338925022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4278102070 0x7f4278199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.078+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 >> 172.21.15.8:0/338925022 conn(0x7f42780fc430 msgr2=0x7f42780fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.078+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 shutdown_connections 2023-10-06T23:12:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.078+0000 7f427e3ff700 1 -- 172.21.15.8:0/338925022 wait complete. 2023-10-06T23:12:47.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:12:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.305+0000 7f2c345ff700 1 -- 172.21.15.8:0/1026651819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c100ea0 msgr2=0x7f2c2c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.305+0000 7f2c345ff700 1 --2- 172.21.15.8:0/1026651819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c100ea0 0x7f2c2c1012c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009990 tx=0x7f2c28009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.306+0000 7f2c345ff700 1 -- 172.21.15.8:0/1026651819 shutdown_connections 2023-10-06T23:12:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.306+0000 7f2c345ff700 1 --2- 172.21.15.8:0/1026651819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c100ea0 0x7f2c2c1012c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.306+0000 7f2c345ff700 1 --2- 172.21.15.8:0/1026651819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c102a40 0x7f2c2c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.306+0000 7f2c345ff700 1 --2- 172.21.15.8:0/1026651819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c102080 0x7f2c2c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.306+0000 7f2c345ff700 1 -- 172.21.15.8:0/1026651819 >> 172.21.15.8:0/1026651819 conn(0x7f2c2c0fc460 msgr2=0x7f2c2c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.306+0000 7f2c345ff700 1 -- 172.21.15.8:0/1026651819 shutdown_connections 2023-10-06T23:12:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.306+0000 7f2c345ff700 1 -- 172.21.15.8:0/1026651819 wait complete. 2023-10-06T23:12:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c345ff700 1 Processor -- start 2023-10-06T23:12:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c345ff700 1 -- start start 2023-10-06T23:12:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c345ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c100ea0 0x7f2c2c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c345ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c102080 0x7f2c2c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c345ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c102a40 0x7f2c2c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c345ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c073f80 con 0x7f2c2c102080 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c345ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0740f0 con 0x7f2c2c100ea0 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c345ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c1a0b50 con 0x7f2c2c102a40 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.307+0000 7f2c31b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c102080 0x7f2c2c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c31b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c102080 0x7f2c2c0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36638/0 (socket says 172.21.15.8:36638) 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c31b9a700 1 -- 172.21.15.8:0/3697981058 learned_addr learned my addr 172.21.15.8:0/3697981058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c3239b700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c100ea0 0x7f2c2c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c31b9a700 1 -- 172.21.15.8:0/3697981058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c102a40 msgr2=0x7f2c2c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c31b9a700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c102a40 0x7f2c2c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c31b9a700 1 -- 172.21.15.8:0/3697981058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c100ea0 msgr2=0x7f2c2c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c31b9a700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c100ea0 0x7f2c2c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c31b9a700 1 -- 172.21.15.8:0/3697981058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280095f0 con 0x7f2c2c102080 2023-10-06T23:12:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c31b9a700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c102080 0x7f2c2c0732a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00d980 tx=0x7f2c1c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c237fe700 1 -- 172.21.15.8:0/3697981058 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c004020 con 0x7f2c2c102080 2023-10-06T23:12:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c237fe700 1 -- 172.21.15.8:0/3697981058 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1c009730 con 0x7f2c2c102080 2023-10-06T23:12:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.308+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c1a0e30 con 0x7f2c2c102080 2023-10-06T23:12:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.309+0000 7f2c237fe700 1 -- 172.21.15.8:0/3697981058 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c003a00 con 0x7f2c2c102080 2023-10-06T23:12:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.309+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c1a1360 con 0x7f2c2c102080 2023-10-06T23:12:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.310+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c10c610 con 0x7f2c2c102080 2023-10-06T23:12:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.311+0000 7f2c237fe700 1 -- 172.21.15.8:0/3697981058 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2c1c0098a0 con 0x7f2c2c102080 2023-10-06T23:12:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.313+0000 7f2c237fe700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2c180a1500 0x7f2c180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.313+0000 7f2c237fe700 1 -- 172.21.15.8:0/3697981058 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2c1c0cc990 con 0x7f2c2c102080 2023-10-06T23:12:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.313+0000 7f2c3239b700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2c180a1500 0x7f2c180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.314+0000 7f2c3239b700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2c180a1500 0x7f2c180a39c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800b5c0 tx=0x7f2c28005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:47.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.317+0000 7f2c237fe700 1 -- 172.21.15.8:0/3697981058 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2c1c095fa0 con 0x7f2c2c102080 2023-10-06T23:12:47.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:47 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/279510685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:47.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:47 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/279510685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:47.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:47 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/279510685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:47.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.526+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c2c107ef0 con 0x7f2c2c102080 2023-10-06T23:12:47.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.526+0000 7f2c237fe700 1 -- 172.21.15.8:0/3697981058 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c1c0995c0 con 0x7f2c2c102080 2023-10-06T23:12:47.529 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:12:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2c180a1500 msgr2=0x7f2c180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2c180a1500 0x7f2c180a39c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800b5c0 tx=0x7f2c28005fb0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c102080 msgr2=0x7f2c2c0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c102080 0x7f2c2c0732a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00d980 tx=0x7f2c1c00dc90 comp rx=0 tx=0).stop 2023-10-06T23:12:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 shutdown_connections 2023-10-06T23:12:47.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2c180a1500 0x7f2c180a39c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c102a40 0x7f2c2c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c100ea0 0x7f2c2c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 --2- 172.21.15.8:0/3697981058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c2c102080 0x7f2c2c0732a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 >> 172.21.15.8:0/3697981058 conn(0x7f2c2c0fc460 msgr2=0x7f2c2c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:47.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 shutdown_connections 2023-10-06T23:12:47.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.529+0000 7f2c345ff700 1 -- 172.21.15.8:0/3697981058 wait complete. 2023-10-06T23:12:47.550 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:12:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 -- 172.21.15.8:0/1032127746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 msgr2=0x7f11a81024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 --2- 172.21.15.8:0/1032127746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a81024f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1194009990 tx=0x7f1194009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 -- 172.21.15.8:0/1032127746 shutdown_connections 2023-10-06T23:12:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 --2- 172.21.15.8:0/1032127746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8102a30 0x7f11a8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 --2- 172.21.15.8:0/1032127746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8100e90 0x7f11a81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 --2- 172.21.15.8:0/1032127746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a81024f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 -- 172.21.15.8:0/1032127746 >> 172.21.15.8:0/1032127746 conn(0x7f11a80fc430 msgr2=0x7f11a80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 -- 172.21.15.8:0/1032127746 shutdown_connections 2023-10-06T23:12:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.754+0000 7f11aefff700 1 -- 172.21.15.8:0/1032127746 wait complete. 2023-10-06T23:12:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.755+0000 7f11aefff700 1 Processor -- start 2023-10-06T23:12:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.755+0000 7f11aefff700 1 -- start start 2023-10-06T23:12:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.755+0000 7f11aefff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.755+0000 7f11aefff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a8197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.755+0000 7f11aefff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102a30 0x7f11a819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.755+0000 7f11aefff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a819e6d0 con 0x7f11a8102070 2023-10-06T23:12:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.755+0000 7f11aefff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a819e810 con 0x7f11a8102a30 2023-10-06T23:12:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.755+0000 7f11aefff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a819e9a0 con 0x7f11a8100e90 2023-10-06T23:12:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a8197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a8197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36654/0 (socket says 172.21.15.8:36654) 2023-10-06T23:12:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 -- 172.21.15.8:0/2807100639 learned_addr learned my addr 172.21.15.8:0/2807100639 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11ad59c700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102a30 0x7f11a819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11acd9b700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 -- 172.21.15.8:0/2807100639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8100e90 msgr2=0x7f11a8196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 -- 172.21.15.8:0/2807100639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102a30 msgr2=0x7f11a819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102a30 0x7f11a819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 -- 172.21.15.8:0/2807100639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940095f0 con 0x7f11a8102070 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.756+0000 7f11a7fff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a8197090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f11940098e0 tx=0x7f1194004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.757+0000 7f11a5ffb700 1 -- 172.21.15.8:0/2807100639 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119401d070 con 0x7f11a8102070 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.757+0000 7f11a5ffb700 1 -- 172.21.15.8:0/2807100639 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f119400bdb0 con 0x7f11a8102070 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.757+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a819ec20 con 0x7f11a8102070 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.757+0000 7f11a5ffb700 1 -- 172.21.15.8:0/2807100639 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194022cf0 con 0x7f11a8102070 2023-10-06T23:12:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.757+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a819f0a0 con 0x7f11a8102070 2023-10-06T23:12:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.758+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a8107f20 con 0x7f11a8102070 2023-10-06T23:12:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.760+0000 7f11a5ffb700 1 -- 172.21.15.8:0/2807100639 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1194022470 con 0x7f11a8102070 2023-10-06T23:12:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.761+0000 7f11a5ffb700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11980a1500 0x7f11980a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.761+0000 7f11a5ffb700 1 -- 172.21.15.8:0/2807100639 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f11940ce2b0 con 0x7f11a8102070 2023-10-06T23:12:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.761+0000 7f11acd9b700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11980a1500 0x7f11980a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.762+0000 7f11acd9b700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11980a1500 0x7f11980a39c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f11a8101be0 tx=0x7f119c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:47.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.765+0000 7f11a5ffb700 1 -- 172.21.15.8:0/2807100639 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f11940979b0 con 0x7f11a8102070 2023-10-06T23:12:47.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.979+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11a802d1c0 con 0x7f11a8102070 2023-10-06T23:12:47.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.979+0000 7f11a5ffb700 1 -- 172.21.15.8:0/2807100639 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1194027020 con 0x7f11a8102070 2023-10-06T23:12:47.982 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:12:47.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11980a1500 msgr2=0x7f11980a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11980a1500 0x7f11980a39c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f11a8101be0 tx=0x7f119c009260 comp rx=0 tx=0).stop 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 msgr2=0x7f11a8197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a8197090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f11940098e0 tx=0x7f1194004730 comp rx=0 tx=0).stop 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 shutdown_connections 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11980a1500 0x7f11980a39c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102a30 0x7f11a819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 --2- 172.21.15.8:0/2807100639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a8197090 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 >> 172.21.15.8:0/2807100639 conn(0x7f11a80fc430 msgr2=0x7f11a80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 shutdown_connections 2023-10-06T23:12:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:47.982+0000 7f11aefff700 1 -- 172.21.15.8:0/2807100639 wait complete. 2023-10-06T23:12:48.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 -- 172.21.15.8:0/2884016049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 msgr2=0x7f0b401012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 --2- 172.21.15.8:0/2884016049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 0x7f0b401012c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009990 tx=0x7f0b30009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 -- 172.21.15.8:0/2884016049 shutdown_connections 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 --2- 172.21.15.8:0/2884016049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 0x7f0b401012c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 --2- 172.21.15.8:0/2884016049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40102a40 0x7f0b40109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 --2- 172.21.15.8:0/2884016049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102080 0x7f0b40102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 -- 172.21.15.8:0/2884016049 >> 172.21.15.8:0/2884016049 conn(0x7f0b400fc420 msgr2=0x7f0b400fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 -- 172.21.15.8:0/2884016049 shutdown_connections 2023-10-06T23:12:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.204+0000 7f0b455ff700 1 -- 172.21.15.8:0/2884016049 wait complete. 2023-10-06T23:12:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.205+0000 7f0b455ff700 1 Processor -- start 2023-10-06T23:12:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.205+0000 7f0b455ff700 1 -- start start 2023-10-06T23:12:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b455ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b455ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102080 0x7f0b40197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b455ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102a40 0x7f0b4019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b455ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4019e6d0 con 0x7f0b40102a40 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b455ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4019e810 con 0x7f0b40102080 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b455ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4019e9a0 con 0x7f0b40100ea0 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102a40 0x7f0b4019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102a40 0x7f0b4019e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36672/0 (socket says 172.21.15.8:36672) 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3f7fe700 1 -- 172.21.15.8:0/830345611 learned_addr learned my addr 172.21.15.8:0/830345611 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3e7fc700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102080 0x7f0b40197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3effd700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3f7fe700 1 -- 172.21.15.8:0/830345611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40100ea0 msgr2=0x7f0b40196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3f7fe700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3f7fe700 1 -- 172.21.15.8:0/830345611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102080 msgr2=0x7f0b40197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3f7fe700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102080 0x7f0b40197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3f7fe700 1 -- 172.21.15.8:0/830345611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34009520 con 0x7f0b40102a40 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.206+0000 7f0b3effd700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.207+0000 7f0b3f7fe700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102a40 0x7f0b4019e100 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800ef30 tx=0x7f0b3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.207+0000 7f0b27fff700 1 -- 172.21.15.8:0/830345611 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38018070 con 0x7f0b40102a40 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.207+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b300095f0 con 0x7f0b40102a40 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.207+0000 7f0b27fff700 1 -- 172.21.15.8:0/830345611 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b3800f040 con 0x7f0b40102a40 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.207+0000 7f0b27fff700 1 -- 172.21.15.8:0/830345611 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800cc70 con 0x7f0b40102a40 2023-10-06T23:12:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.207+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4019ef50 con 0x7f0b40102a40 2023-10-06T23:12:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.208+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b401085e0 con 0x7f0b40102a40 2023-10-06T23:12:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.210+0000 7f0b27fff700 1 -- 172.21.15.8:0/830345611 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0b38007500 con 0x7f0b40102a40 2023-10-06T23:12:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.211+0000 7f0b27fff700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a14d0 0x7f0b280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.211+0000 7f0b27fff700 1 -- 172.21.15.8:0/830345611 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0b380cc8c0 con 0x7f0b40102a40 2023-10-06T23:12:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.211+0000 7f0b3effd700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a14d0 0x7f0b280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.212+0000 7f0b3effd700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a14d0 0x7f0b280a3990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b300098e0 tx=0x7f0b30004740 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:48.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.215+0000 7f0b27fff700 1 -- 172.21.15.8:0/830345611 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0b38095f60 con 0x7f0b40102a40 2023-10-06T23:12:48.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:48 smithi156 ceph-mon[102862]: pgmap v347: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:48.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:48 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/338925022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:48 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3697981058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:48 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2807100639' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:48 smithi008 ceph-mon[98532]: pgmap v347: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:48.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:48 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/338925022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:48 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3697981058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:48 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2807100639' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:48 smithi190 ceph-mon[102658]: pgmap v347: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:48.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:48 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/338925022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:48 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3697981058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:48 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2807100639' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:48.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.478+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b4010c610 con 0x7f0b40102a40 2023-10-06T23:12:48.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.479+0000 7f0b27fff700 1 -- 172.21.15.8:0/830345611 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f0b38099580 con 0x7f0b40102a40 2023-10-06T23:12:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:48.481 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:11:23.244586+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:12:48.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a14d0 msgr2=0x7f0b280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a14d0 0x7f0b280a3990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b300098e0 tx=0x7f0b30004740 comp rx=0 tx=0).stop 2023-10-06T23:12:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102a40 msgr2=0x7f0b4019e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102a40 0x7f0b4019e100 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800ef30 tx=0x7f0b3800c3a0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 shutdown_connections 2023-10-06T23:12:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a14d0 0x7f0b280a3990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102a40 0x7f0b4019e100 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 --2- 172.21.15.8:0/830345611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102080 0x7f0b40197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 >> 172.21.15.8:0/830345611 conn(0x7f0b400fc420 msgr2=0x7f0b40105720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:48.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 shutdown_connections 2023-10-06T23:12:48.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.481+0000 7f0b455ff700 1 -- 172.21.15.8:0/830345611 wait complete. 2023-10-06T23:12:48.485 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:12:48.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:12:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 -- 172.21.15.8:0/4294410662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102a40 msgr2=0x7fd2e0109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/4294410662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102a40 0x7fd2e0109360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b0a0 tx=0x7fd2d800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 -- 172.21.15.8:0/4294410662 shutdown_connections 2023-10-06T23:12:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/4294410662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102a40 0x7fd2e0109360 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/4294410662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2e0100ea0 0x7fd2e01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/4294410662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e0102080 0x7fd2e0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 -- 172.21.15.8:0/4294410662 >> 172.21.15.8:0/4294410662 conn(0x7fd2e00fc420 msgr2=0x7fd2e00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:48.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 -- 172.21.15.8:0/4294410662 shutdown_connections 2023-10-06T23:12:48.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.703+0000 7fd2e59ff700 1 -- 172.21.15.8:0/4294410662 wait complete. 2023-10-06T23:12:48.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.704+0000 7fd2e59ff700 1 Processor -- start 2023-10-06T23:12:48.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.704+0000 7fd2e59ff700 1 -- start start 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2e59ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2e0100ea0 0x7fd2e0074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2e59ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102080 0x7fd2e00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2e59ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e0102a40 0x7fd2e00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2e59ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0073f80 con 0x7fd2e0102080 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2e59ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00740f0 con 0x7fd2e0100ea0 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2e59ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e01a0c90 con 0x7fd2e0102a40 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2de7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102080 0x7fd2e00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2de7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102080 0x7fd2e00732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36694/0 (socket says 172.21.15.8:36694) 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2de7fc700 1 -- 172.21.15.8:0/1818199627 learned_addr learned my addr 172.21.15.8:0/1818199627 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2deffd700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2e0100ea0 0x7fd2e0074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2de7fc700 1 -- 172.21.15.8:0/1818199627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e0102a40 msgr2=0x7fd2e00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2de7fc700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e0102a40 0x7fd2e00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2de7fc700 1 -- 172.21.15.8:0/1818199627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2e0100ea0 msgr2=0x7fd2e0074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2de7fc700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2e0100ea0 0x7fd2e0074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.705+0000 7fd2de7fc700 1 -- 172.21.15.8:0/1818199627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8009d00 con 0x7fd2e0102080 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.706+0000 7fd2deffd700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2e0100ea0 0x7fd2e0074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.706+0000 7fd2de7fc700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102080 0x7fd2e00732a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400d980 tx=0x7fd2d400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.706+0000 7fd2e49fd700 1 -- 172.21.15.8:0/1818199627 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400de60 con 0x7fd2e0102080 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.706+0000 7fd2e49fd700 1 -- 172.21.15.8:0/1818199627 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd2d40044b0 con 0x7fd2e0102080 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.706+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e01a0f70 con 0x7fd2e0102080 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.706+0000 7fd2e49fd700 1 -- 172.21.15.8:0/1818199627 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4003b40 con 0x7fd2e0102080 2023-10-06T23:12:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.706+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e01a14a0 con 0x7fd2e0102080 2023-10-06T23:12:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.707+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e01084a0 con 0x7fd2e0102080 2023-10-06T23:12:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.709+0000 7fd2e49fd700 1 -- 172.21.15.8:0/1818199627 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd2d4003ca0 con 0x7fd2e0102080 2023-10-06T23:12:48.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.711+0000 7fd2e49fd700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2c80a1550 0x7fd2c80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:48.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.711+0000 7fd2e49fd700 1 -- 172.21.15.8:0/1818199627 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd2d40cc950 con 0x7fd2e0102080 2023-10-06T23:12:48.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.711+0000 7fd2deffd700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2c80a1550 0x7fd2c80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:48.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.711+0000 7fd2deffd700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2c80a1550 0x7fd2c80a3a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0101bf0 tx=0x7fd2d000b670 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:48.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.714+0000 7fd2e49fd700 1 -- 172.21.15.8:0/1818199627 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd2d4095f60 con 0x7fd2e0102080 2023-10-06T23:12:48.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.925+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2e010c610 con 0x7fd2e0102080 2023-10-06T23:12:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.927+0000 7fd2e49fd700 1 -- 172.21.15.8:0/1818199627 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7fd2d4009940 con 0x7fd2e0102080 2023-10-06T23:12:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:48.929 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:12:48.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2c80a1550 msgr2=0x7fd2c80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2c80a1550 0x7fd2c80a3a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0101bf0 tx=0x7fd2d000b670 comp rx=0 tx=0).stop 2023-10-06T23:12:48.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102080 msgr2=0x7fd2e00732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:48.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102080 0x7fd2e00732a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400d980 tx=0x7fd2d400dd40 comp rx=0 tx=0).stop 2023-10-06T23:12:48.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 shutdown_connections 2023-10-06T23:12:48.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2c80a1550 0x7fd2c80a3a10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e0102a40 0x7fd2e00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2e0100ea0 0x7fd2e0074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 --2- 172.21.15.8:0/1818199627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2e0102080 0x7fd2e00732a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 >> 172.21.15.8:0/1818199627 conn(0x7fd2e00fc420 msgr2=0x7fd2e01055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.929+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 shutdown_connections 2023-10-06T23:12:48.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:48.930+0000 7fd2e59ff700 1 -- 172.21.15.8:0/1818199627 wait complete. 2023-10-06T23:12:48.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:12:48.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:12:49.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 -- 172.21.15.8:0/725086730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 msgr2=0x7fae801024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 --2- 172.21.15.8:0/725086730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 0x7fae801024f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009990 tx=0x7fae6c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 -- 172.21.15.8:0/725086730 shutdown_connections 2023-10-06T23:12:49.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 --2- 172.21.15.8:0/725086730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae80102a30 0x7fae80109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 --2- 172.21.15.8:0/725086730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae80100e90 0x7fae801012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 --2- 172.21.15.8:0/725086730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 0x7fae801024f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 -- 172.21.15.8:0/725086730 >> 172.21.15.8:0/725086730 conn(0x7fae800fc430 msgr2=0x7fae800fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:49.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 -- 172.21.15.8:0/725086730 shutdown_connections 2023-10-06T23:12:49.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.158+0000 7fae871ff700 1 -- 172.21.15.8:0/725086730 wait complete. 2023-10-06T23:12:49.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.160+0000 7fae871ff700 1 Processor -- start 2023-10-06T23:12:49.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.160+0000 7fae871ff700 1 -- start start 2023-10-06T23:12:49.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae871ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae80100e90 0x7fae80074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:49.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae871ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 0x7fae800732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:49.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae871ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae80102a30 0x7fae800737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:49.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae871ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae80073f80 con 0x7fae80102070 2023-10-06T23:12:49.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae871ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800740f0 con 0x7fae80102a30 2023-10-06T23:12:49.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae871ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801a0bb0 con 0x7fae80100e90 2023-10-06T23:12:49.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae7ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 0x7fae800732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:49.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae7ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 0x7fae800732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36706/0 (socket says 172.21.15.8:36706) 2023-10-06T23:12:49.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae7ffff700 1 -- 172.21.15.8:0/3066653320 learned_addr learned my addr 172.21.15.8:0/3066653320 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:49.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae84f9b700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae80100e90 0x7fae80074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:49.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae8579c700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae80102a30 0x7fae800737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:49.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae7ffff700 1 -- 172.21.15.8:0/3066653320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae80100e90 msgr2=0x7fae80074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae7ffff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae80100e90 0x7fae80074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae7ffff700 1 -- 172.21.15.8:0/3066653320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae80102a30 msgr2=0x7fae800737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae7ffff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae80102a30 0x7fae800737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.161+0000 7fae7ffff700 1 -- 172.21.15.8:0/3066653320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0095f0 con 0x7fae80102070 2023-10-06T23:12:49.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.162+0000 7fae7ffff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 0x7fae800732a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fae6c004730 tx=0x7fae6c004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:49.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.162+0000 7fae7dffb700 1 -- 172.21.15.8:0/3066653320 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c01d070 con 0x7fae80102070 2023-10-06T23:12:49.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.162+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae801a0e30 con 0x7fae80102070 2023-10-06T23:12:49.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.162+0000 7fae7dffb700 1 -- 172.21.15.8:0/3066653320 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae6c004c90 con 0x7fae80102070 2023-10-06T23:12:49.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.162+0000 7fae7dffb700 1 -- 172.21.15.8:0/3066653320 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c003af0 con 0x7fae80102070 2023-10-06T23:12:49.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.162+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae801a11f0 con 0x7fae80102070 2023-10-06T23:12:49.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.163+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae80107f20 con 0x7fae80102070 2023-10-06T23:12:49.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.165+0000 7fae7dffb700 1 -- 172.21.15.8:0/3066653320 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fae6c005000 con 0x7fae80102070 2023-10-06T23:12:49.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.166+0000 7fae7dffb700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fae700a1480 0x7fae700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:49.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.166+0000 7fae7dffb700 1 -- 172.21.15.8:0/3066653320 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fae6c0cdc90 con 0x7fae80102070 2023-10-06T23:12:49.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.167+0000 7fae84f9b700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fae700a1480 0x7fae700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:49.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.167+0000 7fae84f9b700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fae700a1480 0x7fae700a3940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fae80101be0 tx=0x7fae7400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:49.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.170+0000 7fae7dffb700 1 -- 172.21.15.8:0/3066653320 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fae6c097330 con 0x7fae80102070 2023-10-06T23:12:49.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:49 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/830345611' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:49.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:49 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1818199627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:49.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.377+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae8002d020 con 0x7fae80102070 2023-10-06T23:12:49.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.377+0000 7fae7dffb700 1 -- 172.21.15.8:0/3066653320 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae6c09a950 con 0x7fae80102070 2023-10-06T23:12:49.380 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:12:49.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fae700a1480 msgr2=0x7fae700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fae700a1480 0x7fae700a3940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fae80101be0 tx=0x7fae7400b410 comp rx=0 tx=0).stop 2023-10-06T23:12:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 msgr2=0x7fae800732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 0x7fae800732a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fae6c004730 tx=0x7fae6c004760 comp rx=0 tx=0).stop 2023-10-06T23:12:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 shutdown_connections 2023-10-06T23:12:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fae700a1480 0x7fae700a3940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae80102a30 0x7fae800737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae80100e90 0x7fae80074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 --2- 172.21.15.8:0/3066653320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae80102070 0x7fae800732a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 >> 172.21.15.8:0/3066653320 conn(0x7fae800fc430 msgr2=0x7fae800fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 shutdown_connections 2023-10-06T23:12:49.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.380+0000 7fae871ff700 1 -- 172.21.15.8:0/3066653320 wait complete. 2023-10-06T23:12:49.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:49 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/830345611' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:49.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:49 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1818199627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:49.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:12:49.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:49 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/830345611' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:49.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:49 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1818199627' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:49.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 -- 172.21.15.8:0/1708099931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 msgr2=0x7f8e301024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 --2- 172.21.15.8:0/1708099931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 0x7f8e301024f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009990 tx=0x7f8e1c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 -- 172.21.15.8:0/1708099931 shutdown_connections 2023-10-06T23:12:49.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 --2- 172.21.15.8:0/1708099931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e30102a30 0x7f8e30109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 --2- 172.21.15.8:0/1708099931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e30100e90 0x7f8e301012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 --2- 172.21.15.8:0/1708099931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 0x7f8e301024f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 -- 172.21.15.8:0/1708099931 >> 172.21.15.8:0/1708099931 conn(0x7f8e300fc430 msgr2=0x7f8e300fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:49.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 -- 172.21.15.8:0/1708099931 shutdown_connections 2023-10-06T23:12:49.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.605+0000 7f8e36dff700 1 -- 172.21.15.8:0/1708099931 wait complete. 2023-10-06T23:12:49.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.606+0000 7f8e36dff700 1 Processor -- start 2023-10-06T23:12:49.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.606+0000 7f8e36dff700 1 -- start start 2023-10-06T23:12:49.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.606+0000 7f8e36dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e30100e90 0x7f8e30074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:49.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.606+0000 7f8e36dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 0x7f8e300732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e36dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e30102a30 0x7f8e300737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e36dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30073f80 con 0x7f8e30102070 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e36dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300740f0 con 0x7f8e30102a30 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e36dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e301a0b60 con 0x7f8e30100e90 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 0x7f8e300732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 0x7f8e300732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33150/0 (socket says 172.21.15.8:33150) 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 -- 172.21.15.8:0/4185367685 learned_addr learned my addr 172.21.15.8:0/4185367685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e34b9b700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e30100e90 0x7f8e30074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 -- 172.21.15.8:0/4185367685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e30100e90 msgr2=0x7f8e30074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e30100e90 0x7f8e30074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 -- 172.21.15.8:0/4185367685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e30102a30 msgr2=0x7f8e300737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e30102a30 0x7f8e300737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 -- 172.21.15.8:0/4185367685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0095f0 con 0x7f8e30102070 2023-10-06T23:12:49.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2ffff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 0x7f8e300732a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c004730 tx=0x7f8e1c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:49.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.607+0000 7f8e2dffb700 1 -- 172.21.15.8:0/4185367685 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c01d070 con 0x7f8e30102070 2023-10-06T23:12:49.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.608+0000 7f8e2dffb700 1 -- 172.21.15.8:0/4185367685 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e1c004ca0 con 0x7f8e30102070 2023-10-06T23:12:49.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.608+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e301a0de0 con 0x7f8e30102070 2023-10-06T23:12:49.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.608+0000 7f8e2dffb700 1 -- 172.21.15.8:0/4185367685 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c003d90 con 0x7f8e30102070 2023-10-06T23:12:49.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.608+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e301a1200 con 0x7f8e30102070 2023-10-06T23:12:49.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.609+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e30107ef0 con 0x7f8e30102070 2023-10-06T23:12:49.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.611+0000 7f8e2dffb700 1 -- 172.21.15.8:0/4185367685 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8e1c004810 con 0x7f8e30102070 2023-10-06T23:12:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.612+0000 7f8e2dffb700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8e200a1500 0x7f8e200a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.612+0000 7f8e2dffb700 1 -- 172.21.15.8:0/4185367685 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8e1c0cddd0 con 0x7f8e30102070 2023-10-06T23:12:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.612+0000 7f8e34b9b700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8e200a1500 0x7f8e200a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.613+0000 7f8e34b9b700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8e200a1500 0x7f8e200a39c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005950 tx=0x7f8e240058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:49.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.616+0000 7f8e2dffb700 1 -- 172.21.15.8:0/4185367685 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8e1c0974d0 con 0x7f8e30102070 2023-10-06T23:12:49.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.827+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e3010c600 con 0x7f8e30102070 2023-10-06T23:12:49.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.827+0000 7f8e2dffb700 1 -- 172.21.15.8:0/4185367685 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e1c09aaf0 con 0x7f8e30102070 2023-10-06T23:12:49.830 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:12:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8e200a1500 msgr2=0x7f8e200a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8e200a1500 0x7f8e200a39c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005950 tx=0x7f8e240058e0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 msgr2=0x7f8e300732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 0x7f8e300732a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c004730 tx=0x7f8e1c005e80 comp rx=0 tx=0).stop 2023-10-06T23:12:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 shutdown_connections 2023-10-06T23:12:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8e200a1500 0x7f8e200a39c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e30102a30 0x7f8e300737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e30100e90 0x7f8e30074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 --2- 172.21.15.8:0/4185367685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e30102070 0x7f8e300732a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 >> 172.21.15.8:0/4185367685 conn(0x7f8e300fc430 msgr2=0x7f8e300fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 shutdown_connections 2023-10-06T23:12:49.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:49.830+0000 7f8e36dff700 1 -- 172.21.15.8:0/4185367685 wait complete. 2023-10-06T23:12:49.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:12:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.056+0000 7f3588fff700 1 -- 172.21.15.8:0/3897412505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 msgr2=0x7f3584102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.056+0000 7f3588fff700 1 --2- 172.21.15.8:0/3897412505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 0x7f3584102500 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3578009990 tx=0x7f3578009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.056+0000 7f3588fff700 1 -- 172.21.15.8:0/3897412505 shutdown_connections 2023-10-06T23:12:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.056+0000 7f3588fff700 1 --2- 172.21.15.8:0/3897412505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584102a40 0x7f3584109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.056+0000 7f3588fff700 1 --2- 172.21.15.8:0/3897412505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3584100ea0 0x7f35841012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.056+0000 7f3588fff700 1 --2- 172.21.15.8:0/3897412505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 0x7f3584102500 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.056+0000 7f3588fff700 1 -- 172.21.15.8:0/3897412505 >> 172.21.15.8:0/3897412505 conn(0x7f35840fc460 msgr2=0x7f35840fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.057+0000 7f3588fff700 1 -- 172.21.15.8:0/3897412505 shutdown_connections 2023-10-06T23:12:50.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.057+0000 7f3588fff700 1 -- 172.21.15.8:0/3897412505 wait complete. 2023-10-06T23:12:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3588fff700 1 Processor -- start 2023-10-06T23:12:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3588fff700 1 -- start start 2023-10-06T23:12:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3588fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3584100ea0 0x7f3584198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3588fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 0x7f3584199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3588fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584102a40 0x7f35841a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3588fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35841a0830 con 0x7f3584102080 2023-10-06T23:12:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3588fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35841a09a0 con 0x7f3584100ea0 2023-10-06T23:12:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3588fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35841a0b60 con 0x7f3584102a40 2023-10-06T23:12:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3581d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 0x7f3584199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3581d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 0x7f3584199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33172/0 (socket says 172.21.15.8:33172) 2023-10-06T23:12:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.058+0000 7f3581d9b700 1 -- 172.21.15.8:0/2905510159 learned_addr learned my addr 172.21.15.8:0/2905510159 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3582d9d700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584102a40 0x7f35841a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f358259c700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3584100ea0 0x7f3584198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3581d9b700 1 -- 172.21.15.8:0/2905510159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584102a40 msgr2=0x7f35841a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3581d9b700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584102a40 0x7f35841a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3581d9b700 1 -- 172.21.15.8:0/2905510159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3584100ea0 msgr2=0x7f3584198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3581d9b700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3584100ea0 0x7f3584198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3581d9b700 1 -- 172.21.15.8:0/2905510159 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780095f0 con 0x7f3584102080 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f358259c700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3584100ea0 0x7f3584198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3581d9b700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 0x7f3584199230 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3578005910 tx=0x7f35780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f35737fe700 1 -- 172.21.15.8:0/2905510159 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357801d070 con 0x7f3584102080 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f35737fe700 1 -- 172.21.15.8:0/2905510159 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3578022470 con 0x7f3584102080 2023-10-06T23:12:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35841a0de0 con 0x7f3584102080 2023-10-06T23:12:50.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f35737fe700 1 -- 172.21.15.8:0/2905510159 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357800f6c0 con 0x7f3584102080 2023-10-06T23:12:50.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.059+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35841a11b0 con 0x7f3584102080 2023-10-06T23:12:50.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.061+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358410c610 con 0x7f3584102080 2023-10-06T23:12:50.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.062+0000 7f35737fe700 1 -- 172.21.15.8:0/2905510159 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f35780225e0 con 0x7f3584102080 2023-10-06T23:12:50.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.063+0000 7f35737fe700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f356c0a1500 0x7f356c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:50.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.064+0000 7f35737fe700 1 -- 172.21.15.8:0/2905510159 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f35780ce430 con 0x7f3584102080 2023-10-06T23:12:50.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.064+0000 7f358259c700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f356c0a1500 0x7f356c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:50.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.064+0000 7f358259c700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f356c0a1500 0x7f356c0a39c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f358419a1c0 tx=0x7f3574009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.067+0000 7f35737fe700 1 -- 172.21.15.8:0/2905510159 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3578097ad0 con 0x7f3584102080 2023-10-06T23:12:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:50 smithi008 ceph-mon[98532]: pgmap v348: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:50 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3066653320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:50 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4185367685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:50.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.278+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35841a1340 con 0x7f3584102080 2023-10-06T23:12:50.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.278+0000 7f35737fe700 1 -- 172.21.15.8:0/2905510159 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f357809b0f0 con 0x7f3584102080 2023-10-06T23:12:50.281 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:12:50.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f356c0a1500 msgr2=0x7f356c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f356c0a1500 0x7f356c0a39c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f358419a1c0 tx=0x7f3574009260 comp rx=0 tx=0).stop 2023-10-06T23:12:50.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 msgr2=0x7f3584199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 0x7f3584199230 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3578005910 tx=0x7f35780057f0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 shutdown_connections 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f356c0a1500 0x7f356c0a39c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584102a40 0x7f35841a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3584100ea0 0x7f3584198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 --2- 172.21.15.8:0/2905510159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3584102080 0x7f3584199230 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 >> 172.21.15.8:0/2905510159 conn(0x7f35840fc460 msgr2=0x7f35840fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 shutdown_connections 2023-10-06T23:12:50.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.281+0000 7f3588fff700 1 -- 172.21.15.8:0/2905510159 wait complete. 2023-10-06T23:12:50.303 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:12:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:50 smithi156 ceph-mon[102862]: pgmap v348: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:50 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3066653320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:50.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:50 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4185367685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:50.445 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:50 smithi190 ceph-mon[102658]: pgmap v348: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:50.445 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:50 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3066653320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:12:50.445 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:50 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4185367685' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:12:50.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 -- 172.21.15.8:0/615516758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48073910 msgr2=0x7f7c48073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/615516758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48073910 0x7f7c48073d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009990 tx=0x7f7c38009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 -- 172.21.15.8:0/615516758 shutdown_connections 2023-10-06T23:12:50.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/615516758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48108db0 0x7f7c4810b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/615516758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c48074ef0 0x7f7c48073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/615516758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48073910 0x7f7c48073d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 -- 172.21.15.8:0/615516758 >> 172.21.15.8:0/615516758 conn(0x7f7c480fc420 msgr2=0x7f7c480fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:50.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 -- 172.21.15.8:0/615516758 shutdown_connections 2023-10-06T23:12:50.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.504+0000 7f7c4ffff700 1 -- 172.21.15.8:0/615516758 wait complete. 2023-10-06T23:12:50.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4ffff700 1 Processor -- start 2023-10-06T23:12:50.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4ffff700 1 -- start start 2023-10-06T23:12:50.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c48073910 0x7f7c48198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:50.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48074ef0 0x7f7c48199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:50.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48108db0 0x7f7c481a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:50.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4ffff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c481a0860 con 0x7f7c48074ef0 2023-10-06T23:12:50.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c481a09d0 con 0x7f7c48108db0 2023-10-06T23:12:50.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4ffff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c481a0b90 con 0x7f7c48073910 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4d59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48074ef0 0x7f7c48199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4d59a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48074ef0 0x7f7c48199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33182/0 (socket says 172.21.15.8:33182) 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.505+0000 7f7c4d59a700 1 -- 172.21.15.8:0/3349227323 learned_addr learned my addr 172.21.15.8:0/3349227323 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4e59c700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48108db0 0x7f7c481a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4dd9b700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c48073910 0x7f7c48198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4d59a700 1 -- 172.21.15.8:0/3349227323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c48073910 msgr2=0x7f7c48198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4d59a700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c48073910 0x7f7c48198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4d59a700 1 -- 172.21.15.8:0/3349227323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48108db0 msgr2=0x7f7c481a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4d59a700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48108db0 0x7f7c481a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4d59a700 1 -- 172.21.15.8:0/3349227323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c380095f0 con 0x7f7c48074ef0 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4e59c700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48108db0 0x7f7c481a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:50.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4d59a700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48074ef0 0x7f7c48199260 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7c380098e0 tx=0x7f7c38005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c3effd700 1 -- 172.21.15.8:0/3349227323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3801d070 con 0x7f7c48074ef0 2023-10-06T23:12:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c481a0e10 con 0x7f7c48074ef0 2023-10-06T23:12:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c3effd700 1 -- 172.21.15.8:0/3349227323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c3800f460 con 0x7f7c48074ef0 2023-10-06T23:12:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.506+0000 7f7c3effd700 1 -- 172.21.15.8:0/3349227323 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38021670 con 0x7f7c48074ef0 2023-10-06T23:12:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.507+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c481a1180 con 0x7f7c48074ef0 2023-10-06T23:12:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.508+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c48107460 con 0x7f7c48074ef0 2023-10-06T23:12:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.509+0000 7f7c3effd700 1 -- 172.21.15.8:0/3349227323 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7c3800f5d0 con 0x7f7c48074ef0 2023-10-06T23:12:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.511+0000 7f7c3effd700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7c340a14d0 0x7f7c340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.511+0000 7f7c3effd700 1 -- 172.21.15.8:0/3349227323 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7c380cdeb0 con 0x7f7c48074ef0 2023-10-06T23:12:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.511+0000 7f7c4dd9b700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7c340a14d0 0x7f7c340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.511+0000 7f7c4dd9b700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7c340a14d0 0x7f7c340a3990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c44005fd0 tx=0x7f7c44005f60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:50.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.514+0000 7f7c3effd700 1 -- 172.21.15.8:0/3349227323 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7c38097550 con 0x7f7c48074ef0 2023-10-06T23:12:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.771+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c4802d020 con 0x7f7c48074ef0 2023-10-06T23:12:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.772+0000 7f7c3effd700 1 -- 172.21.15.8:0/3349227323 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f7c3809ab70 con 0x7f7c48074ef0 2023-10-06T23:12:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:50.775 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:11:23.244586+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:12:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7c340a14d0 msgr2=0x7f7c340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7c340a14d0 0x7f7c340a3990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c44005fd0 tx=0x7f7c44005f60 comp rx=0 tx=0).stop 2023-10-06T23:12:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48074ef0 msgr2=0x7f7c48199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48074ef0 0x7f7c48199260 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7c380098e0 tx=0x7f7c38005ef0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 shutdown_connections 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7c340a14d0 0x7f7c340a3990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c48108db0 0x7f7c481a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c48073910 0x7f7c48198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 --2- 172.21.15.8:0/3349227323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c48074ef0 0x7f7c48199260 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 >> 172.21.15.8:0/3349227323 conn(0x7f7c480fc420 msgr2=0x7f7c480fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 shutdown_connections 2023-10-06T23:12:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.775+0000 7f7c4ffff700 1 -- 172.21.15.8:0/3349227323 wait complete. 2023-10-06T23:12:50.779 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:12:50.796 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:12:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.997+0000 7f4eec9ff700 1 -- 172.21.15.8:0/496360157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 msgr2=0x7f4ee81012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.997+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/496360157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 0x7f4ee81012c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009990 tx=0x7f4ed8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.998+0000 7f4eec9ff700 1 -- 172.21.15.8:0/496360157 shutdown_connections 2023-10-06T23:12:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.998+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/496360157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 0x7f4ee81012c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.998+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/496360157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ee8102a40 0x7f4ee8109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.998+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/496360157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee8102080 0x7f4ee8102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.998+0000 7f4eec9ff700 1 -- 172.21.15.8:0/496360157 >> 172.21.15.8:0/496360157 conn(0x7f4ee80fc420 msgr2=0x7f4ee80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.998+0000 7f4eec9ff700 1 -- 172.21.15.8:0/496360157 shutdown_connections 2023-10-06T23:12:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.998+0000 7f4eec9ff700 1 -- 172.21.15.8:0/496360157 wait complete. 2023-10-06T23:12:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4eec9ff700 1 Processor -- start 2023-10-06T23:12:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4eec9ff700 1 -- start start 2023-10-06T23:12:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4eec9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 0x7f4ee8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4eec9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ee8102080 0x7f4ee81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4eec9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee8102a40 0x7f4ee81a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4eec9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81a08e0 con 0x7f4ee8100ea0 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4eec9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81a0a20 con 0x7f4ee8102a40 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4eec9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81a0bb0 con 0x7f4ee8102080 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4ee659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 0x7f4ee8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4ee659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 0x7f4ee8198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33198/0 (socket says 172.21.15.8:33198) 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:50.999+0000 7f4ee659c700 1 -- 172.21.15.8:0/317009970 learned_addr learned my addr 172.21.15.8:0/317009970 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ee6d9d700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee8102a40 0x7f4ee81a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ee659c700 1 -- 172.21.15.8:0/317009970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ee8102080 msgr2=0x7f4ee81992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ee659c700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ee8102080 0x7f4ee81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ee659c700 1 -- 172.21.15.8:0/317009970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee8102a40 msgr2=0x7f4ee81a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ee659c700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee8102a40 0x7f4ee81a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ee659c700 1 -- 172.21.15.8:0/317009970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80095f0 con 0x7f4ee8100ea0 2023-10-06T23:12:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ee6d9d700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee8102a40 0x7f4ee81a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ee659c700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 0x7f4ee8198d60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80095c0 tx=0x7f4ed8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ed77fe700 1 -- 172.21.15.8:0/317009970 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed801d070 con 0x7f4ee8100ea0 2023-10-06T23:12:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ed77fe700 1 -- 172.21.15.8:0/317009970 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ed8004080 con 0x7f4ee8100ea0 2023-10-06T23:12:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4ed77fe700 1 -- 172.21.15.8:0/317009970 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8022cb0 con 0x7f4ee8100ea0 2023-10-06T23:12:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.000+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee81a0e30 con 0x7f4ee8100ea0 2023-10-06T23:12:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.001+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee81a11a0 con 0x7f4ee8100ea0 2023-10-06T23:12:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.001+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee8193400 con 0x7f4ee8100ea0 2023-10-06T23:12:51.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.003+0000 7f4ed77fe700 1 -- 172.21.15.8:0/317009970 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4ed8003bf0 con 0x7f4ee8100ea0 2023-10-06T23:12:51.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.005+0000 7f4ed77fe700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4ed00a14d0 0x7f4ed00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.005+0000 7f4ed77fe700 1 -- 172.21.15.8:0/317009970 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4ed80ce450 con 0x7f4ee8100ea0 2023-10-06T23:12:51.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.005+0000 7f4ee5d9b700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4ed00a14d0 0x7f4ed00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.006+0000 7f4ee5d9b700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4ed00a14d0 0x7f4ed00a3990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8100bc0 tx=0x7f4edc009470 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.009+0000 7f4ed77fe700 1 -- 172.21.15.8:0/317009970 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ed8097af0 con 0x7f4ee8100ea0 2023-10-06T23:12:51.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:51 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2905510159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:51.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:51 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3349227323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.224+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ee810c610 con 0x7f4ee8100ea0 2023-10-06T23:12:51.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.226+0000 7f4ed77fe700 1 -- 172.21.15.8:0/317009970 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7f4ed80041f0 con 0x7f4ee8100ea0 2023-10-06T23:12:51.230 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:12:51.230 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:12:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.228+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4ed00a14d0 msgr2=0x7f4ed00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.228+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4ed00a14d0 0x7f4ed00a3990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8100bc0 tx=0x7f4edc009470 comp rx=0 tx=0).stop 2023-10-06T23:12:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.228+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 msgr2=0x7f4ee8198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.228+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 0x7f4ee8198d60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80095c0 tx=0x7f4ed8005ef0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.229+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 shutdown_connections 2023-10-06T23:12:51.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.229+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4ed00a14d0 0x7f4ed00a3990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.229+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ee8100ea0 0x7f4ee8198d60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.229+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ee8102a40 0x7f4ee81a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.229+0000 7f4eec9ff700 1 --2- 172.21.15.8:0/317009970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ee8102080 0x7f4ee81992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.229+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 >> 172.21.15.8:0/317009970 conn(0x7f4ee80fc420 msgr2=0x7f4ee8107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.229+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 shutdown_connections 2023-10-06T23:12:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.229+0000 7f4eec9ff700 1 -- 172.21.15.8:0/317009970 wait complete. 2023-10-06T23:12:51.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-06T23:11:17.784448+0000', 'modified': '2023-10-06T23:11:23.244586+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24581, 'mds_1': 24568, 'mds_2': 24526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24506': {'gid': 24506, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6835/3086367655', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6834', 'nonce': 3086367655}, {'type': 'v1', 'addr': '172.21.15.156:6835', 'nonce': 3086367655}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24526': {'gid': 24526, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.190:6835/2542800704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 2542800704}, {'type': 'v1', 'addr': '172.21.15.190:6835', 'nonce': 2542800704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24538': {'gid': 24538, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.190:6837/3967292194', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 3967292194}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 3967292194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6837/2054249175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 2054249175}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 2054249175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.190:6839/730533990', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6838', 'nonce': 730533990}, {'type': 'v1', 'addr': '172.21.15.190:6839', 'nonce': 730533990}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6839/1606000246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 1606000246}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 1606000246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-06T23:12:51.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-06T23:12:51.251 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-06T23:12:51.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:51 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2905510159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:51.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:51 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3349227323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:51.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:51 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2905510159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:12:51.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:51 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3349227323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:12:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.454+0000 7f488d3ff700 1 -- 172.21.15.8:0/2292085501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 msgr2=0x7f488810b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.454+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2292085501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 0x7f488810b550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f488000b0d0 tx=0x7f488000b3e0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.454+0000 7f488d3ff700 1 -- 172.21.15.8:0/2292085501 shutdown_connections 2023-10-06T23:12:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.454+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2292085501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 0x7f488810b550 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.454+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2292085501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4888103110 0x7f4888103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.454+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2292085501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4888104300 0x7f4888104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.454+0000 7f488d3ff700 1 -- 172.21.15.8:0/2292085501 >> 172.21.15.8:0/2292085501 conn(0x7f48880fe6a0 msgr2=0x7f4888100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.455+0000 7f488d3ff700 1 -- 172.21.15.8:0/2292085501 shutdown_connections 2023-10-06T23:12:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.455+0000 7f488d3ff700 1 -- 172.21.15.8:0/2292085501 wait complete. 2023-10-06T23:12:51.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f488d3ff700 1 Processor -- start 2023-10-06T23:12:51.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f488d3ff700 1 -- start start 2023-10-06T23:12:51.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f488d3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4888103110 0x7f4888198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f488d3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4888104300 0x7f4888199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f488d3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 0x7f48881a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f488d3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48881a09b0 con 0x7f4888104ca0 2023-10-06T23:12:51.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f488d3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48881a0af0 con 0x7f4888104300 2023-10-06T23:12:51.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f488d3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48881a0c80 con 0x7f4888103110 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f48877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 0x7f48881a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f48877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 0x7f48881a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33210/0 (socket says 172.21.15.8:33210) 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.456+0000 7f48877fe700 1 -- 172.21.15.8:0/2464429308 learned_addr learned my addr 172.21.15.8:0/2464429308 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f48877fe700 1 -- 172.21.15.8:0/2464429308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4888103110 msgr2=0x7f4888198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f48877fe700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4888103110 0x7f4888198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f48877fe700 1 -- 172.21.15.8:0/2464429308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4888104300 msgr2=0x7f4888199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f48867fc700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4888104300 0x7f4888199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f48877fe700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4888104300 0x7f4888199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f48877fe700 1 -- 172.21.15.8:0/2464429308 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009d00 con 0x7f4888104ca0 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f48867fc700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4888104300 0x7f4888199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f48877fe700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 0x7f48881a03e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4880009440 tx=0x7f4880009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f486ffff700 1 -- 172.21.15.8:0/2464429308 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000e040 con 0x7f4888104ca0 2023-10-06T23:12:51.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f486ffff700 1 -- 172.21.15.8:0/2464429308 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4880012e10 con 0x7f4888104ca0 2023-10-06T23:12:51.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f486ffff700 1 -- 172.21.15.8:0/2464429308 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488001b450 con 0x7f4888104ca0 2023-10-06T23:12:51.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f488d3ff700 1 -- 172.21.15.8:0/2464429308 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48881a0f00 con 0x7f4888104ca0 2023-10-06T23:12:51.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.457+0000 7f488d3ff700 1 -- 172.21.15.8:0/2464429308 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48881a12d0 con 0x7f4888104ca0 2023-10-06T23:12:51.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.461+0000 7f486ffff700 1 -- 172.21.15.8:0/2464429308 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4880012980 con 0x7f4888104ca0 2023-10-06T23:12:51.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.462+0000 7f48a0e0ab80 1 Processor -- start 2023-10-06T23:12:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.462+0000 7f486ffff700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f48700a1500 0x7f48700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.462+0000 7f48a0e0ab80 1 -- start start 2023-10-06T23:12:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.462+0000 7f486ffff700 1 -- 172.21.15.8:0/2464429308 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f48800ceba0 con 0x7f4888104ca0 2023-10-06T23:12:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.462+0000 7f48867fc700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f48700a1500 0x7f48700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bc210 0x56414f1bc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bcb70 0x56414f1bd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1bde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f124410 con 0x56414f1bda10 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f115bd0 con 0x56414f1bc210 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f1134f0 con 0x56414f1bcb70 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1bde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1bde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33214/0 (socket says 172.21.15.8:33214) 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48867fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bcb70 0x56414f1bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48877fe700 1 -- 172.21.15.8:0/3336693249 learned_addr learned my addr 172.21.15.8:0/3336693249 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f4886ffd700 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bc210 0x56414f1bc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48867fc700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f48700a1500 0x7f48700a39c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f487c009ba0 tx=0x7f487c009550 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48877fe700 1 -- 172.21.15.8:0/3336693249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bcb70 msgr2=0x56414f1bd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48877fe700 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bcb70 0x56414f1bd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48877fe700 1 -- 172.21.15.8:0/3336693249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bc210 msgr2=0x56414f1bc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48877fe700 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bc210 0x56414f1bc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f48877fe700 1 -- 172.21.15.8:0/3336693249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56414ef39d90 con 0x56414f1bda10 2023-10-06T23:12:51.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.463+0000 7f4886ffd700 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bc210 0x56414f1bc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:51.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.464+0000 7f48867fc700 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bcb70 0x56414f1bd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:51.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.464+0000 7f48877fe700 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1bde90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4880098460 tx=0x7f48800982a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629fc1c44256fc10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.464+0000 7f486d7fa700 1 -- 172.21.15.8:0/3336693249 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488001d610 con 0x56414f1bda10 2023-10-06T23:12:51.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.464+0000 7f486d7fa700 1 -- 172.21.15.8:0/3336693249 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4880012c30 con 0x56414f1bda10 2023-10-06T23:12:51.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.464+0000 7f486d7fa700 1 -- 172.21.15.8:0/3336693249 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800a42f0 con 0x56414f1bda10 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/3336693249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 msgr2=0x56414f1bde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1bde90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4880098460 tx=0x7f48800982a0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/3336693249 shutdown_connections 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1bde90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bc210 0x56414f1bc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/3336693249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bcb70 0x56414f1bd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/3336693249 >> 172.21.15.8:0/3336693249 conn(0x56414f130210 msgr2=0x56414f1b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/3336693249 shutdown_connections 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/3336693249 wait complete. 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.465+0000 7f48a0e0ab80 1 -- start start 2023-10-06T23:12:51.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48a0e0ab80 1 Processor -- start 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bc210 0x56414f1c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 0x56414f1c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bda10 0x56414f1cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f10ede0 con 0x56414f1bc210 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f0ab6c0 con 0x56414f1bcb70 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f0ab360 con 0x56414f1bda10 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48a0e0ab80 10 client.0 _ll_register_callbacks cb 0x56414ef087b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f4886ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bc210 0x56414f1c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f4886ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bc210 0x56414f1c5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33226/0 (socket says 172.21.15.8:33226) 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f48867fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 0x56414f1c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.466+0000 7f4886ffd700 1 -- 172.21.15.8:0/72784443 learned_addr learned my addr 172.21.15.8:0/72784443 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f48877fe700 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bda10 0x56414f1cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f4886ffd700 1 -- 172.21.15.8:0/72784443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bda10 msgr2=0x56414f1cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f4886ffd700 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bda10 0x56414f1cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f4886ffd700 1 -- 172.21.15.8:0/72784443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 msgr2=0x56414f1c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f4886ffd700 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 0x56414f1c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f4886ffd700 1 -- 172.21.15.8:0/72784443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48881a12d0 con 0x56414f1bc210 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f4886ffd700 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bc210 0x56414f1c5e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f487800ddb0 tx=0x7f487800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fc65fe81286b00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f486aff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f486aff5700 1 -- 172.21.15.8:0/72784443 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878011640 con 0x56414f1bc210 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/72784443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56414f1aeec0 con 0x56414f1bc210 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f486aff5700 1 -- 172.21.15.8:0/72784443 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f487800fe60 con 0x56414f1bc210 2023-10-06T23:12:51.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f486aff5700 1 -- 172.21.15.8:0/72784443 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4878021030 con 0x56414f1bc210 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f48a0e0ab80 10 client.15213 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.467+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/72784443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56414ef22c10 con 0x56414f1bc210 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f486aff5700 1 -- 172.21.15.8:0/72784443 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56414f1aeec0 con 0x56414f1bc210 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f486aff5700 1 -- 172.21.15.8:0/72784443 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f487801b760 con 0x56414f1bc210 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f48a0e0ab80 10 client.15213 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f48a0e0ab80 10 client.15213 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f48a0e0ab80 20 client.15213 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x56414f1d1a80 0x56414f1d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f48a0e0ab80 4 client.15213 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/72784443 --> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56414f107dc0 con 0x56414f1d1a80 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.468+0000 7f48867fc700 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x56414f1d1a80 0x56414f1d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.469+0000 7f48867fc700 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x56414f1d1a80 0x56414f1d0550 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d6caf31bf11aab3 server_cookie=e32f48555db222bd in_seq=0 out_seq=0 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.469+0000 7f486aff5700 10 client.15213 ms_handle_connect on v2:172.21.15.190:6834/2542800704 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f486aff5700 1 -- 172.21.15.8:0/72784443 <== mds.2 v2:172.21.15.190:6834/2542800704 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56414f107dc0 con 0x56414f1d1a80 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f486aff5700 10 client.15213 handle_command_reply: tid=0 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 client.15213 shutdown 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/72784443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bc210 msgr2=0x56414f1c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bc210 0x56414f1c5e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f487800ddb0 tx=0x7f487800f640 comp rx=0 tx=0).stop 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/72784443 shutdown_connections 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x56414f1d1a80 0x56414f1d0550 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bc210 0x56414f1c5e20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bda10 0x56414f1cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f486aff5700 0 client.15213 ms_handle_reset on v2:172.21.15.190:6834/2542800704 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/72784443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 0x56414f1c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/72784443 >> 172.21.15.8:0/72784443 conn(0x56414f130210 msgr2=0x56414f1b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/72784443 shutdown_connections 2023-10-06T23:12:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.470+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/72784443 wait complete. 2023-10-06T23:12:51.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.471+0000 7f48a0e0ab80 20 client.15213 trim_cache size 0 max 16384 2023-10-06T23:12:51.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48a0e0ab80 1 Processor -- start 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48a0e0ab80 1 -- start start 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bcb70 0x56414f1cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bda10 0x56414f1cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414ef8f8d0 con 0x56414f1bcb70 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f0b54d0 con 0x56414f1bda10 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f0cd590 con 0x56414f1bc210 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bcb70 0x56414f1cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bcb70 0x56414f1cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33228/0 (socket says 172.21.15.8:33228) 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.489+0000 7f48867fc700 1 -- 172.21.15.8:0/4230905923 learned_addr learned my addr 172.21.15.8:0/4230905923 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f48867fc700 1 -- 172.21.15.8:0/4230905923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 msgr2=0x56414f1b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f4886ffd700 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f48867fc700 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f48867fc700 1 -- 172.21.15.8:0/4230905923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bda10 msgr2=0x56414f1cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f48877fe700 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bda10 0x56414f1cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f48867fc700 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bda10 0x56414f1cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f48867fc700 1 -- 172.21.15.8:0/4230905923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56414ef60200 con 0x56414f1bcb70 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f4886ffd700 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f48877fe700 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bda10 0x56414f1cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f48867fc700 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bcb70 0x56414f1cd360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x56414f110100 tx=0x7f487c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753b15801f16777e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f486dffb700 1 -- 172.21.15.8:0/4230905923 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c02d070 con 0x56414f1bcb70 2023-10-06T23:12:51.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f486dffb700 1 -- 172.21.15.8:0/4230905923 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f487c0044b0 con 0x56414f1bcb70 2023-10-06T23:12:51.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.490+0000 7f486dffb700 1 -- 172.21.15.8:0/4230905923 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c025040 con 0x56414f1bcb70 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/4230905923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bcb70 msgr2=0x56414f1cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bcb70 0x56414f1cd360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x56414f110100 tx=0x7f487c013000 comp rx=0 tx=0).stop 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/4230905923 shutdown_connections 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bda10 0x56414f1cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/4230905923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bcb70 0x56414f1cd360 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/4230905923 >> 172.21.15.8:0/4230905923 conn(0x56414f130210 msgr2=0x56414f1b5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/4230905923 shutdown_connections 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/4230905923 wait complete. 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.491+0000 7f48a0e0ab80 1 -- start start 2023-10-06T23:12:51.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48a0e0ab80 1 Processor -- start 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 0x56414f1cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48a0e0ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1c9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f1c9e90 con 0x56414f1bda10 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f1ca000 con 0x56414f1bcb70 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48a0e0ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414f1ca1c0 con 0x56414f1bc210 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48a0e0ab80 10 client.0 _ll_register_callbacks cb 0x7f487800d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33242/0 (socket says 172.21.15.8:33242) 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48877fe700 1 -- 172.21.15.8:0/2368391331 learned_addr learned my addr 172.21.15.8:0/2368391331 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f4886ffd700 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.492+0000 7f48867fc700 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 0x56414f1cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48877fe700 1 -- 172.21.15.8:0/2368391331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 msgr2=0x56414f1ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48877fe700 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48877fe700 1 -- 172.21.15.8:0/2368391331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 msgr2=0x56414f1cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48877fe700 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 0x56414f1cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48877fe700 1 -- 172.21.15.8:0/2368391331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c00e9a0 con 0x56414f1bda10 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48877fe700 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1c9870 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f488009bc60 tx=0x7f488000b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68d2808408813 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f486aff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f486aff5700 1 -- 172.21.15.8:0/2368391331 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488001d610 con 0x56414f1bda10 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f486aff5700 1 -- 172.21.15.8:0/2368391331 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f488009c660 con 0x56414f1bda10 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/2368391331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4880012c30 con 0x56414f1bda10 2023-10-06T23:12:51.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f486aff5700 1 -- 172.21.15.8:0/2368391331 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48800ba170 con 0x56414f1bda10 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48a0e0ab80 10 client.15219 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/2368391331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56414ef38260 con 0x56414f1bda10 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.493+0000 7f486aff5700 1 -- 172.21.15.8:0/2368391331 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4880012c30 con 0x56414f1bda10 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.494+0000 7f486aff5700 1 -- 172.21.15.8:0/2368391331 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f488009b450 con 0x56414f1bda10 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.494+0000 7f48a0e0ab80 10 client.15219 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.494+0000 7f48a0e0ab80 10 client.15219 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.494+0000 7f48a0e0ab80 20 client.15219 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.494+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x56414f229d90 0x56414f226230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.494+0000 7f48a0e0ab80 4 client.15219 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.494+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/2368391331 --> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56414f107ae0 con 0x56414f229d90 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.494+0000 7f4886ffd700 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x56414f229d90 0x56414f226230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.495+0000 7f4886ffd700 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x56414f229d90 0x56414f226230 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a62dae4269631e5f server_cookie=6c0c195a6c7a5abc in_seq=0 out_seq=0 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.495+0000 7f486aff5700 10 client.15219 ms_handle_connect on v2:172.21.15.190:6834/2542800704 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.495+0000 7f486aff5700 1 -- 172.21.15.8:0/2368391331 <== mds.2 v2:172.21.15.190:6834/2542800704 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56414f107ae0 con 0x56414f229d90 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.495+0000 7f486aff5700 10 client.15219 handle_command_reply: tid=0 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.495+0000 7f48a0e0ab80 1 client.15219 shutdown 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.495+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/2368391331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 msgr2=0x56414f1c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.495+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1c9870 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f488009bc60 tx=0x7f488000b9d0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/2368391331 shutdown_connections 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x56414f229d90 0x56414f226230 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56414f1bda10 0x56414f1c9870 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56414f1bc210 0x56414f1ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f486aff5700 0 client.15219 ms_handle_reset on v2:172.21.15.190:6834/2542800704 2023-10-06T23:12:51.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 1 --2- 172.21.15.8:0/2368391331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56414f1bcb70 0x56414f1cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/2368391331 >> 172.21.15.8:0/2368391331 conn(0x56414f130210 msgr2=0x56414f1b6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/2368391331 shutdown_connections 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 1 -- 172.21.15.8:0/2368391331 wait complete. 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f48a0e0ab80 20 client.15219 trim_cache size 0 max 16384 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "5a0d88f6-649c-11ee-8db5-212e2dc638e7", 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24526, 2023-10-06T23:12:51.504 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T23:12:51.505 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T23:12:51.505 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T23:12:51.505 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 89.255835172000005, 2023-10-06T23:12:51.505 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2023-10-06T23:12:51.505 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2023-10-06T23:12:51.505 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2023-10-06T23:12:51.505 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 118.92783574800001 2023-10-06T23:12:51.505 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f488d3ff700 1 -- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f48700a1500 msgr2=0x7f48700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f48700a1500 0x7f48700a39c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f487c009ba0 tx=0x7f487c009550 comp rx=0 tx=0).stop 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f488d3ff700 1 -- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 msgr2=0x7f48881a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.496+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 0x7f48881a03e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4880009440 tx=0x7f4880009520 comp rx=0 tx=0).stop 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.497+0000 7f488d3ff700 1 -- 172.21.15.8:0/2464429308 shutdown_connections 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.497+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f48700a1500 0x7f48700a39c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.497+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4888104ca0 0x7f48881a03e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.497+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4888103110 0x7f4888198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.497+0000 7f488d3ff700 1 --2- 172.21.15.8:0/2464429308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4888104300 0x7f4888199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.497+0000 7f488d3ff700 1 -- 172.21.15.8:0/2464429308 >> 172.21.15.8:0/2464429308 conn(0x7f48880fe6a0 msgr2=0x7f4888107800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.497+0000 7f488d3ff700 1 -- 172.21.15.8:0/2464429308 shutdown_connections 2023-10-06T23:12:51.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.497+0000 7f488d3ff700 1 -- 172.21.15.8:0/2464429308 wait complete. 2023-10-06T23:12:51.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-06T23:12:51.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.717+0000 7f0180dff700 1 -- 172.21.15.8:0/1107847978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c1042e0 msgr2=0x7f017c104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.717+0000 7f0180dff700 1 --2- 172.21.15.8:0/1107847978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c1042e0 0x7f017c104740 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f01640099c0 tx=0x7f0164009cd0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.718+0000 7f0180dff700 1 -- 172.21.15.8:0/1107847978 shutdown_connections 2023-10-06T23:12:51.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.718+0000 7f0180dff700 1 --2- 172.21.15.8:0/1107847978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c104c80 0x7f017c10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.718+0000 7f0180dff700 1 --2- 172.21.15.8:0/1107847978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017c1030f0 0x7f017c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.718+0000 7f0180dff700 1 --2- 172.21.15.8:0/1107847978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c1042e0 0x7f017c104740 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.718+0000 7f0180dff700 1 -- 172.21.15.8:0/1107847978 >> 172.21.15.8:0/1107847978 conn(0x7f017c0fe660 msgr2=0x7f017c100aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.718+0000 7f0180dff700 1 -- 172.21.15.8:0/1107847978 shutdown_connections 2023-10-06T23:12:51.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.718+0000 7f0180dff700 1 -- 172.21.15.8:0/1107847978 wait complete. 2023-10-06T23:12:51.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f0180dff700 1 Processor -- start 2023-10-06T23:12:51.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f0180dff700 1 -- start start 2023-10-06T23:12:51.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f0180dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017c1030f0 0x7f017c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f0180dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c1042e0 0x7f017c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f0180dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c104c80 0x7f017c1a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f0180dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c1a0890 con 0x7f017c104c80 2023-10-06T23:12:51.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f0180dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c1a0a00 con 0x7f017c1042e0 2023-10-06T23:12:51.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f0180dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c1a0bc0 con 0x7f017c1030f0 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f017ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c104c80 0x7f017c1a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f017ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c104c80 0x7f017c1a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33254/0 (socket says 172.21.15.8:33254) 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.719+0000 7f017ad9d700 1 -- 172.21.15.8:0/3969828481 learned_addr learned my addr 172.21.15.8:0/3969828481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f017a59c700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017c1030f0 0x7f017c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f0173fff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c1042e0 0x7f017c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f017ad9d700 1 -- 172.21.15.8:0/3969828481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017c1030f0 msgr2=0x7f017c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f017ad9d700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017c1030f0 0x7f017c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f017ad9d700 1 -- 172.21.15.8:0/3969828481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c1042e0 msgr2=0x7f017c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f017ad9d700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c1042e0 0x7f017c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f017ad9d700 1 -- 172.21.15.8:0/3969828481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01640095f0 con 0x7f017c104c80 2023-10-06T23:12:51.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f0173fff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c1042e0 0x7f017c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f017ad9d700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c104c80 0x7f017c1a02c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0174007ee0 tx=0x7f017400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f01737fe700 1 -- 172.21.15.8:0/3969828481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174017070 con 0x7f017c104c80 2023-10-06T23:12:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f01737fe700 1 -- 172.21.15.8:0/3969828481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f017400f040 con 0x7f017c104c80 2023-10-06T23:12:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f0180dff700 1 -- 172.21.15.8:0/3969828481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c1a0ea0 con 0x7f017c104c80 2023-10-06T23:12:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.720+0000 7f01737fe700 1 -- 172.21.15.8:0/3969828481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174005710 con 0x7f017c104c80 2023-10-06T23:12:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.721+0000 7f0180dff700 1 -- 172.21.15.8:0/3969828481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c1a12c0 con 0x7f017c104c80 2023-10-06T23:12:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.723+0000 7f01737fe700 1 -- 172.21.15.8:0/3969828481 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0174005870 con 0x7f017c104c80 2023-10-06T23:12:51.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01946f9b80 1 Processor -- start 2023-10-06T23:12:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01946f9b80 1 -- start start 2023-10-06T23:12:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01737fe700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01737fe700 1 -- 172.21.15.8:0/3969828481 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f01740cc560 con 0x7f017c104c80 2023-10-06T23:12:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 0x55ac58900630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac58901430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58901e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01946f9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac58868410 con 0x55ac58900b70 2023-10-06T23:12:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01946f9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac58859bd0 con 0x55ac58901a10 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.725+0000 7f01946f9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac588574f0 con 0x55ac58900210 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f0173fff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58901e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f0173fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac58901430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58901e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53612/0 (socket says 172.21.15.8:53612) 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017ad9d700 1 -- 172.21.15.8:0/199735496 learned_addr learned my addr 172.21.15.8:0/199735496 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017a59c700 1 --2- 172.21.15.8:0/199735496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 0x55ac58900630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017ad9d700 1 -- 172.21.15.8:0/199735496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 msgr2=0x55ac58900630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017ad9d700 1 --2- 172.21.15.8:0/199735496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 0x55ac58900630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017ad9d700 1 -- 172.21.15.8:0/199735496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 msgr2=0x55ac58901430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017ad9d700 1 --2- 172.21.15.8:0/199735496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac58901430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.726+0000 7f017ad9d700 1 -- 172.21.15.8:0/199735496 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac5867dd90 con 0x55ac58901a10 2023-10-06T23:12:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.727+0000 7f017ad9d700 1 --2- 172.21.15.8:0/199735496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58901e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01740a1690 tx=0x7f017400dbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb7f22ae41b10e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.727+0000 7f0173fff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f016400b580 tx=0x7f016400b8b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.727+0000 7f0170ff9700 1 -- 172.21.15.8:0/199735496 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400dc60 con 0x55ac58901a10 2023-10-06T23:12:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.727+0000 7f0170ff9700 1 -- 172.21.15.8:0/199735496 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0174099f30 con 0x55ac58901a10 2023-10-06T23:12:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.727+0000 7f0170ff9700 1 -- 172.21.15.8:0/199735496 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01740840c0 con 0x55ac58901a10 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 -- 172.21.15.8:0/199735496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 msgr2=0x55ac58901e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 --2- 172.21.15.8:0/199735496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58901e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01740a1690 tx=0x7f017400dbd0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 -- 172.21.15.8:0/199735496 shutdown_connections 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 --2- 172.21.15.8:0/199735496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58901e90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 --2- 172.21.15.8:0/199735496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 0x55ac58900630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 --2- 172.21.15.8:0/199735496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac58901430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 -- 172.21.15.8:0/199735496 >> 172.21.15.8:0/199735496 conn(0x55ac58874210 msgr2=0x55ac588fb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 -- 172.21.15.8:0/199735496 shutdown_connections 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 -- 172.21.15.8:0/199735496 wait complete. 2023-10-06T23:12:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.728+0000 7f01946f9b80 1 -- start start 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f01946f9b80 1 Processor -- start 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 0x55ac5890a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900b70 0x55ac5890a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58901a10 0x55ac58911590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f01946f9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac58852de0 con 0x55ac58901a10 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f01946f9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac587ef6c0 con 0x55ac58900b70 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f01946f9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac587ef360 con 0x55ac58900210 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f01946f9b80 10 client.0 _ll_register_callbacks cb 0x55ac5864c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f017ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58901a10 0x55ac58911590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f017ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58901a10 0x55ac58911590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33276/0 (socket says 172.21.15.8:33276) 2023-10-06T23:12:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f017ad9d700 1 -- 172.21.15.8:0/2642242965 learned_addr learned my addr 172.21.15.8:0/2642242965 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f017a59c700 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 0x55ac5890a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.729+0000 7f0173fff700 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900b70 0x55ac5890a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f017ad9d700 1 -- 172.21.15.8:0/2642242965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 msgr2=0x55ac5890a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f017ad9d700 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 0x55ac5890a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f017ad9d700 1 -- 172.21.15.8:0/2642242965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900b70 msgr2=0x55ac5890a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f017ad9d700 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900b70 0x55ac5890a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f017ad9d700 1 -- 172.21.15.8:0/2642242965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c1a12c0 con 0x55ac58901a10 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f017ad9d700 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58901a10 0x55ac58911590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f01740962a0 tx=0x7f0174097d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450f2f2f3b89fe05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f0161ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f0161ffb700 1 -- 172.21.15.8:0/2642242965 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01740cc310 con 0x55ac58901a10 2023-10-06T23:12:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f01946f9b80 1 -- 172.21.15.8:0/2642242965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac588f2ec0 con 0x55ac58901a10 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f0161ffb700 1 -- 172.21.15.8:0/2642242965 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0174099830 con 0x55ac58901a10 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f0161ffb700 1 -- 172.21.15.8:0/2642242965 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0174098d20 con 0x55ac58901a10 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f01946f9b80 10 client.15231 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.730+0000 7f01946f9b80 1 -- 172.21.15.8:0/2642242965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ac58666c10 con 0x55ac58901a10 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f0161ffb700 1 -- 172.21.15.8:0/2642242965 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0174063080 con 0x55ac58901a10 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f0161ffb700 1 -- 172.21.15.8:0/2642242965 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0174084050 con 0x55ac58901a10 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f01946f9b80 10 client.15231 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f01946f9b80 10 client.15231 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f01946f9b80 20 client.15231 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55ac58915850 0x55ac589144c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f01946f9b80 4 client.15231 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f01946f9b80 1 -- 172.21.15.8:0/2642242965 --> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac5884bdc0 con 0x55ac58915850 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.731+0000 7f017a59c700 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55ac58915850 0x55ac589144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.732+0000 7f017a59c700 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55ac58915850 0x55ac589144c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e79acc23a938ec77 server_cookie=2457acf4ded9c4c0 in_seq=0 out_seq=0 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.732+0000 7f0161ffb700 10 client.15231 ms_handle_connect on v2:172.21.15.190:6838/730533990 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f0161ffb700 1 -- 172.21.15.8:0/2642242965 <== mds.1 v2:172.21.15.190:6838/730533990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ac5884bdc0 con 0x55ac58915850 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f0161ffb700 10 client.15231 handle_command_reply: tid=0 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 client.15231 shutdown 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 -- 172.21.15.8:0/2642242965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58901a10 msgr2=0x55ac58911590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58901a10 0x55ac58911590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f01740962a0 tx=0x7f0174097d20 comp rx=0 tx=0).stop 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 -- 172.21.15.8:0/2642242965 shutdown_connections 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55ac58915850 0x55ac589144c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58901a10 0x55ac58911590 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900210 0x55ac5890a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2642242965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900b70 0x55ac5890a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f0161ffb700 0 client.15231 ms_handle_reset on v2:172.21.15.190:6838/730533990 2023-10-06T23:12:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 -- 172.21.15.8:0/2642242965 >> 172.21.15.8:0/2642242965 conn(0x55ac58874210 msgr2=0x55ac588faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 -- 172.21.15.8:0/2642242965 shutdown_connections 2023-10-06T23:12:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 1 -- 172.21.15.8:0/2642242965 wait complete. 2023-10-06T23:12:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.733+0000 7f01946f9b80 20 client.15231 trim_cache size 0 max 16384 2023-10-06T23:12:51.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f01946f9b80 1 Processor -- start 2023-10-06T23:12:51.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f01946f9b80 1 -- start start 2023-10-06T23:12:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900210 0x55ac588faf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900b70 0x55ac58911550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58907e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f01946f9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac586d38d0 con 0x55ac58900210 2023-10-06T23:12:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f01946f9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac5884bdc0 con 0x55ac58901a10 2023-10-06T23:12:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f01946f9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac5890b200 con 0x55ac58900b70 2023-10-06T23:12:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f017a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900210 0x55ac588faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f017a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900210 0x55ac588faf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33288/0 (socket says 172.21.15.8:33288) 2023-10-06T23:12:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f017a59c700 1 -- 172.21.15.8:0/1330514172 learned_addr learned my addr 172.21.15.8:0/1330514172 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f017a59c700 1 -- 172.21.15.8:0/1330514172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900b70 msgr2=0x55ac58911550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f017a59c700 1 --2- 172.21.15.8:0/1330514172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900b70 0x55ac58911550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f017a59c700 1 -- 172.21.15.8:0/1330514172 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 msgr2=0x55ac58907e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f017a59c700 1 --2- 172.21.15.8:0/1330514172 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58907e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.752+0000 7f017a59c700 1 -- 172.21.15.8:0/1330514172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac586a4200 con 0x55ac58900210 2023-10-06T23:12:51.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.753+0000 7f017a59c700 1 --2- 172.21.15.8:0/1330514172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900210 0x55ac588faf00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55ac58916580 tx=0x7f016c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6fe06bce3916 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.753+0000 7f01717fa700 1 -- 172.21.15.8:0/1330514172 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c017070 con 0x55ac58900210 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.753+0000 7f01717fa700 1 -- 172.21.15.8:0/1330514172 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f016c018040 con 0x55ac58900210 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.753+0000 7f01717fa700 1 -- 172.21.15.8:0/1330514172 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c004bd0 con 0x55ac58900210 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.753+0000 7f01946f9b80 1 -- 172.21.15.8:0/1330514172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900210 msgr2=0x55ac588faf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.753+0000 7f01946f9b80 1 --2- 172.21.15.8:0/1330514172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900210 0x55ac588faf00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55ac58916580 tx=0x7f016c009260 comp rx=0 tx=0).stop 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 -- 172.21.15.8:0/1330514172 shutdown_connections 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 --2- 172.21.15.8:0/1330514172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900210 0x55ac588faf00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 --2- 172.21.15.8:0/1330514172 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58901a10 0x55ac58907e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 --2- 172.21.15.8:0/1330514172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58900b70 0x55ac58911550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 -- 172.21.15.8:0/1330514172 >> 172.21.15.8:0/1330514172 conn(0x55ac58874210 msgr2=0x55ac58908c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 -- 172.21.15.8:0/1330514172 shutdown_connections 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 -- 172.21.15.8:0/1330514172 wait complete. 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 -- start start 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.754+0000 7f01946f9b80 1 Processor -- start 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900210 0x55ac58911250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac5890dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f01946f9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58901a10 0x55ac5890e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f01946f9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac5890e770 con 0x55ac58900b70 2023-10-06T23:12:51.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f01946f9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac5890e8e0 con 0x55ac58900210 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f01946f9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac58969240 con 0x55ac58901a10 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f01946f9b80 10 client.0 _ll_register_callbacks cb 0x7f0164009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f0173fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac5890dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f0173fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac5890dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33290/0 (socket says 172.21.15.8:33290) 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f0173fff700 1 -- 172.21.15.8:0/2234764578 learned_addr learned my addr 172.21.15.8:0/2234764578 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f017ad9d700 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58901a10 0x55ac5890e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f017a59c700 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900210 0x55ac58911250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f0173fff700 1 -- 172.21.15.8:0/2234764578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58901a10 msgr2=0x55ac5890e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f0173fff700 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58901a10 0x55ac5890e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f0173fff700 1 -- 172.21.15.8:0/2234764578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900210 msgr2=0x55ac58911250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f0173fff700 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900210 0x55ac58911250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.755+0000 7f0173fff700 1 -- 172.21.15.8:0/2234764578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c010430 con 0x55ac58900b70 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f0173fff700 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac5890dcf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f016400bf10 tx=0x7f0164000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a643a4e9acf3dfbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f0161ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f0161ffb700 1 -- 172.21.15.8:0/2234764578 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016402c070 con 0x55ac58900b70 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f01946f9b80 1 -- 172.21.15.8:0/2234764578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0174099f30 con 0x55ac58900b70 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f0161ffb700 1 -- 172.21.15.8:0/2234764578 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f016400f670 con 0x55ac58900b70 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f0161ffb700 1 -- 172.21.15.8:0/2234764578 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f016400f830 con 0x55ac58900b70 2023-10-06T23:12:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f01946f9b80 10 client.15237 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f01946f9b80 1 -- 172.21.15.8:0/2234764578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ac5867c260 con 0x55ac58900b70 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.756+0000 7f0161ffb700 1 -- 172.21.15.8:0/2234764578 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0174099f30 con 0x55ac58900b70 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.757+0000 7f0161ffb700 1 -- 172.21.15.8:0/2234764578 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f01640277f0 con 0x55ac58900b70 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.757+0000 7f01946f9b80 10 client.15237 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.757+0000 7f01946f9b80 10 client.15237 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.757+0000 7f01946f9b80 20 client.15237 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.757+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55ac5896e510 0x55ac5896a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.757+0000 7f01946f9b80 4 client.15237 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.757+0000 7f01946f9b80 1 -- 172.21.15.8:0/2234764578 --> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ac5884bae0 con 0x55ac5896e510 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.757+0000 7f017a59c700 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55ac5896e510 0x55ac5896a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.758+0000 7f017a59c700 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55ac5896e510 0x55ac5896a9f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2a79b5350ee92f30 server_cookie=57af63e018d2f32 in_seq=0 out_seq=0 2023-10-06T23:12:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.758+0000 7f0161ffb700 10 client.15237 ms_handle_connect on v2:172.21.15.190:6838/730533990 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.758+0000 7f0161ffb700 1 -- 172.21.15.8:0/2234764578 <== mds.1 v2:172.21.15.190:6838/730533990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55ac5884bae0 con 0x55ac5896e510 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.758+0000 7f0161ffb700 10 client.15237 handle_command_reply: tid=0 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.758+0000 7f01946f9b80 1 client.15237 shutdown 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.758+0000 7f01946f9b80 1 -- 172.21.15.8:0/2234764578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 msgr2=0x55ac5890dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.758+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac5890dcf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f016400bf10 tx=0x7f0164000bc0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 1 -- 172.21.15.8:0/2234764578 shutdown_connections 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x55ac5896e510 0x55ac5896a9f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac58901a10 0x55ac5890e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac58900210 0x55ac58911250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0161ffb700 0 client.15237 ms_handle_reset on v2:172.21.15.190:6838/730533990 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 1 --2- 172.21.15.8:0/2234764578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac58900b70 0x55ac5890dcf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 1 -- 172.21.15.8:0/2234764578 >> 172.21.15.8:0/2234764578 conn(0x55ac58874210 msgr2=0x55ac58911dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 1 -- 172.21.15.8:0/2234764578 shutdown_connections 2023-10-06T23:12:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 1 -- 172.21.15.8:0/2234764578 wait complete. 2023-10-06T23:12:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f01946f9b80 20 client.15237 trim_cache size 0 max 16384 2023-10-06T23:12:51.768 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:12:51.768 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "5a0d88f6-649c-11ee-8db5-212e2dc638e7", 2023-10-06T23:12:51.768 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2023-10-06T23:12:51.768 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24568, 2023-10-06T23:12:51.768 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T23:12:51.769 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T23:12:51.769 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T23:12:51.769 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 90.450778172, 2023-10-06T23:12:51.769 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2023-10-06T23:12:51.769 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2023-10-06T23:12:51.769 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2023-10-06T23:12:51.769 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 109.950497674 2023-10-06T23:12:51.769 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:12:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0180dff700 1 -- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 msgr2=0x7f01680a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0180dff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f016400b580 tx=0x7f016400b8b0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0180dff700 1 -- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c104c80 msgr2=0x7f017c1a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0180dff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c104c80 0x7f017c1a02c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0174007ee0 tx=0x7f017400d3b0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0180dff700 1 -- 172.21.15.8:0/3969828481 shutdown_connections 2023-10-06T23:12:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0180dff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0180dff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f017c104c80 0x7f017c1a02c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.759+0000 7f0180dff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017c1030f0 0x7f017c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.760+0000 7f0180dff700 1 --2- 172.21.15.8:0/3969828481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f017c1042e0 0x7f017c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.760+0000 7f0180dff700 1 -- 172.21.15.8:0/3969828481 >> 172.21.15.8:0/3969828481 conn(0x7f017c0fe660 msgr2=0x7f017c100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.760+0000 7f0180dff700 1 -- 172.21.15.8:0/3969828481 shutdown_connections 2023-10-06T23:12:51.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.760+0000 7f0180dff700 1 -- 172.21.15.8:0/3969828481 wait complete. 2023-10-06T23:12:51.780 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T23:12:51.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.981+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/2792921063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 msgr2=0x7f0b181012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.981+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/2792921063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 0x7f0b181012b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009990 tx=0x7f0b08009ca0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.982+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/2792921063 shutdown_connections 2023-10-06T23:12:51.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.982+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/2792921063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 0x7f0b181012b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.982+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/2792921063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18102a30 0x7f0b18109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.982+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/2792921063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b18102070 0x7f0b181024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.982+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/2792921063 >> 172.21.15.8:0/2792921063 conn(0x7f0b180fc430 msgr2=0x7f0b180fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.982+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/2792921063 shutdown_connections 2023-10-06T23:12:51.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.982+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/2792921063 wait complete. 2023-10-06T23:12:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b1d9ff700 1 Processor -- start 2023-10-06T23:12:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b1d9ff700 1 -- start start 2023-10-06T23:12:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b1d9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 0x7f0b18074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b1d9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b18102070 0x7f0b180732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b1d9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18102a30 0x7f0b180737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b1d9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18073f80 con 0x7f0b18100e90 2023-10-06T23:12:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b1d9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180740f0 con 0x7f0b18102070 2023-10-06T23:12:51.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b1d9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181a0bf0 con 0x7f0b18102a30 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.983+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 0x7f0b18074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 0x7f0b18074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33308/0 (socket says 172.21.15.8:33308) 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b16ffd700 1 -- 172.21.15.8:0/776854692 learned_addr learned my addr 172.21.15.8:0/776854692 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b167fc700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b18102070 0x7f0b180732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b177fe700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18102a30 0x7f0b180737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b16ffd700 1 -- 172.21.15.8:0/776854692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18102a30 msgr2=0x7f0b180737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18102a30 0x7f0b180737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b16ffd700 1 -- 172.21.15.8:0/776854692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b18102070 msgr2=0x7f0b180732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b18102070 0x7f0b180732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b16ffd700 1 -- 172.21.15.8:0/776854692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b080095f0 con 0x7f0b18100e90 2023-10-06T23:12:51.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b167fc700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b18102070 0x7f0b180732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:51.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 0x7f0b18074c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0b08004730 tx=0x7f0b08005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b1c9fd700 1 -- 172.21.15.8:0/776854692 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0801d070 con 0x7f0b18100e90 2023-10-06T23:12:51.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b1c9fd700 1 -- 172.21.15.8:0/776854692 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b08004ca0 con 0x7f0b18100e90 2023-10-06T23:12:51.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/776854692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b181a0e70 con 0x7f0b18100e90 2023-10-06T23:12:51.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.984+0000 7f0b1c9fd700 1 -- 172.21.15.8:0/776854692 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08003d90 con 0x7f0b18100e90 2023-10-06T23:12:51.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.985+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/776854692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b181a11e0 con 0x7f0b18100e90 2023-10-06T23:12:51.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.988+0000 7f0b1c9fd700 1 -- 172.21.15.8:0/776854692 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0b08004810 con 0x7f0b18100e90 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.989+0000 7f0b31327b80 1 Processor -- start 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.989+0000 7f0b1c9fd700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b000a1480 0x7f0b000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.989+0000 7f0b31327b80 1 -- start start 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.989+0000 7f0b1c9fd700 1 -- 172.21.15.8:0/776854692 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0b080cdec0 con 0x7f0b18100e90 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.989+0000 7f0b177fe700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b000a1480 0x7f0b000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.989+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7ed210 0x55bc8c7ed630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7ee430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7eee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b31327b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c755410 con 0x55bc8c7eea10 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b31327b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c746bd0 con 0x55bc8c7edb70 2023-10-06T23:12:51.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b31327b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c7444f0 con 0x55bc8c7ed210 2023-10-06T23:12:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b167fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7ee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b167fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7ee430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53660/0 (socket says 172.21.15.8:53660) 2023-10-06T23:12:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b167fc700 1 -- 172.21.15.8:0/81894514 learned_addr learned my addr 172.21.15.8:0/81894514 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b177fe700 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7ed210 0x55bc8c7ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b177fe700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b000a1480 0x7f0b000a3940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0b180752c0 tx=0x7f0b100077e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b167fc700 1 -- 172.21.15.8:0/81894514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7ed210 msgr2=0x55bc8c7ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b167fc700 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7ed210 0x55bc8c7ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b167fc700 1 -- 172.21.15.8:0/81894514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 msgr2=0x55bc8c7eee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b167fc700 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7eee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b167fc700 1 -- 172.21.15.8:0/81894514 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc8c56ad90 con 0x55bc8c7edb70 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.990+0000 7f0b177fe700 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7eee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.991+0000 7f0b167fc700 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7ee430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00bd40 tx=0x7f0b0c00f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ac528e480f2ff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.991+0000 7f0afdffb700 1 -- 172.21.15.8:0/81894514 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00fda0 con 0x55bc8c7edb70 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.991+0000 7f0afdffb700 1 -- 172.21.15.8:0/81894514 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b0c00be90 con 0x55bc8c7edb70 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.991+0000 7f0afdffb700 1 -- 172.21.15.8:0/81894514 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c01b6e0 con 0x55bc8c7edb70 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 -- 172.21.15.8:0/81894514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 msgr2=0x55bc8c7ee430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:51.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7ee430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00bd40 tx=0x7f0b0c00f640 comp rx=0 tx=0).stop 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 -- 172.21.15.8:0/81894514 shutdown_connections 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7eee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7ed210 0x55bc8c7ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 --2- 172.21.15.8:0/81894514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7ee430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 -- 172.21.15.8:0/81894514 >> 172.21.15.8:0/81894514 conn(0x55bc8c761210 msgr2=0x55bc8c7e80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 -- 172.21.15.8:0/81894514 shutdown_connections 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 -- 172.21.15.8:0/81894514 wait complete. 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.992+0000 7f0b31327b80 1 -- start start 2023-10-06T23:12:51.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b31327b80 1 Processor -- start 2023-10-06T23:12:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7f7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b31327b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c73fde0 con 0x55bc8c7ed210 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b31327b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c6dc6c0 con 0x55bc8c7edb70 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b31327b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c6dc360 con 0x55bc8c7eea10 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b31327b80 10 client.0 _ll_register_callbacks cb 0x55bc8c5397b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33320/0 (socket says 172.21.15.8:33320) 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.993+0000 7f0b16ffd700 1 -- 172.21.15.8:0/1844579038 learned_addr learned my addr 172.21.15.8:0/1844579038 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b167fc700 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b16ffd700 1 -- 172.21.15.8:0/1844579038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 msgr2=0x55bc8c7fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b16ffd700 1 -- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 msgr2=0x55bc8c7f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b16ffd700 1 -- 172.21.15.8:0/1844579038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b10007d90 con 0x55bc8c7ed210 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b167fc700 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f6ff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0b08097720 tx=0x7f0b0809b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dd336ea542be71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0af6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0af6ffd700 1 -- 172.21.15.8:0/1844579038 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080a3520 con 0x55bc8c7ed210 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0af6ffd700 1 -- 172.21.15.8:0/1844579038 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0b0809f020 con 0x55bc8c7ed210 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b31327b80 1 -- 172.21.15.8:0/1844579038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc8c7dfec0 con 0x55bc8c7ed210 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0af6ffd700 1 -- 172.21.15.8:0/1844579038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b080a3090 con 0x55bc8c7ed210 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b31327b80 10 client.15249 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.994+0000 7f0b31327b80 1 -- 172.21.15.8:0/1844579038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f0b0c00b9a0 con 0x55bc8c7ed210 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0af6ffd700 1 -- 172.21.15.8:0/1844579038 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bc8c7dfec0 con 0x55bc8c7ed210 2023-10-06T23:12:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0af6ffd700 1 -- 172.21.15.8:0/1844579038 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0b08011c30 con 0x55bc8c7ed210 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0b31327b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0b31327b80 10 client.15249 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0b31327b80 20 client.15249 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0b31327b80 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc8c802850 0x55bc8c8014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0b31327b80 4 client.15249 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0b31327b80 1 -- 172.21.15.8:0/1844579038 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc8c738dc0 con 0x55bc8c802850 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.995+0000 7f0b167fc700 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc8c802850 0x55bc8c8014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.996+0000 7f0b167fc700 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc8c802850 0x55bc8c8014a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d78ed05663eb3f9 server_cookie=a956efbbefd13b3c in_seq=0 out_seq=0 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.996+0000 7f0af6ffd700 10 client.15249 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0af6ffd700 1 -- 172.21.15.8:0/1844579038 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bc8c738dc0 con 0x55bc8c802850 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0af6ffd700 10 client.15249 handle_command_reply: tid=0 2023-10-06T23:12:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0b31327b80 1 client.15249 shutdown 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0b31327b80 1 -- 172.21.15.8:0/1844579038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 msgr2=0x55bc8c7f6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0b31327b80 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f6ff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0b08097720 tx=0x7f0b0809b760 comp rx=0 tx=0).stop 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0b31327b80 1 -- 172.21.15.8:0/1844579038 shutdown_connections 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0b31327b80 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc8c802850 0x55bc8c8014a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0b31327b80 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f6ff0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0b31327b80 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.997+0000 7f0af6ffd700 0 client.15249 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.998+0000 7f0b31327b80 1 --2- 172.21.15.8:0/1844579038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.998+0000 7f0b31327b80 1 -- 172.21.15.8:0/1844579038 >> 172.21.15.8:0/1844579038 conn(0x55bc8c761210 msgr2=0x55bc8c7e7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.998+0000 7f0b31327b80 1 -- 172.21.15.8:0/1844579038 shutdown_connections 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.998+0000 7f0b31327b80 1 -- 172.21.15.8:0/1844579038 wait complete. 2023-10-06T23:12:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:51.998+0000 7f0b31327b80 20 client.15249 trim_cache size 0 max 16384 2023-10-06T23:12:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b31327b80 1 Processor -- start 2023-10-06T23:12:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b31327b80 1 -- start start 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fe530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b31327b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c5c08d0 con 0x55bc8c7ed210 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b31327b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c738df0 con 0x55bc8c7edb70 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b31327b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c7e93e0 con 0x55bc8c7eea10 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.016+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33324/0 (socket says 172.21.15.8:33324) 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b16ffd700 1 -- 172.21.15.8:0/2266408020 learned_addr learned my addr 172.21.15.8:0/2266408020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b177fe700 1 --2- 172.21.15.8:0/2266408020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b16ffd700 1 -- 172.21.15.8:0/2266408020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 msgr2=0x55bc8c7fe530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/2266408020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fe530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b16ffd700 1 -- 172.21.15.8:0/2266408020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 msgr2=0x55bc8c7f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/2266408020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b16ffd700 1 -- 172.21.15.8:0/2266408020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc8c553c10 con 0x55bc8c7ed210 2023-10-06T23:12:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/2266408020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f1980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0b080095c0 tx=0x7f0b08000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77581a919511e538 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0afe7fc700 1 -- 172.21.15.8:0/2266408020 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080a3520 con 0x55bc8c7ed210 2023-10-06T23:12:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0afe7fc700 1 -- 172.21.15.8:0/2266408020 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b0809f040 con 0x55bc8c7ed210 2023-10-06T23:12:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.017+0000 7f0afe7fc700 1 -- 172.21.15.8:0/2266408020 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080b91e0 con 0x55bc8c7ed210 2023-10-06T23:12:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 -- 172.21.15.8:0/2266408020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 msgr2=0x55bc8c7f1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 --2- 172.21.15.8:0/2266408020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f1980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0b080095c0 tx=0x7f0b08000bc0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 -- 172.21.15.8:0/2266408020 shutdown_connections 2023-10-06T23:12:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 --2- 172.21.15.8:0/2266408020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7ed210 0x55bc8c7f1980 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 --2- 172.21.15.8:0/2266408020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fe530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 --2- 172.21.15.8:0/2266408020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7edb70 0x55bc8c7f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 -- 172.21.15.8:0/2266408020 >> 172.21.15.8:0/2266408020 conn(0x55bc8c761210 msgr2=0x55bc8c7f5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 -- 172.21.15.8:0/2266408020 shutdown_connections 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 -- 172.21.15.8:0/2266408020 wait complete. 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.018+0000 7f0b31327b80 1 -- start start 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b31327b80 1 Processor -- start 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7ed210 0x55bc8c7fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7edb70 0x55bc8c7fac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b31327b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b31327b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c7fe130 con 0x55bc8c7eea10 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b31327b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c7fe2a0 con 0x55bc8c7ed210 2023-10-06T23:12:52.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b31327b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8c7fe460 con 0x55bc8c7edb70 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b31327b80 10 client.0 _ll_register_callbacks cb 0x7f0b08004ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33326/0 (socket says 172.21.15.8:33326) 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b177fe700 1 -- 172.21.15.8:0/3482046153 learned_addr learned my addr 172.21.15.8:0/3482046153 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.019+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7ed210 0x55bc8c7fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0b167fc700 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7edb70 0x55bc8c7fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0b177fe700 1 -- 172.21.15.8:0/3482046153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7edb70 msgr2=0x55bc8c7fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0b177fe700 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7edb70 0x55bc8c7fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0b177fe700 1 -- 172.21.15.8:0/3482046153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7ed210 msgr2=0x55bc8c7fa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0b177fe700 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7ed210 0x55bc8c7fa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0b177fe700 1 -- 172.21.15.8:0/3482046153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0c00b9a0 con 0x55bc8c7eea10 2023-10-06T23:12:52.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0b177fe700 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fdbf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0b10007be0 tx=0x7f0b10004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90d568c11281799 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0af6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0af6ffd700 1 -- 172.21.15.8:0/3482046153 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10019a30 con 0x55bc8c7eea10 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0b31327b80 1 -- 172.21.15.8:0/3482046153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b0c00be90 con 0x55bc8c7eea10 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.020+0000 7f0af6ffd700 1 -- 172.21.15.8:0/3482046153 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0b1001e040 con 0x55bc8c7eea10 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0af6ffd700 1 -- 172.21.15.8:0/3482046153 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b10019b90 con 0x55bc8c7eea10 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0b31327b80 10 client.15255 fetch_fsmap learned FSMap version 23 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0b31327b80 1 -- 172.21.15.8:0/3482046153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bc8c591200 con 0x55bc8c7eea10 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0af6ffd700 1 -- 172.21.15.8:0/3482046153 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b0c00be90 con 0x55bc8c7eea10 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0af6ffd700 1 -- 172.21.15.8:0/3482046153 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0b1002e420 con 0x55bc8c7eea10 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0b31327b80 10 client.15255 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0b31327b80 10 client.15255 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T23:12:52.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0b31327b80 20 client.15255 populate_metadata read hostname 'smithi008' 2023-10-06T23:12:52.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0b31327b80 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc8c85afd0 0x55bc8c857370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:52.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0b31327b80 4 client.15255 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-06T23:12:52.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.021+0000 7f0b31327b80 1 -- 172.21.15.8:0/3482046153 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc8c738ae0 con 0x55bc8c85afd0 2023-10-06T23:12:52.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.022+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc8c85afd0 0x55bc8c857370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:52.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.022+0000 7f0b16ffd700 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc8c85afd0 0x55bc8c857370 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51c251a211f2d94a server_cookie=95fa6c82ffeccc40 in_seq=0 out_seq=0 2023-10-06T23:12:52.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.022+0000 7f0af6ffd700 10 client.15255 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:12:52.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.022+0000 7f0af6ffd700 1 -- 172.21.15.8:0/3482046153 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55bc8c738ae0 con 0x55bc8c85afd0 2023-10-06T23:12:52.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.022+0000 7f0af6ffd700 10 client.15255 handle_command_reply: tid=0 2023-10-06T23:12:52.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.022+0000 7f0b31327b80 1 client.15255 shutdown 2023-10-06T23:12:52.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 -- 172.21.15.8:0/3482046153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 msgr2=0x55bc8c7fdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:52.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fdbf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0b10007be0 tx=0x7f0b10004ad0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 -- 172.21.15.8:0/3482046153 shutdown_connections 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc8c85afd0 0x55bc8c857370 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc8c7eea10 0x55bc8c7fdbf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc8c7ed210 0x55bc8c7fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 --2- 172.21.15.8:0/3482046153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc8c7edb70 0x55bc8c7fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0af6ffd700 0 client.15255 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 -- 172.21.15.8:0/3482046153 >> 172.21.15.8:0/3482046153 conn(0x55bc8c761210 msgr2=0x55bc8c7f1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 -- 172.21.15.8:0/3482046153 shutdown_connections 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 1 -- 172.21.15.8:0/3482046153 wait complete. 2023-10-06T23:12:52.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.023+0000 7f0b31327b80 20 client.15255 trim_cache size 0 max 16384 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "5a0d88f6-649c-11ee-8db5-212e2dc638e7", 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24581, 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 93.735584838999998, 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 23, 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 88, 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 86, 2023-10-06T23:12:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 100.441228178 2023-10-06T23:12:52.032 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:12:52.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b000a1480 msgr2=0x7f0b000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:52.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b000a1480 0x7f0b000a3940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0b180752c0 tx=0x7f0b100077e0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 msgr2=0x7f0b18074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:52.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 0x7f0b18074c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0b08004730 tx=0x7f0b08005e80 comp rx=0 tx=0).stop 2023-10-06T23:12:52.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/776854692 shutdown_connections 2023-10-06T23:12:52.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b000a1480 0x7f0b000a3940 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b18100e90 0x7f0b18074c60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18102a30 0x7f0b180737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 --2- 172.21.15.8:0/776854692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b18102070 0x7f0b180732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:52.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/776854692 >> 172.21.15.8:0/776854692 conn(0x7f0b180fc430 msgr2=0x7f0b180fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:52.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/776854692 shutdown_connections 2023-10-06T23:12:52.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:52.024+0000 7f0b1d9ff700 1 -- 172.21.15.8:0/776854692 wait complete. 2023-10-06T23:12:52.045 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T23:12:52.069 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T23:12:52.069 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-06T23:12:52.069 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mountpoint': '/tmp/cephfs'} 2023-10-06T23:12:52.069 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-06T23:12:52.069 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-10-06T23:12:52.069 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-10-06T23:12:52.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:52.070 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T23:12:52.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:52.114 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-06T23:12:52.226 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2023-10-06T23:12:52.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:12:52.230 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T23:12:52.230 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-06T23:12:52.292 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:52 smithi008 ceph-mon[98532]: pgmap v349: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:52.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:52 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/317009970' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:52.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:52 smithi156 ceph-mon[102862]: pgmap v349: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:52.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:52 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/317009970' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:52.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:52 smithi190 ceph-mon[102658]: pgmap v349: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:52.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:52 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/317009970' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:12:52.969 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:12:53.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:53 smithi008 ceph-mon[98532]: pgmap v350: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:53.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:53 smithi156 ceph-mon[102862]: pgmap v350: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:53 smithi190 ceph-mon[102658]: pgmap v350: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-06T23:12:54.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 -- 172.21.15.8:0/1075582221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 msgr2=0x7f4bc410ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:54.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/1075582221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 0x7f4bc410ddb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00b0d0 tx=0x7f4bbc00b3e0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 -- 172.21.15.8:0/1075582221 shutdown_connections 2023-10-06T23:12:54.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/1075582221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 0x7f4bc410ddb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/1075582221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc4106f90 0x7f4bc4107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/1075582221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bc4100f80 0x7f4bc4101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 -- 172.21.15.8:0/1075582221 >> 172.21.15.8:0/1075582221 conn(0x7f4bc40780a0 msgr2=0x7f4bc40784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:54.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 -- 172.21.15.8:0/1075582221 shutdown_connections 2023-10-06T23:12:54.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.487+0000 7f4bcbd12700 1 -- 172.21.15.8:0/1075582221 wait complete. 2023-10-06T23:12:54.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.488+0000 7f4bcbd12700 1 Processor -- start 2023-10-06T23:12:54.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.488+0000 7f4bcbd12700 1 -- start start 2023-10-06T23:12:54.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bcbd12700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc4100f80 0x7f4bc4197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bcbd12700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 0x7f4bc4197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bcbd12700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bc4106f90 0x7f4bc419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bcbd12700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc419bfe0 con 0x7f4bc4101940 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bcbd12700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc419c150 con 0x7f4bc4100f80 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bcbd12700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc419c310 con 0x7f4bc4106f90 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc92ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 0x7f4bc4197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc92ad700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 0x7f4bc4197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33352/0 (socket says 172.21.15.8:33352) 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc92ad700 1 -- 172.21.15.8:0/4059493819 learned_addr learned my addr 172.21.15.8:0/4059493819 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc9aae700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc4100f80 0x7f4bc4197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bca2af700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bc4106f90 0x7f4bc419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc92ad700 1 -- 172.21.15.8:0/4059493819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bc4106f90 msgr2=0x7f4bc419b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:54.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc92ad700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bc4106f90 0x7f4bc419b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc92ad700 1 -- 172.21.15.8:0/4059493819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc4100f80 msgr2=0x7f4bc4197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc92ad700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc4100f80 0x7f4bc4197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc92ad700 1 -- 172.21.15.8:0/4059493819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc009d00 con 0x7f4bc4101940 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bca2af700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bc4106f90 0x7f4bc419b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.489+0000 7f4bc9aae700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc4100f80 0x7f4bc4197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.490+0000 7f4bc92ad700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 0x7f4bc4197560 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400e9a0 tx=0x7f4bb400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.490+0000 7f4bbaffd700 1 -- 172.21.15.8:0/4059493819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4009790 con 0x7f4bc4101940 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.490+0000 7f4bbaffd700 1 -- 172.21.15.8:0/4059493819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bb400cbd0 con 0x7f4bc4101940 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.490+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc419c5f0 con 0x7f4bc4101940 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.490+0000 7f4bbaffd700 1 -- 172.21.15.8:0/4059493819 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4018680 con 0x7f4bc4101940 2023-10-06T23:12:54.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.490+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc41a3e50 con 0x7f4bc4101940 2023-10-06T23:12:54.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.491+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc404ebb0 con 0x7f4bc4101940 2023-10-06T23:12:54.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.493+0000 7f4bbaffd700 1 -- 172.21.15.8:0/4059493819 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4bb400cd40 con 0x7f4bc4101940 2023-10-06T23:12:54.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.494+0000 7f4bbaffd700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4bb00a1480 0x7f4bb00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:12:54.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.495+0000 7f4bbaffd700 1 -- 172.21.15.8:0/4059493819 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4bb4014070 con 0x7f4bc4101940 2023-10-06T23:12:54.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.495+0000 7f4bc9aae700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4bb00a1480 0x7f4bb00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:12:54.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.495+0000 7f4bc9aae700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4bb00a1480 0x7f4bb00a3940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009c90 tx=0x7f4bc0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:12:54.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.499+0000 7f4bbaffd700 1 -- 172.21.15.8:0/4059493819 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4bb4052100 con 0x7f4bc4101940 2023-10-06T23:12:54.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.758+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4bc4198380 con 0x7f4bc4101940 2023-10-06T23:12:54.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.759+0000 7f4bbaffd700 1 -- 172.21.15.8:0/4059493819 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4bb4096660 con 0x7f4bc4101940 2023-10-06T23:12:54.761 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T23:12:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4bb00a1480 msgr2=0x7f4bb00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4bb00a1480 0x7f4bb00a3940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009c90 tx=0x7f4bc0009260 comp rx=0 tx=0).stop 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 msgr2=0x7f4bc4197560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 0x7f4bc4197560 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400e9a0 tx=0x7f4bb400ed60 comp rx=0 tx=0).stop 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 shutdown_connections 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4bb00a1480 0x7f4bb00a3940 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bc4106f90 0x7f4bc419b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4bc4100f80 0x7f4bc4197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 --2- 172.21.15.8:0/4059493819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bc4101940 0x7f4bc4197560 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 >> 172.21.15.8:0/4059493819 conn(0x7f4bc40780a0 msgr2=0x7f4bc40ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 shutdown_connections 2023-10-06T23:12:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:54.761+0000 7f4bcbd12700 1 -- 172.21.15.8:0/4059493819 wait complete. 2023-10-06T23:12:55.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:54 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4059493819' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-06T23:12:55.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:54 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4059493819' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-06T23:12:55.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:54 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4059493819' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-06T23:12:55.348 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T23:12:55.348 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T23:12:55.348 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-06T23:12:55.348 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T23:12:55.348 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-10-06T23:12:55.348 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T23:12:55.348 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T23:12:55.349 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T23:12:55.349 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-10-06T23:12:55.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:55.349 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-06T23:12:55.395 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T23:12:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T23:12:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T23:12:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T23:12:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-06T23:12:55.395 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 41534sec preferred_lft 41534sec 2023-10-06T23:12:55.396 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-06T23:12:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-06T23:12:55.397 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T23:12:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T23:12:55.397 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-10-06T23:12:55.397 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T23:12:55.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:55.398 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T23:12:55.398 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T23:12:55.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-10-06T23:12:55.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-10-06T23:12:55.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-10-06T23:12:55.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T23:12:55.398 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T23:12:55.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:55.900 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T23:12:55.972 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-06T23:12:55.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:55.975 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-06T23:12:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-06T23:12:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T23:12:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T23:12:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T23:12:56.040 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T23:12:56.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:56.041 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T23:12:56.041 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T23:12:56.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T23:12:56.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T23:12:56.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T23:12:56.041 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T23:12:56.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:55 smithi156 ceph-mon[102862]: pgmap v351: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:56.144 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:55 smithi008 ceph-mon[98532]: pgmap v351: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:56.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:55 smithi190 ceph-mon[102658]: pgmap v351: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:12:56.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:56.837 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T23:12:56.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:56.882 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-10-06T23:12:56.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:56.966 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T23:12:56.966 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T23:12:56.966 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--tmp-cephfs 2023-10-06T23:12:56.966 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-10-06T23:12:56.966 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T23:12:57.154 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-10-06T23:12:57.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:57.154 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T23:12:57.154 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T23:12:57.154 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-10-06T23:12:57.154 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T23:12:57.154 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-10-06T23:12:57.154 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-10-06T23:12:57.154 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-10-06T23:12:57.155 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T23:12:57.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:57.444 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-06T23:12:57.445 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-06T23:12:57.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-10-06T23:12:57.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T23:12:57.445 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-06T23:12:57.621 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mountpoint': '/tmp/cephfs'} 2023-10-06T23:12:57.621 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T23:12:57.621 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /tmp/cephfs 2023-10-06T23:12:57.665 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/tmp/cephfs' 2023-10-06T23:12:57.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T23:12:57.666 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /tmp/cephfs 2023-10-06T23:12:57.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-10-06T23:12:57.865 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-10-06T23:12:57.910 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-10-06T23:12:57.911 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-10-06T23:12:57.911 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-10-06T23:12:57.911 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-10-06T23:12:57.911 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-10-06T23:12:57.911 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-10-06T23:12:57.912 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-10-06T23:12:57.912 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-10-06T23:12:57.912 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/systemd 2023-10-06T23:12:57.912 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-10-06T23:12:57.912 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/perf_event 2023-10-06T23:12:57.912 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-06T23:12:57.912 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/blkio 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/memory 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/freezer 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/pids 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpuset 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/devices 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/hugetlb 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-10-06T23:12:57.913 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-10-06T23:12:57.914 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/42530154850e0eba163f98d08552a67f9703403b720befb028803f8599834dae/merged 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/7ef1814ab70dac0e1517420daa10b27fe6bd46c436634609a13510651742a1e1/merged 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/0 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d9d3e570d7f6a1cee5c7e5b9b0d4e42f521445984fd21e787c62e5c03b41a687/merged 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/75ed4450e548189f5f9b71730a633f934534e9320c98932481223eefa444e69f/merged 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d420281bf6a16e82cad34dcb717f1cad2774150ed386faf92c6813d91d002528/merged 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/202227c49be933a73ec59686854afcae93c2e1afa84f72e27c7859ca9d0cbd4b/merged 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/a287e9eff85f9b2ac6ba39da13f33017020ac3bdc388e4ddaa5ad393f6d54451/merged 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/36fec6dd2e5c2b68044931b77def30f83d4bcf9f43fbb295175fe68ccafad8a3/merged 2023-10-06T23:12:57.915 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/25499ad1324f0f1bb5cc0ef8ddf9bbee80f7dd79c225277c31c30ab86a2ffd6d/merged 2023-10-06T23:12:57.916 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/330463f544d98f41a059dcbb2be95b696603c3de565dd6c709da1d9eec803553/merged 2023-10-06T23:12:57.916 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-10-06T23:12:57.916 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-06T23:12:57.916 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-06T23:12:57.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:57.918 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-10-06T23:12:58.002 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T23:12:58.002 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 -o context=system_u:object_r:postgresql_db_t:s0) 2023-10-06T23:12:58.046 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-10-06T23:12:58.119 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-10-06T23:12:58.164 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/systemd 2023-10-06T23:12:58.165 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/perf_event 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/blkio 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/memory 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/freezer 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/pids 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpuset 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/devices 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/hugetlb 2023-10-06T23:12:58.166 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-10-06T23:12:58.167 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/42530154850e0eba163f98d08552a67f9703403b720befb028803f8599834dae/merged 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/7ef1814ab70dac0e1517420daa10b27fe6bd46c436634609a13510651742a1e1/merged 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/0 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d9d3e570d7f6a1cee5c7e5b9b0d4e42f521445984fd21e787c62e5c03b41a687/merged 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/75ed4450e548189f5f9b71730a633f934534e9320c98932481223eefa444e69f/merged 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d420281bf6a16e82cad34dcb717f1cad2774150ed386faf92c6813d91d002528/merged 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/202227c49be933a73ec59686854afcae93c2e1afa84f72e27c7859ca9d0cbd4b/merged 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/a287e9eff85f9b2ac6ba39da13f33017020ac3bdc388e4ddaa5ad393f6d54451/merged 2023-10-06T23:12:58.168 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/36fec6dd2e5c2b68044931b77def30f83d4bcf9f43fbb295175fe68ccafad8a3/merged 2023-10-06T23:12:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/25499ad1324f0f1bb5cc0ef8ddf9bbee80f7dd79c225277c31c30ab86a2ffd6d/merged 2023-10-06T23:12:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/330463f544d98f41a059dcbb2be95b696603c3de565dd6c709da1d9eec803553/merged 2023-10-06T23:12:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-10-06T23:12:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-06T23:12:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-06T23:12:58.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:58.170 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-10-06T23:12:58.241 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:2023-10-06T23:12:58.238+0000 7f0b68b455c0 -1 init, newargv = 0x55bb334364d0 newargc=17 2023-10-06T23:12:58.241 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[161984]: starting ceph client 2023-10-06T23:12:58.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[161984]: starting fuse 2023-10-06T23:12:58.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:12:58 smithi156 ceph-mon[102862]: pgmap v352: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:12:58 smithi008 ceph-mon[98532]: pgmap v352: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:58.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:12:58 smithi190 ceph-mon[102658]: pgmap v352: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:12:59.316 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-10-06T23:12:59.396 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-10-06T23:12:59.443 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-10-06T23:12:59.443 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/systemd 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/perf_event 2023-10-06T23:12:59.444 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/blkio 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/memory 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/freezer 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/pids 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpuset 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/devices 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/hugetlb 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-10-06T23:12:59.445 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay 2023-10-06T23:12:59.446 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/42530154850e0eba163f98d08552a67f9703403b720befb028803f8599834dae/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/7ef1814ab70dac0e1517420daa10b27fe6bd46c436634609a13510651742a1e1/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/0 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d9d3e570d7f6a1cee5c7e5b9b0d4e42f521445984fd21e787c62e5c03b41a687/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/75ed4450e548189f5f9b71730a633f934534e9320c98932481223eefa444e69f/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d420281bf6a16e82cad34dcb717f1cad2774150ed386faf92c6813d91d002528/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/202227c49be933a73ec59686854afcae93c2e1afa84f72e27c7859ca9d0cbd4b/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/a287e9eff85f9b2ac6ba39da13f33017020ac3bdc388e4ddaa5ad393f6d54451/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/36fec6dd2e5c2b68044931b77def30f83d4bcf9f43fbb295175fe68ccafad8a3/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/25499ad1324f0f1bb5cc0ef8ddf9bbee80f7dd79c225277c31c30ab86a2ffd6d/merged 2023-10-06T23:12:59.447 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/330463f544d98f41a059dcbb2be95b696603c3de565dd6c709da1d9eec803553/merged 2023-10-06T23:12:59.448 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-10-06T23:12:59.448 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-06T23:12:59.448 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-06T23:12:59.448 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs 2023-10-06T23:12:59.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:59.449 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-10-06T23:12:59.493 INFO:teuthology.orchestra.run.smithi008.stdout:121 2023-10-06T23:12:59.494 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-10-06T23:12:59.494 DEBUG:teuthology.orchestra.run.smithi008:> sudo stdin-killer -- python3 -c ' 2023-10-06T23:12:59.494 DEBUG:teuthology.orchestra.run.smithi008:> import glob 2023-10-06T23:12:59.495 DEBUG:teuthology.orchestra.run.smithi008:> import re 2023-10-06T23:12:59.495 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-10-06T23:12:59.495 DEBUG:teuthology.orchestra.run.smithi008:> import subprocess 2023-10-06T23:12:59.495 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T23:12:59.495 DEBUG:teuthology.orchestra.run.smithi008:> def _find_admin_socket(client_name): 2023-10-06T23:12:59.496 DEBUG:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T23:12:59.496 DEBUG:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2023-10-06T23:12:59.496 DEBUG:teuthology.orchestra.run.smithi008:> mountpoint = "/tmp/cephfs" 2023-10-06T23:12:59.496 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T23:12:59.496 DEBUG:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2023-10-06T23:12:59.497 DEBUG:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2023-10-06T23:12:59.497 DEBUG:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2023-10-06T23:12:59.497 DEBUG:teuthology.orchestra.run.smithi008:> return files[0] 2023-10-06T23:12:59.497 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T23:12:59.497 DEBUG:teuthology.orchestra.run.smithi008:> for f in files: 2023-10-06T23:12:59.498 DEBUG:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T23:12:59.498 DEBUG:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T23:12:59.498 DEBUG:teuthology.orchestra.run.smithi008:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T23:12:59.498 DEBUG:teuthology.orchestra.run.smithi008:> contents = proc_f.read() 2023-10-06T23:12:59.498 DEBUG:teuthology.orchestra.run.smithi008:> if mountpoint in contents: 2023-10-06T23:12:59.498 DEBUG:teuthology.orchestra.run.smithi008:> return f 2023-10-06T23:12:59.499 DEBUG:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T23:12:59.499 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-06T23:12:59.499 DEBUG:teuthology.orchestra.run.smithi008:> print(_find_admin_socket("client.0")) 2023-10-06T23:12:59.499 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-10-06T23:12:59.679 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.0.161984.asok 2023-10-06T23:12:59.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:12:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-06T23:12:59.692 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.161984.asok 2023-10-06T23:12:59.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:59.692 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.161984.asok status 2023-10-06T23:12:59.922 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:12:59.922 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "14d8d032507701c76ca224e769ee65a96b660a8c", 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-6616-g14d8d032 (14d8d032507701c76ca224e769ee65a96b660a8c) reef (dev)", 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "0", 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/tmp/cephfs", 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "161984", 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/" 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2023-10-06T23:12:59.923 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 25082, 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 25082 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1108519147 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-10-06T23:12:59.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1108519147 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.25082 172.21.15.8:0/1108519147", 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "172.21.15.8:0/1108519147", 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 1, 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 23, 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 88, 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 0, 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "blocklisted": false, 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs" 2023-10-06T23:12:59.925 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:12:59.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:59.938 DEBUG:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2023-10-06T23:12:59.938 DEBUG:teuthology.orchestra.run.smithi008:> ' -- /tmp/cephfs 2023-10-06T23:12:59.982 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2023-10-06T23:12:59.983 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2023-10-06T23:12:59.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:12:59.983 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /tmp/cephfs 2023-10-06T23:13:00.101 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-06T23:13:00.113 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-06T23:13:00.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:13:00.206 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:00 smithi008 ceph-mon[98532]: pgmap v353: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:13:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.347+0000 7f8ed0dff700 1 -- 172.21.15.8:0/694585661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc102080 msgr2=0x7f8ecc102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.347+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/694585661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc102080 0x7f8ecc102500 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009990 tx=0x7f8eb4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.348+0000 7f8ed0dff700 1 -- 172.21.15.8:0/694585661 shutdown_connections 2023-10-06T23:13:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.348+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/694585661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ecc102a40 0x7f8ecc109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.348+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/694585661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ecc100ea0 0x7f8ecc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.348+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/694585661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc102080 0x7f8ecc102500 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.348+0000 7f8ed0dff700 1 -- 172.21.15.8:0/694585661 >> 172.21.15.8:0/694585661 conn(0x7f8ecc0fc420 msgr2=0x7f8ecc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.348+0000 7f8ed0dff700 1 -- 172.21.15.8:0/694585661 shutdown_connections 2023-10-06T23:13:00.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.348+0000 7f8ed0dff700 1 -- 172.21.15.8:0/694585661 wait complete. 2023-10-06T23:13:00.351 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:00 smithi156 ceph-mon[102862]: pgmap v353: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:13:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ed0dff700 1 Processor -- start 2023-10-06T23:13:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ed0dff700 1 -- start start 2023-10-06T23:13:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ed0dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc100ea0 0x7f8ecc198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ed0dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ecc102080 0x7f8ecc199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ed0dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ecc102a40 0x7f8ecc1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ed0dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc1a0950 con 0x7f8ecc100ea0 2023-10-06T23:13:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ed0dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc1a0a90 con 0x7f8ecc102080 2023-10-06T23:13:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ed0dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc1a0c20 con 0x7f8ecc102a40 2023-10-06T23:13:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ec259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc100ea0 0x7f8ecc198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ec259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc100ea0 0x7f8ecc198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55458/0 (socket says 172.21.15.8:55458) 2023-10-06T23:13:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ec259c700 1 -- 172.21.15.8:0/1895622205 learned_addr learned my addr 172.21.15.8:0/1895622205 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.349+0000 7f8ecad9d700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ecc102a40 0x7f8ecc1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8eca59c700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ecc102080 0x7f8ecc199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec259c700 1 -- 172.21.15.8:0/1895622205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ecc102a40 msgr2=0x7f8ecc1a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec259c700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ecc102a40 0x7f8ecc1a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec259c700 1 -- 172.21.15.8:0/1895622205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ecc102080 msgr2=0x7f8ecc199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec259c700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ecc102080 0x7f8ecc199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec259c700 1 -- 172.21.15.8:0/1895622205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40095f0 con 0x7f8ecc100ea0 2023-10-06T23:13:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec259c700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc100ea0 0x7f8ecc198dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00e970 tx=0x7f8ebc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec3fff700 1 -- 172.21.15.8:0/1895622205 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc009790 con 0x7f8ecc100ea0 2023-10-06T23:13:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec3fff700 1 -- 172.21.15.8:0/1895622205 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ebc0044b0 con 0x7f8ecc100ea0 2023-10-06T23:13:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc1a0f00 con 0x7f8ecc100ea0 2023-10-06T23:13:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ec3fff700 1 -- 172.21.15.8:0/1895622205 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc003dd0 con 0x7f8ecc100ea0 2023-10-06T23:13:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.350+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc1a1330 con 0x7f8ecc100ea0 2023-10-06T23:13:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.351+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc193400 con 0x7f8ecc100ea0 2023-10-06T23:13:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.353+0000 7f8ec3fff700 1 -- 172.21.15.8:0/1895622205 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8ebc003f30 con 0x7f8ecc100ea0 2023-10-06T23:13:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.355+0000 7f8ec3fff700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8eb80a1550 0x7f8eb80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.355+0000 7f8ec3fff700 1 -- 172.21.15.8:0/1895622205 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8ebc014070 con 0x7f8ecc100ea0 2023-10-06T23:13:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.355+0000 7f8eca59c700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8eb80a1550 0x7f8eb80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.355+0000 7f8eca59c700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8eb80a1550 0x7f8eb80a3a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40098e0 tx=0x7f8eb400b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:00.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.359+0000 7f8ec3fff700 1 -- 172.21.15.8:0/1895622205 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ebc0965b0 con 0x7f8ecc100ea0 2023-10-06T23:13:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:00 smithi190 ceph-mon[102658]: pgmap v353: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-06T23:13:00.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.572+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ecc10c610 con 0x7f8ecc100ea0 2023-10-06T23:13:00.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.573+0000 7f8ec3fff700 1 -- 172.21.15.8:0/1895622205 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7f8ebc099bd0 con 0x7f8ecc100ea0 2023-10-06T23:13:00.575 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:00.575 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:13:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8eb80a1550 msgr2=0x7f8eb80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8eb80a1550 0x7f8eb80a3a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40098e0 tx=0x7f8eb400b260 comp rx=0 tx=0).stop 2023-10-06T23:13:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc100ea0 msgr2=0x7f8ecc198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc100ea0 0x7f8ecc198dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00e970 tx=0x7f8ebc00ed30 comp rx=0 tx=0).stop 2023-10-06T23:13:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 shutdown_connections 2023-10-06T23:13:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8eb80a1550 0x7f8eb80a3a10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ecc100ea0 0x7f8ecc198dd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ecc102a40 0x7f8ecc1a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 --2- 172.21.15.8:0/1895622205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ecc102080 0x7f8ecc199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.575+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 >> 172.21.15.8:0/1895622205 conn(0x7f8ecc0fc420 msgr2=0x7f8ecc107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:00.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.576+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 shutdown_connections 2023-10-06T23:13:00.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.576+0000 7f8ed0dff700 1 -- 172.21.15.8:0/1895622205 wait complete. 2023-10-06T23:13:00.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:13:00.596 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:13:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 -- 172.21.15.8:0/4260279259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8102a30 msgr2=0x7f10a8109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/4260279259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8102a30 0x7f10a8109350 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f10a000b0a0 tx=0x7f10a000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 -- 172.21.15.8:0/4260279259 shutdown_connections 2023-10-06T23:13:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/4260279259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8102a30 0x7f10a8109350 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/4260279259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a8100e90 0x7f10a81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/4260279259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a8102070 0x7f10a81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 -- 172.21.15.8:0/4260279259 >> 172.21.15.8:0/4260279259 conn(0x7f10a80fc430 msgr2=0x7f10a80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 -- 172.21.15.8:0/4260279259 shutdown_connections 2023-10-06T23:13:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.802+0000 7f10ae5ff700 1 -- 172.21.15.8:0/4260279259 wait complete. 2023-10-06T23:13:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.803+0000 7f10ae5ff700 1 Processor -- start 2023-10-06T23:13:00.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10ae5ff700 1 -- start start 2023-10-06T23:13:00.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10ae5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8100e90 0x7f10a8198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:00.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10ae5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a8102070 0x7f10a8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10ae5ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a8102a30 0x7f10a81a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10ae5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81a0960 con 0x7f10a8100e90 2023-10-06T23:13:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10ae5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81a0aa0 con 0x7f10a8102070 2023-10-06T23:13:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10ae5ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81a0c30 con 0x7f10a8102a30 2023-10-06T23:13:00.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8100e90 0x7f10a8198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8100e90 0x7f10a8198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55486/0 (socket says 172.21.15.8:55486) 2023-10-06T23:13:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10a7fff700 1 -- 172.21.15.8:0/2394639956 learned_addr learned my addr 172.21.15.8:0/2394639956 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10a77fe700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a8102070 0x7f10a8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.804+0000 7f10acb9c700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a8102a30 0x7f10a81a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a7fff700 1 -- 172.21.15.8:0/2394639956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a8102a30 msgr2=0x7f10a81a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:00.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a7fff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a8102a30 0x7f10a81a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a7fff700 1 -- 172.21.15.8:0/2394639956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a8102070 msgr2=0x7f10a8199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a7fff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a8102070 0x7f10a8199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a7fff700 1 -- 172.21.15.8:0/2394639956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0009d00 con 0x7f10a8100e90 2023-10-06T23:13:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10acb9c700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a8102a30 0x7f10a81a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a7fff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8100e90 0x7f10a8198de0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f109800d980 tx=0x7f109800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a57fa700 1 -- 172.21.15.8:0/2394639956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109800de60 con 0x7f10a8100e90 2023-10-06T23:13:00.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a57fa700 1 -- 172.21.15.8:0/2394639956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10980044b0 con 0x7f10a8100e90 2023-10-06T23:13:00.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a81a0f10 con 0x7f10a8100e90 2023-10-06T23:13:00.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10a57fa700 1 -- 172.21.15.8:0/2394639956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098003b40 con 0x7f10a8100e90 2023-10-06T23:13:00.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.805+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a81a1330 con 0x7f10a8100e90 2023-10-06T23:13:00.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.806+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a81933a0 con 0x7f10a8100e90 2023-10-06T23:13:00.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.808+0000 7f10a57fa700 1 -- 172.21.15.8:0/2394639956 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1098004870 con 0x7f10a8100e90 2023-10-06T23:13:00.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.810+0000 7f10a57fa700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10900a1480 0x7f10900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:00.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.810+0000 7f10a57fa700 1 -- 172.21.15.8:0/2394639956 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f10980ccd50 con 0x7f10a8100e90 2023-10-06T23:13:00.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.810+0000 7f10a77fe700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10900a1480 0x7f10900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:00.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.811+0000 7f10a77fe700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10900a1480 0x7f10900a3940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f109c005950 tx=0x7f109c0058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:00.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:00.812+0000 7f10a57fa700 1 -- 172.21.15.8:0/2394639956 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1098096360 con 0x7f10a8100e90 2023-10-06T23:13:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.024+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10a810c880 con 0x7f10a8100e90 2023-10-06T23:13:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.025+0000 7f10a57fa700 1 -- 172.21.15.8:0/2394639956 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1098009940 con 0x7f10a8100e90 2023-10-06T23:13:01.026 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:13:01.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10900a1480 msgr2=0x7f10900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10900a1480 0x7f10900a3940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f109c005950 tx=0x7f109c0058e0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8100e90 msgr2=0x7f10a8198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8100e90 0x7f10a8198de0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f109800d980 tx=0x7f109800dd40 comp rx=0 tx=0).stop 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 shutdown_connections 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f10900a1480 0x7f10900a3940 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10a8100e90 0x7f10a8198de0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a8102a30 0x7f10a81a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 --2- 172.21.15.8:0/2394639956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10a8102070 0x7f10a8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 >> 172.21.15.8:0/2394639956 conn(0x7f10a80fc430 msgr2=0x7f10a8107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 shutdown_connections 2023-10-06T23:13:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.027+0000 7f10ae5ff700 1 -- 172.21.15.8:0/2394639956 wait complete. 2023-10-06T23:13:01.048 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:13:01.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 -- 172.21.15.8:0/805950680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414100e90 msgr2=0x7ff4141012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 --2- 172.21.15.8:0/805950680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414100e90 0x7ff4141012b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff410009990 tx=0x7ff410009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 -- 172.21.15.8:0/805950680 shutdown_connections 2023-10-06T23:13:01.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 --2- 172.21.15.8:0/805950680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414100e90 0x7ff4141012b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 --2- 172.21.15.8:0/805950680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff414102a30 0x7ff414109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 --2- 172.21.15.8:0/805950680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff414102070 0x7ff4141024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 -- 172.21.15.8:0/805950680 >> 172.21.15.8:0/805950680 conn(0x7ff4140fc430 msgr2=0x7ff4140fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:01.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 -- 172.21.15.8:0/805950680 shutdown_connections 2023-10-06T23:13:01.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.252+0000 7ff41bfff700 1 -- 172.21.15.8:0/805950680 wait complete. 2023-10-06T23:13:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.253+0000 7ff41bfff700 1 Processor -- start 2023-10-06T23:13:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.253+0000 7ff41bfff700 1 -- start start 2023-10-06T23:13:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff414100e90 0x7ff414074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff414102070 0x7ff4140732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414102a30 0x7ff4140737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414073f80 con 0x7ff414102a30 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41bfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140740f0 con 0x7ff414102070 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41bfff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4141a0bc0 con 0x7ff414100e90 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414102a30 0x7ff4140737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414102a30 0x7ff4140737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55506/0 (socket says 172.21.15.8:55506) 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41a59c700 1 -- 172.21.15.8:0/884413091 learned_addr learned my addr 172.21.15.8:0/884413091 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff419d9b700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff414100e90 0x7ff414074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41959a700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff414102070 0x7ff4140732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41a59c700 1 -- 172.21.15.8:0/884413091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff414100e90 msgr2=0x7ff414074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41a59c700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff414100e90 0x7ff414074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41a59c700 1 -- 172.21.15.8:0/884413091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff414102070 msgr2=0x7ff4140732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41a59c700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff414102070 0x7ff4140732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41a59c700 1 -- 172.21.15.8:0/884413091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100095f0 con 0x7ff414102a30 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.254+0000 7ff41959a700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff414102070 0x7ff4140732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.255+0000 7ff41a59c700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414102a30 0x7ff4140737e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff40c007ee0 tx=0x7ff40c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.255+0000 7ff40affd700 1 -- 172.21.15.8:0/884413091 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c017070 con 0x7ff414102a30 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.255+0000 7ff40affd700 1 -- 172.21.15.8:0/884413091 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff40c00f040 con 0x7ff414102a30 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.255+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4141a0ea0 con 0x7ff414102a30 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.255+0000 7ff40affd700 1 -- 172.21.15.8:0/884413091 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c005710 con 0x7ff414102a30 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.255+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4141a12d0 con 0x7ff414102a30 2023-10-06T23:13:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.256+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4141081f0 con 0x7ff414102a30 2023-10-06T23:13:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.258+0000 7ff40affd700 1 -- 172.21.15.8:0/884413091 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff40c005870 con 0x7ff414102a30 2023-10-06T23:13:01.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.261+0000 7ff40affd700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff4000a1480 0x7ff4000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:01.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.261+0000 7ff40affd700 1 -- 172.21.15.8:0/884413091 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff40c0cc540 con 0x7ff414102a30 2023-10-06T23:13:01.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.261+0000 7ff419d9b700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff4000a1480 0x7ff4000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:01.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.261+0000 7ff419d9b700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff4000a1480 0x7ff4000a3940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff41000b5c0 tx=0x7ff410005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:01.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.265+0000 7ff40affd700 1 -- 172.21.15.8:0/884413091 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff40c095b50 con 0x7ff414102a30 2023-10-06T23:13:01.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1895622205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:01.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1895622205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:01.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1895622205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:01.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.484+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff41402d270 con 0x7ff414102a30 2023-10-06T23:13:01.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.484+0000 7ff40affd700 1 -- 172.21.15.8:0/884413091 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff40c099170 con 0x7ff414102a30 2023-10-06T23:13:01.486 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:13:01.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff4000a1480 msgr2=0x7ff4000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff4000a1480 0x7ff4000a3940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff41000b5c0 tx=0x7ff410005fb0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414102a30 msgr2=0x7ff4140737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414102a30 0x7ff4140737e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff40c007ee0 tx=0x7ff40c00d3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 shutdown_connections 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff4000a1480 0x7ff4000a3940 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff414102a30 0x7ff4140737e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff414100e90 0x7ff414074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 --2- 172.21.15.8:0/884413091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff414102070 0x7ff4140732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 >> 172.21.15.8:0/884413091 conn(0x7ff4140fc430 msgr2=0x7ff414105330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 shutdown_connections 2023-10-06T23:13:01.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.487+0000 7ff41bfff700 1 -- 172.21.15.8:0/884413091 wait complete. 2023-10-06T23:13:01.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 -- 172.21.15.8:0/2460483622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4100e90 msgr2=0x7fb6b41012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/2460483622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4100e90 0x7fb6b41012b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009990 tx=0x7fb6a4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 -- 172.21.15.8:0/2460483622 shutdown_connections 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/2460483622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4100e90 0x7fb6b41012b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/2460483622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6b4102a30 0x7fb6b4109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/2460483622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6b4102070 0x7fb6b41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 -- 172.21.15.8:0/2460483622 >> 172.21.15.8:0/2460483622 conn(0x7fb6b40fc430 msgr2=0x7fb6b40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 -- 172.21.15.8:0/2460483622 shutdown_connections 2023-10-06T23:13:01.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.712+0000 7fb6b9dff700 1 -- 172.21.15.8:0/2460483622 wait complete. 2023-10-06T23:13:01.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.713+0000 7fb6b9dff700 1 Processor -- start 2023-10-06T23:13:01.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.713+0000 7fb6b9dff700 1 -- start start 2023-10-06T23:13:01.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b9dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6b4100e90 0x7fb6b4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:01.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b9dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4102070 0x7fb6b40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:01.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b9dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6b4102a30 0x7fb6b40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:01.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b9dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b4073f80 con 0x7fb6b4102070 2023-10-06T23:13:01.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b9dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b40740f0 con 0x7fb6b4102a30 2023-10-06T23:13:01.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b9dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b41a0b80 con 0x7fb6b4100e90 2023-10-06T23:13:01.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6b4100e90 0x7fb6b4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:01.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4102070 0x7fb6b40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:01.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6b4100e90 0x7fb6b4074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37996/0 (socket says 172.21.15.8:37996) 2023-10-06T23:13:01.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b37fe700 1 -- 172.21.15.8:0/1385672000 learned_addr learned my addr 172.21.15.8:0/1385672000 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:01.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.714+0000 7fb6b2ffd700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4102070 0x7fb6b40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55522/0 (socket says 172.21.15.8:55522) 2023-10-06T23:13:01.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b3fff700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6b4102a30 0x7fb6b40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b37fe700 1 -- 172.21.15.8:0/1385672000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6b4102a30 msgr2=0x7fb6b40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b37fe700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6b4102a30 0x7fb6b40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b37fe700 1 -- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4102070 msgr2=0x7fb6b40732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b37fe700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4102070 0x7fb6b40732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b37fe700 1 -- 172.21.15.8:0/1385672000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40095f0 con 0x7fb6b4100e90 2023-10-06T23:13:01.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b2ffd700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4102070 0x7fb6b40732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:01.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b37fe700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6b4100e90 0x7fb6b4074c60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4005910 tx=0x7fb6a4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:01.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b0ff9700 1 -- 172.21.15.8:0/1385672000 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a401d070 con 0x7fb6b4100e90 2023-10-06T23:13:01.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.715+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b41a0e00 con 0x7fb6b4100e90 2023-10-06T23:13:01.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.716+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b41a11d0 con 0x7fb6b4100e90 2023-10-06T23:13:01.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.716+0000 7fb6b0ff9700 1 -- 172.21.15.8:0/1385672000 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6a4022470 con 0x7fb6b4100e90 2023-10-06T23:13:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.716+0000 7fb6b0ff9700 1 -- 172.21.15.8:0/1385672000 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400f460 con 0x7fb6b4100e90 2023-10-06T23:13:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.716+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b4107ec0 con 0x7fb6b4100e90 2023-10-06T23:13:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.719+0000 7fb6b0ff9700 1 -- 172.21.15.8:0/1385672000 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb6a4022830 con 0x7fb6b4100e90 2023-10-06T23:13:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.720+0000 7fb6b0ff9700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb69c0a1480 0x7fb69c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.720+0000 7fb6b0ff9700 1 -- 172.21.15.8:0/1385672000 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb6a40ce570 con 0x7fb6b4100e90 2023-10-06T23:13:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.720+0000 7fb6b2ffd700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb69c0a1480 0x7fb69c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.721+0000 7fb6b2ffd700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb69c0a1480 0x7fb69c0a3940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4100bb0 tx=0x7fb6a8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:01.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.723+0000 7fb6b0ff9700 1 -- 172.21.15.8:0/1385672000 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb6a4097c10 con 0x7fb6b4100e90 2023-10-06T23:13:01.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.935+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6b402d020 con 0x7fb6b4100e90 2023-10-06T23:13:01.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.936+0000 7fb6b0ff9700 1 -- 172.21.15.8:0/1385672000 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb6a409b230 con 0x7fb6b4100e90 2023-10-06T23:13:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb69c0a1480 msgr2=0x7fb69c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb69c0a1480 0x7fb69c0a3940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4100bb0 tx=0x7fb6a8009260 comp rx=0 tx=0).stop 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6b4100e90 msgr2=0x7fb6b4074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6b4100e90 0x7fb6b4074c60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4005910 tx=0x7fb6a4005740 comp rx=0 tx=0).stop 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 shutdown_connections 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb69c0a1480 0x7fb69c0a3940 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6b4102a30 0x7fb6b40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6b4100e90 0x7fb6b4074c60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 --2- 172.21.15.8:0/1385672000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb6b4102070 0x7fb6b40732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:01.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 >> 172.21.15.8:0/1385672000 conn(0x7fb6b40fc430 msgr2=0x7fb6b40fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:01.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 shutdown_connections 2023-10-06T23:13:01.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:01.939+0000 7fb6b9dff700 1 -- 172.21.15.8:0/1385672000 wait complete. 2023-10-06T23:13:01.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:13:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.160+0000 7fb5643ff700 1 -- 172.21.15.8:0/500304359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c074ef0 msgr2=0x7fb55c073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.160+0000 7fb5643ff700 1 --2- 172.21.15.8:0/500304359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c074ef0 0x7fb55c073340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb558009990 tx=0x7fb558009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.161+0000 7fb5643ff700 1 -- 172.21.15.8:0/500304359 shutdown_connections 2023-10-06T23:13:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.161+0000 7fb5643ff700 1 --2- 172.21.15.8:0/500304359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c074ef0 0x7fb55c073340 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.161+0000 7fb5643ff700 1 --2- 172.21.15.8:0/500304359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb55c108db0 0x7fb55c10b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.161+0000 7fb5643ff700 1 --2- 172.21.15.8:0/500304359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c073910 0x7fb55c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.161+0000 7fb5643ff700 1 -- 172.21.15.8:0/500304359 >> 172.21.15.8:0/500304359 conn(0x7fb55c0fc420 msgr2=0x7fb55c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.161+0000 7fb5643ff700 1 -- 172.21.15.8:0/500304359 shutdown_connections 2023-10-06T23:13:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.161+0000 7fb5643ff700 1 -- 172.21.15.8:0/500304359 wait complete. 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb5643ff700 1 Processor -- start 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb5643ff700 1 -- start start 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb5643ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c073910 0x7fb55c198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb5643ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb55c074ef0 0x7fb55c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb5643ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c108db0 0x7fb55c1a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb5643ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c1a08c0 con 0x7fb55c108db0 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb5643ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c1a0a00 con 0x7fb55c073910 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb5643ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c1a0b90 con 0x7fb55c074ef0 2023-10-06T23:13:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.162+0000 7fb56299c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c108db0 0x7fb55c1a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56299c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c108db0 0x7fb55c1a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55532/0 (socket says 172.21.15.8:55532) 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56299c700 1 -- 172.21.15.8:0/28116408 learned_addr learned my addr 172.21.15.8:0/28116408 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56219b700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c073910 0x7fb55c198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56199a700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb55c074ef0 0x7fb55c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56299c700 1 -- 172.21.15.8:0/28116408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb55c074ef0 msgr2=0x7fb55c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56299c700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb55c074ef0 0x7fb55c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56299c700 1 -- 172.21.15.8:0/28116408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c073910 msgr2=0x7fb55c198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56299c700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c073910 0x7fb55c198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56299c700 1 -- 172.21.15.8:0/28116408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580095f0 con 0x7fb55c108db0 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56199a700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb55c074ef0 0x7fb55c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb56299c700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c108db0 0x7fb55c1a02f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb554007ee0 tx=0x7fb55400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb5537fe700 1 -- 172.21.15.8:0/28116408 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55400ddd0 con 0x7fb55c108db0 2023-10-06T23:13:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb5537fe700 1 -- 172.21.15.8:0/28116408 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb55400f040 con 0x7fb55c108db0 2023-10-06T23:13:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.163+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c1a0e70 con 0x7fb55c108db0 2023-10-06T23:13:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.164+0000 7fb5537fe700 1 -- 172.21.15.8:0/28116408 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540047d0 con 0x7fb55c108db0 2023-10-06T23:13:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.164+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c1a12a0 con 0x7fb55c108db0 2023-10-06T23:13:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.165+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c107460 con 0x7fb55c108db0 2023-10-06T23:13:02.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.167+0000 7fb5537fe700 1 -- 172.21.15.8:0/28116408 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb554003f20 con 0x7fb55c108db0 2023-10-06T23:13:02.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.168+0000 7fb5537fe700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5480a14d0 0x7fb5480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:02.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.168+0000 7fb5537fe700 1 -- 172.21.15.8:0/28116408 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb5540cce30 con 0x7fb55c108db0 2023-10-06T23:13:02.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.168+0000 7fb56219b700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5480a14d0 0x7fb5480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:02.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.169+0000 7fb56219b700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5480a14d0 0x7fb5480a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb55800b5c0 tx=0x7fb558005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:02.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.170+0000 7fb5537fe700 1 -- 172.21.15.8:0/28116408 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb554096440 con 0x7fb55c108db0 2023-10-06T23:13:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:02 smithi156 ceph-mon[102862]: pgmap v354: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:13:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:02 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2394639956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:02 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/884413091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:02 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1385672000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.388+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb55c10e7e0 con 0x7fb55c108db0 2023-10-06T23:13:02.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.390+0000 7fb5537fe700 1 -- 172.21.15.8:0/28116408 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7fb554023090 con 0x7fb55c108db0 2023-10-06T23:13:02.391 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:02.391 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:13:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5480a14d0 msgr2=0x7fb5480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5480a14d0 0x7fb5480a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb55800b5c0 tx=0x7fb558005fb0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c108db0 msgr2=0x7fb55c1a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c108db0 0x7fb55c1a02f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb554007ee0 tx=0x7fb55400d3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 shutdown_connections 2023-10-06T23:13:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5480a14d0 0x7fb5480a3990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb55c108db0 0x7fb55c1a02f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c073910 0x7fb55c198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 --2- 172.21.15.8:0/28116408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb55c074ef0 0x7fb55c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 >> 172.21.15.8:0/28116408 conn(0x7fb55c0fc420 msgr2=0x7fb55c0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 shutdown_connections 2023-10-06T23:13:02.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.392+0000 7fb5643ff700 1 -- 172.21.15.8:0/28116408 wait complete. 2023-10-06T23:13:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:02 smithi008 ceph-mon[98532]: pgmap v354: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:13:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:02 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2394639956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:02 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/884413091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:02 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1385672000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.413 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:13:02.413 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:13:02.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:02 smithi190 ceph-mon[102658]: pgmap v354: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:13:02.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:02 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2394639956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:02 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/884413091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:02 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1385672000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:02.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 -- 172.21.15.8:0/3711724420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c102080 msgr2=0x7f238c102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 --2- 172.21.15.8:0/3711724420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c102080 0x7f238c102500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2380009990 tx=0x7f2380009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 -- 172.21.15.8:0/3711724420 shutdown_connections 2023-10-06T23:13:02.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 --2- 172.21.15.8:0/3711724420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f238c102a40 0x7f238c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 --2- 172.21.15.8:0/3711724420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f238c100ea0 0x7f238c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 --2- 172.21.15.8:0/3711724420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c102080 0x7f238c102500 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 -- 172.21.15.8:0/3711724420 >> 172.21.15.8:0/3711724420 conn(0x7f238c0fc460 msgr2=0x7f238c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:02.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 -- 172.21.15.8:0/3711724420 shutdown_connections 2023-10-06T23:13:02.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.618+0000 7f23927ff700 1 -- 172.21.15.8:0/3711724420 wait complete. 2023-10-06T23:13:02.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.619+0000 7f23927ff700 1 Processor -- start 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f23927ff700 1 -- start start 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f23927ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c100ea0 0x7f238c198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f23927ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f238c102080 0x7f238c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f23927ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f238c102a40 0x7f238c1a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f23927ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c1a0870 con 0x7f238c100ea0 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f23927ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c1a09e0 con 0x7f238c102080 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f23927ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c1a0ba0 con 0x7f238c102a40 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f238bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c100ea0 0x7f238c198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f238bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c100ea0 0x7f238c198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55558/0 (socket says 172.21.15.8:55558) 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f238bfff700 1 -- 172.21.15.8:0/1636516101 learned_addr learned my addr 172.21.15.8:0/1636516101 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f2390d9c700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f238c102a40 0x7f238c1a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:02.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f238b7fe700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f238c102080 0x7f238c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f238bfff700 1 -- 172.21.15.8:0/1636516101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f238c102a40 msgr2=0x7f238c1a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.620+0000 7f238bfff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f238c102a40 0x7f238c1a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f238bfff700 1 -- 172.21.15.8:0/1636516101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f238c102080 msgr2=0x7f238c199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f238bfff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f238c102080 0x7f238c199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f238bfff700 1 -- 172.21.15.8:0/1636516101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23800095f0 con 0x7f238c100ea0 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f238bfff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c100ea0 0x7f238c198d30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f237c00d980 tx=0x7f237c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f23897fa700 1 -- 172.21.15.8:0/1636516101 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00de60 con 0x7f238c100ea0 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f23897fa700 1 -- 172.21.15.8:0/1636516101 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f237c0044b0 con 0x7f238c100ea0 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c1a0e80 con 0x7f238c100ea0 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f23897fa700 1 -- 172.21.15.8:0/1636516101 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c003b40 con 0x7f238c100ea0 2023-10-06T23:13:02.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.621+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c1a12a0 con 0x7f238c100ea0 2023-10-06T23:13:02.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.622+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c10c5c0 con 0x7f238c100ea0 2023-10-06T23:13:02.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.625+0000 7f23897fa700 1 -- 172.21.15.8:0/1636516101 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f237c004870 con 0x7f238c100ea0 2023-10-06T23:13:02.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.626+0000 7f23897fa700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f23740a1480 0x7f23740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:02.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.626+0000 7f23897fa700 1 -- 172.21.15.8:0/1636516101 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f237c0ccd50 con 0x7f238c100ea0 2023-10-06T23:13:02.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.626+0000 7f238b7fe700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f23740a1480 0x7f23740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:02.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.627+0000 7f238b7fe700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f23740a1480 0x7f23740a3940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2380006010 tx=0x7f2380000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:02.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.628+0000 7f23897fa700 1 -- 172.21.15.8:0/1636516101 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f237c096360 con 0x7f238c100ea0 2023-10-06T23:13:02.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.839+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f238c1a1700 con 0x7f238c100ea0 2023-10-06T23:13:02.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.839+0000 7f23897fa700 1 -- 172.21.15.8:0/1636516101 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f237c009940 con 0x7f238c100ea0 2023-10-06T23:13:02.840 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f23740a1480 msgr2=0x7f23740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f23740a1480 0x7f23740a3940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2380006010 tx=0x7f2380000bc0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c100ea0 msgr2=0x7f238c198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c100ea0 0x7f238c198d30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f237c00d980 tx=0x7f237c00dd40 comp rx=0 tx=0).stop 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 shutdown_connections 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f23740a1480 0x7f23740a3940 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f238c100ea0 0x7f238c198d30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f238c102a40 0x7f238c1a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 --2- 172.21.15.8:0/1636516101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f238c102080 0x7f238c199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.841+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 >> 172.21.15.8:0/1636516101 conn(0x7f238c0fc460 msgr2=0x7f238c0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.842+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 shutdown_connections 2023-10-06T23:13:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:02.842+0000 7f23927ff700 1 -- 172.21.15.8:0/1636516101 wait complete. 2023-10-06T23:13:02.861 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:13:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 -- 172.21.15.8:0/135099215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 msgr2=0x7fb64c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 --2- 172.21.15.8:0/135099215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 0x7fb64c103d30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009990 tx=0x7fb63c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 -- 172.21.15.8:0/135099215 shutdown_connections 2023-10-06T23:13:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 --2- 172.21.15.8:0/135099215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 0x7fb64c103d30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 --2- 172.21.15.8:0/135099215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c106ba0 0x7fb64c109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 --2- 172.21.15.8:0/135099215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb64c104270 0x7fb64c106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 -- 172.21.15.8:0/135099215 >> 172.21.15.8:0/135099215 conn(0x7fb64c0fb330 msgr2=0x7fb64c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 -- 172.21.15.8:0/135099215 shutdown_connections 2023-10-06T23:13:03.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.066+0000 7fb6513ff700 1 -- 172.21.15.8:0/135099215 wait complete. 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.067+0000 7fb6513ff700 1 Processor -- start 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb6513ff700 1 -- start start 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb6513ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 0x7fb64c198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb6513ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb64c104270 0x7fb64c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb6513ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c106ba0 0x7fb64c1a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb6513ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c1a0880 con 0x7fb64c101940 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb6513ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c1a09f0 con 0x7fb64c104270 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb6513ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c1a0bb0 con 0x7fb64c106ba0 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb64affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 0x7fb64c198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb64affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 0x7fb64c198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55564/0 (socket says 172.21.15.8:55564) 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb64affd700 1 -- 172.21.15.8:0/2935954659 learned_addr learned my addr 172.21.15.8:0/2935954659 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.068+0000 7fb64a7fc700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb64c104270 0x7fb64c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb64b7fe700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c106ba0 0x7fb64c1a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb64affd700 1 -- 172.21.15.8:0/2935954659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c106ba0 msgr2=0x7fb64c1a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb64affd700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c106ba0 0x7fb64c1a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb64affd700 1 -- 172.21.15.8:0/2935954659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb64c104270 msgr2=0x7fb64c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb64affd700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb64c104270 0x7fb64c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb64affd700 1 -- 172.21.15.8:0/2935954659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0095f0 con 0x7fb64c101940 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb64b7fe700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c106ba0 0x7fb64c1a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb64affd700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 0x7fb64c198d40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb633fff700 1 -- 172.21.15.8:0/2935954659 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c01d070 con 0x7fb64c101940 2023-10-06T23:13:03.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb633fff700 1 -- 172.21.15.8:0/2935954659 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb63c00bd70 con 0x7fb64c101940 2023-10-06T23:13:03.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c1a0e30 con 0x7fb64c101940 2023-10-06T23:13:03.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb633fff700 1 -- 172.21.15.8:0/2935954659 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c022c80 con 0x7fb64c101940 2023-10-06T23:13:03.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.069+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c1a11a0 con 0x7fb64c101940 2023-10-06T23:13:03.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.070+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c108770 con 0x7fb64c101940 2023-10-06T23:13:03.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.073+0000 7fb633fff700 1 -- 172.21.15.8:0/2935954659 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb63c022470 con 0x7fb64c101940 2023-10-06T23:13:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.074+0000 7fb633fff700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb6340a1480 0x7fb6340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.074+0000 7fb633fff700 1 -- 172.21.15.8:0/2935954659 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb63c0cea80 con 0x7fb64c101940 2023-10-06T23:13:03.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.074+0000 7fb64a7fc700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb6340a1480 0x7fb6340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.075+0000 7fb64a7fc700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb6340a1480 0x7fb6340a3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb640005950 tx=0x7fb64000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:03.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.076+0000 7fb633fff700 1 -- 172.21.15.8:0/2935954659 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb63c098120 con 0x7fb64c101940 2023-10-06T23:13:03.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.287+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb64c10c7f0 con 0x7fb64c101940 2023-10-06T23:13:03.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.287+0000 7fb633fff700 1 -- 172.21.15.8:0/2935954659 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb63c09b740 con 0x7fb64c101940 2023-10-06T23:13:03.289 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:13:03.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb6340a1480 msgr2=0x7fb6340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb6340a1480 0x7fb6340a3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb640005950 tx=0x7fb64000b410 comp rx=0 tx=0).stop 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 msgr2=0x7fb64c198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 0x7fb64c198d40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c003a50 comp rx=0 tx=0).stop 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 shutdown_connections 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb6340a1480 0x7fb6340a3940 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb64c101940 0x7fb64c198d40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c106ba0 0x7fb64c1a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 --2- 172.21.15.8:0/2935954659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb64c104270 0x7fb64c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 >> 172.21.15.8:0/2935954659 conn(0x7fb64c0fb330 msgr2=0x7fb64c1025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 shutdown_connections 2023-10-06T23:13:03.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.290+0000 7fb6513ff700 1 -- 172.21.15.8:0/2935954659 wait complete. 2023-10-06T23:13:03.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:13:03.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 -- 172.21.15.8:0/947986461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 msgr2=0x7fa05c073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 --2- 172.21.15.8:0/947986461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 0x7fa05c073d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa050009990 tx=0x7fa050009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 -- 172.21.15.8:0/947986461 shutdown_connections 2023-10-06T23:13:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 --2- 172.21.15.8:0/947986461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05c108da0 0x7fa05c10b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 --2- 172.21.15.8:0/947986461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa05c074ef0 0x7fa05c073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 --2- 172.21.15.8:0/947986461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 0x7fa05c073d90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 -- 172.21.15.8:0/947986461 >> 172.21.15.8:0/947986461 conn(0x7fa05c0fc430 msgr2=0x7fa05c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 -- 172.21.15.8:0/947986461 shutdown_connections 2023-10-06T23:13:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.517+0000 7fa0617ff700 1 -- 172.21.15.8:0/947986461 wait complete. 2023-10-06T23:13:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.518+0000 7fa0617ff700 1 Processor -- start 2023-10-06T23:13:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.518+0000 7fa0617ff700 1 -- start start 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa0617ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 0x7fa05c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa0617ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa05c074ef0 0x7fa05c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa0617ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05c108da0 0x7fa05c1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa0617ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c1a08d0 con 0x7fa05c073910 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa0617ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c1a0a10 con 0x7fa05c074ef0 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa0617ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c1a0ba0 con 0x7fa05c108da0 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 0x7fa05c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 0x7fa05c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55582/0 (socket says 172.21.15.8:55582) 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05affd700 1 -- 172.21.15.8:0/3746029856 learned_addr learned my addr 172.21.15.8:0/3746029856 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05a7fc700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa05c074ef0 0x7fa05c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05b7fe700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05c108da0 0x7fa05c1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05affd700 1 -- 172.21.15.8:0/3746029856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05c108da0 msgr2=0x7fa05c1a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05affd700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05c108da0 0x7fa05c1a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05affd700 1 -- 172.21.15.8:0/3746029856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa05c074ef0 msgr2=0x7fa05c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05affd700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa05c074ef0 0x7fa05c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05affd700 1 -- 172.21.15.8:0/3746029856 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0500095f0 con 0x7fa05c073910 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05b7fe700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05c108da0 0x7fa05c1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.519+0000 7fa05a7fc700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa05c074ef0 0x7fa05c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.520+0000 7fa05affd700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 0x7fa05c198d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00d950 tx=0x7fa04c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.520+0000 7fa043fff700 1 -- 172.21.15.8:0/3746029856 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c009b40 con 0x7fa05c073910 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.520+0000 7fa043fff700 1 -- 172.21.15.8:0/3746029856 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa04c009ca0 con 0x7fa05c073910 2023-10-06T23:13:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.520+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c1a0e80 con 0x7fa05c073910 2023-10-06T23:13:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.520+0000 7fa043fff700 1 -- 172.21.15.8:0/3746029856 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00f620 con 0x7fa05c073910 2023-10-06T23:13:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.520+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c1a12b0 con 0x7fa05c073910 2023-10-06T23:13:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.521+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c107450 con 0x7fa05c073910 2023-10-06T23:13:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.523+0000 7fa043fff700 1 -- 172.21.15.8:0/3746029856 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa04c010460 con 0x7fa05c073910 2023-10-06T23:13:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.525+0000 7fa043fff700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0440a1500 0x7fa0440a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.525+0000 7fa043fff700 1 -- 172.21.15.8:0/3746029856 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa04c0ccfe0 con 0x7fa05c073910 2023-10-06T23:13:03.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.526+0000 7fa05a7fc700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0440a1500 0x7fa0440a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.526+0000 7fa05a7fc700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0440a1500 0x7fa0440a39c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b5c0 tx=0x7fa050005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:03.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.529+0000 7fa043fff700 1 -- 172.21.15.8:0/3746029856 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa04c096630 con 0x7fa05c073910 2023-10-06T23:13:03.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:03 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/28116408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:03.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:03 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1636516101' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:03.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:03 smithi156 ceph-mon[102862]: pgmap v355: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-06T23:13:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:03 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/28116408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:03 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1636516101' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:03.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:03 smithi008 ceph-mon[98532]: pgmap v355: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-06T23:13:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:03 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/28116408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:03.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:03 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1636516101' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:03.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:03 smithi190 ceph-mon[102658]: pgmap v355: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-06T23:13:03.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.740+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa05c02d020 con 0x7fa05c073910 2023-10-06T23:13:03.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.741+0000 7fa043fff700 1 -- 172.21.15.8:0/3746029856 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa04c099c50 con 0x7fa05c073910 2023-10-06T23:13:03.742 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0440a1500 msgr2=0x7fa0440a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0440a1500 0x7fa0440a39c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b5c0 tx=0x7fa050005fb0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 msgr2=0x7fa05c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 0x7fa05c198d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00d950 tx=0x7fa04c00dd10 comp rx=0 tx=0).stop 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 shutdown_connections 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0440a1500 0x7fa0440a39c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa05c073910 0x7fa05c198d50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05c108da0 0x7fa05c1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 --2- 172.21.15.8:0/3746029856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa05c074ef0 0x7fa05c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.743+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 >> 172.21.15.8:0/3746029856 conn(0x7fa05c0fc430 msgr2=0x7fa05c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:03.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.744+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 shutdown_connections 2023-10-06T23:13:03.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.744+0000 7fa0617ff700 1 -- 172.21.15.8:0/3746029856 wait complete. 2023-10-06T23:13:03.763 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-06T23:13:03.763 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:13:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 -- 172.21.15.8:0/3898951338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102080 msgr2=0x7f0b40102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 --2- 172.21.15.8:0/3898951338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102080 0x7f0b40102500 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009990 tx=0x7f0b34009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 -- 172.21.15.8:0/3898951338 shutdown_connections 2023-10-06T23:13:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 --2- 172.21.15.8:0/3898951338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40102a40 0x7f0b40109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 --2- 172.21.15.8:0/3898951338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40100ea0 0x7f0b401012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 --2- 172.21.15.8:0/3898951338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40102080 0x7f0b40102500 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 -- 172.21.15.8:0/3898951338 >> 172.21.15.8:0/3898951338 conn(0x7f0b400fc420 msgr2=0x7f0b400fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 -- 172.21.15.8:0/3898951338 shutdown_connections 2023-10-06T23:13:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.966+0000 7f0b45dff700 1 -- 172.21.15.8:0/3898951338 wait complete. 2023-10-06T23:13:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.967+0000 7f0b45dff700 1 Processor -- start 2023-10-06T23:13:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.967+0000 7f0b45dff700 1 -- start start 2023-10-06T23:13:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.967+0000 7f0b45dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.967+0000 7f0b45dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40102080 0x7f0b40197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.967+0000 7f0b45dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102a40 0x7f0b4019e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.967+0000 7f0b45dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4019e680 con 0x7f0b40100ea0 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.967+0000 7f0b45dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4019e7c0 con 0x7f0b40102a40 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.967+0000 7f0b45dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4019e950 con 0x7f0b40102080 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55602/0 (socket says 172.21.15.8:55602) 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 -- 172.21.15.8:0/1370451198 learned_addr learned my addr 172.21.15.8:0/1370451198 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3ffff700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102a40 0x7f0b4019e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3effd700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40102080 0x7f0b40197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 -- 172.21.15.8:0/1370451198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40102080 msgr2=0x7f0b40197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40102080 0x7f0b40197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 -- 172.21.15.8:0/1370451198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102a40 msgr2=0x7f0b4019e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102a40 0x7f0b4019e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 -- 172.21.15.8:0/1370451198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340095f0 con 0x7f0b40100ea0 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3effd700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40102080 0x7f0b40197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.968+0000 7f0b3f7fe700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d980 tx=0x7f0b3000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.969+0000 7f0b3cff9700 1 -- 172.21.15.8:0/1370451198 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30004020 con 0x7f0b40100ea0 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.969+0000 7f0b3cff9700 1 -- 172.21.15.8:0/1370451198 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b30009730 con 0x7f0b40100ea0 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.969+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4019ec30 con 0x7f0b40100ea0 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.969+0000 7f0b3cff9700 1 -- 172.21.15.8:0/1370451198 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30003a00 con 0x7f0b40100ea0 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.969+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4019f190 con 0x7f0b40100ea0 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.970+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b401085e0 con 0x7f0b40100ea0 2023-10-06T23:13:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.972+0000 7f0b3cff9700 1 -- 172.21.15.8:0/1370451198 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0b300098a0 con 0x7f0b40100ea0 2023-10-06T23:13:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.973+0000 7f0b3cff9700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a1550 0x7f0b280a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.973+0000 7f0b3cff9700 1 -- 172.21.15.8:0/1370451198 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0b300cc9c0 con 0x7f0b40100ea0 2023-10-06T23:13:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.973+0000 7f0b3effd700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a1550 0x7f0b280a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.974+0000 7f0b3effd700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a1550 0x7f0b280a3a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b340095c0 tx=0x7f0b34009510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:03.977+0000 7f0b3cff9700 1 -- 172.21.15.8:0/1370451198 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0b30095fd0 con 0x7f0b40100ea0 2023-10-06T23:13:04.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.235+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b4002d090 con 0x7f0b40100ea0 2023-10-06T23:13:04.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.235+0000 7f0b3cff9700 1 -- 172.21.15.8:0/1370451198 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f0b300995f0 con 0x7f0b40100ea0 2023-10-06T23:13:04.237 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:04.237 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:11:23.244586+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:13:04.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a1550 msgr2=0x7f0b280a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a1550 0x7f0b280a3a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b340095c0 tx=0x7f0b34009510 comp rx=0 tx=0).stop 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 msgr2=0x7f0b40196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d980 tx=0x7f0b3000dc90 comp rx=0 tx=0).stop 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 shutdown_connections 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0b280a1550 0x7f0b280a3a10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b40100ea0 0x7f0b40196b00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b40102a40 0x7f0b4019e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 --2- 172.21.15.8:0/1370451198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b40102080 0x7f0b40197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 >> 172.21.15.8:0/1370451198 conn(0x7f0b400fc420 msgr2=0x7f0b40105720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 shutdown_connections 2023-10-06T23:13:04.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.238+0000 7f0b45dff700 1 -- 172.21.15.8:0/1370451198 wait complete. 2023-10-06T23:13:04.241 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:13:04.258 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-06T23:13:04.258 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-06T23:13:04.258 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T23:13:04.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1272887720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac1019a0 msgr2=0x7fbcac103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1272887720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac1019a0 0x7fbcac103d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009990 tx=0x7fbca0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1272887720 shutdown_connections 2023-10-06T23:13:04.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1272887720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac1019a0 0x7fbcac103d90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1272887720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac106c00 0x7fbcac109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1272887720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac1042d0 0x7fbcac1066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1272887720 >> 172.21.15.8:0/1272887720 conn(0x7fbcac0fb310 msgr2=0x7fbcac0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:04.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1272887720 shutdown_connections 2023-10-06T23:13:04.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.462+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1272887720 wait complete. 2023-10-06T23:13:04.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.463+0000 7fbcb2fff700 1 Processor -- start 2023-10-06T23:13:04.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.463+0000 7fbcb2fff700 1 -- start start 2023-10-06T23:13:04.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb2fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac1019a0 0x7fbcac196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:04.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb2fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac1042d0 0x7fbcac197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:04.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb2fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac106c00 0x7fbcac19e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:04.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb2fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac19e660 con 0x7fbcac106c00 2023-10-06T23:13:04.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb2fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac19e7a0 con 0x7fbcac1019a0 2023-10-06T23:13:04.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb2fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac19e930 con 0x7fbcac1042d0 2023-10-06T23:13:04.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb159c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac106c00 0x7fbcac19e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:04.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb159c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac106c00 0x7fbcac19e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55624/0 (socket says 172.21.15.8:55624) 2023-10-06T23:13:04.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb0d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac1019a0 0x7fbcac196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:04.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb159c700 1 -- 172.21.15.8:0/1120740096 learned_addr learned my addr 172.21.15.8:0/1120740096 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:04.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcabfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac1042d0 0x7fbcac197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:04.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb159c700 1 -- 172.21.15.8:0/1120740096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac1042d0 msgr2=0x7fbcac197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb159c700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac1042d0 0x7fbcac197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb159c700 1 -- 172.21.15.8:0/1120740096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac1019a0 msgr2=0x7fbcac196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.464+0000 7fbcb159c700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac1019a0 0x7fbcac196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.465+0000 7fbcb159c700 1 -- 172.21.15.8:0/1120740096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca00095f0 con 0x7fbcac106c00 2023-10-06T23:13:04.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.465+0000 7fbcb159c700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac106c00 0x7fbcac19e090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbca4007ee0 tx=0x7fbca400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:04.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.465+0000 7fbca9ffb700 1 -- 172.21.15.8:0/1120740096 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca400dd20 con 0x7fbcac106c00 2023-10-06T23:13:04.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.465+0000 7fbca9ffb700 1 -- 172.21.15.8:0/1120740096 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbca400f040 con 0x7fbcac106c00 2023-10-06T23:13:04.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.465+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac19ec10 con 0x7fbcac106c00 2023-10-06T23:13:04.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.465+0000 7fbca9ffb700 1 -- 172.21.15.8:0/1120740096 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4004750 con 0x7fbcac106c00 2023-10-06T23:13:04.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.465+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac19f0d0 con 0x7fbcac106c00 2023-10-06T23:13:04.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.466+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac0fce90 con 0x7fbcac106c00 2023-10-06T23:13:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.468+0000 7fbca9ffb700 1 -- 172.21.15.8:0/1120740096 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbca4003a00 con 0x7fbcac106c00 2023-10-06T23:13:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.470+0000 7fbca9ffb700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc9c0a14d0 0x7fbc9c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.470+0000 7fbca9ffb700 1 -- 172.21.15.8:0/1120740096 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbca40cc610 con 0x7fbcac106c00 2023-10-06T23:13:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.470+0000 7fbcb0d9b700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc9c0a14d0 0x7fbc9c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.471+0000 7fbcb0d9b700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc9c0a14d0 0x7fbc9c0a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbca0006010 tx=0x7fbca000b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:04.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.474+0000 7fbca9ffb700 1 -- 172.21.15.8:0/1120740096 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbca404f100 con 0x7fbcac106c00 2023-10-06T23:13:04.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:04 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2935954659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:04.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:04 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3746029856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:04.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:04 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1370451198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:04.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:04 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2935954659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:04.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:04 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3746029856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:04.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:04 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1370451198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.683+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbcac02d270 con 0x7fbc9c0a14d0 2023-10-06T23:13:04.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:04 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2935954659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:04.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:04 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3746029856' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:04.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:04 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1370451198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:04.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.694+0000 7fbca9ffb700 1 -- 172.21.15.8:0/1120740096 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342659 (secure 0 0 0) 0x7fbcac02d270 con 0x7fbc9c0a14d0 2023-10-06T23:13:04.700 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc9c0a14d0 msgr2=0x7fbc9c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc9c0a14d0 0x7fbc9c0a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbca0006010 tx=0x7fbca000b260 comp rx=0 tx=0).stop 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac106c00 msgr2=0x7fbcac19e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac106c00 0x7fbcac19e090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbca4007ee0 tx=0x7fbca400d3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 shutdown_connections 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc9c0a14d0 0x7fbc9c0a3990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac106c00 0x7fbcac19e090 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac1019a0 0x7fbcac196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 --2- 172.21.15.8:0/1120740096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac1042d0 0x7fbcac197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 >> 172.21.15.8:0/1120740096 conn(0x7fbcac0fb310 msgr2=0x7fbcac102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:04.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 shutdown_connections 2023-10-06T23:13:04.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.699+0000 7fbcb2fff700 1 -- 172.21.15.8:0/1120740096 wait complete. 2023-10-06T23:13:04.704 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T23:13:04.719 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2023-10-06T23:13:02.968757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596440,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":733,"num_read_kb":420,"num_write":310,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180780,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335700,"kb_used_data":11456,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606124,"statfs":{"total":1151940427776,"available":1151596670976,"internally_reserved":0,"allocated":11730944,"data_stored":7291707,"data_compressed":107433,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":850,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003007"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030740+0000","last_change":"2023-10-06T23:11:18.264036+0000","last_active":"2023-10-06T23:11:49.030740+0000","last_peered":"2023-10-06T23:11:49.030740+0000","last_clean":"2023-10-06T23:11:49.030740+0000","last_became_active":"2023-10-06T23:11:18.261784+0000","last_became_peered":"2023-10-06T23:11:18.261784+0000","last_unstale":"2023-10-06T23:11:49.030740+0000","last_undegraded":"2023-10-06T23:11:49.030740+0000","last_fullsized":"2023-10-06T23:11:49.030740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:57.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026996+0000","last_change":"2023-10-06T23:11:18.265181+0000","last_active":"2023-10-06T23:11:49.026996+0000","last_peered":"2023-10-06T23:11:49.026996+0000","last_clean":"2023-10-06T23:11:49.026996+0000","last_became_active":"2023-10-06T23:11:18.264881+0000","last_became_peered":"2023-10-06T23:11:18.264881+0000","last_unstale":"2023-10-06T23:11:49.026996+0000","last_undegraded":"2023-10-06T23:11:49.026996+0000","last_fullsized":"2023-10-06T23:11:49.026996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:17.852643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026807+0000","last_change":"2023-10-06T23:11:18.264321+0000","last_active":"2023-10-06T23:11:49.026807+0000","last_peered":"2023-10-06T23:11:49.026807+0000","last_clean":"2023-10-06T23:11:49.026807+0000","last_became_active":"2023-10-06T23:11:18.263997+0000","last_became_peered":"2023-10-06T23:11:18.263997+0000","last_unstale":"2023-10-06T23:11:49.026807+0000","last_undegraded":"2023-10-06T23:11:49.026807+0000","last_fullsized":"2023-10-06T23:11:49.026807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:41.888419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030300+0000","last_change":"2023-10-06T23:11:18.270871+0000","last_active":"2023-10-06T23:11:49.030300+0000","last_peered":"2023-10-06T23:11:49.030300+0000","last_clean":"2023-10-06T23:11:49.030300+0000","last_became_active":"2023-10-06T23:11:18.270288+0000","last_became_peered":"2023-10-06T23:11:18.270288+0000","last_unstale":"2023-10-06T23:11:49.030300+0000","last_undegraded":"2023-10-06T23:11:49.030300+0000","last_fullsized":"2023-10-06T23:11:49.030300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:02:48.819640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032624+0000","last_change":"2023-10-06T23:11:18.261001+0000","last_active":"2023-10-06T23:11:49.032624+0000","last_peered":"2023-10-06T23:11:49.032624+0000","last_clean":"2023-10-06T23:11:49.032624+0000","last_became_active":"2023-10-06T23:11:18.260661+0000","last_became_peered":"2023-10-06T23:11:18.260661+0000","last_unstale":"2023-10-06T23:11:49.032624+0000","last_undegraded":"2023-10-06T23:11:49.032624+0000","last_fullsized":"2023-10-06T23:11:49.032624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:42.382235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.036376+0000","last_change":"2023-10-06T23:11:50.036376+0000","last_active":"2023-10-06T23:11:50.036376+0000","last_peered":"2023-10-06T23:11:50.036376+0000","last_clean":"2023-10-06T23:11:50.036376+0000","last_became_active":"2023-10-06T23:11:50.035945+0000","last_became_peered":"2023-10-06T23:11:50.035945+0000","last_unstale":"2023-10-06T23:11:50.036376+0000","last_undegraded":"2023-10-06T23:11:50.036376+0000","last_fullsized":"2023-10-06T23:11:50.036376+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:50:33.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036114+0000","last_change":"2023-10-06T23:11:18.263968+0000","last_active":"2023-10-06T23:11:49.036114+0000","last_peered":"2023-10-06T23:11:49.036114+0000","last_clean":"2023-10-06T23:11:49.036114+0000","last_became_active":"2023-10-06T23:11:18.263634+0000","last_became_peered":"2023-10-06T23:11:18.263634+0000","last_unstale":"2023-10-06T23:11:49.036114+0000","last_undegraded":"2023-10-06T23:11:49.036114+0000","last_fullsized":"2023-10-06T23:11:49.036114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:18:23.856232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035537+0000","last_change":"2023-10-06T23:11:18.268945+0000","last_active":"2023-10-06T23:11:49.035537+0000","last_peered":"2023-10-06T23:11:49.035537+0000","last_clean":"2023-10-06T23:11:49.035537+0000","last_became_active":"2023-10-06T23:11:18.268598+0000","last_became_peered":"2023-10-06T23:11:18.268598+0000","last_unstale":"2023-10-06T23:11:49.035537+0000","last_undegraded":"2023-10-06T23:11:49.035537+0000","last_fullsized":"2023-10-06T23:11:49.035537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:09:21.238230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042773+0000","last_change":"2023-10-06T23:11:18.261872+0000","last_active":"2023-10-06T23:11:49.042773+0000","last_peered":"2023-10-06T23:11:49.042773+0000","last_clean":"2023-10-06T23:11:49.042773+0000","last_became_active":"2023-10-06T23:11:18.261583+0000","last_became_peered":"2023-10-06T23:11:18.261583+0000","last_unstale":"2023-10-06T23:11:49.042773+0000","last_undegraded":"2023-10-06T23:11:49.042773+0000","last_fullsized":"2023-10-06T23:11:49.042773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:50:54.145738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039796+0000","last_change":"2023-10-06T23:11:50.039796+0000","last_active":"2023-10-06T23:11:50.039796+0000","last_peered":"2023-10-06T23:11:50.039796+0000","last_clean":"2023-10-06T23:11:50.039796+0000","last_became_active":"2023-10-06T23:11:50.039420+0000","last_became_peered":"2023-10-06T23:11:50.039420+0000","last_unstale":"2023-10-06T23:11:50.039796+0000","last_undegraded":"2023-10-06T23:11:50.039796+0000","last_fullsized":"2023-10-06T23:11:50.039796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:28.641948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036360+0000","last_change":"2023-10-06T23:11:18.266565+0000","last_active":"2023-10-06T23:11:49.036360+0000","last_peered":"2023-10-06T23:11:49.036360+0000","last_clean":"2023-10-06T23:11:49.036360+0000","last_became_active":"2023-10-06T23:11:18.266290+0000","last_became_peered":"2023-10-06T23:11:18.266290+0000","last_unstale":"2023-10-06T23:11:49.036360+0000","last_undegraded":"2023-10-06T23:11:49.036360+0000","last_fullsized":"2023-10-06T23:11:49.036360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:45:07.828100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030127+0000","last_change":"2023-10-06T23:11:18.266849+0000","last_active":"2023-10-06T23:11:49.030127+0000","last_peered":"2023-10-06T23:11:49.030127+0000","last_clean":"2023-10-06T23:11:49.030127+0000","last_became_active":"2023-10-06T23:11:18.266517+0000","last_became_peered":"2023-10-06T23:11:18.266517+0000","last_unstale":"2023-10-06T23:11:49.030127+0000","last_undegraded":"2023-10-06T23:11:49.030127+0000","last_fullsized":"2023-10-06T23:11:49.030127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:25:31.988065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031565+0000","last_change":"2023-10-06T23:11:18.270336+0000","last_active":"2023-10-06T23:11:49.031565+0000","last_peered":"2023-10-06T23:11:49.031565+0000","last_clean":"2023-10-06T23:11:49.031565+0000","last_became_active":"2023-10-06T23:11:18.269969+0000","last_became_peered":"2023-10-06T23:11:18.269969+0000","last_unstale":"2023-10-06T23:11:49.031565+0000","last_undegraded":"2023-10-06T23:11:49.031565+0000","last_fullsized":"2023-10-06T23:11:49.031565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:25.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026121+0000","last_change":"2023-10-06T23:11:18.264549+0000","last_active":"2023-10-06T23:11:49.026121+0000","last_peered":"2023-10-06T23:11:49.026121+0000","last_clean":"2023-10-06T23:11:49.026121+0000","last_became_active":"2023-10-06T23:11:18.263446+0000","last_became_peered":"2023-10-06T23:11:18.263446+0000","last_unstale":"2023-10-06T23:11:49.026121+0000","last_undegraded":"2023-10-06T23:11:49.026121+0000","last_fullsized":"2023-10-06T23:11:49.026121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:21:57.009374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026364+0000","last_change":"2023-10-06T23:11:18.262470+0000","last_active":"2023-10-06T23:11:49.026364+0000","last_peered":"2023-10-06T23:11:49.026364+0000","last_clean":"2023-10-06T23:11:49.026364+0000","last_became_active":"2023-10-06T23:11:18.262134+0000","last_became_peered":"2023-10-06T23:11:18.262134+0000","last_unstale":"2023-10-06T23:11:49.026364+0000","last_undegraded":"2023-10-06T23:11:49.026364+0000","last_fullsized":"2023-10-06T23:11:49.026364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:09:26.745107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042326+0000","last_change":"2023-10-06T23:11:18.260657+0000","last_active":"2023-10-06T23:11:49.042326+0000","last_peered":"2023-10-06T23:11:49.042326+0000","last_clean":"2023-10-06T23:11:49.042326+0000","last_became_active":"2023-10-06T23:11:18.260343+0000","last_became_peered":"2023-10-06T23:11:18.260343+0000","last_unstale":"2023-10-06T23:11:49.042326+0000","last_undegraded":"2023-10-06T23:11:49.042326+0000","last_fullsized":"2023-10-06T23:11:49.042326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:46:24.199333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030882+0000","last_change":"2023-10-06T23:11:18.262071+0000","last_active":"2023-10-06T23:11:49.030882+0000","last_peered":"2023-10-06T23:11:49.030882+0000","last_clean":"2023-10-06T23:11:49.030882+0000","last_became_active":"2023-10-06T23:11:18.261348+0000","last_became_peered":"2023-10-06T23:11:18.261348+0000","last_unstale":"2023-10-06T23:11:49.030882+0000","last_undegraded":"2023-10-06T23:11:49.030882+0000","last_fullsized":"2023-10-06T23:11:49.030882+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:57:54.957156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033065+0000","last_change":"2023-10-06T23:11:18.266593+0000","last_active":"2023-10-06T23:11:49.033065+0000","last_peered":"2023-10-06T23:11:49.033065+0000","last_clean":"2023-10-06T23:11:49.033065+0000","last_became_active":"2023-10-06T23:11:18.266293+0000","last_became_peered":"2023-10-06T23:11:18.266293+0000","last_unstale":"2023-10-06T23:11:49.033065+0000","last_undegraded":"2023-10-06T23:11:49.033065+0000","last_fullsized":"2023-10-06T23:11:49.033065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:03:45.130437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037218+0000","last_change":"2023-10-06T23:11:18.264871+0000","last_active":"2023-10-06T23:11:49.037218+0000","last_peered":"2023-10-06T23:11:49.037218+0000","last_clean":"2023-10-06T23:11:49.037218+0000","last_became_active":"2023-10-06T23:11:18.264451+0000","last_became_peered":"2023-10-06T23:11:18.264451+0000","last_unstale":"2023-10-06T23:11:49.037218+0000","last_undegraded":"2023-10-06T23:11:49.037218+0000","last_fullsized":"2023-10-06T23:11:49.037218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:40:00.581508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033336+0000","last_change":"2023-10-06T23:11:17.255867+0000","last_active":"2023-10-06T23:11:49.033336+0000","last_peered":"2023-10-06T23:11:49.033336+0000","last_clean":"2023-10-06T23:11:49.033336+0000","last_became_active":"2023-10-06T23:11:17.255463+0000","last_became_peered":"2023-10-06T23:11:17.255463+0000","last_unstale":"2023-10-06T23:11:49.033336+0000","last_undegraded":"2023-10-06T23:11:49.033336+0000","last_fullsized":"2023-10-06T23:11:49.033336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:21:29.493049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037811+0000","last_change":"2023-10-06T23:11:18.262575+0000","last_active":"2023-10-06T23:11:49.037811+0000","last_peered":"2023-10-06T23:11:49.037811+0000","last_clean":"2023-10-06T23:11:49.037811+0000","last_became_active":"2023-10-06T23:11:18.262266+0000","last_became_peered":"2023-10-06T23:11:18.262266+0000","last_unstale":"2023-10-06T23:11:49.037811+0000","last_undegraded":"2023-10-06T23:11:49.037811+0000","last_fullsized":"2023-10-06T23:11:49.037811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:37:10.870786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037989+0000","last_change":"2023-10-06T23:11:17.259061+0000","last_active":"2023-10-06T23:11:49.037989+0000","last_peered":"2023-10-06T23:11:49.037989+0000","last_clean":"2023-10-06T23:11:49.037989+0000","last_became_active":"2023-10-06T23:11:17.258624+0000","last_became_peered":"2023-10-06T23:11:17.258624+0000","last_unstale":"2023-10-06T23:11:49.037989+0000","last_undegraded":"2023-10-06T23:11:49.037989+0000","last_fullsized":"2023-10-06T23:11:49.037989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:28.121405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027230+0000","last_change":"2023-10-06T23:11:18.263840+0000","last_active":"2023-10-06T23:11:49.027230+0000","last_peered":"2023-10-06T23:11:49.027230+0000","last_clean":"2023-10-06T23:11:49.027230+0000","last_became_active":"2023-10-06T23:11:18.263454+0000","last_became_peered":"2023-10-06T23:11:18.263454+0000","last_unstale":"2023-10-06T23:11:49.027230+0000","last_undegraded":"2023-10-06T23:11:49.027230+0000","last_fullsized":"2023-10-06T23:11:49.027230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:49.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.044245+0000","last_change":"2023-10-06T23:11:50.044245+0000","last_active":"2023-10-06T23:11:50.044245+0000","last_peered":"2023-10-06T23:11:50.044245+0000","last_clean":"2023-10-06T23:11:50.044245+0000","last_became_active":"2023-10-06T23:11:50.038493+0000","last_became_peered":"2023-10-06T23:11:50.038493+0000","last_unstale":"2023-10-06T23:11:50.044245+0000","last_undegraded":"2023-10-06T23:11:50.044245+0000","last_fullsized":"2023-10-06T23:11:50.044245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:19.463617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042312+0000","last_change":"2023-10-06T23:11:18.274068+0000","last_active":"2023-10-06T23:11:49.042312+0000","last_peered":"2023-10-06T23:11:49.042312+0000","last_clean":"2023-10-06T23:11:49.042312+0000","last_became_active":"2023-10-06T23:11:18.273692+0000","last_became_peered":"2023-10-06T23:11:18.273692+0000","last_unstale":"2023-10-06T23:11:49.042312+0000","last_undegraded":"2023-10-06T23:11:49.042312+0000","last_fullsized":"2023-10-06T23:11:49.042312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:57:07.735915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032982+0000","last_change":"2023-10-06T23:11:17.260046+0000","last_active":"2023-10-06T23:11:49.032982+0000","last_peered":"2023-10-06T23:11:49.032982+0000","last_clean":"2023-10-06T23:11:49.032982+0000","last_became_active":"2023-10-06T23:11:17.259638+0000","last_became_peered":"2023-10-06T23:11:17.259638+0000","last_unstale":"2023-10-06T23:11:49.032982+0000","last_undegraded":"2023-10-06T23:11:49.032982+0000","last_fullsized":"2023-10-06T23:11:49.032982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:21.660072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035736+0000","last_change":"2023-10-06T23:11:18.264328+0000","last_active":"2023-10-06T23:11:49.035736+0000","last_peered":"2023-10-06T23:11:49.035736+0000","last_clean":"2023-10-06T23:11:49.035736+0000","last_became_active":"2023-10-06T23:11:18.263554+0000","last_became_peered":"2023-10-06T23:11:18.263554+0000","last_unstale":"2023-10-06T23:11:49.035736+0000","last_undegraded":"2023-10-06T23:11:49.035736+0000","last_fullsized":"2023-10-06T23:11:49.035736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:44:02.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:13:00.412755+0000","last_change":"2023-10-06T23:11:17.265538+0000","last_active":"2023-10-06T23:13:00.412755+0000","last_peered":"2023-10-06T23:13:00.412755+0000","last_clean":"2023-10-06T23:13:00.412755+0000","last_became_active":"2023-10-06T23:11:17.265044+0000","last_became_peered":"2023-10-06T23:11:17.265044+0000","last_unstale":"2023-10-06T23:13:00.412755+0000","last_undegraded":"2023-10-06T23:13:00.412755+0000","last_fullsized":"2023-10-06T23:13:00.412755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:51.220961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1047,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032801+0000","last_change":"2023-10-06T23:11:18.257044+0000","last_active":"2023-10-06T23:11:49.032801+0000","last_peered":"2023-10-06T23:11:49.032801+0000","last_clean":"2023-10-06T23:11:49.032801+0000","last_became_active":"2023-10-06T23:11:18.256711+0000","last_became_peered":"2023-10-06T23:11:18.256711+0000","last_unstale":"2023-10-06T23:11:49.032801+0000","last_undegraded":"2023-10-06T23:11:49.032801+0000","last_fullsized":"2023-10-06T23:11:49.032801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:40:25.441143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032501+0000","last_change":"2023-10-06T23:11:17.262062+0000","last_active":"2023-10-06T23:11:49.032501+0000","last_peered":"2023-10-06T23:11:49.032501+0000","last_clean":"2023-10-06T23:11:49.032501+0000","last_became_active":"2023-10-06T23:11:17.261618+0000","last_became_peered":"2023-10-06T23:11:17.261618+0000","last_unstale":"2023-10-06T23:11:49.032501+0000","last_undegraded":"2023-10-06T23:11:49.032501+0000","last_fullsized":"2023-10-06T23:11:49.032501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:59:33.544470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034757+0000","last_change":"2023-10-06T23:11:18.263242+0000","last_active":"2023-10-06T23:11:49.034757+0000","last_peered":"2023-10-06T23:11:49.034757+0000","last_clean":"2023-10-06T23:11:49.034757+0000","last_became_active":"2023-10-06T23:11:18.262684+0000","last_became_peered":"2023-10-06T23:11:18.262684+0000","last_unstale":"2023-10-06T23:11:49.034757+0000","last_undegraded":"2023-10-06T23:11:49.034757+0000","last_fullsized":"2023-10-06T23:11:49.034757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:30:04.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032315+0000","last_change":"2023-10-06T23:11:17.254042+0000","last_active":"2023-10-06T23:11:49.032315+0000","last_peered":"2023-10-06T23:11:49.032315+0000","last_clean":"2023-10-06T23:11:49.032315+0000","last_became_active":"2023-10-06T23:11:17.253704+0000","last_became_peered":"2023-10-06T23:11:17.253704+0000","last_unstale":"2023-10-06T23:11:49.032315+0000","last_undegraded":"2023-10-06T23:11:49.032315+0000","last_fullsized":"2023-10-06T23:11:49.032315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:44.179814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035458+0000","last_change":"2023-10-06T23:11:18.259161+0000","last_active":"2023-10-06T23:11:49.035458+0000","last_peered":"2023-10-06T23:11:49.035458+0000","last_clean":"2023-10-06T23:11:49.035458+0000","last_became_active":"2023-10-06T23:11:18.258747+0000","last_became_peered":"2023-10-06T23:11:18.258747+0000","last_unstale":"2023-10-06T23:11:49.035458+0000","last_undegraded":"2023-10-06T23:11:49.035458+0000","last_fullsized":"2023-10-06T23:11:49.035458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:55:38.340988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034650+0000","last_change":"2023-10-06T23:11:17.266278+0000","last_active":"2023-10-06T23:11:49.034650+0000","last_peered":"2023-10-06T23:11:49.034650+0000","last_clean":"2023-10-06T23:11:49.034650+0000","last_became_active":"2023-10-06T23:11:17.265174+0000","last_became_peered":"2023-10-06T23:11:17.265174+0000","last_unstale":"2023-10-06T23:11:49.034650+0000","last_undegraded":"2023-10-06T23:11:49.034650+0000","last_fullsized":"2023-10-06T23:11:49.034650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:51.203566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032078+0000","last_change":"2023-10-06T23:11:18.259699+0000","last_active":"2023-10-06T23:11:49.032078+0000","last_peered":"2023-10-06T23:11:49.032078+0000","last_clean":"2023-10-06T23:11:49.032078+0000","last_became_active":"2023-10-06T23:11:18.259395+0000","last_became_peered":"2023-10-06T23:11:18.259395+0000","last_unstale":"2023-10-06T23:11:49.032078+0000","last_undegraded":"2023-10-06T23:11:49.032078+0000","last_fullsized":"2023-10-06T23:11:49.032078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:32:37.830092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":117,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:58.407910+0000","last_change":"2023-10-06T23:11:17.259592+0000","last_active":"2023-10-06T23:12:58.407910+0000","last_peered":"2023-10-06T23:12:58.407910+0000","last_clean":"2023-10-06T23:12:58.407910+0000","last_became_active":"2023-10-06T23:11:17.259254+0000","last_became_peered":"2023-10-06T23:11:17.259254+0000","last_unstale":"2023-10-06T23:12:58.407910+0000","last_undegraded":"2023-10-06T23:12:58.407910+0000","last_fullsized":"2023-10-06T23:12:58.407910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:31.633620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042667+0000","last_change":"2023-10-06T23:11:18.271568+0000","last_active":"2023-10-06T23:11:49.042667+0000","last_peered":"2023-10-06T23:11:49.042667+0000","last_clean":"2023-10-06T23:11:49.042667+0000","last_became_active":"2023-10-06T23:11:18.271248+0000","last_became_peered":"2023-10-06T23:11:18.271248+0000","last_unstale":"2023-10-06T23:11:49.042667+0000","last_undegraded":"2023-10-06T23:11:49.042667+0000","last_fullsized":"2023-10-06T23:11:49.042667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:30.138803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036265+0000","last_change":"2023-10-06T23:11:17.257823+0000","last_active":"2023-10-06T23:11:49.036265+0000","last_peered":"2023-10-06T23:11:49.036265+0000","last_clean":"2023-10-06T23:11:49.036265+0000","last_became_active":"2023-10-06T23:11:17.257426+0000","last_became_peered":"2023-10-06T23:11:17.257426+0000","last_unstale":"2023-10-06T23:11:49.036265+0000","last_undegraded":"2023-10-06T23:11:49.036265+0000","last_fullsized":"2023-10-06T23:11:49.036265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:27:17.158360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027188+0000","last_change":"2023-10-06T23:11:18.260555+0000","last_active":"2023-10-06T23:11:49.027188+0000","last_peered":"2023-10-06T23:11:49.027188+0000","last_clean":"2023-10-06T23:11:49.027188+0000","last_became_active":"2023-10-06T23:11:18.260236+0000","last_became_peered":"2023-10-06T23:11:18.260236+0000","last_unstale":"2023-10-06T23:11:49.027188+0000","last_undegraded":"2023-10-06T23:11:49.027188+0000","last_fullsized":"2023-10-06T23:11:49.027188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:51.499668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035946+0000","last_change":"2023-10-06T23:11:17.267686+0000","last_active":"2023-10-06T23:11:49.035946+0000","last_peered":"2023-10-06T23:11:49.035946+0000","last_clean":"2023-10-06T23:11:49.035946+0000","last_became_active":"2023-10-06T23:11:17.267322+0000","last_became_peered":"2023-10-06T23:11:17.267322+0000","last_unstale":"2023-10-06T23:11:49.035946+0000","last_undegraded":"2023-10-06T23:11:49.035946+0000","last_fullsized":"2023-10-06T23:11:49.035946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:48:40.755898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042418+0000","last_change":"2023-10-06T23:11:18.257382+0000","last_active":"2023-10-06T23:11:49.042418+0000","last_peered":"2023-10-06T23:11:49.042418+0000","last_clean":"2023-10-06T23:11:49.042418+0000","last_became_active":"2023-10-06T23:11:18.256572+0000","last_became_peered":"2023-10-06T23:11:18.256572+0000","last_unstale":"2023-10-06T23:11:49.042418+0000","last_undegraded":"2023-10-06T23:11:49.042418+0000","last_fullsized":"2023-10-06T23:11:49.042418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:43.631813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'10","reported_seq":223,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:13:00.095849+0000","last_change":"2023-10-06T23:11:17.257340+0000","last_active":"2023-10-06T23:13:00.095849+0000","last_peered":"2023-10-06T23:13:00.095849+0000","last_clean":"2023-10-06T23:13:00.095849+0000","last_became_active":"2023-10-06T23:11:17.256973+0000","last_became_peered":"2023-10-06T23:11:17.256973+0000","last_unstale":"2023-10-06T23:13:00.095849+0000","last_undegraded":"2023-10-06T23:13:00.095849+0000","last_fullsized":"2023-10-06T23:13:00.095849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:35.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":100,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033409+0000","last_change":"2023-10-06T23:11:18.258928+0000","last_active":"2023-10-06T23:11:49.033409+0000","last_peered":"2023-10-06T23:11:49.033409+0000","last_clean":"2023-10-06T23:11:49.033409+0000","last_became_active":"2023-10-06T23:11:18.258572+0000","last_became_peered":"2023-10-06T23:11:18.258572+0000","last_unstale":"2023-10-06T23:11:49.033409+0000","last_undegraded":"2023-10-06T23:11:49.033409+0000","last_fullsized":"2023-10-06T23:11:49.033409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:51.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037051+0000","last_change":"2023-10-06T23:11:17.260955+0000","last_active":"2023-10-06T23:11:49.037051+0000","last_peered":"2023-10-06T23:11:49.037051+0000","last_clean":"2023-10-06T23:11:49.037051+0000","last_became_active":"2023-10-06T23:11:17.260565+0000","last_became_peered":"2023-10-06T23:11:17.260565+0000","last_unstale":"2023-10-06T23:11:49.037051+0000","last_undegraded":"2023-10-06T23:11:49.037051+0000","last_fullsized":"2023-10-06T23:11:49.037051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:14:51.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031110+0000","last_change":"2023-10-06T23:11:18.266857+0000","last_active":"2023-10-06T23:11:49.031110+0000","last_peered":"2023-10-06T23:11:49.031110+0000","last_clean":"2023-10-06T23:11:49.031110+0000","last_became_active":"2023-10-06T23:11:18.266476+0000","last_became_peered":"2023-10-06T23:11:18.266476+0000","last_unstale":"2023-10-06T23:11:49.031110+0000","last_undegraded":"2023-10-06T23:11:49.031110+0000","last_fullsized":"2023-10-06T23:11:49.031110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:26.131492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035426+0000","last_change":"2023-10-06T23:11:17.265672+0000","last_active":"2023-10-06T23:11:49.035426+0000","last_peered":"2023-10-06T23:11:49.035426+0000","last_clean":"2023-10-06T23:11:49.035426+0000","last_became_active":"2023-10-06T23:11:17.265329+0000","last_became_peered":"2023-10-06T23:11:17.265329+0000","last_unstale":"2023-10-06T23:11:49.035426+0000","last_undegraded":"2023-10-06T23:11:49.035426+0000","last_fullsized":"2023-10-06T23:11:49.035426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:43.159919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036115+0000","last_change":"2023-10-06T23:11:18.269427+0000","last_active":"2023-10-06T23:11:49.036115+0000","last_peered":"2023-10-06T23:11:49.036115+0000","last_clean":"2023-10-06T23:11:49.036115+0000","last_became_active":"2023-10-06T23:11:18.269115+0000","last_became_peered":"2023-10-06T23:11:18.269115+0000","last_unstale":"2023-10-06T23:11:49.036115+0000","last_undegraded":"2023-10-06T23:11:49.036115+0000","last_fullsized":"2023-10-06T23:11:49.036115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:12.598526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:59.407905+0000","last_change":"2023-10-06T23:11:17.252599+0000","last_active":"2023-10-06T23:12:59.407905+0000","last_peered":"2023-10-06T23:12:59.407905+0000","last_clean":"2023-10-06T23:12:59.407905+0000","last_became_active":"2023-10-06T23:11:17.251893+0000","last_became_peered":"2023-10-06T23:11:17.251893+0000","last_unstale":"2023-10-06T23:12:59.407905+0000","last_undegraded":"2023-10-06T23:12:59.407905+0000","last_fullsized":"2023-10-06T23:12:59.407905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:24:10.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035840+0000","last_change":"2023-10-06T23:11:18.269026+0000","last_active":"2023-10-06T23:11:49.035840+0000","last_peered":"2023-10-06T23:11:49.035840+0000","last_clean":"2023-10-06T23:11:49.035840+0000","last_became_active":"2023-10-06T23:11:18.268701+0000","last_became_peered":"2023-10-06T23:11:18.268701+0000","last_unstale":"2023-10-06T23:11:49.035840+0000","last_undegraded":"2023-10-06T23:11:49.035840+0000","last_fullsized":"2023-10-06T23:11:49.035840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:03:25.903664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032636+0000","last_change":"2023-10-06T23:11:17.255323+0000","last_active":"2023-10-06T23:11:49.032636+0000","last_peered":"2023-10-06T23:11:49.032636+0000","last_clean":"2023-10-06T23:11:49.032636+0000","last_became_active":"2023-10-06T23:11:17.254975+0000","last_became_peered":"2023-10-06T23:11:17.254975+0000","last_unstale":"2023-10-06T23:11:49.032636+0000","last_undegraded":"2023-10-06T23:11:49.032636+0000","last_fullsized":"2023-10-06T23:11:49.032636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:41:35.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035228+0000","last_change":"2023-10-06T23:11:18.263290+0000","last_active":"2023-10-06T23:11:49.035228+0000","last_peered":"2023-10-06T23:11:49.035228+0000","last_clean":"2023-10-06T23:11:49.035228+0000","last_became_active":"2023-10-06T23:11:18.262680+0000","last_became_peered":"2023-10-06T23:11:18.262680+0000","last_unstale":"2023-10-06T23:11:49.035228+0000","last_undegraded":"2023-10-06T23:11:49.035228+0000","last_fullsized":"2023-10-06T23:11:49.035228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:43:12.249803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.048876+0000","last_change":"2023-10-06T23:11:50.048453+0000","last_active":"2023-10-06T23:11:50.048876+0000","last_peered":"2023-10-06T23:11:50.048876+0000","last_clean":"2023-10-06T23:11:50.048876+0000","last_became_active":"2023-10-06T23:11:50.035200+0000","last_became_peered":"2023-10-06T23:11:50.035200+0000","last_unstale":"2023-10-06T23:11:50.048876+0000","last_undegraded":"2023-10-06T23:11:50.048876+0000","last_fullsized":"2023-10-06T23:11:50.048876+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:31:21.791916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.032715+0000","last_change":"2023-10-06T23:11:50.032715+0000","last_active":"2023-10-06T23:11:50.032715+0000","last_peered":"2023-10-06T23:11:50.032715+0000","last_clean":"2023-10-06T23:11:50.032715+0000","last_became_active":"2023-10-06T23:11:50.032326+0000","last_became_peered":"2023-10-06T23:11:50.032326+0000","last_unstale":"2023-10-06T23:11:50.032715+0000","last_undegraded":"2023-10-06T23:11:50.032715+0000","last_fullsized":"2023-10-06T23:11:50.032715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:26:25.453692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032907+0000","last_change":"2023-10-06T23:11:17.258175+0000","last_active":"2023-10-06T23:11:49.032907+0000","last_peered":"2023-10-06T23:11:49.032907+0000","last_clean":"2023-10-06T23:11:49.032907+0000","last_became_active":"2023-10-06T23:11:17.257780+0000","last_became_peered":"2023-10-06T23:11:17.257780+0000","last_unstale":"2023-10-06T23:11:49.032907+0000","last_undegraded":"2023-10-06T23:11:49.032907+0000","last_fullsized":"2023-10-06T23:11:49.032907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:19:51.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033026+0000","last_change":"2023-10-06T23:11:18.267837+0000","last_active":"2023-10-06T23:11:49.033026+0000","last_peered":"2023-10-06T23:11:49.033026+0000","last_clean":"2023-10-06T23:11:49.033026+0000","last_became_active":"2023-10-06T23:11:18.267535+0000","last_became_peered":"2023-10-06T23:11:18.267535+0000","last_unstale":"2023-10-06T23:11:49.033026+0000","last_undegraded":"2023-10-06T23:11:49.033026+0000","last_fullsized":"2023-10-06T23:11:49.033026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:08.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036029+0000","last_change":"2023-10-06T23:11:17.261075+0000","last_active":"2023-10-06T23:11:49.036029+0000","last_peered":"2023-10-06T23:11:49.036029+0000","last_clean":"2023-10-06T23:11:49.036029+0000","last_became_active":"2023-10-06T23:11:17.260456+0000","last_became_peered":"2023-10-06T23:11:17.260456+0000","last_unstale":"2023-10-06T23:11:49.036029+0000","last_undegraded":"2023-10-06T23:11:49.036029+0000","last_fullsized":"2023-10-06T23:11:49.036029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:00:25.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032760+0000","last_change":"2023-10-06T23:11:18.265347+0000","last_active":"2023-10-06T23:11:49.032760+0000","last_peered":"2023-10-06T23:11:49.032760+0000","last_clean":"2023-10-06T23:11:49.032760+0000","last_became_active":"2023-10-06T23:11:18.265034+0000","last_became_peered":"2023-10-06T23:11:18.265034+0000","last_unstale":"2023-10-06T23:11:49.032760+0000","last_undegraded":"2023-10-06T23:11:49.032760+0000","last_fullsized":"2023-10-06T23:11:49.032760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:32:44.253022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034992+0000","last_change":"2023-10-06T23:11:18.263990+0000","last_active":"2023-10-06T23:11:49.034992+0000","last_peered":"2023-10-06T23:11:49.034992+0000","last_clean":"2023-10-06T23:11:49.034992+0000","last_became_active":"2023-10-06T23:11:18.262760+0000","last_became_peered":"2023-10-06T23:11:18.262760+0000","last_unstale":"2023-10-06T23:11:49.034992+0000","last_undegraded":"2023-10-06T23:11:49.034992+0000","last_fullsized":"2023-10-06T23:11:49.034992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:48:51.754187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":114,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:56.402311+0000","last_change":"2023-10-06T23:11:17.263187+0000","last_active":"2023-10-06T23:12:56.402311+0000","last_peered":"2023-10-06T23:12:56.402311+0000","last_clean":"2023-10-06T23:12:56.402311+0000","last_became_active":"2023-10-06T23:11:17.262770+0000","last_became_peered":"2023-10-06T23:11:17.262770+0000","last_unstale":"2023-10-06T23:12:56.402311+0000","last_undegraded":"2023-10-06T23:12:56.402311+0000","last_fullsized":"2023-10-06T23:12:56.402311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:27.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036248+0000","last_change":"2023-10-06T23:11:18.264305+0000","last_active":"2023-10-06T23:11:49.036248+0000","last_peered":"2023-10-06T23:11:49.036248+0000","last_clean":"2023-10-06T23:11:49.036248+0000","last_became_active":"2023-10-06T23:11:18.263964+0000","last_became_peered":"2023-10-06T23:11:18.263964+0000","last_unstale":"2023-10-06T23:11:49.036248+0000","last_undegraded":"2023-10-06T23:11:49.036248+0000","last_fullsized":"2023-10-06T23:11:49.036248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:11.855254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030137+0000","last_change":"2023-10-06T23:11:17.249832+0000","last_active":"2023-10-06T23:11:49.030137+0000","last_peered":"2023-10-06T23:11:49.030137+0000","last_clean":"2023-10-06T23:11:49.030137+0000","last_became_active":"2023-10-06T23:11:17.249425+0000","last_became_peered":"2023-10-06T23:11:17.249425+0000","last_unstale":"2023-10-06T23:11:49.030137+0000","last_undegraded":"2023-10-06T23:11:49.030137+0000","last_fullsized":"2023-10-06T23:11:49.030137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:02:49.349981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":313,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.036797+0000","last_change":"2023-10-06T23:09:57.868881+0000","last_active":"2023-10-06T23:11:50.036797+0000","last_peered":"2023-10-06T23:11:50.036797+0000","last_clean":"2023-10-06T23:11:50.036797+0000","last_became_active":"2023-10-06T23:09:57.868450+0000","last_became_peered":"2023-10-06T23:09:57.868450+0000","last_unstale":"2023-10-06T23:11:50.036797+0000","last_undegraded":"2023-10-06T23:11:50.036797+0000","last_fullsized":"2023-10-06T23:11:50.036797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_clean_scrub_stamp":"2023-10-06T23:06:23.790096+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:39:38.741355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039829+0000","last_change":"2023-10-06T23:11:50.039829+0000","last_active":"2023-10-06T23:11:50.039829+0000","last_peered":"2023-10-06T23:11:50.039829+0000","last_clean":"2023-10-06T23:11:50.039829+0000","last_became_active":"2023-10-06T23:11:50.039403+0000","last_became_peered":"2023-10-06T23:11:50.039403+0000","last_unstale":"2023-10-06T23:11:50.039829+0000","last_undegraded":"2023-10-06T23:11:50.039829+0000","last_fullsized":"2023-10-06T23:11:50.039829+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:33.599164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036051+0000","last_change":"2023-10-06T23:11:17.259610+0000","last_active":"2023-10-06T23:11:49.036051+0000","last_peered":"2023-10-06T23:11:49.036051+0000","last_clean":"2023-10-06T23:11:49.036051+0000","last_became_active":"2023-10-06T23:11:17.259314+0000","last_became_peered":"2023-10-06T23:11:17.259314+0000","last_unstale":"2023-10-06T23:11:49.036051+0000","last_undegraded":"2023-10-06T23:11:49.036051+0000","last_fullsized":"2023-10-06T23:11:49.036051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:48.131199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.040322+0000","last_change":"2023-10-06T23:11:50.039550+0000","last_active":"2023-10-06T23:11:50.040322+0000","last_peered":"2023-10-06T23:11:50.040322+0000","last_clean":"2023-10-06T23:11:50.040322+0000","last_became_active":"2023-10-06T23:11:50.033804+0000","last_became_peered":"2023-10-06T23:11:50.033804+0000","last_unstale":"2023-10-06T23:11:50.040322+0000","last_undegraded":"2023-10-06T23:11:50.040322+0000","last_fullsized":"2023-10-06T23:11:50.040322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:06.172652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031729+0000","last_change":"2023-10-06T23:11:18.259562+0000","last_active":"2023-10-06T23:11:49.031729+0000","last_peered":"2023-10-06T23:11:49.031729+0000","last_clean":"2023-10-06T23:11:49.031729+0000","last_became_active":"2023-10-06T23:11:18.259188+0000","last_became_peered":"2023-10-06T23:11:18.259188+0000","last_unstale":"2023-10-06T23:11:49.031729+0000","last_undegraded":"2023-10-06T23:11:49.031729+0000","last_fullsized":"2023-10-06T23:11:49.031729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:19.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033164+0000","last_change":"2023-10-06T23:11:17.260888+0000","last_active":"2023-10-06T23:11:49.033164+0000","last_peered":"2023-10-06T23:11:49.033164+0000","last_clean":"2023-10-06T23:11:49.033164+0000","last_became_active":"2023-10-06T23:11:17.260563+0000","last_became_peered":"2023-10-06T23:11:17.260563+0000","last_unstale":"2023-10-06T23:11:49.033164+0000","last_undegraded":"2023-10-06T23:11:49.033164+0000","last_fullsized":"2023-10-06T23:11:49.033164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:43.087389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036989+0000","last_change":"2023-10-06T23:11:18.261401+0000","last_active":"2023-10-06T23:11:49.036989+0000","last_peered":"2023-10-06T23:11:49.036989+0000","last_clean":"2023-10-06T23:11:49.036989+0000","last_became_active":"2023-10-06T23:11:18.261037+0000","last_became_peered":"2023-10-06T23:11:18.261037+0000","last_unstale":"2023-10-06T23:11:49.036989+0000","last_undegraded":"2023-10-06T23:11:49.036989+0000","last_fullsized":"2023-10-06T23:11:49.036989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:53.298980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030447+0000","last_change":"2023-10-06T23:11:17.264907+0000","last_active":"2023-10-06T23:11:49.030447+0000","last_peered":"2023-10-06T23:11:49.030447+0000","last_clean":"2023-10-06T23:11:49.030447+0000","last_became_active":"2023-10-06T23:11:17.264426+0000","last_became_peered":"2023-10-06T23:11:17.264426+0000","last_unstale":"2023-10-06T23:11:49.030447+0000","last_undegraded":"2023-10-06T23:11:49.030447+0000","last_fullsized":"2023-10-06T23:11:49.030447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:21.330048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027045+0000","last_change":"2023-10-06T23:11:18.259337+0000","last_active":"2023-10-06T23:11:49.027045+0000","last_peered":"2023-10-06T23:11:49.027045+0000","last_clean":"2023-10-06T23:11:49.027045+0000","last_became_active":"2023-10-06T23:11:18.259008+0000","last_became_peered":"2023-10-06T23:11:18.259008+0000","last_unstale":"2023-10-06T23:11:49.027045+0000","last_undegraded":"2023-10-06T23:11:49.027045+0000","last_fullsized":"2023-10-06T23:11:49.027045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:28.845368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042510+0000","last_change":"2023-10-06T23:11:17.267695+0000","last_active":"2023-10-06T23:11:49.042510+0000","last_peered":"2023-10-06T23:11:49.042510+0000","last_clean":"2023-10-06T23:11:49.042510+0000","last_became_active":"2023-10-06T23:11:17.267292+0000","last_became_peered":"2023-10-06T23:11:17.267292+0000","last_unstale":"2023-10-06T23:11:49.042510+0000","last_undegraded":"2023-10-06T23:11:49.042510+0000","last_fullsized":"2023-10-06T23:11:49.042510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:36:54.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032536+0000","last_change":"2023-10-06T23:11:18.260012+0000","last_active":"2023-10-06T23:11:49.032536+0000","last_peered":"2023-10-06T23:11:49.032536+0000","last_clean":"2023-10-06T23:11:49.032536+0000","last_became_active":"2023-10-06T23:11:18.259684+0000","last_became_peered":"2023-10-06T23:11:18.259684+0000","last_unstale":"2023-10-06T23:11:49.032536+0000","last_undegraded":"2023-10-06T23:11:49.032536+0000","last_fullsized":"2023-10-06T23:11:49.032536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:46:08.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035791+0000","last_change":"2023-10-06T23:11:17.264262+0000","last_active":"2023-10-06T23:11:49.035791+0000","last_peered":"2023-10-06T23:11:49.035791+0000","last_clean":"2023-10-06T23:11:49.035791+0000","last_became_active":"2023-10-06T23:11:17.263922+0000","last_became_peered":"2023-10-06T23:11:17.263922+0000","last_unstale":"2023-10-06T23:11:49.035791+0000","last_undegraded":"2023-10-06T23:11:49.035791+0000","last_fullsized":"2023-10-06T23:11:49.035791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:00:14.045943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029509+0000","last_change":"2023-10-06T23:11:18.260908+0000","last_active":"2023-10-06T23:11:49.029509+0000","last_peered":"2023-10-06T23:11:49.029509+0000","last_clean":"2023-10-06T23:11:49.029509+0000","last_became_active":"2023-10-06T23:11:18.260459+0000","last_became_peered":"2023-10-06T23:11:18.260459+0000","last_unstale":"2023-10-06T23:11:49.029509+0000","last_undegraded":"2023-10-06T23:11:49.029509+0000","last_fullsized":"2023-10-06T23:11:49.029509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:51.570508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036705+0000","last_change":"2023-10-06T23:11:17.262559+0000","last_active":"2023-10-06T23:11:49.036705+0000","last_peered":"2023-10-06T23:11:49.036705+0000","last_clean":"2023-10-06T23:11:49.036705+0000","last_became_active":"2023-10-06T23:11:17.262062+0000","last_became_peered":"2023-10-06T23:11:17.262062+0000","last_unstale":"2023-10-06T23:11:49.036705+0000","last_undegraded":"2023-10-06T23:11:49.036705+0000","last_fullsized":"2023-10-06T23:11:49.036705+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:03.751385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036526+0000","last_change":"2023-10-06T23:11:18.269813+0000","last_active":"2023-10-06T23:11:49.036526+0000","last_peered":"2023-10-06T23:11:49.036526+0000","last_clean":"2023-10-06T23:11:49.036526+0000","last_became_active":"2023-10-06T23:11:18.269506+0000","last_became_peered":"2023-10-06T23:11:18.269506+0000","last_unstale":"2023-10-06T23:11:49.036526+0000","last_undegraded":"2023-10-06T23:11:49.036526+0000","last_fullsized":"2023-10-06T23:11:49.036526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:43:21.635237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032699+0000","last_change":"2023-10-06T23:11:17.253040+0000","last_active":"2023-10-06T23:11:49.032699+0000","last_peered":"2023-10-06T23:11:49.032699+0000","last_clean":"2023-10-06T23:11:49.032699+0000","last_became_active":"2023-10-06T23:11:17.252596+0000","last_became_peered":"2023-10-06T23:11:17.252596+0000","last_unstale":"2023-10-06T23:11:49.032699+0000","last_undegraded":"2023-10-06T23:11:49.032699+0000","last_fullsized":"2023-10-06T23:11:49.032699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:39:30.721464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036362+0000","last_change":"2023-10-06T23:11:18.267465+0000","last_active":"2023-10-06T23:11:49.036362+0000","last_peered":"2023-10-06T23:11:49.036362+0000","last_clean":"2023-10-06T23:11:49.036362+0000","last_became_active":"2023-10-06T23:11:18.267164+0000","last_became_peered":"2023-10-06T23:11:18.267164+0000","last_unstale":"2023-10-06T23:11:49.036362+0000","last_undegraded":"2023-10-06T23:11:49.036362+0000","last_fullsized":"2023-10-06T23:11:49.036362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:16.747117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037242+0000","last_change":"2023-10-06T23:11:17.267653+0000","last_active":"2023-10-06T23:11:49.037242+0000","last_peered":"2023-10-06T23:11:49.037242+0000","last_clean":"2023-10-06T23:11:49.037242+0000","last_became_active":"2023-10-06T23:11:17.267264+0000","last_became_peered":"2023-10-06T23:11:17.267264+0000","last_unstale":"2023-10-06T23:11:49.037242+0000","last_undegraded":"2023-10-06T23:11:49.037242+0000","last_fullsized":"2023-10-06T23:11:49.037242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:45:57.242383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036468+0000","last_change":"2023-10-06T23:11:18.264869+0000","last_active":"2023-10-06T23:11:49.036468+0000","last_peered":"2023-10-06T23:11:49.036468+0000","last_clean":"2023-10-06T23:11:49.036468+0000","last_became_active":"2023-10-06T23:11:18.264549+0000","last_became_peered":"2023-10-06T23:11:18.264549+0000","last_unstale":"2023-10-06T23:11:49.036468+0000","last_undegraded":"2023-10-06T23:11:49.036468+0000","last_fullsized":"2023-10-06T23:11:49.036468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:00:35.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035779+0000","last_change":"2023-10-06T23:11:17.263806+0000","last_active":"2023-10-06T23:11:49.035779+0000","last_peered":"2023-10-06T23:11:49.035779+0000","last_clean":"2023-10-06T23:11:49.035779+0000","last_became_active":"2023-10-06T23:11:17.263499+0000","last_became_peered":"2023-10-06T23:11:17.263499+0000","last_unstale":"2023-10-06T23:11:49.035779+0000","last_undegraded":"2023-10-06T23:11:49.035779+0000","last_fullsized":"2023-10-06T23:11:49.035779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:26.191338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036159+0000","last_change":"2023-10-06T23:11:18.264691+0000","last_active":"2023-10-06T23:11:49.036159+0000","last_peered":"2023-10-06T23:11:49.036159+0000","last_clean":"2023-10-06T23:11:49.036159+0000","last_became_active":"2023-10-06T23:11:18.264286+0000","last_became_peered":"2023-10-06T23:11:18.264286+0000","last_unstale":"2023-10-06T23:11:49.036159+0000","last_undegraded":"2023-10-06T23:11:49.036159+0000","last_fullsized":"2023-10-06T23:11:49.036159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:35:23.728707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.401402+0000","last_change":"2023-10-06T23:11:50.401402+0000","last_active":"2023-10-06T23:11:50.401402+0000","last_peered":"2023-10-06T23:11:50.401402+0000","last_clean":"2023-10-06T23:11:50.401402+0000","last_became_active":"2023-10-06T23:11:50.397772+0000","last_became_peered":"2023-10-06T23:11:50.397772+0000","last_unstale":"2023-10-06T23:11:50.401402+0000","last_undegraded":"2023-10-06T23:11:50.401402+0000","last_fullsized":"2023-10-06T23:11:50.401402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:33.727845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036474+0000","last_change":"2023-10-06T23:11:18.265822+0000","last_active":"2023-10-06T23:11:49.036474+0000","last_peered":"2023-10-06T23:11:49.036474+0000","last_clean":"2023-10-06T23:11:49.036474+0000","last_became_active":"2023-10-06T23:11:18.265457+0000","last_became_peered":"2023-10-06T23:11:18.265457+0000","last_unstale":"2023-10-06T23:11:49.036474+0000","last_undegraded":"2023-10-06T23:11:49.036474+0000","last_fullsized":"2023-10-06T23:11:49.036474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:09.132431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029634+0000","last_change":"2023-10-06T23:11:18.267305+0000","last_active":"2023-10-06T23:11:49.029634+0000","last_peered":"2023-10-06T23:11:49.029634+0000","last_clean":"2023-10-06T23:11:49.029634+0000","last_became_active":"2023-10-06T23:11:18.266975+0000","last_became_peered":"2023-10-06T23:11:18.266975+0000","last_unstale":"2023-10-06T23:11:49.029634+0000","last_undegraded":"2023-10-06T23:11:49.029634+0000","last_fullsized":"2023-10-06T23:11:49.029634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036823+0000","last_change":"2023-10-06T23:11:18.262045+0000","last_active":"2023-10-06T23:11:49.036823+0000","last_peered":"2023-10-06T23:11:49.036823+0000","last_clean":"2023-10-06T23:11:49.036823+0000","last_became_active":"2023-10-06T23:11:18.261662+0000","last_became_peered":"2023-10-06T23:11:18.261662+0000","last_unstale":"2023-10-06T23:11:49.036823+0000","last_undegraded":"2023-10-06T23:11:49.036823+0000","last_fullsized":"2023-10-06T23:11:49.036823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:56:06.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036972+0000","last_change":"2023-10-06T23:11:18.259540+0000","last_active":"2023-10-06T23:11:49.036972+0000","last_peered":"2023-10-06T23:11:49.036972+0000","last_clean":"2023-10-06T23:11:49.036972+0000","last_became_active":"2023-10-06T23:11:18.259234+0000","last_became_peered":"2023-10-06T23:11:18.259234+0000","last_unstale":"2023-10-06T23:11:49.036972+0000","last_undegraded":"2023-10-06T23:11:49.036972+0000","last_fullsized":"2023-10-06T23:11:49.036972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:47:15.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026670+0000","last_change":"2023-10-06T23:11:18.266295+0000","last_active":"2023-10-06T23:11:49.026670+0000","last_peered":"2023-10-06T23:11:49.026670+0000","last_clean":"2023-10-06T23:11:49.026670+0000","last_became_active":"2023-10-06T23:11:18.265991+0000","last_became_peered":"2023-10-06T23:11:18.265991+0000","last_unstale":"2023-10-06T23:11:49.026670+0000","last_undegraded":"2023-10-06T23:11:49.026670+0000","last_fullsized":"2023-10-06T23:11:49.026670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:34:43.165643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031833+0000","last_change":"2023-10-06T23:11:18.266239+0000","last_active":"2023-10-06T23:11:49.031833+0000","last_peered":"2023-10-06T23:11:49.031833+0000","last_clean":"2023-10-06T23:11:49.031833+0000","last_became_active":"2023-10-06T23:11:18.265849+0000","last_became_peered":"2023-10-06T23:11:18.265849+0000","last_unstale":"2023-10-06T23:11:49.031833+0000","last_undegraded":"2023-10-06T23:11:49.031833+0000","last_fullsized":"2023-10-06T23:11:49.031833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:47.219459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030522+0000","last_change":"2023-10-06T23:11:18.260885+0000","last_active":"2023-10-06T23:11:49.030522+0000","last_peered":"2023-10-06T23:11:49.030522+0000","last_clean":"2023-10-06T23:11:49.030522+0000","last_became_active":"2023-10-06T23:11:18.260567+0000","last_became_peered":"2023-10-06T23:11:18.260567+0000","last_unstale":"2023-10-06T23:11:49.030522+0000","last_undegraded":"2023-10-06T23:11:49.030522+0000","last_fullsized":"2023-10-06T23:11:49.030522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:36.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037629+0000","last_change":"2023-10-06T23:11:18.257105+0000","last_active":"2023-10-06T23:11:49.037629+0000","last_peered":"2023-10-06T23:11:49.037629+0000","last_clean":"2023-10-06T23:11:49.037629+0000","last_became_active":"2023-10-06T23:11:18.256816+0000","last_became_peered":"2023-10-06T23:11:18.256816+0000","last_unstale":"2023-10-06T23:11:49.037629+0000","last_undegraded":"2023-10-06T23:11:49.037629+0000","last_fullsized":"2023-10-06T23:11:49.037629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:07.749678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036911+0000","last_change":"2023-10-06T23:11:18.260383+0000","last_active":"2023-10-06T23:11:49.036911+0000","last_peered":"2023-10-06T23:11:49.036911+0000","last_clean":"2023-10-06T23:11:49.036911+0000","last_became_active":"2023-10-06T23:11:18.260010+0000","last_became_peered":"2023-10-06T23:11:18.260010+0000","last_unstale":"2023-10-06T23:11:49.036911+0000","last_undegraded":"2023-10-06T23:11:49.036911+0000","last_fullsized":"2023-10-06T23:11:49.036911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:25.014895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034750+0000","last_change":"2023-10-06T23:11:18.261948+0000","last_active":"2023-10-06T23:11:49.034750+0000","last_peered":"2023-10-06T23:11:49.034750+0000","last_clean":"2023-10-06T23:11:49.034750+0000","last_became_active":"2023-10-06T23:11:18.261605+0000","last_became_peered":"2023-10-06T23:11:18.261605+0000","last_unstale":"2023-10-06T23:11:49.034750+0000","last_undegraded":"2023-10-06T23:11:49.034750+0000","last_fullsized":"2023-10-06T23:11:49.034750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:10:59.720181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035691+0000","last_change":"2023-10-06T23:11:18.261123+0000","last_active":"2023-10-06T23:11:49.035691+0000","last_peered":"2023-10-06T23:11:49.035691+0000","last_clean":"2023-10-06T23:11:49.035691+0000","last_became_active":"2023-10-06T23:11:18.260754+0000","last_became_peered":"2023-10-06T23:11:18.260754+0000","last_unstale":"2023-10-06T23:11:49.035691+0000","last_undegraded":"2023-10-06T23:11:49.035691+0000","last_fullsized":"2023-10-06T23:11:49.035691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:04:25.335790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042589+0000","last_change":"2023-10-06T23:11:18.261021+0000","last_active":"2023-10-06T23:11:49.042589+0000","last_peered":"2023-10-06T23:11:49.042589+0000","last_clean":"2023-10-06T23:11:49.042589+0000","last_became_active":"2023-10-06T23:11:18.260613+0000","last_became_peered":"2023-10-06T23:11:18.260613+0000","last_unstale":"2023-10-06T23:11:49.042589+0000","last_undegraded":"2023-10-06T23:11:49.042589+0000","last_fullsized":"2023-10-06T23:11:49.042589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:31:28.443342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031481+0000","last_change":"2023-10-06T23:11:18.266771+0000","last_active":"2023-10-06T23:11:49.031481+0000","last_peered":"2023-10-06T23:11:49.031481+0000","last_clean":"2023-10-06T23:11:49.031481+0000","last_became_active":"2023-10-06T23:11:18.266434+0000","last_became_peered":"2023-10-06T23:11:18.266434+0000","last_unstale":"2023-10-06T23:11:49.031481+0000","last_undegraded":"2023-10-06T23:11:49.031481+0000","last_fullsized":"2023-10-06T23:11:49.031481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:59:53.056671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029587+0000","last_change":"2023-10-06T23:11:18.265674+0000","last_active":"2023-10-06T23:11:49.029587+0000","last_peered":"2023-10-06T23:11:49.029587+0000","last_clean":"2023-10-06T23:11:49.029587+0000","last_became_active":"2023-10-06T23:11:18.265323+0000","last_became_peered":"2023-10-06T23:11:18.265323+0000","last_unstale":"2023-10-06T23:11:49.029587+0000","last_undegraded":"2023-10-06T23:11:49.029587+0000","last_fullsized":"2023-10-06T23:11:49.029587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:15.281707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281556,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6072,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":607,"num_read_kb":311,"num_write":129,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":44,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":19031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351011,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":459304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.72899999999999998,"15min":0.755},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":3.7559999999999998,"15min":3.7559999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.84599999999999997,"15min":0.88700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78300000000000003,"5min":5.585,"15min":5.585},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.48599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.036,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.82199999999999995,"15min":0.83399999999999996},"min":{"1min":0.59999999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92000000000000004,"5min":3.895,"15min":3.895},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.44700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81499999999999995,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.63},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.42099999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.92100000000000004,"5min":3.052,"15min":3.052},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.56599999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.872,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.079,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.92700000000000005},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93100000000000005,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4009999999999998,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.018,"15min":1.052},"min":{"1min":0.60899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0589999999999999,"5min":5.9640000000000004,"15min":5.9640000000000004},"last":0.90200000000000002}]},{"osd":7,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.97299999999999998,"15min":0.98899999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.131,"5min":4.21,"15min":4.21},"last":0.81100000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.204},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.95799999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.2,"15min":1.246},"min":{"1min":0.73199999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.089,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.71999999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0900000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.97799999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0389999999999999,"15min":1.0589999999999999},"min":{"1min":0.65200000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.1659999999999999,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.131,"15min":1.1519999999999999},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4930000000000001,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":1.1439999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612648,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1052236,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.46800000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.755,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.84099999999999997}]},{"osd":2,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.73299999999999998,"15min":0.69699999999999995},"min":{"1min":0.70799999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.61099999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82399999999999995,"5min":1.631,"15min":1.631},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.83199999999999996,"15min":0.81299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86899999999999999,"5min":8.2669999999999995,"15min":8.2669999999999995},"last":0.751}]},{"osd":4,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67900000000000005,"15min":0.66900000000000004},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.004,"15min":1.004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96799999999999997,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.02,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90800000000000003,"15min":0.91300000000000003},"min":{"1min":0.68799999999999994,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0720000000000001,"5min":1.228,"15min":1.228},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.98599999999999999,"15min":0.97499999999999998},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1020000000000001,"5min":7.9539999999999997,"15min":7.9539999999999997},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.94299999999999995,"15min":0.92600000000000005},"min":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4740000000000002,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":0.92800000000000005}]},{"osd":7,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1240000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.98599999999999999,"15min":1.012},"min":{"1min":0.65600000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.1559999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.069}]},{"osd":9,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.97499999999999998,"15min":1.0069999999999999},"min":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1399999999999999,"5min":1.391,"15min":1.391},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.0940000000000001,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.117,"5min":8.1799999999999997,"15min":8.1799999999999997},"last":1.038}]},{"osd":11,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.119,"5min":1.641,"15min":1.641},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.94099999999999995,"15min":0.93799999999999994},"min":{"1min":0.73799999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.0980000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.054}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":459496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.79600000000000004,"15min":0.83199999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0609999999999999,"5min":1.167,"15min":1.167},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1759999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":9.4990000000000006}]},{"osd":2,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":9.3900000000000006},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80100000000000005,"15min":0.82499999999999996},"min":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.88900000000000001}]},{"osd":3,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69299999999999995,"15min":0.71799999999999997},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.69699999999999995,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1080000000000001,"5min":1.153,"15min":1.153},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86599999999999999,"15min":0.90800000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.89000000000000001,"15min":0.93799999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.89600000000000002,"15min":0.94499999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.264,"5min":2.109,"15min":2.109},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.89400000000000002,"15min":0.93700000000000006},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1679999999999999,"5min":1.359,"15min":1.359},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.196,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89300000000000002,"15min":0.94699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.133,"5min":1.738,"15min":1.738},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.97199999999999998,"15min":1.024},"min":{"1min":0.63600000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.383,"5min":2.149,"15min":2.149},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.98699999999999999,"15min":1.0309999999999999},"min":{"1min":0.626,"5min":0.624,"15min":0.624},"max":{"1min":1.2290000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.97099999999999997}]},{"osd":8,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.99199999999999999,"15min":1.032},"min":{"1min":0.70599999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.284,"5min":1.778,"15min":1.778},"last":1.022},{"interface":"front","average":{"1min":0.879,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.335,"5min":1.698,"15min":1.698},"last":1.087}]},{"osd":10,"last update":"Fri Oct 6 23:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.0389999999999999},"min":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1240000000000001,"5min":1.417,"15min":1.417},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1,"15min":1.016},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.1799999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.98799999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037811,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":459041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.71599999999999997,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.435,"15min":0.435},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.024,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":1.272,"15min":1.272},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.96499999999999997,"5min":1.196,"15min":1.196},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.79000000000000004},"min":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.3799999999999999,"5min":3.3799999999999999,"15min":3.3799999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75,"15min":0.751},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.878},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.125,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.748},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.073,"5min":1.248,"15min":1.248},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98299999999999998,"5min":1.05,"15min":1.05},"last":0.96699999999999997}]},{"osd":6,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.67700000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1719999999999999,"5min":1.399,"15min":1.399},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88800000000000001,"15min":0.92000000000000004},"min":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.115,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.90800000000000003}]},{"osd":9,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.65900000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.94599999999999995,"15min":0.94999999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.94399999999999995}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.70099999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.145,"5min":1.304,"15min":1.304},"last":1.004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.88600000000000001,"15min":0.875},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.155,"5min":1.242,"15min":1.242},"last":0.995}]},{"osd":11,"last update":"Fri Oct 6 23:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.081}]}]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":1050932,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34599999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80700000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.434},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73799999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.502}]},{"osd":2,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69799999999999995,"15min":0.67600000000000005},"min":{"1min":0.502,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0389999999999999,"5min":1.04,"15min":1.04},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.51900000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76900000000000002,"15min":0.72499999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94999999999999996,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":1.149,"15min":1.149},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79300000000000004,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.47899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91200000000000003,"5min":1.103,"15min":1.103},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.877,"5min":1.244,"15min":1.244},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78800000000000003,"15min":0.77600000000000002},"min":{"1min":0.629,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0600000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90000000000000002}]},{"osd":6,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.92800000000000005,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.26,"15min":1.26},"last":0.60999999999999999}]},{"osd":8,"last update":"Fri Oct 6 23:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.61899999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.871,"15min":0.85399999999999998},"min":{"1min":0.70499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.97199999999999998}]},{"osd":9,"last update":"Fri Oct 6 23:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90300000000000002,"15min":0.90000000000000002},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.012,"5min":1.206,"15min":1.206},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.61299999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.147,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.86499999999999999}]},{"osd":10,"last update":"Fri Oct 6 23:11:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.93600000000000005,"15min":0.93200000000000005},"min":{"1min":0.68799999999999994,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.179,"5min":1.2,"15min":1.2},"last":1.018},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88600000000000001,"15min":0.88400000000000001},"min":{"1min":0.60199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.997}]},{"osd":11,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0329999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462973,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":458768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.48699999999999999,"15min":0.45100000000000001},"min":{"1min":0.35699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.52700000000000002,"15min":0.47999999999999998},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.69399999999999995},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.83799999999999997}]},{"osd":2,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.74199999999999999,"15min":0.70399999999999996},"min":{"1min":0.54000000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.66400000000000003,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.539,"5min":10.539,"15min":10.539},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.69099999999999995,"15min":0.63700000000000001},"min":{"1min":0.46500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78000000000000003,"15min":0.74299999999999999},"min":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.2839999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79500000000000004,"15min":0.77200000000000002},"min":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.8719999999999999,"5min":3.8719999999999999,"15min":3.8719999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79400000000000004,"15min":0.77600000000000002},"min":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5349999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.84599999999999997,"15min":0.80700000000000005},"min":{"1min":0.63600000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Oct 6 23:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.83899999999999997,"15min":0.81499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.133,"5min":3.915,"15min":3.915},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.876,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3979999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.92700000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.89000000000000001,"15min":0.85399999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.97799999999999998}]},{"osd":9,"last update":"Fri Oct 6 23:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.91600000000000004,"15min":0.91100000000000003},"min":{"1min":0.58399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.4820000000000002,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90700000000000003,"15min":0.89900000000000002},"min":{"1min":0.69599999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.71899999999999997}]},{"osd":10,"last update":"Fri Oct 6 23:11:59 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.046,"5min":1.018,"15min":1.014},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.998}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":460715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.38200000000000001,"15min":0.35599999999999998},"max":{"1min":1.1220000000000001,"5min":1.222,"15min":1.222},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.627,"15min":0.60399999999999998},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":1.0429999999999999,"5min":1.056,"15min":1.056},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Oct 6 23:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96799999999999997,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.032,"5min":1.198,"15min":1.198},"last":0.96499999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":1.282,"15min":1.282},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.436},"max":{"1min":0.83599999999999997,"5min":1.522,"15min":1.522},"last":0.502}]},{"osd":4,"last update":"Fri Oct 6 23:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":1.097,"15min":1.097},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.621,"15min":0.58199999999999996},"min":{"1min":0.47999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0780000000000001,"5min":2.02,"15min":2.02},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.74199999999999999,"15min":0.68000000000000005},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.04,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80300000000000005,"15min":0.72799999999999998},"min":{"1min":0.64100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1259999999999999,"5min":1.254,"15min":1.254},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.80200000000000005,"15min":0.76800000000000002},"min":{"1min":0.59999999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.119,"5min":1.385,"15min":1.385},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.60799999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.175,"5min":1.492,"15min":1.492},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.77100000000000002,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2050000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.94099999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.83399999999999996,"15min":0.80000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2410000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.78100000000000003,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3280000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.872}]},{"osd":9,"last update":"Fri Oct 6 23:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90400000000000003,"15min":0.88800000000000001},"min":{"1min":0.745,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1599999999999999,"5min":1.355,"15min":1.355},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85099999999999998,"15min":0.83299999999999996},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.048,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.70399999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91000000000000003,"15min":0.90000000000000002},"min":{"1min":0.623,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3600000000000001,"5min":1.706,"15min":1.706},"last":0.623},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92900000000000005,"15min":0.92100000000000004},"min":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0409999999999999}]},{"osd":11,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0629999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":460156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.61299999999999999},"min":{"1min":0.42599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.091,"15min":1.091},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.63600000000000001},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.63900000000000001},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95199999999999996,"5min":1.236,"15min":1.236},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.64000000000000001},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66700000000000004,"15min":0.63300000000000001},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98599999999999999,"5min":0.995,"15min":0.995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68500000000000005,"15min":0.64100000000000001},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.752}]},{"osd":5,"last update":"Fri Oct 6 23:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86099999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.746,"15min":0.70499999999999996},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66100000000000003,"15min":0.63600000000000001},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.002,"5min":1.085,"15min":1.085},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.59699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.81399999999999995,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70299999999999996}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.25,"5min":1.296,"15min":1.296},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.68400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.88700000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83299999999999996,"15min":0.83699999999999997},"min":{"1min":0.499,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0580000000000001,"5min":1.206,"15min":1.206},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.85599999999999998,"15min":0.88700000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.173,"5min":1.325,"15min":1.325},"last":0.875}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85999999999999999,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92500000000000004,"15min":0.92300000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.202,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.008}]},{"osd":11,"last update":"Fri Oct 6 23:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.73899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0720000000000001,"5min":1.724,"15min":1.724},"last":1.044},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.29,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.90100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":462490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.59399999999999997},"min":{"1min":0.40699999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.91900000000000004,"5min":1.0009999999999999,"15min":1.7949999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.65100000000000002,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66700000000000004,"15min":0.629},"min":{"1min":0.498,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.88900000000000001,"5min":1.012,"15min":1.4990000000000001},"last":0.752},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70899999999999996,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.41299999999999998},"max":{"1min":0.97699999999999998,"5min":1.2430000000000001,"15min":1.746},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67600000000000005,"15min":0.65400000000000003},"min":{"1min":0.39000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.75800000000000001,"15min":0.71099999999999997},"min":{"1min":0.56599999999999995,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri Oct 6 23:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95899999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.751,"15min":0.70099999999999996},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.022,"5min":1.169,"15min":1.169},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.78400000000000003,"15min":0.73799999999999999},"min":{"1min":0.59499999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0409999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.54400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75}]},{"osd":8,"last update":"Fri Oct 6 23:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.65500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0800000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82499999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0629999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.746}]},{"osd":9,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0920000000000001,"5min":1.155,"15min":1.155},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.81699999999999995}]},{"osd":10,"last update":"Fri Oct 6 23:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91900000000000004,"15min":0.93100000000000005},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.62},"max":{"1min":1.0620000000000001,"5min":1.333,"15min":1.333},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92900000000000005,"15min":0.94199999999999995},"min":{"1min":0.745,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.0920000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90100000000000002}]},{"osd":11,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.871}]}]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":458631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.40200000000000002},"min":{"1min":0.40699999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92700000000000005,"5min":1.03,"15min":1.03},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.47299999999999998,"15min":0.41699999999999998},"min":{"1min":0.38900000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.67800000000000005,"15min":0.63600000000000001},"min":{"1min":0.55400000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.79300000000000004,"15min":0.69899999999999995},"min":{"1min":0.57399999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":9.3989999999999991,"5min":9.3989999999999991,"15min":9.3989999999999991},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.71499999999999997,"15min":0.65900000000000003},"min":{"1min":0.47199999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.3769999999999998,"5min":4.3769999999999998,"15min":4.3769999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70699999999999996,"15min":0.67000000000000004},"min":{"1min":0.59699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.048,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Oct 6 23:12:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":0.80900000000000005,"15min":0.68899999999999995},"min":{"1min":0.57199999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":9.4399999999999995,"5min":9.4399999999999995,"15min":9.4399999999999995},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.68600000000000005},"min":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 23:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.85299999999999998,"15min":0.76000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0489999999999999,"5min":9.3379999999999992,"15min":9.3379999999999992},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.875,"15min":0.75700000000000001},"min":{"1min":0.58999999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":6.6289999999999996,"5min":6.6289999999999996,"15min":6.6289999999999996},"last":0.88700000000000001}]},{"osd":6,"last update":"Fri Oct 6 23:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.69099999999999995,"15min":0.626},"min":{"1min":0.51400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":5.3680000000000003,"5min":5.3680000000000003,"15min":5.3680000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.139,"5min":0.77900000000000003,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":11.281000000000001,"5min":11.281000000000001,"15min":11.281000000000001},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:12:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.96399999999999997,"15min":0.86899999999999999},"min":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.5970000000000004,"5min":9.4779999999999998,"15min":9.4779999999999998},"last":0.748},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.84899999999999998,"15min":0.81699999999999995},"min":{"1min":0.60599999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97799999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":0.75800000000000001}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.66900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.008,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0009999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.872,"15min":0.878},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.204,"5min":0.91700000000000004,"15min":0.86299999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.336,"5min":11.336,"15min":11.336},"last":0.62}]},{"osd":10,"last update":"Fri Oct 6 23:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.026,"15min":0.97799999999999998},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":9.516,"5min":9.516,"15min":9.516},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.083,"5min":0.998,"15min":0.98399999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.83899999999999997}]},{"osd":11,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":0.95199999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888137,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":459322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52100000000000002,"15min":0.47299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.53200000000000003,"15min":0.46999999999999997},"min":{"1min":0.42999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.439}]},{"osd":2,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.76100000000000001,"15min":0.68899999999999995},"min":{"1min":0.65900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0580000000000001,"5min":1.109,"15min":1.109},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.73199999999999998,"15min":0.70599999999999996},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70799999999999996,"15min":0.66100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.65300000000000002},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.014,"5min":1.141,"15min":1.141},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.73899999999999999,"15min":0.70099999999999996},"min":{"1min":0.61599999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98699999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.76900000000000002,"15min":0.71499999999999997},"min":{"1min":0.67000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79000000000000004,"15min":0.75800000000000001},"min":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0629999999999999,"5min":1.083,"15min":1.083},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.73199999999999998},"min":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0449999999999999,"5min":1.161,"15min":1.161},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 23:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.77700000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.67100000000000004}]},{"osd":8,"last update":"Fri Oct 6 23:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.90900000000000003,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0920000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.749}]},{"osd":9,"last update":"Fri Oct 6 23:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70099999999999996,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":0.96699999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.181,"5min":1.22,"15min":1.22},"last":0.83299999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.89000000000000001}]},{"osd":11,"last update":"Fri Oct 6 23:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.91400000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":1050616,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98699999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.69299999999999995,"15min":0.64900000000000002},"min":{"1min":0.60299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.97399999999999998,"5min":1.153,"15min":1.153},"last":0.749},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.66500000000000004,"15min":0.63200000000000001},"min":{"1min":0.52900000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.94399999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.627}]},{"osd":2,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.49299999999999999},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.504},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.51800000000000002},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.879,"15min":0.879},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.46999999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.499,"5min":0.441,"15min":0.441},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.93899999999999995}]},{"osd":4,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.59599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96799999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.747,"15min":0.69899999999999995},"min":{"1min":0.58799999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Oct 6 23:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.125},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.749,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.625,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.76500000000000001,"15min":0.71899999999999997},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.042,"5min":1.349,"15min":1.349},"last":0.81599999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.879,"5min":0.77700000000000002,"15min":0.75700000000000001},"min":{"1min":0.52500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.71899999999999997}]},{"osd":9,"last update":"Fri Oct 6 23:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0660000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81299999999999994},"min":{"1min":0.63400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Fri Oct 6 23:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.88200000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.85099999999999998,"15min":0.83899999999999997},"min":{"1min":0.61599999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.88}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T23:13:04.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T23:13:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.962+0000 7f99c99ff700 1 -- 172.21.15.8:0/2741702874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c4102a40 msgr2=0x7f99c4109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.962+0000 7f99c99ff700 1 --2- 172.21.15.8:0/2741702874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c4102a40 0x7f99c4109360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009f90 tx=0x7f99bc00b330 comp rx=0 tx=0).stop 2023-10-06T23:13:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.962+0000 7f99c99ff700 1 -- 172.21.15.8:0/2741702874 shutdown_connections 2023-10-06T23:13:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.962+0000 7f99c99ff700 1 --2- 172.21.15.8:0/2741702874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c4102a40 0x7f99c4109360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.962+0000 7f99c99ff700 1 --2- 172.21.15.8:0/2741702874 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c4100ea0 0x7f99c41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.962+0000 7f99c99ff700 1 --2- 172.21.15.8:0/2741702874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c4102080 0x7f99c4102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.962+0000 7f99c99ff700 1 -- 172.21.15.8:0/2741702874 >> 172.21.15.8:0/2741702874 conn(0x7f99c40fc420 msgr2=0x7f99c40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.963+0000 7f99c99ff700 1 -- 172.21.15.8:0/2741702874 shutdown_connections 2023-10-06T23:13:04.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.963+0000 7f99c99ff700 1 -- 172.21.15.8:0/2741702874 wait complete. 2023-10-06T23:13:04.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.963+0000 7f99c99ff700 1 Processor -- start 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c99ff700 1 -- start start 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c99ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c4100ea0 0x7f99c4198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c99ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c4102080 0x7f99c4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c99ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c4102a40 0x7f99c41a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c99ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c41a0990 con 0x7f99c4102a40 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c99ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c41a0ad0 con 0x7f99c4100ea0 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c99ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c41a0c60 con 0x7f99c4102080 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c4102a40 0x7f99c41a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c4102a40 0x7f99c41a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55642/0 (socket says 172.21.15.8:55642) 2023-10-06T23:13:04.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c37fe700 1 -- 172.21.15.8:0/392090435 learned_addr learned my addr 172.21.15.8:0/392090435 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.964+0000 7f99c2ffd700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c4100ea0 0x7f99c4198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c27fc700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c4102080 0x7f99c4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c37fe700 1 -- 172.21.15.8:0/392090435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c4102080 msgr2=0x7f99c4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c37fe700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c4102080 0x7f99c4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c37fe700 1 -- 172.21.15.8:0/392090435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c4100ea0 msgr2=0x7f99c4198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c37fe700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c4100ea0 0x7f99c4198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c37fe700 1 -- 172.21.15.8:0/392090435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80095f0 con 0x7f99c4102a40 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c37fe700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c4102a40 0x7f99c41a03c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f99bc007890 tx=0x7f99bc008c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c89fd700 1 -- 172.21.15.8:0/392090435 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00e040 con 0x7f99c4102a40 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc009c40 con 0x7f99c4102a40 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c89fd700 1 -- 172.21.15.8:0/392090435 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99bc00be00 con 0x7f99c4102a40 2023-10-06T23:13:04.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.965+0000 7f99c89fd700 1 -- 172.21.15.8:0/392090435 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0052a0 con 0x7f99c4102a40 2023-10-06T23:13:04.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.966+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c41a11d0 con 0x7f99c4102a40 2023-10-06T23:13:04.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.966+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c4193400 con 0x7f99c4102a40 2023-10-06T23:13:04.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.968+0000 7f99c89fd700 1 -- 172.21.15.8:0/392090435 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f99bc01d470 con 0x7f99c4102a40 2023-10-06T23:13:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.970+0000 7f99c89fd700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99ac0a14d0 0x7f99ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.970+0000 7f99c89fd700 1 -- 172.21.15.8:0/392090435 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f99bc0ce200 con 0x7f99c4102a40 2023-10-06T23:13:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.970+0000 7f99c2ffd700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99ac0a14d0 0x7f99ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.971+0000 7f99c2ffd700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99ac0a14d0 0x7f99ac0a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f99c4101bf0 tx=0x7f99b4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:04.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:04.974+0000 7f99c89fd700 1 -- 172.21.15.8:0/392090435 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99bc0978a0 con 0x7f99c4102a40 2023-10-06T23:13:05.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.181+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99c402d270 con 0x7f99ac0a14d0 2023-10-06T23:13:05.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.193+0000 7f99c89fd700 1 -- 172.21.15.8:0/392090435 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342711 (secure 0 0 0) 0x7f99c402d270 con 0x7f99ac0a14d0 2023-10-06T23:13:05.198 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:05.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99ac0a14d0 msgr2=0x7f99ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99ac0a14d0 0x7f99ac0a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f99c4101bf0 tx=0x7f99b4009260 comp rx=0 tx=0).stop 2023-10-06T23:13:05.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c4102a40 msgr2=0x7f99c41a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c4102a40 0x7f99c41a03c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f99bc007890 tx=0x7f99bc008c80 comp rx=0 tx=0).stop 2023-10-06T23:13:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 shutdown_connections 2023-10-06T23:13:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99ac0a14d0 0x7f99ac0a3990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99c4102a40 0x7f99c41a03c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c4100ea0 0x7f99c4198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 --2- 172.21.15.8:0/392090435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99c4102080 0x7f99c4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 >> 172.21.15.8:0/392090435 conn(0x7f99c40fc420 msgr2=0x7f99c4107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.197+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 shutdown_connections 2023-10-06T23:13:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.198+0000 7f99c99ff700 1 -- 172.21.15.8:0/392090435 wait complete. 2023-10-06T23:13:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T23:13:05.218 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2023-10-06T23:13:04.969193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596440,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":738,"num_read_kb":425,"num_write":310,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180780,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335700,"kb_used_data":11456,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606124,"statfs":{"total":1151940427776,"available":1151596670976,"internally_reserved":0,"allocated":11730944,"data_stored":7291707,"data_compressed":107433,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":850,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002987"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030740+0000","last_change":"2023-10-06T23:11:18.264036+0000","last_active":"2023-10-06T23:11:49.030740+0000","last_peered":"2023-10-06T23:11:49.030740+0000","last_clean":"2023-10-06T23:11:49.030740+0000","last_became_active":"2023-10-06T23:11:18.261784+0000","last_became_peered":"2023-10-06T23:11:18.261784+0000","last_unstale":"2023-10-06T23:11:49.030740+0000","last_undegraded":"2023-10-06T23:11:49.030740+0000","last_fullsized":"2023-10-06T23:11:49.030740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:57.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026996+0000","last_change":"2023-10-06T23:11:18.265181+0000","last_active":"2023-10-06T23:11:49.026996+0000","last_peered":"2023-10-06T23:11:49.026996+0000","last_clean":"2023-10-06T23:11:49.026996+0000","last_became_active":"2023-10-06T23:11:18.264881+0000","last_became_peered":"2023-10-06T23:11:18.264881+0000","last_unstale":"2023-10-06T23:11:49.026996+0000","last_undegraded":"2023-10-06T23:11:49.026996+0000","last_fullsized":"2023-10-06T23:11:49.026996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:17.852643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026807+0000","last_change":"2023-10-06T23:11:18.264321+0000","last_active":"2023-10-06T23:11:49.026807+0000","last_peered":"2023-10-06T23:11:49.026807+0000","last_clean":"2023-10-06T23:11:49.026807+0000","last_became_active":"2023-10-06T23:11:18.263997+0000","last_became_peered":"2023-10-06T23:11:18.263997+0000","last_unstale":"2023-10-06T23:11:49.026807+0000","last_undegraded":"2023-10-06T23:11:49.026807+0000","last_fullsized":"2023-10-06T23:11:49.026807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:41.888419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030300+0000","last_change":"2023-10-06T23:11:18.270871+0000","last_active":"2023-10-06T23:11:49.030300+0000","last_peered":"2023-10-06T23:11:49.030300+0000","last_clean":"2023-10-06T23:11:49.030300+0000","last_became_active":"2023-10-06T23:11:18.270288+0000","last_became_peered":"2023-10-06T23:11:18.270288+0000","last_unstale":"2023-10-06T23:11:49.030300+0000","last_undegraded":"2023-10-06T23:11:49.030300+0000","last_fullsized":"2023-10-06T23:11:49.030300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:02:48.819640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032624+0000","last_change":"2023-10-06T23:11:18.261001+0000","last_active":"2023-10-06T23:11:49.032624+0000","last_peered":"2023-10-06T23:11:49.032624+0000","last_clean":"2023-10-06T23:11:49.032624+0000","last_became_active":"2023-10-06T23:11:18.260661+0000","last_became_peered":"2023-10-06T23:11:18.260661+0000","last_unstale":"2023-10-06T23:11:49.032624+0000","last_undegraded":"2023-10-06T23:11:49.032624+0000","last_fullsized":"2023-10-06T23:11:49.032624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:42.382235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.036376+0000","last_change":"2023-10-06T23:11:50.036376+0000","last_active":"2023-10-06T23:11:50.036376+0000","last_peered":"2023-10-06T23:11:50.036376+0000","last_clean":"2023-10-06T23:11:50.036376+0000","last_became_active":"2023-10-06T23:11:50.035945+0000","last_became_peered":"2023-10-06T23:11:50.035945+0000","last_unstale":"2023-10-06T23:11:50.036376+0000","last_undegraded":"2023-10-06T23:11:50.036376+0000","last_fullsized":"2023-10-06T23:11:50.036376+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:50:33.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036114+0000","last_change":"2023-10-06T23:11:18.263968+0000","last_active":"2023-10-06T23:11:49.036114+0000","last_peered":"2023-10-06T23:11:49.036114+0000","last_clean":"2023-10-06T23:11:49.036114+0000","last_became_active":"2023-10-06T23:11:18.263634+0000","last_became_peered":"2023-10-06T23:11:18.263634+0000","last_unstale":"2023-10-06T23:11:49.036114+0000","last_undegraded":"2023-10-06T23:11:49.036114+0000","last_fullsized":"2023-10-06T23:11:49.036114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:18:23.856232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035537+0000","last_change":"2023-10-06T23:11:18.268945+0000","last_active":"2023-10-06T23:11:49.035537+0000","last_peered":"2023-10-06T23:11:49.035537+0000","last_clean":"2023-10-06T23:11:49.035537+0000","last_became_active":"2023-10-06T23:11:18.268598+0000","last_became_peered":"2023-10-06T23:11:18.268598+0000","last_unstale":"2023-10-06T23:11:49.035537+0000","last_undegraded":"2023-10-06T23:11:49.035537+0000","last_fullsized":"2023-10-06T23:11:49.035537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:09:21.238230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042773+0000","last_change":"2023-10-06T23:11:18.261872+0000","last_active":"2023-10-06T23:11:49.042773+0000","last_peered":"2023-10-06T23:11:49.042773+0000","last_clean":"2023-10-06T23:11:49.042773+0000","last_became_active":"2023-10-06T23:11:18.261583+0000","last_became_peered":"2023-10-06T23:11:18.261583+0000","last_unstale":"2023-10-06T23:11:49.042773+0000","last_undegraded":"2023-10-06T23:11:49.042773+0000","last_fullsized":"2023-10-06T23:11:49.042773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:50:54.145738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039796+0000","last_change":"2023-10-06T23:11:50.039796+0000","last_active":"2023-10-06T23:11:50.039796+0000","last_peered":"2023-10-06T23:11:50.039796+0000","last_clean":"2023-10-06T23:11:50.039796+0000","last_became_active":"2023-10-06T23:11:50.039420+0000","last_became_peered":"2023-10-06T23:11:50.039420+0000","last_unstale":"2023-10-06T23:11:50.039796+0000","last_undegraded":"2023-10-06T23:11:50.039796+0000","last_fullsized":"2023-10-06T23:11:50.039796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:28.641948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036360+0000","last_change":"2023-10-06T23:11:18.266565+0000","last_active":"2023-10-06T23:11:49.036360+0000","last_peered":"2023-10-06T23:11:49.036360+0000","last_clean":"2023-10-06T23:11:49.036360+0000","last_became_active":"2023-10-06T23:11:18.266290+0000","last_became_peered":"2023-10-06T23:11:18.266290+0000","last_unstale":"2023-10-06T23:11:49.036360+0000","last_undegraded":"2023-10-06T23:11:49.036360+0000","last_fullsized":"2023-10-06T23:11:49.036360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:45:07.828100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030127+0000","last_change":"2023-10-06T23:11:18.266849+0000","last_active":"2023-10-06T23:11:49.030127+0000","last_peered":"2023-10-06T23:11:49.030127+0000","last_clean":"2023-10-06T23:11:49.030127+0000","last_became_active":"2023-10-06T23:11:18.266517+0000","last_became_peered":"2023-10-06T23:11:18.266517+0000","last_unstale":"2023-10-06T23:11:49.030127+0000","last_undegraded":"2023-10-06T23:11:49.030127+0000","last_fullsized":"2023-10-06T23:11:49.030127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:25:31.988065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031565+0000","last_change":"2023-10-06T23:11:18.270336+0000","last_active":"2023-10-06T23:11:49.031565+0000","last_peered":"2023-10-06T23:11:49.031565+0000","last_clean":"2023-10-06T23:11:49.031565+0000","last_became_active":"2023-10-06T23:11:18.269969+0000","last_became_peered":"2023-10-06T23:11:18.269969+0000","last_unstale":"2023-10-06T23:11:49.031565+0000","last_undegraded":"2023-10-06T23:11:49.031565+0000","last_fullsized":"2023-10-06T23:11:49.031565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:25.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026121+0000","last_change":"2023-10-06T23:11:18.264549+0000","last_active":"2023-10-06T23:11:49.026121+0000","last_peered":"2023-10-06T23:11:49.026121+0000","last_clean":"2023-10-06T23:11:49.026121+0000","last_became_active":"2023-10-06T23:11:18.263446+0000","last_became_peered":"2023-10-06T23:11:18.263446+0000","last_unstale":"2023-10-06T23:11:49.026121+0000","last_undegraded":"2023-10-06T23:11:49.026121+0000","last_fullsized":"2023-10-06T23:11:49.026121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:21:57.009374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026364+0000","last_change":"2023-10-06T23:11:18.262470+0000","last_active":"2023-10-06T23:11:49.026364+0000","last_peered":"2023-10-06T23:11:49.026364+0000","last_clean":"2023-10-06T23:11:49.026364+0000","last_became_active":"2023-10-06T23:11:18.262134+0000","last_became_peered":"2023-10-06T23:11:18.262134+0000","last_unstale":"2023-10-06T23:11:49.026364+0000","last_undegraded":"2023-10-06T23:11:49.026364+0000","last_fullsized":"2023-10-06T23:11:49.026364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:09:26.745107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042326+0000","last_change":"2023-10-06T23:11:18.260657+0000","last_active":"2023-10-06T23:11:49.042326+0000","last_peered":"2023-10-06T23:11:49.042326+0000","last_clean":"2023-10-06T23:11:49.042326+0000","last_became_active":"2023-10-06T23:11:18.260343+0000","last_became_peered":"2023-10-06T23:11:18.260343+0000","last_unstale":"2023-10-06T23:11:49.042326+0000","last_undegraded":"2023-10-06T23:11:49.042326+0000","last_fullsized":"2023-10-06T23:11:49.042326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:46:24.199333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030882+0000","last_change":"2023-10-06T23:11:18.262071+0000","last_active":"2023-10-06T23:11:49.030882+0000","last_peered":"2023-10-06T23:11:49.030882+0000","last_clean":"2023-10-06T23:11:49.030882+0000","last_became_active":"2023-10-06T23:11:18.261348+0000","last_became_peered":"2023-10-06T23:11:18.261348+0000","last_unstale":"2023-10-06T23:11:49.030882+0000","last_undegraded":"2023-10-06T23:11:49.030882+0000","last_fullsized":"2023-10-06T23:11:49.030882+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:57:54.957156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033065+0000","last_change":"2023-10-06T23:11:18.266593+0000","last_active":"2023-10-06T23:11:49.033065+0000","last_peered":"2023-10-06T23:11:49.033065+0000","last_clean":"2023-10-06T23:11:49.033065+0000","last_became_active":"2023-10-06T23:11:18.266293+0000","last_became_peered":"2023-10-06T23:11:18.266293+0000","last_unstale":"2023-10-06T23:11:49.033065+0000","last_undegraded":"2023-10-06T23:11:49.033065+0000","last_fullsized":"2023-10-06T23:11:49.033065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:03:45.130437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037218+0000","last_change":"2023-10-06T23:11:18.264871+0000","last_active":"2023-10-06T23:11:49.037218+0000","last_peered":"2023-10-06T23:11:49.037218+0000","last_clean":"2023-10-06T23:11:49.037218+0000","last_became_active":"2023-10-06T23:11:18.264451+0000","last_became_peered":"2023-10-06T23:11:18.264451+0000","last_unstale":"2023-10-06T23:11:49.037218+0000","last_undegraded":"2023-10-06T23:11:49.037218+0000","last_fullsized":"2023-10-06T23:11:49.037218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:40:00.581508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033336+0000","last_change":"2023-10-06T23:11:17.255867+0000","last_active":"2023-10-06T23:11:49.033336+0000","last_peered":"2023-10-06T23:11:49.033336+0000","last_clean":"2023-10-06T23:11:49.033336+0000","last_became_active":"2023-10-06T23:11:17.255463+0000","last_became_peered":"2023-10-06T23:11:17.255463+0000","last_unstale":"2023-10-06T23:11:49.033336+0000","last_undegraded":"2023-10-06T23:11:49.033336+0000","last_fullsized":"2023-10-06T23:11:49.033336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:21:29.493049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037811+0000","last_change":"2023-10-06T23:11:18.262575+0000","last_active":"2023-10-06T23:11:49.037811+0000","last_peered":"2023-10-06T23:11:49.037811+0000","last_clean":"2023-10-06T23:11:49.037811+0000","last_became_active":"2023-10-06T23:11:18.262266+0000","last_became_peered":"2023-10-06T23:11:18.262266+0000","last_unstale":"2023-10-06T23:11:49.037811+0000","last_undegraded":"2023-10-06T23:11:49.037811+0000","last_fullsized":"2023-10-06T23:11:49.037811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:37:10.870786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037989+0000","last_change":"2023-10-06T23:11:17.259061+0000","last_active":"2023-10-06T23:11:49.037989+0000","last_peered":"2023-10-06T23:11:49.037989+0000","last_clean":"2023-10-06T23:11:49.037989+0000","last_became_active":"2023-10-06T23:11:17.258624+0000","last_became_peered":"2023-10-06T23:11:17.258624+0000","last_unstale":"2023-10-06T23:11:49.037989+0000","last_undegraded":"2023-10-06T23:11:49.037989+0000","last_fullsized":"2023-10-06T23:11:49.037989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:28.121405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027230+0000","last_change":"2023-10-06T23:11:18.263840+0000","last_active":"2023-10-06T23:11:49.027230+0000","last_peered":"2023-10-06T23:11:49.027230+0000","last_clean":"2023-10-06T23:11:49.027230+0000","last_became_active":"2023-10-06T23:11:18.263454+0000","last_became_peered":"2023-10-06T23:11:18.263454+0000","last_unstale":"2023-10-06T23:11:49.027230+0000","last_undegraded":"2023-10-06T23:11:49.027230+0000","last_fullsized":"2023-10-06T23:11:49.027230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:49.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.044245+0000","last_change":"2023-10-06T23:11:50.044245+0000","last_active":"2023-10-06T23:11:50.044245+0000","last_peered":"2023-10-06T23:11:50.044245+0000","last_clean":"2023-10-06T23:11:50.044245+0000","last_became_active":"2023-10-06T23:11:50.038493+0000","last_became_peered":"2023-10-06T23:11:50.038493+0000","last_unstale":"2023-10-06T23:11:50.044245+0000","last_undegraded":"2023-10-06T23:11:50.044245+0000","last_fullsized":"2023-10-06T23:11:50.044245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:19.463617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042312+0000","last_change":"2023-10-06T23:11:18.274068+0000","last_active":"2023-10-06T23:11:49.042312+0000","last_peered":"2023-10-06T23:11:49.042312+0000","last_clean":"2023-10-06T23:11:49.042312+0000","last_became_active":"2023-10-06T23:11:18.273692+0000","last_became_peered":"2023-10-06T23:11:18.273692+0000","last_unstale":"2023-10-06T23:11:49.042312+0000","last_undegraded":"2023-10-06T23:11:49.042312+0000","last_fullsized":"2023-10-06T23:11:49.042312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:57:07.735915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032982+0000","last_change":"2023-10-06T23:11:17.260046+0000","last_active":"2023-10-06T23:11:49.032982+0000","last_peered":"2023-10-06T23:11:49.032982+0000","last_clean":"2023-10-06T23:11:49.032982+0000","last_became_active":"2023-10-06T23:11:17.259638+0000","last_became_peered":"2023-10-06T23:11:17.259638+0000","last_unstale":"2023-10-06T23:11:49.032982+0000","last_undegraded":"2023-10-06T23:11:49.032982+0000","last_fullsized":"2023-10-06T23:11:49.032982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:21.660072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035736+0000","last_change":"2023-10-06T23:11:18.264328+0000","last_active":"2023-10-06T23:11:49.035736+0000","last_peered":"2023-10-06T23:11:49.035736+0000","last_clean":"2023-10-06T23:11:49.035736+0000","last_became_active":"2023-10-06T23:11:18.263554+0000","last_became_peered":"2023-10-06T23:11:18.263554+0000","last_unstale":"2023-10-06T23:11:49.035736+0000","last_undegraded":"2023-10-06T23:11:49.035736+0000","last_fullsized":"2023-10-06T23:11:49.035736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:44:02.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:13:00.412755+0000","last_change":"2023-10-06T23:11:17.265538+0000","last_active":"2023-10-06T23:13:00.412755+0000","last_peered":"2023-10-06T23:13:00.412755+0000","last_clean":"2023-10-06T23:13:00.412755+0000","last_became_active":"2023-10-06T23:11:17.265044+0000","last_became_peered":"2023-10-06T23:11:17.265044+0000","last_unstale":"2023-10-06T23:13:00.412755+0000","last_undegraded":"2023-10-06T23:13:00.412755+0000","last_fullsized":"2023-10-06T23:13:00.412755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:51.220961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1047,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032801+0000","last_change":"2023-10-06T23:11:18.257044+0000","last_active":"2023-10-06T23:11:49.032801+0000","last_peered":"2023-10-06T23:11:49.032801+0000","last_clean":"2023-10-06T23:11:49.032801+0000","last_became_active":"2023-10-06T23:11:18.256711+0000","last_became_peered":"2023-10-06T23:11:18.256711+0000","last_unstale":"2023-10-06T23:11:49.032801+0000","last_undegraded":"2023-10-06T23:11:49.032801+0000","last_fullsized":"2023-10-06T23:11:49.032801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:40:25.441143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032501+0000","last_change":"2023-10-06T23:11:17.262062+0000","last_active":"2023-10-06T23:11:49.032501+0000","last_peered":"2023-10-06T23:11:49.032501+0000","last_clean":"2023-10-06T23:11:49.032501+0000","last_became_active":"2023-10-06T23:11:17.261618+0000","last_became_peered":"2023-10-06T23:11:17.261618+0000","last_unstale":"2023-10-06T23:11:49.032501+0000","last_undegraded":"2023-10-06T23:11:49.032501+0000","last_fullsized":"2023-10-06T23:11:49.032501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:59:33.544470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034757+0000","last_change":"2023-10-06T23:11:18.263242+0000","last_active":"2023-10-06T23:11:49.034757+0000","last_peered":"2023-10-06T23:11:49.034757+0000","last_clean":"2023-10-06T23:11:49.034757+0000","last_became_active":"2023-10-06T23:11:18.262684+0000","last_became_peered":"2023-10-06T23:11:18.262684+0000","last_unstale":"2023-10-06T23:11:49.034757+0000","last_undegraded":"2023-10-06T23:11:49.034757+0000","last_fullsized":"2023-10-06T23:11:49.034757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:30:04.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032315+0000","last_change":"2023-10-06T23:11:17.254042+0000","last_active":"2023-10-06T23:11:49.032315+0000","last_peered":"2023-10-06T23:11:49.032315+0000","last_clean":"2023-10-06T23:11:49.032315+0000","last_became_active":"2023-10-06T23:11:17.253704+0000","last_became_peered":"2023-10-06T23:11:17.253704+0000","last_unstale":"2023-10-06T23:11:49.032315+0000","last_undegraded":"2023-10-06T23:11:49.032315+0000","last_fullsized":"2023-10-06T23:11:49.032315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:44.179814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035458+0000","last_change":"2023-10-06T23:11:18.259161+0000","last_active":"2023-10-06T23:11:49.035458+0000","last_peered":"2023-10-06T23:11:49.035458+0000","last_clean":"2023-10-06T23:11:49.035458+0000","last_became_active":"2023-10-06T23:11:18.258747+0000","last_became_peered":"2023-10-06T23:11:18.258747+0000","last_unstale":"2023-10-06T23:11:49.035458+0000","last_undegraded":"2023-10-06T23:11:49.035458+0000","last_fullsized":"2023-10-06T23:11:49.035458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:55:38.340988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034650+0000","last_change":"2023-10-06T23:11:17.266278+0000","last_active":"2023-10-06T23:11:49.034650+0000","last_peered":"2023-10-06T23:11:49.034650+0000","last_clean":"2023-10-06T23:11:49.034650+0000","last_became_active":"2023-10-06T23:11:17.265174+0000","last_became_peered":"2023-10-06T23:11:17.265174+0000","last_unstale":"2023-10-06T23:11:49.034650+0000","last_undegraded":"2023-10-06T23:11:49.034650+0000","last_fullsized":"2023-10-06T23:11:49.034650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:51.203566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032078+0000","last_change":"2023-10-06T23:11:18.259699+0000","last_active":"2023-10-06T23:11:49.032078+0000","last_peered":"2023-10-06T23:11:49.032078+0000","last_clean":"2023-10-06T23:11:49.032078+0000","last_became_active":"2023-10-06T23:11:18.259395+0000","last_became_peered":"2023-10-06T23:11:18.259395+0000","last_unstale":"2023-10-06T23:11:49.032078+0000","last_undegraded":"2023-10-06T23:11:49.032078+0000","last_fullsized":"2023-10-06T23:11:49.032078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:32:37.830092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":117,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:58.407910+0000","last_change":"2023-10-06T23:11:17.259592+0000","last_active":"2023-10-06T23:12:58.407910+0000","last_peered":"2023-10-06T23:12:58.407910+0000","last_clean":"2023-10-06T23:12:58.407910+0000","last_became_active":"2023-10-06T23:11:17.259254+0000","last_became_peered":"2023-10-06T23:11:17.259254+0000","last_unstale":"2023-10-06T23:12:58.407910+0000","last_undegraded":"2023-10-06T23:12:58.407910+0000","last_fullsized":"2023-10-06T23:12:58.407910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:31.633620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042667+0000","last_change":"2023-10-06T23:11:18.271568+0000","last_active":"2023-10-06T23:11:49.042667+0000","last_peered":"2023-10-06T23:11:49.042667+0000","last_clean":"2023-10-06T23:11:49.042667+0000","last_became_active":"2023-10-06T23:11:18.271248+0000","last_became_peered":"2023-10-06T23:11:18.271248+0000","last_unstale":"2023-10-06T23:11:49.042667+0000","last_undegraded":"2023-10-06T23:11:49.042667+0000","last_fullsized":"2023-10-06T23:11:49.042667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:30.138803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036265+0000","last_change":"2023-10-06T23:11:17.257823+0000","last_active":"2023-10-06T23:11:49.036265+0000","last_peered":"2023-10-06T23:11:49.036265+0000","last_clean":"2023-10-06T23:11:49.036265+0000","last_became_active":"2023-10-06T23:11:17.257426+0000","last_became_peered":"2023-10-06T23:11:17.257426+0000","last_unstale":"2023-10-06T23:11:49.036265+0000","last_undegraded":"2023-10-06T23:11:49.036265+0000","last_fullsized":"2023-10-06T23:11:49.036265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:27:17.158360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027188+0000","last_change":"2023-10-06T23:11:18.260555+0000","last_active":"2023-10-06T23:11:49.027188+0000","last_peered":"2023-10-06T23:11:49.027188+0000","last_clean":"2023-10-06T23:11:49.027188+0000","last_became_active":"2023-10-06T23:11:18.260236+0000","last_became_peered":"2023-10-06T23:11:18.260236+0000","last_unstale":"2023-10-06T23:11:49.027188+0000","last_undegraded":"2023-10-06T23:11:49.027188+0000","last_fullsized":"2023-10-06T23:11:49.027188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:51.499668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035946+0000","last_change":"2023-10-06T23:11:17.267686+0000","last_active":"2023-10-06T23:11:49.035946+0000","last_peered":"2023-10-06T23:11:49.035946+0000","last_clean":"2023-10-06T23:11:49.035946+0000","last_became_active":"2023-10-06T23:11:17.267322+0000","last_became_peered":"2023-10-06T23:11:17.267322+0000","last_unstale":"2023-10-06T23:11:49.035946+0000","last_undegraded":"2023-10-06T23:11:49.035946+0000","last_fullsized":"2023-10-06T23:11:49.035946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:48:40.755898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042418+0000","last_change":"2023-10-06T23:11:18.257382+0000","last_active":"2023-10-06T23:11:49.042418+0000","last_peered":"2023-10-06T23:11:49.042418+0000","last_clean":"2023-10-06T23:11:49.042418+0000","last_became_active":"2023-10-06T23:11:18.256572+0000","last_became_peered":"2023-10-06T23:11:18.256572+0000","last_unstale":"2023-10-06T23:11:49.042418+0000","last_undegraded":"2023-10-06T23:11:49.042418+0000","last_fullsized":"2023-10-06T23:11:49.042418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:43.631813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'10","reported_seq":223,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:13:00.095849+0000","last_change":"2023-10-06T23:11:17.257340+0000","last_active":"2023-10-06T23:13:00.095849+0000","last_peered":"2023-10-06T23:13:00.095849+0000","last_clean":"2023-10-06T23:13:00.095849+0000","last_became_active":"2023-10-06T23:11:17.256973+0000","last_became_peered":"2023-10-06T23:11:17.256973+0000","last_unstale":"2023-10-06T23:13:00.095849+0000","last_undegraded":"2023-10-06T23:13:00.095849+0000","last_fullsized":"2023-10-06T23:13:00.095849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:35.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":100,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033409+0000","last_change":"2023-10-06T23:11:18.258928+0000","last_active":"2023-10-06T23:11:49.033409+0000","last_peered":"2023-10-06T23:11:49.033409+0000","last_clean":"2023-10-06T23:11:49.033409+0000","last_became_active":"2023-10-06T23:11:18.258572+0000","last_became_peered":"2023-10-06T23:11:18.258572+0000","last_unstale":"2023-10-06T23:11:49.033409+0000","last_undegraded":"2023-10-06T23:11:49.033409+0000","last_fullsized":"2023-10-06T23:11:49.033409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:51.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037051+0000","last_change":"2023-10-06T23:11:17.260955+0000","last_active":"2023-10-06T23:11:49.037051+0000","last_peered":"2023-10-06T23:11:49.037051+0000","last_clean":"2023-10-06T23:11:49.037051+0000","last_became_active":"2023-10-06T23:11:17.260565+0000","last_became_peered":"2023-10-06T23:11:17.260565+0000","last_unstale":"2023-10-06T23:11:49.037051+0000","last_undegraded":"2023-10-06T23:11:49.037051+0000","last_fullsized":"2023-10-06T23:11:49.037051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:14:51.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031110+0000","last_change":"2023-10-06T23:11:18.266857+0000","last_active":"2023-10-06T23:11:49.031110+0000","last_peered":"2023-10-06T23:11:49.031110+0000","last_clean":"2023-10-06T23:11:49.031110+0000","last_became_active":"2023-10-06T23:11:18.266476+0000","last_became_peered":"2023-10-06T23:11:18.266476+0000","last_unstale":"2023-10-06T23:11:49.031110+0000","last_undegraded":"2023-10-06T23:11:49.031110+0000","last_fullsized":"2023-10-06T23:11:49.031110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:26.131492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035426+0000","last_change":"2023-10-06T23:11:17.265672+0000","last_active":"2023-10-06T23:11:49.035426+0000","last_peered":"2023-10-06T23:11:49.035426+0000","last_clean":"2023-10-06T23:11:49.035426+0000","last_became_active":"2023-10-06T23:11:17.265329+0000","last_became_peered":"2023-10-06T23:11:17.265329+0000","last_unstale":"2023-10-06T23:11:49.035426+0000","last_undegraded":"2023-10-06T23:11:49.035426+0000","last_fullsized":"2023-10-06T23:11:49.035426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:43.159919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036115+0000","last_change":"2023-10-06T23:11:18.269427+0000","last_active":"2023-10-06T23:11:49.036115+0000","last_peered":"2023-10-06T23:11:49.036115+0000","last_clean":"2023-10-06T23:11:49.036115+0000","last_became_active":"2023-10-06T23:11:18.269115+0000","last_became_peered":"2023-10-06T23:11:18.269115+0000","last_unstale":"2023-10-06T23:11:49.036115+0000","last_undegraded":"2023-10-06T23:11:49.036115+0000","last_fullsized":"2023-10-06T23:11:49.036115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:12.598526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:59.407905+0000","last_change":"2023-10-06T23:11:17.252599+0000","last_active":"2023-10-06T23:12:59.407905+0000","last_peered":"2023-10-06T23:12:59.407905+0000","last_clean":"2023-10-06T23:12:59.407905+0000","last_became_active":"2023-10-06T23:11:17.251893+0000","last_became_peered":"2023-10-06T23:11:17.251893+0000","last_unstale":"2023-10-06T23:12:59.407905+0000","last_undegraded":"2023-10-06T23:12:59.407905+0000","last_fullsized":"2023-10-06T23:12:59.407905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:24:10.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035840+0000","last_change":"2023-10-06T23:11:18.269026+0000","last_active":"2023-10-06T23:11:49.035840+0000","last_peered":"2023-10-06T23:11:49.035840+0000","last_clean":"2023-10-06T23:11:49.035840+0000","last_became_active":"2023-10-06T23:11:18.268701+0000","last_became_peered":"2023-10-06T23:11:18.268701+0000","last_unstale":"2023-10-06T23:11:49.035840+0000","last_undegraded":"2023-10-06T23:11:49.035840+0000","last_fullsized":"2023-10-06T23:11:49.035840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:03:25.903664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032636+0000","last_change":"2023-10-06T23:11:17.255323+0000","last_active":"2023-10-06T23:11:49.032636+0000","last_peered":"2023-10-06T23:11:49.032636+0000","last_clean":"2023-10-06T23:11:49.032636+0000","last_became_active":"2023-10-06T23:11:17.254975+0000","last_became_peered":"2023-10-06T23:11:17.254975+0000","last_unstale":"2023-10-06T23:11:49.032636+0000","last_undegraded":"2023-10-06T23:11:49.032636+0000","last_fullsized":"2023-10-06T23:11:49.032636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:41:35.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035228+0000","last_change":"2023-10-06T23:11:18.263290+0000","last_active":"2023-10-06T23:11:49.035228+0000","last_peered":"2023-10-06T23:11:49.035228+0000","last_clean":"2023-10-06T23:11:49.035228+0000","last_became_active":"2023-10-06T23:11:18.262680+0000","last_became_peered":"2023-10-06T23:11:18.262680+0000","last_unstale":"2023-10-06T23:11:49.035228+0000","last_undegraded":"2023-10-06T23:11:49.035228+0000","last_fullsized":"2023-10-06T23:11:49.035228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:43:12.249803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.048876+0000","last_change":"2023-10-06T23:11:50.048453+0000","last_active":"2023-10-06T23:11:50.048876+0000","last_peered":"2023-10-06T23:11:50.048876+0000","last_clean":"2023-10-06T23:11:50.048876+0000","last_became_active":"2023-10-06T23:11:50.035200+0000","last_became_peered":"2023-10-06T23:11:50.035200+0000","last_unstale":"2023-10-06T23:11:50.048876+0000","last_undegraded":"2023-10-06T23:11:50.048876+0000","last_fullsized":"2023-10-06T23:11:50.048876+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:31:21.791916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.032715+0000","last_change":"2023-10-06T23:11:50.032715+0000","last_active":"2023-10-06T23:11:50.032715+0000","last_peered":"2023-10-06T23:11:50.032715+0000","last_clean":"2023-10-06T23:11:50.032715+0000","last_became_active":"2023-10-06T23:11:50.032326+0000","last_became_peered":"2023-10-06T23:11:50.032326+0000","last_unstale":"2023-10-06T23:11:50.032715+0000","last_undegraded":"2023-10-06T23:11:50.032715+0000","last_fullsized":"2023-10-06T23:11:50.032715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:26:25.453692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032907+0000","last_change":"2023-10-06T23:11:17.258175+0000","last_active":"2023-10-06T23:11:49.032907+0000","last_peered":"2023-10-06T23:11:49.032907+0000","last_clean":"2023-10-06T23:11:49.032907+0000","last_became_active":"2023-10-06T23:11:17.257780+0000","last_became_peered":"2023-10-06T23:11:17.257780+0000","last_unstale":"2023-10-06T23:11:49.032907+0000","last_undegraded":"2023-10-06T23:11:49.032907+0000","last_fullsized":"2023-10-06T23:11:49.032907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:19:51.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033026+0000","last_change":"2023-10-06T23:11:18.267837+0000","last_active":"2023-10-06T23:11:49.033026+0000","last_peered":"2023-10-06T23:11:49.033026+0000","last_clean":"2023-10-06T23:11:49.033026+0000","last_became_active":"2023-10-06T23:11:18.267535+0000","last_became_peered":"2023-10-06T23:11:18.267535+0000","last_unstale":"2023-10-06T23:11:49.033026+0000","last_undegraded":"2023-10-06T23:11:49.033026+0000","last_fullsized":"2023-10-06T23:11:49.033026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:08.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036029+0000","last_change":"2023-10-06T23:11:17.261075+0000","last_active":"2023-10-06T23:11:49.036029+0000","last_peered":"2023-10-06T23:11:49.036029+0000","last_clean":"2023-10-06T23:11:49.036029+0000","last_became_active":"2023-10-06T23:11:17.260456+0000","last_became_peered":"2023-10-06T23:11:17.260456+0000","last_unstale":"2023-10-06T23:11:49.036029+0000","last_undegraded":"2023-10-06T23:11:49.036029+0000","last_fullsized":"2023-10-06T23:11:49.036029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:00:25.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032760+0000","last_change":"2023-10-06T23:11:18.265347+0000","last_active":"2023-10-06T23:11:49.032760+0000","last_peered":"2023-10-06T23:11:49.032760+0000","last_clean":"2023-10-06T23:11:49.032760+0000","last_became_active":"2023-10-06T23:11:18.265034+0000","last_became_peered":"2023-10-06T23:11:18.265034+0000","last_unstale":"2023-10-06T23:11:49.032760+0000","last_undegraded":"2023-10-06T23:11:49.032760+0000","last_fullsized":"2023-10-06T23:11:49.032760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:32:44.253022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034992+0000","last_change":"2023-10-06T23:11:18.263990+0000","last_active":"2023-10-06T23:11:49.034992+0000","last_peered":"2023-10-06T23:11:49.034992+0000","last_clean":"2023-10-06T23:11:49.034992+0000","last_became_active":"2023-10-06T23:11:18.262760+0000","last_became_peered":"2023-10-06T23:11:18.262760+0000","last_unstale":"2023-10-06T23:11:49.034992+0000","last_undegraded":"2023-10-06T23:11:49.034992+0000","last_fullsized":"2023-10-06T23:11:49.034992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:48:51.754187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:13:01.410223+0000","last_change":"2023-10-06T23:11:17.263187+0000","last_active":"2023-10-06T23:13:01.410223+0000","last_peered":"2023-10-06T23:13:01.410223+0000","last_clean":"2023-10-06T23:13:01.410223+0000","last_became_active":"2023-10-06T23:11:17.262770+0000","last_became_peered":"2023-10-06T23:11:17.262770+0000","last_unstale":"2023-10-06T23:13:01.410223+0000","last_undegraded":"2023-10-06T23:13:01.410223+0000","last_fullsized":"2023-10-06T23:13:01.410223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:27.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036248+0000","last_change":"2023-10-06T23:11:18.264305+0000","last_active":"2023-10-06T23:11:49.036248+0000","last_peered":"2023-10-06T23:11:49.036248+0000","last_clean":"2023-10-06T23:11:49.036248+0000","last_became_active":"2023-10-06T23:11:18.263964+0000","last_became_peered":"2023-10-06T23:11:18.263964+0000","last_unstale":"2023-10-06T23:11:49.036248+0000","last_undegraded":"2023-10-06T23:11:49.036248+0000","last_fullsized":"2023-10-06T23:11:49.036248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:11.855254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030137+0000","last_change":"2023-10-06T23:11:17.249832+0000","last_active":"2023-10-06T23:11:49.030137+0000","last_peered":"2023-10-06T23:11:49.030137+0000","last_clean":"2023-10-06T23:11:49.030137+0000","last_became_active":"2023-10-06T23:11:17.249425+0000","last_became_peered":"2023-10-06T23:11:17.249425+0000","last_unstale":"2023-10-06T23:11:49.030137+0000","last_undegraded":"2023-10-06T23:11:49.030137+0000","last_fullsized":"2023-10-06T23:11:49.030137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:02:49.349981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":313,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.036797+0000","last_change":"2023-10-06T23:09:57.868881+0000","last_active":"2023-10-06T23:11:50.036797+0000","last_peered":"2023-10-06T23:11:50.036797+0000","last_clean":"2023-10-06T23:11:50.036797+0000","last_became_active":"2023-10-06T23:09:57.868450+0000","last_became_peered":"2023-10-06T23:09:57.868450+0000","last_unstale":"2023-10-06T23:11:50.036797+0000","last_undegraded":"2023-10-06T23:11:50.036797+0000","last_fullsized":"2023-10-06T23:11:50.036797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_clean_scrub_stamp":"2023-10-06T23:06:23.790096+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:39:38.741355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039829+0000","last_change":"2023-10-06T23:11:50.039829+0000","last_active":"2023-10-06T23:11:50.039829+0000","last_peered":"2023-10-06T23:11:50.039829+0000","last_clean":"2023-10-06T23:11:50.039829+0000","last_became_active":"2023-10-06T23:11:50.039403+0000","last_became_peered":"2023-10-06T23:11:50.039403+0000","last_unstale":"2023-10-06T23:11:50.039829+0000","last_undegraded":"2023-10-06T23:11:50.039829+0000","last_fullsized":"2023-10-06T23:11:50.039829+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:33.599164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036051+0000","last_change":"2023-10-06T23:11:17.259610+0000","last_active":"2023-10-06T23:11:49.036051+0000","last_peered":"2023-10-06T23:11:49.036051+0000","last_clean":"2023-10-06T23:11:49.036051+0000","last_became_active":"2023-10-06T23:11:17.259314+0000","last_became_peered":"2023-10-06T23:11:17.259314+0000","last_unstale":"2023-10-06T23:11:49.036051+0000","last_undegraded":"2023-10-06T23:11:49.036051+0000","last_fullsized":"2023-10-06T23:11:49.036051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:48.131199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.040322+0000","last_change":"2023-10-06T23:11:50.039550+0000","last_active":"2023-10-06T23:11:50.040322+0000","last_peered":"2023-10-06T23:11:50.040322+0000","last_clean":"2023-10-06T23:11:50.040322+0000","last_became_active":"2023-10-06T23:11:50.033804+0000","last_became_peered":"2023-10-06T23:11:50.033804+0000","last_unstale":"2023-10-06T23:11:50.040322+0000","last_undegraded":"2023-10-06T23:11:50.040322+0000","last_fullsized":"2023-10-06T23:11:50.040322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:06.172652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031729+0000","last_change":"2023-10-06T23:11:18.259562+0000","last_active":"2023-10-06T23:11:49.031729+0000","last_peered":"2023-10-06T23:11:49.031729+0000","last_clean":"2023-10-06T23:11:49.031729+0000","last_became_active":"2023-10-06T23:11:18.259188+0000","last_became_peered":"2023-10-06T23:11:18.259188+0000","last_unstale":"2023-10-06T23:11:49.031729+0000","last_undegraded":"2023-10-06T23:11:49.031729+0000","last_fullsized":"2023-10-06T23:11:49.031729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:19.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033164+0000","last_change":"2023-10-06T23:11:17.260888+0000","last_active":"2023-10-06T23:11:49.033164+0000","last_peered":"2023-10-06T23:11:49.033164+0000","last_clean":"2023-10-06T23:11:49.033164+0000","last_became_active":"2023-10-06T23:11:17.260563+0000","last_became_peered":"2023-10-06T23:11:17.260563+0000","last_unstale":"2023-10-06T23:11:49.033164+0000","last_undegraded":"2023-10-06T23:11:49.033164+0000","last_fullsized":"2023-10-06T23:11:49.033164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:43.087389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036989+0000","last_change":"2023-10-06T23:11:18.261401+0000","last_active":"2023-10-06T23:11:49.036989+0000","last_peered":"2023-10-06T23:11:49.036989+0000","last_clean":"2023-10-06T23:11:49.036989+0000","last_became_active":"2023-10-06T23:11:18.261037+0000","last_became_peered":"2023-10-06T23:11:18.261037+0000","last_unstale":"2023-10-06T23:11:49.036989+0000","last_undegraded":"2023-10-06T23:11:49.036989+0000","last_fullsized":"2023-10-06T23:11:49.036989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:53.298980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030447+0000","last_change":"2023-10-06T23:11:17.264907+0000","last_active":"2023-10-06T23:11:49.030447+0000","last_peered":"2023-10-06T23:11:49.030447+0000","last_clean":"2023-10-06T23:11:49.030447+0000","last_became_active":"2023-10-06T23:11:17.264426+0000","last_became_peered":"2023-10-06T23:11:17.264426+0000","last_unstale":"2023-10-06T23:11:49.030447+0000","last_undegraded":"2023-10-06T23:11:49.030447+0000","last_fullsized":"2023-10-06T23:11:49.030447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:21.330048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027045+0000","last_change":"2023-10-06T23:11:18.259337+0000","last_active":"2023-10-06T23:11:49.027045+0000","last_peered":"2023-10-06T23:11:49.027045+0000","last_clean":"2023-10-06T23:11:49.027045+0000","last_became_active":"2023-10-06T23:11:18.259008+0000","last_became_peered":"2023-10-06T23:11:18.259008+0000","last_unstale":"2023-10-06T23:11:49.027045+0000","last_undegraded":"2023-10-06T23:11:49.027045+0000","last_fullsized":"2023-10-06T23:11:49.027045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:28.845368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042510+0000","last_change":"2023-10-06T23:11:17.267695+0000","last_active":"2023-10-06T23:11:49.042510+0000","last_peered":"2023-10-06T23:11:49.042510+0000","last_clean":"2023-10-06T23:11:49.042510+0000","last_became_active":"2023-10-06T23:11:17.267292+0000","last_became_peered":"2023-10-06T23:11:17.267292+0000","last_unstale":"2023-10-06T23:11:49.042510+0000","last_undegraded":"2023-10-06T23:11:49.042510+0000","last_fullsized":"2023-10-06T23:11:49.042510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:36:54.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032536+0000","last_change":"2023-10-06T23:11:18.260012+0000","last_active":"2023-10-06T23:11:49.032536+0000","last_peered":"2023-10-06T23:11:49.032536+0000","last_clean":"2023-10-06T23:11:49.032536+0000","last_became_active":"2023-10-06T23:11:18.259684+0000","last_became_peered":"2023-10-06T23:11:18.259684+0000","last_unstale":"2023-10-06T23:11:49.032536+0000","last_undegraded":"2023-10-06T23:11:49.032536+0000","last_fullsized":"2023-10-06T23:11:49.032536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:46:08.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035791+0000","last_change":"2023-10-06T23:11:17.264262+0000","last_active":"2023-10-06T23:11:49.035791+0000","last_peered":"2023-10-06T23:11:49.035791+0000","last_clean":"2023-10-06T23:11:49.035791+0000","last_became_active":"2023-10-06T23:11:17.263922+0000","last_became_peered":"2023-10-06T23:11:17.263922+0000","last_unstale":"2023-10-06T23:11:49.035791+0000","last_undegraded":"2023-10-06T23:11:49.035791+0000","last_fullsized":"2023-10-06T23:11:49.035791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:00:14.045943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029509+0000","last_change":"2023-10-06T23:11:18.260908+0000","last_active":"2023-10-06T23:11:49.029509+0000","last_peered":"2023-10-06T23:11:49.029509+0000","last_clean":"2023-10-06T23:11:49.029509+0000","last_became_active":"2023-10-06T23:11:18.260459+0000","last_became_peered":"2023-10-06T23:11:18.260459+0000","last_unstale":"2023-10-06T23:11:49.029509+0000","last_undegraded":"2023-10-06T23:11:49.029509+0000","last_fullsized":"2023-10-06T23:11:49.029509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:51.570508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036705+0000","last_change":"2023-10-06T23:11:17.262559+0000","last_active":"2023-10-06T23:11:49.036705+0000","last_peered":"2023-10-06T23:11:49.036705+0000","last_clean":"2023-10-06T23:11:49.036705+0000","last_became_active":"2023-10-06T23:11:17.262062+0000","last_became_peered":"2023-10-06T23:11:17.262062+0000","last_unstale":"2023-10-06T23:11:49.036705+0000","last_undegraded":"2023-10-06T23:11:49.036705+0000","last_fullsized":"2023-10-06T23:11:49.036705+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:03.751385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036526+0000","last_change":"2023-10-06T23:11:18.269813+0000","last_active":"2023-10-06T23:11:49.036526+0000","last_peered":"2023-10-06T23:11:49.036526+0000","last_clean":"2023-10-06T23:11:49.036526+0000","last_became_active":"2023-10-06T23:11:18.269506+0000","last_became_peered":"2023-10-06T23:11:18.269506+0000","last_unstale":"2023-10-06T23:11:49.036526+0000","last_undegraded":"2023-10-06T23:11:49.036526+0000","last_fullsized":"2023-10-06T23:11:49.036526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:43:21.635237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032699+0000","last_change":"2023-10-06T23:11:17.253040+0000","last_active":"2023-10-06T23:11:49.032699+0000","last_peered":"2023-10-06T23:11:49.032699+0000","last_clean":"2023-10-06T23:11:49.032699+0000","last_became_active":"2023-10-06T23:11:17.252596+0000","last_became_peered":"2023-10-06T23:11:17.252596+0000","last_unstale":"2023-10-06T23:11:49.032699+0000","last_undegraded":"2023-10-06T23:11:49.032699+0000","last_fullsized":"2023-10-06T23:11:49.032699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:39:30.721464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036362+0000","last_change":"2023-10-06T23:11:18.267465+0000","last_active":"2023-10-06T23:11:49.036362+0000","last_peered":"2023-10-06T23:11:49.036362+0000","last_clean":"2023-10-06T23:11:49.036362+0000","last_became_active":"2023-10-06T23:11:18.267164+0000","last_became_peered":"2023-10-06T23:11:18.267164+0000","last_unstale":"2023-10-06T23:11:49.036362+0000","last_undegraded":"2023-10-06T23:11:49.036362+0000","last_fullsized":"2023-10-06T23:11:49.036362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:16.747117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037242+0000","last_change":"2023-10-06T23:11:17.267653+0000","last_active":"2023-10-06T23:11:49.037242+0000","last_peered":"2023-10-06T23:11:49.037242+0000","last_clean":"2023-10-06T23:11:49.037242+0000","last_became_active":"2023-10-06T23:11:17.267264+0000","last_became_peered":"2023-10-06T23:11:17.267264+0000","last_unstale":"2023-10-06T23:11:49.037242+0000","last_undegraded":"2023-10-06T23:11:49.037242+0000","last_fullsized":"2023-10-06T23:11:49.037242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:45:57.242383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036468+0000","last_change":"2023-10-06T23:11:18.264869+0000","last_active":"2023-10-06T23:11:49.036468+0000","last_peered":"2023-10-06T23:11:49.036468+0000","last_clean":"2023-10-06T23:11:49.036468+0000","last_became_active":"2023-10-06T23:11:18.264549+0000","last_became_peered":"2023-10-06T23:11:18.264549+0000","last_unstale":"2023-10-06T23:11:49.036468+0000","last_undegraded":"2023-10-06T23:11:49.036468+0000","last_fullsized":"2023-10-06T23:11:49.036468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:00:35.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035779+0000","last_change":"2023-10-06T23:11:17.263806+0000","last_active":"2023-10-06T23:11:49.035779+0000","last_peered":"2023-10-06T23:11:49.035779+0000","last_clean":"2023-10-06T23:11:49.035779+0000","last_became_active":"2023-10-06T23:11:17.263499+0000","last_became_peered":"2023-10-06T23:11:17.263499+0000","last_unstale":"2023-10-06T23:11:49.035779+0000","last_undegraded":"2023-10-06T23:11:49.035779+0000","last_fullsized":"2023-10-06T23:11:49.035779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:26.191338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036159+0000","last_change":"2023-10-06T23:11:18.264691+0000","last_active":"2023-10-06T23:11:49.036159+0000","last_peered":"2023-10-06T23:11:49.036159+0000","last_clean":"2023-10-06T23:11:49.036159+0000","last_became_active":"2023-10-06T23:11:18.264286+0000","last_became_peered":"2023-10-06T23:11:18.264286+0000","last_unstale":"2023-10-06T23:11:49.036159+0000","last_undegraded":"2023-10-06T23:11:49.036159+0000","last_fullsized":"2023-10-06T23:11:49.036159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:35:23.728707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.401402+0000","last_change":"2023-10-06T23:11:50.401402+0000","last_active":"2023-10-06T23:11:50.401402+0000","last_peered":"2023-10-06T23:11:50.401402+0000","last_clean":"2023-10-06T23:11:50.401402+0000","last_became_active":"2023-10-06T23:11:50.397772+0000","last_became_peered":"2023-10-06T23:11:50.397772+0000","last_unstale":"2023-10-06T23:11:50.401402+0000","last_undegraded":"2023-10-06T23:11:50.401402+0000","last_fullsized":"2023-10-06T23:11:50.401402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:33.727845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036474+0000","last_change":"2023-10-06T23:11:18.265822+0000","last_active":"2023-10-06T23:11:49.036474+0000","last_peered":"2023-10-06T23:11:49.036474+0000","last_clean":"2023-10-06T23:11:49.036474+0000","last_became_active":"2023-10-06T23:11:18.265457+0000","last_became_peered":"2023-10-06T23:11:18.265457+0000","last_unstale":"2023-10-06T23:11:49.036474+0000","last_undegraded":"2023-10-06T23:11:49.036474+0000","last_fullsized":"2023-10-06T23:11:49.036474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:09.132431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029634+0000","last_change":"2023-10-06T23:11:18.267305+0000","last_active":"2023-10-06T23:11:49.029634+0000","last_peered":"2023-10-06T23:11:49.029634+0000","last_clean":"2023-10-06T23:11:49.029634+0000","last_became_active":"2023-10-06T23:11:18.266975+0000","last_became_peered":"2023-10-06T23:11:18.266975+0000","last_unstale":"2023-10-06T23:11:49.029634+0000","last_undegraded":"2023-10-06T23:11:49.029634+0000","last_fullsized":"2023-10-06T23:11:49.029634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036823+0000","last_change":"2023-10-06T23:11:18.262045+0000","last_active":"2023-10-06T23:11:49.036823+0000","last_peered":"2023-10-06T23:11:49.036823+0000","last_clean":"2023-10-06T23:11:49.036823+0000","last_became_active":"2023-10-06T23:11:18.261662+0000","last_became_peered":"2023-10-06T23:11:18.261662+0000","last_unstale":"2023-10-06T23:11:49.036823+0000","last_undegraded":"2023-10-06T23:11:49.036823+0000","last_fullsized":"2023-10-06T23:11:49.036823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:56:06.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036972+0000","last_change":"2023-10-06T23:11:18.259540+0000","last_active":"2023-10-06T23:11:49.036972+0000","last_peered":"2023-10-06T23:11:49.036972+0000","last_clean":"2023-10-06T23:11:49.036972+0000","last_became_active":"2023-10-06T23:11:18.259234+0000","last_became_peered":"2023-10-06T23:11:18.259234+0000","last_unstale":"2023-10-06T23:11:49.036972+0000","last_undegraded":"2023-10-06T23:11:49.036972+0000","last_fullsized":"2023-10-06T23:11:49.036972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:47:15.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026670+0000","last_change":"2023-10-06T23:11:18.266295+0000","last_active":"2023-10-06T23:11:49.026670+0000","last_peered":"2023-10-06T23:11:49.026670+0000","last_clean":"2023-10-06T23:11:49.026670+0000","last_became_active":"2023-10-06T23:11:18.265991+0000","last_became_peered":"2023-10-06T23:11:18.265991+0000","last_unstale":"2023-10-06T23:11:49.026670+0000","last_undegraded":"2023-10-06T23:11:49.026670+0000","last_fullsized":"2023-10-06T23:11:49.026670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:34:43.165643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031833+0000","last_change":"2023-10-06T23:11:18.266239+0000","last_active":"2023-10-06T23:11:49.031833+0000","last_peered":"2023-10-06T23:11:49.031833+0000","last_clean":"2023-10-06T23:11:49.031833+0000","last_became_active":"2023-10-06T23:11:18.265849+0000","last_became_peered":"2023-10-06T23:11:18.265849+0000","last_unstale":"2023-10-06T23:11:49.031833+0000","last_undegraded":"2023-10-06T23:11:49.031833+0000","last_fullsized":"2023-10-06T23:11:49.031833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:47.219459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030522+0000","last_change":"2023-10-06T23:11:18.260885+0000","last_active":"2023-10-06T23:11:49.030522+0000","last_peered":"2023-10-06T23:11:49.030522+0000","last_clean":"2023-10-06T23:11:49.030522+0000","last_became_active":"2023-10-06T23:11:18.260567+0000","last_became_peered":"2023-10-06T23:11:18.260567+0000","last_unstale":"2023-10-06T23:11:49.030522+0000","last_undegraded":"2023-10-06T23:11:49.030522+0000","last_fullsized":"2023-10-06T23:11:49.030522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:36.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037629+0000","last_change":"2023-10-06T23:11:18.257105+0000","last_active":"2023-10-06T23:11:49.037629+0000","last_peered":"2023-10-06T23:11:49.037629+0000","last_clean":"2023-10-06T23:11:49.037629+0000","last_became_active":"2023-10-06T23:11:18.256816+0000","last_became_peered":"2023-10-06T23:11:18.256816+0000","last_unstale":"2023-10-06T23:11:49.037629+0000","last_undegraded":"2023-10-06T23:11:49.037629+0000","last_fullsized":"2023-10-06T23:11:49.037629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:07.749678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036911+0000","last_change":"2023-10-06T23:11:18.260383+0000","last_active":"2023-10-06T23:11:49.036911+0000","last_peered":"2023-10-06T23:11:49.036911+0000","last_clean":"2023-10-06T23:11:49.036911+0000","last_became_active":"2023-10-06T23:11:18.260010+0000","last_became_peered":"2023-10-06T23:11:18.260010+0000","last_unstale":"2023-10-06T23:11:49.036911+0000","last_undegraded":"2023-10-06T23:11:49.036911+0000","last_fullsized":"2023-10-06T23:11:49.036911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:25.014895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034750+0000","last_change":"2023-10-06T23:11:18.261948+0000","last_active":"2023-10-06T23:11:49.034750+0000","last_peered":"2023-10-06T23:11:49.034750+0000","last_clean":"2023-10-06T23:11:49.034750+0000","last_became_active":"2023-10-06T23:11:18.261605+0000","last_became_peered":"2023-10-06T23:11:18.261605+0000","last_unstale":"2023-10-06T23:11:49.034750+0000","last_undegraded":"2023-10-06T23:11:49.034750+0000","last_fullsized":"2023-10-06T23:11:49.034750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:10:59.720181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035691+0000","last_change":"2023-10-06T23:11:18.261123+0000","last_active":"2023-10-06T23:11:49.035691+0000","last_peered":"2023-10-06T23:11:49.035691+0000","last_clean":"2023-10-06T23:11:49.035691+0000","last_became_active":"2023-10-06T23:11:18.260754+0000","last_became_peered":"2023-10-06T23:11:18.260754+0000","last_unstale":"2023-10-06T23:11:49.035691+0000","last_undegraded":"2023-10-06T23:11:49.035691+0000","last_fullsized":"2023-10-06T23:11:49.035691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:04:25.335790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042589+0000","last_change":"2023-10-06T23:11:18.261021+0000","last_active":"2023-10-06T23:11:49.042589+0000","last_peered":"2023-10-06T23:11:49.042589+0000","last_clean":"2023-10-06T23:11:49.042589+0000","last_became_active":"2023-10-06T23:11:18.260613+0000","last_became_peered":"2023-10-06T23:11:18.260613+0000","last_unstale":"2023-10-06T23:11:49.042589+0000","last_undegraded":"2023-10-06T23:11:49.042589+0000","last_fullsized":"2023-10-06T23:11:49.042589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:31:28.443342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031481+0000","last_change":"2023-10-06T23:11:18.266771+0000","last_active":"2023-10-06T23:11:49.031481+0000","last_peered":"2023-10-06T23:11:49.031481+0000","last_clean":"2023-10-06T23:11:49.031481+0000","last_became_active":"2023-10-06T23:11:18.266434+0000","last_became_peered":"2023-10-06T23:11:18.266434+0000","last_unstale":"2023-10-06T23:11:49.031481+0000","last_undegraded":"2023-10-06T23:11:49.031481+0000","last_fullsized":"2023-10-06T23:11:49.031481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:59:53.056671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029587+0000","last_change":"2023-10-06T23:11:18.265674+0000","last_active":"2023-10-06T23:11:49.029587+0000","last_peered":"2023-10-06T23:11:49.029587+0000","last_clean":"2023-10-06T23:11:49.029587+0000","last_became_active":"2023-10-06T23:11:18.265323+0000","last_became_peered":"2023-10-06T23:11:18.265323+0000","last_unstale":"2023-10-06T23:11:49.029587+0000","last_undegraded":"2023-10-06T23:11:49.029587+0000","last_fullsized":"2023-10-06T23:11:49.029587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:15.281707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281556,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6072,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":612,"num_read_kb":316,"num_write":129,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":44,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":19031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351011,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":459304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.72899999999999998,"15min":0.755},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":3.7559999999999998,"15min":3.7559999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.84599999999999997,"15min":0.88700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78300000000000003,"5min":5.585,"15min":5.585},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.48599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.036,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.82199999999999995,"15min":0.83399999999999996},"min":{"1min":0.59999999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92000000000000004,"5min":3.895,"15min":3.895},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.44700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81499999999999995,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.63},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.42099999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.92100000000000004,"5min":3.052,"15min":3.052},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.56599999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.872,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.079,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.92700000000000005},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93100000000000005,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4009999999999998,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.018,"15min":1.052},"min":{"1min":0.60899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0589999999999999,"5min":5.9640000000000004,"15min":5.9640000000000004},"last":0.90200000000000002}]},{"osd":7,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.97299999999999998,"15min":0.98899999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.131,"5min":4.21,"15min":4.21},"last":0.81100000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.204},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.95799999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.2,"15min":1.246},"min":{"1min":0.73199999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.089,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.71999999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0900000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.97799999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0389999999999999,"15min":1.0589999999999999},"min":{"1min":0.65200000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.1659999999999999,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.131,"15min":1.1519999999999999},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4930000000000001,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":1.1439999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612648,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1052236,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.46800000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.755,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.84099999999999997}]},{"osd":2,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.73299999999999998,"15min":0.69699999999999995},"min":{"1min":0.70799999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.61099999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82399999999999995,"5min":1.631,"15min":1.631},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.83199999999999996,"15min":0.81299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86899999999999999,"5min":8.2669999999999995,"15min":8.2669999999999995},"last":0.751}]},{"osd":4,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67900000000000005,"15min":0.66900000000000004},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.004,"15min":1.004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96799999999999997,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.02,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90800000000000003,"15min":0.91300000000000003},"min":{"1min":0.68799999999999994,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0720000000000001,"5min":1.228,"15min":1.228},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.98599999999999999,"15min":0.97499999999999998},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1020000000000001,"5min":7.9539999999999997,"15min":7.9539999999999997},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.94299999999999995,"15min":0.92600000000000005},"min":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4740000000000002,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":0.92800000000000005}]},{"osd":7,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1240000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.98599999999999999,"15min":1.012},"min":{"1min":0.65600000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.1559999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.069}]},{"osd":9,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.97499999999999998,"15min":1.0069999999999999},"min":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1399999999999999,"5min":1.391,"15min":1.391},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.0940000000000001,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.117,"5min":8.1799999999999997,"15min":8.1799999999999997},"last":1.038}]},{"osd":11,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.119,"5min":1.641,"15min":1.641},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.94099999999999995,"15min":0.93799999999999994},"min":{"1min":0.73799999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.0980000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.054}]}]},{"osd":9,"up_from":68,"seq":292057776174,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":459496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.79600000000000004,"15min":0.83199999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0609999999999999,"5min":1.167,"15min":1.167},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1759999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80100000000000005,"15min":0.82499999999999996},"min":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.874}]},{"osd":3,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69299999999999995,"15min":0.71799999999999997},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.69699999999999995,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1080000000000001,"5min":1.153,"15min":1.153},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86599999999999999,"15min":0.90800000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.89000000000000001,"15min":0.93799999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.89600000000000002,"15min":0.94499999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.264,"5min":2.109,"15min":2.109},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.89400000000000002,"15min":0.93700000000000006},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1679999999999999,"5min":1.359,"15min":1.359},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.196,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89300000000000002,"15min":0.94699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.133,"5min":1.738,"15min":1.738},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.97199999999999998,"15min":1.024},"min":{"1min":0.63600000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.383,"5min":2.149,"15min":2.149},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.98699999999999999,"15min":1.0309999999999999},"min":{"1min":0.626,"5min":0.624,"15min":0.624},"max":{"1min":1.2290000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.90900000000000003}]},{"osd":8,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.99199999999999999,"15min":1.032},"min":{"1min":0.70599999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.284,"5min":1.778,"15min":1.778},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.335,"5min":1.698,"15min":1.698},"last":0.89600000000000002}]},{"osd":10,"last update":"Fri Oct 6 23:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98699999999999999,"15min":1.028},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.137,"5min":1.417,"15min":1.417},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":1.006},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.3640000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0049999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037811,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":459041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.71599999999999997,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.435,"15min":0.435},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.024,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":1.272,"15min":1.272},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.96499999999999997,"5min":1.196,"15min":1.196},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.79000000000000004},"min":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.3799999999999999,"5min":3.3799999999999999,"15min":3.3799999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75,"15min":0.751},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.878},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.125,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.748},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.073,"5min":1.248,"15min":1.248},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98299999999999998,"5min":1.05,"15min":1.05},"last":0.96699999999999997}]},{"osd":6,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.67700000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1719999999999999,"5min":1.399,"15min":1.399},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88800000000000001,"15min":0.92000000000000004},"min":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.115,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.90800000000000003}]},{"osd":9,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.65900000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.94599999999999995,"15min":0.94999999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.94399999999999995}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.70099999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.145,"5min":1.304,"15min":1.304},"last":1.004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.88600000000000001,"15min":0.875},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.155,"5min":1.242,"15min":1.242},"last":0.995}]},{"osd":11,"last update":"Fri Oct 6 23:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.081}]}]},{"osd":7,"up_from":52,"seq":223338299448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":1050932,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34599999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80700000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73799999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69799999999999995,"15min":0.67600000000000005},"min":{"1min":0.502,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0389999999999999,"5min":1.04,"15min":1.04},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.51900000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76900000000000002,"15min":0.72499999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94999999999999996,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":0.498},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":1.149,"15min":1.149},"last":0.66600000000000004}]},{"osd":4,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79300000000000004,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.47899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91200000000000003,"5min":1.103,"15min":1.103},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.877,"5min":1.244,"15min":1.244},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78800000000000003,"15min":0.77600000000000002},"min":{"1min":0.629,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0600000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.92800000000000005,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.26,"15min":1.26},"last":0.55500000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.61899999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.871,"15min":0.85399999999999998},"min":{"1min":0.70499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89300000000000002}]},{"osd":9,"last update":"Fri Oct 6 23:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90300000000000002,"15min":0.90000000000000002},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.012,"5min":1.206,"15min":1.206},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.61299999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.147,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.73299999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93100000000000005},"min":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.139,"5min":1.2,"15min":1.2},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88500000000000001,"15min":0.88400000000000001},"min":{"1min":0.65900000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.117,"5min":1.298,"15min":1.298},"last":0.86199999999999999}]},{"osd":11,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92500000000000004}]}]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":458768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.48699999999999999,"15min":0.45100000000000001},"min":{"1min":0.35699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.52700000000000002,"15min":0.47999999999999998},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.44}]},{"osd":1,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.69399999999999995},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.74199999999999999,"15min":0.70399999999999996},"min":{"1min":0.54000000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.66400000000000003,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.539,"5min":10.539,"15min":10.539},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.69099999999999995,"15min":0.63700000000000001},"min":{"1min":0.46500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78000000000000003,"15min":0.74299999999999999},"min":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.2839999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79500000000000004,"15min":0.77200000000000002},"min":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.8719999999999999,"5min":3.8719999999999999,"15min":3.8719999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79400000000000004,"15min":0.77600000000000002},"min":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5349999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.84599999999999997,"15min":0.80700000000000005},"min":{"1min":0.63600000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.78200000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.83899999999999997,"15min":0.81499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.133,"5min":3.915,"15min":3.915},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.876,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3979999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.85799999999999998}]},{"osd":8,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.89000000000000001,"15min":0.85399999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.88300000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.91600000000000004,"15min":0.91100000000000003},"min":{"1min":0.58399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.4820000000000002,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90700000000000003,"15min":0.89900000000000002},"min":{"1min":0.69599999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.93799999999999994}]},{"osd":10,"last update":"Fri Oct 6 23:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.93200000000000005,"15min":0.92300000000000004},"min":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0940000000000001,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.999,"15min":1.0069999999999999},"min":{"1min":0.75900000000000001,"5min":0.749,"15min":0.749},"max":{"1min":0.998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.97699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":460715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.38200000000000001,"15min":0.35599999999999998},"max":{"1min":1.1220000000000001,"5min":1.222,"15min":1.222},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.627,"15min":0.60399999999999998},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":1.0429999999999999,"5min":1.056,"15min":1.056},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Oct 6 23:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96799999999999997,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.032,"5min":1.198,"15min":1.198},"last":0.96499999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":1.282,"15min":1.282},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.436},"max":{"1min":0.83599999999999997,"5min":1.522,"15min":1.522},"last":0.502}]},{"osd":4,"last update":"Fri Oct 6 23:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":1.097,"15min":1.097},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.621,"15min":0.58199999999999996},"min":{"1min":0.47999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0780000000000001,"5min":2.02,"15min":2.02},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.74199999999999999,"15min":0.68000000000000005},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.04,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80300000000000005,"15min":0.72799999999999998},"min":{"1min":0.64100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1259999999999999,"5min":1.254,"15min":1.254},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.80200000000000005,"15min":0.76800000000000002},"min":{"1min":0.59999999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.119,"5min":1.385,"15min":1.385},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.60799999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.175,"5min":1.492,"15min":1.492},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.77100000000000002,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2050000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.94099999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.83399999999999996,"15min":0.80000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2410000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.78100000000000003,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3280000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.872}]},{"osd":9,"last update":"Fri Oct 6 23:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90400000000000003,"15min":0.88800000000000001},"min":{"1min":0.745,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1599999999999999,"5min":1.355,"15min":1.355},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85099999999999998,"15min":0.83299999999999996},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.048,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.70399999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91000000000000003,"15min":0.90000000000000002},"min":{"1min":0.623,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3600000000000001,"5min":1.706,"15min":1.706},"last":0.623},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92900000000000005,"15min":0.92100000000000004},"min":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0409999999999999}]},{"osd":11,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0629999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":460156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.61299999999999999},"min":{"1min":0.42599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.091,"15min":1.091},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.63600000000000001},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.63900000000000001},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95199999999999996,"5min":1.236,"15min":1.236},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.64000000000000001},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66700000000000004,"15min":0.63300000000000001},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98599999999999999,"5min":0.995,"15min":0.995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68500000000000005,"15min":0.64100000000000001},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.752}]},{"osd":5,"last update":"Fri Oct 6 23:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86099999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.746,"15min":0.70499999999999996},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66100000000000003,"15min":0.63600000000000001},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.002,"5min":1.085,"15min":1.085},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.59699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.81399999999999995,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70299999999999996}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.25,"5min":1.296,"15min":1.296},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.68400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.88700000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83299999999999996,"15min":0.83699999999999997},"min":{"1min":0.499,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0580000000000001,"5min":1.206,"15min":1.206},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.85599999999999998,"15min":0.88700000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.173,"5min":1.325,"15min":1.325},"last":0.875}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85999999999999999,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92500000000000004,"15min":0.92300000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.202,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.008}]},{"osd":11,"last update":"Fri Oct 6 23:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.73899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0720000000000001,"5min":1.724,"15min":1.724},"last":1.044},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.29,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.90100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":462490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.59399999999999997},"min":{"1min":0.40699999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.91900000000000004,"5min":1.0009999999999999,"15min":1.7949999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.65100000000000002,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66700000000000004,"15min":0.629},"min":{"1min":0.498,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.88900000000000001,"5min":1.012,"15min":1.4990000000000001},"last":0.752},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70899999999999996,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.41299999999999998},"max":{"1min":0.97699999999999998,"5min":1.2430000000000001,"15min":1.746},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67600000000000005,"15min":0.65400000000000003},"min":{"1min":0.39000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.75800000000000001,"15min":0.71099999999999997},"min":{"1min":0.56599999999999995,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri Oct 6 23:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95899999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.751,"15min":0.70099999999999996},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.022,"5min":1.169,"15min":1.169},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.78400000000000003,"15min":0.73799999999999999},"min":{"1min":0.59499999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0409999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.54400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75}]},{"osd":8,"last update":"Fri Oct 6 23:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.65500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0800000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82499999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0629999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.746}]},{"osd":9,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0920000000000001,"5min":1.155,"15min":1.155},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.81699999999999995}]},{"osd":10,"last update":"Fri Oct 6 23:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91900000000000004,"15min":0.93100000000000005},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.62},"max":{"1min":1.0620000000000001,"5min":1.333,"15min":1.333},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92900000000000005,"15min":0.94199999999999995},"min":{"1min":0.745,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.0920000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90100000000000002}]},{"osd":11,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.871}]}]},{"osd":3,"up_from":26,"seq":111669149773,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":458631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48399999999999999,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.753,"5min":1.03,"15min":1.03},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49199999999999999,"15min":0.42399999999999999},"min":{"1min":0.314,"5min":0.29899999999999999,"15min":0.26300000000000001},"max":{"1min":0.72799999999999998,"5min":1.409,"15min":1.409},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Oct 6 23:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69899999999999995,"15min":0.64300000000000002},"min":{"1min":0.50900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92200000000000004,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81499999999999995,"15min":0.70599999999999996},"min":{"1min":0.55600000000000005,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.99199999999999999,"5min":9.3989999999999991,"15min":9.3989999999999991},"last":0.99199999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71499999999999997,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.35299999999999998},"max":{"1min":0.83499999999999996,"5min":4.3769999999999998,"15min":4.3769999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.39300000000000002,"15min":0.379},"max":{"1min":0.91300000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Fri Oct 6 23:12:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":0.80900000000000005,"15min":0.68899999999999995},"min":{"1min":0.57199999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":9.4399999999999995,"5min":9.4399999999999995,"15min":9.4399999999999995},"last":0.873},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.68600000000000005},"min":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Oct 6 23:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.85299999999999998,"15min":0.76000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0489999999999999,"5min":9.3379999999999992,"15min":9.3379999999999992},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.875,"15min":0.75700000000000001},"min":{"1min":0.58999999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":6.6289999999999996,"5min":6.6289999999999996,"15min":6.6289999999999996},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.69099999999999995,"15min":0.626},"min":{"1min":0.51400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":5.3680000000000003,"5min":5.3680000000000003,"15min":5.3680000000000003},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.139,"5min":0.77900000000000003,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":11.281000000000001,"5min":11.281000000000001,"15min":11.281000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Oct 6 23:12:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.96399999999999997,"15min":0.86899999999999999},"min":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.5970000000000004,"5min":9.4779999999999998,"15min":9.4779999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.84899999999999998,"15min":0.81699999999999995},"min":{"1min":0.60599999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97799999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.02}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.66900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.008,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0009999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.872,"15min":0.878},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.204,"5min":0.91700000000000004,"15min":0.86299999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.336,"5min":11.336,"15min":11.336},"last":0.83399999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.004,"15min":0.96999999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2190000000000001,"5min":9.516,"15min":9.516},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.1180000000000001,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.1180000000000001}]},{"osd":11,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":1.1870000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888137,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":459322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52100000000000002,"15min":0.47299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.53200000000000003,"15min":0.46999999999999997},"min":{"1min":0.42999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.439}]},{"osd":2,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.76100000000000001,"15min":0.68899999999999995},"min":{"1min":0.65900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0580000000000001,"5min":1.109,"15min":1.109},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.73199999999999998,"15min":0.70599999999999996},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70799999999999996,"15min":0.66100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.65300000000000002},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.014,"5min":1.141,"15min":1.141},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.73899999999999999,"15min":0.70099999999999996},"min":{"1min":0.61599999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98699999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.76900000000000002,"15min":0.71499999999999997},"min":{"1min":0.67000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79000000000000004,"15min":0.75800000000000001},"min":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0629999999999999,"5min":1.083,"15min":1.083},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.73199999999999998},"min":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0449999999999999,"5min":1.161,"15min":1.161},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 23:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.77700000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.67100000000000004}]},{"osd":8,"last update":"Fri Oct 6 23:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.90900000000000003,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0920000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.749}]},{"osd":9,"last update":"Fri Oct 6 23:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70099999999999996,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":0.96699999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.181,"5min":1.22,"15min":1.22},"last":0.83299999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.89000000000000001}]},{"osd":11,"last update":"Fri Oct 6 23:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.91400000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":1050616,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98699999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.69299999999999995,"15min":0.64900000000000002},"min":{"1min":0.60299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.97399999999999998,"5min":1.153,"15min":1.153},"last":0.749},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.66500000000000004,"15min":0.63200000000000001},"min":{"1min":0.52900000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.94399999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.627}]},{"osd":2,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.49299999999999999},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.504},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.51800000000000002},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.879,"15min":0.879},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.46999999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.499,"5min":0.441,"15min":0.441},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.93899999999999995}]},{"osd":4,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.59599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96799999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.747,"15min":0.69899999999999995},"min":{"1min":0.58799999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Oct 6 23:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.125},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.749,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.625,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.76500000000000001,"15min":0.71899999999999997},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.042,"5min":1.349,"15min":1.349},"last":0.81599999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.879,"5min":0.77700000000000002,"15min":0.75700000000000001},"min":{"1min":0.52500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.71899999999999997}]},{"osd":9,"last update":"Fri Oct 6 23:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0660000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81299999999999994},"min":{"1min":0.63400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Fri Oct 6 23:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.88200000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.85099999999999998,"15min":0.83899999999999997},"min":{"1min":0.61599999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.88}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T23:13:05.226 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-06T23:13:05.226 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T23:13:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.461+0000 7f77b1fff700 1 -- 172.21.15.8:0/1714220118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102080 msgr2=0x7f77ac102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.461+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1714220118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102080 0x7f77ac102500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009990 tx=0x7f77a0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.461+0000 7f77b1fff700 1 -- 172.21.15.8:0/1714220118 shutdown_connections 2023-10-06T23:13:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.461+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1714220118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77ac102a40 0x7f77ac109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.461+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1714220118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77ac100ea0 0x7f77ac1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.461+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1714220118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102080 0x7f77ac102500 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.461+0000 7f77b1fff700 1 -- 172.21.15.8:0/1714220118 >> 172.21.15.8:0/1714220118 conn(0x7f77ac0fc420 msgr2=0x7f77ac0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.462+0000 7f77b1fff700 1 -- 172.21.15.8:0/1714220118 shutdown_connections 2023-10-06T23:13:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.462+0000 7f77b1fff700 1 -- 172.21.15.8:0/1714220118 wait complete. 2023-10-06T23:13:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77b1fff700 1 Processor -- start 2023-10-06T23:13:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77b1fff700 1 -- start start 2023-10-06T23:13:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77b1fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77ac100ea0 0x7f77ac198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77b1fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77ac102080 0x7f77ac199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77b1fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102a40 0x7f77ac1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77b1fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac1a0950 con 0x7f77ac102a40 2023-10-06T23:13:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77b1fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac1a0a90 con 0x7f77ac100ea0 2023-10-06T23:13:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77b1fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac1a0c20 con 0x7f77ac102080 2023-10-06T23:13:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102a40 0x7f77ac1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102a40 0x7f77ac1a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55674/0 (socket says 172.21.15.8:55674) 2023-10-06T23:13:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77abfff700 1 -- 172.21.15.8:0/1270696529 learned_addr learned my addr 172.21.15.8:0/1270696529 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.463+0000 7f77aaffd700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77ac102080 0x7f77ac199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77ab7fe700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77ac100ea0 0x7f77ac198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77abfff700 1 -- 172.21.15.8:0/1270696529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77ac102080 msgr2=0x7f77ac199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77abfff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77ac102080 0x7f77ac199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77abfff700 1 -- 172.21.15.8:0/1270696529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77ac100ea0 msgr2=0x7f77ac198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77abfff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77ac100ea0 0x7f77ac198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77abfff700 1 -- 172.21.15.8:0/1270696529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00095f0 con 0x7f77ac102a40 2023-10-06T23:13:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77aaffd700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77ac102080 0x7f77ac199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77ab7fe700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77ac100ea0 0x7f77ac198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77abfff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102a40 0x7f77ac1a0380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77a4007ee0 tx=0x7f77a400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77a8ff9700 1 -- 172.21.15.8:0/1270696529 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4017070 con 0x7f77ac102a40 2023-10-06T23:13:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77a8ff9700 1 -- 172.21.15.8:0/1270696529 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77a400f040 con 0x7f77ac102a40 2023-10-06T23:13:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac1a0f00 con 0x7f77ac102a40 2023-10-06T23:13:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.464+0000 7f77a8ff9700 1 -- 172.21.15.8:0/1270696529 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4005710 con 0x7f77ac102a40 2023-10-06T23:13:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.465+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac1a1330 con 0x7f77ac102a40 2023-10-06T23:13:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.466+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac193400 con 0x7f77ac102a40 2023-10-06T23:13:05.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.467+0000 7f77a8ff9700 1 -- 172.21.15.8:0/1270696529 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f77a4005870 con 0x7f77ac102a40 2023-10-06T23:13:05.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.469+0000 7f77a8ff9700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77940a14d0 0x7f77940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:05.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.469+0000 7f77a8ff9700 1 -- 172.21.15.8:0/1270696529 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77a40cc4b0 con 0x7f77ac102a40 2023-10-06T23:13:05.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.469+0000 7f77ab7fe700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77940a14d0 0x7f77940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:05.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.470+0000 7f77ab7fe700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77940a14d0 0x7f77940a3990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f77ac101bf0 tx=0x7f779c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.473+0000 7f77a8ff9700 1 -- 172.21.15.8:0/1270696529 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f77a4095ac0 con 0x7f77ac102a40 2023-10-06T23:13:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:05 smithi156 ceph-mon[102862]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:05.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:05 smithi156 ceph-mon[102862]: pgmap v356: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2023-10-06T23:13:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:05 smithi008 ceph-mon[98532]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:05 smithi008 ceph-mon[98532]: pgmap v356: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2023-10-06T23:13:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.682+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 --> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77ac02d2f0 con 0x7f77940a14d0 2023-10-06T23:13:05.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:05 smithi190 ceph-mon[102658]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:05.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:05 smithi190 ceph-mon[102658]: pgmap v356: 97 pgs: 97 active+clean; 582 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2023-10-06T23:13:05.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.693+0000 7f77a8ff9700 1 -- 172.21.15.8:0/1270696529 <== mgr.14148 v2:172.21.15.8:6800/3959613712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342711 (secure 0 0 0) 0x7f77ac02d2f0 con 0x7f77940a14d0 2023-10-06T23:13:05.699 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77940a14d0 msgr2=0x7f77940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77940a14d0 0x7f77940a3990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f77ac101bf0 tx=0x7f779c009260 comp rx=0 tx=0).stop 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102a40 msgr2=0x7f77ac1a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102a40 0x7f77ac1a0380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77a4007ee0 tx=0x7f77a400d3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 shutdown_connections 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77940a14d0 0x7f77940a3990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac102a40 0x7f77ac1a0380 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77ac100ea0 0x7f77ac198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 --2- 172.21.15.8:0/1270696529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77ac102080 0x7f77ac199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 >> 172.21.15.8:0/1270696529 conn(0x7f77ac0fc420 msgr2=0x7f77ac107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 shutdown_connections 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.698+0000 7f77b1fff700 1 -- 172.21.15.8:0/1270696529 wait complete. 2023-10-06T23:13:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-06T23:13:05.718 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2023-10-06T23:13:04.969193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596440,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":738,"num_read_kb":425,"num_write":310,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180780,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335700,"kb_used_data":11456,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606124,"statfs":{"total":1151940427776,"available":1151596670976,"internally_reserved":0,"allocated":11730944,"data_stored":7291707,"data_compressed":107433,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":850,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002987"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030740+0000","last_change":"2023-10-06T23:11:18.264036+0000","last_active":"2023-10-06T23:11:49.030740+0000","last_peered":"2023-10-06T23:11:49.030740+0000","last_clean":"2023-10-06T23:11:49.030740+0000","last_became_active":"2023-10-06T23:11:18.261784+0000","last_became_peered":"2023-10-06T23:11:18.261784+0000","last_unstale":"2023-10-06T23:11:49.030740+0000","last_undegraded":"2023-10-06T23:11:49.030740+0000","last_fullsized":"2023-10-06T23:11:49.030740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:17:57.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026996+0000","last_change":"2023-10-06T23:11:18.265181+0000","last_active":"2023-10-06T23:11:49.026996+0000","last_peered":"2023-10-06T23:11:49.026996+0000","last_clean":"2023-10-06T23:11:49.026996+0000","last_became_active":"2023-10-06T23:11:18.264881+0000","last_became_peered":"2023-10-06T23:11:18.264881+0000","last_unstale":"2023-10-06T23:11:49.026996+0000","last_undegraded":"2023-10-06T23:11:49.026996+0000","last_fullsized":"2023-10-06T23:11:49.026996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:17.852643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026807+0000","last_change":"2023-10-06T23:11:18.264321+0000","last_active":"2023-10-06T23:11:49.026807+0000","last_peered":"2023-10-06T23:11:49.026807+0000","last_clean":"2023-10-06T23:11:49.026807+0000","last_became_active":"2023-10-06T23:11:18.263997+0000","last_became_peered":"2023-10-06T23:11:18.263997+0000","last_unstale":"2023-10-06T23:11:49.026807+0000","last_undegraded":"2023-10-06T23:11:49.026807+0000","last_fullsized":"2023-10-06T23:11:49.026807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:38:41.888419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030300+0000","last_change":"2023-10-06T23:11:18.270871+0000","last_active":"2023-10-06T23:11:49.030300+0000","last_peered":"2023-10-06T23:11:49.030300+0000","last_clean":"2023-10-06T23:11:49.030300+0000","last_became_active":"2023-10-06T23:11:18.270288+0000","last_became_peered":"2023-10-06T23:11:18.270288+0000","last_unstale":"2023-10-06T23:11:49.030300+0000","last_undegraded":"2023-10-06T23:11:49.030300+0000","last_fullsized":"2023-10-06T23:11:49.030300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:02:48.819640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032624+0000","last_change":"2023-10-06T23:11:18.261001+0000","last_active":"2023-10-06T23:11:49.032624+0000","last_peered":"2023-10-06T23:11:49.032624+0000","last_clean":"2023-10-06T23:11:49.032624+0000","last_became_active":"2023-10-06T23:11:18.260661+0000","last_became_peered":"2023-10-06T23:11:18.260661+0000","last_unstale":"2023-10-06T23:11:49.032624+0000","last_undegraded":"2023-10-06T23:11:49.032624+0000","last_fullsized":"2023-10-06T23:11:49.032624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:26:42.382235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.036376+0000","last_change":"2023-10-06T23:11:50.036376+0000","last_active":"2023-10-06T23:11:50.036376+0000","last_peered":"2023-10-06T23:11:50.036376+0000","last_clean":"2023-10-06T23:11:50.036376+0000","last_became_active":"2023-10-06T23:11:50.035945+0000","last_became_peered":"2023-10-06T23:11:50.035945+0000","last_unstale":"2023-10-06T23:11:50.036376+0000","last_undegraded":"2023-10-06T23:11:50.036376+0000","last_fullsized":"2023-10-06T23:11:50.036376+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:50:33.237128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036114+0000","last_change":"2023-10-06T23:11:18.263968+0000","last_active":"2023-10-06T23:11:49.036114+0000","last_peered":"2023-10-06T23:11:49.036114+0000","last_clean":"2023-10-06T23:11:49.036114+0000","last_became_active":"2023-10-06T23:11:18.263634+0000","last_became_peered":"2023-10-06T23:11:18.263634+0000","last_unstale":"2023-10-06T23:11:49.036114+0000","last_undegraded":"2023-10-06T23:11:49.036114+0000","last_fullsized":"2023-10-06T23:11:49.036114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:18:23.856232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035537+0000","last_change":"2023-10-06T23:11:18.268945+0000","last_active":"2023-10-06T23:11:49.035537+0000","last_peered":"2023-10-06T23:11:49.035537+0000","last_clean":"2023-10-06T23:11:49.035537+0000","last_became_active":"2023-10-06T23:11:18.268598+0000","last_became_peered":"2023-10-06T23:11:18.268598+0000","last_unstale":"2023-10-06T23:11:49.035537+0000","last_undegraded":"2023-10-06T23:11:49.035537+0000","last_fullsized":"2023-10-06T23:11:49.035537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:09:21.238230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042773+0000","last_change":"2023-10-06T23:11:18.261872+0000","last_active":"2023-10-06T23:11:49.042773+0000","last_peered":"2023-10-06T23:11:49.042773+0000","last_clean":"2023-10-06T23:11:49.042773+0000","last_became_active":"2023-10-06T23:11:18.261583+0000","last_became_peered":"2023-10-06T23:11:18.261583+0000","last_unstale":"2023-10-06T23:11:49.042773+0000","last_undegraded":"2023-10-06T23:11:49.042773+0000","last_fullsized":"2023-10-06T23:11:49.042773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:50:54.145738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039796+0000","last_change":"2023-10-06T23:11:50.039796+0000","last_active":"2023-10-06T23:11:50.039796+0000","last_peered":"2023-10-06T23:11:50.039796+0000","last_clean":"2023-10-06T23:11:50.039796+0000","last_became_active":"2023-10-06T23:11:50.039420+0000","last_became_peered":"2023-10-06T23:11:50.039420+0000","last_unstale":"2023-10-06T23:11:50.039796+0000","last_undegraded":"2023-10-06T23:11:50.039796+0000","last_fullsized":"2023-10-06T23:11:50.039796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:28.641948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036360+0000","last_change":"2023-10-06T23:11:18.266565+0000","last_active":"2023-10-06T23:11:49.036360+0000","last_peered":"2023-10-06T23:11:49.036360+0000","last_clean":"2023-10-06T23:11:49.036360+0000","last_became_active":"2023-10-06T23:11:18.266290+0000","last_became_peered":"2023-10-06T23:11:18.266290+0000","last_unstale":"2023-10-06T23:11:49.036360+0000","last_undegraded":"2023-10-06T23:11:49.036360+0000","last_fullsized":"2023-10-06T23:11:49.036360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:45:07.828100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030127+0000","last_change":"2023-10-06T23:11:18.266849+0000","last_active":"2023-10-06T23:11:49.030127+0000","last_peered":"2023-10-06T23:11:49.030127+0000","last_clean":"2023-10-06T23:11:49.030127+0000","last_became_active":"2023-10-06T23:11:18.266517+0000","last_became_peered":"2023-10-06T23:11:18.266517+0000","last_unstale":"2023-10-06T23:11:49.030127+0000","last_undegraded":"2023-10-06T23:11:49.030127+0000","last_fullsized":"2023-10-06T23:11:49.030127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:25:31.988065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031565+0000","last_change":"2023-10-06T23:11:18.270336+0000","last_active":"2023-10-06T23:11:49.031565+0000","last_peered":"2023-10-06T23:11:49.031565+0000","last_clean":"2023-10-06T23:11:49.031565+0000","last_became_active":"2023-10-06T23:11:18.269969+0000","last_became_peered":"2023-10-06T23:11:18.269969+0000","last_unstale":"2023-10-06T23:11:49.031565+0000","last_undegraded":"2023-10-06T23:11:49.031565+0000","last_fullsized":"2023-10-06T23:11:49.031565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:25.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026121+0000","last_change":"2023-10-06T23:11:18.264549+0000","last_active":"2023-10-06T23:11:49.026121+0000","last_peered":"2023-10-06T23:11:49.026121+0000","last_clean":"2023-10-06T23:11:49.026121+0000","last_became_active":"2023-10-06T23:11:18.263446+0000","last_became_peered":"2023-10-06T23:11:18.263446+0000","last_unstale":"2023-10-06T23:11:49.026121+0000","last_undegraded":"2023-10-06T23:11:49.026121+0000","last_fullsized":"2023-10-06T23:11:49.026121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:21:57.009374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026364+0000","last_change":"2023-10-06T23:11:18.262470+0000","last_active":"2023-10-06T23:11:49.026364+0000","last_peered":"2023-10-06T23:11:49.026364+0000","last_clean":"2023-10-06T23:11:49.026364+0000","last_became_active":"2023-10-06T23:11:18.262134+0000","last_became_peered":"2023-10-06T23:11:18.262134+0000","last_unstale":"2023-10-06T23:11:49.026364+0000","last_undegraded":"2023-10-06T23:11:49.026364+0000","last_fullsized":"2023-10-06T23:11:49.026364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:09:26.745107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042326+0000","last_change":"2023-10-06T23:11:18.260657+0000","last_active":"2023-10-06T23:11:49.042326+0000","last_peered":"2023-10-06T23:11:49.042326+0000","last_clean":"2023-10-06T23:11:49.042326+0000","last_became_active":"2023-10-06T23:11:18.260343+0000","last_became_peered":"2023-10-06T23:11:18.260343+0000","last_unstale":"2023-10-06T23:11:49.042326+0000","last_undegraded":"2023-10-06T23:11:49.042326+0000","last_fullsized":"2023-10-06T23:11:49.042326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:46:24.199333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030882+0000","last_change":"2023-10-06T23:11:18.262071+0000","last_active":"2023-10-06T23:11:49.030882+0000","last_peered":"2023-10-06T23:11:49.030882+0000","last_clean":"2023-10-06T23:11:49.030882+0000","last_became_active":"2023-10-06T23:11:18.261348+0000","last_became_peered":"2023-10-06T23:11:18.261348+0000","last_unstale":"2023-10-06T23:11:49.030882+0000","last_undegraded":"2023-10-06T23:11:49.030882+0000","last_fullsized":"2023-10-06T23:11:49.030882+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:57:54.957156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033065+0000","last_change":"2023-10-06T23:11:18.266593+0000","last_active":"2023-10-06T23:11:49.033065+0000","last_peered":"2023-10-06T23:11:49.033065+0000","last_clean":"2023-10-06T23:11:49.033065+0000","last_became_active":"2023-10-06T23:11:18.266293+0000","last_became_peered":"2023-10-06T23:11:18.266293+0000","last_unstale":"2023-10-06T23:11:49.033065+0000","last_undegraded":"2023-10-06T23:11:49.033065+0000","last_fullsized":"2023-10-06T23:11:49.033065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:03:45.130437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037218+0000","last_change":"2023-10-06T23:11:18.264871+0000","last_active":"2023-10-06T23:11:49.037218+0000","last_peered":"2023-10-06T23:11:49.037218+0000","last_clean":"2023-10-06T23:11:49.037218+0000","last_became_active":"2023-10-06T23:11:18.264451+0000","last_became_peered":"2023-10-06T23:11:18.264451+0000","last_unstale":"2023-10-06T23:11:49.037218+0000","last_undegraded":"2023-10-06T23:11:49.037218+0000","last_fullsized":"2023-10-06T23:11:49.037218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:40:00.581508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033336+0000","last_change":"2023-10-06T23:11:17.255867+0000","last_active":"2023-10-06T23:11:49.033336+0000","last_peered":"2023-10-06T23:11:49.033336+0000","last_clean":"2023-10-06T23:11:49.033336+0000","last_became_active":"2023-10-06T23:11:17.255463+0000","last_became_peered":"2023-10-06T23:11:17.255463+0000","last_unstale":"2023-10-06T23:11:49.033336+0000","last_undegraded":"2023-10-06T23:11:49.033336+0000","last_fullsized":"2023-10-06T23:11:49.033336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:21:29.493049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037811+0000","last_change":"2023-10-06T23:11:18.262575+0000","last_active":"2023-10-06T23:11:49.037811+0000","last_peered":"2023-10-06T23:11:49.037811+0000","last_clean":"2023-10-06T23:11:49.037811+0000","last_became_active":"2023-10-06T23:11:18.262266+0000","last_became_peered":"2023-10-06T23:11:18.262266+0000","last_unstale":"2023-10-06T23:11:49.037811+0000","last_undegraded":"2023-10-06T23:11:49.037811+0000","last_fullsized":"2023-10-06T23:11:49.037811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:37:10.870786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037989+0000","last_change":"2023-10-06T23:11:17.259061+0000","last_active":"2023-10-06T23:11:49.037989+0000","last_peered":"2023-10-06T23:11:49.037989+0000","last_clean":"2023-10-06T23:11:49.037989+0000","last_became_active":"2023-10-06T23:11:17.258624+0000","last_became_peered":"2023-10-06T23:11:17.258624+0000","last_unstale":"2023-10-06T23:11:49.037989+0000","last_undegraded":"2023-10-06T23:11:49.037989+0000","last_fullsized":"2023-10-06T23:11:49.037989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:28.121405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027230+0000","last_change":"2023-10-06T23:11:18.263840+0000","last_active":"2023-10-06T23:11:49.027230+0000","last_peered":"2023-10-06T23:11:49.027230+0000","last_clean":"2023-10-06T23:11:49.027230+0000","last_became_active":"2023-10-06T23:11:18.263454+0000","last_became_peered":"2023-10-06T23:11:18.263454+0000","last_unstale":"2023-10-06T23:11:49.027230+0000","last_undegraded":"2023-10-06T23:11:49.027230+0000","last_fullsized":"2023-10-06T23:11:49.027230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:49.462270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.044245+0000","last_change":"2023-10-06T23:11:50.044245+0000","last_active":"2023-10-06T23:11:50.044245+0000","last_peered":"2023-10-06T23:11:50.044245+0000","last_clean":"2023-10-06T23:11:50.044245+0000","last_became_active":"2023-10-06T23:11:50.038493+0000","last_became_peered":"2023-10-06T23:11:50.038493+0000","last_unstale":"2023-10-06T23:11:50.044245+0000","last_undegraded":"2023-10-06T23:11:50.044245+0000","last_fullsized":"2023-10-06T23:11:50.044245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:19.463617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042312+0000","last_change":"2023-10-06T23:11:18.274068+0000","last_active":"2023-10-06T23:11:49.042312+0000","last_peered":"2023-10-06T23:11:49.042312+0000","last_clean":"2023-10-06T23:11:49.042312+0000","last_became_active":"2023-10-06T23:11:18.273692+0000","last_became_peered":"2023-10-06T23:11:18.273692+0000","last_unstale":"2023-10-06T23:11:49.042312+0000","last_undegraded":"2023-10-06T23:11:49.042312+0000","last_fullsized":"2023-10-06T23:11:49.042312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:57:07.735915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032982+0000","last_change":"2023-10-06T23:11:17.260046+0000","last_active":"2023-10-06T23:11:49.032982+0000","last_peered":"2023-10-06T23:11:49.032982+0000","last_clean":"2023-10-06T23:11:49.032982+0000","last_became_active":"2023-10-06T23:11:17.259638+0000","last_became_peered":"2023-10-06T23:11:17.259638+0000","last_unstale":"2023-10-06T23:11:49.032982+0000","last_undegraded":"2023-10-06T23:11:49.032982+0000","last_fullsized":"2023-10-06T23:11:49.032982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:21.660072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035736+0000","last_change":"2023-10-06T23:11:18.264328+0000","last_active":"2023-10-06T23:11:49.035736+0000","last_peered":"2023-10-06T23:11:49.035736+0000","last_clean":"2023-10-06T23:11:49.035736+0000","last_became_active":"2023-10-06T23:11:18.263554+0000","last_became_peered":"2023-10-06T23:11:18.263554+0000","last_unstale":"2023-10-06T23:11:49.035736+0000","last_undegraded":"2023-10-06T23:11:49.035736+0000","last_fullsized":"2023-10-06T23:11:49.035736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:44:02.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:13:00.412755+0000","last_change":"2023-10-06T23:11:17.265538+0000","last_active":"2023-10-06T23:13:00.412755+0000","last_peered":"2023-10-06T23:13:00.412755+0000","last_clean":"2023-10-06T23:13:00.412755+0000","last_became_active":"2023-10-06T23:11:17.265044+0000","last_became_peered":"2023-10-06T23:11:17.265044+0000","last_unstale":"2023-10-06T23:13:00.412755+0000","last_undegraded":"2023-10-06T23:13:00.412755+0000","last_fullsized":"2023-10-06T23:13:00.412755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:29:51.220961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1047,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032801+0000","last_change":"2023-10-06T23:11:18.257044+0000","last_active":"2023-10-06T23:11:49.032801+0000","last_peered":"2023-10-06T23:11:49.032801+0000","last_clean":"2023-10-06T23:11:49.032801+0000","last_became_active":"2023-10-06T23:11:18.256711+0000","last_became_peered":"2023-10-06T23:11:18.256711+0000","last_unstale":"2023-10-06T23:11:49.032801+0000","last_undegraded":"2023-10-06T23:11:49.032801+0000","last_fullsized":"2023-10-06T23:11:49.032801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:40:25.441143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032501+0000","last_change":"2023-10-06T23:11:17.262062+0000","last_active":"2023-10-06T23:11:49.032501+0000","last_peered":"2023-10-06T23:11:49.032501+0000","last_clean":"2023-10-06T23:11:49.032501+0000","last_became_active":"2023-10-06T23:11:17.261618+0000","last_became_peered":"2023-10-06T23:11:17.261618+0000","last_unstale":"2023-10-06T23:11:49.032501+0000","last_undegraded":"2023-10-06T23:11:49.032501+0000","last_fullsized":"2023-10-06T23:11:49.032501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:59:33.544470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034757+0000","last_change":"2023-10-06T23:11:18.263242+0000","last_active":"2023-10-06T23:11:49.034757+0000","last_peered":"2023-10-06T23:11:49.034757+0000","last_clean":"2023-10-06T23:11:49.034757+0000","last_became_active":"2023-10-06T23:11:18.262684+0000","last_became_peered":"2023-10-06T23:11:18.262684+0000","last_unstale":"2023-10-06T23:11:49.034757+0000","last_undegraded":"2023-10-06T23:11:49.034757+0000","last_fullsized":"2023-10-06T23:11:49.034757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:30:04.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032315+0000","last_change":"2023-10-06T23:11:17.254042+0000","last_active":"2023-10-06T23:11:49.032315+0000","last_peered":"2023-10-06T23:11:49.032315+0000","last_clean":"2023-10-06T23:11:49.032315+0000","last_became_active":"2023-10-06T23:11:17.253704+0000","last_became_peered":"2023-10-06T23:11:17.253704+0000","last_unstale":"2023-10-06T23:11:49.032315+0000","last_undegraded":"2023-10-06T23:11:49.032315+0000","last_fullsized":"2023-10-06T23:11:49.032315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:44.179814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035458+0000","last_change":"2023-10-06T23:11:18.259161+0000","last_active":"2023-10-06T23:11:49.035458+0000","last_peered":"2023-10-06T23:11:49.035458+0000","last_clean":"2023-10-06T23:11:49.035458+0000","last_became_active":"2023-10-06T23:11:18.258747+0000","last_became_peered":"2023-10-06T23:11:18.258747+0000","last_unstale":"2023-10-06T23:11:49.035458+0000","last_undegraded":"2023-10-06T23:11:49.035458+0000","last_fullsized":"2023-10-06T23:11:49.035458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:55:38.340988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034650+0000","last_change":"2023-10-06T23:11:17.266278+0000","last_active":"2023-10-06T23:11:49.034650+0000","last_peered":"2023-10-06T23:11:49.034650+0000","last_clean":"2023-10-06T23:11:49.034650+0000","last_became_active":"2023-10-06T23:11:17.265174+0000","last_became_peered":"2023-10-06T23:11:17.265174+0000","last_unstale":"2023-10-06T23:11:49.034650+0000","last_undegraded":"2023-10-06T23:11:49.034650+0000","last_fullsized":"2023-10-06T23:11:49.034650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:51.203566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032078+0000","last_change":"2023-10-06T23:11:18.259699+0000","last_active":"2023-10-06T23:11:49.032078+0000","last_peered":"2023-10-06T23:11:49.032078+0000","last_clean":"2023-10-06T23:11:49.032078+0000","last_became_active":"2023-10-06T23:11:18.259395+0000","last_became_peered":"2023-10-06T23:11:18.259395+0000","last_unstale":"2023-10-06T23:11:49.032078+0000","last_undegraded":"2023-10-06T23:11:49.032078+0000","last_fullsized":"2023-10-06T23:11:49.032078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:32:37.830092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":117,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:58.407910+0000","last_change":"2023-10-06T23:11:17.259592+0000","last_active":"2023-10-06T23:12:58.407910+0000","last_peered":"2023-10-06T23:12:58.407910+0000","last_clean":"2023-10-06T23:12:58.407910+0000","last_became_active":"2023-10-06T23:11:17.259254+0000","last_became_peered":"2023-10-06T23:11:17.259254+0000","last_unstale":"2023-10-06T23:12:58.407910+0000","last_undegraded":"2023-10-06T23:12:58.407910+0000","last_fullsized":"2023-10-06T23:12:58.407910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:31.633620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042667+0000","last_change":"2023-10-06T23:11:18.271568+0000","last_active":"2023-10-06T23:11:49.042667+0000","last_peered":"2023-10-06T23:11:49.042667+0000","last_clean":"2023-10-06T23:11:49.042667+0000","last_became_active":"2023-10-06T23:11:18.271248+0000","last_became_peered":"2023-10-06T23:11:18.271248+0000","last_unstale":"2023-10-06T23:11:49.042667+0000","last_undegraded":"2023-10-06T23:11:49.042667+0000","last_fullsized":"2023-10-06T23:11:49.042667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:29:30.138803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036265+0000","last_change":"2023-10-06T23:11:17.257823+0000","last_active":"2023-10-06T23:11:49.036265+0000","last_peered":"2023-10-06T23:11:49.036265+0000","last_clean":"2023-10-06T23:11:49.036265+0000","last_became_active":"2023-10-06T23:11:17.257426+0000","last_became_peered":"2023-10-06T23:11:17.257426+0000","last_unstale":"2023-10-06T23:11:49.036265+0000","last_undegraded":"2023-10-06T23:11:49.036265+0000","last_fullsized":"2023-10-06T23:11:49.036265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:27:17.158360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027188+0000","last_change":"2023-10-06T23:11:18.260555+0000","last_active":"2023-10-06T23:11:49.027188+0000","last_peered":"2023-10-06T23:11:49.027188+0000","last_clean":"2023-10-06T23:11:49.027188+0000","last_became_active":"2023-10-06T23:11:18.260236+0000","last_became_peered":"2023-10-06T23:11:18.260236+0000","last_unstale":"2023-10-06T23:11:49.027188+0000","last_undegraded":"2023-10-06T23:11:49.027188+0000","last_fullsized":"2023-10-06T23:11:49.027188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:51.499668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035946+0000","last_change":"2023-10-06T23:11:17.267686+0000","last_active":"2023-10-06T23:11:49.035946+0000","last_peered":"2023-10-06T23:11:49.035946+0000","last_clean":"2023-10-06T23:11:49.035946+0000","last_became_active":"2023-10-06T23:11:17.267322+0000","last_became_peered":"2023-10-06T23:11:17.267322+0000","last_unstale":"2023-10-06T23:11:49.035946+0000","last_undegraded":"2023-10-06T23:11:49.035946+0000","last_fullsized":"2023-10-06T23:11:49.035946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:48:40.755898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042418+0000","last_change":"2023-10-06T23:11:18.257382+0000","last_active":"2023-10-06T23:11:49.042418+0000","last_peered":"2023-10-06T23:11:49.042418+0000","last_clean":"2023-10-06T23:11:49.042418+0000","last_became_active":"2023-10-06T23:11:18.256572+0000","last_became_peered":"2023-10-06T23:11:18.256572+0000","last_unstale":"2023-10-06T23:11:49.042418+0000","last_undegraded":"2023-10-06T23:11:49.042418+0000","last_fullsized":"2023-10-06T23:11:49.042418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:06:43.631813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'10","reported_seq":223,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:13:00.095849+0000","last_change":"2023-10-06T23:11:17.257340+0000","last_active":"2023-10-06T23:13:00.095849+0000","last_peered":"2023-10-06T23:13:00.095849+0000","last_clean":"2023-10-06T23:13:00.095849+0000","last_became_active":"2023-10-06T23:11:17.256973+0000","last_became_peered":"2023-10-06T23:11:17.256973+0000","last_unstale":"2023-10-06T23:13:00.095849+0000","last_undegraded":"2023-10-06T23:13:00.095849+0000","last_fullsized":"2023-10-06T23:13:00.095849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:35.688357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2037,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":100,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033409+0000","last_change":"2023-10-06T23:11:18.258928+0000","last_active":"2023-10-06T23:11:49.033409+0000","last_peered":"2023-10-06T23:11:49.033409+0000","last_clean":"2023-10-06T23:11:49.033409+0000","last_became_active":"2023-10-06T23:11:18.258572+0000","last_became_peered":"2023-10-06T23:11:18.258572+0000","last_unstale":"2023-10-06T23:11:49.033409+0000","last_undegraded":"2023-10-06T23:11:49.033409+0000","last_fullsized":"2023-10-06T23:11:49.033409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:51.059399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037051+0000","last_change":"2023-10-06T23:11:17.260955+0000","last_active":"2023-10-06T23:11:49.037051+0000","last_peered":"2023-10-06T23:11:49.037051+0000","last_clean":"2023-10-06T23:11:49.037051+0000","last_became_active":"2023-10-06T23:11:17.260565+0000","last_became_peered":"2023-10-06T23:11:17.260565+0000","last_unstale":"2023-10-06T23:11:49.037051+0000","last_undegraded":"2023-10-06T23:11:49.037051+0000","last_fullsized":"2023-10-06T23:11:49.037051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:14:51.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031110+0000","last_change":"2023-10-06T23:11:18.266857+0000","last_active":"2023-10-06T23:11:49.031110+0000","last_peered":"2023-10-06T23:11:49.031110+0000","last_clean":"2023-10-06T23:11:49.031110+0000","last_became_active":"2023-10-06T23:11:18.266476+0000","last_became_peered":"2023-10-06T23:11:18.266476+0000","last_unstale":"2023-10-06T23:11:49.031110+0000","last_undegraded":"2023-10-06T23:11:49.031110+0000","last_fullsized":"2023-10-06T23:11:49.031110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:23:26.131492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035426+0000","last_change":"2023-10-06T23:11:17.265672+0000","last_active":"2023-10-06T23:11:49.035426+0000","last_peered":"2023-10-06T23:11:49.035426+0000","last_clean":"2023-10-06T23:11:49.035426+0000","last_became_active":"2023-10-06T23:11:17.265329+0000","last_became_peered":"2023-10-06T23:11:17.265329+0000","last_unstale":"2023-10-06T23:11:49.035426+0000","last_undegraded":"2023-10-06T23:11:49.035426+0000","last_fullsized":"2023-10-06T23:11:49.035426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:43.159919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036115+0000","last_change":"2023-10-06T23:11:18.269427+0000","last_active":"2023-10-06T23:11:49.036115+0000","last_peered":"2023-10-06T23:11:49.036115+0000","last_clean":"2023-10-06T23:11:49.036115+0000","last_became_active":"2023-10-06T23:11:18.269115+0000","last_became_peered":"2023-10-06T23:11:18.269115+0000","last_unstale":"2023-10-06T23:11:49.036115+0000","last_undegraded":"2023-10-06T23:11:49.036115+0000","last_fullsized":"2023-10-06T23:11:49.036115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:02:12.598526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:12:59.407905+0000","last_change":"2023-10-06T23:11:17.252599+0000","last_active":"2023-10-06T23:12:59.407905+0000","last_peered":"2023-10-06T23:12:59.407905+0000","last_clean":"2023-10-06T23:12:59.407905+0000","last_became_active":"2023-10-06T23:11:17.251893+0000","last_became_peered":"2023-10-06T23:11:17.251893+0000","last_unstale":"2023-10-06T23:12:59.407905+0000","last_undegraded":"2023-10-06T23:12:59.407905+0000","last_fullsized":"2023-10-06T23:12:59.407905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:24:10.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035840+0000","last_change":"2023-10-06T23:11:18.269026+0000","last_active":"2023-10-06T23:11:49.035840+0000","last_peered":"2023-10-06T23:11:49.035840+0000","last_clean":"2023-10-06T23:11:49.035840+0000","last_became_active":"2023-10-06T23:11:18.268701+0000","last_became_peered":"2023-10-06T23:11:18.268701+0000","last_unstale":"2023-10-06T23:11:49.035840+0000","last_undegraded":"2023-10-06T23:11:49.035840+0000","last_fullsized":"2023-10-06T23:11:49.035840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:03:25.903664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032636+0000","last_change":"2023-10-06T23:11:17.255323+0000","last_active":"2023-10-06T23:11:49.032636+0000","last_peered":"2023-10-06T23:11:49.032636+0000","last_clean":"2023-10-06T23:11:49.032636+0000","last_became_active":"2023-10-06T23:11:17.254975+0000","last_became_peered":"2023-10-06T23:11:17.254975+0000","last_unstale":"2023-10-06T23:11:49.032636+0000","last_undegraded":"2023-10-06T23:11:49.032636+0000","last_fullsized":"2023-10-06T23:11:49.032636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:41:35.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035228+0000","last_change":"2023-10-06T23:11:18.263290+0000","last_active":"2023-10-06T23:11:49.035228+0000","last_peered":"2023-10-06T23:11:49.035228+0000","last_clean":"2023-10-06T23:11:49.035228+0000","last_became_active":"2023-10-06T23:11:18.262680+0000","last_became_peered":"2023-10-06T23:11:18.262680+0000","last_unstale":"2023-10-06T23:11:49.035228+0000","last_undegraded":"2023-10-06T23:11:49.035228+0000","last_fullsized":"2023-10-06T23:11:49.035228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:43:12.249803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.048876+0000","last_change":"2023-10-06T23:11:50.048453+0000","last_active":"2023-10-06T23:11:50.048876+0000","last_peered":"2023-10-06T23:11:50.048876+0000","last_clean":"2023-10-06T23:11:50.048876+0000","last_became_active":"2023-10-06T23:11:50.035200+0000","last_became_peered":"2023-10-06T23:11:50.035200+0000","last_unstale":"2023-10-06T23:11:50.048876+0000","last_undegraded":"2023-10-06T23:11:50.048876+0000","last_fullsized":"2023-10-06T23:11:50.048876+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:31:21.791916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.032715+0000","last_change":"2023-10-06T23:11:50.032715+0000","last_active":"2023-10-06T23:11:50.032715+0000","last_peered":"2023-10-06T23:11:50.032715+0000","last_clean":"2023-10-06T23:11:50.032715+0000","last_became_active":"2023-10-06T23:11:50.032326+0000","last_became_peered":"2023-10-06T23:11:50.032326+0000","last_unstale":"2023-10-06T23:11:50.032715+0000","last_undegraded":"2023-10-06T23:11:50.032715+0000","last_fullsized":"2023-10-06T23:11:50.032715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:26:25.453692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032907+0000","last_change":"2023-10-06T23:11:17.258175+0000","last_active":"2023-10-06T23:11:49.032907+0000","last_peered":"2023-10-06T23:11:49.032907+0000","last_clean":"2023-10-06T23:11:49.032907+0000","last_became_active":"2023-10-06T23:11:17.257780+0000","last_became_peered":"2023-10-06T23:11:17.257780+0000","last_unstale":"2023-10-06T23:11:49.032907+0000","last_undegraded":"2023-10-06T23:11:49.032907+0000","last_fullsized":"2023-10-06T23:11:49.032907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:19:51.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033026+0000","last_change":"2023-10-06T23:11:18.267837+0000","last_active":"2023-10-06T23:11:49.033026+0000","last_peered":"2023-10-06T23:11:49.033026+0000","last_clean":"2023-10-06T23:11:49.033026+0000","last_became_active":"2023-10-06T23:11:18.267535+0000","last_became_peered":"2023-10-06T23:11:18.267535+0000","last_unstale":"2023-10-06T23:11:49.033026+0000","last_undegraded":"2023-10-06T23:11:49.033026+0000","last_fullsized":"2023-10-06T23:11:49.033026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:35:08.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036029+0000","last_change":"2023-10-06T23:11:17.261075+0000","last_active":"2023-10-06T23:11:49.036029+0000","last_peered":"2023-10-06T23:11:49.036029+0000","last_clean":"2023-10-06T23:11:49.036029+0000","last_became_active":"2023-10-06T23:11:17.260456+0000","last_became_peered":"2023-10-06T23:11:17.260456+0000","last_unstale":"2023-10-06T23:11:49.036029+0000","last_undegraded":"2023-10-06T23:11:49.036029+0000","last_fullsized":"2023-10-06T23:11:49.036029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:00:25.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032760+0000","last_change":"2023-10-06T23:11:18.265347+0000","last_active":"2023-10-06T23:11:49.032760+0000","last_peered":"2023-10-06T23:11:49.032760+0000","last_clean":"2023-10-06T23:11:49.032760+0000","last_became_active":"2023-10-06T23:11:18.265034+0000","last_became_peered":"2023-10-06T23:11:18.265034+0000","last_unstale":"2023-10-06T23:11:49.032760+0000","last_undegraded":"2023-10-06T23:11:49.032760+0000","last_fullsized":"2023-10-06T23:11:49.032760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:32:44.253022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034992+0000","last_change":"2023-10-06T23:11:18.263990+0000","last_active":"2023-10-06T23:11:49.034992+0000","last_peered":"2023-10-06T23:11:49.034992+0000","last_clean":"2023-10-06T23:11:49.034992+0000","last_became_active":"2023-10-06T23:11:18.262760+0000","last_became_peered":"2023-10-06T23:11:18.262760+0000","last_unstale":"2023-10-06T23:11:49.034992+0000","last_undegraded":"2023-10-06T23:11:49.034992+0000","last_fullsized":"2023-10-06T23:11:49.034992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:48:51.754187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:13:01.410223+0000","last_change":"2023-10-06T23:11:17.263187+0000","last_active":"2023-10-06T23:13:01.410223+0000","last_peered":"2023-10-06T23:13:01.410223+0000","last_clean":"2023-10-06T23:13:01.410223+0000","last_became_active":"2023-10-06T23:11:17.262770+0000","last_became_peered":"2023-10-06T23:11:17.262770+0000","last_unstale":"2023-10-06T23:13:01.410223+0000","last_undegraded":"2023-10-06T23:13:01.410223+0000","last_fullsized":"2023-10-06T23:13:01.410223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:27.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036248+0000","last_change":"2023-10-06T23:11:18.264305+0000","last_active":"2023-10-06T23:11:49.036248+0000","last_peered":"2023-10-06T23:11:49.036248+0000","last_clean":"2023-10-06T23:11:49.036248+0000","last_became_active":"2023-10-06T23:11:18.263964+0000","last_became_peered":"2023-10-06T23:11:18.263964+0000","last_unstale":"2023-10-06T23:11:49.036248+0000","last_undegraded":"2023-10-06T23:11:49.036248+0000","last_fullsized":"2023-10-06T23:11:49.036248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:11.855254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030137+0000","last_change":"2023-10-06T23:11:17.249832+0000","last_active":"2023-10-06T23:11:49.030137+0000","last_peered":"2023-10-06T23:11:49.030137+0000","last_clean":"2023-10-06T23:11:49.030137+0000","last_became_active":"2023-10-06T23:11:17.249425+0000","last_became_peered":"2023-10-06T23:11:17.249425+0000","last_unstale":"2023-10-06T23:11:49.030137+0000","last_undegraded":"2023-10-06T23:11:49.030137+0000","last_fullsized":"2023-10-06T23:11:49.030137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:02:49.349981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":313,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.036797+0000","last_change":"2023-10-06T23:09:57.868881+0000","last_active":"2023-10-06T23:11:50.036797+0000","last_peered":"2023-10-06T23:11:50.036797+0000","last_clean":"2023-10-06T23:11:50.036797+0000","last_became_active":"2023-10-06T23:09:57.868450+0000","last_became_peered":"2023-10-06T23:09:57.868450+0000","last_unstale":"2023-10-06T23:11:50.036797+0000","last_undegraded":"2023-10-06T23:11:50.036797+0000","last_fullsized":"2023-10-06T23:11:50.036797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:06:23.790096+0000","last_clean_scrub_stamp":"2023-10-06T23:06:23.790096+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:39:38.741355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.039829+0000","last_change":"2023-10-06T23:11:50.039829+0000","last_active":"2023-10-06T23:11:50.039829+0000","last_peered":"2023-10-06T23:11:50.039829+0000","last_clean":"2023-10-06T23:11:50.039829+0000","last_became_active":"2023-10-06T23:11:50.039403+0000","last_became_peered":"2023-10-06T23:11:50.039403+0000","last_unstale":"2023-10-06T23:11:50.039829+0000","last_undegraded":"2023-10-06T23:11:50.039829+0000","last_fullsized":"2023-10-06T23:11:50.039829+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:08:33.599164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036051+0000","last_change":"2023-10-06T23:11:17.259610+0000","last_active":"2023-10-06T23:11:49.036051+0000","last_peered":"2023-10-06T23:11:49.036051+0000","last_clean":"2023-10-06T23:11:49.036051+0000","last_became_active":"2023-10-06T23:11:17.259314+0000","last_became_peered":"2023-10-06T23:11:17.259314+0000","last_unstale":"2023-10-06T23:11:49.036051+0000","last_undegraded":"2023-10-06T23:11:49.036051+0000","last_fullsized":"2023-10-06T23:11:49.036051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:45:48.131199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.040322+0000","last_change":"2023-10-06T23:11:50.039550+0000","last_active":"2023-10-06T23:11:50.040322+0000","last_peered":"2023-10-06T23:11:50.040322+0000","last_clean":"2023-10-06T23:11:50.040322+0000","last_became_active":"2023-10-06T23:11:50.033804+0000","last_became_peered":"2023-10-06T23:11:50.033804+0000","last_unstale":"2023-10-06T23:11:50.040322+0000","last_undegraded":"2023-10-06T23:11:50.040322+0000","last_fullsized":"2023-10-06T23:11:50.040322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:06.172652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031729+0000","last_change":"2023-10-06T23:11:18.259562+0000","last_active":"2023-10-06T23:11:49.031729+0000","last_peered":"2023-10-06T23:11:49.031729+0000","last_clean":"2023-10-06T23:11:49.031729+0000","last_became_active":"2023-10-06T23:11:18.259188+0000","last_became_peered":"2023-10-06T23:11:18.259188+0000","last_unstale":"2023-10-06T23:11:49.031729+0000","last_undegraded":"2023-10-06T23:11:49.031729+0000","last_fullsized":"2023-10-06T23:11:49.031729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:19.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.033164+0000","last_change":"2023-10-06T23:11:17.260888+0000","last_active":"2023-10-06T23:11:49.033164+0000","last_peered":"2023-10-06T23:11:49.033164+0000","last_clean":"2023-10-06T23:11:49.033164+0000","last_became_active":"2023-10-06T23:11:17.260563+0000","last_became_peered":"2023-10-06T23:11:17.260563+0000","last_unstale":"2023-10-06T23:11:49.033164+0000","last_undegraded":"2023-10-06T23:11:49.033164+0000","last_fullsized":"2023-10-06T23:11:49.033164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:43.087389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036989+0000","last_change":"2023-10-06T23:11:18.261401+0000","last_active":"2023-10-06T23:11:49.036989+0000","last_peered":"2023-10-06T23:11:49.036989+0000","last_clean":"2023-10-06T23:11:49.036989+0000","last_became_active":"2023-10-06T23:11:18.261037+0000","last_became_peered":"2023-10-06T23:11:18.261037+0000","last_unstale":"2023-10-06T23:11:49.036989+0000","last_undegraded":"2023-10-06T23:11:49.036989+0000","last_fullsized":"2023-10-06T23:11:49.036989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:53.298980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030447+0000","last_change":"2023-10-06T23:11:17.264907+0000","last_active":"2023-10-06T23:11:49.030447+0000","last_peered":"2023-10-06T23:11:49.030447+0000","last_clean":"2023-10-06T23:11:49.030447+0000","last_became_active":"2023-10-06T23:11:17.264426+0000","last_became_peered":"2023-10-06T23:11:17.264426+0000","last_unstale":"2023-10-06T23:11:49.030447+0000","last_undegraded":"2023-10-06T23:11:49.030447+0000","last_fullsized":"2023-10-06T23:11:49.030447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:57:21.330048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.027045+0000","last_change":"2023-10-06T23:11:18.259337+0000","last_active":"2023-10-06T23:11:49.027045+0000","last_peered":"2023-10-06T23:11:49.027045+0000","last_clean":"2023-10-06T23:11:49.027045+0000","last_became_active":"2023-10-06T23:11:18.259008+0000","last_became_peered":"2023-10-06T23:11:18.259008+0000","last_unstale":"2023-10-06T23:11:49.027045+0000","last_undegraded":"2023-10-06T23:11:49.027045+0000","last_fullsized":"2023-10-06T23:11:49.027045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:23:28.845368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042510+0000","last_change":"2023-10-06T23:11:17.267695+0000","last_active":"2023-10-06T23:11:49.042510+0000","last_peered":"2023-10-06T23:11:49.042510+0000","last_clean":"2023-10-06T23:11:49.042510+0000","last_became_active":"2023-10-06T23:11:17.267292+0000","last_became_peered":"2023-10-06T23:11:17.267292+0000","last_unstale":"2023-10-06T23:11:49.042510+0000","last_undegraded":"2023-10-06T23:11:49.042510+0000","last_fullsized":"2023-10-06T23:11:49.042510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:36:54.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032536+0000","last_change":"2023-10-06T23:11:18.260012+0000","last_active":"2023-10-06T23:11:49.032536+0000","last_peered":"2023-10-06T23:11:49.032536+0000","last_clean":"2023-10-06T23:11:49.032536+0000","last_became_active":"2023-10-06T23:11:18.259684+0000","last_became_peered":"2023-10-06T23:11:18.259684+0000","last_unstale":"2023-10-06T23:11:49.032536+0000","last_undegraded":"2023-10-06T23:11:49.032536+0000","last_fullsized":"2023-10-06T23:11:49.032536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T04:46:08.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035791+0000","last_change":"2023-10-06T23:11:17.264262+0000","last_active":"2023-10-06T23:11:49.035791+0000","last_peered":"2023-10-06T23:11:49.035791+0000","last_clean":"2023-10-06T23:11:49.035791+0000","last_became_active":"2023-10-06T23:11:17.263922+0000","last_became_peered":"2023-10-06T23:11:17.263922+0000","last_unstale":"2023-10-06T23:11:49.035791+0000","last_undegraded":"2023-10-06T23:11:49.035791+0000","last_fullsized":"2023-10-06T23:11:49.035791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:00:14.045943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029509+0000","last_change":"2023-10-06T23:11:18.260908+0000","last_active":"2023-10-06T23:11:49.029509+0000","last_peered":"2023-10-06T23:11:49.029509+0000","last_clean":"2023-10-06T23:11:49.029509+0000","last_became_active":"2023-10-06T23:11:18.260459+0000","last_became_peered":"2023-10-06T23:11:18.260459+0000","last_unstale":"2023-10-06T23:11:49.029509+0000","last_undegraded":"2023-10-06T23:11:49.029509+0000","last_fullsized":"2023-10-06T23:11:49.029509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:23:51.570508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036705+0000","last_change":"2023-10-06T23:11:17.262559+0000","last_active":"2023-10-06T23:11:49.036705+0000","last_peered":"2023-10-06T23:11:49.036705+0000","last_clean":"2023-10-06T23:11:49.036705+0000","last_became_active":"2023-10-06T23:11:17.262062+0000","last_became_peered":"2023-10-06T23:11:17.262062+0000","last_unstale":"2023-10-06T23:11:49.036705+0000","last_undegraded":"2023-10-06T23:11:49.036705+0000","last_fullsized":"2023-10-06T23:11:49.036705+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:47:03.751385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036526+0000","last_change":"2023-10-06T23:11:18.269813+0000","last_active":"2023-10-06T23:11:49.036526+0000","last_peered":"2023-10-06T23:11:49.036526+0000","last_clean":"2023-10-06T23:11:49.036526+0000","last_became_active":"2023-10-06T23:11:18.269506+0000","last_became_peered":"2023-10-06T23:11:18.269506+0000","last_unstale":"2023-10-06T23:11:49.036526+0000","last_undegraded":"2023-10-06T23:11:49.036526+0000","last_fullsized":"2023-10-06T23:11:49.036526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:43:21.635237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.032699+0000","last_change":"2023-10-06T23:11:17.253040+0000","last_active":"2023-10-06T23:11:49.032699+0000","last_peered":"2023-10-06T23:11:49.032699+0000","last_clean":"2023-10-06T23:11:49.032699+0000","last_became_active":"2023-10-06T23:11:17.252596+0000","last_became_peered":"2023-10-06T23:11:17.252596+0000","last_unstale":"2023-10-06T23:11:49.032699+0000","last_undegraded":"2023-10-06T23:11:49.032699+0000","last_fullsized":"2023-10-06T23:11:49.032699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:39:30.721464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036362+0000","last_change":"2023-10-06T23:11:18.267465+0000","last_active":"2023-10-06T23:11:49.036362+0000","last_peered":"2023-10-06T23:11:49.036362+0000","last_clean":"2023-10-06T23:11:49.036362+0000","last_became_active":"2023-10-06T23:11:18.267164+0000","last_became_peered":"2023-10-06T23:11:18.267164+0000","last_unstale":"2023-10-06T23:11:49.036362+0000","last_undegraded":"2023-10-06T23:11:49.036362+0000","last_fullsized":"2023-10-06T23:11:49.036362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:36:16.747117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037242+0000","last_change":"2023-10-06T23:11:17.267653+0000","last_active":"2023-10-06T23:11:49.037242+0000","last_peered":"2023-10-06T23:11:49.037242+0000","last_clean":"2023-10-06T23:11:49.037242+0000","last_became_active":"2023-10-06T23:11:17.267264+0000","last_became_peered":"2023-10-06T23:11:17.267264+0000","last_unstale":"2023-10-06T23:11:49.037242+0000","last_undegraded":"2023-10-06T23:11:49.037242+0000","last_fullsized":"2023-10-06T23:11:49.037242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:45:57.242383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036468+0000","last_change":"2023-10-06T23:11:18.264869+0000","last_active":"2023-10-06T23:11:49.036468+0000","last_peered":"2023-10-06T23:11:49.036468+0000","last_clean":"2023-10-06T23:11:49.036468+0000","last_became_active":"2023-10-06T23:11:18.264549+0000","last_became_peered":"2023-10-06T23:11:18.264549+0000","last_unstale":"2023-10-06T23:11:49.036468+0000","last_undegraded":"2023-10-06T23:11:49.036468+0000","last_fullsized":"2023-10-06T23:11:49.036468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:00:35.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035779+0000","last_change":"2023-10-06T23:11:17.263806+0000","last_active":"2023-10-06T23:11:49.035779+0000","last_peered":"2023-10-06T23:11:49.035779+0000","last_clean":"2023-10-06T23:11:49.035779+0000","last_became_active":"2023-10-06T23:11:17.263499+0000","last_became_peered":"2023-10-06T23:11:17.263499+0000","last_unstale":"2023-10-06T23:11:49.035779+0000","last_undegraded":"2023-10-06T23:11:49.035779+0000","last_fullsized":"2023-10-06T23:11:49.035779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:07:26.191338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036159+0000","last_change":"2023-10-06T23:11:18.264691+0000","last_active":"2023-10-06T23:11:49.036159+0000","last_peered":"2023-10-06T23:11:49.036159+0000","last_clean":"2023-10-06T23:11:49.036159+0000","last_became_active":"2023-10-06T23:11:18.264286+0000","last_became_peered":"2023-10-06T23:11:18.264286+0000","last_unstale":"2023-10-06T23:11:49.036159+0000","last_undegraded":"2023-10-06T23:11:49.036159+0000","last_fullsized":"2023-10-06T23:11:49.036159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:35:23.728707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T23:11:50.401402+0000","last_change":"2023-10-06T23:11:50.401402+0000","last_active":"2023-10-06T23:11:50.401402+0000","last_peered":"2023-10-06T23:11:50.401402+0000","last_clean":"2023-10-06T23:11:50.401402+0000","last_became_active":"2023-10-06T23:11:50.397772+0000","last_became_peered":"2023-10-06T23:11:50.397772+0000","last_unstale":"2023-10-06T23:11:50.401402+0000","last_undegraded":"2023-10-06T23:11:50.401402+0000","last_fullsized":"2023-10-06T23:11:50.401402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:16.180797+0000","last_clean_scrub_stamp":"2023-10-06T23:11:16.180797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:12:33.727845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036474+0000","last_change":"2023-10-06T23:11:18.265822+0000","last_active":"2023-10-06T23:11:49.036474+0000","last_peered":"2023-10-06T23:11:49.036474+0000","last_clean":"2023-10-06T23:11:49.036474+0000","last_became_active":"2023-10-06T23:11:18.265457+0000","last_became_peered":"2023-10-06T23:11:18.265457+0000","last_unstale":"2023-10-06T23:11:49.036474+0000","last_undegraded":"2023-10-06T23:11:49.036474+0000","last_fullsized":"2023-10-06T23:11:49.036474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:09.132431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029634+0000","last_change":"2023-10-06T23:11:18.267305+0000","last_active":"2023-10-06T23:11:49.029634+0000","last_peered":"2023-10-06T23:11:49.029634+0000","last_clean":"2023-10-06T23:11:49.029634+0000","last_became_active":"2023-10-06T23:11:18.266975+0000","last_became_peered":"2023-10-06T23:11:18.266975+0000","last_unstale":"2023-10-06T23:11:49.029634+0000","last_undegraded":"2023-10-06T23:11:49.029634+0000","last_fullsized":"2023-10-06T23:11:49.029634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T06:48:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036823+0000","last_change":"2023-10-06T23:11:18.262045+0000","last_active":"2023-10-06T23:11:49.036823+0000","last_peered":"2023-10-06T23:11:49.036823+0000","last_clean":"2023-10-06T23:11:49.036823+0000","last_became_active":"2023-10-06T23:11:18.261662+0000","last_became_peered":"2023-10-06T23:11:18.261662+0000","last_unstale":"2023-10-06T23:11:49.036823+0000","last_undegraded":"2023-10-06T23:11:49.036823+0000","last_fullsized":"2023-10-06T23:11:49.036823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:56:06.429705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036972+0000","last_change":"2023-10-06T23:11:18.259540+0000","last_active":"2023-10-06T23:11:49.036972+0000","last_peered":"2023-10-06T23:11:49.036972+0000","last_clean":"2023-10-06T23:11:49.036972+0000","last_became_active":"2023-10-06T23:11:18.259234+0000","last_became_peered":"2023-10-06T23:11:18.259234+0000","last_unstale":"2023-10-06T23:11:49.036972+0000","last_undegraded":"2023-10-06T23:11:49.036972+0000","last_fullsized":"2023-10-06T23:11:49.036972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T03:47:15.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.026670+0000","last_change":"2023-10-06T23:11:18.266295+0000","last_active":"2023-10-06T23:11:49.026670+0000","last_peered":"2023-10-06T23:11:49.026670+0000","last_clean":"2023-10-06T23:11:49.026670+0000","last_became_active":"2023-10-06T23:11:18.265991+0000","last_became_peered":"2023-10-06T23:11:18.265991+0000","last_unstale":"2023-10-06T23:11:49.026670+0000","last_undegraded":"2023-10-06T23:11:49.026670+0000","last_fullsized":"2023-10-06T23:11:49.026670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T05:34:43.165643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031833+0000","last_change":"2023-10-06T23:11:18.266239+0000","last_active":"2023-10-06T23:11:49.031833+0000","last_peered":"2023-10-06T23:11:49.031833+0000","last_clean":"2023-10-06T23:11:49.031833+0000","last_became_active":"2023-10-06T23:11:18.265849+0000","last_became_peered":"2023-10-06T23:11:18.265849+0000","last_unstale":"2023-10-06T23:11:49.031833+0000","last_undegraded":"2023-10-06T23:11:49.031833+0000","last_fullsized":"2023-10-06T23:11:49.031833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:47.219459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.030522+0000","last_change":"2023-10-06T23:11:18.260885+0000","last_active":"2023-10-06T23:11:49.030522+0000","last_peered":"2023-10-06T23:11:49.030522+0000","last_clean":"2023-10-06T23:11:49.030522+0000","last_became_active":"2023-10-06T23:11:18.260567+0000","last_became_peered":"2023-10-06T23:11:18.260567+0000","last_unstale":"2023-10-06T23:11:49.030522+0000","last_undegraded":"2023-10-06T23:11:49.030522+0000","last_fullsized":"2023-10-06T23:11:49.030522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T02:31:36.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.037629+0000","last_change":"2023-10-06T23:11:18.257105+0000","last_active":"2023-10-06T23:11:49.037629+0000","last_peered":"2023-10-06T23:11:49.037629+0000","last_clean":"2023-10-06T23:11:49.037629+0000","last_became_active":"2023-10-06T23:11:18.256816+0000","last_became_peered":"2023-10-06T23:11:18.256816+0000","last_unstale":"2023-10-06T23:11:49.037629+0000","last_undegraded":"2023-10-06T23:11:49.037629+0000","last_fullsized":"2023-10-06T23:11:49.037629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:31:07.749678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.036911+0000","last_change":"2023-10-06T23:11:18.260383+0000","last_active":"2023-10-06T23:11:49.036911+0000","last_peered":"2023-10-06T23:11:49.036911+0000","last_clean":"2023-10-06T23:11:49.036911+0000","last_became_active":"2023-10-06T23:11:18.260010+0000","last_became_peered":"2023-10-06T23:11:18.260010+0000","last_unstale":"2023-10-06T23:11:49.036911+0000","last_undegraded":"2023-10-06T23:11:49.036911+0000","last_fullsized":"2023-10-06T23:11:49.036911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T07:25:25.014895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.034750+0000","last_change":"2023-10-06T23:11:18.261948+0000","last_active":"2023-10-06T23:11:49.034750+0000","last_peered":"2023-10-06T23:11:49.034750+0000","last_clean":"2023-10-06T23:11:49.034750+0000","last_became_active":"2023-10-06T23:11:18.261605+0000","last_became_peered":"2023-10-06T23:11:18.261605+0000","last_unstale":"2023-10-06T23:11:49.034750+0000","last_undegraded":"2023-10-06T23:11:49.034750+0000","last_fullsized":"2023-10-06T23:11:49.034750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T01:10:59.720181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.035691+0000","last_change":"2023-10-06T23:11:18.261123+0000","last_active":"2023-10-06T23:11:49.035691+0000","last_peered":"2023-10-06T23:11:49.035691+0000","last_clean":"2023-10-06T23:11:49.035691+0000","last_became_active":"2023-10-06T23:11:18.260754+0000","last_became_peered":"2023-10-06T23:11:18.260754+0000","last_unstale":"2023-10-06T23:11:49.035691+0000","last_undegraded":"2023-10-06T23:11:49.035691+0000","last_fullsized":"2023-10-06T23:11:49.035691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:04:25.335790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.042589+0000","last_change":"2023-10-06T23:11:18.261021+0000","last_active":"2023-10-06T23:11:49.042589+0000","last_peered":"2023-10-06T23:11:49.042589+0000","last_clean":"2023-10-06T23:11:49.042589+0000","last_became_active":"2023-10-06T23:11:18.260613+0000","last_became_peered":"2023-10-06T23:11:18.260613+0000","last_unstale":"2023-10-06T23:11:49.042589+0000","last_undegraded":"2023-10-06T23:11:49.042589+0000","last_fullsized":"2023-10-06T23:11:49.042589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T00:31:28.443342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.031481+0000","last_change":"2023-10-06T23:11:18.266771+0000","last_active":"2023-10-06T23:11:49.031481+0000","last_peered":"2023-10-06T23:11:49.031481+0000","last_clean":"2023-10-06T23:11:49.031481+0000","last_became_active":"2023-10-06T23:11:18.266434+0000","last_became_peered":"2023-10-06T23:11:18.266434+0000","last_unstale":"2023-10-06T23:11:49.031481+0000","last_undegraded":"2023-10-06T23:11:49.031481+0000","last_fullsized":"2023-10-06T23:11:49.031481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:59:53.056671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T23:11:49.029587+0000","last_change":"2023-10-06T23:11:18.265674+0000","last_active":"2023-10-06T23:11:49.029587+0000","last_peered":"2023-10-06T23:11:49.029587+0000","last_clean":"2023-10-06T23:11:49.029587+0000","last_became_active":"2023-10-06T23:11:18.265323+0000","last_became_peered":"2023-10-06T23:11:18.265323+0000","last_unstale":"2023-10-06T23:11:49.029587+0000","last_undegraded":"2023-10-06T23:11:49.029587+0000","last_fullsized":"2023-10-06T23:11:49.029587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T23:11:17.232421+0000","last_clean_scrub_stamp":"2023-10-06T23:11:17.232421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:15.281707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281556,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6072,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":612,"num_read_kb":316,"num_write":129,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":44,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":19031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351011,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":459304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.72899999999999998,"15min":0.755},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":3.7559999999999998,"15min":3.7559999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.84599999999999997,"15min":0.88700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78300000000000003,"5min":5.585,"15min":5.585},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.48599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.036,"5min":3.4689999999999999,"15min":3.4689999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.82199999999999995,"15min":0.83399999999999996},"min":{"1min":0.59999999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92000000000000004,"5min":3.895,"15min":3.895},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.44700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81499999999999995,"5min":5.3390000000000004,"15min":5.3390000000000004},"last":0.63},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.42099999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.92100000000000004,"5min":3.052,"15min":3.052},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.85399999999999998,"15min":0.86699999999999999},"min":{"1min":0.56599999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.98099999999999998,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.872,"15min":0.89200000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.079,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.92700000000000005},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93899999999999995,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93100000000000005,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4009999999999998,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.018,"15min":1.052},"min":{"1min":0.60899999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0589999999999999,"5min":5.9640000000000004,"15min":5.9640000000000004},"last":0.90200000000000002}]},{"osd":7,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.97299999999999998,"15min":0.98899999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.131,"5min":4.21,"15min":4.21},"last":0.81100000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.204},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.95799999999999996}]},{"osd":9,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":1.2,"15min":1.246},"min":{"1min":0.73199999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.089,"5min":5.5190000000000001,"15min":5.5190000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.71999999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0900000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.97799999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":1.0389999999999999,"15min":1.0589999999999999},"min":{"1min":0.65200000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.1659999999999999,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.131,"15min":1.1519999999999999},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4930000000000001,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":1.1439999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612648,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1052236,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.46800000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.755,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.84099999999999997}]},{"osd":2,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.73299999999999998,"15min":0.69699999999999995},"min":{"1min":0.70799999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.61099999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82399999999999995,"5min":1.631,"15min":1.631},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.83199999999999996,"15min":0.81299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86899999999999999,"5min":8.2669999999999995,"15min":8.2669999999999995},"last":0.751}]},{"osd":4,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67900000000000005,"15min":0.66900000000000004},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":1.004,"15min":1.004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78800000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96799999999999997,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.02,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.90800000000000003,"15min":0.91300000000000003},"min":{"1min":0.68799999999999994,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0720000000000001,"5min":1.228,"15min":1.228},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.98599999999999999,"15min":0.97499999999999998},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1020000000000001,"5min":7.9539999999999997,"15min":7.9539999999999997},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.94299999999999995,"15min":0.92600000000000005},"min":{"1min":0.66200000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4740000000000002,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":0.92800000000000005}]},{"osd":7,"last update":"Fri Oct 6 23:10:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.64100000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1240000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.98599999999999999,"15min":1.012},"min":{"1min":0.65600000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.1559999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.069}]},{"osd":9,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.97499999999999998,"15min":1.0069999999999999},"min":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1399999999999999,"5min":1.391,"15min":1.391},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.0940000000000001,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.117,"5min":8.1799999999999997,"15min":8.1799999999999997},"last":1.038}]},{"osd":11,"last update":"Fri Oct 6 23:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.119,"5min":1.641,"15min":1.641},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.94099999999999995,"15min":0.93799999999999994},"min":{"1min":0.73799999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.0980000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.054}]}]},{"osd":9,"up_from":68,"seq":292057776174,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":459496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.79600000000000004,"15min":0.83199999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0609999999999999,"5min":1.167,"15min":1.167},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1759999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80100000000000005,"15min":0.82499999999999996},"min":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.874}]},{"osd":3,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69299999999999995,"15min":0.71799999999999997},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.69699999999999995,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1080000000000001,"5min":1.153,"15min":1.153},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86599999999999999,"15min":0.90800000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.89000000000000001,"15min":0.93799999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.89600000000000002,"15min":0.94499999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.264,"5min":2.109,"15min":2.109},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.89400000000000002,"15min":0.93700000000000006},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1679999999999999,"5min":1.359,"15min":1.359},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.82999999999999996,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.196,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89300000000000002,"15min":0.94699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.133,"5min":1.738,"15min":1.738},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.97199999999999998,"15min":1.024},"min":{"1min":0.63600000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.383,"5min":2.149,"15min":2.149},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.98699999999999999,"15min":1.0309999999999999},"min":{"1min":0.626,"5min":0.624,"15min":0.624},"max":{"1min":1.2290000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.90900000000000003}]},{"osd":8,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.99199999999999999,"15min":1.032},"min":{"1min":0.70599999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.284,"5min":1.778,"15min":1.778},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.335,"5min":1.698,"15min":1.698},"last":0.89600000000000002}]},{"osd":10,"last update":"Fri Oct 6 23:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98699999999999999,"15min":1.028},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.137,"5min":1.417,"15min":1.417},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.97199999999999998,"15min":1.006},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.3640000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0049999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037811,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":459041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.895,"5min":2.895,"15min":2.895},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.74099999999999999},"min":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.71599999999999997,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.435,"15min":0.435},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.55400000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.024,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":1.272,"15min":1.272},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.42499999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.96499999999999997,"5min":1.196,"15min":1.196},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.79000000000000004},"min":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.3799999999999999,"5min":3.3799999999999999,"15min":3.3799999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75,"15min":0.751},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.878},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.58599999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.125,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.748},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.073,"5min":1.248,"15min":1.248},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.78100000000000003},"min":{"1min":0.53600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98299999999999998,"5min":1.05,"15min":1.05},"last":0.96699999999999997}]},{"osd":6,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.90300000000000002,"15min":0.92600000000000005},"min":{"1min":0.67700000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.92600000000000005},"min":{"1min":0.67800000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1719999999999999,"5min":1.399,"15min":1.399},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88800000000000001,"15min":0.92000000000000004},"min":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.115,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.90800000000000003}]},{"osd":9,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.94699999999999995,"15min":0.94599999999999995},"min":{"1min":0.65900000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.94599999999999995,"15min":0.94999999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":0.94399999999999995}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.70099999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.145,"5min":1.304,"15min":1.304},"last":1.004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.88600000000000001,"15min":0.875},"min":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.155,"5min":1.242,"15min":1.242},"last":0.995}]},{"osd":11,"last update":"Fri Oct 6 23:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.081}]}]},{"osd":7,"up_from":52,"seq":223338299448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":1050932,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.72299999999999998},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93200000000000005,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51000000000000001},"min":{"1min":0.34599999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80700000000000005,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73799999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69799999999999995,"15min":0.67600000000000005},"min":{"1min":0.502,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0389999999999999,"5min":1.04,"15min":1.04},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.51900000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76900000000000002,"15min":0.72499999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94999999999999996,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":0.498},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93400000000000005,"5min":1.149,"15min":1.149},"last":0.66600000000000004}]},{"osd":4,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79300000000000004,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.63400000000000001},"min":{"1min":0.47899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91200000000000003,"5min":1.103,"15min":1.103},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.877,"5min":1.244,"15min":1.244},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78800000000000003,"15min":0.77600000000000002},"min":{"1min":0.629,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0600000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 23:12:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.92800000000000005,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0980000000000001,"5min":1.26,"15min":1.26},"last":0.55500000000000005}]},{"osd":8,"last update":"Fri Oct 6 23:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79800000000000004,"15min":0.78700000000000003},"min":{"1min":0.61899999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.871,"15min":0.85399999999999998},"min":{"1min":0.70499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.89300000000000002}]},{"osd":9,"last update":"Fri Oct 6 23:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90300000000000002,"15min":0.90000000000000002},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.012,"5min":1.206,"15min":1.206},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.61299999999999999,"5min":0.501,"15min":0.501},"max":{"1min":1.147,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.73299999999999998}]},{"osd":10,"last update":"Fri Oct 6 23:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93200000000000005,"15min":0.93100000000000005},"min":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.139,"5min":1.2,"15min":1.2},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88500000000000001,"15min":0.88400000000000001},"min":{"1min":0.65900000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.117,"5min":1.298,"15min":1.298},"last":0.86199999999999999}]},{"osd":11,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92500000000000004}]}]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":458768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.48699999999999999,"15min":0.45100000000000001},"min":{"1min":0.35699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.52700000000000002,"15min":0.47999999999999998},"min":{"1min":0.36799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.44}]},{"osd":1,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.70399999999999996,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.69399999999999995},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.73699999999999999,"15min":0.68999999999999995},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.74199999999999999,"15min":0.70399999999999996},"min":{"1min":0.54000000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.66400000000000003,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":10.539,"5min":10.539,"15min":10.539},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.69099999999999995,"15min":0.63700000000000001},"min":{"1min":0.46500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78000000000000003,"15min":0.74299999999999999},"min":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.2839999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79500000000000004,"15min":0.77200000000000002},"min":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.8719999999999999,"5min":3.8719999999999999,"15min":3.8719999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Oct 6 23:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79400000000000004,"15min":0.77600000000000002},"min":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5349999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.84599999999999997,"15min":0.80700000000000005},"min":{"1min":0.63600000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.78200000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.83899999999999997,"15min":0.81499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.133,"5min":3.915,"15min":3.915},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.876,"15min":0.85999999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3979999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.85799999999999998}]},{"osd":8,"last update":"Fri Oct 6 23:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.89000000000000001,"15min":0.85399999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.88300000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.91600000000000004,"15min":0.91100000000000003},"min":{"1min":0.58399999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.4820000000000002,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90700000000000003,"15min":0.89900000000000002},"min":{"1min":0.69599999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.93799999999999994}]},{"osd":10,"last update":"Fri Oct 6 23:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.93200000000000005,"15min":0.92300000000000004},"min":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0940000000000001,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.999,"15min":1.0069999999999999},"min":{"1min":0.75900000000000001,"5min":0.749,"15min":0.749},"max":{"1min":0.998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.97699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":460715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63500000000000001,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.38200000000000001,"15min":0.35599999999999998},"max":{"1min":1.1220000000000001,"5min":1.222,"15min":1.222},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.627,"15min":0.60399999999999998},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":1.0429999999999999,"5min":1.056,"15min":1.056},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Oct 6 23:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66200000000000003,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96799999999999997,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.032,"5min":1.198,"15min":1.198},"last":0.96499999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":1.282,"15min":1.282},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.436},"max":{"1min":0.83599999999999997,"5min":1.522,"15min":1.522},"last":0.502}]},{"osd":4,"last update":"Fri Oct 6 23:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59299999999999997,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.92200000000000004,"5min":1.097,"15min":1.097},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.621,"15min":0.58199999999999996},"min":{"1min":0.47999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0780000000000001,"5min":2.02,"15min":2.02},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.74199999999999999,"15min":0.68000000000000005},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.04,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80300000000000005,"15min":0.72799999999999998},"min":{"1min":0.64100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1259999999999999,"5min":1.254,"15min":1.254},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.80200000000000005,"15min":0.76800000000000002},"min":{"1min":0.59999999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.119,"5min":1.385,"15min":1.385},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.60799999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.175,"5min":1.492,"15min":1.492},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.77100000000000002,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2050000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.94099999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.83399999999999996,"15min":0.80000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2410000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.78100000000000003,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3280000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.872}]},{"osd":9,"last update":"Fri Oct 6 23:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90400000000000003,"15min":0.88800000000000001},"min":{"1min":0.745,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1599999999999999,"5min":1.355,"15min":1.355},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85099999999999998,"15min":0.83299999999999996},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.048,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.70399999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:11:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91000000000000003,"15min":0.90000000000000002},"min":{"1min":0.623,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3600000000000001,"5min":1.706,"15min":1.706},"last":0.623},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92900000000000005,"15min":0.92100000000000004},"min":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0409999999999999}]},{"osd":11,"last update":"Fri Oct 6 23:12:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0629999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":460156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.61299999999999999},"min":{"1min":0.42599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.091,"15min":1.091},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.63600000000000001},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99099999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.63900000000000001},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95199999999999996,"5min":1.236,"15min":1.236},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.64000000000000001},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66700000000000004,"15min":0.63300000000000001},"min":{"1min":0.51400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98599999999999999,"5min":0.995,"15min":0.995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68500000000000005,"15min":0.64100000000000001},"min":{"1min":0.47599999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.0649999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.752}]},{"osd":5,"last update":"Fri Oct 6 23:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86099999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.746,"15min":0.70499999999999996},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Oct 6 23:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66100000000000003,"15min":0.63600000000000001},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.002,"5min":1.085,"15min":1.085},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.59699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.81399999999999995,"15min":0.79900000000000004},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70299999999999996}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.25,"5min":1.296,"15min":1.296},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.68400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.88700000000000001}]},{"osd":9,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83299999999999996,"15min":0.83699999999999997},"min":{"1min":0.499,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0580000000000001,"5min":1.206,"15min":1.206},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.85599999999999998,"15min":0.88700000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.173,"5min":1.325,"15min":1.325},"last":0.875}]},{"osd":10,"last update":"Fri Oct 6 23:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85999999999999999,"15min":0.85799999999999998},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92500000000000004,"15min":0.92300000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.202,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.008}]},{"osd":11,"last update":"Fri Oct 6 23:12:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.73899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0720000000000001,"5min":1.724,"15min":1.724},"last":1.044},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.72299999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.29,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.90100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":462490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.59399999999999997},"min":{"1min":0.40699999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.91900000000000004,"5min":1.0009999999999999,"15min":1.7949999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.65100000000000002,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66700000000000004,"15min":0.629},"min":{"1min":0.498,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.88900000000000001,"5min":1.012,"15min":1.4990000000000001},"last":0.752},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70899999999999996,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.41299999999999998},"max":{"1min":0.97699999999999998,"5min":1.2430000000000001,"15min":1.746},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67600000000000005,"15min":0.65400000000000003},"min":{"1min":0.39000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.75800000000000001,"15min":0.71099999999999997},"min":{"1min":0.56599999999999995,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri Oct 6 23:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:12:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95899999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.751,"15min":0.70099999999999996},"min":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.022,"5min":1.169,"15min":1.169},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.78400000000000003,"15min":0.73799999999999999},"min":{"1min":0.59499999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0409999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Oct 6 23:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.54400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75}]},{"osd":8,"last update":"Fri Oct 6 23:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.65500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0800000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82499999999999996},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0629999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.746}]},{"osd":9,"last update":"Fri Oct 6 23:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0920000000000001,"5min":1.155,"15min":1.155},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.006,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.81699999999999995}]},{"osd":10,"last update":"Fri Oct 6 23:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91900000000000004,"15min":0.93100000000000005},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.62},"max":{"1min":1.0620000000000001,"5min":1.333,"15min":1.333},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92900000000000005,"15min":0.94199999999999995},"min":{"1min":0.745,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.0920000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90100000000000002}]},{"osd":11,"last update":"Fri Oct 6 23:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.871}]}]},{"osd":3,"up_from":26,"seq":111669149773,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":458631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48399999999999999,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.753,"5min":1.03,"15min":1.03},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49199999999999999,"15min":0.42399999999999999},"min":{"1min":0.314,"5min":0.29899999999999999,"15min":0.26300000000000001},"max":{"1min":0.72799999999999998,"5min":1.409,"15min":1.409},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Oct 6 23:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69899999999999995,"15min":0.64300000000000002},"min":{"1min":0.50900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92200000000000004,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81499999999999995,"15min":0.70599999999999996},"min":{"1min":0.55600000000000005,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.99199999999999999,"5min":9.3989999999999991,"15min":9.3989999999999991},"last":0.99199999999999999}]},{"osd":2,"last update":"Fri Oct 6 23:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71499999999999997,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.35299999999999998},"max":{"1min":0.83499999999999996,"5min":4.3769999999999998,"15min":4.3769999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.39300000000000002,"15min":0.379},"max":{"1min":0.91300000000000003,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Fri Oct 6 23:12:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":0.80900000000000005,"15min":0.68899999999999995},"min":{"1min":0.57199999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":9.4399999999999995,"5min":9.4399999999999995,"15min":9.4399999999999995},"last":0.873},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.68600000000000005},"min":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Oct 6 23:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.85299999999999998,"15min":0.76000000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0489999999999999,"5min":9.3379999999999992,"15min":9.3379999999999992},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.875,"15min":0.75700000000000001},"min":{"1min":0.58999999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":6.6289999999999996,"5min":6.6289999999999996,"15min":6.6289999999999996},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:12:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.69099999999999995,"15min":0.626},"min":{"1min":0.51400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":5.3680000000000003,"5min":5.3680000000000003,"15min":5.3680000000000003},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.139,"5min":0.77900000000000003,"15min":0.68500000000000005},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":11.281000000000001,"5min":11.281000000000001,"15min":11.281000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Oct 6 23:12:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.96399999999999997,"15min":0.86899999999999999},"min":{"1min":0.58999999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":6.5970000000000004,"5min":9.4779999999999998,"15min":9.4779999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.84899999999999998,"15min":0.81699999999999995},"min":{"1min":0.60599999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97799999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.02}]},{"osd":8,"last update":"Fri Oct 6 23:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.878,"15min":0.88400000000000001},"min":{"1min":0.66900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.008,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0009999999999999}]},{"osd":9,"last update":"Fri Oct 6 23:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.872,"15min":0.878},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.204,"5min":0.91700000000000004,"15min":0.86299999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":11.336,"5min":11.336,"15min":11.336},"last":0.83399999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.004,"15min":0.96999999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2190000000000001,"5min":9.516,"15min":9.516},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.1180000000000001,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.1180000000000001}]},{"osd":11,"last update":"Fri Oct 6 23:12:20 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.6100000000000003,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":4.577,"5min":4.577,"15min":4.577},"last":1.1870000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888137,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":459322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52100000000000002,"15min":0.47299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76200000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.53200000000000003,"15min":0.46999999999999997},"min":{"1min":0.42999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.439}]},{"osd":2,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.76100000000000001,"15min":0.68899999999999995},"min":{"1min":0.65900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0580000000000001,"5min":1.109,"15min":1.109},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.73199999999999998,"15min":0.70599999999999996},"min":{"1min":0.55800000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Oct 6 23:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70799999999999996,"15min":0.66100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.65300000000000002},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.014,"5min":1.141,"15min":1.141},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Oct 6 23:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.73899999999999999,"15min":0.70099999999999996},"min":{"1min":0.61599999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98699999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.76900000000000002,"15min":0.71499999999999997},"min":{"1min":0.67000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Oct 6 23:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79000000000000004,"15min":0.75800000000000001},"min":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0629999999999999,"5min":1.083,"15min":1.083},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.73199999999999998},"min":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0449999999999999,"5min":1.161,"15min":1.161},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Oct 6 23:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.77700000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.67100000000000004}]},{"osd":8,"last update":"Fri Oct 6 23:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.90900000000000003,"15min":0.875},"min":{"1min":0.64200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88,"15min":0.84999999999999998},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0920000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.749}]},{"osd":9,"last update":"Fri Oct 6 23:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.70099999999999996,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":0.96699999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.181,"5min":1.22,"15min":1.22},"last":0.83299999999999996}]},{"osd":10,"last update":"Fri Oct 6 23:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.02},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2390000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.89000000000000001}]},{"osd":11,"last update":"Fri Oct 6 23:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.91400000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724610,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":1050616,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98699999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.69299999999999995,"15min":0.64900000000000002},"min":{"1min":0.60299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.97399999999999998,"5min":1.153,"15min":1.153},"last":0.749},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.66500000000000004,"15min":0.63200000000000001},"min":{"1min":0.52900000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.94399999999999995,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.627}]},{"osd":2,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.49299999999999999},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.80400000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.504},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.51800000000000002},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.69999999999999996,"5min":0.879,"15min":0.879},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.46999999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.499,"5min":0.441,"15min":0.441},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.93899999999999995}]},{"osd":4,"last update":"Fri Oct 6 23:12:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.59599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96799999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.747,"15min":0.69899999999999995},"min":{"1min":0.58799999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Oct 6 23:12:15 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.125},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.749,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97799999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Oct 6 23:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.625,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.76500000000000001,"15min":0.71899999999999997},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.042,"5min":1.349,"15min":1.349},"last":0.81599999999999995}]},{"osd":8,"last update":"Fri Oct 6 23:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.879,"5min":0.77700000000000002,"15min":0.75700000000000001},"min":{"1min":0.52500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.71899999999999997}]},{"osd":9,"last update":"Fri Oct 6 23:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.84499999999999997,"15min":0.83699999999999997},"min":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0660000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81299999999999994},"min":{"1min":0.63400000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Fri Oct 6 23:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.88200000000000001,"15min":0.86899999999999999},"min":{"1min":0.70199999999999996,"5min":0.625,"15min":0.625},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.85099999999999998,"15min":0.83899999999999997},"min":{"1min":0.61599999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.88}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34167,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35811,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T23:13:05.725 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:13:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 -- 172.21.15.8:0/791389899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c102080 msgr2=0x7f961c102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 --2- 172.21.15.8:0/791389899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c102080 0x7f961c102500 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9610009990 tx=0x7f9610009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 -- 172.21.15.8:0/791389899 shutdown_connections 2023-10-06T23:13:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 --2- 172.21.15.8:0/791389899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f961c102a40 0x7f961c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 --2- 172.21.15.8:0/791389899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c100ea0 0x7f961c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 --2- 172.21.15.8:0/791389899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c102080 0x7f961c102500 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 -- 172.21.15.8:0/791389899 >> 172.21.15.8:0/791389899 conn(0x7f961c0fc420 msgr2=0x7f961c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:05.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 -- 172.21.15.8:0/791389899 shutdown_connections 2023-10-06T23:13:05.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.960+0000 7f96211ff700 1 -- 172.21.15.8:0/791389899 wait complete. 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.961+0000 7f96211ff700 1 Processor -- start 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.961+0000 7f96211ff700 1 -- start start 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f96211ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c100ea0 0x7f961c196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f96211ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c102080 0x7f961c197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f96211ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f961c102a40 0x7f961c19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f96211ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c19e6d0 con 0x7f961c100ea0 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f96211ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c19e810 con 0x7f961c102080 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f96211ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c19e9a0 con 0x7f961c102a40 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c100ea0 0x7f961c196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c100ea0 0x7f961c196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55694/0 (socket says 172.21.15.8:55694) 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961ad9d700 1 -- 172.21.15.8:0/2227617641 learned_addr learned my addr 172.21.15.8:0/2227617641 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961b59e700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f961c102a40 0x7f961c19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961a59c700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c102080 0x7f961c197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961ad9d700 1 -- 172.21.15.8:0/2227617641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f961c102a40 msgr2=0x7f961c19e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961ad9d700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f961c102a40 0x7f961c19e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961ad9d700 1 -- 172.21.15.8:0/2227617641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c102080 msgr2=0x7f961c197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961ad9d700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c102080 0x7f961c197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961ad9d700 1 -- 172.21.15.8:0/2227617641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100095f0 con 0x7f961c100ea0 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.962+0000 7f961a59c700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c102080 0x7f961c197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.963+0000 7f961ad9d700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c100ea0 0x7f961c196b50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f960c00e970 tx=0x7f960c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.963+0000 7f9603fff700 1 -- 172.21.15.8:0/2227617641 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c009790 con 0x7f961c100ea0 2023-10-06T23:13:05.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.963+0000 7f9603fff700 1 -- 172.21.15.8:0/2227617641 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f960c00eec0 con 0x7f961c100ea0 2023-10-06T23:13:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.963+0000 7f9603fff700 1 -- 172.21.15.8:0/2227617641 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c003c10 con 0x7f961c100ea0 2023-10-06T23:13:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.963+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c19ec80 con 0x7f961c100ea0 2023-10-06T23:13:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.963+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c19f190 con 0x7f961c100ea0 2023-10-06T23:13:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.964+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c1085e0 con 0x7f961c100ea0 2023-10-06T23:13:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.966+0000 7f9603fff700 1 -- 172.21.15.8:0/2227617641 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f960c003db0 con 0x7f961c100ea0 2023-10-06T23:13:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.968+0000 7f9603fff700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f96040a1550 0x7f96040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.968+0000 7f9603fff700 1 -- 172.21.15.8:0/2227617641 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f960c014070 con 0x7f961c100ea0 2023-10-06T23:13:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.968+0000 7f961a59c700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f96040a1550 0x7f96040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.969+0000 7f961a59c700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f96040a1550 0x7f96040a3a10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9610005910 tx=0x7f961000b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:05.971+0000 7f9603fff700 1 -- 172.21.15.8:0/2227617641 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f960c096560 con 0x7f961c100ea0 2023-10-06T23:13:06.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.186+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f961c10c610 con 0x7f961c100ea0 2023-10-06T23:13:06.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.187+0000 7f9603fff700 1 -- 172.21.15.8:0/2227617641 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7f960c099b80 con 0x7f961c100ea0 2023-10-06T23:13:06.189 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:06.189 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:13:06.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f96040a1550 msgr2=0x7f96040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f96040a1550 0x7f96040a3a10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9610005910 tx=0x7f961000b260 comp rx=0 tx=0).stop 2023-10-06T23:13:06.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c100ea0 msgr2=0x7f961c196b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c100ea0 0x7f961c196b50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f960c00e970 tx=0x7f960c00ec80 comp rx=0 tx=0).stop 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 shutdown_connections 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f96040a1550 0x7f96040a3a10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f961c100ea0 0x7f961c196b50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f961c102a40 0x7f961c19e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 --2- 172.21.15.8:0/2227617641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f961c102080 0x7f961c197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 >> 172.21.15.8:0/2227617641 conn(0x7f961c0fc420 msgr2=0x7f961c105720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 shutdown_connections 2023-10-06T23:13:06.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.190+0000 7f96211ff700 1 -- 172.21.15.8:0/2227617641 wait complete. 2023-10-06T23:13:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:13:06.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:13:06.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 -- 172.21.15.8:0/2862588767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 msgr2=0x7fa090073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2862588767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 0x7fa090073340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa080009990 tx=0x7fa080009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 -- 172.21.15.8:0/2862588767 shutdown_connections 2023-10-06T23:13:06.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2862588767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 0x7fa090073340 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2862588767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa090108da0 0x7fa09010b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2862588767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa090073910 0x7fa090073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 -- 172.21.15.8:0/2862588767 >> 172.21.15.8:0/2862588767 conn(0x7fa0900fc430 msgr2=0x7fa0900fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:06.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 -- 172.21.15.8:0/2862588767 shutdown_connections 2023-10-06T23:13:06.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.415+0000 7fa0955ff700 1 -- 172.21.15.8:0/2862588767 wait complete. 2023-10-06T23:13:06.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.416+0000 7fa0955ff700 1 Processor -- start 2023-10-06T23:13:06.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.416+0000 7fa0955ff700 1 -- start start 2023-10-06T23:13:06.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa0955ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa090073910 0x7fa090198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:06.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa0955ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 0x7fa090199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:06.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa0955ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa090108da0 0x7fa0901a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:06.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa0955ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901a0890 con 0x7fa090074ef0 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa0955ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901a0a00 con 0x7fa090108da0 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa0955ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901a0bc0 con 0x7fa090073910 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 0x7fa090199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 0x7fa090199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55708/0 (socket says 172.21.15.8:55708) 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08e7fc700 1 -- 172.21.15.8:0/2291979173 learned_addr learned my addr 172.21.15.8:0/2291979173 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa090073910 0x7fa090198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08f7fe700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa090108da0 0x7fa0901a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08e7fc700 1 -- 172.21.15.8:0/2291979173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa090073910 msgr2=0x7fa090198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08e7fc700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa090073910 0x7fa090198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08e7fc700 1 -- 172.21.15.8:0/2291979173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa090108da0 msgr2=0x7fa0901a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08e7fc700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa090108da0 0x7fa0901a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.417+0000 7fa08e7fc700 1 -- 172.21.15.8:0/2291979173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0800095f0 con 0x7fa090074ef0 2023-10-06T23:13:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.418+0000 7fa08e7fc700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 0x7fa090199290 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa08400d980 tx=0x7fa08400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.418+0000 7fa077fff700 1 -- 172.21.15.8:0/2291979173 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084004020 con 0x7fa090074ef0 2023-10-06T23:13:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.418+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0901a0ea0 con 0x7fa090074ef0 2023-10-06T23:13:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.418+0000 7fa077fff700 1 -- 172.21.15.8:0/2291979173 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa08400f690 con 0x7fa090074ef0 2023-10-06T23:13:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.418+0000 7fa077fff700 1 -- 172.21.15.8:0/2291979173 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0840039e0 con 0x7fa090074ef0 2023-10-06T23:13:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.418+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0901a12c0 con 0x7fa090074ef0 2023-10-06T23:13:06.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.419+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa090107450 con 0x7fa090074ef0 2023-10-06T23:13:06.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.421+0000 7fa077fff700 1 -- 172.21.15.8:0/2291979173 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa08400f800 con 0x7fa090074ef0 2023-10-06T23:13:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.423+0000 7fa077fff700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0780a1480 0x7fa0780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.423+0000 7fa077fff700 1 -- 172.21.15.8:0/2291979173 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa0840cc910 con 0x7fa090074ef0 2023-10-06T23:13:06.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.423+0000 7fa08effd700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0780a1480 0x7fa0780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:06.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.424+0000 7fa08effd700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0780a1480 0x7fa0780a3940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa080000c00 tx=0x7fa08000b560 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:06.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.427+0000 7fa077fff700 1 -- 172.21.15.8:0/2291979173 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa084095f20 con 0x7fa090074ef0 2023-10-06T23:13:06.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:06 smithi156 ceph-mon[102862]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:06.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:06 smithi156 ceph-mon[102862]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:06.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:06 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2227617641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:06.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.641+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa09002d1e0 con 0x7fa090074ef0 2023-10-06T23:13:06.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.641+0000 7fa077fff700 1 -- 172.21.15.8:0/2291979173 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa084099540 con 0x7fa090074ef0 2023-10-06T23:13:06.643 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:13:06.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:06 smithi008 ceph-mon[98532]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:06.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:06 smithi008 ceph-mon[98532]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:06.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:06 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2227617641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:06.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0780a1480 msgr2=0x7fa0780a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0780a1480 0x7fa0780a3940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa080000c00 tx=0x7fa08000b560 comp rx=0 tx=0).stop 2023-10-06T23:13:06.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 msgr2=0x7fa090199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 0x7fa090199290 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa08400d980 tx=0x7fa08400dc90 comp rx=0 tx=0).stop 2023-10-06T23:13:06.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 shutdown_connections 2023-10-06T23:13:06.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa0780a1480 0x7fa0780a3940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa090108da0 0x7fa0901a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa090073910 0x7fa090198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 --2- 172.21.15.8:0/2291979173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa090074ef0 0x7fa090199290 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 >> 172.21.15.8:0/2291979173 conn(0x7fa0900fc430 msgr2=0x7fa0900fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:06.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.644+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 shutdown_connections 2023-10-06T23:13:06.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.645+0000 7fa0955ff700 1 -- 172.21.15.8:0/2291979173 wait complete. 2023-10-06T23:13:06.664 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:13:06.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:06 smithi190 ceph-mon[102658]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:06.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:06 smithi190 ceph-mon[102658]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-06T23:13:06.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:06 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2227617641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 -- 172.21.15.8:0/1165293044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 msgr2=0x7fa15c10b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 --2- 172.21.15.8:0/1165293044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 0x7fa15c10b230 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa15400b0a0 tx=0x7fa15400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 -- 172.21.15.8:0/1165293044 shutdown_connections 2023-10-06T23:13:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 --2- 172.21.15.8:0/1165293044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 0x7fa15c10b230 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 --2- 172.21.15.8:0/1165293044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c074ef0 0x7fa15c073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 --2- 172.21.15.8:0/1165293044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa15c073910 0x7fa15c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 -- 172.21.15.8:0/1165293044 >> 172.21.15.8:0/1165293044 conn(0x7fa15c0fc430 msgr2=0x7fa15c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:06.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 -- 172.21.15.8:0/1165293044 shutdown_connections 2023-10-06T23:13:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.869+0000 7fa1625ff700 1 -- 172.21.15.8:0/1165293044 wait complete. 2023-10-06T23:13:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.871+0000 7fa1625ff700 1 Processor -- start 2023-10-06T23:13:06.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.871+0000 7fa1625ff700 1 -- start start 2023-10-06T23:13:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa1625ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c073910 0x7fa15c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa1625ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa15c074ef0 0x7fa15c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa1625ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 0x7fa15c1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa1625ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c1a0940 con 0x7fa15c108da0 2023-10-06T23:13:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa1625ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c1a0a80 con 0x7fa15c074ef0 2023-10-06T23:13:06.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa1625ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c1a0c10 con 0x7fa15c073910 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa160b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 0x7fa15c1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa160b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 0x7fa15c1a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55738/0 (socket says 172.21.15.8:55738) 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa160b9c700 1 -- 172.21.15.8:0/970749352 learned_addr learned my addr 172.21.15.8:0/970749352 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa15b7fe700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa15c074ef0 0x7fa15c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa15bfff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c073910 0x7fa15c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa160b9c700 1 -- 172.21.15.8:0/970749352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c073910 msgr2=0x7fa15c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa160b9c700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c073910 0x7fa15c198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa160b9c700 1 -- 172.21.15.8:0/970749352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa15c074ef0 msgr2=0x7fa15c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa160b9c700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa15c074ef0 0x7fa15c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa160b9c700 1 -- 172.21.15.8:0/970749352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154009d00 con 0x7fa15c108da0 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa15b7fe700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa15c074ef0 0x7fa15c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:06.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.872+0000 7fa15bfff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c073910 0x7fa15c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.873+0000 7fa160b9c700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 0x7fa15c1a0370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa15400d010 tx=0x7fa15400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.873+0000 7fa1597fa700 1 -- 172.21.15.8:0/970749352 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15400e040 con 0x7fa15c108da0 2023-10-06T23:13:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.873+0000 7fa1597fa700 1 -- 172.21.15.8:0/970749352 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa154003e10 con 0x7fa15c108da0 2023-10-06T23:13:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.873+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c1a0e90 con 0x7fa15c108da0 2023-10-06T23:13:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.873+0000 7fa1597fa700 1 -- 172.21.15.8:0/970749352 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154005310 con 0x7fa15c108da0 2023-10-06T23:13:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.873+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c1a12b0 con 0x7fa15c108da0 2023-10-06T23:13:06.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.874+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15c107450 con 0x7fa15c108da0 2023-10-06T23:13:06.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.876+0000 7fa1597fa700 1 -- 172.21.15.8:0/970749352 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa15401daa0 con 0x7fa15c108da0 2023-10-06T23:13:06.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.877+0000 7fa1597fa700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1440a1500 0x7fa1440a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:06.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.877+0000 7fa1597fa700 1 -- 172.21.15.8:0/970749352 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa1540cde30 con 0x7fa15c108da0 2023-10-06T23:13:06.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.878+0000 7fa15bfff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1440a1500 0x7fa1440a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:06.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.878+0000 7fa15bfff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1440a1500 0x7fa1440a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009cb0 tx=0x7fa14c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:06.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:06.881+0000 7fa1597fa700 1 -- 172.21.15.8:0/970749352 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa1540974d0 con 0x7fa15c108da0 2023-10-06T23:13:07.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.093+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa15c0008d0 con 0x7fa15c108da0 2023-10-06T23:13:07.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.093+0000 7fa1597fa700 1 -- 172.21.15.8:0/970749352 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa15409aaf0 con 0x7fa15c108da0 2023-10-06T23:13:07.095 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:13:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1440a1500 msgr2=0x7fa1440a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1440a1500 0x7fa1440a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009cb0 tx=0x7fa14c009260 comp rx=0 tx=0).stop 2023-10-06T23:13:07.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 msgr2=0x7fa15c1a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 0x7fa15c1a0370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa15400d010 tx=0x7fa15400bd70 comp rx=0 tx=0).stop 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 shutdown_connections 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa1440a1500 0x7fa1440a39c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa15c108da0 0x7fa15c1a0370 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c073910 0x7fa15c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 --2- 172.21.15.8:0/970749352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa15c074ef0 0x7fa15c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 >> 172.21.15.8:0/970749352 conn(0x7fa15c0fc430 msgr2=0x7fa15c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 shutdown_connections 2023-10-06T23:13:07.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.096+0000 7fa1625ff700 1 -- 172.21.15.8:0/970749352 wait complete. 2023-10-06T23:13:07.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:13:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 -- 172.21.15.8:0/2316899849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 msgr2=0x7ff64c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 --2- 172.21.15.8:0/2316899849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 0x7ff64c1012c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009990 tx=0x7ff63c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 -- 172.21.15.8:0/2316899849 shutdown_connections 2023-10-06T23:13:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 --2- 172.21.15.8:0/2316899849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 0x7ff64c1012c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 --2- 172.21.15.8:0/2316899849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff64c102a40 0x7ff64c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 --2- 172.21.15.8:0/2316899849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff64c102080 0x7ff64c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 -- 172.21.15.8:0/2316899849 >> 172.21.15.8:0/2316899849 conn(0x7ff64c0fc460 msgr2=0x7ff64c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 -- 172.21.15.8:0/2316899849 shutdown_connections 2023-10-06T23:13:07.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.321+0000 7ff6509ff700 1 -- 172.21.15.8:0/2316899849 wait complete. 2023-10-06T23:13:07.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.322+0000 7ff6509ff700 1 Processor -- start 2023-10-06T23:13:07.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff6509ff700 1 -- start start 2023-10-06T23:13:07.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff6509ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 0x7ff64c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:07.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff6509ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff64c102080 0x7ff64c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:07.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff6509ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff64c102a40 0x7ff64c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:07.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff6509ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19e6e0 con 0x7ff64c100ea0 2023-10-06T23:13:07.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff6509ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19e820 con 0x7ff64c102a40 2023-10-06T23:13:07.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff6509ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19e9b0 con 0x7ff64c102080 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 0x7ff64c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 0x7ff64c196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55752/0 (socket says 172.21.15.8:55752) 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64a59c700 1 -- 172.21.15.8:0/4125087297 learned_addr learned my addr 172.21.15.8:0/4125087297 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff643fff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff64c102080 0x7ff64c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64ad9d700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff64c102a40 0x7ff64c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64a59c700 1 -- 172.21.15.8:0/4125087297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff64c102080 msgr2=0x7ff64c1970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64a59c700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff64c102080 0x7ff64c1970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64a59c700 1 -- 172.21.15.8:0/4125087297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff64c102a40 msgr2=0x7ff64c19e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64a59c700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff64c102a40 0x7ff64c19e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.323+0000 7ff64a59c700 1 -- 172.21.15.8:0/4125087297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c0095f0 con 0x7ff64c100ea0 2023-10-06T23:13:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.324+0000 7ff64ad9d700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff64c102a40 0x7ff64c19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.324+0000 7ff64a59c700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 0x7ff64c196b60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0095c0 tx=0x7ff63c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.324+0000 7ff6437fe700 1 -- 172.21.15.8:0/4125087297 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c01d070 con 0x7ff64c100ea0 2023-10-06T23:13:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.324+0000 7ff6437fe700 1 -- 172.21.15.8:0/4125087297 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff63c004080 con 0x7ff64c100ea0 2023-10-06T23:13:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.324+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c19ec30 con 0x7ff64c100ea0 2023-10-06T23:13:07.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.324+0000 7ff6437fe700 1 -- 172.21.15.8:0/4125087297 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c022cb0 con 0x7ff64c100ea0 2023-10-06T23:13:07.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.324+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c19f050 con 0x7ff64c100ea0 2023-10-06T23:13:07.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.325+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c107f30 con 0x7ff64c100ea0 2023-10-06T23:13:07.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.327+0000 7ff6437fe700 1 -- 172.21.15.8:0/4125087297 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff63c003bf0 con 0x7ff64c100ea0 2023-10-06T23:13:07.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.328+0000 7ff6437fe700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff6380a1480 0x7ff6380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:07.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.329+0000 7ff6437fe700 1 -- 172.21.15.8:0/4125087297 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff63c0ce450 con 0x7ff64c100ea0 2023-10-06T23:13:07.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.329+0000 7ff643fff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff6380a1480 0x7ff6380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:07.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.329+0000 7ff643fff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff6380a1480 0x7ff6380a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff634005950 tx=0x7ff6340058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:07.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.333+0000 7ff6437fe700 1 -- 172.21.15.8:0/4125087297 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff63c097af0 con 0x7ff64c100ea0 2023-10-06T23:13:07.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:07 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2291979173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:07.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:07 smithi008 ceph-mon[98532]: pgmap v357: 97 pgs: 97 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2023-10-06T23:13:07.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:07 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/970749352' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:07.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.547+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff64c0008d0 con 0x7ff64c100ea0 2023-10-06T23:13:07.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.547+0000 7ff6437fe700 1 -- 172.21.15.8:0/4125087297 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff63c0041f0 con 0x7ff64c100ea0 2023-10-06T23:13:07.549 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:13:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff6380a1480 msgr2=0x7ff6380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff6380a1480 0x7ff6380a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff634005950 tx=0x7ff6340058e0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 msgr2=0x7ff64c196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 0x7ff64c196b60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0095c0 tx=0x7ff63c005ef0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 shutdown_connections 2023-10-06T23:13:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff6380a1480 0x7ff6380a3940 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff64c100ea0 0x7ff64c196b60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff64c102a40 0x7ff64c19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 --2- 172.21.15.8:0/4125087297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff64c102080 0x7ff64c1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 >> 172.21.15.8:0/4125087297 conn(0x7ff64c0fc460 msgr2=0x7ff64c0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 shutdown_connections 2023-10-06T23:13:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.550+0000 7ff6509ff700 1 -- 172.21.15.8:0/4125087297 wait complete. 2023-10-06T23:13:07.570 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:13:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:07 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2291979173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:07 smithi156 ceph-mon[102862]: pgmap v357: 97 pgs: 97 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2023-10-06T23:13:07.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:07 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/970749352' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:07.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:07 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2291979173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:13:07.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:07 smithi190 ceph-mon[102658]: pgmap v357: 97 pgs: 97 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2023-10-06T23:13:07.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:07 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/970749352' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:13:07.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 -- 172.21.15.8:0/3749533300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0102a40 msgr2=0x7f6bc0109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/3749533300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0102a40 0x7f6bc0109360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009f90 tx=0x7f6bb800b330 comp rx=0 tx=0).stop 2023-10-06T23:13:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 -- 172.21.15.8:0/3749533300 shutdown_connections 2023-10-06T23:13:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/3749533300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0102a40 0x7f6bc0109360 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/3749533300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc0100ea0 0x7f6bc01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/3749533300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0102080 0x7f6bc0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 -- 172.21.15.8:0/3749533300 >> 172.21.15.8:0/3749533300 conn(0x7f6bc00fc420 msgr2=0x7f6bc00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 -- 172.21.15.8:0/3749533300 shutdown_connections 2023-10-06T23:13:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.772+0000 7f6bc71ff700 1 -- 172.21.15.8:0/3749533300 wait complete. 2023-10-06T23:13:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.773+0000 7f6bc71ff700 1 Processor -- start 2023-10-06T23:13:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.773+0000 7f6bc71ff700 1 -- start start 2023-10-06T23:13:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.773+0000 7f6bc71ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0100ea0 0x7f6bc0196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.773+0000 7f6bc71ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0102080 0x7f6bc0197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc71ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc0102a40 0x7f6bc019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc71ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019e760 con 0x7f6bc0100ea0 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc71ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019e8d0 con 0x7f6bc0102080 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc71ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019ea90 con 0x7f6bc0102a40 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc4f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0100ea0 0x7f6bc0196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc4f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0100ea0 0x7f6bc0196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55784/0 (socket says 172.21.15.8:55784) 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc4f9b700 1 -- 172.21.15.8:0/2443452051 learned_addr learned my addr 172.21.15.8:0/2443452051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc579c700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc0102a40 0x7f6bc019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bbffff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0102080 0x7f6bc0197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc4f9b700 1 -- 172.21.15.8:0/2443452051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc0102a40 msgr2=0x7f6bc019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc4f9b700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc0102a40 0x7f6bc019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc4f9b700 1 -- 172.21.15.8:0/2443452051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0102080 msgr2=0x7f6bc0197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc4f9b700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0102080 0x7f6bc0197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bc4f9b700 1 -- 172.21.15.8:0/2443452051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac0095f0 con 0x7f6bc0100ea0 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.774+0000 7f6bbffff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0102080 0x7f6bc0197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.775+0000 7f6bc4f9b700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0100ea0 0x7f6bc0196c20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e970 tx=0x7f6bb400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.775+0000 7f6bbdffb700 1 -- 172.21.15.8:0/2443452051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4009790 con 0x7f6bc0100ea0 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.775+0000 7f6bbdffb700 1 -- 172.21.15.8:0/2443452051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6bb400eec0 con 0x7f6bc0100ea0 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.775+0000 7f6bbdffb700 1 -- 172.21.15.8:0/2443452051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4003c10 con 0x7f6bc0100ea0 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.775+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb8009c40 con 0x7f6bc0100ea0 2023-10-06T23:13:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.775+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc019f0f0 con 0x7f6bc0100ea0 2023-10-06T23:13:07.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.776+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc010c610 con 0x7f6bc0100ea0 2023-10-06T23:13:07.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.778+0000 7f6bbdffb700 1 -- 172.21.15.8:0/2443452051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6bb4003db0 con 0x7f6bc0100ea0 2023-10-06T23:13:07.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.779+0000 7f6bbdffb700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6bb00a1550 0x7f6bb00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:07.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.779+0000 7f6bbdffb700 1 -- 172.21.15.8:0/2443452051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6bb4014070 con 0x7f6bc0100ea0 2023-10-06T23:13:07.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.779+0000 7f6bbffff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6bb00a1550 0x7f6bb00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:07.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.780+0000 7f6bbffff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6bb00a1550 0x7f6bb00a3a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0100bc0 tx=0x7f6bac009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:07.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:07.783+0000 7f6bbdffb700 1 -- 172.21.15.8:0/2443452051 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6bb4096560 con 0x7f6bc0100ea0 2023-10-06T23:13:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.041+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bc0107e40 con 0x7f6bc0100ea0 2023-10-06T23:13:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.041+0000 7f6bbdffb700 1 -- 172.21.15.8:0/2443452051 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11306 (secure 0 0 0) 0x7f6bb4099b80 con 0x7f6bc0100ea0 2023-10-06T23:13:08.043 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:08.043 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:11:23.244586+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:13:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6bb00a1550 msgr2=0x7f6bb00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6bb00a1550 0x7f6bb00a3a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0100bc0 tx=0x7f6bac009310 comp rx=0 tx=0).stop 2023-10-06T23:13:08.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0100ea0 msgr2=0x7f6bc0196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0100ea0 0x7f6bc0196c20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e970 tx=0x7f6bb400ec80 comp rx=0 tx=0).stop 2023-10-06T23:13:08.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 shutdown_connections 2023-10-06T23:13:08.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6bb00a1550 0x7f6bb00a3a10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bc0100ea0 0x7f6bc0196c20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc0102a40 0x7f6bc019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 --2- 172.21.15.8:0/2443452051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0102080 0x7f6bc0197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 >> 172.21.15.8:0/2443452051 conn(0x7f6bc00fc420 msgr2=0x7f6bc00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 shutdown_connections 2023-10-06T23:13:08.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.044+0000 7f6bc71ff700 1 -- 172.21.15.8:0/2443452051 wait complete. 2023-10-06T23:13:08.048 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 23 2023-10-06T23:13:08.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:13:08.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.265+0000 7fc2c27ff700 1 -- 172.21.15.8:0/1115125936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc102a40 msgr2=0x7fc2bc109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.265+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/1115125936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc102a40 0x7fc2bc109360 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400b0a0 tx=0x7fc2b400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.265+0000 7fc2c27ff700 1 -- 172.21.15.8:0/1115125936 shutdown_connections 2023-10-06T23:13:08.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.265+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/1115125936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc102a40 0x7fc2bc109360 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.265+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/1115125936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc100ea0 0x7fc2bc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.265+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/1115125936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2bc102080 0x7fc2bc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.265+0000 7fc2c27ff700 1 -- 172.21.15.8:0/1115125936 >> 172.21.15.8:0/1115125936 conn(0x7fc2bc0fc420 msgr2=0x7fc2bc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.265+0000 7fc2c27ff700 1 -- 172.21.15.8:0/1115125936 shutdown_connections 2023-10-06T23:13:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.266+0000 7fc2c27ff700 1 -- 172.21.15.8:0/1115125936 wait complete. 2023-10-06T23:13:08.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.267+0000 7fc2c27ff700 1 Processor -- start 2023-10-06T23:13:08.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.267+0000 7fc2c27ff700 1 -- start start 2023-10-06T23:13:08.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2c27ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc100ea0 0x7fc2bc196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2c27ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2bc102080 0x7fc2bc197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2c27ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc102a40 0x7fc2bc19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2c27ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc19e770 con 0x7fc2bc100ea0 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2c27ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc19e8e0 con 0x7fc2bc102080 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2c27ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc19eaa0 con 0x7fc2bc102a40 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc100ea0 0x7fc2bc196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc100ea0 0x7fc2bc196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55810/0 (socket says 172.21.15.8:55810) 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bbfff700 1 -- 172.21.15.8:0/67248433 learned_addr learned my addr 172.21.15.8:0/67248433 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2c0d9c700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc102a40 0x7fc2bc19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bbfff700 1 -- 172.21.15.8:0/67248433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc102a40 msgr2=0x7fc2bc19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bbfff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc102a40 0x7fc2bc19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bb7fe700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2bc102080 0x7fc2bc197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bbfff700 1 -- 172.21.15.8:0/67248433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2bc102080 msgr2=0x7fc2bc197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bbfff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2bc102080 0x7fc2bc197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bbfff700 1 -- 172.21.15.8:0/67248433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4009d00 con 0x7fc2bc100ea0 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.268+0000 7fc2bb7fe700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2bc102080 0x7fc2bc197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.269+0000 7fc2bbfff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc100ea0 0x7fc2bc196c30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00e970 tx=0x7fc2ac00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.269+0000 7fc2b97fa700 1 -- 172.21.15.8:0/67248433 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac009790 con 0x7fc2bc100ea0 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.269+0000 7fc2b97fa700 1 -- 172.21.15.8:0/67248433 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2ac00eec0 con 0x7fc2bc100ea0 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.269+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2bc19ed80 con 0x7fc2bc100ea0 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.269+0000 7fc2b97fa700 1 -- 172.21.15.8:0/67248433 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac003c10 con 0x7fc2bc100ea0 2023-10-06T23:13:08.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.269+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2bc19f220 con 0x7fc2bc100ea0 2023-10-06T23:13:08.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.270+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2bc108510 con 0x7fc2bc100ea0 2023-10-06T23:13:08.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.272+0000 7fc2b97fa700 1 -- 172.21.15.8:0/67248433 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc2ac003db0 con 0x7fc2bc100ea0 2023-10-06T23:13:08.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.273+0000 7fc2b97fa700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2a40a1550 0x7fc2a40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.273+0000 7fc2b97fa700 1 -- 172.21.15.8:0/67248433 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc2ac014070 con 0x7fc2bc100ea0 2023-10-06T23:13:08.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.274+0000 7fc2bb7fe700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2a40a1550 0x7fc2a40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.274+0000 7fc2bb7fe700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2a40a1550 0x7fc2a40a3a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0005e10 tx=0x7fc2b0005d20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:08.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.277+0000 7fc2b97fa700 1 -- 172.21.15.8:0/67248433 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc2ac096560 con 0x7fc2bc100ea0 2023-10-06T23:13:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:08 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4125087297' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:08 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2443452051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:08.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.494+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2bc02d240 con 0x7fc2bc100ea0 2023-10-06T23:13:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.495+0000 7fc2b97fa700 1 -- 172.21.15.8:0/67248433 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22491 (secure 0 0 0) 0x7fc2ac099b80 con 0x7fc2bc100ea0 2023-10-06T23:13:08.497 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:08.497 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":88,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:11:50.023175+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:13:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.498+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2a40a1550 msgr2=0x7fc2a40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.498+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2a40a1550 0x7fc2a40a3a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0005e10 tx=0x7fc2b0005d20 comp rx=0 tx=0).stop 2023-10-06T23:13:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc100ea0 msgr2=0x7fc2bc196c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc100ea0 0x7fc2bc196c30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00e970 tx=0x7fc2ac00ec80 comp rx=0 tx=0).stop 2023-10-06T23:13:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 shutdown_connections 2023-10-06T23:13:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc2a40a1550 0x7fc2a40a3a10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2bc100ea0 0x7fc2bc196c30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2bc102a40 0x7fc2bc19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 --2- 172.21.15.8:0/67248433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2bc102080 0x7fc2bc197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 >> 172.21.15.8:0/67248433 conn(0x7fc2bc0fc420 msgr2=0x7fc2bc105650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 shutdown_connections 2023-10-06T23:13:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.499+0000 7fc2c27ff700 1 -- 172.21.15.8:0/67248433 wait complete. 2023-10-06T23:13:08.520 DEBUG:tasks.fwd_scrub:Yielding 2023-10-06T23:13:08.520 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-06T23:13:08.530 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T23:13:08.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-06T23:13:08.531 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-06T23:13:08.531 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-06T23:13:08.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-06T23:13:08.535 INFO:teuthology.run_tasks:Running task exec... 2023-10-06T23:13:08.573 INFO:teuthology.task.exec:Executing custom commands... 2023-10-06T23:13:08.573 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T23:13:08.573 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-10-06T23:13:08.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:08 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4125087297' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:08.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:08 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2443452051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:08.684 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-10-06T23:13:08.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:08 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4125087297' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:13:08.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:08 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2443452051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:08.727 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem Size Used Avail Use% Mounted on 2023-10-06T23:13:08.727 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-fuse 340G 0 340G 0% /tmp/cephfs 2023-10-06T23:13:08.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-10-06T23:13:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 -- 172.21.15.8:0/3672912358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444104270 msgr2=0x7f9444106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 --2- 172.21.15.8:0/3672912358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444104270 0x7f9444106660 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9434009990 tx=0x7f9434009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 -- 172.21.15.8:0/3672912358 shutdown_connections 2023-10-06T23:13:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 --2- 172.21.15.8:0/3672912358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9444106ba0 0x7f9444109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 --2- 172.21.15.8:0/3672912358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9444101940 0x7f9444103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 --2- 172.21.15.8:0/3672912358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444104270 0x7f9444106660 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 -- 172.21.15.8:0/3672912358 >> 172.21.15.8:0/3672912358 conn(0x7f94440fb330 msgr2=0x7f94440fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 -- 172.21.15.8:0/3672912358 shutdown_connections 2023-10-06T23:13:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.750+0000 7f944c7ff700 1 -- 172.21.15.8:0/3672912358 wait complete. 2023-10-06T23:13:08.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.751+0000 7f944c7ff700 1 Processor -- start 2023-10-06T23:13:08.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.752+0000 7f944c7ff700 1 -- start start 2023-10-06T23:13:08.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.752+0000 7f944c7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444101940 0x7f9444198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.752+0000 7f944c7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9444104270 0x7f9444199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.752+0000 7f944c7ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9444106ba0 0x7f94441a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.752+0000 7f944c7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94441a0880 con 0x7f9444101940 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.752+0000 7f944c7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94441a09f0 con 0x7f9444104270 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.752+0000 7f944c7ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94441a0bb0 con 0x7f9444106ba0 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.752+0000 7f944a59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444101940 0x7f9444198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944a59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444101940 0x7f9444198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55838/0 (socket says 172.21.15.8:55838) 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944a59b700 1 -- 172.21.15.8:0/1226264865 learned_addr learned my addr 172.21.15.8:0/1226264865 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f9449d9a700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9444104270 0x7f9444199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944ad9c700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9444106ba0 0x7f94441a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944a59b700 1 -- 172.21.15.8:0/1226264865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9444106ba0 msgr2=0x7f94441a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944a59b700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9444106ba0 0x7f94441a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944a59b700 1 -- 172.21.15.8:0/1226264865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9444104270 msgr2=0x7f9444199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944a59b700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9444104270 0x7f9444199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944a59b700 1 -- 172.21.15.8:0/1226264865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94340095f0 con 0x7f9444101940 2023-10-06T23:13:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f9449d9a700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9444104270 0x7f9444199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.753+0000 7f944a59b700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444101940 0x7f9444198d40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f944000d980 tx=0x7f944000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.754+0000 7f943b7fe700 1 -- 172.21.15.8:0/1226264865 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000bb60 con 0x7f9444101940 2023-10-06T23:13:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.754+0000 7f943b7fe700 1 -- 172.21.15.8:0/1226264865 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9440007640 con 0x7f9444101940 2023-10-06T23:13:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.754+0000 7f943b7fe700 1 -- 172.21.15.8:0/1226264865 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440004d60 con 0x7f9444101940 2023-10-06T23:13:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.754+0000 7f944c7ff700 1 -- 172.21.15.8:0/1226264865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94441a0e90 con 0x7f9444101940 2023-10-06T23:13:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.754+0000 7f944c7ff700 1 -- 172.21.15.8:0/1226264865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94441a12b0 con 0x7f9444101940 2023-10-06T23:13:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.757+0000 7f943b7fe700 1 -- 172.21.15.8:0/1226264865 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9440004020 con 0x7f9444101940 2023-10-06T23:13:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.758+0000 7f943b7fe700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f94300a1500 0x7f94300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f94600a5b80 1 Processor -- start 2023-10-06T23:13:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f943b7fe700 1 -- 172.21.15.8:0/1226264865 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f94400ccbb0 con 0x7f9444101940 2023-10-06T23:13:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f94600a5b80 1 -- start start 2023-10-06T23:13:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f9449d9a700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f94300a1500 0x7f94300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d778700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 0x564d7d779500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d779f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f94600a5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d6e04e0 con 0x564d7d7782e0 2023-10-06T23:13:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f94600a5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d6d1ca0 con 0x564d7d778c40 2023-10-06T23:13:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f94600a5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d6cf5c0 con 0x564d7d779ae0 2023-10-06T23:13:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.759+0000 7f944a59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d778700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944a59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d778700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55846/0 (socket says 172.21.15.8:55846) 2023-10-06T23:13:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944a59b700 1 -- 172.21.15.8:0/2029061852 learned_addr learned my addr 172.21.15.8:0/2029061852 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944ad9c700 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d779f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f9449d9a700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f94300a1500 0x7f94300a39c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9434006010 tx=0x7f943400b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f9449d9a700 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 0x564d7d779500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944a59b700 1 -- 172.21.15.8:0/2029061852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 msgr2=0x564d7d779f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944a59b700 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d779f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944a59b700 1 -- 172.21.15.8:0/2029061852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 msgr2=0x564d7d779500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944a59b700 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 0x564d7d779500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944a59b700 1 -- 172.21.15.8:0/2029061852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d7d4f5e60 con 0x564d7d7782e0 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.760+0000 7f944a59b700 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d778700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9440099e10 tx=0x7f94400997e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c267ce6750a3b6ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.761+0000 7f9438ff9700 1 -- 172.21.15.8:0/2029061852 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000f3c0 con 0x564d7d7782e0 2023-10-06T23:13:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.761+0000 7f9438ff9700 1 -- 172.21.15.8:0/2029061852 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f944009a580 con 0x564d7d7782e0 2023-10-06T23:13:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.761+0000 7f9438ff9700 1 -- 172.21.15.8:0/2029061852 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440099370 con 0x564d7d7782e0 2023-10-06T23:13:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 -- 172.21.15.8:0/2029061852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 msgr2=0x564d7d778700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d778700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9440099e10 tx=0x7f94400997e0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 -- 172.21.15.8:0/2029061852 shutdown_connections 2023-10-06T23:13:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d778700 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d779f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2029061852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 0x564d7d779500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 -- 172.21.15.8:0/2029061852 >> 172.21.15.8:0/2029061852 conn(0x564d7d6ec2e0 msgr2=0x564d7d7731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 -- 172.21.15.8:0/2029061852 shutdown_connections 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 -- 172.21.15.8:0/2029061852 wait complete. 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.762+0000 7f94600a5b80 1 -- start start 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f94600a5b80 1 Processor -- start 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d7782e0 0x564d7d782120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d782660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d779ae0 0x564d7d7896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f94600a5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d6caeb0 con 0x564d7d778c40 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f94600a5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d667790 con 0x564d7d779ae0 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f94600a5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d667430 con 0x564d7d7782e0 2023-10-06T23:13:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f94600a5b80 10 client.0 _ll_register_callbacks cb 0x564d7d4c4880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.763+0000 7f9449d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d782660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f944a59b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d7782e0 0x564d7d782120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f9449d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d782660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55854/0 (socket says 172.21.15.8:55854) 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f9449d9a700 1 -- 172.21.15.8:0/214814934 learned_addr learned my addr 172.21.15.8:0/214814934 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f944ad9c700 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d779ae0 0x564d7d7896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f944a59b700 1 -- 172.21.15.8:0/214814934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d779ae0 msgr2=0x564d7d7896a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f944a59b700 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d779ae0 0x564d7d7896a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f944a59b700 1 -- 172.21.15.8:0/214814934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 msgr2=0x564d7d782660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f944a59b700 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d782660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f944a59b700 1 -- 172.21.15.8:0/214814934 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94441a12b0 con 0x564d7d7782e0 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f944a59b700 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d7782e0 0x564d7d782120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9440099e10 tx=0x7f944000df20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17fa5aad8ac558e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f942dffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:13:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.764+0000 7f942dffb700 1 -- 172.21.15.8:0/214814934 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000f3c0 con 0x564d7d7782e0 2023-10-06T23:13:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f942dffb700 1 -- 172.21.15.8:0/214814934 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9440099e80 con 0x564d7d7782e0 2023-10-06T23:13:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 1 -- 172.21.15.8:0/214814934 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d7d76af90 con 0x564d7d7782e0 2023-10-06T23:13:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f942dffb700 1 -- 172.21.15.8:0/214814934 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9440099570 con 0x564d7d7782e0 2023-10-06T23:13:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 10 client.25219 fetch_fsmap learned FSMap version 23 2023-10-06T23:13:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 1 -- 172.21.15.8:0/214814934 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564d7d4dece0 con 0x564d7d7782e0 2023-10-06T23:13:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f942dffb700 1 -- 172.21.15.8:0/214814934 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f94400a6080 con 0x564d7d7782e0 2023-10-06T23:13:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f942dffb700 1 -- 172.21.15.8:0/214814934 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9440098de0 con 0x564d7d7782e0 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 10 client.25219 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 10 client.25219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 20 client.25219 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d7d78d9d0 0x564d7d78fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 4 client.25219 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.765+0000 7f94600a5b80 1 -- 172.21.15.8:0/214814934 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d7d6c3e90 con 0x564d7d78d9d0 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.766+0000 7f9449d9a700 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d7d78d9d0 0x564d7d78fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.767+0000 7f942dffb700 10 client.25219 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.767+0000 7f9449d9a700 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d7d78d9d0 0x564d7d78fdc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35fb028c8cdd5cc8 server_cookie=569869910617a6e in_seq=0 out_seq=0 2023-10-06T23:13:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f942dffb700 1 -- 172.21.15.8:0/214814934 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564d7d6c3e90 con 0x564d7d78d9d0 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f942dffb700 10 client.25219 handle_command_reply: tid=0 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 client.25219 shutdown 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 -- 172.21.15.8:0/214814934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d7782e0 msgr2=0x564d7d782120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d7782e0 0x564d7d782120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9440099e10 tx=0x7f944000df20 comp rx=0 tx=0).stop 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 -- 172.21.15.8:0/214814934 shutdown_connections 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d7d78d9d0 0x564d7d78fdc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d779ae0 0x564d7d7896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d7782e0 0x564d7d782120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 --2- 172.21.15.8:0/214814934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d782660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 -- 172.21.15.8:0/214814934 >> 172.21.15.8:0/214814934 conn(0x564d7d6ec2e0 msgr2=0x564d7d772fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f942dffb700 0 client.25219 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 -- 172.21.15.8:0/214814934 shutdown_connections 2023-10-06T23:13:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 1 -- 172.21.15.8:0/214814934 wait complete. 2023-10-06T23:13:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.768+0000 7f94600a5b80 20 client.25219 trim_cache size 0 max 16384 2023-10-06T23:13:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.786+0000 7f94600a5b80 1 Processor -- start 2023-10-06T23:13:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.786+0000 7f94600a5b80 1 -- start start 2023-10-06T23:13:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d772fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 0x564d7d789660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d77ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f94600a5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d54b9a0 con 0x564d7d7782e0 2023-10-06T23:13:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f94600a5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d783310 con 0x564d7d778c40 2023-10-06T23:13:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f94600a5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d780980 con 0x564d7d779ae0 2023-10-06T23:13:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944a59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d772fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944a59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d772fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55862/0 (socket says 172.21.15.8:55862) 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944a59b700 1 -- 172.21.15.8:0/1801524658 learned_addr learned my addr 172.21.15.8:0/1801524658 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944ad9c700 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d77ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f9449d9a700 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 0x564d7d789660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944a59b700 1 -- 172.21.15.8:0/1801524658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 msgr2=0x564d7d77ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944a59b700 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d77ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944a59b700 1 -- 172.21.15.8:0/1801524658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 msgr2=0x564d7d789660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944a59b700 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 0x564d7d789660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.787+0000 7f944a59b700 1 -- 172.21.15.8:0/1801524658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d7d7949b0 con 0x564d7d7782e0 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.788+0000 7f944a59b700 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d772fd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f944009e190 tx=0x7f94400a2390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f997832cae09276 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.788+0000 7f94397fa700 1 -- 172.21.15.8:0/1801524658 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000f3c0 con 0x564d7d7782e0 2023-10-06T23:13:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.788+0000 7f94397fa700 1 -- 172.21.15.8:0/1801524658 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564d7d76af90 con 0x564d7d7782e0 2023-10-06T23:13:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.788+0000 7f94397fa700 1 -- 172.21.15.8:0/1801524658 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440099e80 con 0x564d7d7782e0 2023-10-06T23:13:08.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 -- 172.21.15.8:0/1801524658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 msgr2=0x564d7d772fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d772fd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f944009e190 tx=0x7f94400a2390 comp rx=0 tx=0).stop 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 -- 172.21.15.8:0/1801524658 shutdown_connections 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d7782e0 0x564d7d772fd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d77ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 --2- 172.21.15.8:0/1801524658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d778c40 0x564d7d789660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 -- 172.21.15.8:0/1801524658 >> 172.21.15.8:0/1801524658 conn(0x564d7d6ec2e0 msgr2=0x564d7d789f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 -- 172.21.15.8:0/1801524658 shutdown_connections 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 -- 172.21.15.8:0/1801524658 wait complete. 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.789+0000 7f94600a5b80 1 -- start start 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f94600a5b80 1 Processor -- start 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d7782e0 0x564d7d787dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d788310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f94600a5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d788850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f94600a5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d789a50 con 0x564d7d778c40 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f94600a5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d7e1780 con 0x564d7d7782e0 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f94600a5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7d7e1940 con 0x564d7d779ae0 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f94600a5b80 10 client.0 _ll_register_callbacks cb 0x7f943c009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f9449d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d788310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.790+0000 7f9449d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d788310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55870/0 (socket says 172.21.15.8:55870) 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f944a59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d7782e0 0x564d7d787dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f9449d9a700 1 -- 172.21.15.8:0/2350063990 learned_addr learned my addr 172.21.15.8:0/2350063990 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f944ad9c700 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d788850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f9449d9a700 1 -- 172.21.15.8:0/2350063990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 msgr2=0x564d7d788850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f9449d9a700 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d788850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f9449d9a700 1 -- 172.21.15.8:0/2350063990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d7782e0 msgr2=0x564d7d787dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f9449d9a700 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d7782e0 0x564d7d787dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f9449d9a700 1 -- 172.21.15.8:0/2350063990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d7d4dece0 con 0x564d7d778c40 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f944a59b700 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d7782e0 0x564d7d787dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f9449d9a700 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d788310 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9434003f60 tx=0x7f9434009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502559b247b39de8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.791+0000 7f942dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f942dffb700 1 -- 172.21.15.8:0/2350063990 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943402b070 con 0x564d7d778c40 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 1 -- 172.21.15.8:0/2350063990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f944009a580 con 0x564d7d778c40 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f942dffb700 1 -- 172.21.15.8:0/2350063990 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9434003d10 con 0x564d7d778c40 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f942dffb700 1 -- 172.21.15.8:0/2350063990 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9434032980 con 0x564d7d778c40 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 10 client.15393 fetch_fsmap learned FSMap version 23 2023-10-06T23:13:08.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 1 -- 172.21.15.8:0/2350063990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564d7d76f1c0 con 0x564d7d778c40 2023-10-06T23:13:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f942dffb700 1 -- 172.21.15.8:0/2350063990 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f944009a580 con 0x564d7d778c40 2023-10-06T23:13:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f942dffb700 1 -- 172.21.15.8:0/2350063990 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9434043070 con 0x564d7d778c40 2023-10-06T23:13:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 10 client.15393 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:13:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 10 client.15393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 20 client.15393 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d7d7e3280 0x564d7d7e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 4 client.15393 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-06T23:13:08.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.792+0000 7f94600a5b80 1 -- 172.21.15.8:0/2350063990 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564d7d6c3bb0 con 0x564d7d7e3280 2023-10-06T23:13:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.793+0000 7f944a59b700 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d7d7e3280 0x564d7d7e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.793+0000 7f944a59b700 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d7d7e3280 0x564d7d7e56a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec1d749953320534 server_cookie=88b3a3397075f2e3 in_seq=0 out_seq=0 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.793+0000 7f942dffb700 10 client.15393 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.794+0000 7f942dffb700 1 -- 172.21.15.8:0/2350063990 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564d7d6c3bb0 con 0x564d7d7e3280 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.794+0000 7f942dffb700 10 client.15393 handle_command_reply: tid=0 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.794+0000 7f94600a5b80 1 client.15393 shutdown 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.794+0000 7f94600a5b80 1 -- 172.21.15.8:0/2350063990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 msgr2=0x564d7d788310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.794+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d788310 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9434003f60 tx=0x7f9434009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.794+0000 7f94600a5b80 1 -- 172.21.15.8:0/2350063990 shutdown_connections 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.794+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d7d7e3280 0x564d7d7e56a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f942dffb700 0 client.15393 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.794+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d7d779ae0 0x564d7d788850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d7d7782e0 0x564d7d787dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f94600a5b80 1 --2- 172.21.15.8:0/2350063990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d7d778c40 0x564d7d788310 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f94600a5b80 1 -- 172.21.15.8:0/2350063990 >> 172.21.15.8:0/2350063990 conn(0x564d7d6ec2e0 msgr2=0x564d7d77ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f94600a5b80 1 -- 172.21.15.8:0/2350063990 shutdown_connections 2023-10-06T23:13:08.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f94600a5b80 1 -- 172.21.15.8:0/2350063990 wait complete. 2023-10-06T23:13:08.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f94600a5b80 20 client.15393 trim_cache size 0 max 16384 2023-10-06T23:13:08.800 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:13:08.800 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-06T23:13:08.800 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "da04de51-d335-44e6-b757-90f9c8b35691", 2023-10-06T23:13:08.800 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-06T23:13:08.801 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:13:08.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f944c7ff700 1 -- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f94300a1500 msgr2=0x7f94300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f944c7ff700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f94300a1500 0x7f94300a39c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9434006010 tx=0x7f943400b260 comp rx=0 tx=0).stop 2023-10-06T23:13:08.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f944c7ff700 1 -- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444101940 msgr2=0x7f9444198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:08.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.795+0000 7f944c7ff700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444101940 0x7f9444198d40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f944000d980 tx=0x7f944000dd40 comp rx=0 tx=0).stop 2023-10-06T23:13:08.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.796+0000 7f944c7ff700 1 -- 172.21.15.8:0/1226264865 shutdown_connections 2023-10-06T23:13:08.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.796+0000 7f944c7ff700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f94300a1500 0x7f94300a39c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.796+0000 7f944c7ff700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9444101940 0x7f9444198d40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.796+0000 7f944c7ff700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9444106ba0 0x7f94441a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.796+0000 7f944c7ff700 1 --2- 172.21.15.8:0/1226264865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9444104270 0x7f9444199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:08.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.796+0000 7f944c7ff700 1 -- 172.21.15.8:0/1226264865 >> 172.21.15.8:0/1226264865 conn(0x7f94440fb330 msgr2=0x7f94440fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:08.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.796+0000 7f944c7ff700 1 -- 172.21.15.8:0/1226264865 shutdown_connections 2023-10-06T23:13:08.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:08.796+0000 7f944c7ff700 1 -- 172.21.15.8:0/1226264865 wait complete. 2023-10-06T23:13:08.817 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:13:08.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-10-06T23:13:09.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/1632986426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb94106c20 msgr2=0x7ffb94109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/1632986426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb94106c20 0x7ffb94109090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00b0a0 tx=0x7ffb8c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/1632986426 shutdown_connections 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/1632986426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb94106c20 0x7ffb94109090 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/1632986426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb941019c0 0x7ffb94103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/1632986426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb941042f0 0x7ffb941066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/1632986426 >> 172.21.15.8:0/1632986426 conn(0x7ffb940fb3b0 msgr2=0x7ffb940fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/1632986426 shutdown_connections 2023-10-06T23:13:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.068+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/1632986426 wait complete. 2023-10-06T23:13:09.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.069+0000 7ffb9a3ff700 1 Processor -- start 2023-10-06T23:13:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.069+0000 7ffb9a3ff700 1 -- start start 2023-10-06T23:13:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb9a3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb941019c0 0x7ffb94196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb9a3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb941042f0 0x7ffb94197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb9a3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb94106c20 0x7ffb9419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb9a3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9419e760 con 0x7ffb941042f0 2023-10-06T23:13:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb9a3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9419e8a0 con 0x7ffb94106c20 2023-10-06T23:13:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb9a3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9419ea30 con 0x7ffb941019c0 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb941042f0 0x7ffb94197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb941042f0 0x7ffb94197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55886/0 (socket says 172.21.15.8:55886) 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb937fe700 1 -- 172.21.15.8:0/100148210 learned_addr learned my addr 172.21.15.8:0/100148210 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb93fff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb941019c0 0x7ffb94196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.070+0000 7ffb9899c700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb94106c20 0x7ffb9419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb93fff700 1 -- 172.21.15.8:0/100148210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb94106c20 msgr2=0x7ffb9419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb93fff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb94106c20 0x7ffb9419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb93fff700 1 -- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb941042f0 msgr2=0x7ffb94197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb93fff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb941042f0 0x7ffb94197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb93fff700 1 -- 172.21.15.8:0/100148210 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c009d00 con 0x7ffb941019c0 2023-10-06T23:13:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb937fe700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb941042f0 0x7ffb94197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb93fff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb941019c0 0x7ffb94196be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400d950 tx=0x7ffb8400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb917fa700 1 -- 172.21.15.8:0/100148210 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84009930 con 0x7ffb941019c0 2023-10-06T23:13:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb917fa700 1 -- 172.21.15.8:0/100148210 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb84010460 con 0x7ffb941019c0 2023-10-06T23:13:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/100148210 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9419ed10 con 0x7ffb941019c0 2023-10-06T23:13:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.071+0000 7ffb917fa700 1 -- 172.21.15.8:0/100148210 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400b5d0 con 0x7ffb941019c0 2023-10-06T23:13:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.072+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/100148210 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9419f1c0 con 0x7ffb941019c0 2023-10-06T23:13:09.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.075+0000 7ffb917fa700 1 -- 172.21.15.8:0/100148210 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ffb84009a90 con 0x7ffb941019c0 2023-10-06T23:13:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.076+0000 7ffbadd8eb80 1 Processor -- start 2023-10-06T23:13:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.076+0000 7ffbadd8eb80 1 -- start start 2023-10-06T23:13:09.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3e670 0x563b20a3ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a3f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a402f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b209a2460 con 0x563b20a3fe70 2023-10-06T23:13:09.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b20993c20 con 0x563b20a3e670 2023-10-06T23:13:09.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b20991540 con 0x563b20a3efd0 2023-10-06T23:13:09.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffb917fa700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ffb7c0a1500 0x7ffb7c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffb93fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a3f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffb9899c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3e670 0x563b20a3ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffb9899c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3e670 0x563b20a3ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47048/0 (socket says 172.21.15.8:47048) 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffb9899c700 1 -- 172.21.15.8:0/492170693 learned_addr learned my addr 172.21.15.8:0/492170693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffb917fa700 1 -- 172.21.15.8:0/100148210 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffb840cc890 con 0x7ffb941019c0 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffb9899c700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ffb7c0a1500 0x7ffb7c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.077+0000 7ffb937fe700 1 --2- 172.21.15.8:0/492170693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb93fff700 1 -- 172.21.15.8:0/492170693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3e670 msgr2=0x563b20a3ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb93fff700 1 --2- 172.21.15.8:0/492170693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3e670 0x563b20a3ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb93fff700 1 -- 172.21.15.8:0/492170693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 msgr2=0x563b20a402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb93fff700 1 --2- 172.21.15.8:0/492170693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a402f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb93fff700 1 -- 172.21.15.8:0/492170693 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b207b7de0 con 0x563b20a3efd0 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb9899c700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ffb7c0a1500 0x7ffb7c0a39c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00b0a0 tx=0x7ffb8c0099e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:09.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb93fff700 1 --2- 172.21.15.8:0/492170693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a3f890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009520 tx=0x7ffb8408f320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b019ce9c1c38768 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:09.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb7a7fc700 1 -- 172.21.15.8:0/492170693 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840994c0 con 0x563b20a3efd0 2023-10-06T23:13:09.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb7a7fc700 1 -- 172.21.15.8:0/492170693 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb8409ae90 con 0x563b20a3efd0 2023-10-06T23:13:09.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.078+0000 7ffb7a7fc700 1 -- 172.21.15.8:0/492170693 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84099b60 con 0x563b20a3efd0 2023-10-06T23:13:09.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/492170693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 msgr2=0x563b20a3f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/492170693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a3f890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009520 tx=0x7ffb8408f320 comp rx=0 tx=0).stop 2023-10-06T23:13:09.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/492170693 shutdown_connections 2023-10-06T23:13:09.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/492170693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/492170693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3e670 0x563b20a3ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/492170693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a3f890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/492170693 >> 172.21.15.8:0/492170693 conn(0x563b209ae260 msgr2=0x563b20a35140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:09.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/492170693 shutdown_connections 2023-10-06T23:13:09.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.079+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/492170693 wait complete. 2023-10-06T23:13:09.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.080+0000 7ffbadd8eb80 1 -- start start 2023-10-06T23:13:09.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.080+0000 7ffbadd8eb80 1 Processor -- start 2023-10-06T23:13:09.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.080+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3e670 0x563b20a48420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a48960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3fe70 0x563b20a4f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2098ce30 con 0x563b20a3e670 2023-10-06T23:13:09.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b20929710 con 0x563b20a3fe70 2023-10-06T23:13:09.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b209293b0 con 0x563b20a3efd0 2023-10-06T23:13:09.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffbadd8eb80 10 client.0 _ll_register_callbacks cb 0x563b20786800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:09.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb93fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3e670 0x563b20a48420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb93fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3e670 0x563b20a48420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55908/0 (socket says 172.21.15.8:55908) 2023-10-06T23:13:09.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb93fff700 1 -- 172.21.15.8:0/2751337100 learned_addr learned my addr 172.21.15.8:0/2751337100 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:09.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb937fe700 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a48960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb9899c700 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3fe70 0x563b20a4f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb93fff700 1 -- 172.21.15.8:0/2751337100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 msgr2=0x563b20a48960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:09.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb93fff700 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a48960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb93fff700 1 -- 172.21.15.8:0/2751337100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3fe70 msgr2=0x563b20a4f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:09.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb93fff700 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3fe70 0x563b20a4f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.081+0000 7ffb93fff700 1 -- 172.21.15.8:0/2751337100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9419f1c0 con 0x563b20a3e670 2023-10-06T23:13:09.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffb93fff700 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3e670 0x563b20a48420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffb84005950 tx=0x7ffb840994c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1478d557c0ef24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:09.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffb737fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:09.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffb737fe700 1 -- 172.21.15.8:0/2751337100 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8409dcb0 con 0x563b20a3e670 2023-10-06T23:13:09.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffb737fe700 1 -- 172.21.15.8:0/2751337100 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffb84084040 con 0x563b20a3e670 2023-10-06T23:13:09.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/2751337100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b20a2cf10 con 0x563b20a3e670 2023-10-06T23:13:09.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffb737fe700 1 -- 172.21.15.8:0/2751337100 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb840a1ef0 con 0x563b20a3e670 2023-10-06T23:13:09.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffbadd8eb80 10 client.15405 fetch_fsmap learned FSMap version 23 2023-10-06T23:13:09.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/2751337100 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563b207a0c60 con 0x563b20a3e670 2023-10-06T23:13:09.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.082+0000 7ffb737fe700 1 -- 172.21.15.8:0/2751337100 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563b20a2cf10 con 0x563b20a3e670 2023-10-06T23:13:09.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.083+0000 7ffb737fe700 1 -- 172.21.15.8:0/2751337100 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffb840b21c0 con 0x563b20a3e670 2023-10-06T23:13:09.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.083+0000 7ffbadd8eb80 10 client.15405 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:13:09.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.083+0000 7ffbadd8eb80 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:09.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.083+0000 7ffbadd8eb80 20 client.15405 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:09.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.083+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b20a53e30 0x563b20a56220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.083+0000 7ffbadd8eb80 4 client.15405 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:09.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.083+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/2751337100 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b20985e10 con 0x563b20a53e30 2023-10-06T23:13:09.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.083+0000 7ffb937fe700 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b20a53e30 0x563b20a56220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.084+0000 7ffb937fe700 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b20a53e30 0x563b20a56220 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0aac333b342ec5 server_cookie=506b077083c0111b in_seq=0 out_seq=0 2023-10-06T23:13:09.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.084+0000 7ffb737fe700 10 client.15405 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.084+0000 7ffb737fe700 1 -- 172.21.15.8:0/2751337100 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563b20985e10 con 0x563b20a53e30 2023-10-06T23:13:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffb737fe700 10 client.15405 handle_command_reply: tid=0 2023-10-06T23:13:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 client.15405 shutdown 2023-10-06T23:13:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/2751337100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3e670 msgr2=0x563b20a48420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3e670 0x563b20a48420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffb84005950 tx=0x7ffb840994c0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/2751337100 shutdown_connections 2023-10-06T23:13:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b20a53e30 0x563b20a56220 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3e670 0x563b20a48420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3fe70 0x563b20a4f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/2751337100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3efd0 0x563b20a48960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffb737fe700 0 client.15405 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/2751337100 >> 172.21.15.8:0/2751337100 conn(0x563b209ae260 msgr2=0x563b20a34f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/2751337100 shutdown_connections 2023-10-06T23:13:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/2751337100 wait complete. 2023-10-06T23:13:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.085+0000 7ffbadd8eb80 20 client.15405 trim_cache size 0 max 16384 2023-10-06T23:13:09.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.104+0000 7ffbadd8eb80 1 Processor -- start 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffbadd8eb80 1 -- start start 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a501d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2080d920 con 0x563b20a3fe70 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b20a46ed0 con 0x563b20a3efd0 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b20a36270 con 0x563b20a3e670 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffb9899c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffb9899c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55918/0 (socket says 172.21.15.8:55918) 2023-10-06T23:13:09.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffb9899c700 1 -- 172.21.15.8:0/1632099913 learned_addr learned my addr 172.21.15.8:0/1632099913 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:09.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.105+0000 7ffb937fe700 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb93fff700 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb9899c700 1 -- 172.21.15.8:0/1632099913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 msgr2=0x563b20a501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb9899c700 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb9899c700 1 -- 172.21.15.8:0/1632099913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 msgr2=0x563b20a4f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb9899c700 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb9899c700 1 -- 172.21.15.8:0/1632099913 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b207de250 con 0x563b20a3fe70 2023-10-06T23:13:09.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb93fff700 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb937fe700 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.106+0000 7ffb9899c700 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a481d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0093c0 tx=0x7ffb8c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81be120a442ea584 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffb7affd700 1 -- 172.21.15.8:0/1632099913 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c00e070 con 0x563b20a3fe70 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffb7affd700 1 -- 172.21.15.8:0/1632099913 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb8c02dad0 con 0x563b20a3fe70 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffb7affd700 1 -- 172.21.15.8:0/1632099913 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c01e8d0 con 0x563b20a3fe70 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/1632099913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 msgr2=0x563b20a481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a481d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0093c0 tx=0x7ffb8c013000 comp rx=0 tx=0).stop 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/1632099913 shutdown_connections 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a481d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/1632099913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/1632099913 >> 172.21.15.8:0/1632099913 conn(0x563b209ae260 msgr2=0x563b20a470e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:09.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.107+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/1632099913 shutdown_connections 2023-10-06T23:13:09.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.108+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/1632099913 wait complete. 2023-10-06T23:13:09.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.108+0000 7ffbadd8eb80 1 -- start start 2023-10-06T23:13:09.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.108+0000 7ffbadd8eb80 1 Processor -- start 2023-10-06T23:13:09.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a4f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffbadd8eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a4e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b20a4e6c0 con 0x563b20a3fe70 2023-10-06T23:13:09.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b20a4e830 con 0x563b20a3efd0 2023-10-06T23:13:09.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffbadd8eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b20a4e9a0 con 0x563b20a3e670 2023-10-06T23:13:09.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffbadd8eb80 10 client.0 _ll_register_callbacks cb 0x7ffb8c00b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb9899c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a4e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb9899c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a4e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55928/0 (socket says 172.21.15.8:55928) 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb9899c700 1 -- 172.21.15.8:0/215351955 learned_addr learned my addr 172.21.15.8:0/215351955 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb937fe700 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb93fff700 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a4f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb9899c700 1 -- 172.21.15.8:0/215351955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 msgr2=0x563b20a4f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb9899c700 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a4f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb9899c700 1 -- 172.21.15.8:0/215351955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 msgr2=0x563b20a4dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb9899c700 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb9899c700 1 -- 172.21.15.8:0/215351955 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb88012040 con 0x563b20a3fe70 2023-10-06T23:13:09.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.109+0000 7ffb93fff700 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a4f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffb9899c700 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a4e180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c006130 tx=0x7ffb8c02d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705fbf307a84d108 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffb737fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffb737fe700 1 -- 172.21.15.8:0/215351955 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c00e040 con 0x563b20a3fe70 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffb737fe700 1 -- 172.21.15.8:0/215351955 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffb8c01e9e0 con 0x563b20a3fe70 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/215351955 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb8409ae90 con 0x563b20a3fe70 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffb737fe700 1 -- 172.21.15.8:0/215351955 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb8c01eba0 con 0x563b20a3fe70 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffbadd8eb80 10 client.15411 fetch_fsmap learned FSMap version 23 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/215351955 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7ffb94109c80 con 0x563b20a3fe70 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.110+0000 7ffb737fe700 1 -- 172.21.15.8:0/215351955 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb8409ae90 con 0x563b20a3fe70 2023-10-06T23:13:09.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.111+0000 7ffb737fe700 1 -- 172.21.15.8:0/215351955 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffb8c036c40 con 0x563b20a3fe70 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.111+0000 7ffbadd8eb80 10 client.15411 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.111+0000 7ffbadd8eb80 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.111+0000 7ffbadd8eb80 20 client.15411 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.111+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b20aa9080 0x563b20aab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.111+0000 7ffbadd8eb80 4 client.15411 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.111+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/215351955 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563b20985b30 con 0x563b20aa9080 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.111+0000 7ffb93fff700 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b20aa9080 0x563b20aab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffb93fff700 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b20aa9080 0x563b20aab4a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad459cd4b562d1d9 server_cookie=9357693cd2210550 in_seq=0 out_seq=0 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffb737fe700 10 client.15411 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffb737fe700 1 -- 172.21.15.8:0/215351955 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563b20985b30 con 0x563b20aa9080 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffb737fe700 10 client.15411 handle_command_reply: tid=0 2023-10-06T23:13:09.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 client.15411 shutdown 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/215351955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 msgr2=0x563b20a4e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a4e180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c006130 tx=0x7ffb8c02d810 comp rx=0 tx=0).stop 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/215351955 shutdown_connections 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b20aa9080 0x563b20aab4a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b20a3fe70 0x563b20a4e180 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b20a3e670 0x563b20a4f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 --2- 172.21.15.8:0/215351955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b20a3efd0 0x563b20a4dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/215351955 >> 172.21.15.8:0/215351955 conn(0x563b209ae260 msgr2=0x563b20a46060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.112+0000 7ffb737fe700 0 client.15411 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/215351955 shutdown_connections 2023-10-06T23:13:09.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffbadd8eb80 1 -- 172.21.15.8:0/215351955 wait complete. 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffbadd8eb80 20 client.15411 trim_cache size 0 max 16384 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stdout: "da04de51-d335-44e6-b757-90f9c8b35691": { 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "da04de51-d335-44e6-b757-90f9c8b35691", 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:13:09.119 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:13:09.120 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:13:09.120 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:13:09.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ffb7c0a1500 msgr2=0x7ffb7c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ffb7c0a1500 0x7ffb7c0a39c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00b0a0 tx=0x7ffb8c0099e0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/100148210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb941019c0 msgr2=0x7ffb94196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb941019c0 0x7ffb94196be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400d950 tx=0x7ffb8400dc60 comp rx=0 tx=0).stop 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/100148210 shutdown_connections 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ffb7c0a1500 0x7ffb7c0a39c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb94106c20 0x7ffb9419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb941019c0 0x7ffb94196be0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 --2- 172.21.15.8:0/100148210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb941042f0 0x7ffb94197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.113+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/100148210 >> 172.21.15.8:0/100148210 conn(0x7ffb940fb3b0 msgr2=0x7ffb94102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.114+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/100148210 shutdown_connections 2023-10-06T23:13:09.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:09.114+0000 7ffb9a3ff700 1 -- 172.21.15.8:0/100148210 wait complete. 2023-10-06T23:13:09.133 INFO:tasks.cephfs.filesystem:scrub status for tag:da04de51-d335-44e6-b757-90f9c8b35691 - {'path': '/', 'tag': 'da04de51-d335-44e6-b757-90f9c8b35691', 'options': 'recursive,force'} 2023-10-06T23:13:09.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:09 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/67248433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:09.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:09 smithi008 ceph-mon[98532]: pgmap v358: 97 pgs: 97 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-06T23:13:09.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:09 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/67248433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:09.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:09 smithi156 ceph-mon[102862]: pgmap v358: 97 pgs: 97 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-06T23:13:09.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:09 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/67248433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:13:09.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:09 smithi190 ceph-mon[102658]: pgmap v358: 97 pgs: 97 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-06T23:13:10.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:10 smithi156 ceph-mon[102862]: scrub queued for path: / 2023-10-06T23:13:10.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:10 smithi156 ceph-mon[102862]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:10.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:10 smithi156 ceph-mon[102862]: scrub summary: active paths [/] 2023-10-06T23:13:10.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:10 smithi156 ceph-mon[102862]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:10.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:10 smithi008 ceph-mon[98532]: scrub queued for path: / 2023-10-06T23:13:10.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:10 smithi008 ceph-mon[98532]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:10.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:10 smithi008 ceph-mon[98532]: scrub summary: active paths [/] 2023-10-06T23:13:10.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:10 smithi008 ceph-mon[98532]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:10.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:10 smithi190 ceph-mon[102658]: scrub queued for path: / 2023-10-06T23:13:10.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:10 smithi190 ceph-mon[102658]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:10.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:10 smithi190 ceph-mon[102658]: scrub summary: active paths [/] 2023-10-06T23:13:10.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:10 smithi190 ceph-mon[102658]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:11.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:11 smithi156 ceph-mon[102862]: pgmap v359: 97 pgs: 97 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 7 op/s 2023-10-06T23:13:11.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:11 smithi008 ceph-mon[98532]: pgmap v359: 97 pgs: 97 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 7 op/s 2023-10-06T23:13:11.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:11 smithi190 ceph-mon[102658]: pgmap v359: 97 pgs: 97 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 7 op/s 2023-10-06T23:13:12.385 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:12 smithi008 ceph-mon[98532]: scrub summary: idle 2023-10-06T23:13:12.388 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-10-06T23:13:12.488 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-10-06T23:13:12.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-10-06T23:13:12.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:12 smithi156 ceph-mon[102862]: scrub summary: idle 2023-10-06T23:13:12.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-06T23:13:12.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:12 smithi190 ceph-mon[102658]: scrub summary: idle 2023-10-06T23:13:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/: 2023-10-06T23:13:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-06T23:13:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:12.704 INFO:teuthology.orchestra.run.smithi008.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 .. 2023-10-06T23:13:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 data 2023-10-06T23:13:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data: 2023-10-06T23:13:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 .. 2023-10-06T23:13:12.710 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-10-06T23:13:12.832 INFO:teuthology.orchestra.run.smithi008.stdout:[Service] 2023-10-06T23:13:12.832 INFO:teuthology.orchestra.run.smithi008.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-10-06T23:13:12.832 INFO:teuthology.orchestra.run.smithi008.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-10-06T23:13:12.837 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-10-06T23:13:13.048 INFO:teuthology.orchestra.run.smithi008.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-10-06T23:13:13.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:13 smithi156 ceph-mon[102862]: pgmap v360: 97 pgs: 97 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2023-10-06T23:13:13.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:13 smithi008 ceph-mon[98532]: pgmap v360: 97 pgs: 97 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2023-10-06T23:13:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:13 smithi190 ceph-mon[102658]: pgmap v360: 97 pgs: 97 active+clean; 587 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2023-10-06T23:13:16.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:16 smithi156 ceph-mon[102862]: pgmap v361: 97 pgs: 97 active+clean; 611 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2023-10-06T23:13:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:16 smithi008 ceph-mon[98532]: pgmap v361: 97 pgs: 97 active+clean; 611 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2023-10-06T23:13:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:16 smithi190 ceph-mon[102658]: pgmap v361: 97 pgs: 97 active+clean; 611 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2023-10-06T23:13:18.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:18 smithi156 ceph-mon[102862]: pgmap v362: 97 pgs: 97 active+clean; 9.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 782 KiB/s wr, 14 op/s 2023-10-06T23:13:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:18 smithi008 ceph-mon[98532]: pgmap v362: 97 pgs: 97 active+clean; 9.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 782 KiB/s wr, 14 op/s 2023-10-06T23:13:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:18 smithi190 ceph-mon[102658]: pgmap v362: 97 pgs: 97 active+clean; 9.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 782 KiB/s wr, 14 op/s 2023-10-06T23:13:20.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:20 smithi156 ceph-mon[102862]: pgmap v363: 97 pgs: 97 active+clean; 20 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-10-06T23:13:20.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:20 smithi008 ceph-mon[98532]: pgmap v363: 97 pgs: 97 active+clean; 20 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-10-06T23:13:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:20 smithi190 ceph-mon[102658]: pgmap v363: 97 pgs: 97 active+clean; 20 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-10-06T23:13:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 -- 172.21.15.8:0/3520844239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 msgr2=0x7f3d94109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 --2- 172.21.15.8:0/3520844239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 0x7f3d94109340 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00b0a0 tx=0x7f3d8c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 -- 172.21.15.8:0/3520844239 shutdown_connections 2023-10-06T23:13:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 --2- 172.21.15.8:0/3520844239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 0x7f3d94109340 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 --2- 172.21.15.8:0/3520844239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94100f10 0x7f3d94101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 --2- 172.21.15.8:0/3520844239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d94102060 0x7f3d941024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 -- 172.21.15.8:0/3520844239 >> 172.21.15.8:0/3520844239 conn(0x7f3d940fc460 msgr2=0x7f3d940fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 -- 172.21.15.8:0/3520844239 shutdown_connections 2023-10-06T23:13:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.816+0000 7f3d993ff700 1 -- 172.21.15.8:0/3520844239 wait complete. 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.817+0000 7f3d993ff700 1 Processor -- start 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.817+0000 7f3d993ff700 1 -- start start 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d993ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94100f10 0x7f3d940732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d993ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d94102060 0x7f3d940737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d993ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 0x7f3d94073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d993ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941a0c80 con 0x7f3d94102a20 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d993ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941a0dc0 con 0x7f3d94100f10 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d993ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941a0f00 con 0x7f3d94102060 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94100f10 0x7f3d940732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94100f10 0x7f3d940732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58344/0 (socket says 172.21.15.8:58344) 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d92ffd700 1 -- 172.21.15.8:0/1161483093 learned_addr learned my addr 172.21.15.8:0/1161483093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.818+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 0x7f3d94073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d927fc700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d94102060 0x7f3d940737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d92ffd700 1 -- 172.21.15.8:0/1161483093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d94102060 msgr2=0x7f3d940737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d94102060 0x7f3d940737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d92ffd700 1 -- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 msgr2=0x7f3d94073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 0x7f3d94073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d92ffd700 1 -- 172.21.15.8:0/1161483093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c009d00 con 0x7f3d94100f10 2023-10-06T23:13:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 0x7f3d94073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94100f10 0x7f3d940732a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400e9a0 tx=0x7f3d8400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d7bfff700 1 -- 172.21.15.8:0/1161483093 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84009790 con 0x7f3d94100f10 2023-10-06T23:13:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d7bfff700 1 -- 172.21.15.8:0/1161483093 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d8400cbd0 con 0x7f3d94100f10 2023-10-06T23:13:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d993ff700 1 -- 172.21.15.8:0/1161483093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d941a1190 con 0x7f3d94100f10 2023-10-06T23:13:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.819+0000 7f3d7bfff700 1 -- 172.21.15.8:0/1161483093 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84018680 con 0x7f3d94100f10 2023-10-06T23:13:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.820+0000 7f3d993ff700 1 -- 172.21.15.8:0/1161483093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d941a16a0 con 0x7f3d94100f10 2023-10-06T23:13:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.824+0000 7f3d7bfff700 1 -- 172.21.15.8:0/1161483093 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3d8400cd40 con 0x7f3d94100f10 2023-10-06T23:13:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.825+0000 7f3dacd17b80 1 Processor -- start 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.825+0000 7f3dacd17b80 1 -- start start 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x5653308f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 0x5653308fa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308fa990 0x565330901220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565330861400 con 0x5653308f8ec0 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565330852bc0 con 0x5653308fa990 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653308504e0 con 0x5653308f9fd0 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x5653308f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x5653308f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59450/0 (socket says 172.21.15.8:59450) 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3d937fe700 1 -- 172.21.15.8:0/995701420 learned_addr learned my addr 172.21.15.8:0/995701420 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3d7bfff700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3d7c0a1480 0x7f3d7c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.826+0000 7f3d927fc700 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308fa990 0x565330901220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d7bfff700 1 -- 172.21.15.8:0/1161483093 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3d84014070 con 0x7f3d94100f10 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d937fe700 1 -- 172.21.15.8:0/995701420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 msgr2=0x5653308fa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d937fe700 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 0x5653308fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d937fe700 1 -- 172.21.15.8:0/995701420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308fa990 msgr2=0x565330901220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d937fe700 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308fa990 0x565330901220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d937fe700 1 -- 172.21.15.8:0/995701420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565330676d80 con 0x5653308f8ec0 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d927fc700 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308fa990 0x565330901220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3d7c0a1480 0x7f3d7c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d937fe700 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x5653308f92e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c008fb0 tx=0x7f3d8c008fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb5e6033748b600 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d797fa700 1 -- 172.21.15.8:0/995701420 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00e040 con 0x5653308f8ec0 2023-10-06T23:13:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d797fa700 1 -- 172.21.15.8:0/995701420 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d8c00be30 con 0x5653308f8ec0 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.827+0000 7f3d797fa700 1 -- 172.21.15.8:0/995701420 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c028d20 con 0x5653308f8ec0 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3dacd17b80 1 -- 172.21.15.8:0/995701420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 msgr2=0x5653308f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3d7c0a1480 0x7f3d7c0a3940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c02b000 tx=0x7f3d8c02c000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x5653308f92e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c008fb0 tx=0x7f3d8c008fe0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3dacd17b80 1 -- 172.21.15.8:0/995701420 shutdown_connections 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x5653308f92e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308fa990 0x565330901220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/995701420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 0x5653308fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3dacd17b80 1 -- 172.21.15.8:0/995701420 >> 172.21.15.8:0/995701420 conn(0x56533086d200 msgr2=0x5653308f3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.828+0000 7f3dacd17b80 1 -- 172.21.15.8:0/995701420 shutdown_connections 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.829+0000 7f3dacd17b80 1 -- 172.21.15.8:0/995701420 wait complete. 2023-10-06T23:13:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.829+0000 7f3dacd17b80 1 -- start start 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.829+0000 7f3dacd17b80 1 Processor -- start 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330902c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 0x565330903140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308fa990 0x56533090a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56533084bdd0 con 0x5653308fa990 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653307e86b0 con 0x5653308f8ec0 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653307e8350 con 0x5653308f9fd0 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3dacd17b80 10 client.0 _ll_register_callbacks cb 0x5653306457a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308fa990 0x56533090a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308fa990 0x56533090a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59462/0 (socket says 172.21.15.8:59462) 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 0x565330903140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3d937fe700 1 -- 172.21.15.8:0/1058927731 learned_addr learned my addr 172.21.15.8:0/1058927731 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.830+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330902c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d937fe700 1 -- 172.21.15.8:0/1058927731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 msgr2=0x565330903140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 0x565330903140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d937fe700 1 -- 172.21.15.8:0/1058927731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 msgr2=0x565330902c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330902c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d937fe700 1 -- 172.21.15.8:0/1058927731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d94109c70 con 0x5653308fa990 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308fa990 0x56533090a180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00b780 tx=0x7f3d8c00afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a53ca697d07d6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1058927731 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0050e0 con 0x5653308fa990 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1058927731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653308ebd50 con 0x5653308fa990 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.831+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1058927731 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3d8c005240 con 0x5653308fa990 2023-10-06T23:13:21.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1058927731 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d8c009540 con 0x5653308fa990 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3dacd17b80 10 client.15423 fetch_fsmap learned FSMap version 23 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1058927731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56533065fc00 con 0x5653308fa990 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1058927731 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653308ebd50 con 0x5653308fa990 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1058927731 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3d8c046070 con 0x5653308fa990 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3dacd17b80 10 client.15423 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3dacd17b80 10 client.15423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3dacd17b80 20 client.15423 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56533090e7e0 0x565330910c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3dacd17b80 4 client.15423 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.832+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1058927731 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565330844db0 con 0x56533090e7e0 2023-10-06T23:13:21.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.833+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56533090e7e0 0x565330910c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.833+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56533090e7e0 0x565330910c00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d682e7777e4c7b91 server_cookie=f23a09a737bb4b85 in_seq=0 out_seq=0 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.833+0000 7f3d76ff5700 10 client.15423 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1058927731 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565330844db0 con 0x56533090e7e0 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3d76ff5700 10 client.15423 handle_command_reply: tid=0 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 client.15423 shutdown 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1058927731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308fa990 msgr2=0x56533090a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308fa990 0x56533090a180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00b780 tx=0x7f3d8c00afe0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1058927731 shutdown_connections 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56533090e7e0 0x565330910c00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308fa990 0x56533090a180 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330902c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1058927731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308f9fd0 0x565330903140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3d76ff5700 0 client.15423 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1058927731 >> 172.21.15.8:0/1058927731 conn(0x56533086d200 msgr2=0x5653308f3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1058927731 shutdown_connections 2023-10-06T23:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.834+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1058927731 wait complete. 2023-10-06T23:13:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.835+0000 7f3dacd17b80 20 client.15423 trim_cache size 0 max 16384 2023-10-06T23:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.854+0000 7f3dacd17b80 1 Processor -- start 2023-10-06T23:13:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.854+0000 7f3dacd17b80 1 -- start start 2023-10-06T23:13:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.854+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330910bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f9fd0 0x56533090a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330902c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653306cc8c0 con 0x5653308f9fd0 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653308fd450 con 0x5653308f8ec0 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x565330902770 con 0x5653308fa990 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f9fd0 0x56533090a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f9fd0 0x56533090a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59466/0 (socket says 172.21.15.8:59466) 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d927fc700 1 -- 172.21.15.8:0/870300706 learned_addr learned my addr 172.21.15.8:0/870300706 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330910bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d937fe700 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330902c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d927fc700 1 -- 172.21.15.8:0/870300706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 msgr2=0x565330902c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d927fc700 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330902c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d927fc700 1 -- 172.21.15.8:0/870300706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 msgr2=0x565330910bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d927fc700 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330910bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d927fc700 1 -- 172.21.15.8:0/870300706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56533069d1f0 con 0x5653308f9fd0 2023-10-06T23:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.855+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330910bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.856+0000 7f3d927fc700 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f9fd0 0x56533090a110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009bd0 tx=0x7f3d88009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc94f4d25c59deb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.856+0000 7f3d79ffb700 1 -- 172.21.15.8:0/870300706 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88018070 con 0x5653308f9fd0 2023-10-06T23:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.856+0000 7f3d79ffb700 1 -- 172.21.15.8:0/870300706 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d88013e20 con 0x5653308f9fd0 2023-10-06T23:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.856+0000 7f3d79ffb700 1 -- 172.21.15.8:0/870300706 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8801c410 con 0x5653308f9fd0 2023-10-06T23:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 -- 172.21.15.8:0/870300706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f9fd0 msgr2=0x56533090a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f9fd0 0x56533090a110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009bd0 tx=0x7f3d88009ee0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 -- 172.21.15.8:0/870300706 shutdown_connections 2023-10-06T23:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330902c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f8ec0 0x565330910bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/870300706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f9fd0 0x56533090a110 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 -- 172.21.15.8:0/870300706 >> 172.21.15.8:0/870300706 conn(0x56533086d200 msgr2=0x5653309018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 -- 172.21.15.8:0/870300706 shutdown_connections 2023-10-06T23:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.857+0000 7f3dacd17b80 1 -- 172.21.15.8:0/870300706 wait complete. 2023-10-06T23:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.858+0000 7f3dacd17b80 1 -- start start 2023-10-06T23:13:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.858+0000 7f3dacd17b80 1 Processor -- start 2023-10-06T23:13:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x565330907cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f9fd0 0x565330908210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3dacd17b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330909220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565330909760 con 0x5653308f8ec0 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653309098d0 con 0x5653308f9fd0 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3dacd17b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x565330909a40 con 0x5653308fa990 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3dacd17b80 10 client.0 _ll_register_callbacks cb 0x7f3d8c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x565330907cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x565330907cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59474/0 (socket says 172.21.15.8:59474) 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3d92ffd700 1 -- 172.21.15.8:0/1686247927 learned_addr learned my addr 172.21.15.8:0/1686247927 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330909220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3d927fc700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f9fd0 0x565330908210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.859+0000 7f3d92ffd700 1 -- 172.21.15.8:0/1686247927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 msgr2=0x565330909220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330909220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d92ffd700 1 -- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f9fd0 msgr2=0x565330908210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f9fd0 0x565330908210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d92ffd700 1 -- 172.21.15.8:0/1686247927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d88009880 con 0x5653308f8ec0 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d937fe700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330909220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d927fc700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f9fd0 0x565330908210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d92ffd700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x565330907cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3d8409a230 tx=0x7f3d840109d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6703587d7d417eb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1686247927 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8409e3f0 con 0x5653308f8ec0 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1686247927 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3d840a2630 con 0x5653308f8ec0 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1686247927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d8c00be30 con 0x5653308f8ec0 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1686247927 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d840b8030 con 0x5653308f8ec0 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3dacd17b80 10 client.15429 fetch_fsmap learned FSMap version 23 2023-10-06T23:13:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.860+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1686247927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x565330675250 con 0x5653308f8ec0 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1686247927 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d8c00be30 con 0x5653308f8ec0 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1686247927 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3d84099790 con 0x5653308f8ec0 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3dacd17b80 10 client.15429 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3dacd17b80 10 client.15429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3dacd17b80 20 client.15429 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56533095d430 0x56533095f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3dacd17b80 4 client.15429 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1686247927 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565330844ad0 con 0x56533095d430 2023-10-06T23:13:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.861+0000 7f3d927fc700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56533095d430 0x56533095f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.862+0000 7f3d927fc700 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56533095d430 0x56533095f850 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f661d83f4a0ceab server_cookie=cd8d7f74d3231a28 in_seq=0 out_seq=0 2023-10-06T23:13:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:21.862+0000 7f3d76ff5700 10 client.15429 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3d76ff5700 1 -- 172.21.15.8:0/1686247927 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565330844ad0 con 0x56533095d430 2023-10-06T23:13:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3d76ff5700 10 client.15429 handle_command_reply: tid=0 2023-10-06T23:13:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 client.15429 shutdown 2023-10-06T23:13:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1686247927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 msgr2=0x565330907cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x565330907cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3d8409a230 tx=0x7f3d840109d0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1686247927 shutdown_connections 2023-10-06T23:13:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56533095d430 0x56533095f850 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653308f8ec0 0x565330907cd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5653308fa990 0x565330909220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 --2- 172.21.15.8:0/1686247927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5653308f9fd0 0x565330908210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1686247927 >> 172.21.15.8:0/1686247927 conn(0x56533086d200 msgr2=0x5653308fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3d76ff5700 0 client.15429 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1686247927 shutdown_connections 2023-10-06T23:13:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.186+0000 7f3dacd17b80 1 -- 172.21.15.8:0/1686247927 wait complete. 2023-10-06T23:13:22.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3dacd17b80 20 client.15429 trim_cache size 0 max 16384 2023-10-06T23:13:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:13:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:13:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:13:22.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:13:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 -- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3d7c0a1480 msgr2=0x7f3d7c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3d7c0a1480 0x7f3d7c0a3940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c02b000 tx=0x7f3d8c02c000 comp rx=0 tx=0).stop 2023-10-06T23:13:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 -- 172.21.15.8:0/1161483093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94100f10 msgr2=0x7f3d940732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94100f10 0x7f3d940732a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400e9a0 tx=0x7f3d8400ecb0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 -- 172.21.15.8:0/1161483093 shutdown_connections 2023-10-06T23:13:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3d7c0a1480 0x7f3d7c0a3940 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3d94102a20 0x7f3d94073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d94100f10 0x7f3d940732a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 --2- 172.21.15.8:0/1161483093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d94102060 0x7f3d940737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.187+0000 7f3d993ff700 1 -- 172.21.15.8:0/1161483093 >> 172.21.15.8:0/1161483093 conn(0x7f3d940fc460 msgr2=0x7f3d940fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.188+0000 7f3d993ff700 1 -- 172.21.15.8:0/1161483093 shutdown_connections 2023-10-06T23:13:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:22.188+0000 7f3d993ff700 1 -- 172.21.15.8:0/1161483093 wait complete. 2023-10-06T23:13:22.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:22 smithi156 ceph-mon[102862]: pgmap v364: 97 pgs: 97 active+clean; 25 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.2 MiB/s wr, 45 op/s 2023-10-06T23:13:22.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:22 smithi008 ceph-mon[98532]: pgmap v364: 97 pgs: 97 active+clean; 25 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.2 MiB/s wr, 45 op/s 2023-10-06T23:13:22.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:22 smithi190 ceph-mon[102658]: pgmap v364: 97 pgs: 97 active+clean; 25 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.2 MiB/s wr, 45 op/s 2023-10-06T23:13:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:23 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:23.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:23 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:23.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:23 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:24.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:24 smithi156 ceph-mon[102862]: pgmap v365: 97 pgs: 97 active+clean; 27 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.6 MiB/s wr, 66 op/s 2023-10-06T23:13:24.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:24 smithi008 ceph-mon[98532]: pgmap v365: 97 pgs: 97 active+clean; 27 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.6 MiB/s wr, 66 op/s 2023-10-06T23:13:24.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:24 smithi190 ceph-mon[102658]: pgmap v365: 97 pgs: 97 active+clean; 27 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.6 MiB/s wr, 66 op/s 2023-10-06T23:13:26.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:26 smithi156 ceph-mon[102862]: pgmap v366: 97 pgs: 97 active+clean; 31 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 3.3 MiB/s wr, 125 op/s 2023-10-06T23:13:26.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:26 smithi008 ceph-mon[98532]: pgmap v366: 97 pgs: 97 active+clean; 31 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 3.3 MiB/s wr, 125 op/s 2023-10-06T23:13:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:26 smithi190 ceph-mon[102658]: pgmap v366: 97 pgs: 97 active+clean; 31 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 3.3 MiB/s wr, 125 op/s 2023-10-06T23:13:27.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:27 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:13:27.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:27 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:13:27.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:27 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:13:28.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:28 smithi156 ceph-mon[102862]: pgmap v367: 97 pgs: 97 active+clean; 37 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 4.1 MiB/s wr, 196 op/s 2023-10-06T23:13:28.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:28 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:28.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:28 smithi008 ceph-mon[98532]: pgmap v367: 97 pgs: 97 active+clean; 37 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 4.1 MiB/s wr, 196 op/s 2023-10-06T23:13:28.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:28 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:28.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:28 smithi190 ceph-mon[102658]: pgmap v367: 97 pgs: 97 active+clean; 37 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 4.1 MiB/s wr, 196 op/s 2023-10-06T23:13:28.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:28 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:30.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:30 smithi156 ceph-mon[102862]: pgmap v368: 97 pgs: 97 active+clean; 38 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 3.6 MiB/s wr, 196 op/s 2023-10-06T23:13:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:30 smithi008 ceph-mon[98532]: pgmap v368: 97 pgs: 97 active+clean; 38 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 3.6 MiB/s wr, 196 op/s 2023-10-06T23:13:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:30 smithi190 ceph-mon[102658]: pgmap v368: 97 pgs: 97 active+clean; 38 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 3.6 MiB/s wr, 196 op/s 2023-10-06T23:13:31.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:31 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:31 smithi008 ceph-mon[98532]: pgmap v369: 97 pgs: 97 active+clean; 42 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 2.9 MiB/s wr, 194 op/s 2023-10-06T23:13:31.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:31 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:31 smithi190 ceph-mon[102658]: pgmap v369: 97 pgs: 97 active+clean; 42 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 2.9 MiB/s wr, 194 op/s 2023-10-06T23:13:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:31 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:31 smithi156 ceph-mon[102862]: pgmap v369: 97 pgs: 97 active+clean; 42 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 2.9 MiB/s wr, 194 op/s 2023-10-06T23:13:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:13:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:13:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:32.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:13:32.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:13:32.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:32.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:13:32.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:13:32.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:13:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:33 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:33 smithi008 ceph-mon[98532]: pgmap v370: 97 pgs: 97 active+clean; 46 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 2.8 MiB/s wr, 237 op/s 2023-10-06T23:13:33.674 INFO:teuthology.orchestra.run.smithi008.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-10-06T23:13:33.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-06T23:13:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:33 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:33 smithi190 ceph-mon[102658]: pgmap v370: 97 pgs: 97 active+clean; 46 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 2.8 MiB/s wr, 237 op/s 2023-10-06T23:13:33.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:33 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:13:33.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:33 smithi156 ceph-mon[102862]: pgmap v370: 97 pgs: 97 active+clean; 46 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 2.8 MiB/s wr, 237 op/s 2023-10-06T23:13:34.419 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/: 2023-10-06T23:13:34.419 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 . 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 data 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data: 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:total 40 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 . 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 6 23:13 base 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Oct 6 23:13 global 2023-10-06T23:13:34.420 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 log 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_commit_ts 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_dynshmem 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 6 23:13 pg_hba.conf 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 6 23:13 pg_ident.conf 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:13 pg_logical 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 pg_multixact 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 pg_notify 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_replslot 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_serial 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_snapshots 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_stat 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_stat_tmp 2023-10-06T23:13:34.421 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 pg_subtrans 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_tblspc 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_twophase 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 6 23:13 PG_VERSION 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:13 pg_wal 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 pg_xact 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 6 23:13 postgresql.auto.conf 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 6 23:13 postgresql.conf 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base: 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:total 3 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 6 23:13 . 2023-10-06T23:13:34.422 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 1 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 12346 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 12347 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 . 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 6 23:13 .. 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 112 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 113 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 6 23:13 12182 2023-10-06T23:13:34.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12182_fsm 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12182_vm 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12184 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12186 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12187_fsm 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187_vm 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12189 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12191 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12192_fsm 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192_vm 2023-10-06T23:13:34.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12194 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12196 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12197_fsm 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197_vm 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12199 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12201 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12202_fsm 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202_vm 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12204 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12206 2023-10-06T23:13:34.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12207_fsm 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207_vm 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12209 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12211 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12212 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12214 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12216 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 6 23:13 1247 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1247_fsm 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1247_vm 2023-10-06T23:13:34.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 6 23:13 1249 2023-10-06T23:13:34.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1249_fsm 2023-10-06T23:13:34.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1249_vm 2023-10-06T23:13:34.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 6 23:13 1255 2023-10-06T23:13:34.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1255_fsm 2023-10-06T23:13:34.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1255_vm 2023-10-06T23:13:34.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 6 23:13 1259 2023-10-06T23:13:34.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1259_fsm 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1259_vm 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417_vm 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418_vm 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 174 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 175 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2187 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224_vm 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328 2023-10-06T23:13:34.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328_vm 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336_vm 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2337 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2600 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2600_fsm 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2600_vm 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2601_fsm 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601_vm 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2602 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2602_fsm 2023-10-06T23:13:34.429 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2602_vm 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2603 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2603_fsm 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2603_vm 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604_vm 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2605 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2605_fsm 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2605_vm 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2606_fsm 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606_vm 2023-10-06T23:13:34.430 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607_fsm 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2607_vm 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 6 23:13 2608 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2608_fsm 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2608_vm 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 6 23:13 2609 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2609_fsm 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2609_vm 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610_fsm 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2610_vm 2023-10-06T23:13:34.431 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611_vm 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2612_fsm 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612_vm 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613_vm 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2615_fsm 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615_vm 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616_fsm 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2616_vm 2023-10-06T23:13:34.432 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 6 23:13 2617 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2617_fsm 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2617_vm 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 6 23:13 2618 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2618_fsm 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2618_vm 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 6 23:13 2619 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2619_fsm 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2619_vm 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620_vm 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2650 2023-10-06T23:13:34.433 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2651 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2652 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2653 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2654 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2655 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2656 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2657 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 6 23:13 2658 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2659 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2660 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2661 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2662 2023-10-06T23:13:34.434 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2663 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2664 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2665 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2666 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2667 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2668 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2669 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2670 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 6 23:13 2673 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 6 23:13 2674 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 6 23:13 2675 2023-10-06T23:13:34.435 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2678 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2679 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2680 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2681 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2682 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2683 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2684 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2685 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2686 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2687 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2688 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2689 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2690 2023-10-06T23:13:34.436 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 6 23:13 2691 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2692 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2693 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2696 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2699 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2701 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2702 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2703 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2704 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2753 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2753_fsm 2023-10-06T23:13:34.437 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2753_vm 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2754 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2755 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2756 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2757 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830_vm 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2831 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832_vm 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2833 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834_vm 2023-10-06T23:13:34.438 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2835 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836_vm 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2837 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 6 23:13 2838 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2838_fsm 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2838_vm 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2839 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840_fsm 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2840_vm 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2841 2023-10-06T23:13:34.439 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995_vm 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2996 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3079_fsm 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079_vm 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3080 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3081 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3085 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118_vm 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3119 2023-10-06T23:13:34.440 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3164 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256_vm 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3257 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3258 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350_vm 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3351 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3379 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3380 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381_vm 2023-10-06T23:13:34.441 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3394 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3394_fsm 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3394_vm 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3395 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439_vm 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3440 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 3455 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3456 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3456_fsm 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3456_vm 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466 2023-10-06T23:13:34.442 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466_vm 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3467 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3468 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501_vm 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3502 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3503 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3534 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3541_fsm 2023-10-06T23:13:34.443 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541_vm 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3542 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3574 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3575 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576_vm 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596_vm 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3597 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598_vm 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3599 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600 2023-10-06T23:13:34.444 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3600_fsm 2023-10-06T23:13:34.445 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600_vm 2023-10-06T23:13:34.445 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601 2023-10-06T23:13:34.445 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3601_fsm 2023-10-06T23:13:34.445 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601_vm 2023-10-06T23:13:34.445 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602 2023-10-06T23:13:34.445 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3602_fsm 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602_vm 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3603 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3603_fsm 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3603_vm 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3604 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3605 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3606 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3607 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3608 2023-10-06T23:13:35.015 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 3609 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3712 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3764_fsm 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764_vm 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3766 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3767 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3997 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 5002 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 548 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 549 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102_vm 2023-10-06T23:13:35.016 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104_vm 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106_vm 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6110 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6111 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6112 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6113 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6117 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826_vm 2023-10-06T23:13:35.017 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 827 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 828 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 6 23:13 pg_filenode.map 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 6 23:13 PG_VERSION 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 . 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 6 23:13 .. 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 112 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 113 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 6 23:13 12182 2023-10-06T23:13:35.018 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12182_fsm 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12182_vm 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12184 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12186 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12187_fsm 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187_vm 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12189 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12191 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12192_fsm 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192_vm 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12194 2023-10-06T23:13:35.019 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12196 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12197_fsm 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197_vm 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12199 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12201 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12202_fsm 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202_vm 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12204 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12206 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207 2023-10-06T23:13:35.020 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12207_fsm 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207_vm 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12209 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12211 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12212 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12214 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12216 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 6 23:13 1247 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1247_fsm 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1247_vm 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 6 23:13 1249 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1249_fsm 2023-10-06T23:13:35.021 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1249_vm 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 6 23:13 1255 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1255_fsm 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1255_vm 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 6 23:13 1259 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1259_fsm 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1259_vm 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417_vm 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418_vm 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 174 2023-10-06T23:13:35.022 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 175 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2187 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224_vm 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328_vm 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336_vm 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2337 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2600 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2600_fsm 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2600_vm 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601 2023-10-06T23:13:35.023 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2601_fsm 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601_vm 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2602 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2602_fsm 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2602_vm 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2603 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2603_fsm 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2603_vm 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604_vm 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2605 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2605_fsm 2023-10-06T23:13:35.024 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2605_vm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2606_fsm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606_vm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607_fsm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2607_vm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 6 23:13 2608 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2608_fsm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2608_vm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 6 23:13 2609 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2609_fsm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2609_vm 2023-10-06T23:13:35.025 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610_fsm 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2610_vm 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611_vm 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2612_fsm 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612_vm 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613_vm 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2615_fsm 2023-10-06T23:13:35.026 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615_vm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616_fsm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2616_vm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 6 23:13 2617 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2617_fsm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2617_vm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 6 23:13 2618 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2618_fsm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2618_vm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 6 23:13 2619 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2619_fsm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2619_vm 2023-10-06T23:13:35.027 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620_vm 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2650 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2651 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2652 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2653 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2654 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2655 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2656 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2657 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 6 23:13 2658 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2659 2023-10-06T23:13:35.028 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2660 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2661 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2662 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2663 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2664 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2665 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2666 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2667 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2668 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2669 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2670 2023-10-06T23:13:35.029 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 6 23:13 2673 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 6 23:13 2674 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 6 23:13 2675 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2678 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2679 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2680 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2681 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2682 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2683 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2684 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2685 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2686 2023-10-06T23:13:35.030 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2687 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2688 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2689 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2690 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 6 23:13 2691 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2692 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2693 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2696 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2699 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2701 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2702 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2703 2023-10-06T23:13:35.031 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2704 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2753 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2753_fsm 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2753_vm 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2754 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2755 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2756 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2757 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830_vm 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2831 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832 2023-10-06T23:13:35.032 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832_vm 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2833 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834_vm 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2835 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836_vm 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2837 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 6 23:13 2838 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2838_fsm 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2838_vm 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2839 2023-10-06T23:13:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840_fsm 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2840_vm 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2841 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995_vm 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2996 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3079_fsm 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079_vm 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3080 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3081 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3085 2023-10-06T23:13:35.034 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118_vm 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3119 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3164 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256_vm 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3257 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3258 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350_vm 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3351 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3379 2023-10-06T23:13:35.035 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3380 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381_vm 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3394 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3394_fsm 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3394_vm 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3395 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439_vm 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3440 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 3455 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3456 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3456_fsm 2023-10-06T23:13:35.036 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3456_vm 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466_vm 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3467 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3468 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501_vm 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3502 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3503 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3534 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3541_fsm 2023-10-06T23:13:35.037 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541_vm 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3542 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3574 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3575 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576_vm 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596_vm 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3597 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598_vm 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3599 2023-10-06T23:13:35.038 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600 2023-10-06T23:13:35.039 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3600_fsm 2023-10-06T23:13:35.039 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600_vm 2023-10-06T23:13:35.039 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601 2023-10-06T23:13:35.039 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3601_fsm 2023-10-06T23:13:35.039 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601_vm 2023-10-06T23:13:35.039 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602 2023-10-06T23:13:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.348+0000 7f01867ff700 1 -- 172.21.15.8:0/236635289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 msgr2=0x7f0180104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.348+0000 7f01867ff700 1 --2- 172.21.15.8:0/236635289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 0x7f0180104780 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f01740099c0 tx=0x7f0174009cd0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.348+0000 7f01867ff700 1 -- 172.21.15.8:0/236635289 shutdown_connections 2023-10-06T23:13:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.348+0000 7f01867ff700 1 --2- 172.21.15.8:0/236635289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0180104cc0 0x7f018010b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.348+0000 7f01867ff700 1 --2- 172.21.15.8:0/236635289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0180103130 0x7f0180103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.348+0000 7f01867ff700 1 --2- 172.21.15.8:0/236635289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 0x7f0180104780 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.348+0000 7f01867ff700 1 -- 172.21.15.8:0/236635289 >> 172.21.15.8:0/236635289 conn(0x7f01800fe6a0 msgr2=0x7f0180100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:35.351 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.349+0000 7f01867ff700 1 -- 172.21.15.8:0/236635289 shutdown_connections 2023-10-06T23:13:35.351 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.349+0000 7f01867ff700 1 -- 172.21.15.8:0/236635289 wait complete. 2023-10-06T23:13:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.350+0000 7f01867ff700 1 Processor -- start 2023-10-06T23:13:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.350+0000 7f01867ff700 1 -- start start 2023-10-06T23:13:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.350+0000 7f01867ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0180103130 0x7f0180075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.350+0000 7f01867ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 0x7f0180075ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.350+0000 7f01867ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0180104cc0 0x7f0180076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.350+0000 7f01867ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800771d0 con 0x7f0180104320 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.350+0000 7f01867ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180077340 con 0x7f0180104cc0 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.350+0000 7f01867ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180077500 con 0x7f0180103130 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 0x7f0180075ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 0x7f0180075ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56912/0 (socket says 172.21.15.8:56912) 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 -- 172.21.15.8:0/593455311 learned_addr learned my addr 172.21.15.8:0/593455311 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017ffff700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0180103130 0x7f0180075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f0184d9c700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0180104cc0 0x7f0180076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 -- 172.21.15.8:0/593455311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0180103130 msgr2=0x7f0180075760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0180103130 0x7f0180075760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 -- 172.21.15.8:0/593455311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0180104cc0 msgr2=0x7f0180076b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0180104cc0 0x7f0180076b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 -- 172.21.15.8:0/593455311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740095f0 con 0x7f0180104320 2023-10-06T23:13:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.351+0000 7f017f7fe700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 0x7f0180075ca0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0174000c00 tx=0x7f017400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.352+0000 7f017d7fa700 1 -- 172.21.15.8:0/593455311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017401d070 con 0x7f0180104320 2023-10-06T23:13:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.352+0000 7f017d7fa700 1 -- 172.21.15.8:0/593455311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f017400bcf0 con 0x7f0180104320 2023-10-06T23:13:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.352+0000 7f01867ff700 1 -- 172.21.15.8:0/593455311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0180077780 con 0x7f0180104320 2023-10-06T23:13:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.352+0000 7f017d7fa700 1 -- 172.21.15.8:0/593455311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174004c60 con 0x7f0180104320 2023-10-06T23:13:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.352+0000 7f01867ff700 1 -- 172.21.15.8:0/593455311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0180077f90 con 0x7f0180104320 2023-10-06T23:13:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.355+0000 7f017d7fa700 1 -- 172.21.15.8:0/593455311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0174005570 con 0x7f0180104320 2023-10-06T23:13:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.357+0000 7f019a0a8b80 1 Processor -- start 2023-10-06T23:13:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.357+0000 7f019a0a8b80 1 -- start start 2023-10-06T23:13:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.357+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d3e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.357+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3efd0 0x555fb3d3f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.357+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d46220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3ca6400 con 0x555fb3d3f990 2023-10-06T23:13:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3c97bc0 con 0x555fb3d3dec0 2023-10-06T23:13:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3c954e0 con 0x555fb3d3efd0 2023-10-06T23:13:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017d7fa700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d46220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017d7fa700 1 -- 172.21.15.8:0/593455311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f01740cdbb0 con 0x7f0180104320 2023-10-06T23:13:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d46220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56926/0 (socket says 172.21.15.8:56926) 2023-10-06T23:13:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017f7fe700 1 -- 172.21.15.8:0/1114974631 learned_addr learned my addr 172.21.15.8:0/1114974631 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f0184d9c700 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d3e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017ffff700 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3efd0 0x555fb3d3f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f0184d9c700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017f7fe700 1 -- 172.21.15.8:0/1114974631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3efd0 msgr2=0x555fb3d3f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017f7fe700 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3efd0 0x555fb3d3f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017f7fe700 1 -- 172.21.15.8:0/1114974631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 msgr2=0x555fb3d3e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017f7fe700 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d3e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.358+0000 7f017f7fe700 1 -- 172.21.15.8:0/1114974631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fb3abbd80 con 0x555fb3d3f990 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.359+0000 7f017f7fe700 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d46220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f01740cb660 tx=0x7f0174097250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52e22a17b116e38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.359+0000 7f0184d9c700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x555fb3d3dc60 tx=0x7f017800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.359+0000 7f01667fc700 1 -- 172.21.15.8:0/1114974631 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017409aa50 con 0x555fb3d3f990 2023-10-06T23:13:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.359+0000 7f01667fc700 1 -- 172.21.15.8:0/1114974631 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f017409a870 con 0x555fb3d3f990 2023-10-06T23:13:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.359+0000 7f01667fc700 1 -- 172.21.15.8:0/1114974631 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01740a1190 con 0x555fb3d3f990 2023-10-06T23:13:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1114974631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 msgr2=0x555fb3d46220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d46220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f01740cb660 tx=0x7f0174097250 comp rx=0 tx=0).stop 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1114974631 shutdown_connections 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d46220 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d3e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1114974631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3efd0 0x555fb3d3f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1114974631 >> 172.21.15.8:0/1114974631 conn(0x555fb3cb2200 msgr2=0x555fb3d38bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1114974631 shutdown_connections 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.360+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1114974631 wait complete. 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.361+0000 7f019a0a8b80 1 -- start start 2023-10-06T23:13:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.361+0000 7f019a0a8b80 1 Processor -- start 2023-10-06T23:13:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d47820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3efd0 0x555fb3d47d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3f990 0x555fb3d4eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3c90dd0 con 0x555fb3d3efd0 2023-10-06T23:13:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3c2d6b0 con 0x555fb3d3dec0 2023-10-06T23:13:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3c2d350 con 0x555fb3d3f990 2023-10-06T23:13:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f019a0a8b80 10 client.0 _ll_register_callbacks cb 0x555fb3a8a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f017f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3efd0 0x555fb3d47d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f017ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d47820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f017f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3efd0 0x555fb3d47d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56932/0 (socket says 172.21.15.8:56932) 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f017f7fe700 1 -- 172.21.15.8:0/1685415259 learned_addr learned my addr 172.21.15.8:0/1685415259 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.362+0000 7f0184d9c700 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3f990 0x555fb3d4eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f017ffff700 1 -- 172.21.15.8:0/1685415259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3f990 msgr2=0x555fb3d4eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f017ffff700 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3f990 0x555fb3d4eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f017ffff700 1 -- 172.21.15.8:0/1685415259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3efd0 msgr2=0x555fb3d47d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f017ffff700 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3efd0 0x555fb3d47d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f017ffff700 1 -- 172.21.15.8:0/1685415259 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0180077f90 con 0x555fb3d3dec0 2023-10-06T23:13:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f017ffff700 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d47820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0180104180 tx=0x7f01700129b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e39d12012e569b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f015f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f015f7fe700 1 -- 172.21.15.8:0/1685415259 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170017070 con 0x555fb3d3dec0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f015f7fe700 1 -- 172.21.15.8:0/1685415259 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0170004300 con 0x555fb3d3dec0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.363+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1685415259 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fb3d30d50 con 0x555fb3d3dec0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.364+0000 7f015f7fe700 1 -- 172.21.15.8:0/1685415259 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0170022030 con 0x555fb3d3dec0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.364+0000 7f019a0a8b80 10 client.25244 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.364+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1685415259 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555fb3aa4c00 con 0x555fb3d3dec0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.364+0000 7f015f7fe700 1 -- 172.21.15.8:0/1685415259 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555fb3d30d50 con 0x555fb3d3dec0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.364+0000 7f015f7fe700 1 -- 172.21.15.8:0/1685415259 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f017000f5b0 con 0x555fb3d3dec0 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.365+0000 7f019a0a8b80 10 client.25244 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.365+0000 7f019a0a8b80 10 client.25244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.365+0000 7f019a0a8b80 20 client.25244 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.365+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555fb3d536b0 0x555fb3d55ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.365+0000 7f019a0a8b80 4 client.25244 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:35.369 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.365+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1685415259 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fb3c89db0 con 0x555fb3d536b0 2023-10-06T23:13:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.365+0000 7f017f7fe700 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555fb3d536b0 0x555fb3d55ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.366+0000 7f017f7fe700 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555fb3d536b0 0x555fb3d55ad0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7508e3a86112c880 server_cookie=8a1e1be154fa8b41 in_seq=0 out_seq=0 2023-10-06T23:13:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.366+0000 7f015f7fe700 10 client.25244 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f015f7fe700 1 -- 172.21.15.8:0/1685415259 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555fb3c89db0 con 0x555fb3d536b0 2023-10-06T23:13:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f015f7fe700 10 client.25244 handle_command_reply: tid=0 2023-10-06T23:13:35.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 client.25244 shutdown 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1685415259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 msgr2=0x555fb3d47820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d47820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0180104180 tx=0x7f01700129b0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1685415259 shutdown_connections 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555fb3d536b0 0x555fb3d55ad0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3f990 0x555fb3d4eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3dec0 0x555fb3d47820 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1685415259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3efd0 0x555fb3d47d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f015f7fe700 0 client.25244 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1685415259 >> 172.21.15.8:0/1685415259 conn(0x555fb3cb2200 msgr2=0x555fb3d38250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1685415259 shutdown_connections 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1685415259 wait complete. 2023-10-06T23:13:35.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.367+0000 7f019a0a8b80 20 client.25244 trim_cache size 0 max 16384 2023-10-06T23:13:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.388+0000 7f019a0a8b80 1 Processor -- start 2023-10-06T23:13:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.388+0000 7f019a0a8b80 1 -- start start 2023-10-06T23:13:35.392 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 0x555fb3d3e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 0x555fb3d4ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3b118c0 con 0x555fb3d3f990 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3d39f80 con 0x555fb3d3efd0 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3d33340 con 0x555fb3d3dec0 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f0184d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f0184d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56936/0 (socket says 172.21.15.8:56936) 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f0184d9c700 1 -- 172.21.15.8:0/1890987960 learned_addr learned my addr 172.21.15.8:0/1890987960 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f017ffff700 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 0x555fb3d3e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.389+0000 7f017f7fe700 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 0x555fb3d4ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0184d9c700 1 -- 172.21.15.8:0/1890987960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 msgr2=0x555fb3d3e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0184d9c700 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 0x555fb3d3e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0184d9c700 1 -- 172.21.15.8:0/1890987960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 msgr2=0x555fb3d4ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0184d9c700 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 0x555fb3d4ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0184d9c700 1 -- 172.21.15.8:0/1890987960 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fb3ae21f0 con 0x555fb3d3f990 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0184d9c700 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d475d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0178012fc0 tx=0x7f0178017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e811e9243f7e9096 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0166ffd700 1 -- 172.21.15.8:0/1890987960 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800e040 con 0x555fb3d3f990 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0166ffd700 1 -- 172.21.15.8:0/1890987960 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0178021040 con 0x555fb3d3f990 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.390+0000 7f0166ffd700 1 -- 172.21.15.8:0/1890987960 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178007760 con 0x555fb3d3f990 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1890987960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 msgr2=0x555fb3d475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d475d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0178012fc0 tx=0x7f0178017000 comp rx=0 tx=0).stop 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1890987960 shutdown_connections 2023-10-06T23:13:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d475d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 0x555fb3d3e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/1890987960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 0x555fb3d4ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1890987960 >> 172.21.15.8:0/1890987960 conn(0x555fb3cb2200 msgr2=0x555fb3d42750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1890987960 shutdown_connections 2023-10-06T23:13:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.391+0000 7f019a0a8b80 1 -- 172.21.15.8:0/1890987960 wait complete. 2023-10-06T23:13:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 1 -- start start 2023-10-06T23:13:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 1 Processor -- start 2023-10-06T23:13:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 0x555fb3d4e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 0x555fb3d4ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d4cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3d4d050 con 0x555fb3d3f990 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3d4d1c0 con 0x555fb3d3efd0 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb3d4d380 con 0x555fb3d3dec0 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.392+0000 7f019a0a8b80 10 client.0 _ll_register_callbacks cb 0x7f0170009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d4cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d4cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56942/0 (socket says 172.21.15.8:56942) 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 -- 172.21.15.8:0/3207248261 learned_addr learned my addr 172.21.15.8:0/3207248261 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f017f7fe700 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 0x555fb3d4ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f017ffff700 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 0x555fb3d4e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 -- 172.21.15.8:0/3207248261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 msgr2=0x555fb3d4e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 0x555fb3d4e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 -- 172.21.15.8:0/3207248261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 msgr2=0x555fb3d4ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 0x555fb3d4ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 -- 172.21.15.8:0/3207248261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0178012ab0 con 0x555fb3d3f990 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f0184d9c700 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d4cb10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0178027040 tx=0x7f0178009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254d7ed1704f58d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.393+0000 7f015f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.394+0000 7f015f7fe700 1 -- 172.21.15.8:0/3207248261 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800e030 con 0x555fb3d3f990 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.394+0000 7f019a0a8b80 1 -- 172.21.15.8:0/3207248261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f017409a870 con 0x555fb3d3f990 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.394+0000 7f015f7fe700 1 -- 172.21.15.8:0/3207248261 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0178007a50 con 0x555fb3d3f990 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.394+0000 7f015f7fe700 1 -- 172.21.15.8:0/3207248261 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0178007c50 con 0x555fb3d3f990 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.394+0000 7f019a0a8b80 10 client.15447 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.394+0000 7f019a0a8b80 1 -- 172.21.15.8:0/3207248261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555fb3aba250 con 0x555fb3d3f990 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.394+0000 7f015f7fe700 1 -- 172.21.15.8:0/3207248261 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f017803d020 con 0x555fb3d3f990 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.395+0000 7f015f7fe700 1 -- 172.21.15.8:0/3207248261 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0178035060 con 0x555fb3d3f990 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.395+0000 7f019a0a8b80 10 client.15447 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.395+0000 7f019a0a8b80 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.395+0000 7f019a0a8b80 20 client.15447 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.395+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555fb3da8700 0x555fb3daaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.395+0000 7f019a0a8b80 4 client.15447 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.395+0000 7f019a0a8b80 1 -- 172.21.15.8:0/3207248261 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555fb3c89ad0 con 0x555fb3da8700 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.395+0000 7f017ffff700 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555fb3da8700 0x555fb3daaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.396+0000 7f015f7fe700 10 client.15447 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.396+0000 7f017ffff700 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555fb3da8700 0x555fb3daaba0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f02f9b09ca2320a server_cookie=16f7712a426fceff in_seq=0 out_seq=0 2023-10-06T23:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f015f7fe700 1 -- 172.21.15.8:0/3207248261 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555fb3c89ad0 con 0x555fb3da8700 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f015f7fe700 10 client.15447 handle_command_reply: tid=0 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 client.15447 shutdown 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 -- 172.21.15.8:0/3207248261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 msgr2=0x555fb3d4cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d4cb10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0178027040 tx=0x7f0178009b20 comp rx=0 tx=0).stop 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 -- 172.21.15.8:0/3207248261 shutdown_connections 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555fb3da8700 0x555fb3daaba0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555fb3d3f990 0x555fb3d4cb10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fb3d3dec0 0x555fb3d4e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 --2- 172.21.15.8:0/3207248261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555fb3d3efd0 0x555fb3d4ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f015f7fe700 0 client.15447 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 -- 172.21.15.8:0/3207248261 >> 172.21.15.8:0/3207248261 conn(0x555fb3cb2200 msgr2=0x555fb3d475d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 -- 172.21.15.8:0/3207248261 shutdown_connections 2023-10-06T23:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 1 -- 172.21.15.8:0/3207248261 wait complete. 2023-10-06T23:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.492+0000 7f019a0a8b80 20 client.15447 trim_cache size 0 max 16384 2023-10-06T23:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 -- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 msgr2=0x7f01680a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x555fb3d3dc60 tx=0x7f017800b040 comp rx=0 tx=0).stop 2023-10-06T23:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 -- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 msgr2=0x7f0180075ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 0x7f0180075ca0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0174000c00 tx=0x7f017400fab0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 -- 172.21.15.8:0/593455311 shutdown_connections 2023-10-06T23:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01680a1480 0x7f01680a3940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0180104cc0 0x7f0180076b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0180103130 0x7f0180075760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 --2- 172.21.15.8:0/593455311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0180104320 0x7f0180075ca0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 -- 172.21.15.8:0/593455311 >> 172.21.15.8:0/593455311 conn(0x7f01800fe6a0 msgr2=0x7f0180100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.493+0000 7f01867ff700 1 -- 172.21.15.8:0/593455311 shutdown_connections 2023-10-06T23:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:35.494+0000 7f01867ff700 1 -- 172.21.15.8:0/593455311 wait complete. 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3602_fsm 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602_vm 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3603 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3603_fsm 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3603_vm 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3604 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3605 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3606 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3607 2023-10-06T23:13:35.636 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3608 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 3609 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3712 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3764_fsm 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764_vm 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3766 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3767 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3997 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 5002 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 548 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 549 2023-10-06T23:13:35.637 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102_vm 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104_vm 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106_vm 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6110 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6111 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6112 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6113 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6117 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826 2023-10-06T23:13:35.638 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826_vm 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 827 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 828 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 6 23:13 pg_filenode.map 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 6 23:13 PG_VERSION 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 . 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 6 23:13 .. 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 112 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 113 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 6 23:13 12182 2023-10-06T23:13:35.639 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12182_fsm 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12182_vm 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12184 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12186 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12187_fsm 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187_vm 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12189 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12191 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12192_fsm 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192_vm 2023-10-06T23:13:35.640 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12194 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12196 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12197_fsm 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197_vm 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12199 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12201 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12202_fsm 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202_vm 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12204 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12206 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207 2023-10-06T23:13:35.641 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12207_fsm 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207_vm 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12209 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12211 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12212 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12214 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12216 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 6 23:13 1247 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1247_fsm 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1247_vm 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 6 23:13 1249 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1249_fsm 2023-10-06T23:13:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1249_vm 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 6 23:13 1255 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1255_fsm 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1255_vm 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 6 23:13 1259 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1259_fsm 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1259_vm 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417_vm 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418_vm 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 174 2023-10-06T23:13:35.643 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 175 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2187 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224_vm 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328_vm 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336_vm 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2337 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2600 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2600_fsm 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2600_vm 2023-10-06T23:13:35.644 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2601_fsm 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601_vm 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2602 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2602_fsm 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2602_vm 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2603 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2603_fsm 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2603_vm 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604_vm 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2605 2023-10-06T23:13:35.645 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2605_fsm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2605_vm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2606_fsm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606_vm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607_fsm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2607_vm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 6 23:13 2608 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2608_fsm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2608_vm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 6 23:13 2609 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2609_fsm 2023-10-06T23:13:35.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2609_vm 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610_fsm 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2610_vm 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611_vm 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2612_fsm 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612_vm 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613_vm 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615 2023-10-06T23:13:35.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2615_fsm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615_vm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616_fsm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2616_vm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 6 23:13 2617 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2617_fsm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2617_vm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 6 23:13 2618 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2618_fsm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2618_vm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 6 23:13 2619 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2619_fsm 2023-10-06T23:13:35.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2619_vm 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620_vm 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2650 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2651 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2652 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2653 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2654 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2655 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2656 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2657 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 6 23:13 2658 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2659 2023-10-06T23:13:35.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2660 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2661 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2662 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2663 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2664 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2665 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2666 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2667 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2668 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2669 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2670 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 6 23:13 2673 2023-10-06T23:13:35.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 6 23:13 2674 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 6 23:13 2675 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2678 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2679 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2680 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2681 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2682 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2683 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2684 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2685 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2686 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2687 2023-10-06T23:13:35.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2688 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2689 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2690 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 6 23:13 2691 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2692 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2693 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2696 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2699 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2701 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2702 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2703 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2704 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2753 2023-10-06T23:13:35.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2753_fsm 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2753_vm 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2754 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2755 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2756 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2757 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830_vm 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2831 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832_vm 2023-10-06T23:13:35.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2833 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834_vm 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2835 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836_vm 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2837 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 6 23:13 2838 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2838_fsm 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2838_vm 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2839 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840 2023-10-06T23:13:35.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840_fsm 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2840_vm 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2841 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995_vm 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2996 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3079_fsm 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079_vm 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3080 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3081 2023-10-06T23:13:35.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3085 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118_vm 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3119 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3164 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256_vm 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3257 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3258 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350 2023-10-06T23:13:35.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350_vm 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3351 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3379 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3380 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381_vm 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3394 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3394_fsm 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3394_vm 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3395 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439 2023-10-06T23:13:35.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439_vm 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3440 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 3455 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3456 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3456_fsm 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3456_vm 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466_vm 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3467 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3468 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501_vm 2023-10-06T23:13:35.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3502 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3503 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3534 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3541_fsm 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541_vm 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3542 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3574 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3575 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576_vm 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596 2023-10-06T23:13:35.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596_vm 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3597 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598_vm 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3599 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3600_fsm 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600_vm 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3601_fsm 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601_vm 2023-10-06T23:13:35.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602 2023-10-06T23:13:35.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3602_fsm 2023-10-06T23:13:35.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602_vm 2023-10-06T23:13:35.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3603 2023-10-06T23:13:35.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3603_fsm 2023-10-06T23:13:35.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3603_vm 2023-10-06T23:13:35.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3604 2023-10-06T23:13:35.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3605 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3606 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3607 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3608 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 3609 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3712 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3764_fsm 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764_vm 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3766 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3767 2023-10-06T23:13:35.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3997 2023-10-06T23:13:35.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 5002 2023-10-06T23:13:35.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 548 2023-10-06T23:13:35.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 549 2023-10-06T23:13:35.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102 2023-10-06T23:13:35.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102_vm 2023-10-06T23:13:35.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104 2023-10-06T23:13:35.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104_vm 2023-10-06T23:13:35.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106 2023-10-06T23:13:35.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106_vm 2023-10-06T23:13:35.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6110 2023-10-06T23:13:35.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6111 2023-10-06T23:13:35.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6112 2023-10-06T23:13:35.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6113 2023-10-06T23:13:35.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6117 2023-10-06T23:13:35.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826 2023-10-06T23:13:35.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826_vm 2023-10-06T23:13:35.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 827 2023-10-06T23:13:35.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 828 2023-10-06T23:13:35.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 6 23:13 pg_filenode.map 2023-10-06T23:13:35.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 6 23:13 PG_VERSION 2023-10-06T23:13:35.741 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.741 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/global: 2023-10-06T23:13:35.741 INFO:teuthology.orchestra.run.smithi008.stdout:total 554 2023-10-06T23:13:35.741 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Oct 6 23:13 . 2023-10-06T23:13:35.742 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1136 2023-10-06T23:13:35.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1136_fsm 2023-10-06T23:13:35.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1136_vm 2023-10-06T23:13:35.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 1137 2023-10-06T23:13:35.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1213 2023-10-06T23:13:35.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1213_fsm 2023-10-06T23:13:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1213_vm 2023-10-06T23:13:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1214 2023-10-06T23:13:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1214_fsm 2023-10-06T23:13:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1214_vm 2023-10-06T23:13:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 1232 2023-10-06T23:13:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 1233 2023-10-06T23:13:35.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1260 2023-10-06T23:13:35.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1260_fsm 2023-10-06T23:13:35.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1260_vm 2023-10-06T23:13:35.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1261 2023-10-06T23:13:35.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1261_fsm 2023-10-06T23:13:35.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1261_vm 2023-10-06T23:13:35.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1262 2023-10-06T23:13:35.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1262_fsm 2023-10-06T23:13:35.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1262_vm 2023-10-06T23:13:35.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2396 2023-10-06T23:13:35.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2396_fsm 2023-10-06T23:13:35.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2396_vm 2023-10-06T23:13:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2397 2023-10-06T23:13:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2671 2023-10-06T23:13:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2672 2023-10-06T23:13:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2676 2023-10-06T23:13:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2677 2023-10-06T23:13:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2694 2023-10-06T23:13:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2695 2023-10-06T23:13:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2697 2023-10-06T23:13:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2698 2023-10-06T23:13:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2846 2023-10-06T23:13:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2846_vm 2023-10-06T23:13:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2847 2023-10-06T23:13:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2964 2023-10-06T23:13:35.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2964_vm 2023-10-06T23:13:35.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2965 2023-10-06T23:13:35.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2966 2023-10-06T23:13:35.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2966_vm 2023-10-06T23:13:35.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2967 2023-10-06T23:13:35.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3592 2023-10-06T23:13:35.802 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3592_vm 2023-10-06T23:13:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3593 2023-10-06T23:13:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 4060 2023-10-06T23:13:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 4060_vm 2023-10-06T23:13:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 4061 2023-10-06T23:13:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6000 2023-10-06T23:13:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6000_vm 2023-10-06T23:13:35.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6001 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6002 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6100 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6100_vm 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6114 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6115 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 pg_control 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 6 23:13 pg_filenode.map 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/log: 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.804 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-06T23:13:35.805 INFO:teuthology.orchestra.run.smithi008.stdout:total 3 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:13 . 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 mappings 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:13 replorigin_checkpoint 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 snapshots 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:13 .. 2023-10-06T23:13:35.806 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.807 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-06T23:13:35.807 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.807 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.807 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:13 .. 2023-10-06T23:13:35.807 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.807 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-06T23:13:35.807 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-06T23:13:35.807 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 . 2023-10-06T23:13:35.808 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.808 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 members 2023-10-06T23:13:35.808 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 offsets 2023-10-06T23:13:35.808 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.808 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-06T23:13:35.808 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-06T23:13:35.808 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 . 2023-10-06T23:13:35.809 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 .. 2023-10-06T23:13:35.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 0000 2023-10-06T23:13:35.809 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.809 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-06T23:13:35.809 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-06T23:13:35.809 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 . 2023-10-06T23:13:35.870 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 .. 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 0000 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 . 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 0000 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.871 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-06T23:13:35.872 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.872 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.872 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.872 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.872 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-06T23:13:35.872 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.872 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.872 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.873 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-06T23:13:35.874 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 . 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 0000 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.875 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:total 16386 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:13 . 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:13 000000010000000000000001 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 archive_status 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:13:35.876 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:13:35.877 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:13 .. 2023-10-06T23:13:35.877 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:35.877 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-06T23:13:35.877 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-06T23:13:35.877 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 . 2023-10-06T23:13:35.877 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 6 23:13 .. 2023-10-06T23:13:35.877 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 0000 2023-10-06T23:13:35.878 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-10-06T23:13:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:36 smithi008 ceph-mon[98532]: pgmap v371: 97 pgs: 97 active+clean; 46 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 2.5 MiB/s wr, 216 op/s 2023-10-06T23:13:36.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2023-10-06T23:13:36.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:36 smithi156 ceph-mon[102862]: pgmap v371: 97 pgs: 97 active+clean; 46 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 2.5 MiB/s wr, 216 op/s 2023-10-06T23:13:36.426 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-10-06T23:13:36.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:36 smithi190 ceph-mon[102658]: pgmap v371: 97 pgs: 97 active+clean; 46 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 2.5 MiB/s wr, 216 op/s 2023-10-06T23:13:36.480 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-10-06T23:13:36.486 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-10-06T23:13:36.493 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-10-06T23:13:36.531 INFO:teuthology.orchestra.run.smithi008.stderr:creating tables... 2023-10-06T23:13:37.342 INFO:teuthology.orchestra.run.smithi008.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.81 s, remaining 25.05 s) 2023-10-06T23:13:38.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:38 smithi156 ceph-mon[102862]: pgmap v372: 97 pgs: 97 active+clean; 46 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2023-10-06T23:13:38.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:38 smithi008 ceph-mon[98532]: pgmap v372: 97 pgs: 97 active+clean; 46 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2023-10-06T23:13:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:38 smithi190 ceph-mon[102658]: pgmap v372: 97 pgs: 97 active+clean; 46 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1.8 MiB/s wr, 187 op/s 2023-10-06T23:13:39.134 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:13:39.179 INFO:teuthology.orchestra.run.smithi008.stderr:200000 of 3200000 tuples (6%) done (elapsed 2.65 s, remaining 39.68 s) 2023-10-06T23:13:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 -- 172.21.15.8:0/1362709018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 msgr2=0x7feb9810f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 --2- 172.21.15.8:0/1362709018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 0x7feb9810f8b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b0a0 tx=0x7feb9000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 -- 172.21.15.8:0/1362709018 shutdown_connections 2023-10-06T23:13:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 --2- 172.21.15.8:0/1362709018 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 0x7feb9810f8b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 --2- 172.21.15.8:0/1362709018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb98074ef0 0x7feb98073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 --2- 172.21.15.8:0/1362709018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb98073910 0x7feb98073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 -- 172.21.15.8:0/1362709018 >> 172.21.15.8:0/1362709018 conn(0x7feb980fc460 msgr2=0x7feb980fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:39.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 -- 172.21.15.8:0/1362709018 shutdown_connections 2023-10-06T23:13:39.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.387+0000 7feb9ebff700 1 -- 172.21.15.8:0/1362709018 wait complete. 2023-10-06T23:13:39.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.388+0000 7feb9ebff700 1 Processor -- start 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.388+0000 7feb9ebff700 1 -- start start 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9ebff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb98073910 0x7feb9819d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9ebff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb98074ef0 0x7feb9819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9ebff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 0x7feb981a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9ebff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981a4d60 con 0x7feb9810d4c0 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9ebff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981a4ea0 con 0x7feb98073910 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9ebff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981a5030 con 0x7feb98074ef0 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9c99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb98073910 0x7feb9819d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9d19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 0x7feb981a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9c99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb98073910 0x7feb9819d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48930/0 (socket says 172.21.15.8:48930) 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb9c99b700 1 -- 172.21.15.8:0/2250378432 learned_addr learned my addr 172.21.15.8:0/2250378432 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:39.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.389+0000 7feb97fff700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb98074ef0 0x7feb9819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb9d19c700 1 -- 172.21.15.8:0/2250378432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb98074ef0 msgr2=0x7feb9819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb9d19c700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb98074ef0 0x7feb9819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb9d19c700 1 -- 172.21.15.8:0/2250378432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb98073910 msgr2=0x7feb9819d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb9d19c700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb98073910 0x7feb9819d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb9d19c700 1 -- 172.21.15.8:0/2250378432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009d00 con 0x7feb9810d4c0 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb9c99b700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb98073910 0x7feb9819d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb9d19c700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 0x7feb981a4790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b070 tx=0x7feb9000bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb95ffb700 1 -- 172.21.15.8:0/2250378432 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000e040 con 0x7feb9810d4c0 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb95ffb700 1 -- 172.21.15.8:0/2250378432 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb90009480 con 0x7feb9810d4c0 2023-10-06T23:13:39.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb95ffb700 1 -- 172.21.15.8:0/2250378432 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900052a0 con 0x7feb9810d4c0 2023-10-06T23:13:39.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.390+0000 7feb9ebff700 1 -- 172.21.15.8:0/2250378432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb981a52b0 con 0x7feb9810d4c0 2023-10-06T23:13:39.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.391+0000 7feb9ebff700 1 -- 172.21.15.8:0/2250378432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb981a5680 con 0x7feb9810d4c0 2023-10-06T23:13:39.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.394+0000 7feb95ffb700 1 -- 172.21.15.8:0/2250378432 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7feb90005400 con 0x7feb9810d4c0 2023-10-06T23:13:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7febb25acb80 1 Processor -- start 2023-10-06T23:13:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7febb25acb80 1 -- start start 2023-10-06T23:13:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7febb25acb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc14d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7febb25acb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc14e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7febb25acb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7febb25acb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc0b5460 con 0x5634fc14ea60 2023-10-06T23:13:39.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7febb25acb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc0a6c20 con 0x5634fc14d260 2023-10-06T23:13:39.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7febb25acb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc0a4540 con 0x5634fc14dbc0 2023-10-06T23:13:39.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.396+0000 7feb95ffb700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb880a1500 0x7feb880a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc14d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48932/0 (socket says 172.21.15.8:48932) 2023-10-06T23:13:39.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 -- 172.21.15.8:0/1550730039 learned_addr learned my addr 172.21.15.8:0/1550730039 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb95ffb700 1 -- 172.21.15.8:0/2250378432 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb900cdd10 con 0x7feb9810d4c0 2023-10-06T23:13:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb9c99b700 1 --2- 172.21.15.8:0/1550730039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 -- 172.21.15.8:0/1550730039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 msgr2=0x5634fc14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb9d19c700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb880a1500 0x7feb880a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 --2- 172.21.15.8:0/1550730039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc14e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 -- 172.21.15.8:0/1550730039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 msgr2=0x5634fc14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:39.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 --2- 172.21.15.8:0/1550730039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 -- 172.21.15.8:0/1550730039 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634fbecade0 con 0x5634fc14ea60 2023-10-06T23:13:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.397+0000 7feb97fff700 1 --2- 172.21.15.8:0/1550730039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc14eee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feb84012820 tx=0x7feb840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16e15eaff0c49b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.398+0000 7feb82ffd700 1 -- 172.21.15.8:0/1550730039 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84012e40 con 0x5634fc14ea60 2023-10-06T23:13:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.398+0000 7feb82ffd700 1 -- 172.21.15.8:0/1550730039 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb840044c0 con 0x5634fc14ea60 2023-10-06T23:13:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.398+0000 7feb82ffd700 1 -- 172.21.15.8:0/1550730039 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84005020 con 0x5634fc14ea60 2023-10-06T23:13:39.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.398+0000 7feb9d19c700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb880a1500 0x7feb880a39c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb900a2e40 tx=0x7feb90009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 -- 172.21.15.8:0/1550730039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 msgr2=0x5634fc14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 --2- 172.21.15.8:0/1550730039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc14eee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feb84012820 tx=0x7feb840047c0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 -- 172.21.15.8:0/1550730039 shutdown_connections 2023-10-06T23:13:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 --2- 172.21.15.8:0/1550730039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc14eee0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 --2- 172.21.15.8:0/1550730039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 --2- 172.21.15.8:0/1550730039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 -- 172.21.15.8:0/1550730039 >> 172.21.15.8:0/1550730039 conn(0x5634fc0c1260 msgr2=0x5634fc148140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 -- 172.21.15.8:0/1550730039 shutdown_connections 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.399+0000 7febb25acb80 1 -- 172.21.15.8:0/1550730039 wait complete. 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.400+0000 7febb25acb80 1 -- start start 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.400+0000 7febb25acb80 1 Processor -- start 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.400+0000 7febb25acb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14d260 0x5634fc157090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.400+0000 7febb25acb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.400+0000 7febb25acb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14ea60 0x5634fc15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.400+0000 7febb25acb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc09fe30 con 0x5634fc14dbc0 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7febb25acb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc03c710 con 0x5634fc14ea60 2023-10-06T23:13:39.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7febb25acb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc03c3b0 con 0x5634fc14d260 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7febb25acb80 10 client.0 _ll_register_callbacks cb 0x5634fbe99800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14ea60 0x5634fc15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14ea60 0x5634fc15e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48944/0 (socket says 172.21.15.8:48944) 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb97fff700 1 -- 172.21.15.8:0/2577105413 learned_addr learned my addr 172.21.15.8:0/2577105413 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb9c99b700 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb97fff700 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14d260 0x5634fc157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb9c99b700 1 -- 172.21.15.8:0/2577105413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14d260 msgr2=0x5634fc157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb9c99b700 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14d260 0x5634fc157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb9c99b700 1 -- 172.21.15.8:0/2577105413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14ea60 msgr2=0x5634fc15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:39.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.401+0000 7feb9c99b700 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14ea60 0x5634fc15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7feb9c99b700 1 -- 172.21.15.8:0/2577105413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8401a040 con 0x5634fc14dbc0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7feb97fff700 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14ea60 0x5634fc15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7feb9c99b700 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc1575d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feb8c011ce0 tx=0x7feb8c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f12e7b0e80a640 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7feb77fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7feb77fff700 1 -- 172.21.15.8:0/2577105413 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c016070 con 0x5634fc14dbc0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7febb25acb80 1 -- 172.21.15.8:0/2577105413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634fc13ff10 con 0x5634fc14dbc0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7feb77fff700 1 -- 172.21.15.8:0/2577105413 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb8c004320 con 0x5634fc14dbc0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7feb77fff700 1 -- 172.21.15.8:0/2577105413 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb8c0044e0 con 0x5634fc14dbc0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7febb25acb80 10 client.15459 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.402+0000 7febb25acb80 1 -- 172.21.15.8:0/2577105413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5634fbeb3c60 con 0x5634fc14dbc0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.403+0000 7feb77fff700 1 -- 172.21.15.8:0/2577105413 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5634fc13ff10 con 0x5634fc14dbc0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.403+0000 7feb77fff700 1 -- 172.21.15.8:0/2577105413 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7feb8c005020 con 0x5634fc14dbc0 2023-10-06T23:13:39.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.403+0000 7febb25acb80 10 client.15459 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.403+0000 7febb25acb80 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.403+0000 7febb25acb80 20 client.15459 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.403+0000 7febb25acb80 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5634fc162f60 0x5634fc165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.403+0000 7febb25acb80 4 client.15459 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:39.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.403+0000 7febb25acb80 1 -- 172.21.15.8:0/2577105413 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634fc098e10 con 0x5634fc162f60 2023-10-06T23:13:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.404+0000 7feb97fff700 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5634fc162f60 0x5634fc165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.404+0000 7feb97fff700 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5634fc162f60 0x5634fc165380 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf5c47dd0975f002 server_cookie=ed049493db5e740a in_seq=0 out_seq=0 2023-10-06T23:13:39.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.404+0000 7feb77fff700 10 client.15459 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7feb77fff700 1 -- 172.21.15.8:0/2577105413 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5634fc098e10 con 0x5634fc162f60 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7feb77fff700 10 client.15459 handle_command_reply: tid=0 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 client.15459 shutdown 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 -- 172.21.15.8:0/2577105413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 msgr2=0x5634fc1575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc1575d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feb8c011ce0 tx=0x7feb8c009ed0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 -- 172.21.15.8:0/2577105413 shutdown_connections 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5634fc162f60 0x5634fc165380 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14ea60 0x5634fc15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7feb77fff700 0 client.15459 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:39.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14d260 0x5634fc157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 --2- 172.21.15.8:0/2577105413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc1575d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 -- 172.21.15.8:0/2577105413 >> 172.21.15.8:0/2577105413 conn(0x5634fc0c1260 msgr2=0x5634fc147f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:39.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 -- 172.21.15.8:0/2577105413 shutdown_connections 2023-10-06T23:13:39.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.405+0000 7febb25acb80 1 -- 172.21.15.8:0/2577105413 wait complete. 2023-10-06T23:13:39.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.406+0000 7febb25acb80 20 client.15459 trim_cache size 0 max 16384 2023-10-06T23:13:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.426+0000 7febb25acb80 1 Processor -- start 2023-10-06T23:13:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.426+0000 7febb25acb80 1 -- start start 2023-10-06T23:13:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.426+0000 7febb25acb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc155d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.426+0000 7febb25acb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.426+0000 7febb25acb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.426+0000 7febb25acb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fbf20920 con 0x5634fc14ea60 2023-10-06T23:13:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.426+0000 7febb25acb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc14cee0 con 0x5634fc14d260 2023-10-06T23:13:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.426+0000 7febb25acb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc156540 con 0x5634fc14dbc0 2023-10-06T23:13:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48950/0 (socket says 172.21.15.8:48950) 2023-10-06T23:13:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 -- 172.21.15.8:0/2929975056 learned_addr learned my addr 172.21.15.8:0/2929975056 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:39.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb9c99b700 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 -- 172.21.15.8:0/2929975056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 msgr2=0x5634fc15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc15e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 -- 172.21.15.8:0/2929975056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 msgr2=0x5634fc1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc1519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb97fff700 1 -- 172.21.15.8:0/2929975056 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634fbef1250 con 0x5634fc14d260 2023-10-06T23:13:39.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.427+0000 7feb9c99b700 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.428+0000 7feb97fff700 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc155d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb84008010 tx=0x7feb84007400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46346a311db2e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.428+0000 7feb837fe700 1 -- 172.21.15.8:0/2929975056 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84035040 con 0x5634fc14d260 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.428+0000 7feb837fe700 1 -- 172.21.15.8:0/2929975056 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb84036040 con 0x5634fc14d260 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.428+0000 7feb837fe700 1 -- 172.21.15.8:0/2929975056 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84026040 con 0x5634fc14d260 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 -- 172.21.15.8:0/2929975056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 msgr2=0x5634fc155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc155d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb84008010 tx=0x7feb84007400 comp rx=0 tx=0).stop 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 -- 172.21.15.8:0/2929975056 shutdown_connections 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14ea60 0x5634fc1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc155d00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 --2- 172.21.15.8:0/2929975056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14dbc0 0x5634fc15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 -- 172.21.15.8:0/2929975056 >> 172.21.15.8:0/2929975056 conn(0x5634fc0c1260 msgr2=0x5634fc169ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:39.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 -- 172.21.15.8:0/2929975056 shutdown_connections 2023-10-06T23:13:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 -- 172.21.15.8:0/2929975056 wait complete. 2023-10-06T23:13:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.429+0000 7febb25acb80 1 -- start start 2023-10-06T23:13:39.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.430+0000 7febb25acb80 1 Processor -- start 2023-10-06T23:13:39.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.430+0000 7febb25acb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc15c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.430+0000 7febb25acb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.430+0000 7febb25acb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14ea60 0x5634fc15db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7febb25acb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc15e0a0 con 0x5634fc14dbc0 2023-10-06T23:13:39.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7febb25acb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc15e210 con 0x5634fc14d260 2023-10-06T23:13:39.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7febb25acb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fc15e3d0 con 0x5634fc14ea60 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7febb25acb80 10 client.0 _ll_register_callbacks cb 0x7feb8c0117e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc15c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48952/0 (socket says 172.21.15.8:48952) 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 -- 172.21.15.8:0/263293028 learned_addr learned my addr 172.21.15.8:0/263293028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14ea60 0x5634fc15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb9c99b700 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 -- 172.21.15.8:0/263293028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 msgr2=0x5634fc15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 -- 172.21.15.8:0/263293028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 msgr2=0x5634fc15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:39.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.431+0000 7feb97fff700 1 -- 172.21.15.8:0/263293028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634fbeb3c60 con 0x5634fc14ea60 2023-10-06T23:13:39.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.432+0000 7feb97fff700 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14ea60 0x5634fc15db60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb84007690 tx=0x7feb84007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d4266c48fd0a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:39.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.432+0000 7feb77fff700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:13:39.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.432+0000 7feb77fff700 1 -- 172.21.15.8:0/263293028 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84026070 con 0x5634fc14ea60 2023-10-06T23:13:39.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.432+0000 7febb25acb80 1 -- 172.21.15.8:0/263293028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb840044c0 con 0x5634fc14ea60 2023-10-06T23:13:39.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.432+0000 7feb77fff700 1 -- 172.21.15.8:0/263293028 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb84000e40 con 0x5634fc14ea60 2023-10-06T23:13:39.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7feb77fff700 1 -- 172.21.15.8:0/263293028 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb84030500 con 0x5634fc14ea60 2023-10-06T23:13:39.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7febb25acb80 10 client.25294 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7febb25acb80 1 -- 172.21.15.8:0/263293028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7feb84029040 con 0x5634fc14ea60 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7feb77fff700 1 -- 172.21.15.8:0/263293028 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb84044030 con 0x5634fc14ea60 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7feb77fff700 1 -- 172.21.15.8:0/263293028 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7feb84005180 con 0x5634fc14ea60 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7febb25acb80 10 client.25294 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7febb25acb80 10 client.25294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7febb25acb80 20 client.25294 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7febb25acb80 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5634fc1b7ce0 0x5634fc1ba100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7febb25acb80 4 client.25294 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.433+0000 7febb25acb80 1 -- 172.21.15.8:0/263293028 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5634fc098b30 con 0x5634fc1b7ce0 2023-10-06T23:13:39.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.434+0000 7feb9c99b700 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5634fc1b7ce0 0x5634fc1ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.434+0000 7feb9c99b700 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5634fc1b7ce0 0x5634fc1ba100 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6cf33f2bfb53e9 server_cookie=b98b2428d5bc3a5d in_seq=0 out_seq=0 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.434+0000 7feb77fff700 10 client.25294 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7feb77fff700 1 -- 172.21.15.8:0/263293028 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5634fc098b30 con 0x5634fc1b7ce0 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7feb77fff700 10 client.25294 handle_command_reply: tid=0 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 client.25294 shutdown 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 -- 172.21.15.8:0/263293028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14ea60 msgr2=0x5634fc15db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14ea60 0x5634fc15db60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb84007690 tx=0x7feb84007e80 comp rx=0 tx=0).stop 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 -- 172.21.15.8:0/263293028 shutdown_connections 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5634fc1b7ce0 0x5634fc1ba100 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634fc14ea60 0x5634fc15db60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634fc14d260 0x5634fc15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7feb77fff700 0 client.25294 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 --2- 172.21.15.8:0/263293028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634fc14dbc0 0x5634fc15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 -- 172.21.15.8:0/263293028 >> 172.21.15.8:0/263293028 conn(0x5634fc0c1260 msgr2=0x5634fc155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 -- 172.21.15.8:0/263293028 shutdown_connections 2023-10-06T23:13:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.435+0000 7febb25acb80 1 -- 172.21.15.8:0/263293028 wait complete. 2023-10-06T23:13:39.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7febb25acb80 20 client.25294 trim_cache size 0 max 16384 2023-10-06T23:13:39.441 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:13:39.442 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-06T23:13:39.442 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-06T23:13:39.442 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:13:39.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 -- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb880a1500 msgr2=0x7feb880a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb880a1500 0x7feb880a39c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb900a2e40 tx=0x7feb90009040 comp rx=0 tx=0).stop 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 -- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 msgr2=0x7feb981a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 0x7feb981a4790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b070 tx=0x7feb9000bcc0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 -- 172.21.15.8:0/2250378432 shutdown_connections 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb880a1500 0x7feb880a39c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb9810d4c0 0x7feb981a4790 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb98073910 0x7feb9819d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 --2- 172.21.15.8:0/2250378432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb98074ef0 0x7feb9819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.436+0000 7feb9ebff700 1 -- 172.21.15.8:0/2250378432 >> 172.21.15.8:0/2250378432 conn(0x7feb980fc460 msgr2=0x7feb980fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:39.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.437+0000 7feb9ebff700 1 -- 172.21.15.8:0/2250378432 shutdown_connections 2023-10-06T23:13:39.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.437+0000 7feb9ebff700 1 -- 172.21.15.8:0/2250378432 wait complete. 2023-10-06T23:13:39.459 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T23:13:39.459 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T23:13:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 -- 172.21.15.8:0/830799361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c64104100 msgr2=0x7f4c641064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/830799361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c64104100 0x7f4c641064f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009990 tx=0x7f4c54009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 -- 172.21.15.8:0/830799361 shutdown_connections 2023-10-06T23:13:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/830799361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c64106a30 0x7f4c64108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/830799361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c641017d0 0x7f4c64103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/830799361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c64104100 0x7f4c641064f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 -- 172.21.15.8:0/830799361 >> 172.21.15.8:0/830799361 conn(0x7f4c640fb1c0 msgr2=0x7f4c640fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 -- 172.21.15.8:0/830799361 shutdown_connections 2023-10-06T23:13:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.726+0000 7f4c6a79d700 1 -- 172.21.15.8:0/830799361 wait complete. 2023-10-06T23:13:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.727+0000 7f4c6a79d700 1 Processor -- start 2023-10-06T23:13:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.727+0000 7f4c6a79d700 1 -- start start 2023-10-06T23:13:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6a79d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c641017d0 0x7f4c64196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6a79d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c64104100 0x7f4c64196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6a79d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c64106a30 0x7f4c6419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6a79d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6419e3d0 con 0x7f4c641017d0 2023-10-06T23:13:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6a79d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6419e510 con 0x7f4c64104100 2023-10-06T23:13:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6a79d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6419e6a0 con 0x7f4c64106a30 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6979b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c641017d0 0x7f4c64196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6979b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c641017d0 0x7f4c64196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45526/0 (socket says 172.21.15.8:45526) 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c6979b700 1 -- 172.21.15.8:0/722890419 learned_addr learned my addr 172.21.15.8:0/722890419 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c69f9c700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c64106a30 0x7f4c6419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.728+0000 7f4c68f9a700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c64104100 0x7f4c64196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c6979b700 1 -- 172.21.15.8:0/722890419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c64106a30 msgr2=0x7f4c6419de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c6979b700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c64106a30 0x7f4c6419de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c6979b700 1 -- 172.21.15.8:0/722890419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c64104100 msgr2=0x7f4c64196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c6979b700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c64104100 0x7f4c64196d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c6979b700 1 -- 172.21.15.8:0/722890419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540095f0 con 0x7f4c641017d0 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c68f9a700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c64104100 0x7f4c64196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c6979b700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c641017d0 0x7f4c64196850 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000e9a0 tx=0x7f4c6000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c5a7fc700 1 -- 172.21.15.8:0/722890419 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60009790 con 0x7f4c641017d0 2023-10-06T23:13:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6419e980 con 0x7f4c641017d0 2023-10-06T23:13:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c5a7fc700 1 -- 172.21.15.8:0/722890419 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c6000cbd0 con 0x7f4c641017d0 2023-10-06T23:13:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c5a7fc700 1 -- 172.21.15.8:0/722890419 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60018680 con 0x7f4c641017d0 2023-10-06T23:13:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.729+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6419ee90 con 0x7f4c641017d0 2023-10-06T23:13:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.731+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c640fcd40 con 0x7f4c641017d0 2023-10-06T23:13:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.733+0000 7f4c5a7fc700 1 -- 172.21.15.8:0/722890419 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4c6000cd40 con 0x7f4c641017d0 2023-10-06T23:13:39.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.735+0000 7f4c5a7fc700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4c500a1570 0x7f4c500a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:39.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.735+0000 7f4c5a7fc700 1 -- 172.21.15.8:0/722890419 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4c60014070 con 0x7f4c641017d0 2023-10-06T23:13:39.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.735+0000 7f4c68f9a700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4c500a1570 0x7f4c500a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:39.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.736+0000 7f4c68f9a700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4c500a1570 0x7f4c500a3a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c540098e0 tx=0x7f4c54005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:39.740+0000 7f4c5a7fc700 1 -- 172.21.15.8:0/722890419 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4c60096510 con 0x7f4c641017d0 2023-10-06T23:13:40.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.009+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c6410c440 con 0x7f4c641017d0 2023-10-06T23:13:40.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.010+0000 7f4c5a7fc700 1 -- 172.21.15.8:0/722890419 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11310 (secure 0 0 0) 0x7f4c60099b30 con 0x7f4c641017d0 2023-10-06T23:13:40.011 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:13:40.011 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/3213157438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":3213157438},{"type":"v1","addr":"172.21.15.8:6837","nonce":3213157438}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14664,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1169721104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1169721104},{"type":"v1","addr":"172.21.15.8:6839","nonce":1169721104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/686934069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":686934069},{"type":"v1","addr":"172.21.15.8:6841","nonce":686934069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/865735895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":865735895},{"type":"v1","addr":"172.21.15.156:6833","nonce":865735895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/345838273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":345838273},{"type":"v1","addr":"172.21.15.190:6833","nonce":345838273}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24485,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3180877421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3180877421},{"type":"v1","addr":"172.21.15.8:6835","nonce":3180877421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-06T23:11:17.784448+0000","modified":"2023-10-06T23:13:31.816997+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/3086367655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3086367655},{"type":"v1","addr":"172.21.15.156:6835","nonce":3086367655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.190:6835/2542800704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":2542800704},{"type":"v1","addr":"172.21.15.190:6835","nonce":2542800704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24538":{"gid":24538,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3967292194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3967292194},{"type":"v1","addr":"172.21.15.190:6837","nonce":3967292194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/2054249175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2054249175},{"type":"v1","addr":"172.21.15.156:6837","nonce":2054249175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/730533990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":730533990},{"type":"v1","addr":"172.21.15.190:6839","nonce":730533990}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1606000246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1606000246},{"type":"v1","addr":"172.21.15.156:6839","nonce":1606000246}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-06T23:13:40.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4c500a1570 msgr2=0x7f4c500a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4c500a1570 0x7f4c500a3a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c540098e0 tx=0x7f4c54005fb0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c641017d0 msgr2=0x7f4c64196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c641017d0 0x7f4c64196850 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000e9a0 tx=0x7f4c6000ed60 comp rx=0 tx=0).stop 2023-10-06T23:13:40.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 shutdown_connections 2023-10-06T23:13:40.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f4c500a1570 0x7f4c500a3a30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c641017d0 0x7f4c64196850 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c64106a30 0x7f4c6419de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 --2- 172.21.15.8:0/722890419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c64104100 0x7f4c64196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 >> 172.21.15.8:0/722890419 conn(0x7f4c640fb1c0 msgr2=0x7f4c64102440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.014+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 shutdown_connections 2023-10-06T23:13:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.015+0000 7f4c6a79d700 1 -- 172.21.15.8:0/722890419 wait complete. 2023-10-06T23:13:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-06T23:13:40.037 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-06T23:13:40.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2162524583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04104330 msgr2=0x7fed04106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2162524583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04104330 0x7fed04106720 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009990 tx=0x7fecf4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2162524583 shutdown_connections 2023-10-06T23:13:40.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2162524583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04106c60 0x7fed04109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2162524583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101a00 0x7fed04103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2162524583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04104330 0x7fed04106720 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2162524583 >> 172.21.15.8:0/2162524583 conn(0x7fed040fb330 msgr2=0x7fed040fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2162524583 shutdown_connections 2023-10-06T23:13:40.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.271+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2162524583 wait complete. 2023-10-06T23:13:40.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.272+0000 7fed0b3ff700 1 Processor -- start 2023-10-06T23:13:40.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.272+0000 7fed0b3ff700 1 -- start start 2023-10-06T23:13:40.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0b3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101a00 0x7fed04101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0b3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04104330 0x7fed040ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0b3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04106c60 0x7fed040ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0b3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed04100690 con 0x7fed04106c60 2023-10-06T23:13:40.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0b3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed04100800 con 0x7fed04104330 2023-10-06T23:13:40.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0b3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed041a0b70 con 0x7fed04101a00 2023-10-06T23:13:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101a00 0x7fed04101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0999c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04106c60 0x7fed040ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101a00 0x7fed04101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37898/0 (socket says 172.21.15.8:37898) 2023-10-06T23:13:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0919b700 1 -- 172.21.15.8:0/2154264592 learned_addr learned my addr 172.21.15.8:0/2154264592 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.273+0000 7fed0899a700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04104330 0x7fed040ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fed0999c700 1 -- 172.21.15.8:0/2154264592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101a00 msgr2=0x7fed04101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fed0999c700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101a00 0x7fed04101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fed0999c700 1 -- 172.21.15.8:0/2154264592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04104330 msgr2=0x7fed040ff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fed0999c700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04104330 0x7fed040ff9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fed0999c700 1 -- 172.21.15.8:0/2154264592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf40095f0 con 0x7fed04106c60 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fed0919b700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101a00 0x7fed04101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fed0999c700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04106c60 0x7fed040ffef0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00efc0 tx=0x7fecfc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fecfa7fc700 1 -- 172.21.15.8:0/2154264592 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc018070 con 0x7fed04106c60 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2154264592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed041a0df0 con 0x7fed04106c60 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fecfa7fc700 1 -- 172.21.15.8:0/2154264592 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecfc00f040 con 0x7fed04106c60 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.274+0000 7fecfa7fc700 1 -- 172.21.15.8:0/2154264592 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc00cba0 con 0x7fed04106c60 2023-10-06T23:13:40.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.275+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2154264592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed041a1220 con 0x7fed04106c60 2023-10-06T23:13:40.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.279+0000 7fecfa7fc700 1 -- 172.21.15.8:0/2154264592 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fecfc003a00 con 0x7fed04106c60 2023-10-06T23:13:40.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.279+0000 7fed1ed0db80 1 Processor -- start 2023-10-06T23:13:40.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.279+0000 7fed1ed0db80 1 -- start start 2023-10-06T23:13:40.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.280+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 0x5654f1a7d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.280+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7dbc0 0x5654f1a7e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.280+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7ea60 0x5654f1a7eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.280+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f19e5460 con 0x5654f1a7ea60 2023-10-06T23:13:40.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.280+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f19d6c20 con 0x5654f1a7d260 2023-10-06T23:13:40.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.280+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f19d4540 con 0x5654f1a7dbc0 2023-10-06T23:13:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.280+0000 7fed0899a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7ea60 0x5654f1a7eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.280+0000 7fed0919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7dbc0 0x5654f1a7e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7dbc0 0x5654f1a7e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37912/0 (socket says 172.21.15.8:37912) 2023-10-06T23:13:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0919b700 1 -- 172.21.15.8:0/1077341136 learned_addr learned my addr 172.21.15.8:0/1077341136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0899a700 1 --2- 172.21.15.8:0/1077341136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 0x5654f1a7d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fecfa7fc700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecf00a1480 0x7fecf00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fecfa7fc700 1 -- 172.21.15.8:0/2154264592 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecfc0cc840 con 0x7fed04106c60 2023-10-06T23:13:40.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0919b700 1 -- 172.21.15.8:0/1077341136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 msgr2=0x5654f1a7d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0919b700 1 --2- 172.21.15.8:0/1077341136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 0x5654f1a7d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0919b700 1 -- 172.21.15.8:0/1077341136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7ea60 msgr2=0x5654f1a7eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0919b700 1 --2- 172.21.15.8:0/1077341136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7ea60 0x5654f1a7eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0919b700 1 -- 172.21.15.8:0/1077341136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654f17fade0 con 0x5654f1a7dbc0 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.281+0000 7fed0999c700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecf00a1480 0x7fecf00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.282+0000 7fed0919b700 1 --2- 172.21.15.8:0/1077341136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7dbc0 0x5654f1a7e480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed000117e0 tx=0x7fed00011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cea9fb6338c9b817 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.282+0000 7fed0999c700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecf00a1480 0x7fecf00a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009fd0 tx=0x7fecfc004c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.282+0000 7fecef7fe700 1 -- 172.21.15.8:0/1077341136 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0000f480 con 0x5654f1a7dbc0 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.282+0000 7fecef7fe700 1 -- 172.21.15.8:0/1077341136 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed0000fa70 con 0x5654f1a7dbc0 2023-10-06T23:13:40.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.282+0000 7fecef7fe700 1 -- 172.21.15.8:0/1077341136 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00019930 con 0x5654f1a7dbc0 2023-10-06T23:13:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 -- 172.21.15.8:0/1077341136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7dbc0 msgr2=0x5654f1a7e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/1077341136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7dbc0 0x5654f1a7e480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed000117e0 tx=0x7fed00011af0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 -- 172.21.15.8:0/1077341136 shutdown_connections 2023-10-06T23:13:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/1077341136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7ea60 0x5654f1a7eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/1077341136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 0x5654f1a7d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/1077341136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7dbc0 0x5654f1a7e480 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 -- 172.21.15.8:0/1077341136 >> 172.21.15.8:0/1077341136 conn(0x5654f19f1260 msgr2=0x5654f1a78140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 -- 172.21.15.8:0/1077341136 shutdown_connections 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 -- 172.21.15.8:0/1077341136 wait complete. 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.283+0000 7fed1ed0db80 1 -- start start 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.284+0000 7fed1ed0db80 1 Processor -- start 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.284+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a87010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.284+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 0x5654f1a87550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a8e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f19cfe30 con 0x5654f1a7d260 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f196c710 con 0x5654f1a7dbc0 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f196c3b0 con 0x5654f1a7ea60 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed1ed0db80 10 client.0 _ll_register_callbacks cb 0x5654f17c9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:40.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a87010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a87010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45558/0 (socket says 172.21.15.8:45558) 2023-10-06T23:13:40.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 -- 172.21.15.8:0/3538218063 learned_addr learned my addr 172.21.15.8:0/3538218063 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0919b700 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 0x5654f1a87550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a8e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 -- 172.21.15.8:0/3538218063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 msgr2=0x5654f1a8e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a8e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 -- 172.21.15.8:0/3538218063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 msgr2=0x5654f1a87550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 0x5654f1a87550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.285+0000 7fed0899a700 1 -- 172.21.15.8:0/3538218063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed00011440 con 0x5654f1a7d260 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.286+0000 7fed0899a700 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a87010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fecf40059d0 tx=0x7fecf4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5361f37eb9ebbbd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.286+0000 7fececff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.286+0000 7fececff9700 1 -- 172.21.15.8:0/3538218063 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf401d040 con 0x5654f1a7d260 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.286+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3538218063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654f1a6ff10 con 0x5654f1a7d260 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.286+0000 7fececff9700 1 -- 172.21.15.8:0/3538218063 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecf400b710 con 0x5654f1a7d260 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.286+0000 7fececff9700 1 -- 172.21.15.8:0/3538218063 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecf400b8d0 con 0x5654f1a7d260 2023-10-06T23:13:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.286+0000 7fed1ed0db80 10 client.15483 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.286+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3538218063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5654f17e3c60 con 0x5654f1a7d260 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fececff9700 1 -- 172.21.15.8:0/3538218063 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5654f1a6ff10 con 0x5654f1a7d260 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fececff9700 1 -- 172.21.15.8:0/3538218063 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fecf400fa00 con 0x5654f1a7d260 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fed1ed0db80 10 client.15483 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fed1ed0db80 10 client.15483 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fed1ed0db80 20 client.15483 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x5654f1a92dc0 0x5654f1a951e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fed1ed0db80 4 client.15483 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3538218063 --> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654f19c8e10 con 0x5654f1a92dc0 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.287+0000 7fed0919b700 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x5654f1a92dc0 0x5654f1a951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.288+0000 7fed0919b700 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x5654f1a92dc0 0x5654f1a951e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a693396dfcf49bda server_cookie=b725fe7b62378b41 in_seq=0 out_seq=0 2023-10-06T23:13:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.288+0000 7fececff9700 10 client.15483 ms_handle_connect on v2:172.21.15.190:6834/2542800704 2023-10-06T23:13:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fececff9700 1 -- 172.21.15.8:0/3538218063 <== mds.2 v2:172.21.15.190:6834/2542800704 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5654f19c8e10 con 0x5654f1a92dc0 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fececff9700 10 client.15483 handle_command_reply: tid=0 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 client.15483 shutdown 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3538218063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 msgr2=0x5654f1a87010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a87010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fecf40059d0 tx=0x7fecf4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3538218063 shutdown_connections 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x5654f1a92dc0 0x5654f1a951e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a87010 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a8e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3538218063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 0x5654f1a87550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3538218063 >> 172.21.15.8:0/3538218063 conn(0x5654f19f1260 msgr2=0x5654f1a77f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fececff9700 0 client.15483 ms_handle_reset on v2:172.21.15.190:6834/2542800704 2023-10-06T23:13:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.289+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3538218063 shutdown_connections 2023-10-06T23:13:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.290+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3538218063 wait complete. 2023-10-06T23:13:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.290+0000 7fed1ed0db80 20 client.15483 trim_cache size 0 max 16384 2023-10-06T23:13:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.306+0000 7fed1ed0db80 1 Processor -- start 2023-10-06T23:13:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.306+0000 7fed1ed0db80 1 -- start start 2023-10-06T23:13:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.306+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a84ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.306+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.306+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a77f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.306+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f1850920 con 0x5654f1a7d260 2023-10-06T23:13:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f1a88230 con 0x5654f1a7dbc0 2023-10-06T23:13:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f1a79270 con 0x5654f1a7ea60 2023-10-06T23:13:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0899a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a84ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0899a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a84ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45564/0 (socket says 172.21.15.8:45564) 2023-10-06T23:13:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0899a700 1 -- 172.21.15.8:0/2625482171 learned_addr learned my addr 172.21.15.8:0/2625482171 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0919b700 1 --2- 172.21.15.8:0/2625482171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0899a700 1 -- 172.21.15.8:0/2625482171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 msgr2=0x5654f1a77f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0899a700 1 --2- 172.21.15.8:0/2625482171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a77f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0899a700 1 -- 172.21.15.8:0/2625482171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 msgr2=0x5654f1a8e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0899a700 1 --2- 172.21.15.8:0/2625482171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.307+0000 7fed0899a700 1 -- 172.21.15.8:0/2625482171 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654f1821250 con 0x5654f1a7d260 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.308+0000 7fed0899a700 1 --2- 172.21.15.8:0/2625482171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a84ea0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fecf4003f60 tx=0x7fecf4009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f129fb21b1a885b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.308+0000 7feceffff700 1 -- 172.21.15.8:0/2625482171 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf401d070 con 0x5654f1a7d260 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.308+0000 7feceffff700 1 -- 172.21.15.8:0/2625482171 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecf4009290 con 0x5654f1a7d260 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.308+0000 7feceffff700 1 -- 172.21.15.8:0/2625482171 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf400f5e0 con 0x5654f1a7d260 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 -- 172.21.15.8:0/2625482171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 msgr2=0x5654f1a84ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/2625482171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a84ea0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fecf4003f60 tx=0x7fecf4009530 comp rx=0 tx=0).stop 2023-10-06T23:13:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 -- 172.21.15.8:0/2625482171 shutdown_connections 2023-10-06T23:13:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/2625482171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7d260 0x5654f1a84ea0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/2625482171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a77f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/2625482171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 -- 172.21.15.8:0/2625482171 >> 172.21.15.8:0/2625482171 conn(0x5654f19f1260 msgr2=0x5654f1a85cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 -- 172.21.15.8:0/2625482171 shutdown_connections 2023-10-06T23:13:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.309+0000 7fed1ed0db80 1 -- 172.21.15.8:0/2625482171 wait complete. 2023-10-06T23:13:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 1 -- start start 2023-10-06T23:13:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 1 Processor -- start 2023-10-06T23:13:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 0x5654f1a8c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a8d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f1a8ddc0 con 0x5654f1a7dbc0 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f1a8df30 con 0x5654f1a7d260 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f1a8e0f0 con 0x5654f1a7ea60 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.310+0000 7fed1ed0db80 10 client.0 _ll_register_callbacks cb 0x7fecf4004020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45572/0 (socket says 172.21.15.8:45572) 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 -- 172.21.15.8:0/3154555468 learned_addr learned my addr 172.21.15.8:0/3154555468 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0899a700 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 0x5654f1a8c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0899a700 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a8d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 -- 172.21.15.8:0/3154555468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 msgr2=0x5654f1a8d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a8d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 -- 172.21.15.8:0/3154555468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 msgr2=0x5654f1a8c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 0x5654f1a8c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 -- 172.21.15.8:0/3154555468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654f17e3c60 con 0x5654f1a7dbc0 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fed0919b700 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8c870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fed0000a010 tx=0x7fed00005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53338f8def5e84fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.311+0000 7fececff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.312+0000 7fececff9700 1 -- 172.21.15.8:0/3154555468 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00009260 con 0x5654f1a7dbc0 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.312+0000 7fececff9700 1 -- 172.21.15.8:0/3154555468 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fed0000f710 con 0x5654f1a7dbc0 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.312+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3154555468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed0000fa70 con 0x5654f1a7dbc0 2023-10-06T23:13:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.312+0000 7fececff9700 1 -- 172.21.15.8:0/3154555468 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed0000f8d0 con 0x5654f1a7dbc0 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.312+0000 7fed1ed0db80 10 client.15489 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.312+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3154555468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5654f17f92b0 con 0x5654f1a7dbc0 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.312+0000 7fececff9700 1 -- 172.21.15.8:0/3154555468 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed00039020 con 0x5654f1a7dbc0 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.313+0000 7fececff9700 1 -- 172.21.15.8:0/3154555468 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fed00003940 con 0x5654f1a7dbc0 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.313+0000 7fed1ed0db80 10 client.15489 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.313+0000 7fed1ed0db80 10 client.15489 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.313+0000 7fed1ed0db80 20 client.15489 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.313+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x5654f1ae7bf0 0x5654f1aea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.313+0000 7fed1ed0db80 4 client.15489 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-06T23:13:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.313+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3154555468 --> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654f19c8b30 con 0x5654f1ae7bf0 2023-10-06T23:13:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.314+0000 7fed0899a700 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x5654f1ae7bf0 0x5654f1aea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.314+0000 7fed0899a700 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x5654f1ae7bf0 0x5654f1aea010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f6f047ab56254982 server_cookie=4dba32953fb63465 in_seq=0 out_seq=0 2023-10-06T23:13:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.314+0000 7fececff9700 10 client.15489 ms_handle_connect on v2:172.21.15.190:6834/2542800704 2023-10-06T23:13:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.314+0000 7fececff9700 1 -- 172.21.15.8:0/3154555468 <== mds.2 v2:172.21.15.190:6834/2542800704 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5654f19c8b30 con 0x5654f1ae7bf0 2023-10-06T23:13:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.314+0000 7fececff9700 10 client.15489 handle_command_reply: tid=0 2023-10-06T23:13:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.314+0000 7fed1ed0db80 1 client.15489 shutdown 2023-10-06T23:13:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.314+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3154555468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7dbc0 msgr2=0x5654f1a8c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.314+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8c870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fed0000a010 tx=0x7fed00005ce0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3154555468 shutdown_connections 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.190:6834/2542800704,v1:172.21.15.190:6835/2542800704] conn(0x5654f1ae7bf0 0x5654f1aea010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5654f1a7ea60 0x5654f1a8d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5654f1a7d260 0x5654f1a8c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 1 --2- 172.21.15.8:0/3154555468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654f1a7dbc0 0x5654f1a8c870 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fececff9700 0 client.15489 ms_handle_reset on v2:172.21.15.190:6834/2542800704 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3154555468 >> 172.21.15.8:0/3154555468 conn(0x5654f19f1260 msgr2=0x5654f1a819d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3154555468 shutdown_connections 2023-10-06T23:13:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 1 -- 172.21.15.8:0/3154555468 wait complete. 2023-10-06T23:13:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.315+0000 7fed1ed0db80 20 client.15489 trim_cache size 0 max 16384 2023-10-06T23:13:40.321 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-06T23:13:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecf00a1480 msgr2=0x7fecf00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecf00a1480 0x7fecf00a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009fd0 tx=0x7fecfc004c50 comp rx=0 tx=0).stop 2023-10-06T23:13:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04106c60 msgr2=0x7fed040ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04106c60 0x7fed040ffef0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00efc0 tx=0x7fecfc00c3a0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2154264592 shutdown_connections 2023-10-06T23:13:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecf00a1480 0x7fecf00a3940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed04106c60 0x7fed040ffef0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101a00 0x7fed04101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 --2- 172.21.15.8:0/2154264592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04104330 0x7fed040ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2154264592 >> 172.21.15.8:0/2154264592 conn(0x7fed040fb330 msgr2=0x7fed04102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2154264592 shutdown_connections 2023-10-06T23:13:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.316+0000 7fed0b3ff700 1 -- 172.21.15.8:0/2154264592 wait complete. 2023-10-06T23:13:40.334 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:40 smithi008 ceph-mon[98532]: pgmap v373: 97 pgs: 97 active+clean; 51 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.9 MiB/s wr, 162 op/s 2023-10-06T23:13:40.334 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:40 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/722890419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:40.336 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-06T23:13:40.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:40 smithi156 ceph-mon[102862]: pgmap v373: 97 pgs: 97 active+clean; 51 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.9 MiB/s wr, 162 op/s 2023-10-06T23:13:40.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:40 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/722890419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:40 smithi190 ceph-mon[102658]: pgmap v373: 97 pgs: 97 active+clean; 51 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.9 MiB/s wr, 162 op/s 2023-10-06T23:13:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:40 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/722890419' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-06T23:13:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.604+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/3813526087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e81000d0 msgr2=0x7ff0e8100550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.604+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/3813526087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e81000d0 0x7ff0e8100550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009990 tx=0x7ff0dc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.604+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/3813526087 shutdown_connections 2023-10-06T23:13:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.604+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/3813526087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e8100a90 0x7ff0e8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.604+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/3813526087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0e80ff770 0x7ff0e80ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.604+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/3813526087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e81000d0 0x7ff0e8100550 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.604+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/3813526087 >> 172.21.15.8:0/3813526087 conn(0x7ff0e80fb330 msgr2=0x7ff0e80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.604+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/3813526087 shutdown_connections 2023-10-06T23:13:40.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.605+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/3813526087 wait complete. 2023-10-06T23:13:40.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.606+0000 7ff0ec9ff700 1 Processor -- start 2023-10-06T23:13:40.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.606+0000 7ff0ec9ff700 1 -- start start 2023-10-06T23:13:40.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.606+0000 7ff0ec9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80ff770 0x7ff0e8198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.606+0000 7ff0ec9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0e81000d0 0x7ff0e8199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.606+0000 7ff0ec9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e8100a90 0x7ff0e81a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.606+0000 7ff0ec9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81a0860 con 0x7ff0e80ff770 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.606+0000 7ff0ec9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81a09d0 con 0x7ff0e81000d0 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.606+0000 7ff0ec9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81a0b90 con 0x7ff0e8100a90 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80ff770 0x7ff0e8198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80ff770 0x7ff0e8198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45598/0 (socket says 172.21.15.8:45598) 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e659c700 1 -- 172.21.15.8:0/2910142649 learned_addr learned my addr 172.21.15.8:0/2910142649 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e8100a90 0x7ff0e81a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e5d9b700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0e81000d0 0x7ff0e8199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e659c700 1 -- 172.21.15.8:0/2910142649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e8100a90 msgr2=0x7ff0e81a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e659c700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e8100a90 0x7ff0e81a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e659c700 1 -- 172.21.15.8:0/2910142649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0e81000d0 msgr2=0x7ff0e8199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e659c700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0e81000d0 0x7ff0e8199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e659c700 1 -- 172.21.15.8:0/2910142649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0095f0 con 0x7ff0e80ff770 2023-10-06T23:13:40.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.607+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e8100a90 0x7ff0e81a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:40.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.608+0000 7ff0e659c700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80ff770 0x7ff0e8198d20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800e9a0 tx=0x7ff0d800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.608+0000 7ff0d77fe700 1 -- 172.21.15.8:0/2910142649 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8009790 con 0x7ff0e80ff770 2023-10-06T23:13:40.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.608+0000 7ff0d77fe700 1 -- 172.21.15.8:0/2910142649 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d800cbd0 con 0x7ff0e80ff770 2023-10-06T23:13:40.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.608+0000 7ff0d77fe700 1 -- 172.21.15.8:0/2910142649 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8018680 con 0x7ff0e80ff770 2023-10-06T23:13:40.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.608+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/2910142649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e81a0e70 con 0x7ff0e80ff770 2023-10-06T23:13:40.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.608+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/2910142649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e81a1240 con 0x7ff0e80ff770 2023-10-06T23:13:40.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.612+0000 7ff0d77fe700 1 -- 172.21.15.8:0/2910142649 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff0d800cd40 con 0x7ff0e80ff770 2023-10-06T23:13:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.613+0000 7ff0d77fe700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0d00a1500 0x7ff0d00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.613+0000 7ff0d77fe700 1 -- 172.21.15.8:0/2910142649 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0d8014070 con 0x7ff0e80ff770 2023-10-06T23:13:40.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.613+0000 7ff0e5d9b700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0d00a1500 0x7ff0d00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.614+0000 7ff100359b80 1 Processor -- start 2023-10-06T23:13:40.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.614+0000 7ff100359b80 1 -- start start 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.614+0000 7ff100359b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6628680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.614+0000 7ff100359b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628bc0 0x5634a6629480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.614+0000 7ff100359b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6629ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.614+0000 7ff100359b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a6590460 con 0x5634a6628260 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.614+0000 7ff100359b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a6581c20 con 0x5634a6628bc0 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.614+0000 7ff100359b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a657f540 con 0x5634a6629a60 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6628680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6628680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45606/0 (socket says 172.21.15.8:45606) 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e659c700 1 -- 172.21.15.8:0/3155296620 learned_addr learned my addr 172.21.15.8:0/3155296620 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/3155296620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6629ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e5d9b700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0d00a1500 0x7ff0d00a39c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006010 tx=0x7ff0dc00b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e659c700 1 -- 172.21.15.8:0/3155296620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 msgr2=0x5634a6629ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e659c700 1 --2- 172.21.15.8:0/3155296620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6629ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e659c700 1 -- 172.21.15.8:0/3155296620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628bc0 msgr2=0x5634a6629480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e659c700 1 --2- 172.21.15.8:0/3155296620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628bc0 0x5634a6629480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.615+0000 7ff0e659c700 1 -- 172.21.15.8:0/3155296620 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634a63a5de0 con 0x5634a6628260 2023-10-06T23:13:40.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.616+0000 7ff0e659c700 1 --2- 172.21.15.8:0/3155296620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6628680 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff0d809a090 tx=0x7ff0d8099b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6f56c045960334 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.616+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/3155296620 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d809a100 con 0x5634a6628260 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.616+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/3155296620 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d809e250 con 0x5634a6628260 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.616+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/3155296620 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80a2000 con 0x5634a6628260 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 -- 172.21.15.8:0/3155296620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 msgr2=0x5634a6628680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 --2- 172.21.15.8:0/3155296620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6628680 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff0d809a090 tx=0x7ff0d8099b90 comp rx=0 tx=0).stop 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 -- 172.21.15.8:0/3155296620 shutdown_connections 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 --2- 172.21.15.8:0/3155296620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6628680 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 --2- 172.21.15.8:0/3155296620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6629ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 --2- 172.21.15.8:0/3155296620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628bc0 0x5634a6629480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 -- 172.21.15.8:0/3155296620 >> 172.21.15.8:0/3155296620 conn(0x5634a659c260 msgr2=0x5634a6623140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 -- 172.21.15.8:0/3155296620 shutdown_connections 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.617+0000 7ff100359b80 1 -- 172.21.15.8:0/3155296620 wait complete. 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.618+0000 7ff100359b80 1 -- start start 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.618+0000 7ff100359b80 1 Processor -- start 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.618+0000 7ff100359b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628260 0x5634a66320e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.618+0000 7ff100359b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6632620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.618+0000 7ff100359b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6639660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.618+0000 7ff100359b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a657ae30 con 0x5634a6628bc0 2023-10-06T23:13:40.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.618+0000 7ff100359b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a6517710 con 0x5634a6628260 2023-10-06T23:13:40.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.618+0000 7ff100359b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a65173b0 con 0x5634a6629a60 2023-10-06T23:13:40.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff100359b80 10 client.0 _ll_register_callbacks cb 0x5634a6374800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:40.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6632620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e6d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6639660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6632620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45622/0 (socket says 172.21.15.8:45622) 2023-10-06T23:13:40.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e5d9b700 1 -- 172.21.15.8:0/281656966 learned_addr learned my addr 172.21.15.8:0/281656966 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e659c700 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628260 0x5634a66320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e6d9d700 1 -- 172.21.15.8:0/281656966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628260 msgr2=0x5634a66320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628260 0x5634a66320e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e6d9d700 1 -- 172.21.15.8:0/281656966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 msgr2=0x5634a6632620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6632620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e6d9d700 1 -- 172.21.15.8:0/281656966 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e81a1240 con 0x5634a6629a60 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.619+0000 7ff0e5d9b700 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6632620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.620+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6639660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0007b30 tx=0x7ff0e0007b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f85cda47ce8dc1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.620+0000 7ff0cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.620+0000 7ff0cdffb700 1 -- 172.21.15.8:0/281656966 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000e070 con 0x5634a6629a60 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.620+0000 7ff0cdffb700 1 -- 172.21.15.8:0/281656966 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0e0004bb0 con 0x5634a6629a60 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.620+0000 7ff100359b80 1 -- 172.21.15.8:0/281656966 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634a661af10 con 0x5634a6629a60 2023-10-06T23:13:40.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff0cdffb700 1 -- 172.21.15.8:0/281656966 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0e0004d70 con 0x5634a6629a60 2023-10-06T23:13:40.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff100359b80 10 client.25327 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:40.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff100359b80 1 -- 172.21.15.8:0/281656966 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5634a638ec60 con 0x5634a6629a60 2023-10-06T23:13:40.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff0cdffb700 1 -- 172.21.15.8:0/281656966 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5634a661af10 con 0x5634a6629a60 2023-10-06T23:13:40.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff0cdffb700 1 -- 172.21.15.8:0/281656966 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff0e0004020 con 0x5634a6629a60 2023-10-06T23:13:40.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff100359b80 10 client.25327 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:40.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff100359b80 10 client.25327 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-06T23:13:40.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff100359b80 20 client.25327 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:40.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff100359b80 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x5634a663dfb0 0x5634a66403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff100359b80 4 client.25327 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:40.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.621+0000 7ff100359b80 1 -- 172.21.15.8:0/281656966 --> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634a6573e10 con 0x5634a663dfb0 2023-10-06T23:13:40.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.622+0000 7ff0e659c700 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x5634a663dfb0 0x5634a66403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.622+0000 7ff0e659c700 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x5634a663dfb0 0x5634a66403d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2a7eaf981c7a38d3 server_cookie=da6bcacc4bf2b526 in_seq=0 out_seq=0 2023-10-06T23:13:40.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.622+0000 7ff0cdffb700 10 client.25327 ms_handle_connect on v2:172.21.15.190:6838/730533990 2023-10-06T23:13:40.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff0cdffb700 1 -- 172.21.15.8:0/281656966 <== mds.1 v2:172.21.15.190:6838/730533990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5634a6573e10 con 0x5634a663dfb0 2023-10-06T23:13:40.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff0cdffb700 10 client.25327 handle_command_reply: tid=0 2023-10-06T23:13:40.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 client.25327 shutdown 2023-10-06T23:13:40.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 -- 172.21.15.8:0/281656966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 msgr2=0x5634a6639660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6639660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0007b30 tx=0x7ff0e0007b60 comp rx=0 tx=0).stop 2023-10-06T23:13:40.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 -- 172.21.15.8:0/281656966 shutdown_connections 2023-10-06T23:13:40.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x5634a663dfb0 0x5634a66403d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6629a60 0x5634a6639660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6628260 0x5634a66320e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 --2- 172.21.15.8:0/281656966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6632620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff0cdffb700 0 client.25327 ms_handle_reset on v2:172.21.15.190:6838/730533990 2023-10-06T23:13:40.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.623+0000 7ff100359b80 1 -- 172.21.15.8:0/281656966 >> 172.21.15.8:0/281656966 conn(0x5634a659c260 msgr2=0x5634a6622f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.624+0000 7ff100359b80 1 -- 172.21.15.8:0/281656966 shutdown_connections 2023-10-06T23:13:40.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.624+0000 7ff100359b80 1 -- 172.21.15.8:0/281656966 wait complete. 2023-10-06T23:13:40.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.624+0000 7ff100359b80 20 client.25327 trim_cache size 0 max 16384 2023-10-06T23:13:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.646+0000 7ff100359b80 1 Processor -- start 2023-10-06T23:13:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.646+0000 7ff100359b80 1 -- start start 2023-10-06T23:13:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.646+0000 7ff100359b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628260 0x5634a6624020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.646+0000 7ff100359b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6639620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff100359b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6639e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff100359b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a6631af0 con 0x5634a6628bc0 2023-10-06T23:13:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff100359b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a63fb920 con 0x5634a6629a60 2023-10-06T23:13:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff100359b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a6631590 con 0x5634a6628260 2023-10-06T23:13:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6639620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e659c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628260 0x5634a6624020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6639620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45638/0 (socket says 172.21.15.8:45638) 2023-10-06T23:13:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e5d9b700 1 -- 172.21.15.8:0/3838197948 learned_addr learned my addr 172.21.15.8:0/3838197948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6639e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e659c700 1 -- 172.21.15.8:0/3838197948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 msgr2=0x5634a6639e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e659c700 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6639e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e659c700 1 -- 172.21.15.8:0/3838197948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 msgr2=0x5634a6639620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e659c700 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6639620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e659c700 1 -- 172.21.15.8:0/3838197948 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634a63cc250 con 0x5634a6628260 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6639e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.647+0000 7ff0e5d9b700 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6639620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.648+0000 7ff0e659c700 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628260 0x5634a6624020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0d809a040 tx=0x7ff0d8096570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b494c2bad2a8c17a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.648+0000 7ff0d57fa700 1 -- 172.21.15.8:0/3838197948 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d807a070 con 0x5634a6628260 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.648+0000 7ff0d57fa700 1 -- 172.21.15.8:0/3838197948 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d809a100 con 0x5634a6628260 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.648+0000 7ff0d57fa700 1 -- 172.21.15.8:0/3838197948 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8099850 con 0x5634a6628260 2023-10-06T23:13:40.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 -- 172.21.15.8:0/3838197948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628260 msgr2=0x5634a6624020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628260 0x5634a6624020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0d809a040 tx=0x7ff0d8096570 comp rx=0 tx=0).stop 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 -- 172.21.15.8:0/3838197948 shutdown_connections 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6639e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628260 0x5634a6624020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 --2- 172.21.15.8:0/3838197948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628bc0 0x5634a6639620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 -- 172.21.15.8:0/3838197948 >> 172.21.15.8:0/3838197948 conn(0x5634a659c260 msgr2=0x5634a6621bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 -- 172.21.15.8:0/3838197948 shutdown_connections 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.649+0000 7ff100359b80 1 -- 172.21.15.8:0/3838197948 wait complete. 2023-10-06T23:13:40.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.650+0000 7ff100359b80 1 -- start start 2023-10-06T23:13:40.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.650+0000 7ff100359b80 1 Processor -- start 2023-10-06T23:13:40.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.650+0000 7ff100359b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6636aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.650+0000 7ff100359b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628bc0 0x5634a6636fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.650+0000 7ff100359b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6637ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.650+0000 7ff100359b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a6638530 con 0x5634a6628260 2023-10-06T23:13:40.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.650+0000 7ff100359b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a66386a0 con 0x5634a6629a60 2023-10-06T23:13:40.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.650+0000 7ff100359b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a6638860 con 0x5634a6628bc0 2023-10-06T23:13:40.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff100359b80 10 client.0 _ll_register_callbacks cb 0x7ff0e0007500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:40.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6636aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6636aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45650/0 (socket says 172.21.15.8:45650) 2023-10-06T23:13:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e659c700 1 -- 172.21.15.8:0/1889870277 learned_addr learned my addr 172.21.15.8:0/1889870277 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e6d9d700 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6637ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e5d9b700 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628bc0 0x5634a6636fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e659c700 1 -- 172.21.15.8:0/1889870277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628bc0 msgr2=0x5634a6636fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e659c700 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628bc0 0x5634a6636fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e659c700 1 -- 172.21.15.8:0/1889870277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 msgr2=0x5634a6637ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e659c700 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6637ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.651+0000 7ff0e659c700 1 -- 172.21.15.8:0/1889870277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e810be40 con 0x5634a6628260 2023-10-06T23:13:40.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff0e659c700 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6636aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8099db0 tx=0x7ff0d80a2520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de13016beb3c2180 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff0cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:40.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff0cdffb700 1 -- 172.21.15.8:0/1889870277 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d807a070 con 0x5634a6628260 2023-10-06T23:13:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff0cdffb700 1 -- 172.21.15.8:0/1889870277 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0d80995f0 con 0x5634a6628260 2023-10-06T23:13:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff100359b80 1 -- 172.21.15.8:0/1889870277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0d809e250 con 0x5634a6628260 2023-10-06T23:13:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff0cdffb700 1 -- 172.21.15.8:0/1889870277 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d80997b0 con 0x5634a6628260 2023-10-06T23:13:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff100359b80 10 client.15507 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:40.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff100359b80 1 -- 172.21.15.8:0/1889870277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5634a63a5de0 con 0x5634a6628260 2023-10-06T23:13:40.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.652+0000 7ff0cdffb700 1 -- 172.21.15.8:0/1889870277 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d809e250 con 0x5634a6628260 2023-10-06T23:13:40.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.653+0000 7ff0cdffb700 1 -- 172.21.15.8:0/1889870277 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff0d80991d0 con 0x5634a6628260 2023-10-06T23:13:40.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.653+0000 7ff100359b80 10 client.15507 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:40.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.653+0000 7ff100359b80 10 client.15507 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-06T23:13:40.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.653+0000 7ff100359b80 20 client.15507 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:40.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.653+0000 7ff100359b80 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x5634a6691f00 0x5634a66942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.653+0000 7ff100359b80 4 client.15507 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-06T23:13:40.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.653+0000 7ff100359b80 1 -- 172.21.15.8:0/1889870277 --> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5634a6573b30 con 0x5634a6691f00 2023-10-06T23:13:40.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.653+0000 7ff0e5d9b700 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x5634a6691f00 0x5634a66942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.664 INFO:teuthology.orchestra.run.smithi008.stderr:300000 of 3200000 tuples (9%) done (elapsed 4.12 s, remaining 39.83 s) 2023-10-06T23:13:40.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.654+0000 7ff0e5d9b700 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x5634a6691f00 0x5634a66942f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3dd2efa4cf9b7769 server_cookie=27072c2bf3af7e0 in_seq=0 out_seq=0 2023-10-06T23:13:40.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.654+0000 7ff0cdffb700 10 client.15507 ms_handle_connect on v2:172.21.15.190:6838/730533990 2023-10-06T23:13:40.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.654+0000 7ff0cdffb700 1 -- 172.21.15.8:0/1889870277 <== mds.1 v2:172.21.15.190:6838/730533990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5634a6573b30 con 0x5634a6691f00 2023-10-06T23:13:40.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.654+0000 7ff0cdffb700 10 client.15507 handle_command_reply: tid=0 2023-10-06T23:13:40.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.654+0000 7ff100359b80 1 client.15507 shutdown 2023-10-06T23:13:40.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 -- 172.21.15.8:0/1889870277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 msgr2=0x5634a6636aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6636aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8099db0 tx=0x7ff0d80a2520 comp rx=0 tx=0).stop 2023-10-06T23:13:40.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 -- 172.21.15.8:0/1889870277 shutdown_connections 2023-10-06T23:13:40.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.190:6838/730533990,v1:172.21.15.190:6839/730533990] conn(0x5634a6691f00 0x5634a66942f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5634a6628260 0x5634a6636aa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5634a6629a60 0x5634a6637ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff0cdffb700 0 client.15507 ms_handle_reset on v2:172.21.15.190:6838/730533990 2023-10-06T23:13:40.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 --2- 172.21.15.8:0/1889870277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5634a6628bc0 0x5634a6636fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 -- 172.21.15.8:0/1889870277 >> 172.21.15.8:0/1889870277 conn(0x5634a659c260 msgr2=0x5634a6639e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 -- 172.21.15.8:0/1889870277 shutdown_connections 2023-10-06T23:13:40.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 1 -- 172.21.15.8:0/1889870277 wait complete. 2023-10-06T23:13:40.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.655+0000 7ff100359b80 20 client.15507 trim_cache size 0 max 16384 2023-10-06T23:13:40.669 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-06T23:13:40.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0d00a1500 msgr2=0x7ff0d00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0d00a1500 0x7ff0d00a39c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006010 tx=0x7ff0dc00b260 comp rx=0 tx=0).stop 2023-10-06T23:13:40.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80ff770 msgr2=0x7ff0e8198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80ff770 0x7ff0e8198d20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800e9a0 tx=0x7ff0d800ed60 comp rx=0 tx=0).stop 2023-10-06T23:13:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/2910142649 shutdown_connections 2023-10-06T23:13:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0d00a1500 0x7ff0d00a39c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0e80ff770 0x7ff0e8198d20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e8100a90 0x7ff0e81a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 --2- 172.21.15.8:0/2910142649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0e81000d0 0x7ff0e8199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/2910142649 >> 172.21.15.8:0/2910142649 conn(0x7ff0e80fb330 msgr2=0x7ff0e80fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.656+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/2910142649 shutdown_connections 2023-10-06T23:13:40.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.657+0000 7ff0ec9ff700 1 -- 172.21.15.8:0/2910142649 wait complete. 2023-10-06T23:13:40.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-06T23:13:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.918+0000 7fc8aafff700 1 -- 172.21.15.8:0/3518678813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 msgr2=0x7fc8a4109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.918+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3518678813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 0x7fc8a4109090 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009f90 tx=0x7fc89c00b330 comp rx=0 tx=0).stop 2023-10-06T23:13:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.918+0000 7fc8aafff700 1 -- 172.21.15.8:0/3518678813 shutdown_connections 2023-10-06T23:13:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.918+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3518678813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 0x7fc8a4109090 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.918+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3518678813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8a41019c0 0x7fc8a4103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.918+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3518678813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a41042f0 0x7fc8a41066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.918+0000 7fc8aafff700 1 -- 172.21.15.8:0/3518678813 >> 172.21.15.8:0/3518678813 conn(0x7fc8a40fb3b0 msgr2=0x7fc8a40fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.919+0000 7fc8aafff700 1 -- 172.21.15.8:0/3518678813 shutdown_connections 2023-10-06T23:13:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.919+0000 7fc8aafff700 1 -- 172.21.15.8:0/3518678813 wait complete. 2023-10-06T23:13:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.920+0000 7fc8aafff700 1 Processor -- start 2023-10-06T23:13:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.920+0000 7fc8aafff700 1 -- start start 2023-10-06T23:13:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.920+0000 7fc8aafff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8a41019c0 0x7fc8a4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8aafff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a41042f0 0x7fc8a41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8aafff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 0x7fc8a41a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8aafff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a41a0930 con 0x7fc8a4106c20 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8aafff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a41a0a70 con 0x7fc8a41042f0 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8aafff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a41a0c00 con 0x7fc8a41019c0 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a959c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 0x7fc8a41a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a41042f0 0x7fc8a41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a41042f0 0x7fc8a41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33846/0 (socket says 172.21.15.8:33846) 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a959c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 0x7fc8a41a0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45654/0 (socket says 172.21.15.8:45654) 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a3fff700 1 -- 172.21.15.8:0/3573563411 learned_addr learned my addr 172.21.15.8:0/3573563411 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8a41019c0 0x7fc8a4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a959c700 1 -- 172.21.15.8:0/3573563411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8a41019c0 msgr2=0x7fc8a4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a959c700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8a41019c0 0x7fc8a4198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a959c700 1 -- 172.21.15.8:0/3573563411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a41042f0 msgr2=0x7fc8a41992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a959c700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a41042f0 0x7fc8a41992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.921+0000 7fc8a959c700 1 -- 172.21.15.8:0/3573563411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980095f0 con 0x7fc8a4106c20 2023-10-06T23:13:40.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.922+0000 7fc8a959c700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 0x7fc8a41a0360 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00d010 tx=0x7fc89c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.922+0000 7fc8a1ffb700 1 -- 172.21.15.8:0/3573563411 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c00e040 con 0x7fc8a4106c20 2023-10-06T23:13:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.922+0000 7fc8a1ffb700 1 -- 172.21.15.8:0/3573563411 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc89c004e80 con 0x7fc8a4106c20 2023-10-06T23:13:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.922+0000 7fc8aafff700 1 -- 172.21.15.8:0/3573563411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c009c40 con 0x7fc8a4106c20 2023-10-06T23:13:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.922+0000 7fc8a1ffb700 1 -- 172.21.15.8:0/3573563411 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c01b6b0 con 0x7fc8a4106c20 2023-10-06T23:13:40.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.922+0000 7fc8aafff700 1 -- 172.21.15.8:0/3573563411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a41a1170 con 0x7fc8a4106c20 2023-10-06T23:13:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.927+0000 7fc8a1ffb700 1 -- 172.21.15.8:0/3573563411 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc89c01d480 con 0x7fc8a4106c20 2023-10-06T23:13:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.928+0000 7fc8be93db80 1 Processor -- start 2023-10-06T23:13:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8be93db80 1 -- start start 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf84680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8a1ffb700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc8940a1480 0x7fc8940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf85480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf85ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8be93db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaeec460 con 0x55a3aaf84260 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8be93db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaeddc20 con 0x55a3aaf84bc0 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8be93db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaedb540 con 0x55a3aaf85a60 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8a1ffb700 1 -- 172.21.15.8:0/3573563411 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc89c0cde70 con 0x7fc8a4106c20 2023-10-06T23:13:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.929+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf84680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf84680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45670/0 (socket says 172.21.15.8:45670) 2023-10-06T23:13:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 -- 172.21.15.8:0/4196313807 learned_addr learned my addr 172.21.15.8:0/4196313807 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a959c700 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf85ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf85480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc8940a1480 0x7fc8940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 -- 172.21.15.8:0/4196313807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 msgr2=0x55a3aaf85ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf85ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 -- 172.21.15.8:0/4196313807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84bc0 msgr2=0x55a3aaf85480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf85480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 -- 172.21.15.8:0/4196313807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3aad01de0 con 0x55a3aaf84260 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.930+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf84680 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc890009e80 tx=0x7fc8900099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb318e64585f6ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.931+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc8940a1480 0x7fc8940a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc898005fd0 tx=0x7fc898009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.931+0000 7fc88effd700 1 -- 172.21.15.8:0/4196313807 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890021960 con 0x55a3aaf84260 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.931+0000 7fc88effd700 1 -- 172.21.15.8:0/4196313807 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc890010430 con 0x55a3aaf84260 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.931+0000 7fc88effd700 1 -- 172.21.15.8:0/4196313807 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89000e610 con 0x55a3aaf84260 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 -- 172.21.15.8:0/4196313807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 msgr2=0x55a3aaf84680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf84680 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc890009e80 tx=0x7fc8900099e0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 -- 172.21.15.8:0/4196313807 shutdown_connections 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf84680 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf85ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 --2- 172.21.15.8:0/4196313807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf85480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 -- 172.21.15.8:0/4196313807 >> 172.21.15.8:0/4196313807 conn(0x55a3aaef8260 msgr2=0x55a3aaf7f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 -- 172.21.15.8:0/4196313807 shutdown_connections 2023-10-06T23:13:40.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 -- 172.21.15.8:0/4196313807 wait complete. 2023-10-06T23:13:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.932+0000 7fc8be93db80 1 -- start start 2023-10-06T23:13:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8be93db80 1 Processor -- start 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf8e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf8e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf955e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8be93db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaed6e30 con 0x55a3aaf84260 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8be93db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aae73710 con 0x55a3aaf85a60 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8be93db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aae733b0 con 0x55a3aaf84bc0 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8be93db80 10 client.0 _ll_register_callbacks cb 0x55a3aacd0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.933+0000 7fc8a8d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf8e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a8d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf8e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45678/0 (socket says 172.21.15.8:45678) 2023-10-06T23:13:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a8d9b700 1 -- 172.21.15.8:0/2415616109 learned_addr learned my addr 172.21.15.8:0/2415616109 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf8e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a959c700 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a8d9b700 1 -- 172.21.15.8:0/2415616109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84bc0 msgr2=0x55a3aaf8e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf8e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a8d9b700 1 -- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 msgr2=0x55a3aaf955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a8d9b700 1 -- 172.21.15.8:0/2415616109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc890013460 con 0x55a3aaf84260 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a959c700 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.934+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf8e060 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc898009a60 tx=0x7fc8980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79df7c40973341f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.935+0000 7fc883fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:40.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.935+0000 7fc883fff700 1 -- 172.21.15.8:0/2415616109 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89801c9b0 con 0x55a3aaf84260 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.935+0000 7fc8be93db80 1 -- 172.21.15.8:0/2415616109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3aaf76f10 con 0x55a3aaf84260 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.935+0000 7fc883fff700 1 -- 172.21.15.8:0/2415616109 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc898023070 con 0x55a3aaf84260 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.935+0000 7fc883fff700 1 -- 172.21.15.8:0/2415616109 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc89802e030 con 0x55a3aaf84260 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.935+0000 7fc8be93db80 10 client.15519 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.935+0000 7fc8be93db80 1 -- 172.21.15.8:0/2415616109 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a3aaceac60 con 0x55a3aaf84260 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.935+0000 7fc883fff700 1 -- 172.21.15.8:0/2415616109 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a3aaf76f10 con 0x55a3aaf84260 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.936+0000 7fc883fff700 1 -- 172.21.15.8:0/2415616109 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc898028d10 con 0x55a3aaf84260 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.936+0000 7fc8be93db80 10 client.15519 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.936+0000 7fc8be93db80 10 client.15519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.936+0000 7fc8be93db80 20 client.15519 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:40.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.936+0000 7fc8be93db80 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a3aaf99ef0 0x55a3aaf9c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.936+0000 7fc8be93db80 4 client.15519 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:40.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.936+0000 7fc8be93db80 1 -- 172.21.15.8:0/2415616109 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3aaecfe10 con 0x55a3aaf99ef0 2023-10-06T23:13:40.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.936+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a3aaf99ef0 0x55a3aaf9c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.937+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a3aaf99ef0 0x55a3aaf9c310 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64638bfc756a5bb5 server_cookie=4b9d80c0746b0d4e in_seq=0 out_seq=0 2023-10-06T23:13:40.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.937+0000 7fc883fff700 10 client.15519 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:40.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc883fff700 1 -- 172.21.15.8:0/2415616109 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a3aaecfe10 con 0x55a3aaf99ef0 2023-10-06T23:13:40.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc883fff700 10 client.15519 handle_command_reply: tid=0 2023-10-06T23:13:40.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 client.15519 shutdown 2023-10-06T23:13:40.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 -- 172.21.15.8:0/2415616109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 msgr2=0x55a3aaf8e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf8e060 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc898009a60 tx=0x7fc8980047c0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 -- 172.21.15.8:0/2415616109 shutdown_connections 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a3aaf99ef0 0x55a3aaf9c310 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84260 0x55a3aaf8e060 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc883fff700 0 client.15519 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 --2- 172.21.15.8:0/2415616109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf8e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 -- 172.21.15.8:0/2415616109 >> 172.21.15.8:0/2415616109 conn(0x55a3aaef8260 msgr2=0x55a3aaf7ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 -- 172.21.15.8:0/2415616109 shutdown_connections 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.938+0000 7fc8be93db80 1 -- 172.21.15.8:0/2415616109 wait complete. 2023-10-06T23:13:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.939+0000 7fc8be93db80 20 client.15519 trim_cache size 0 max 16384 2023-10-06T23:13:40.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.955+0000 7fc8be93db80 1 Processor -- start 2023-10-06T23:13:40.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.955+0000 7fc8be93db80 1 -- start start 2023-10-06T23:13:40.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.955+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84260 0x55a3aaf84640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.955+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf955a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.955+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf7dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.955+0000 7fc8be93db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aad57920 con 0x55a3aaf84bc0 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.955+0000 7fc8be93db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaf7e100 con 0x55a3aaf84260 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.955+0000 7fc8be93db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaf895b0 con 0x55a3aaf85a60 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45690/0 (socket says 172.21.15.8:45690) 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 -- 172.21.15.8:0/13695953 learned_addr learned my addr 172.21.15.8:0/13695953 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84260 0x55a3aaf84640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a959c700 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf7dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 -- 172.21.15.8:0/13695953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 msgr2=0x55a3aaf7dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf7dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 -- 172.21.15.8:0/13695953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84260 msgr2=0x55a3aaf84640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84260 0x55a3aaf84640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 -- 172.21.15.8:0/13695953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3aad28250 con 0x55a3aaf84bc0 2023-10-06T23:13:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a959c700 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf7dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:40.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.956+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf955a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc890016010 tx=0x7fc890013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f1ac1378ec7eee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.957+0000 7fc88f7fe700 1 -- 172.21.15.8:0/13695953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890010ea0 con 0x55a3aaf84bc0 2023-10-06T23:13:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.957+0000 7fc88f7fe700 1 -- 172.21.15.8:0/13695953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc890010b60 con 0x55a3aaf84bc0 2023-10-06T23:13:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.957+0000 7fc88f7fe700 1 -- 172.21.15.8:0/13695953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89002f3f0 con 0x55a3aaf84bc0 2023-10-06T23:13:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 -- 172.21.15.8:0/13695953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 msgr2=0x55a3aaf955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf955a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc890016010 tx=0x7fc890013680 comp rx=0 tx=0).stop 2023-10-06T23:13:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 -- 172.21.15.8:0/13695953 shutdown_connections 2023-10-06T23:13:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf85a60 0x55a3aaf7dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf84260 0x55a3aaf84640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 --2- 172.21.15.8:0/13695953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf955a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 -- 172.21.15.8:0/13695953 >> 172.21.15.8:0/13695953 conn(0x55a3aaef8260 msgr2=0x55a3aafa0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 -- 172.21.15.8:0/13695953 shutdown_connections 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 -- 172.21.15.8:0/13695953 wait complete. 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 -- start start 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.958+0000 7fc8be93db80 1 Processor -- start 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84260 0x55a3aaf93370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8be93db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf948c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8be93db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaf94e00 con 0x55a3aaf84bc0 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8be93db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaf94f70 con 0x55a3aaf85a60 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8be93db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3aaf95130 con 0x55a3aaf84260 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8be93db80 10 client.0 _ll_register_callbacks cb 0x7fc89800e900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf938b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45698/0 (socket says 172.21.15.8:45698) 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.959+0000 7fc8a3fff700 1 -- 172.21.15.8:0/908986471 learned_addr learned my addr 172.21.15.8:0/908986471 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84260 0x55a3aaf93370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a959c700 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a3fff700 1 -- 172.21.15.8:0/908986471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84260 msgr2=0x55a3aaf93370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84260 0x55a3aaf93370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a3fff700 1 -- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 msgr2=0x55a3aaf948c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf948c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a3fff700 1 -- 172.21.15.8:0/908986471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3aad01de0 con 0x55a3aaf84bc0 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a959c700 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc8a3fff700 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf938b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc890001eb0 tx=0x7fc8900095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b138e9095d1c16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc883fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.960+0000 7fc883fff700 1 -- 172.21.15.8:0/908986471 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89002fcd0 con 0x55a3aaf84bc0 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc8be93db80 1 -- 172.21.15.8:0/908986471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc890010430 con 0x55a3aaf84bc0 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc883fff700 1 -- 172.21.15.8:0/908986471 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc89002fe30 con 0x55a3aaf84bc0 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc883fff700 1 -- 172.21.15.8:0/908986471 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc89002f190 con 0x55a3aaf84bc0 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc8be93db80 10 client.15525 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc8be93db80 1 -- 172.21.15.8:0/908986471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a3aad002b0 con 0x55a3aaf84bc0 2023-10-06T23:13:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc883fff700 1 -- 172.21.15.8:0/908986471 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc89004a020 con 0x55a3aaf84bc0 2023-10-06T23:13:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc883fff700 1 -- 172.21.15.8:0/908986471 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc890005040 con 0x55a3aaf84bc0 2023-10-06T23:13:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc8be93db80 10 client.15525 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc8be93db80 10 client.15525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc8be93db80 20 client.15525 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.961+0000 7fc8be93db80 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a3aafee8c0 0x55a3aaff0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.962+0000 7fc8be93db80 4 client.15525 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.962+0000 7fc8be93db80 1 -- 172.21.15.8:0/908986471 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a3aaecfb30 con 0x55a3aafee8c0 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.962+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a3aafee8c0 0x55a3aaff0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc883fff700 10 client.15525 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8a8d9b700 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a3aafee8c0 0x55a3aaff0cb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368707185baa51d0 server_cookie=df30f4b391624d76 in_seq=0 out_seq=0 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc883fff700 1 -- 172.21.15.8:0/908986471 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a3aaecfb30 con 0x55a3aafee8c0 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc883fff700 10 client.15525 handle_command_reply: tid=0 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 client.15525 shutdown 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 -- 172.21.15.8:0/908986471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 msgr2=0x55a3aaf938b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf938b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc890001eb0 tx=0x7fc8900095c0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 -- 172.21.15.8:0/908986471 shutdown_connections 2023-10-06T23:13:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a3aafee8c0 0x55a3aaff0cb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a3aaf85a60 0x55a3aaf948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a3aaf84260 0x55a3aaf93370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc883fff700 0 client.15525 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 --2- 172.21.15.8:0/908986471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a3aaf84bc0 0x55a3aaf938b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 -- 172.21.15.8:0/908986471 >> 172.21.15.8:0/908986471 conn(0x55a3aaef8260 msgr2=0x55a3aaf8ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 -- 172.21.15.8:0/908986471 shutdown_connections 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.963+0000 7fc8be93db80 1 -- 172.21.15.8:0/908986471 wait complete. 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8be93db80 20 client.15525 trim_cache size 0 max 16384 2023-10-06T23:13:40.969 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-06T23:13:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 -- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc8940a1480 msgr2=0x7fc8940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc8940a1480 0x7fc8940a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc898005fd0 tx=0x7fc898009310 comp rx=0 tx=0).stop 2023-10-06T23:13:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 -- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 msgr2=0x7fc8a41a0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 0x7fc8a41a0360 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00d010 tx=0x7fc89c00bc20 comp rx=0 tx=0).stop 2023-10-06T23:13:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 -- 172.21.15.8:0/3573563411 shutdown_connections 2023-10-06T23:13:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc8940a1480 0x7fc8940a3940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8a4106c20 0x7fc8a41a0360 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8a41019c0 0x7fc8a4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 --2- 172.21.15.8:0/3573563411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8a41042f0 0x7fc8a41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.964+0000 7fc8aafff700 1 -- 172.21.15.8:0/3573563411 >> 172.21.15.8:0/3573563411 conn(0x7fc8a40fb3b0 msgr2=0x7fc8a4100020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.965+0000 7fc8aafff700 1 -- 172.21.15.8:0/3573563411 shutdown_connections 2023-10-06T23:13:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:40.965+0000 7fc8aafff700 1 -- 172.21.15.8:0/3573563411 wait complete. 2023-10-06T23:13:41.985 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-06T23:13:41.985 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-06T23:13:42.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2734972299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88100ea0 msgr2=0x7f3f881012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2734972299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88100ea0 0x7f3f881012c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009990 tx=0x7f3f84009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2734972299 shutdown_connections 2023-10-06T23:13:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2734972299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88100ea0 0x7f3f881012c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2734972299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f88102a40 0x7f3f88109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2734972299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f88102080 0x7f3f88102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2734972299 >> 172.21.15.8:0/2734972299 conn(0x7f3f880fc460 msgr2=0x7f3f880fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2734972299 shutdown_connections 2023-10-06T23:13:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.229+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2734972299 wait complete. 2023-10-06T23:13:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.230+0000 7f3f8fbff700 1 Processor -- start 2023-10-06T23:13:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.230+0000 7f3f8fbff700 1 -- start start 2023-10-06T23:13:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8fbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f88100ea0 0x7f3f88198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8fbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88102080 0x7f3f88199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8fbff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f88102a40 0x7f3f881a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8fbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f881a0850 con 0x7f3f88102080 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8fbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f881a09c0 con 0x7f3f88100ea0 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8fbff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f881a0b80 con 0x7f3f88102a40 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88102080 0x7f3f88199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88102080 0x7f3f88199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45704/0 (socket says 172.21.15.8:45704) 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8d19a700 1 -- 172.21.15.8:0/2301039019 learned_addr learned my addr 172.21.15.8:0/2301039019 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f88100ea0 0x7f3f88198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.231+0000 7f3f8e19c700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f88102a40 0x7f3f881a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f8d19a700 1 -- 172.21.15.8:0/2301039019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f88102a40 msgr2=0x7f3f881a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f88102a40 0x7f3f881a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f8d19a700 1 -- 172.21.15.8:0/2301039019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f88100ea0 msgr2=0x7f3f88198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f88100ea0 0x7f3f88198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f8d19a700 1 -- 172.21.15.8:0/2301039019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840095f0 con 0x7f3f88102080 2023-10-06T23:13:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88102080 0x7f3f88199250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800d980 tx=0x7f3f7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f7effd700 1 -- 172.21.15.8:0/2301039019 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78004020 con 0x7f3f88102080 2023-10-06T23:13:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2301039019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f881a0e60 con 0x7f3f88102080 2023-10-06T23:13:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f7effd700 1 -- 172.21.15.8:0/2301039019 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f7800f690 con 0x7f3f88102080 2023-10-06T23:13:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f7effd700 1 -- 172.21.15.8:0/2301039019 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780039e0 con 0x7f3f88102080 2023-10-06T23:13:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.232+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2301039019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f881a1280 con 0x7f3f88102080 2023-10-06T23:13:42.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.236+0000 7f3f7effd700 1 -- 172.21.15.8:0/2301039019 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3f7800f800 con 0x7f3f88102080 2023-10-06T23:13:42.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.237+0000 7f3fa34f3b80 1 Processor -- start 2023-10-06T23:13:42.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3fa34f3b80 1 -- start start 2023-10-06T23:13:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3f7effd700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3f740a1480 0x7f3f740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3f7effd700 1 -- 172.21.15.8:0/2301039019 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f780cc900 con 0x7f3f88102080 2023-10-06T23:13:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3e2e0 0x555f93a3e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a3f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a3ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f939a64e0 con 0x555f93a3fae0 2023-10-06T23:13:42.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3f8e19c700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3f740a1480 0x7f3f740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f93997ca0 con 0x555f93a3e2e0 2023-10-06T23:13:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f939955c0 con 0x555f93a3ec40 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3f8e19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a3ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3f8d19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a3f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3f8e19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a3ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45710/0 (socket says 172.21.15.8:45710) 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.238+0000 7f3f8e19c700 1 -- 172.21.15.8:0/4239966105 learned_addr learned my addr 172.21.15.8:0/4239966105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/4239966105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3e2e0 0x555f93a3e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f8d19a700 1 -- 172.21.15.8:0/4239966105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3e2e0 msgr2=0x555f93a3e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/4239966105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3e2e0 0x555f93a3e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f8d19a700 1 -- 172.21.15.8:0/4239966105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 msgr2=0x555f93a3ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/4239966105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a3ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f8d19a700 1 -- 172.21.15.8:0/4239966105 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f937bbe60 con 0x555f93a3ec40 2023-10-06T23:13:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f8e19c700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3f740a1480 0x7f3f740a3940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f80014e30 tx=0x7f3f80014430 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/4239966105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a3f500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f780ca3b0 tx=0x7f3f78099790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=652e6697fdeb1ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f73fff700 1 -- 172.21.15.8:0/4239966105 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780232f0 con 0x555f93a3ec40 2023-10-06T23:13:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f73fff700 1 -- 172.21.15.8:0/4239966105 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f7809a2d0 con 0x555f93a3ec40 2023-10-06T23:13:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.239+0000 7f3f73fff700 1 -- 172.21.15.8:0/4239966105 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780990c0 con 0x555f93a3ec40 2023-10-06T23:13:42.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/4239966105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 msgr2=0x555f93a3f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/4239966105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a3f500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f780ca3b0 tx=0x7f3f78099790 comp rx=0 tx=0).stop 2023-10-06T23:13:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/4239966105 shutdown_connections 2023-10-06T23:13:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/4239966105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a3ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/4239966105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3e2e0 0x555f93a3e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/4239966105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a3f500 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/4239966105 >> 172.21.15.8:0/4239966105 conn(0x555f939b22e0 msgr2=0x555f93a391c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/4239966105 shutdown_connections 2023-10-06T23:13:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.240+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/4239966105 wait complete. 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.241+0000 7f3fa34f3b80 1 -- start start 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.241+0000 7f3fa34f3b80 1 Processor -- start 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3e2e0 0x555f93a480c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a48600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a4f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f93990eb0 con 0x555f93a3fae0 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f9392d790 con 0x555f93a3ec40 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f9392d430 con 0x555f93a3e2e0 2023-10-06T23:13:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3fa34f3b80 10 client.0 _ll_register_callbacks cb 0x555f9378a880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3f8d99b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3e2e0 0x555f93a480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3f8d99b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3e2e0 0x555f93a480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38070/0 (socket says 172.21.15.8:38070) 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3f8d99b700 1 -- 172.21.15.8:0/1283613503 learned_addr learned my addr 172.21.15.8:0/1283613503 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3f8e19c700 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a4f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.242+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a48600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f8e19c700 1 -- 172.21.15.8:0/1283613503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3e2e0 msgr2=0x555f93a480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f8e19c700 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3e2e0 0x555f93a480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f8e19c700 1 -- 172.21.15.8:0/1283613503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 msgr2=0x555f93a48600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f8e19c700 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a48600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f8e19c700 1 -- 172.21.15.8:0/1283613503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f881a1280 con 0x555f93a3fae0 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3e2e0 0x555f93a480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f8e19c700 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a4f640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x555f93a3f2c0 tx=0x7f3f8001b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fcbe9f109dd289 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f717fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:42.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f717fa700 1 -- 172.21.15.8:0/1283613503 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80029070 con 0x555f93a3fae0 2023-10-06T23:13:42.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/1283613503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f93a30f90 con 0x555f93a3fae0 2023-10-06T23:13:42.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.243+0000 7f3f717fa700 1 -- 172.21.15.8:0/1283613503 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f8001f040 con 0x555f93a3fae0 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3f717fa700 1 -- 172.21.15.8:0/1283613503 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f80007ca0 con 0x555f93a3fae0 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3fa34f3b80 10 client.15537 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/1283613503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555f937a4ce0 con 0x555f93a3fae0 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3f717fa700 1 -- 172.21.15.8:0/1283613503 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f93a30f90 con 0x555f93a3fae0 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3f717fa700 1 -- 172.21.15.8:0/1283613503 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3f8002c030 con 0x555f93a3fae0 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3fa34f3b80 10 client.15537 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3fa34f3b80 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3fa34f3b80 20 client.15537 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555f93a53f10 0x555f93a56330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3fa34f3b80 4 client.15537 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.244+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/1283613503 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f93989e90 con 0x555f93a53f10 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.245+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555f93a53f10 0x555f93a56330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.245+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555f93a53f10 0x555f93a56330 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d90d52200ee38c61 server_cookie=81e37ad4f39e8fc in_seq=0 out_seq=0 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.245+0000 7f3f717fa700 10 client.15537 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.246+0000 7f3f717fa700 1 -- 172.21.15.8:0/1283613503 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555f93989e90 con 0x555f93a53f10 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.246+0000 7f3f717fa700 10 client.15537 handle_command_reply: tid=0 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.246+0000 7f3fa34f3b80 1 client.15537 shutdown 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/1283613503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 msgr2=0x555f93a4f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a4f640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x555f93a3f2c0 tx=0x7f3f8001b070 comp rx=0 tx=0).stop 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/1283613503 shutdown_connections 2023-10-06T23:13:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555f93a53f10 0x555f93a56330 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3fae0 0x555f93a4f640 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3e2e0 0x555f93a480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/1283613503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a48600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/1283613503 >> 172.21.15.8:0/1283613503 conn(0x555f939b22e0 msgr2=0x555f93a38fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3f717fa700 0 client.15537 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/1283613503 shutdown_connections 2023-10-06T23:13:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/1283613503 wait complete. 2023-10-06T23:13:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.247+0000 7f3fa34f3b80 20 client.15537 trim_cache size 0 max 16384 2023-10-06T23:13:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.268+0000 7f3fa34f3b80 1 Processor -- start 2023-10-06T23:13:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.268+0000 7f3fa34f3b80 1 -- start start 2023-10-06T23:13:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.268+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a48080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.268+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3fae0 0x555f93a4f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f938119a0 con 0x555f93a3e2e0 2023-10-06T23:13:42.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f93a3a320 con 0x555f93a3ec40 2023-10-06T23:13:42.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f93a3f020 con 0x555f93a3fae0 2023-10-06T23:13:42.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3f8d19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3f8e19c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3fae0 0x555f93a4f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3f8d19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33926/0 (socket says 172.21.15.8:33926) 2023-10-06T23:13:42.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3f8d19a700 1 -- 172.21.15.8:0/3763690429 learned_addr learned my addr 172.21.15.8:0/3763690429 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.269+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a48080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f8d19a700 1 -- 172.21.15.8:0/3763690429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3fae0 msgr2=0x555f93a4f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3fae0 0x555f93a4f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f8d19a700 1 -- 172.21.15.8:0/3763690429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 msgr2=0x555f93a48080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a48080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f8d19a700 1 -- 172.21.15.8:0/3763690429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f937e22d0 con 0x555f93a3ec40 2023-10-06T23:13:42.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a48080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:42.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a485c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3f78099880 tx=0x7f3f7809a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b0d47993d7bb347 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f7cbff700 1 -- 172.21.15.8:0/3763690429 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780232f0 con 0x555f93a3ec40 2023-10-06T23:13:42.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f7cbff700 1 -- 172.21.15.8:0/3763690429 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f78099bd0 con 0x555f93a3ec40 2023-10-06T23:13:42.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.270+0000 7f3f7cbff700 1 -- 172.21.15.8:0/3763690429 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780990c0 con 0x555f93a3ec40 2023-10-06T23:13:42.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.271+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/3763690429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 msgr2=0x555f93a485c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.271+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a485c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3f78099880 tx=0x7f3f7809a440 comp rx=0 tx=0).stop 2023-10-06T23:13:42.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.271+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/3763690429 shutdown_connections 2023-10-06T23:13:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.271+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a48080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.271+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3fae0 0x555f93a4f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.271+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/3763690429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3ec40 0x555f93a485c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.271+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/3763690429 >> 172.21.15.8:0/3763690429 conn(0x555f939b22e0 msgr2=0x555f93a46d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.272+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/3763690429 shutdown_connections 2023-10-06T23:13:42.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.272+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/3763690429 wait complete. 2023-10-06T23:13:42.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.272+0000 7f3fa34f3b80 1 -- start start 2023-10-06T23:13:42.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3fa34f3b80 1 Processor -- start 2023-10-06T23:13:42.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a4ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a4e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3fa34f3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3fae0 0x555f93a4e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f93a4fa40 con 0x555f93a3e2e0 2023-10-06T23:13:42.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f93ab0560 con 0x555f93a3fae0 2023-10-06T23:13:42.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3fa34f3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f93ab06a0 con 0x555f93a3ec40 2023-10-06T23:13:42.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3fa34f3b80 10 client.0 _ll_register_callbacks cb 0x555f9378a880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:42.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.273+0000 7f3f8d19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a4e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a4ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8d19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a4e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38088/0 (socket says 172.21.15.8:38088) 2023-10-06T23:13:42.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8d19a700 1 -- 172.21.15.8:0/2056581898 learned_addr learned my addr 172.21.15.8:0/2056581898 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8e19c700 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3fae0 0x555f93a4e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8d19a700 1 -- 172.21.15.8:0/2056581898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3fae0 msgr2=0x555f93a4e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3fae0 0x555f93a4e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8d19a700 1 -- 172.21.15.8:0/2056581898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 msgr2=0x555f93a4ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a4ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.274+0000 7f3f8d19a700 1 -- 172.21.15.8:0/2056581898 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f937bbe60 con 0x555f93a3ec40 2023-10-06T23:13:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.275+0000 7f3f8d19a700 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a4e300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f78004820 tx=0x7f3f7800fe70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786fffbba03ee421 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.275+0000 7f3f717fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:13:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.276+0000 7f3f717fa700 1 -- 172.21.15.8:0/2056581898 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780992c0 con 0x555f93a3ec40 2023-10-06T23:13:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.276+0000 7f3f717fa700 1 -- 172.21.15.8:0/2056581898 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f7809dd20 con 0x555f93a3ec40 2023-10-06T23:13:42.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.276+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/2056581898 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f7809a2d0 con 0x555f93a3ec40 2023-10-06T23:13:42.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.280+0000 7f3f717fa700 1 -- 172.21.15.8:0/2056581898 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f780a1f60 con 0x555f93a3ec40 2023-10-06T23:13:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.280+0000 7f3fa34f3b80 10 client.25369 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.280+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/2056581898 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555f937ba330 con 0x555f93a3ec40 2023-10-06T23:13:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.280+0000 7f3f717fa700 1 -- 172.21.15.8:0/2056581898 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f7809a2d0 con 0x555f93a3ec40 2023-10-06T23:13:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.280+0000 7f3f717fa700 1 -- 172.21.15.8:0/2056581898 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3f78003b40 con 0x555f93a3ec40 2023-10-06T23:13:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.281+0000 7f3fa34f3b80 10 client.25369 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.281+0000 7f3fa34f3b80 10 client.25369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.281+0000 7f3fa34f3b80 20 client.25369 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:42.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.281+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555f93ab1c80 0x555f93ab40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.281+0000 7f3fa34f3b80 4 client.25369 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-06T23:13:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.281+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/2056581898 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555f93989bb0 con 0x555f93ab1c80 2023-10-06T23:13:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.281+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555f93ab1c80 0x555f93ab40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.282+0000 7f3f8d99b700 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555f93ab1c80 0x555f93ab40a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d23ae380eabe6 server_cookie=922e93f917319277 in_seq=0 out_seq=0 2023-10-06T23:13:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.282+0000 7f3f717fa700 10 client.25369 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.283+0000 7f3f717fa700 1 -- 172.21.15.8:0/2056581898 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555f93989bb0 con 0x555f93ab1c80 2023-10-06T23:13:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.283+0000 7f3f717fa700 10 client.25369 handle_command_reply: tid=0 2023-10-06T23:13:42.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.283+0000 7f3fa34f3b80 1 client.25369 shutdown 2023-10-06T23:13:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/2056581898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 msgr2=0x555f93a4e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a4e300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f78004820 tx=0x7f3f7800fe70 comp rx=0 tx=0).stop 2023-10-06T23:13:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/2056581898 shutdown_connections 2023-10-06T23:13:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555f93ab1c80 0x555f93ab40a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f93a3e2e0 0x555f93a4ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555f93a3fae0 0x555f93a4e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3f717fa700 0 client.25369 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 --2- 172.21.15.8:0/2056581898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555f93a3ec40 0x555f93a4e300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/2056581898 >> 172.21.15.8:0/2056581898 conn(0x555f939b22e0 msgr2=0x555f93a42a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/2056581898 shutdown_connections 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 1 -- 172.21.15.8:0/2056581898 wait complete. 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.284+0000 7f3fa34f3b80 20 client.25369 trim_cache size 0 max 16384 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:13:42.288 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-06T23:13:42.289 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:13:42.289 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-06T23:13:42.289 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:13:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3f740a1480 msgr2=0x7f3f740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3f740a1480 0x7f3f740a3940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f80014e30 tx=0x7f3f80014430 comp rx=0 tx=0).stop 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88102080 msgr2=0x7f3f88199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88102080 0x7f3f88199250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800d980 tx=0x7f3f7800dc90 comp rx=0 tx=0).stop 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2301039019 shutdown_connections 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3f740a1480 0x7f3f740a3940 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f88102a40 0x7f3f881a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f88100ea0 0x7f3f88198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 --2- 172.21.15.8:0/2301039019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f88102080 0x7f3f88199250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.285+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2301039019 >> 172.21.15.8:0/2301039019 conn(0x7f3f880fc460 msgr2=0x7f3f880fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.286+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2301039019 shutdown_connections 2023-10-06T23:13:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.286+0000 7f3f8fbff700 1 -- 172.21.15.8:0/2301039019 wait complete. 2023-10-06T23:13:42.304 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:42 smithi008 ceph-mon[98532]: pgmap v374: 97 pgs: 97 active+clean; 71 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.3 MiB/s wr, 183 op/s 2023-10-06T23:13:42.307 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:13:42.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:42 smithi156 ceph-mon[102862]: pgmap v374: 97 pgs: 97 active+clean; 71 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.3 MiB/s wr, 183 op/s 2023-10-06T23:13:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:42 smithi190 ceph-mon[102658]: pgmap v374: 97 pgs: 97 active+clean; 71 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.3 MiB/s wr, 183 op/s 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 -- 172.21.15.8:0/1730790425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 msgr2=0x7f79d010b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 --2- 172.21.15.8:0/1730790425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 0x7f79d010b230 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f79c800b0a0 tx=0x7f79c800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 -- 172.21.15.8:0/1730790425 shutdown_connections 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 --2- 172.21.15.8:0/1730790425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 0x7f79d010b230 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 --2- 172.21.15.8:0/1730790425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d0074ef0 0x7f79d0073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 --2- 172.21.15.8:0/1730790425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0073910 0x7f79d0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 -- 172.21.15.8:0/1730790425 >> 172.21.15.8:0/1730790425 conn(0x7f79d00fc430 msgr2=0x7f79d00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 -- 172.21.15.8:0/1730790425 shutdown_connections 2023-10-06T23:13:42.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.571+0000 7f79d7fff700 1 -- 172.21.15.8:0/1730790425 wait complete. 2023-10-06T23:13:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.572+0000 7f79d7fff700 1 Processor -- start 2023-10-06T23:13:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d7fff700 1 -- start start 2023-10-06T23:13:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d0073910 0x7f79d0198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0074ef0 0x7f79d0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 0x7f79d01a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d01a0960 con 0x7f79d0108da0 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d01a0aa0 con 0x7f79d0073910 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d7fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d01a0c30 con 0x7f79d0074ef0 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d559a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0074ef0 0x7f79d0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 0x7f79d01a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d0073910 0x7f79d0198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d559a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0074ef0 0x7f79d0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38102/0 (socket says 172.21.15.8:38102) 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.573+0000 7f79d559a700 1 -- 172.21.15.8:0/3054892020 learned_addr learned my addr 172.21.15.8:0/3054892020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d559a700 1 -- 172.21.15.8:0/3054892020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d0073910 msgr2=0x7f79d0198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d559a700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d0073910 0x7f79d0198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d559a700 1 -- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 msgr2=0x7f79d01a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d559a700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 0x7f79d01a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d559a700 1 -- 172.21.15.8:0/3054892020 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009d00 con 0x7f79d0074ef0 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d0073910 0x7f79d0198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d659c700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 0x7f79d01a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d559a700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0074ef0 0x7f79d0199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79c000e970 tx=0x7f79c000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79c6ffd700 1 -- 172.21.15.8:0/3054892020 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0009790 con 0x7f79d0074ef0 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.574+0000 7f79d7fff700 1 -- 172.21.15.8:0/3054892020 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d01a0f10 con 0x7f79d0074ef0 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.575+0000 7f79c6ffd700 1 -- 172.21.15.8:0/3054892020 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79c000c7e0 con 0x7f79d0074ef0 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.575+0000 7f79c6ffd700 1 -- 172.21.15.8:0/3054892020 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0003bd0 con 0x7f79d0074ef0 2023-10-06T23:13:42.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.575+0000 7f79d7fff700 1 -- 172.21.15.8:0/3054892020 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d01a13e0 con 0x7f79d0074ef0 2023-10-06T23:13:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.579+0000 7f79c6ffd700 1 -- 172.21.15.8:0/3054892020 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f79c000c950 con 0x7f79d0074ef0 2023-10-06T23:13:42.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.580+0000 7f79eb84bb80 1 Processor -- start 2023-10-06T23:13:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.580+0000 7f79eb84bb80 1 -- start start 2023-10-06T23:13:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79c6ffd700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f79bc0a1480 0x7f79bc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703260 0x55830d703680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d704480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d704ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d66b460 con 0x55830d703bc0 2023-10-06T23:13:42.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d65cc20 con 0x55830d703260 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d65a540 con 0x55830d704a60 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79c6ffd700 1 -- 172.21.15.8:0/3054892020 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f79c0014070 con 0x7f79d0074ef0 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79d559a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d704480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703260 0x55830d703680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703260 0x55830d703680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33960/0 (socket says 172.21.15.8:33960) 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79d5d9b700 1 -- 172.21.15.8:0/3021894187 learned_addr learned my addr 172.21.15.8:0/3021894187 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79d659c700 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d704ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.581+0000 7f79d659c700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f79bc0a1480 0x7f79bc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79d5d9b700 1 -- 172.21.15.8:0/3021894187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 msgr2=0x55830d704ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d704ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79d5d9b700 1 -- 172.21.15.8:0/3021894187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 msgr2=0x55830d704480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d704480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79d5d9b700 1 -- 172.21.15.8:0/3021894187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55830d480de0 con 0x55830d703260 2023-10-06T23:13:42.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79d559a700 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d704480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703260 0x55830d703680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0115f0 tx=0x7f79cc011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f9800b02a4c4fa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79d659c700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f79bc0a1480 0x7f79bc0a3940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f79c800b780 tx=0x7f79c8006210 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.582+0000 7f79bbfff700 1 -- 172.21.15.8:0/3021894187 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc019630 con 0x55830d703260 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79bbfff700 1 -- 172.21.15.8:0/3021894187 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79cc019c20 con 0x55830d703260 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79bbfff700 1 -- 172.21.15.8:0/3021894187 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00eae0 con 0x55830d703260 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3021894187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703260 msgr2=0x55830d703680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703260 0x55830d703680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0115f0 tx=0x7f79cc011900 comp rx=0 tx=0).stop 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3021894187 shutdown_connections 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d704ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703260 0x55830d703680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3021894187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d704480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3021894187 >> 172.21.15.8:0/3021894187 conn(0x55830d677260 msgr2=0x55830d6fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.583+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3021894187 shutdown_connections 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.584+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3021894187 wait complete. 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.584+0000 7f79eb84bb80 1 -- start start 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.584+0000 7f79eb84bb80 1 Processor -- start 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d703260 0x55830d70d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d70d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d704a60 0x55830d7145b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d655e30 con 0x55830d703bc0 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d5f2710 con 0x55830d704a60 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d5f23b0 con 0x55830d703260 2023-10-06T23:13:42.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79eb84bb80 10 client.0 _ll_register_callbacks cb 0x55830d44f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d559a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d70d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d703260 0x55830d70d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d559a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d70d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45784/0 (socket says 172.21.15.8:45784) 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d559a700 1 -- 172.21.15.8:0/3833283452 learned_addr learned my addr 172.21.15.8:0/3833283452 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d659c700 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d704a60 0x55830d7145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d559a700 1 -- 172.21.15.8:0/3833283452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d703260 msgr2=0x55830d70d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d559a700 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d703260 0x55830d70d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d559a700 1 -- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d704a60 msgr2=0x55830d7145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d559a700 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d704a60 0x55830d7145b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d559a700 1 -- 172.21.15.8:0/3833283452 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d01a13e0 con 0x55830d703bc0 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.585+0000 7f79d659c700 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d704a60 0x55830d7145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79d559a700 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d70d570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f79c00966c0 tx=0x7f79c0099ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178b089f739a7668 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79b97fa700 1 -- 172.21.15.8:0/3833283452 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c009e120 con 0x55830d703bc0 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3833283452 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55830d6f5f10 con 0x55830d703bc0 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79b97fa700 1 -- 172.21.15.8:0/3833283452 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f79c009a1c0 con 0x55830d703bc0 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79b97fa700 1 -- 172.21.15.8:0/3833283452 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c009e310 con 0x55830d703bc0 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79eb84bb80 10 client.15555 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3833283452 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f79cc009dd0 con 0x55830d703bc0 2023-10-06T23:13:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.586+0000 7f79b97fa700 1 -- 172.21.15.8:0/3833283452 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79c00b1080 con 0x55830d703bc0 2023-10-06T23:13:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.587+0000 7f79b97fa700 1 -- 172.21.15.8:0/3833283452 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f79c009a420 con 0x55830d703bc0 2023-10-06T23:13:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.587+0000 7f79eb84bb80 10 client.15555 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.587+0000 7f79eb84bb80 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.587+0000 7f79eb84bb80 20 client.15555 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:42.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.587+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55830d718de0 0x55830d71b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.587+0000 7f79eb84bb80 4 client.15555 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.587+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3833283452 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55830d64ee10 con 0x55830d718de0 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.587+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55830d718de0 0x55830d71b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.588+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55830d718de0 0x55830d71b200 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=937b0f311a5ad9fc server_cookie=3aa6abbdbe109e62 in_seq=0 out_seq=0 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.588+0000 7f79b97fa700 10 client.15555 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79b97fa700 1 -- 172.21.15.8:0/3833283452 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55830d64ee10 con 0x55830d718de0 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79b97fa700 10 client.15555 handle_command_reply: tid=0 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79eb84bb80 1 client.15555 shutdown 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3833283452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 msgr2=0x55830d70d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d70d570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f79c00966c0 tx=0x7f79c0099ba0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3833283452 shutdown_connections 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55830d718de0 0x55830d71b200 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d704a60 0x55830d7145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d703260 0x55830d70d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79b97fa700 0 client.15555 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.589+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/3833283452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703bc0 0x55830d70d570 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.590+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3833283452 >> 172.21.15.8:0/3833283452 conn(0x55830d677260 msgr2=0x55830d6fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.590+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3833283452 shutdown_connections 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.590+0000 7f79eb84bb80 1 -- 172.21.15.8:0/3833283452 wait complete. 2023-10-06T23:13:42.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.590+0000 7f79eb84bb80 20 client.15555 trim_cache size 0 max 16384 2023-10-06T23:13:42.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.611+0000 7f79eb84bb80 1 Processor -- start 2023-10-06T23:13:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.611+0000 7f79eb84bb80 1 -- start start 2023-10-06T23:13:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.611+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d70cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.611+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d714570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.611+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d70d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.611+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d4d6920 con 0x55830d703260 2023-10-06T23:13:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.611+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d70c350 con 0x55830d703bc0 2023-10-06T23:13:42.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.611+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d70e220 con 0x55830d704a60 2023-10-06T23:13:42.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d70cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d714570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d714570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33966/0 (socket says 172.21.15.8:33966) 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d70cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45792/0 (socket says 172.21.15.8:45792) 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d559a700 1 -- 172.21.15.8:0/2036490990 learned_addr learned my addr 172.21.15.8:0/2036490990 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d659c700 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d70d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d5d9b700 1 -- 172.21.15.8:0/2036490990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 msgr2=0x55830d70d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d70d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d5d9b700 1 -- 172.21.15.8:0/2036490990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 msgr2=0x55830d714570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d714570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d5d9b700 1 -- 172.21.15.8:0/2036490990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55830d469c60 con 0x55830d703260 2023-10-06T23:13:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.612+0000 7f79d559a700 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d714570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.613+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d70cde0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0115c0 tx=0x7f79cc009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9c672e8e03a20f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.613+0000 7f79c4ff9700 1 -- 172.21.15.8:0/2036490990 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc028ce0 con 0x55830d703260 2023-10-06T23:13:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.613+0000 7f79c4ff9700 1 -- 172.21.15.8:0/2036490990 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79cc00e410 con 0x55830d703260 2023-10-06T23:13:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.613+0000 7f79c4ff9700 1 -- 172.21.15.8:0/2036490990 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc0198c0 con 0x55830d703260 2023-10-06T23:13:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 -- 172.21.15.8:0/2036490990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 msgr2=0x55830d70cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d70cde0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0115c0 tx=0x7f79cc009f60 comp rx=0 tx=0).stop 2023-10-06T23:13:42.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 -- 172.21.15.8:0/2036490990 shutdown_connections 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d70cde0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d70d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/2036490990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d714570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 -- 172.21.15.8:0/2036490990 >> 172.21.15.8:0/2036490990 conn(0x55830d677260 msgr2=0x55830d7079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 -- 172.21.15.8:0/2036490990 shutdown_connections 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 -- 172.21.15.8:0/2036490990 wait complete. 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 -- start start 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.614+0000 7f79eb84bb80 1 Processor -- start 2023-10-06T23:13:42.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d714210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d712820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79eb84bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d712d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d7132a0 con 0x55830d703260 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d713410 con 0x55830d703bc0 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79eb84bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830d7135d0 con 0x55830d704a60 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79eb84bb80 10 client.0 _ll_register_callbacks cb 0x7f79c0099fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d714210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d714210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45800/0 (socket says 172.21.15.8:45800) 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79d5d9b700 1 -- 172.21.15.8:0/1485068823 learned_addr learned my addr 172.21.15.8:0/1485068823 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:42.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79d659c700 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d712d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.615+0000 7f79d559a700 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d712820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79d5d9b700 1 -- 172.21.15.8:0/1485068823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 msgr2=0x55830d712d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d712d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79d5d9b700 1 -- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 msgr2=0x55830d712820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d712820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79d5d9b700 1 -- 172.21.15.8:0/1485068823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc009dd0 con 0x55830d703260 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79d559a700 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d712820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79d5d9b700 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d714210 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f79cc011c50 tx=0x7f79cc009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e49b7eb7a7ae65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:13:42.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79b97fa700 1 -- 172.21.15.8:0/1485068823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc028160 con 0x55830d703260 2023-10-06T23:13:42.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79eb84bb80 1 -- 172.21.15.8:0/1485068823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79cc019c20 con 0x55830d703260 2023-10-06T23:13:42.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.616+0000 7f79b97fa700 1 -- 172.21.15.8:0/1485068823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f79cc0282c0 con 0x55830d703260 2023-10-06T23:13:42.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79b97fa700 1 -- 172.21.15.8:0/1485068823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79cc028480 con 0x55830d703260 2023-10-06T23:13:42.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79eb84bb80 10 client.15561 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:42.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79eb84bb80 1 -- 172.21.15.8:0/1485068823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55830d480de0 con 0x55830d703260 2023-10-06T23:13:42.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79b97fa700 1 -- 172.21.15.8:0/1485068823 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79cc019c20 con 0x55830d703260 2023-10-06T23:13:42.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79b97fa700 1 -- 172.21.15.8:0/1485068823 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f79cc0054c0 con 0x55830d703260 2023-10-06T23:13:42.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79eb84bb80 10 client.15561 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:42.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79eb84bb80 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:42.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79eb84bb80 20 client.15561 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:42.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55830d76e070 0x55830d770490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:42.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79eb84bb80 4 client.15561 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:13:42.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.617+0000 7f79eb84bb80 1 -- 172.21.15.8:0/1485068823 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55830d64eb30 con 0x55830d76e070 2023-10-06T23:13:42.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.618+0000 7f79d559a700 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55830d76e070 0x55830d770490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.618+0000 7f79d559a700 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55830d76e070 0x55830d770490 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fd6c64e3b8ff0ea server_cookie=48613336a94ec08 in_seq=0 out_seq=0 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.618+0000 7f79b97fa700 10 client.15561 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.618+0000 7f79b97fa700 1 -- 172.21.15.8:0/1485068823 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55830d64eb30 con 0x55830d76e070 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.618+0000 7f79b97fa700 10 client.15561 handle_command_reply: tid=0 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.618+0000 7f79eb84bb80 1 client.15561 shutdown 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 -- 172.21.15.8:0/1485068823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 msgr2=0x55830d714210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d714210 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f79cc011c50 tx=0x7f79cc009490 comp rx=0 tx=0).stop 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 -- 172.21.15.8:0/1485068823 shutdown_connections 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55830d76e070 0x55830d770490 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55830d703260 0x55830d714210 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55830d704a60 0x55830d712d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79b97fa700 0 client.15561 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:42.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 --2- 172.21.15.8:0/1485068823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55830d703bc0 0x55830d712820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 -- 172.21.15.8:0/1485068823 >> 172.21.15.8:0/1485068823 conn(0x55830d677260 msgr2=0x55830d70cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 -- 172.21.15.8:0/1485068823 shutdown_connections 2023-10-06T23:13:42.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 1 -- 172.21.15.8:0/1485068823 wait complete. 2023-10-06T23:13:42.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.619+0000 7f79eb84bb80 20 client.15561 trim_cache size 0 max 16384 2023-10-06T23:13:42.629 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:13:42.629 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-06T23:13:42.630 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:13:42.630 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:13:42.630 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:13:42.630 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:13:42.630 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:13:42.630 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:13:42.630 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:13:42.630 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:13:42.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 -- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f79bc0a1480 msgr2=0x7f79bc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f79bc0a1480 0x7f79bc0a3940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f79c800b780 tx=0x7f79c8006210 comp rx=0 tx=0).stop 2023-10-06T23:13:42.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 -- 172.21.15.8:0/3054892020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0074ef0 msgr2=0x7f79d0199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:42.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0074ef0 0x7f79d0199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79c000e970 tx=0x7f79c000ec80 comp rx=0 tx=0).stop 2023-10-06T23:13:42.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 -- 172.21.15.8:0/3054892020 shutdown_connections 2023-10-06T23:13:42.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f79bc0a1480 0x7f79bc0a3940 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79d0108da0 0x7f79d01a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d0073910 0x7f79d0198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 --2- 172.21.15.8:0/3054892020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0074ef0 0x7f79d0199320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:42.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 -- 172.21.15.8:0/3054892020 >> 172.21.15.8:0/3054892020 conn(0x7f79d00fc430 msgr2=0x7f79d00fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:42.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 -- 172.21.15.8:0/3054892020 shutdown_connections 2023-10-06T23:13:42.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:13:42.620+0000 7f79d7fff700 1 -- 172.21.15.8:0/3054892020 wait complete. 2023-10-06T23:13:42.640 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:13:42.656 INFO:teuthology.orchestra.run.smithi008.stderr:400000 of 3200000 tuples (12%) done (elapsed 6.12 s, remaining 42.85 s) 2023-10-06T23:13:43.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub queued for path: / 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub summary: active paths [/] 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub summary: active paths [/] 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub summary: active paths [/] 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub summary: active paths [/] 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:43 smithi156 ceph-mon[102862]: pgmap v375: 97 pgs: 97 active+clean; 87 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 7.7 MiB/s wr, 186 op/s 2023-10-06T23:13:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub queued for path: / 2023-10-06T23:13:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub summary: active paths [/] 2023-10-06T23:13:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub summary: active paths [/] 2023-10-06T23:13:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub summary: active paths [/] 2023-10-06T23:13:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub summary: active paths [/] 2023-10-06T23:13:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:43 smithi008 ceph-mon[98532]: pgmap v375: 97 pgs: 97 active+clean; 87 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 7.7 MiB/s wr, 186 op/s 2023-10-06T23:13:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub queued for path: / 2023-10-06T23:13:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub summary: active paths [/] 2023-10-06T23:13:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub summary: active paths [/] 2023-10-06T23:13:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub summary: active paths [/] 2023-10-06T23:13:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub summary: active paths [/] 2023-10-06T23:13:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: scrub summary: idle+waiting paths [/] 2023-10-06T23:13:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:43 smithi190 ceph-mon[102658]: pgmap v375: 97 pgs: 97 active+clean; 87 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 7.7 MiB/s wr, 186 op/s 2023-10-06T23:13:44.529 INFO:teuthology.orchestra.run.smithi008.stderr:500000 of 3200000 tuples (15%) done (elapsed 7.99 s, remaining 43.17 s) 2023-10-06T23:13:45.899 INFO:teuthology.orchestra.run.smithi008.stderr:600000 of 3200000 tuples (18%) done (elapsed 9.36 s, remaining 40.58 s) 2023-10-06T23:13:46.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:46 smithi156 ceph-mon[102862]: pgmap v376: 97 pgs: 97 active+clean; 119 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 13 MiB/s wr, 146 op/s 2023-10-06T23:13:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:46 smithi008 ceph-mon[98532]: pgmap v376: 97 pgs: 97 active+clean; 119 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 13 MiB/s wr, 146 op/s 2023-10-06T23:13:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:46 smithi190 ceph-mon[102658]: pgmap v376: 97 pgs: 97 active+clean; 119 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 13 MiB/s wr, 146 op/s 2023-10-06T23:13:47.683 INFO:teuthology.orchestra.run.smithi008.stderr:700000 of 3200000 tuples (21%) done (elapsed 11.15 s, remaining 39.82 s) 2023-10-06T23:13:48.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:48 smithi156 ceph-mon[102862]: pgmap v377: 97 pgs: 97 active+clean; 144 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 16 MiB/s wr, 180 op/s 2023-10-06T23:13:48.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:48 smithi008 ceph-mon[98532]: pgmap v377: 97 pgs: 97 active+clean; 144 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 16 MiB/s wr, 180 op/s 2023-10-06T23:13:48.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:48 smithi190 ceph-mon[102658]: pgmap v377: 97 pgs: 97 active+clean; 144 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 16 MiB/s wr, 180 op/s 2023-10-06T23:13:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 -- 172.21.15.8:0/880392786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 msgr2=0x7f0afc1064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 --2- 172.21.15.8:0/880392786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 0x7f0afc1064f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009990 tx=0x7f0af0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 -- 172.21.15.8:0/880392786 shutdown_connections 2023-10-06T23:13:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 --2- 172.21.15.8:0/880392786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc1017d0 0x7f0afc103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 --2- 172.21.15.8:0/880392786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0afc106a30 0x7f0afc108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 --2- 172.21.15.8:0/880392786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 0x7f0afc1064f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 -- 172.21.15.8:0/880392786 >> 172.21.15.8:0/880392786 conn(0x7f0afc0fb1a0 msgr2=0x7f0afc0fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 -- 172.21.15.8:0/880392786 shutdown_connections 2023-10-06T23:13:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.672+0000 7f0afbfff700 1 -- 172.21.15.8:0/880392786 wait complete. 2023-10-06T23:13:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.673+0000 7f0afbfff700 1 Processor -- start 2023-10-06T23:13:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afbfff700 1 -- start start 2023-10-06T23:13:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc1017d0 0x7f0afc196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 0x7f0afc196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afbfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0afc106a30 0x7f0afc19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afbfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc19e4c0 con 0x7f0afc1017d0 2023-10-06T23:13:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afbfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc19e600 con 0x7f0afc104100 2023-10-06T23:13:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afbfff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc19e790 con 0x7f0afc106a30 2023-10-06T23:13:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afb7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0afc106a30 0x7f0afc19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afa7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 0x7f0afc196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afb7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0afc106a30 0x7f0afc19def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38162/0 (socket says 172.21.15.8:38162) 2023-10-06T23:13:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.675+0000 7f0afb7fe700 1 -- 172.21.15.8:0/4084633856 learned_addr learned my addr 172.21.15.8:0/4084633856 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.676+0000 7f0afaffd700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc1017d0 0x7f0afc196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.676+0000 7f0afb7fe700 1 -- 172.21.15.8:0/4084633856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 msgr2=0x7f0afc196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.676+0000 7f0afb7fe700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 0x7f0afc196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.676+0000 7f0afb7fe700 1 -- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc1017d0 msgr2=0x7f0afc196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.676+0000 7f0afb7fe700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc1017d0 0x7f0afc196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.676+0000 7f0afb7fe700 1 -- 172.21.15.8:0/4084633856 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00095f0 con 0x7f0afc106a30 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.676+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 0x7f0afc196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.676+0000 7f0afb7fe700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0afc106a30 0x7f0afc19def0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0af400ef30 tx=0x7f0af400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.677+0000 7f0ae3fff700 1 -- 172.21.15.8:0/4084633856 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4018070 con 0x7f0afc106a30 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.677+0000 7f0ae3fff700 1 -- 172.21.15.8:0/4084633856 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0af400f040 con 0x7f0afc106a30 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.677+0000 7f0ae3fff700 1 -- 172.21.15.8:0/4084633856 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400cc70 con 0x7f0afc106a30 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.677+0000 7f0afbfff700 1 -- 172.21.15.8:0/4084633856 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc19ea10 con 0x7f0afc106a30 2023-10-06T23:13:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.677+0000 7f0afbfff700 1 -- 172.21.15.8:0/4084633856 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc19eed0 con 0x7f0afc106a30 2023-10-06T23:13:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.681+0000 7f0ae3fff700 1 -- 172.21.15.8:0/4084633856 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0af4003a00 con 0x7f0afc106a30 2023-10-06T23:13:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0b14da3b80 1 Processor -- start 2023-10-06T23:13:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0b14da3b80 1 -- start start 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12ce020 0x55c9f12ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f1236400 con 0x55c9f12cf130 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0ae3fff700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ae40a5990 0x7f0ae40a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f1227bc0 con 0x55c9f12cfaf0 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f12254e0 con 0x55c9f12ce020 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.683+0000 7f0ae3fff700 1 -- 172.21.15.8:0/4084633856 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0af40cc7b0 con 0x7f0afc106a30 2023-10-06T23:13:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12ce020 0x55c9f12ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12ce020 0x55c9f12ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38168/0 (socket says 172.21.15.8:38168) 2023-10-06T23:13:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 -- 172.21.15.8:0/4056194358 learned_addr learned my addr 172.21.15.8:0/4056194358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afb7fe700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ae40a5990 0x7f0ae40a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afaffd700 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 -- 172.21.15.8:0/4056194358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 msgr2=0x55c9f12d6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 -- 172.21.15.8:0/4056194358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 msgr2=0x55c9f12cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.684+0000 7f0afa7fc700 1 -- 172.21.15.8:0/4056194358 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9f104bd80 con 0x55c9f12ce020 2023-10-06T23:13:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.685+0000 7f0afaffd700 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.685+0000 7f0afb7fe700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ae40a5990 0x7f0ae40a7e50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0af4004de0 tx=0x7f0af4004d30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.685+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12ce020 0x55c9f12ce440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0af0003f60 tx=0x7f0af000b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc0bdd006d89bd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.686+0000 7f0ae17fa700 1 -- 172.21.15.8:0/4056194358 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00041f0 con 0x55c9f12ce020 2023-10-06T23:13:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.686+0000 7f0ae17fa700 1 -- 172.21.15.8:0/4056194358 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0af001e030 con 0x55c9f12ce020 2023-10-06T23:13:48.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.686+0000 7f0ae17fa700 1 -- 172.21.15.8:0/4056194358 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000f6c0 con 0x55c9f12ce020 2023-10-06T23:13:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 -- 172.21.15.8:0/4056194358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12ce020 msgr2=0x55c9f12ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12ce020 0x55c9f12ce440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0af0003f60 tx=0x7f0af000b260 comp rx=0 tx=0).stop 2023-10-06T23:13:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 -- 172.21.15.8:0/4056194358 shutdown_connections 2023-10-06T23:13:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12ce020 0x55c9f12ce440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/4056194358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 -- 172.21.15.8:0/4056194358 >> 172.21.15.8:0/4056194358 conn(0x55c9f1242200 msgr2=0x55c9f12c8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 -- 172.21.15.8:0/4056194358 shutdown_connections 2023-10-06T23:13:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.687+0000 7f0b14da3b80 1 -- 172.21.15.8:0/4056194358 wait complete. 2023-10-06T23:13:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.688+0000 7f0b14da3b80 1 -- start start 2023-10-06T23:13:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.688+0000 7f0b14da3b80 1 Processor -- start 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 0x55c9f12e0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cfaf0 0x55c9f12e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f1220dd0 con 0x55c9f12cfaf0 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f11bd6b0 con 0x55c9f12ce020 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f11bd350 con 0x55c9f12cf130 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0b14da3b80 10 client.0 _ll_register_callbacks cb 0x55c9f101a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0afaffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.689+0000 7f0afaffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38182/0 (socket says 172.21.15.8:38182) 2023-10-06T23:13:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.690+0000 7f0afaffd700 1 -- 172.21.15.8:0/1015821399 learned_addr learned my addr 172.21.15.8:0/1015821399 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.690+0000 7f0afaffd700 1 -- 172.21.15.8:0/1015821399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 msgr2=0x55c9f12e0580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T23:13:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.690+0000 7f0afaffd700 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 0x55c9f12e0580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.690+0000 7f0afaffd700 1 -- 172.21.15.8:0/1015821399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cfaf0 msgr2=0x55c9f12e7b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.690+0000 7f0afaffd700 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cfaf0 0x55c9f12e7b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.690+0000 7f0afaffd700 1 -- 172.21.15.8:0/1015821399 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af0020040 con 0x55c9f12cf130 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.690+0000 7f0afaffd700 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e0ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0aec012450 tx=0x7f0aec012810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212fcfeb8f3841ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.690+0000 7f0adeff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.691+0000 7f0adeff5700 1 -- 172.21.15.8:0/1015821399 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec004460 con 0x55c9f12cf130 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.691+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1015821399 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9f12c0eb0 con 0x55c9f12cf130 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.691+0000 7f0adeff5700 1 -- 172.21.15.8:0/1015821399 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0aec003680 con 0x55c9f12cf130 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.691+0000 7f0adeff5700 1 -- 172.21.15.8:0/1015821399 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aec021030 con 0x55c9f12cf130 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.691+0000 7f0b14da3b80 10 client.25399 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.691+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1015821399 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c9f1034c00 con 0x55c9f12cf130 2023-10-06T23:13:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.691+0000 7f0adeff5700 1 -- 172.21.15.8:0/1015821399 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c9f12c0eb0 con 0x55c9f12cf130 2023-10-06T23:13:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.692+0000 7f0adeff5700 1 -- 172.21.15.8:0/1015821399 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0aec01b740 con 0x55c9f12cf130 2023-10-06T23:13:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.692+0000 7f0b14da3b80 10 client.25399 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.692+0000 7f0b14da3b80 10 client.25399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.692+0000 7f0b14da3b80 20 client.25399 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.692+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c9f12ec560 0x55c9f12ee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.692+0000 7f0b14da3b80 4 client.25399 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:13:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.692+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1015821399 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9f1219db0 con 0x55c9f12ec560 2023-10-06T23:13:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.693+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c9f12ec560 0x55c9f12ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.693+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c9f12ec560 0x55c9f12ee980 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ded5e7805f4f21b5 server_cookie=f7c86cd1afa2bb01 in_seq=0 out_seq=0 2023-10-06T23:13:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.693+0000 7f0adeff5700 10 client.25399 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.694+0000 7f0adeff5700 1 -- 172.21.15.8:0/1015821399 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c9f1219db0 con 0x55c9f12ec560 2023-10-06T23:13:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.694+0000 7f0adeff5700 10 client.25399 handle_command_reply: tid=0 2023-10-06T23:13:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.694+0000 7f0b14da3b80 1 client.25399 shutdown 2023-10-06T23:13:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1015821399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 msgr2=0x55c9f12e0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e0ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0aec012450 tx=0x7f0aec012810 comp rx=0 tx=0).stop 2023-10-06T23:13:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1015821399 shutdown_connections 2023-10-06T23:13:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c9f12ec560 0x55c9f12ee980 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cfaf0 0x55c9f12e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 0x55c9f12e0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0adeff5700 0 client.25399 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1015821399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e0ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1015821399 >> 172.21.15.8:0/1015821399 conn(0x55c9f1242200 msgr2=0x55c9f12c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1015821399 shutdown_connections 2023-10-06T23:13:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1015821399 wait complete. 2023-10-06T23:13:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.695+0000 7f0b14da3b80 20 client.25399 trim_cache size 0 max 16384 2023-10-06T23:13:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.718+0000 7f0b14da3b80 1 Processor -- start 2023-10-06T23:13:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.718+0000 7f0b14da3b80 1 -- start start 2023-10-06T23:13:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.718+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 0x55c9f12dfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.718+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.718+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.718+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f10a18c0 con 0x55c9f12cf130 2023-10-06T23:13:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.718+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f12ce650 con 0x55c9f12ce020 2023-10-06T23:13:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.718+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f12c09f0 con 0x55c9f12cfaf0 2023-10-06T23:13:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12e7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45832/0 (socket says 172.21.15.8:45832) 2023-10-06T23:13:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 -- 172.21.15.8:0/1467926415 learned_addr learned my addr 172.21.15.8:0/1467926415 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 0x55c9f12dfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 -- 172.21.15.8:0/1467926415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cfaf0 msgr2=0x55c9f12d5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 -- 172.21.15.8:0/1467926415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 msgr2=0x55c9f12dfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 0x55c9f12dfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 -- 172.21.15.8:0/1467926415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9f10721f0 con 0x55c9f12cf130 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.719+0000 7f0afaffd700 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12e7ac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0aec026410 tx=0x7f0aec005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d59ef62c1a8a5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.720+0000 7f0ae1ffb700 1 -- 172.21.15.8:0/1467926415 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec021030 con 0x55c9f12cf130 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.720+0000 7f0ae1ffb700 1 -- 172.21.15.8:0/1467926415 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0aec012c10 con 0x55c9f12cf130 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.720+0000 7f0ae1ffb700 1 -- 172.21.15.8:0/1467926415 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec003bd0 con 0x55c9f12cf130 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1467926415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 msgr2=0x55c9f12e7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12e7ac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0aec026410 tx=0x7f0aec005ca0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1467926415 shutdown_connections 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cfaf0 0x55c9f12d5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12ce020 0x55c9f12dfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/1467926415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12cf130 0x55c9f12e7ac0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1467926415 >> 172.21.15.8:0/1467926415 conn(0x55c9f1242200 msgr2=0x55c9f12c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1467926415 shutdown_connections 2023-10-06T23:13:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 -- 172.21.15.8:0/1467926415 wait complete. 2023-10-06T23:13:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.721+0000 7f0b14da3b80 1 -- start start 2023-10-06T23:13:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0b14da3b80 1 Processor -- start 2023-10-06T23:13:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12ce020 0x55c9f12e5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0b14da3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 0x55c9f12e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f12e6f00 con 0x55c9f12ce020 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f12e7070 con 0x55c9f12cfaf0 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0b14da3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9f12e7230 con 0x55c9f12cf130 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0b14da3b80 10 client.0 _ll_register_callbacks cb 0x7f0aec007a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.722+0000 7f0afa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12ce020 0x55c9f12e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afaffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afaffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38202/0 (socket says 172.21.15.8:38202) 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afaffd700 1 -- 172.21.15.8:0/19477115 learned_addr learned my addr 172.21.15.8:0/19477115 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12ce020 0x55c9f12e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45848/0 (socket says 172.21.15.8:45848) 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 0x55c9f12e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afaffd700 1 -- 172.21.15.8:0/19477115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 msgr2=0x55c9f12e69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afaffd700 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 0x55c9f12e69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afaffd700 1 -- 172.21.15.8:0/19477115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12ce020 msgr2=0x55c9f12e5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afaffd700 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12ce020 0x55c9f12e5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afaffd700 1 -- 172.21.15.8:0/19477115 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9f1034c00 con 0x55c9f12cf130 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.723+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12ce020 0x55c9f12e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.724+0000 7f0afaffd700 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e59b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0aec000c00 tx=0x7f0aec01b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c507422e2afa05e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.724+0000 7f0adeff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.724+0000 7f0adeff5700 1 -- 172.21.15.8:0/19477115 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec021050 con 0x55c9f12cf130 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.724+0000 7f0adeff5700 1 -- 172.21.15.8:0/19477115 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0aec000e40 con 0x55c9f12cf130 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.724+0000 7f0b14da3b80 1 -- 172.21.15.8:0/19477115 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0af001e030 con 0x55c9f12cf130 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.724+0000 7f0adeff5700 1 -- 172.21.15.8:0/19477115 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aec03f030 con 0x55c9f12cf130 2023-10-06T23:13:48.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.724+0000 7f0b14da3b80 10 client.25405 fetch_fsmap learned FSMap version 26 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.724+0000 7f0b14da3b80 1 -- 172.21.15.8:0/19477115 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c9f104a250 con 0x55c9f12cf130 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0adeff5700 1 -- 172.21.15.8:0/19477115 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0af001e030 con 0x55c9f12cf130 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0adeff5700 1 -- 172.21.15.8:0/19477115 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0aec039920 con 0x55c9f12cf130 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0b14da3b80 10 client.25405 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0b14da3b80 10 client.25405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0b14da3b80 20 client.25405 populate_metadata read hostname 'smithi008' 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c9f1340c10 0x55c9f1343030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0b14da3b80 4 client.25405 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0b14da3b80 1 -- 172.21.15.8:0/19477115 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c9f1219ad0 con 0x55c9f1340c10 2023-10-06T23:13:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.725+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c9f1340c10 0x55c9f1343030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:13:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.726+0000 7f0afa7fc700 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c9f1340c10 0x55c9f1343030 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e6f44d61c7a8b1 server_cookie=b4b6d72dccfc97b in_seq=0 out_seq=0 2023-10-06T23:13:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.726+0000 7f0adeff5700 10 client.25405 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.741+0000 7f0adeff5700 1 -- 172.21.15.8:0/19477115 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c9f1219ad0 con 0x55c9f1340c10 2023-10-06T23:13:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.741+0000 7f0adeff5700 10 client.25405 handle_command_reply: tid=0 2023-10-06T23:13:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.741+0000 7f0b14da3b80 1 client.25405 shutdown 2023-10-06T23:13:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 -- 172.21.15.8:0/19477115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 msgr2=0x55c9f12e59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e59b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0aec000c00 tx=0x7f0aec01b670 comp rx=0 tx=0).stop 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 -- 172.21.15.8:0/19477115 shutdown_connections 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c9f1340c10 0x55c9f1343030 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c9f12ce020 0x55c9f12e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9f12cfaf0 0x55c9f12e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0adeff5700 0 client.25405 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 --2- 172.21.15.8:0/19477115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c9f12cf130 0x55c9f12e59b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 -- 172.21.15.8:0/19477115 >> 172.21.15.8:0/19477115 conn(0x55c9f1242200 msgr2=0x55c9f12d5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 -- 172.21.15.8:0/19477115 shutdown_connections 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 1 -- 172.21.15.8:0/19477115 wait complete. 2023-10-06T23:13:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.742+0000 7f0b14da3b80 20 client.25405 trim_cache size 0 max 16384 2023-10-06T23:13:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:13:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:13:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:13:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 -- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ae40a5990 msgr2=0x7f0ae40a7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ae40a5990 0x7f0ae40a7e50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0af4004de0 tx=0x7f0af4004d30 comp rx=0 tx=0).stop 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 -- 172.21.15.8:0/4084633856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0afc106a30 msgr2=0x7f0afc19def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0afc106a30 0x7f0afc19def0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0af400ef30 tx=0x7f0af400c3a0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 -- 172.21.15.8:0/4084633856 shutdown_connections 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0ae40a5990 0x7f0ae40a7e50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0afc1017d0 0x7f0afc196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0afc106a30 0x7f0afc19def0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 --2- 172.21.15.8:0/4084633856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0afc104100 0x7f0afc196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 -- 172.21.15.8:0/4084633856 >> 172.21.15.8:0/4084633856 conn(0x7f0afc0fb1a0 msgr2=0x7f0afc102440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:13:48.746 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 -- 172.21.15.8:0/4084633856 shutdown_connections 2023-10-06T23:13:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:13:48.743+0000 7f0afbfff700 1 -- 172.21.15.8:0/4084633856 wait complete. 2023-10-06T23:13:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:800000 of 3200000 tuples (25%) done (elapsed 13.07 s, remaining 39.20 s) 2023-10-06T23:13:50.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:50 smithi156 ceph-mon[102862]: pgmap v378: 97 pgs: 97 active+clean; 184 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 23 MiB/s wr, 157 op/s 2023-10-06T23:13:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:50 smithi008 ceph-mon[98532]: pgmap v378: 97 pgs: 97 active+clean; 184 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 23 MiB/s wr, 157 op/s 2023-10-06T23:13:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:50 smithi190 ceph-mon[102658]: pgmap v378: 97 pgs: 97 active+clean; 184 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 23 MiB/s wr, 157 op/s 2023-10-06T23:13:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:900000 of 3200000 tuples (28%) done (elapsed 14.40 s, remaining 36.80 s) 2023-10-06T23:13:52.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:52 smithi156 ceph-mon[102862]: pgmap v379: 97 pgs: 97 active+clean; 205 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 25 MiB/s wr, 112 op/s 2023-10-06T23:13:52.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:52 smithi008 ceph-mon[98532]: pgmap v379: 97 pgs: 97 active+clean; 205 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 25 MiB/s wr, 112 op/s 2023-10-06T23:13:52.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:52 smithi190 ceph-mon[102658]: pgmap v379: 97 pgs: 97 active+clean; 205 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 25 MiB/s wr, 112 op/s 2023-10-06T23:13:52.879 INFO:teuthology.orchestra.run.smithi008.stderr:1000000 of 3200000 tuples (31%) done (elapsed 16.34 s, remaining 35.96 s) 2023-10-06T23:13:53.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:53 smithi156 ceph-mon[102862]: pgmap v380: 97 pgs: 97 active+clean; 221 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 25 MiB/s wr, 91 op/s 2023-10-06T23:13:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:53 smithi008 ceph-mon[98532]: pgmap v380: 97 pgs: 97 active+clean; 221 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 25 MiB/s wr, 91 op/s 2023-10-06T23:13:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:53 smithi190 ceph-mon[102658]: pgmap v380: 97 pgs: 97 active+clean; 221 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 25 MiB/s wr, 91 op/s 2023-10-06T23:13:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:1100000 of 3200000 tuples (34%) done (elapsed 18.20 s, remaining 34.75 s) 2023-10-06T23:13:56.094 INFO:teuthology.orchestra.run.smithi008.stderr:1200000 of 3200000 tuples (37%) done (elapsed 19.56 s, remaining 32.60 s) 2023-10-06T23:13:56.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:56 smithi156 ceph-mon[102862]: pgmap v381: 97 pgs: 97 active+clean; 245 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-10-06T23:13:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:56 smithi008 ceph-mon[98532]: pgmap v381: 97 pgs: 97 active+clean; 245 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-10-06T23:13:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:56 smithi190 ceph-mon[102658]: pgmap v381: 97 pgs: 97 active+clean; 245 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-10-06T23:13:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:1300000 of 3200000 tuples (40%) done (elapsed 21.32 s, remaining 31.16 s) 2023-10-06T23:13:58.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:13:58 smithi156 ceph-mon[102862]: pgmap v382: 97 pgs: 97 active+clean; 297 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 28 MiB/s wr, 60 op/s 2023-10-06T23:13:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:13:58 smithi008 ceph-mon[98532]: pgmap v382: 97 pgs: 97 active+clean; 297 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 28 MiB/s wr, 60 op/s 2023-10-06T23:13:58.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:13:58 smithi190 ceph-mon[102658]: pgmap v382: 97 pgs: 97 active+clean; 297 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 28 MiB/s wr, 60 op/s 2023-10-06T23:13:59.760 INFO:teuthology.orchestra.run.smithi008.stderr:1400000 of 3200000 tuples (43%) done (elapsed 23.23 s, remaining 29.86 s) 2023-10-06T23:14:00.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:00 smithi156 ceph-mon[102862]: pgmap v383: 97 pgs: 97 active+clean; 317 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-10-06T23:14:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:00 smithi008 ceph-mon[98532]: pgmap v383: 97 pgs: 97 active+clean; 317 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-10-06T23:14:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:00 smithi190 ceph-mon[102658]: pgmap v383: 97 pgs: 97 active+clean; 317 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-10-06T23:14:01.081 INFO:teuthology.orchestra.run.smithi008.stderr:1500000 of 3200000 tuples (46%) done (elapsed 24.55 s, remaining 27.82 s) 2023-10-06T23:14:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 -- 172.21.15.8:0/933403953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038074ef0 msgr2=0x7f7038073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 --2- 172.21.15.8:0/933403953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038074ef0 0x7f7038073340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7034009990 tx=0x7f7034009ca0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 -- 172.21.15.8:0/933403953 shutdown_connections 2023-10-06T23:14:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 --2- 172.21.15.8:0/933403953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038074ef0 0x7f7038073340 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 --2- 172.21.15.8:0/933403953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f703810d4e0 0x7f703810f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 --2- 172.21.15.8:0/933403953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7038073910 0x7f7038073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 -- 172.21.15.8:0/933403953 >> 172.21.15.8:0/933403953 conn(0x7f70380fc460 msgr2=0x7f70380fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 -- 172.21.15.8:0/933403953 shutdown_connections 2023-10-06T23:14:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.910+0000 7f703fbff700 1 -- 172.21.15.8:0/933403953 wait complete. 2023-10-06T23:14:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.911+0000 7f703fbff700 1 Processor -- start 2023-10-06T23:14:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.911+0000 7f703fbff700 1 -- start start 2023-10-06T23:14:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703fbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038073910 0x7f703819d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703fbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7038074ef0 0x7f703819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703fbff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f703810d4e0 0x7f703819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703fbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703819ecb0 con 0x7f7038073910 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703fbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703819ee20 con 0x7f7038074ef0 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703fbff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703819efe0 con 0x7f703810d4e0 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038073910 0x7f703819d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703d99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038073910 0x7f703819d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57942/0 (socket says 172.21.15.8:57942) 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703d19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7038074ef0 0x7f703819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703d99b700 1 -- 172.21.15.8:0/238479611 learned_addr learned my addr 172.21.15.8:0/238479611 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.912+0000 7f703e19c700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f703810d4e0 0x7f703819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f703d99b700 1 -- 172.21.15.8:0/238479611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f703810d4e0 msgr2=0x7f703819e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f703d99b700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f703810d4e0 0x7f703819e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f703d99b700 1 -- 172.21.15.8:0/238479611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7038074ef0 msgr2=0x7f703819d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f703d99b700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7038074ef0 0x7f703819d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f703d99b700 1 -- 172.21.15.8:0/238479611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340095f0 con 0x7f7038073910 2023-10-06T23:14:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f703d19a700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7038074ef0 0x7f703819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f703d99b700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038073910 0x7f703819d290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f70340098e0 tx=0x7f7034004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f702effd700 1 -- 172.21.15.8:0/238479611 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703401d070 con 0x7f7038073910 2023-10-06T23:14:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f702effd700 1 -- 172.21.15.8:0/238479611 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f703400bdb0 con 0x7f7038073910 2023-10-06T23:14:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f703fbff700 1 -- 172.21.15.8:0/238479611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703819f260 con 0x7f7038073910 2023-10-06T23:14:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.913+0000 7f702effd700 1 -- 172.21.15.8:0/238479611 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034022d20 con 0x7f7038073910 2023-10-06T23:14:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.914+0000 7f703fbff700 1 -- 172.21.15.8:0/238479611 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70381a5a80 con 0x7f7038073910 2023-10-06T23:14:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.917+0000 7f702effd700 1 -- 172.21.15.8:0/238479611 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f703400b920 con 0x7f7038073910 2023-10-06T23:14:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.918+0000 7f702effd700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f70240a1480 0x7f70240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.918+0000 7f7053610b80 1 Processor -- start 2023-10-06T23:14:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.918+0000 7f702effd700 1 -- 172.21.15.8:0/238479611 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f70340ce3b0 con 0x7f7038073910 2023-10-06T23:14:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.919+0000 7f703d19a700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f70240a1480 0x7f70240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.919+0000 7f7053610b80 1 -- start start 2023-10-06T23:14:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.919+0000 7f7053610b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.919+0000 7f7053610b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee39450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.919+0000 7f7053610b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee39990 0x5637fee40220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.919+0000 7f7053610b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637feda0400 con 0x5637fee38fd0 2023-10-06T23:14:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.919+0000 7f7053610b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fed91bc0 con 0x5637fee39990 2023-10-06T23:14:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.919+0000 7f7053610b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fed8f4e0 con 0x5637fee37ec0 2023-10-06T23:14:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee39450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57958/0 (socket says 172.21.15.8:57958) 2023-10-06T23:14:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d19a700 1 -- 172.21.15.8:0/3084917340 learned_addr learned my addr 172.21.15.8:0/3084917340 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d99b700 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703e19c700 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee39990 0x5637fee40220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d19a700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f70240a1480 0x7f70240a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7038074c10 tx=0x7f7028009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d99b700 1 -- 172.21.15.8:0/3084917340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee39990 msgr2=0x5637fee40220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d99b700 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee39990 0x5637fee40220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d99b700 1 -- 172.21.15.8:0/3084917340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 msgr2=0x5637fee39450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d99b700 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee39450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d99b700 1 -- 172.21.15.8:0/3084917340 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637febb5d80 con 0x5637fee37ec0 2023-10-06T23:14:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d19a700 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee39450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.920+0000 7f703d99b700 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee382e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f703409b410 tx=0x7f7034005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc23efc6c63529 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.921+0000 7f7023fff700 1 -- 172.21.15.8:0/3084917340 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340bb070 con 0x5637fee37ec0 2023-10-06T23:14:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.921+0000 7f7023fff700 1 -- 172.21.15.8:0/3084917340 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f703409b070 con 0x5637fee37ec0 2023-10-06T23:14:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.921+0000 7f7023fff700 1 -- 172.21.15.8:0/3084917340 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340a3a10 con 0x5637fee37ec0 2023-10-06T23:14:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.921+0000 7f7053610b80 1 -- 172.21.15.8:0/3084917340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 msgr2=0x5637fee382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.921+0000 7f7053610b80 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee382e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f703409b410 tx=0x7f7034005a00 comp rx=0 tx=0).stop 2023-10-06T23:14:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.922+0000 7f7053610b80 1 -- 172.21.15.8:0/3084917340 shutdown_connections 2023-10-06T23:14:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.922+0000 7f7053610b80 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee39990 0x5637fee40220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.922+0000 7f7053610b80 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee382e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.922+0000 7f7053610b80 1 --2- 172.21.15.8:0/3084917340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee39450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.922+0000 7f7053610b80 1 -- 172.21.15.8:0/3084917340 >> 172.21.15.8:0/3084917340 conn(0x5637fedac200 msgr2=0x5637fee32bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.922+0000 7f7053610b80 1 -- 172.21.15.8:0/3084917340 shutdown_connections 2023-10-06T23:14:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.922+0000 7f7053610b80 1 -- 172.21.15.8:0/3084917340 wait complete. 2023-10-06T23:14:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.922+0000 7f7053610b80 1 -- start start 2023-10-06T23:14:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.923+0000 7f7053610b80 1 Processor -- start 2023-10-06T23:14:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.923+0000 7f7053610b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee41850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.923+0000 7f7053610b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee41d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.923+0000 7f7053610b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.923+0000 7f7053610b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fed8add0 con 0x5637fee38fd0 2023-10-06T23:14:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.923+0000 7f7053610b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fed276b0 con 0x5637fee37ec0 2023-10-06T23:14:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.923+0000 7f7053610b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fed27350 con 0x5637fee39990 2023-10-06T23:14:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.923+0000 7f7053610b80 10 client.0 _ll_register_callbacks cb 0x5637feb847a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee41d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee41850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee41d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57972/0 (socket says 172.21.15.8:57972) 2023-10-06T23:14:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 -- 172.21.15.8:0/2939752424 learned_addr learned my addr 172.21.15.8:0/2939752424 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703e19c700 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 -- 172.21.15.8:0/2939752424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 msgr2=0x5637fee48dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 -- 172.21.15.8:0/2939752424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 msgr2=0x5637fee41850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee41850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 -- 172.21.15.8:0/2939752424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7028017070 con 0x5637fee38fd0 2023-10-06T23:14:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f703d19a700 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee41d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7028003900 tx=0x7f70280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8481051e5321c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.924+0000 7f70217fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.925+0000 7f70217fa700 1 -- 172.21.15.8:0/2939752424 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028022070 con 0x5637fee38fd0 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.925+0000 7f7053610b80 1 -- 172.21.15.8:0/2939752424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637fee2ad50 con 0x5637fee38fd0 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.925+0000 7f70217fa700 1 -- 172.21.15.8:0/2939752424 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f702800e5a0 con 0x5637fee38fd0 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.925+0000 7f70217fa700 1 -- 172.21.15.8:0/2939752424 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f702802d030 con 0x5637fee38fd0 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.925+0000 7f7053610b80 10 client.15588 fetch_fsmap learned FSMap version 26 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.925+0000 7f7053610b80 1 -- 172.21.15.8:0/2939752424 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f70381a5a80 con 0x5637fee38fd0 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.925+0000 7f70217fa700 1 -- 172.21.15.8:0/2939752424 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637fee2ad50 con 0x5637fee38fd0 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.925+0000 7f70217fa700 1 -- 172.21.15.8:0/2939752424 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f702801c7f0 con 0x5637fee38fd0 2023-10-06T23:14:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f7053610b80 10 client.15588 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:14:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f7053610b80 10 client.15588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f7053610b80 20 client.15588 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f7053610b80 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5637fee4d700 0x5637fee4fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f7053610b80 4 client.15588 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:14:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f7053610b80 1 -- 172.21.15.8:0/2939752424 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637fed83db0 con 0x5637fee4d700 2023-10-06T23:14:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f703d99b700 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5637fee4d700 0x5637fee4fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f703d99b700 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5637fee4d700 0x5637fee4fb20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2997b3242685e25e server_cookie=d692a80e92676c47 in_seq=0 out_seq=0 2023-10-06T23:14:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.926+0000 7f70217fa700 10 client.15588 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.927+0000 7f70217fa700 1 -- 172.21.15.8:0/2939752424 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7f70340b9730 con 0x5637fee4d700 2023-10-06T23:14:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.927+0000 7f70217fa700 10 client.15588 handle_command_reply: tid=0 2023-10-06T23:14:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.927+0000 7f7053610b80 1 client.15588 shutdown 2023-10-06T23:14:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.927+0000 7f7053610b80 1 -- 172.21.15.8:0/2939752424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 msgr2=0x5637fee41d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.927+0000 7f7053610b80 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee41d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7028003900 tx=0x7f70280047c0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 1 -- 172.21.15.8:0/2939752424 shutdown_connections 2023-10-06T23:14:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5637fee4d700 0x5637fee4fb20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee41850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f70217fa700 0 client.15588 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 1 --2- 172.21.15.8:0/2939752424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee38fd0 0x5637fee41d90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 1 -- 172.21.15.8:0/2939752424 >> 172.21.15.8:0/2939752424 conn(0x5637fedac200 msgr2=0x5637fee32250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 1 -- 172.21.15.8:0/2939752424 shutdown_connections 2023-10-06T23:14:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 1 -- 172.21.15.8:0/2939752424 wait complete. 2023-10-06T23:14:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.928+0000 7f7053610b80 20 client.15588 trim_cache size 0 max 16384 2023-10-06T23:14:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.945+0000 7f7053610b80 1 Processor -- start 2023-10-06T23:14:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.945+0000 7f7053610b80 1 -- start start 2023-10-06T23:14:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.945+0000 7f7053610b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee33ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.945+0000 7f7053610b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.945+0000 7f7053610b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee49600 0x5637fee41810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.945+0000 7f7053610b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fec0b8c0 con 0x5637fee49600 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.945+0000 7f7053610b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fee40d00 con 0x5637fee37ec0 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.945+0000 7f7053610b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fee413f0 con 0x5637fee39990 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703e19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee49600 0x5637fee41810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee33ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee33ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59842/0 (socket says 172.21.15.8:59842) 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 -- 172.21.15.8:0/3317161043 learned_addr learned my addr 172.21.15.8:0/3317161043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49908/0 (socket says 172.21.15.8:49908) 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 -- 172.21.15.8:0/3317161043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 msgr2=0x5637fee48d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 --2- 172.21.15.8:0/3317161043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 -- 172.21.15.8:0/3317161043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee49600 msgr2=0x5637fee41810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 --2- 172.21.15.8:0/3317161043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee49600 0x5637fee41810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 -- 172.21.15.8:0/3317161043 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637feb9ec00 con 0x5637fee37ec0 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d19a700 1 --2- 172.21.15.8:0/3317161043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.946+0000 7f703d99b700 1 --2- 172.21.15.8:0/3317161043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee33ad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7034098180 tx=0x7f7034086040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=350ae04a65ebaebe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f702cbff700 1 -- 172.21.15.8:0/3317161043 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703409b790 con 0x5637fee37ec0 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f702cbff700 1 -- 172.21.15.8:0/3317161043 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70340b5030 con 0x5637fee37ec0 2023-10-06T23:14:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f702cbff700 1 -- 172.21.15.8:0/3317161043 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340a3a10 con 0x5637fee37ec0 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f7053610b80 1 -- 172.21.15.8:0/3317161043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 msgr2=0x5637fee33ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f7053610b80 1 --2- 172.21.15.8:0/3317161043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee33ad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7034098180 tx=0x7f7034086040 comp rx=0 tx=0).stop 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f7053610b80 1 -- 172.21.15.8:0/3317161043 shutdown_connections 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f7053610b80 1 --2- 172.21.15.8:0/3317161043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee49600 0x5637fee41810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f7053610b80 1 --2- 172.21.15.8:0/3317161043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee37ec0 0x5637fee33ad0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f7053610b80 1 --2- 172.21.15.8:0/3317161043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee39990 0x5637fee48d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.947+0000 7f7053610b80 1 -- 172.21.15.8:0/3317161043 >> 172.21.15.8:0/3317161043 conn(0x5637fedac200 msgr2=0x5637fee32b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.948+0000 7f7053610b80 1 -- 172.21.15.8:0/3317161043 shutdown_connections 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.948+0000 7f7053610b80 1 -- 172.21.15.8:0/3317161043 wait complete. 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.948+0000 7f7053610b80 1 -- start start 2023-10-06T23:14:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.948+0000 7f7053610b80 1 Processor -- start 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f7053610b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee48710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f7053610b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee39990 0x5637fee48c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f7053610b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee49600 0x5637fee46d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f7053610b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fee472f0 con 0x5637fee39990 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f7053610b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fee47460 con 0x5637fee49600 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f7053610b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637fee47620 con 0x5637fee37ec0 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f7053610b80 10 client.0 _ll_register_callbacks cb 0x7f7028004400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f703d99b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee48710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f703d19a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee39990 0x5637fee48c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f703d99b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee48710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49916/0 (socket says 172.21.15.8:49916) 2023-10-06T23:14:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f703d99b700 1 -- 172.21.15.8:0/3582522368 learned_addr learned my addr 172.21.15.8:0/3582522368 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.949+0000 7f703e19c700 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee49600 0x5637fee46d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f703d99b700 1 -- 172.21.15.8:0/3582522368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee49600 msgr2=0x5637fee46d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f703d99b700 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee49600 0x5637fee46d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f703d99b700 1 -- 172.21.15.8:0/3582522368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee39990 msgr2=0x5637fee48c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f703d99b700 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee39990 0x5637fee48c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f703d99b700 1 -- 172.21.15.8:0/3582522368 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70381a5a80 con 0x5637fee37ec0 2023-10-06T23:14:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f703d19a700 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee39990 0x5637fee48c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f703d99b700 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee48710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f703409b1e0 tx=0x7f7034009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42e1be365997e8cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f70217fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:14:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f70217fa700 1 -- 172.21.15.8:0/3582522368 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703409f860 con 0x5637fee37ec0 2023-10-06T23:14:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f70217fa700 1 -- 172.21.15.8:0/3582522368 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f70340a3a10 con 0x5637fee37ec0 2023-10-06T23:14:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f7053610b80 1 -- 172.21.15.8:0/3582522368 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f703409b070 con 0x5637fee37ec0 2023-10-06T23:14:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f70217fa700 1 -- 172.21.15.8:0/3582522368 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f703409b4e0 con 0x5637fee37ec0 2023-10-06T23:14:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f7053610b80 10 client.25423 fetch_fsmap learned FSMap version 26 2023-10-06T23:14:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.950+0000 7f7053610b80 1 -- 172.21.15.8:0/3582522368 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5637febb5d80 con 0x5637fee37ec0 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f70217fa700 1 -- 172.21.15.8:0/3582522368 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f703409b070 con 0x5637fee37ec0 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f70217fa700 1 -- 172.21.15.8:0/3582522368 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 26) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7034081020 con 0x5637fee37ec0 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f7053610b80 10 client.25423 fetch_fsmap finished waiting for FSMap version 26 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f7053610b80 10 client.25423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f7053610b80 20 client.25423 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f7053610b80 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5637feea2490 0x5637feea48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f7053610b80 4 client.25423 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f7053610b80 1 -- 172.21.15.8:0/3582522368 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5637fed83ad0 con 0x5637feea2490 2023-10-06T23:14:01.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.951+0000 7f703d19a700 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5637feea2490 0x5637feea48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:01.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.952+0000 7f703d19a700 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5637feea2490 0x5637feea48b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255c936a2c328443 server_cookie=434ff80261080238 in_seq=0 out_seq=0 2023-10-06T23:14:01.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.952+0000 7f70217fa700 10 client.25423 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.964+0000 7f70217fa700 1 -- 172.21.15.8:0/3582522368 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5637fed83ad0 con 0x5637feea2490 2023-10-06T23:14:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.964+0000 7f70217fa700 10 client.25423 handle_command_reply: tid=0 2023-10-06T23:14:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.964+0000 7f7053610b80 1 client.25423 shutdown 2023-10-06T23:14:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 -- 172.21.15.8:0/3582522368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 msgr2=0x5637fee48710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee48710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f703409b1e0 tx=0x7f7034009ca0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 -- 172.21.15.8:0/3582522368 shutdown_connections 2023-10-06T23:14:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5637feea2490 0x5637feea48b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637fee49600 0x5637fee46d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5637fee37ec0 0x5637fee48710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f70217fa700 0 client.25423 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 --2- 172.21.15.8:0/3582522368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5637fee39990 0x5637fee48c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 -- 172.21.15.8:0/3582522368 >> 172.21.15.8:0/3582522368 conn(0x5637fedac200 msgr2=0x5637fee3c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 -- 172.21.15.8:0/3582522368 shutdown_connections 2023-10-06T23:14:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 1 -- 172.21.15.8:0/3582522368 wait complete. 2023-10-06T23:14:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.965+0000 7f7053610b80 20 client.25423 trim_cache size 0 max 16384 2023-10-06T23:14:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:14:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:14:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:14:01.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:14:01.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 -- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f70240a1480 msgr2=0x7f70240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f70240a1480 0x7f70240a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7038074c10 tx=0x7f7028009260 comp rx=0 tx=0).stop 2023-10-06T23:14:01.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 -- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038073910 msgr2=0x7f703819d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:01.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038073910 0x7f703819d290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f70340098e0 tx=0x7f7034004730 comp rx=0 tx=0).stop 2023-10-06T23:14:01.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 -- 172.21.15.8:0/238479611 shutdown_connections 2023-10-06T23:14:01.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f70240a1480 0x7f70240a3940 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7038073910 0x7f703819d290 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f703810d4e0 0x7f703819e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 --2- 172.21.15.8:0/238479611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7038074ef0 0x7f703819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 -- 172.21.15.8:0/238479611 >> 172.21.15.8:0/238479611 conn(0x7f70380fc460 msgr2=0x7f70380fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 -- 172.21.15.8:0/238479611 shutdown_connections 2023-10-06T23:14:01.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:01.966+0000 7f703fbff700 1 -- 172.21.15.8:0/238479611 wait complete. 2023-10-06T23:14:02.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:02 smithi156 ceph-mon[102862]: pgmap v384: 97 pgs: 97 active+clean; 356 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 26 op/s 2023-10-06T23:14:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:02 smithi008 ceph-mon[98532]: pgmap v384: 97 pgs: 97 active+clean; 356 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 26 op/s 2023-10-06T23:14:02.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:02 smithi190 ceph-mon[102658]: pgmap v384: 97 pgs: 97 active+clean; 356 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 26 op/s 2023-10-06T23:14:02.974 INFO:teuthology.orchestra.run.smithi008.stderr:1600000 of 3200000 tuples (50%) done (elapsed 26.44 s, remaining 26.44 s) 2023-10-06T23:14:03.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:03 smithi156 ceph-mon[102862]: pgmap v385: 97 pgs: 97 active+clean; 364 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-10-06T23:14:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:03 smithi008 ceph-mon[98532]: pgmap v385: 97 pgs: 97 active+clean; 364 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-10-06T23:14:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:03 smithi190 ceph-mon[102658]: pgmap v385: 97 pgs: 97 active+clean; 364 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-10-06T23:14:04.322 INFO:teuthology.orchestra.run.smithi008.stderr:1700000 of 3200000 tuples (53%) done (elapsed 27.79 s, remaining 24.52 s) 2023-10-06T23:14:06.203 INFO:teuthology.orchestra.run.smithi008.stderr:1800000 of 3200000 tuples (56%) done (elapsed 29.67 s, remaining 23.08 s) 2023-10-06T23:14:06.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:06 smithi156 ceph-mon[102862]: pgmap v386: 97 pgs: 97 active+clean; 388 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-10-06T23:14:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:06 smithi008 ceph-mon[98532]: pgmap v386: 97 pgs: 97 active+clean; 388 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-10-06T23:14:06.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:06 smithi190 ceph-mon[102658]: pgmap v386: 97 pgs: 97 active+clean; 388 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-10-06T23:14:08.089 INFO:teuthology.orchestra.run.smithi008.stderr:1900000 of 3200000 tuples (59%) done (elapsed 31.55 s, remaining 21.59 s) 2023-10-06T23:14:08.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:08 smithi156 ceph-mon[102862]: pgmap v387: 97 pgs: 97 active+clean; 440 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 MiB/s wr, 27 op/s 2023-10-06T23:14:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:08 smithi008 ceph-mon[98532]: pgmap v387: 97 pgs: 97 active+clean; 440 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 MiB/s wr, 27 op/s 2023-10-06T23:14:08.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:08 smithi190 ceph-mon[102658]: pgmap v387: 97 pgs: 97 active+clean; 440 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 31 MiB/s wr, 27 op/s 2023-10-06T23:14:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2000000 of 3200000 tuples (62%) done (elapsed 32.78 s, remaining 19.67 s) 2023-10-06T23:14:10.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:10 smithi156 ceph-mon[102862]: pgmap v388: 97 pgs: 97 active+clean; 464 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-10-06T23:14:10.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:10 smithi008 ceph-mon[98532]: pgmap v388: 97 pgs: 97 active+clean; 464 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-10-06T23:14:10.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:10 smithi190 ceph-mon[102658]: pgmap v388: 97 pgs: 97 active+clean; 464 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-10-06T23:14:11.180 INFO:teuthology.orchestra.run.smithi008.stderr:2100000 of 3200000 tuples (65%) done (elapsed 34.65 s, remaining 18.15 s) 2023-10-06T23:14:12.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:12 smithi156 ceph-mon[102862]: pgmap v389: 97 pgs: 97 active+clean; 484 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 24 op/s 2023-10-06T23:14:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:12 smithi008 ceph-mon[98532]: pgmap v389: 97 pgs: 97 active+clean; 484 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 24 op/s 2023-10-06T23:14:12.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:12 smithi190 ceph-mon[102658]: pgmap v389: 97 pgs: 97 active+clean; 484 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 24 op/s 2023-10-06T23:14:12.642 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:14:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 -- 172.21.15.8:0/534341792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0104300 msgr2=0x7effb0104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 --2- 172.21.15.8:0/534341792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0104300 0x7effb0104760 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7effa40099c0 tx=0x7effa4009cd0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 -- 172.21.15.8:0/534341792 shutdown_connections 2023-10-06T23:14:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 --2- 172.21.15.8:0/534341792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb0104ca0 0x7effb010b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 --2- 172.21.15.8:0/534341792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effb0103110 0x7effb0103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 --2- 172.21.15.8:0/534341792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0104300 0x7effb0104760 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 -- 172.21.15.8:0/534341792 >> 172.21.15.8:0/534341792 conn(0x7effb00fe660 msgr2=0x7effb0100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:12.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 -- 172.21.15.8:0/534341792 shutdown_connections 2023-10-06T23:14:12.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.874+0000 7effb4bff700 1 -- 172.21.15.8:0/534341792 wait complete. 2023-10-06T23:14:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.875+0000 7effb4bff700 1 Processor -- start 2023-10-06T23:14:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effb4bff700 1 -- start start 2023-10-06T23:14:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effb4bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0103110 0x7effb0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effb4bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb0104300 0x7effb0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effb4bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effb0104ca0 0x7effb01a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effb4bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb01a08c0 con 0x7effb0103110 2023-10-06T23:14:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effb4bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb01a0a00 con 0x7effb0104300 2023-10-06T23:14:12.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effb4bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb01a0b90 con 0x7effb0104ca0 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0103110 0x7effb0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effae59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0103110 0x7effb0198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35980/0 (socket says 172.21.15.8:35980) 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effae59c700 1 -- 172.21.15.8:0/1229115696 learned_addr learned my addr 172.21.15.8:0/1229115696 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effadd9b700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb0104300 0x7effb0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.876+0000 7effaed9d700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effb0104ca0 0x7effb01a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7effae59c700 1 -- 172.21.15.8:0/1229115696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effb0104ca0 msgr2=0x7effb01a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7effae59c700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effb0104ca0 0x7effb01a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7effae59c700 1 -- 172.21.15.8:0/1229115696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb0104300 msgr2=0x7effb0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7effae59c700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb0104300 0x7effb0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7effae59c700 1 -- 172.21.15.8:0/1229115696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009520 con 0x7effb0103110 2023-10-06T23:14:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7effae59c700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0103110 0x7effb0198d40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7effa000ea50 tx=0x7effa000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7eff9f7fe700 1 -- 172.21.15.8:0/1229115696 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa000cbd0 con 0x7effb0103110 2023-10-06T23:14:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7effb4bff700 1 -- 172.21.15.8:0/1229115696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa40095f0 con 0x7effb0103110 2023-10-06T23:14:12.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7eff9f7fe700 1 -- 172.21.15.8:0/1229115696 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effa000cd30 con 0x7effb0103110 2023-10-06T23:14:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.877+0000 7eff9f7fe700 1 -- 172.21.15.8:0/1229115696 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0018680 con 0x7effb0103110 2023-10-06T23:14:12.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.878+0000 7effb4bff700 1 -- 172.21.15.8:0/1229115696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb01a1190 con 0x7effb0103110 2023-10-06T23:14:12.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.881+0000 7eff9f7fe700 1 -- 172.21.15.8:0/1229115696 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7effa0010430 con 0x7effb0103110 2023-10-06T23:14:12.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.883+0000 7effc8589b80 1 Processor -- start 2023-10-06T23:14:12.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.883+0000 7eff9f7fe700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff980a1480 0x7eff980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.883+0000 7effc8589b80 1 -- start start 2023-10-06T23:14:12.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.883+0000 7eff9f7fe700 1 -- 172.21.15.8:0/1229115696 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7effa0014070 con 0x7effb0103110 2023-10-06T23:14:12.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.883+0000 7effaed9d700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff980a1480 0x7eff980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effc8589b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ac260 0x564d578ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effc8589b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578ad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effc8589b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 0x564d578adee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effc8589b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d57814460 con 0x564d578ac260 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effc8589b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d57805c20 con 0x564d578acbc0 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effc8589b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d57803540 con 0x564d578ada60 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effadd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effaed9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 0x564d578adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effadd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578ad480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38660/0 (socket says 172.21.15.8:38660) 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effadd9b700 1 -- 172.21.15.8:0/3077351957 learned_addr learned my addr 172.21.15.8:0/3077351957 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effae59c700 1 --2- 172.21.15.8:0/3077351957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ac260 0x564d578ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effadd9b700 1 -- 172.21.15.8:0/3077351957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 msgr2=0x564d578adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:12.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effadd9b700 1 --2- 172.21.15.8:0/3077351957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 0x564d578adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effadd9b700 1 -- 172.21.15.8:0/3077351957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ac260 msgr2=0x564d578ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effadd9b700 1 --2- 172.21.15.8:0/3077351957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ac260 0x564d578ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effaed9d700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff980a1480 0x7eff980a3940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7effa800f870 tx=0x7effa800fc30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.884+0000 7effadd9b700 1 -- 172.21.15.8:0/3077351957 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d57629de0 con 0x564d578acbc0 2023-10-06T23:14:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.885+0000 7effadd9b700 1 --2- 172.21.15.8:0/3077351957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578ad480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7effa400bf10 tx=0x7effa4005c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c71301794542b4aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.885+0000 7eff9cff9700 1 -- 172.21.15.8:0/3077351957 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400b990 con 0x564d578acbc0 2023-10-06T23:14:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.885+0000 7eff9cff9700 1 -- 172.21.15.8:0/3077351957 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effa401e040 con 0x564d578acbc0 2023-10-06T23:14:12.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.885+0000 7eff9cff9700 1 -- 172.21.15.8:0/3077351957 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40039c0 con 0x564d578acbc0 2023-10-06T23:14:12.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 -- 172.21.15.8:0/3077351957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 msgr2=0x564d578ad480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 --2- 172.21.15.8:0/3077351957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578ad480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7effa400bf10 tx=0x7effa4005c30 comp rx=0 tx=0).stop 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 -- 172.21.15.8:0/3077351957 shutdown_connections 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 --2- 172.21.15.8:0/3077351957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ac260 0x564d578ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 --2- 172.21.15.8:0/3077351957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 0x564d578adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 --2- 172.21.15.8:0/3077351957 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578ad480 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 -- 172.21.15.8:0/3077351957 >> 172.21.15.8:0/3077351957 conn(0x564d57820260 msgr2=0x564d578a7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 -- 172.21.15.8:0/3077351957 shutdown_connections 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.886+0000 7effc8589b80 1 -- 172.21.15.8:0/3077351957 wait complete. 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.887+0000 7effc8589b80 1 -- start start 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.887+0000 7effc8589b80 1 Processor -- start 2023-10-06T23:14:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.887+0000 7effc8589b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578ac260 0x564d578b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.887+0000 7effc8589b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578acbc0 0x564d578b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.887+0000 7effc8589b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 0x564d578bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.887+0000 7effc8589b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d577fee30 con 0x564d578acbc0 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.887+0000 7effc8589b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d5779b710 con 0x564d578ac260 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.887+0000 7effc8589b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d5779b3b0 con 0x564d578ada60 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effc8589b80 10 client.0 _ll_register_callbacks cb 0x564d575f8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578ac260 0x564d578b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578ac260 0x564d578b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38674/0 (socket says 172.21.15.8:38674) 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 -- 172.21.15.8:0/4179973650 learned_addr learned my addr 172.21.15.8:0/4179973650 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effadd9b700 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578acbc0 0x564d578b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effaed9d700 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 0x564d578bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 -- 172.21.15.8:0/4179973650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 msgr2=0x564d578bd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 0x564d578bd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 -- 172.21.15.8:0/4179973650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578acbc0 msgr2=0x564d578b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578acbc0 0x564d578b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 -- 172.21.15.8:0/4179973650 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb010bea0 con 0x564d578ac260 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7effae59c700 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578ac260 0x564d578b5fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7effa00cae10 tx=0x7effa009a170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6720c60794d0c6b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.888+0000 7eff95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.889+0000 7eff95ffb700 1 -- 172.21.15.8:0/4179973650 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa009ad30 con 0x564d578ac260 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.889+0000 7effc8589b80 1 -- 172.21.15.8:0/4179973650 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d5789ef10 con 0x564d578ac260 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.889+0000 7eff95ffb700 1 -- 172.21.15.8:0/4179973650 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7effa009a630 con 0x564d578ac260 2023-10-06T23:14:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.889+0000 7eff95ffb700 1 -- 172.21.15.8:0/4179973650 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7effa009e780 con 0x564d578ac260 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.889+0000 7effc8589b80 10 client.25394 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.889+0000 7effc8589b80 1 -- 172.21.15.8:0/4179973650 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564d57612c60 con 0x564d578ac260 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.889+0000 7eff95ffb700 1 -- 172.21.15.8:0/4179973650 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effa0064020 con 0x564d578ac260 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.890+0000 7eff95ffb700 1 -- 172.21.15.8:0/4179973650 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7effa00a2530 con 0x564d578ac260 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.890+0000 7effc8589b80 10 client.25394 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.890+0000 7effc8589b80 10 client.25394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.890+0000 7effc8589b80 20 client.25394 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.890+0000 7effc8589b80 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d578c1e60 0x564d578c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.890+0000 7effc8589b80 4 client.25394 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.890+0000 7effc8589b80 1 -- 172.21.15.8:0/4179973650 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d577f7e10 con 0x564d578c1e60 2023-10-06T23:14:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.890+0000 7effadd9b700 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d578c1e60 0x564d578c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.891+0000 7effadd9b700 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d578c1e60 0x564d578c4280 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a947e7c4bc3eec server_cookie=47247c9f3c52b288 in_seq=0 out_seq=0 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.891+0000 7eff95ffb700 10 client.25394 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7eff95ffb700 1 -- 172.21.15.8:0/4179973650 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564d577f7e10 con 0x564d578c1e60 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7eff95ffb700 10 client.25394 handle_command_reply: tid=0 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 client.25394 shutdown 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 -- 172.21.15.8:0/4179973650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578ac260 msgr2=0x564d578b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578ac260 0x564d578b5fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7effa00cae10 tx=0x7effa009a170 comp rx=0 tx=0).stop 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 -- 172.21.15.8:0/4179973650 shutdown_connections 2023-10-06T23:14:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d578c1e60 0x564d578c4280 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ada60 0x564d578bd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578ac260 0x564d578b5fe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7eff95ffb700 0 client.25394 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 --2- 172.21.15.8:0/4179973650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578acbc0 0x564d578b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 -- 172.21.15.8:0/4179973650 >> 172.21.15.8:0/4179973650 conn(0x564d57820260 msgr2=0x564d578a6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 -- 172.21.15.8:0/4179973650 shutdown_connections 2023-10-06T23:14:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 1 -- 172.21.15.8:0/4179973650 wait complete. 2023-10-06T23:14:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.892+0000 7effc8589b80 20 client.25394 trim_cache size 0 max 16384 2023-10-06T23:14:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.911+0000 7effc8589b80 1 Processor -- start 2023-10-06T23:14:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.911+0000 7effc8589b80 1 -- start start 2023-10-06T23:14:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.911+0000 7effc8589b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.911+0000 7effc8589b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.911+0000 7effc8589b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.911+0000 7effc8589b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d5767f920 con 0x564d578ada60 2023-10-06T23:14:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.911+0000 7effc8589b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d578b5490 con 0x564d578acbc0 2023-10-06T23:14:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.911+0000 7effc8589b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d578b5b50 con 0x564d578ac260 2023-10-06T23:14:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effae59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effaed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38678/0 (socket says 172.21.15.8:38678) 2023-10-06T23:14:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 -- 172.21.15.8:0/2664853743 learned_addr learned my addr 172.21.15.8:0/2664853743 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effae59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55066/0 (socket says 172.21.15.8:55066) 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 -- 172.21.15.8:0/2664853743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 msgr2=0x564d578b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 --2- 172.21.15.8:0/2664853743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 -- 172.21.15.8:0/2664853743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 msgr2=0x564d578bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 --2- 172.21.15.8:0/2664853743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 -- 172.21.15.8:0/2664853743 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d57650250 con 0x564d578acbc0 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.912+0000 7effadd9b700 1 --2- 172.21.15.8:0/2664853743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578b0f10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effa4005b20 tx=0x7effa4009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a180bd8f9042634 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.913+0000 7eff9d7fa700 1 -- 172.21.15.8:0/2664853743 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400b8b0 con 0x564d578acbc0 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.913+0000 7eff9d7fa700 1 -- 172.21.15.8:0/2664853743 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effa402f170 con 0x564d578acbc0 2023-10-06T23:14:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.913+0000 7eff9d7fa700 1 -- 172.21.15.8:0/2664853743 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4005420 con 0x564d578acbc0 2023-10-06T23:14:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.913+0000 7effc8589b80 1 -- 172.21.15.8:0/2664853743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 msgr2=0x564d578b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.913+0000 7effc8589b80 1 --2- 172.21.15.8:0/2664853743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578b0f10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effa4005b20 tx=0x7effa4009570 comp rx=0 tx=0).stop 2023-10-06T23:14:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 -- 172.21.15.8:0/2664853743 shutdown_connections 2023-10-06T23:14:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 --2- 172.21.15.8:0/2664853743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 --2- 172.21.15.8:0/2664853743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 --2- 172.21.15.8:0/2664853743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578b0f10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 -- 172.21.15.8:0/2664853743 >> 172.21.15.8:0/2664853743 conn(0x564d57820260 msgr2=0x564d578b4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 -- 172.21.15.8:0/2664853743 shutdown_connections 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 -- 172.21.15.8:0/2664853743 wait complete. 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 -- start start 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.914+0000 7effc8589b80 1 Processor -- start 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effc8589b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effc8589b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578bb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effc8589b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effc8589b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d578bce70 con 0x564d578ada60 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effc8589b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d578bcfe0 con 0x564d578acbc0 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effc8589b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d578bd1a0 con 0x564d578ac260 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effc8589b80 10 client.0 _ll_register_callbacks cb 0x564d575f8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effae59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effae59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578bb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55068/0 (socket says 172.21.15.8:55068) 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effae59c700 1 -- 172.21.15.8:0/4278797000 learned_addr learned my addr 172.21.15.8:0/4278797000 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.915+0000 7effadd9b700 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578bb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effaed9d700 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effae59c700 1 -- 172.21.15.8:0/4278797000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 msgr2=0x564d578bb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effae59c700 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578bb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effae59c700 1 -- 172.21.15.8:0/4278797000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 msgr2=0x564d578bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effae59c700 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effae59c700 1 -- 172.21.15.8:0/4278797000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d57629de0 con 0x564d578ac260 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effaed9d700 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effae59c700 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578bb3e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7effa000efc0 tx=0x7effa00b8f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c774464d27991656 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7eff95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7eff95ffb700 1 -- 172.21.15.8:0/4278797000 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa009ad30 con 0x564d578ac260 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7eff95ffb700 1 -- 172.21.15.8:0/4278797000 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7effa0065080 con 0x564d578ac260 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.916+0000 7effc8589b80 1 -- 172.21.15.8:0/4278797000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7effa401e040 con 0x564d578ac260 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7eff95ffb700 1 -- 172.21.15.8:0/4278797000 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7effa007e020 con 0x564d578ac260 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7effc8589b80 10 client.25441 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7effc8589b80 1 -- 172.21.15.8:0/4278797000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564d576282b0 con 0x564d578ac260 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7eff95ffb700 1 -- 172.21.15.8:0/4278797000 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effa401e040 con 0x564d578ac260 2023-10-06T23:14:12.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7eff95ffb700 1 -- 172.21.15.8:0/4278797000 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7effa00a2530 con 0x564d578ac260 2023-10-06T23:14:12.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7effc8589b80 10 client.25441 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:12.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7effc8589b80 10 client.25441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:12.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7effc8589b80 20 client.25441 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:12.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7effc8589b80 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d57916be0 0x564d57919000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:12.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7effc8589b80 4 client.25441 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:14:12.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.917+0000 7effc8589b80 1 -- 172.21.15.8:0/4278797000 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564d577f7b30 con 0x564d57916be0 2023-10-06T23:14:12.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.918+0000 7effadd9b700 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d57916be0 0x564d57919000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:12.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.918+0000 7effadd9b700 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d57916be0 0x564d57919000 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453469f8d36218ea server_cookie=3e82442c3a8b3dc8 in_seq=0 out_seq=0 2023-10-06T23:14:12.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.918+0000 7eff95ffb700 10 client.25441 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:12.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7eff95ffb700 1 -- 172.21.15.8:0/4278797000 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564d577f7b30 con 0x564d57916be0 2023-10-06T23:14:12.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7eff95ffb700 10 client.25441 handle_command_reply: tid=0 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 client.25441 shutdown 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 -- 172.21.15.8:0/4278797000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 msgr2=0x564d578bb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578bb3e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7effa000efc0 tx=0x7effa00b8f90 comp rx=0 tx=0).stop 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 -- 172.21.15.8:0/4278797000 shutdown_connections 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564d57916be0 0x564d57919000 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d578ada60 0x564d578bc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d578ac260 0x564d578bb3e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 --2- 172.21.15.8:0/4278797000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d578acbc0 0x564d578bb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 -- 172.21.15.8:0/4278797000 >> 172.21.15.8:0/4278797000 conn(0x564d57820260 msgr2=0x564d578b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7eff95ffb700 0 client.25441 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 -- 172.21.15.8:0/4278797000 shutdown_connections 2023-10-06T23:14:12.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 1 -- 172.21.15.8:0/4278797000 wait complete. 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.919+0000 7effc8589b80 20 client.25441 trim_cache size 0 max 16384 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:14:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:14:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:14:12.926 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:14:12.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 -- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff980a1480 msgr2=0x7eff980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff980a1480 0x7eff980a3940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7effa800f870 tx=0x7effa800fc30 comp rx=0 tx=0).stop 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 -- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0103110 msgr2=0x7effb0198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0103110 0x7effb0198d40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7effa000ea50 tx=0x7effa000ed60 comp rx=0 tx=0).stop 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 -- 172.21.15.8:0/1229115696 shutdown_connections 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7eff980a1480 0x7eff980a3940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effb0103110 0x7effb0198d40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effb0104ca0 0x7effb01a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 --2- 172.21.15.8:0/1229115696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7effb0104300 0x7effb0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 -- 172.21.15.8:0/1229115696 >> 172.21.15.8:0/1229115696 conn(0x7effb00fe660 msgr2=0x7effb01009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 -- 172.21.15.8:0/1229115696 shutdown_connections 2023-10-06T23:14:12.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:12.920+0000 7effb4bff700 1 -- 172.21.15.8:0/1229115696 wait complete. 2023-10-06T23:14:12.939 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:14:13.060 INFO:teuthology.orchestra.run.smithi008.stderr:2200000 of 3200000 tuples (68%) done (elapsed 36.53 s, remaining 16.60 s) 2023-10-06T23:14:13.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:13 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:14:13.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:13 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:14:13.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:13 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:14:14.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:14 smithi156 ceph-mon[102862]: pgmap v390: 97 pgs: 97 active+clean; 504 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-10-06T23:14:14.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:14 smithi008 ceph-mon[98532]: pgmap v390: 97 pgs: 97 active+clean; 504 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-10-06T23:14:14.400 INFO:teuthology.orchestra.run.smithi008.stderr:2300000 of 3200000 tuples (71%) done (elapsed 37.87 s, remaining 14.82 s) 2023-10-06T23:14:14.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:14 smithi190 ceph-mon[102658]: pgmap v390: 97 pgs: 97 active+clean; 504 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-10-06T23:14:15.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 -- 172.21.15.8:0/238879751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff100102060 msgr2=0x7ff1001024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 --2- 172.21.15.8:0/238879751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff100102060 0x7ff1001024e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009990 tx=0x7ff0f4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 -- 172.21.15.8:0/238879751 shutdown_connections 2023-10-06T23:14:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 --2- 172.21.15.8:0/238879751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff100102a20 0x7ff100109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 --2- 172.21.15.8:0/238879751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff100100f10 0x7ff100101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 --2- 172.21.15.8:0/238879751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff100102060 0x7ff1001024e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 -- 172.21.15.8:0/238879751 >> 172.21.15.8:0/238879751 conn(0x7ff1000fc460 msgr2=0x7ff1000fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 -- 172.21.15.8:0/238879751 shutdown_connections 2023-10-06T23:14:15.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.155+0000 7ff1053ff700 1 -- 172.21.15.8:0/238879751 wait complete. 2023-10-06T23:14:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.157+0000 7ff1053ff700 1 Processor -- start 2023-10-06T23:14:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.157+0000 7ff1053ff700 1 -- start start 2023-10-06T23:14:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.157+0000 7ff1053ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff100100f10 0x7ff10019d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.157+0000 7ff1053ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff100102060 0x7ff10019d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.160 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.157+0000 7ff1053ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff100102a20 0x7ff10019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.157+0000 7ff1053ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10019ec10 con 0x7ff100100f10 2023-10-06T23:14:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.157+0000 7ff1053ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10019ed80 con 0x7ff100102a20 2023-10-06T23:14:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.157+0000 7ff1053ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10019ef40 con 0x7ff100102060 2023-10-06T23:14:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.158+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff100100f10 0x7ff10019d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.158+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff100100f10 0x7ff10019d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36048/0 (socket says 172.21.15.8:36048) 2023-10-06T23:14:15.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.158+0000 7ff0feffd700 1 -- 172.21.15.8:0/3048946629 learned_addr learned my addr 172.21.15.8:0/3048946629 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0feffd700 1 -- 172.21.15.8:0/3048946629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff100102060 msgr2=0x7ff10019d730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T23:14:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff100102060 0x7ff10019d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0feffd700 1 -- 172.21.15.8:0/3048946629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff100102a20 msgr2=0x7ff10019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff100102a20 0x7ff10019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0feffd700 1 -- 172.21.15.8:0/3048946629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f8009c40 con 0x7ff100100f10 2023-10-06T23:14:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff100100f10 0x7ff10019d1f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000d950 tx=0x7ff0f000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0e7fff700 1 -- 172.21.15.8:0/3048946629 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0009b40 con 0x7ff100100f10 2023-10-06T23:14:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0e7fff700 1 -- 172.21.15.8:0/3048946629 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0f0009ca0 con 0x7ff100100f10 2023-10-06T23:14:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.159+0000 7ff0e7fff700 1 -- 172.21.15.8:0/3048946629 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000f3c0 con 0x7ff100100f10 2023-10-06T23:14:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.160+0000 7ff1053ff700 1 -- 172.21.15.8:0/3048946629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f40095f0 con 0x7ff100100f10 2023-10-06T23:14:15.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.160+0000 7ff1053ff700 1 -- 172.21.15.8:0/3048946629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1001a5800 con 0x7ff100100f10 2023-10-06T23:14:15.166 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.165+0000 7ff0e7fff700 1 -- 172.21.15.8:0/3048946629 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff0f0010460 con 0x7ff100100f10 2023-10-06T23:14:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.166+0000 7ff118c99b80 1 Processor -- start 2023-10-06T23:14:15.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.166+0000 7ff118c99b80 1 -- start start 2023-10-06T23:14:15.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.166+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2662ec0 0x55fde26632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.166+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2663fd0 0x55fde2664450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.166+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde266b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff118c99b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde25cb400 con 0x55fde2662ec0 2023-10-06T23:14:15.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff118c99b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde25bcbc0 con 0x55fde2664990 2023-10-06T23:14:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff118c99b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde25ba4e0 con 0x55fde2663fd0 2023-10-06T23:14:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2662ec0 0x55fde26632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0ff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2662ec0 0x55fde26632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36062/0 (socket says 172.21.15.8:36062) 2023-10-06T23:14:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/444371640 learned_addr learned my addr 172.21.15.8:0/444371640 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0feffd700 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2663fd0 0x55fde2664450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0fe7fc700 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde266b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0e7fff700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0e80a1500 0x7ff0e80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0e7fff700 1 -- 172.21.15.8:0/3048946629 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0f00ccbf0 con 0x7ff100100f10 2023-10-06T23:14:15.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0feffd700 1 -- 172.21.15.8:0/444371640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 msgr2=0x55fde266b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0feffd700 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde266b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0feffd700 1 -- 172.21.15.8:0/444371640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2662ec0 msgr2=0x55fde26632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0feffd700 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2662ec0 0x55fde26632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.167+0000 7ff0feffd700 1 -- 172.21.15.8:0/444371640 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fde23e0d80 con 0x55fde2663fd0 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.168+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0e80a1500 0x7ff0e80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.168+0000 7ff0feffd700 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2663fd0 0x55fde2664450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ca750 tx=0x7ff0f0095c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840441b5d6dd31ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.168+0000 7ff0e57fa700 1 -- 172.21.15.8:0/444371640 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f00d0050 con 0x55fde2663fd0 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.168+0000 7ff0e57fa700 1 -- 172.21.15.8:0/444371640 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0f0099a60 con 0x55fde2663fd0 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.168+0000 7ff0e57fa700 1 -- 172.21.15.8:0/444371640 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f009e070 con 0x55fde2663fd0 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 -- 172.21.15.8:0/444371640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2663fd0 msgr2=0x55fde2664450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0e80a1500 0x7ff0e80a39c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8009690 tx=0x7ff0f8009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2663fd0 0x55fde2664450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ca750 tx=0x7ff0f0095c50 comp rx=0 tx=0).stop 2023-10-06T23:14:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 -- 172.21.15.8:0/444371640 shutdown_connections 2023-10-06T23:14:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2662ec0 0x55fde26632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde266b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 --2- 172.21.15.8:0/444371640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2663fd0 0x55fde2664450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 -- 172.21.15.8:0/444371640 >> 172.21.15.8:0/444371640 conn(0x55fde25d7200 msgr2=0x55fde265dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 -- 172.21.15.8:0/444371640 shutdown_connections 2023-10-06T23:14:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.169+0000 7ff118c99b80 1 -- 172.21.15.8:0/444371640 wait complete. 2023-10-06T23:14:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.170+0000 7ff118c99b80 1 -- start start 2023-10-06T23:14:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.170+0000 7ff118c99b80 1 Processor -- start 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.170+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.170+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde266cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.170+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde2673ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.170+0000 7ff118c99b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde25b5dd0 con 0x55fde2663fd0 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.170+0000 7ff118c99b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde25526b0 con 0x55fde2662ec0 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.170+0000 7ff118c99b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde2552350 con 0x55fde2664990 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff118c99b80 10 client.0 _ll_register_callbacks cb 0x55fde23af7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0ff7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde2673ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0fe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde266cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38722/0 (socket says 172.21.15.8:38722) 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0feffd700 1 -- 172.21.15.8:0/3041024578 learned_addr learned my addr 172.21.15.8:0/3041024578 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3041024578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 msgr2=0x55fde266ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3041024578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 msgr2=0x55fde266cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde266cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3041024578 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1001a5800 con 0x55fde2664990 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.171+0000 7ff0fe7fc700 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde266cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.172+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde2673ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55fde2662c60 tx=0x7ff0f8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a08dcc68fb07a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.172+0000 7ff0e2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.172+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3041024578 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f801f070 con 0x55fde2664990 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.172+0000 7ff118c99b80 1 -- 172.21.15.8:0/3041024578 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fde2655d50 con 0x55fde2664990 2023-10-06T23:14:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.172+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3041024578 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0f8018600 con 0x55fde2664990 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.172+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3041024578 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0f800e030 con 0x55fde2664990 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.172+0000 7ff118c99b80 10 client.25450 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.172+0000 7ff118c99b80 1 -- 172.21.15.8:0/3041024578 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fde23c9c00 con 0x55fde2664990 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.173+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3041024578 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fde2655d50 con 0x55fde2664990 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.173+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3041024578 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff0f80246c0 con 0x55fde2664990 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.173+0000 7ff118c99b80 10 client.25450 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.173+0000 7ff118c99b80 10 client.25450 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.173+0000 7ff118c99b80 20 client.25450 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.173+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fde26789d0 0x55fde267adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.173+0000 7ff118c99b80 4 client.25450 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:14:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.173+0000 7ff118c99b80 1 -- 172.21.15.8:0/3041024578 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fde25aedb0 con 0x55fde26789d0 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.175+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fde26789d0 0x55fde267adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.175+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fde26789d0 0x55fde267adf0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6688e2be2f9a7657 server_cookie=a88f15697153e716 in_seq=0 out_seq=0 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.175+0000 7ff0e2ff5700 10 client.25450 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3041024578 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fde25aedb0 con 0x55fde26789d0 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff0e2ff5700 10 client.25450 handle_command_reply: tid=0 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 client.25450 shutdown 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 -- 172.21.15.8:0/3041024578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 msgr2=0x55fde2673ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde2673ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55fde2662c60 tx=0x7ff0f8004ad0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 -- 172.21.15.8:0/3041024578 shutdown_connections 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fde26789d0 0x55fde267adf0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde2673ff0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff0e2ff5700 0 client.25450 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3041024578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde266cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.176+0000 7ff118c99b80 1 -- 172.21.15.8:0/3041024578 >> 172.21.15.8:0/3041024578 conn(0x55fde25d7200 msgr2=0x55fde265d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.177+0000 7ff118c99b80 1 -- 172.21.15.8:0/3041024578 shutdown_connections 2023-10-06T23:14:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.177+0000 7ff118c99b80 1 -- 172.21.15.8:0/3041024578 wait complete. 2023-10-06T23:14:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.177+0000 7ff118c99b80 20 client.25450 trim_cache size 0 max 16384 2023-10-06T23:14:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.198+0000 7ff118c99b80 1 Processor -- start 2023-10-06T23:14:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.198+0000 7ff118c99b80 1 -- start start 2023-10-06T23:14:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.198+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.198+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2673fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.198+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde266ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.198+0000 7ff118c99b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde24368c0 con 0x55fde2663fd0 2023-10-06T23:14:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.198+0000 7ff118c99b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde266bf20 con 0x55fde2662ec0 2023-10-06T23:14:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.198+0000 7ff118c99b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde2675c60 con 0x55fde2664990 2023-10-06T23:14:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2673fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2673fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36082/0 (socket says 172.21.15.8:36082) 2023-10-06T23:14:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 -- 172.21.15.8:0/3760343537 learned_addr learned my addr 172.21.15.8:0/3760343537 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde266ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 -- 172.21.15.8:0/3760343537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 msgr2=0x55fde266ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde266ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 -- 172.21.15.8:0/3760343537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 msgr2=0x55fde266c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 -- 172.21.15.8:0/3760343537 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fde24071f0 con 0x55fde2663fd0 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.199+0000 7ff0fe7fc700 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2673fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009990 tx=0x7ff0f400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d0531cb6c157b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.200+0000 7ff0e5ffb700 1 -- 172.21.15.8:0/3760343537 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f401f040 con 0x55fde2663fd0 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.200+0000 7ff0e5ffb700 1 -- 172.21.15.8:0/3760343537 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0f4005710 con 0x55fde2663fd0 2023-10-06T23:14:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.200+0000 7ff0e5ffb700 1 -- 172.21.15.8:0/3760343537 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400bcd0 con 0x55fde2663fd0 2023-10-06T23:14:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 -- 172.21.15.8:0/3760343537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 msgr2=0x55fde2673fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2673fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009990 tx=0x7ff0f400b260 comp rx=0 tx=0).stop 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 -- 172.21.15.8:0/3760343537 shutdown_connections 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2664990 0x55fde266ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2662ec0 0x55fde266c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3760343537 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2673fb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 -- 172.21.15.8:0/3760343537 >> 172.21.15.8:0/3760343537 conn(0x55fde25d7200 msgr2=0x55fde266b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 -- 172.21.15.8:0/3760343537 shutdown_connections 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 -- 172.21.15.8:0/3760343537 wait complete. 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 -- start start 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.201+0000 7ff118c99b80 1 Processor -- start 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2662ec0 0x55fde26718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2671df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff118c99b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde2672e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff118c99b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde2673340 con 0x55fde2663fd0 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff118c99b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde26734b0 con 0x55fde2664990 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff118c99b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fde2673670 con 0x55fde2662ec0 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff118c99b80 10 client.0 _ll_register_callbacks cb 0x7ff0f80090b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2662ec0 0x55fde26718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2662ec0 0x55fde26718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55126/0 (socket says 172.21.15.8:55126) 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.202+0000 7ff0feffd700 1 -- 172.21.15.8:0/3852700066 learned_addr learned my addr 172.21.15.8:0/3852700066 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde2672e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0fe7fc700 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2671df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3852700066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2662ec0 msgr2=0x55fde26718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2662ec0 0x55fde26718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3852700066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 msgr2=0x55fde2671df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2671df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3852700066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fde23e0d80 con 0x55fde2664990 2023-10-06T23:14:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0ff7fe700 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde2672e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8024af0 tx=0x7ff0f80094f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feabef7e99450f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2662ec0 0x55fde26718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.203+0000 7ff0e2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:14:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.204+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3852700066 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f801f050 con 0x55fde2664990 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.204+0000 7ff118c99b80 1 -- 172.21.15.8:0/3852700066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0f0099a60 con 0x55fde2664990 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.204+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3852700066 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0f800e030 con 0x55fde2664990 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.204+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3852700066 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0f803d030 con 0x55fde2664990 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.204+0000 7ff118c99b80 10 client.25415 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.204+0000 7ff118c99b80 1 -- 172.21.15.8:0/3852700066 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7ff100109c70 con 0x55fde2664990 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.204+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3852700066 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0f0099a60 con 0x55fde2664990 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.204+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3852700066 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff0f8037a80 con 0x55fde2664990 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff118c99b80 10 client.25415 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff118c99b80 10 client.25415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff118c99b80 20 client.25415 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fde26cd3a0 0x55fde26cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff118c99b80 4 client.25415 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:14:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff118c99b80 1 -- 172.21.15.8:0/3852700066 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fde25aead0 con 0x55fde26cd3a0 2023-10-06T23:14:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fde26cd3a0 0x55fde26cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff0feffd700 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fde26cd3a0 0x55fde26cf7c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d4f5f29f6bdf45 server_cookie=e4526c0c2d211bce in_seq=0 out_seq=0 2023-10-06T23:14:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.205+0000 7ff0e2ff5700 10 client.25415 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.215+0000 7ff0e2ff5700 1 -- 172.21.15.8:0/3852700066 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fde25aead0 con 0x55fde26cd3a0 2023-10-06T23:14:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.215+0000 7ff0e2ff5700 10 client.25415 handle_command_reply: tid=0 2023-10-06T23:14:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 client.25415 shutdown 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 -- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 msgr2=0x55fde2672e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde2672e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8024af0 tx=0x7ff0f80094f0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 -- 172.21.15.8:0/3852700066 shutdown_connections 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fde26cd3a0 0x55fde26cf7c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fde2664990 0x55fde2672e00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff0e2ff5700 0 client.25415 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fde2662ec0 0x55fde26718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 --2- 172.21.15.8:0/3852700066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fde2663fd0 0x55fde2671df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 -- 172.21.15.8:0/3852700066 >> 172.21.15.8:0/3852700066 conn(0x55fde25d7200 msgr2=0x55fde266ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 -- 172.21.15.8:0/3852700066 shutdown_connections 2023-10-06T23:14:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 1 -- 172.21.15.8:0/3852700066 wait complete. 2023-10-06T23:14:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.216+0000 7ff118c99b80 20 client.25415 trim_cache size 0 max 16384 2023-10-06T23:14:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:14:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:14:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:14:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:14:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 -- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0e80a1500 msgr2=0x7ff0e80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0e80a1500 0x7ff0e80a39c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8009690 tx=0x7ff0f8009920 comp rx=0 tx=0).stop 2023-10-06T23:14:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 -- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff100100f10 msgr2=0x7ff10019d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff100100f10 0x7ff10019d1f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000d950 tx=0x7ff0f000dd10 comp rx=0 tx=0).stop 2023-10-06T23:14:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 -- 172.21.15.8:0/3048946629 shutdown_connections 2023-10-06T23:14:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff0e80a1500 0x7ff0e80a39c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff100100f10 0x7ff10019d1f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff100102a20 0x7ff10019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 --2- 172.21.15.8:0/3048946629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff100102060 0x7ff10019d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 -- 172.21.15.8:0/3048946629 >> 172.21.15.8:0/3048946629 conn(0x7ff1000fc460 msgr2=0x7ff1000fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 -- 172.21.15.8:0/3048946629 shutdown_connections 2023-10-06T23:14:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:15.217+0000 7ff1053ff700 1 -- 172.21.15.8:0/3048946629 wait complete. 2023-10-06T23:14:16.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:16 smithi156 ceph-mon[102862]: pgmap v391: 97 pgs: 97 active+clean; 524 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 23 op/s 2023-10-06T23:14:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:16 smithi008 ceph-mon[98532]: pgmap v391: 97 pgs: 97 active+clean; 524 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 23 op/s 2023-10-06T23:14:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:16 smithi190 ceph-mon[102658]: pgmap v391: 97 pgs: 97 active+clean; 524 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 23 op/s 2023-10-06T23:14:16.696 INFO:teuthology.orchestra.run.smithi008.stderr:2400000 of 3200000 tuples (75%) done (elapsed 40.16 s, remaining 13.39 s) 2023-10-06T23:14:18.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:18 smithi156 ceph-mon[102862]: pgmap v392: 97 pgs: 97 active+clean; 572 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-10-06T23:14:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:18 smithi008 ceph-mon[98532]: pgmap v392: 97 pgs: 97 active+clean; 572 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-10-06T23:14:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:18 smithi190 ceph-mon[102658]: pgmap v392: 97 pgs: 97 active+clean; 572 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 32 MiB/s wr, 26 op/s 2023-10-06T23:14:18.482 INFO:teuthology.orchestra.run.smithi008.stderr:2500000 of 3200000 tuples (78%) done (elapsed 41.95 s, remaining 11.75 s) 2023-10-06T23:14:19.809 INFO:teuthology.orchestra.run.smithi008.stderr:2600000 of 3200000 tuples (81%) done (elapsed 43.28 s, remaining 9.99 s) 2023-10-06T23:14:20.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:20 smithi156 ceph-mon[102862]: pgmap v393: 97 pgs: 97 active+clean; 588 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-10-06T23:14:20.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:20 smithi008 ceph-mon[98532]: pgmap v393: 97 pgs: 97 active+clean; 588 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-10-06T23:14:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:20 smithi190 ceph-mon[102658]: pgmap v393: 97 pgs: 97 active+clean; 588 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-10-06T23:14:21.593 INFO:teuthology.orchestra.run.smithi008.stderr:2700000 of 3200000 tuples (84%) done (elapsed 45.06 s, remaining 8.34 s) 2023-10-06T23:14:22.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:22 smithi156 ceph-mon[102862]: pgmap v394: 97 pgs: 97 active+clean; 616 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-10-06T23:14:22.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:22 smithi008 ceph-mon[98532]: pgmap v394: 97 pgs: 97 active+clean; 616 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-10-06T23:14:22.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:22 smithi190 ceph-mon[102658]: pgmap v394: 97 pgs: 97 active+clean; 616 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-10-06T23:14:22.964 INFO:teuthology.orchestra.run.smithi008.stderr:2800000 of 3200000 tuples (87%) done (elapsed 46.43 s, remaining 6.63 s) 2023-10-06T23:14:23.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:23 smithi156 ceph-mon[102862]: pgmap v395: 97 pgs: 97 active+clean; 642 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-10-06T23:14:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:23 smithi008 ceph-mon[98532]: pgmap v395: 97 pgs: 97 active+clean; 642 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-10-06T23:14:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:23 smithi190 ceph-mon[102658]: pgmap v395: 97 pgs: 97 active+clean; 642 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-10-06T23:14:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2900000 of 3200000 tuples (90%) done (elapsed 48.23 s, remaining 4.99 s) 2023-10-06T23:14:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:26 smithi156 ceph-mon[102862]: pgmap v396: 97 pgs: 97 active+clean; 670 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-10-06T23:14:26.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:26 smithi008 ceph-mon[98532]: pgmap v396: 97 pgs: 97 active+clean; 670 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-10-06T23:14:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:26 smithi190 ceph-mon[102658]: pgmap v396: 97 pgs: 97 active+clean; 670 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-10-06T23:14:26.662 INFO:teuthology.orchestra.run.smithi008.stderr:3000000 of 3200000 tuples (93%) done (elapsed 50.13 s, remaining 3.34 s) 2023-10-06T23:14:27.995 INFO:teuthology.orchestra.run.smithi008.stderr:3100000 of 3200000 tuples (96%) done (elapsed 51.46 s, remaining 1.66 s) 2023-10-06T23:14:28.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:28 smithi156 ceph-mon[102862]: pgmap v397: 97 pgs: 97 active+clean; 702 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-10-06T23:14:28.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:28 smithi008 ceph-mon[98532]: pgmap v397: 97 pgs: 97 active+clean; 702 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 -- 172.21.15.8:0/3916926687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4102a20 msgr2=0x7fd0d4109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/3916926687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4102a20 0x7fd0d4109340 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00b0a0 tx=0x7fd0cc00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 -- 172.21.15.8:0/3916926687 shutdown_connections 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/3916926687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4102a20 0x7fd0d4109340 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/3916926687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0d4100f10 0x7fd0d4101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/3916926687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0d4102060 0x7fd0d41024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 -- 172.21.15.8:0/3916926687 >> 172.21.15.8:0/3916926687 conn(0x7fd0d40fc460 msgr2=0x7fd0d40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 -- 172.21.15.8:0/3916926687 shutdown_connections 2023-10-06T23:14:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.412+0000 7fd0d97ff700 1 -- 172.21.15.8:0/3916926687 wait complete. 2023-10-06T23:14:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.414+0000 7fd0d97ff700 1 Processor -- start 2023-10-06T23:14:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.414+0000 7fd0d97ff700 1 -- start start 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.414+0000 7fd0d97ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4100f10 0x7fd0d4196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.414+0000 7fd0d97ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0d4102060 0x7fd0d41972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.414+0000 7fd0d97ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0d4102a20 0x7fd0d4197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.414+0000 7fd0d97ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d41986f0 con 0x7fd0d4100f10 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.414+0000 7fd0d97ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d4198860 con 0x7fd0d4102060 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.414+0000 7fd0d97ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d4198a20 con 0x7fd0d4102a20 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4100f10 0x7fd0d4196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0d4102060 0x7fd0d41972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0d4102060 0x7fd0d41972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53112/0 (socket says 172.21.15.8:53112) 2023-10-06T23:14:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d27fc700 1 -- 172.21.15.8:0/119661691 learned_addr learned my addr 172.21.15.8:0/119661691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d37fe700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0d4102a20 0x7fd0d4197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/119661691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0d4102a20 msgr2=0x7fd0d4197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0d4102a20 0x7fd0d4197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/119661691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0d4102060 msgr2=0x7fd0d41972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0d4102060 0x7fd0d41972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/119661691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc009d00 con 0x7fd0d4100f10 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.415+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0d4102060 0x7fd0d41972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.416+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4100f10 0x7fd0d4196d70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400e9f0 tx=0x7fd0c400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.416+0000 7fd0bbfff700 1 -- 172.21.15.8:0/119661691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400c9c0 con 0x7fd0d4100f10 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.416+0000 7fd0bbfff700 1 -- 172.21.15.8:0/119661691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0c4010430 con 0x7fd0d4100f10 2023-10-06T23:14:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.416+0000 7fd0bbfff700 1 -- 172.21.15.8:0/119661691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4018680 con 0x7fd0d4100f10 2023-10-06T23:14:28.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.416+0000 7fd0d97ff700 1 -- 172.21.15.8:0/119661691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d4198d00 con 0x7fd0d4100f10 2023-10-06T23:14:28.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.416+0000 7fd0d97ff700 1 -- 172.21.15.8:0/119661691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d419f420 con 0x7fd0d4100f10 2023-10-06T23:14:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.420+0000 7fd0bbfff700 1 -- 172.21.15.8:0/119661691 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd0c40105a0 con 0x7fd0d4100f10 2023-10-06T23:14:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.421+0000 7fd0ed06eb80 1 Processor -- start 2023-10-06T23:14:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.421+0000 7fd0ed06eb80 1 -- start start 2023-10-06T23:14:28.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be46794860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be4679b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be466f7400 con 0x55be46794da0 2023-10-06T23:14:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be466e8bc0 con 0x55be467932d0 2023-10-06T23:14:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be466e64e0 con 0x55be467943e0 2023-10-06T23:14:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0d2ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be46794860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0d37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0d37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53120/0 (socket says 172.21.15.8:53120) 2023-10-06T23:14:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0d37fe700 1 -- 172.21.15.8:0/1808399408 learned_addr learned my addr 172.21.15.8:0/1808399408 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0bc0a1500 0x7fd0bc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.422+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/1808399408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be4679b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0bbfff700 1 -- 172.21.15.8:0/119661691 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0c4014070 con 0x7fd0d4100f10 2023-10-06T23:14:28.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0d37fe700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0bc0a1500 0x7fd0bc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/1808399408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 msgr2=0x55be467936f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:28.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/1808399408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467936f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/1808399408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 msgr2=0x55be4679b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/1808399408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be4679b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/1808399408 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4650cd80 con 0x55be467943e0 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/1808399408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be46794860 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40ca8f0 tx=0x7fd0c4009790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4a922da05bd0ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.423+0000 7fd0b97fa700 1 -- 172.21.15.8:0/1808399408 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4099e90 con 0x55be467943e0 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.424+0000 7fd0d37fe700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0bc0a1500 0x7fd0bc0a39c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55be46793070 tx=0x7fd0cc00b3b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.424+0000 7fd0b97fa700 1 -- 172.21.15.8:0/1808399408 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0c4099c00 con 0x55be467943e0 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.424+0000 7fd0b97fa700 1 -- 172.21.15.8:0/1808399408 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40a2450 con 0x55be467943e0 2023-10-06T23:14:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.424+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1808399408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 msgr2=0x55be46794860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.424+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1808399408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be46794860 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40ca8f0 tx=0x7fd0c4009790 comp rx=0 tx=0).stop 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.425+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1808399408 shutdown_connections 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.425+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1808399408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be4679b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.425+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1808399408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467936f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.425+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1808399408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be46794860 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.425+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1808399408 >> 172.21.15.8:0/1808399408 conn(0x55be46703200 msgr2=0x55be46789b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.425+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1808399408 shutdown_connections 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.425+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1808399408 wait complete. 2023-10-06T23:14:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.425+0000 7fd0ed06eb80 1 -- start start 2023-10-06T23:14:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.426+0000 7fd0ed06eb80 1 Processor -- start 2023-10-06T23:14:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.426+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be4678f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.426+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be4678f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.426+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be4678c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.426+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be466e1dd0 con 0x55be46794da0 2023-10-06T23:14:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.426+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4667e6b0 con 0x55be467932d0 2023-10-06T23:14:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.426+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4667e350 con 0x55be467943e0 2023-10-06T23:14:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.426+0000 7fd0ed06eb80 10 client.0 _ll_register_callbacks cb 0x55be464db7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d27fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be4678f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be4678f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d27fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be4678f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45498/0 (socket says 172.21.15.8:45498) 2023-10-06T23:14:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d27fc700 1 -- 172.21.15.8:0/155330471 learned_addr learned my addr 172.21.15.8:0/155330471 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be4678f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53134/0 (socket says 172.21.15.8:53134) 2023-10-06T23:14:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d37fe700 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be4678c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/155330471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 msgr2=0x55be4678f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be4678f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/155330471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 msgr2=0x55be4678c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be4678c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d2ffd700 1 -- 172.21.15.8:0/155330471 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d419f420 con 0x55be467932d0 2023-10-06T23:14:28.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.427+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be4678f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be4678f4b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4000c00 tx=0x7fd0c400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde39adc1c0d0d55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0b6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:14:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/155330471 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40adea0 con 0x55be467932d0 2023-10-06T23:14:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/155330471 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0c4010880 con 0x55be467932d0 2023-10-06T23:14:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/155330471 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be46781d50 con 0x55be467932d0 2023-10-06T23:14:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/155330471 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0c4099a20 con 0x55be467932d0 2023-10-06T23:14:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0ed06eb80 10 client.25427 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:28.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/155330471 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55be464f5c00 con 0x55be467932d0 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.428+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/155330471 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55be46781d50 con 0x55be467932d0 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.429+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/155330471 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd0c400cb20 con 0x55be467932d0 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.429+0000 7fd0ed06eb80 10 client.25427 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.429+0000 7fd0ed06eb80 10 client.25427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.429+0000 7fd0ed06eb80 20 client.25427 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.430+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be467acd60 0x55be467af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.430+0000 7fd0ed06eb80 4 client.25427 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.430+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/155330471 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be466dadb0 con 0x55be467acd60 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.430+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be467acd60 0x55be467af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.430+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be467acd60 0x55be467af180 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=653e5647aa2d3743 server_cookie=e78150051757700c in_seq=0 out_seq=0 2023-10-06T23:14:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.430+0000 7fd0b6ff5700 10 client.25427 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/155330471 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55be466dadb0 con 0x55be467acd60 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0b6ff5700 10 client.25427 handle_command_reply: tid=0 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 client.25427 shutdown 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/155330471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 msgr2=0x55be4678f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be4678f4b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4000c00 tx=0x7fd0c400c6e0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/155330471 shutdown_connections 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be467acd60 0x55be467af180 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be4678c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be4678f4b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/155330471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be4678f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.431+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/155330471 >> 172.21.15.8:0/155330471 conn(0x55be46703200 msgr2=0x55be46789250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.432+0000 7fd0b6ff5700 0 client.25427 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.432+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/155330471 shutdown_connections 2023-10-06T23:14:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.432+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/155330471 wait complete. 2023-10-06T23:14:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.432+0000 7fd0ed06eb80 20 client.25427 trim_cache size 0 max 16384 2023-10-06T23:14:28.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:28 smithi190 ceph-mon[102658]: pgmap v397: 97 pgs: 97 active+clean; 702 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-10-06T23:14:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.448+0000 7fd0ed06eb80 1 Processor -- start 2023-10-06T23:14:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.448+0000 7fd0ed06eb80 1 -- start start 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467932d0 0x55be467947c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be467943e0 0x55be46789250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be46794da0 0x55be467aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be465628c0 con 0x55be467943e0 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be46789790 con 0x55be46794da0 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be46797860 con 0x55be467932d0 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be467943e0 0x55be46789250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d2ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467932d0 0x55be467947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be467943e0 0x55be46789250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46346/0 (socket says 172.21.15.8:46346) 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d2ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467932d0 0x55be467947c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45500/0 (socket says 172.21.15.8:45500) 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d27fc700 1 -- 172.21.15.8:0/590563860 learned_addr learned my addr 172.21.15.8:0/590563860 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d37fe700 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be46794da0 0x55be467aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d27fc700 1 -- 172.21.15.8:0/590563860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467932d0 msgr2=0x55be467947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467932d0 0x55be467947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d27fc700 1 -- 172.21.15.8:0/590563860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be46794da0 msgr2=0x55be467aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.449+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be46794da0 0x55be467aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.450+0000 7fd0d27fc700 1 -- 172.21.15.8:0/590563860 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be465331f0 con 0x55be467943e0 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.450+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467932d0 0x55be467947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.450+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be467943e0 0x55be46789250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8011800 tx=0x7fd0c800b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5a6727e8eda720 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.450+0000 7fd0b9ffb700 1 -- 172.21.15.8:0/590563860 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8011ea0 con 0x55be467943e0 2023-10-06T23:14:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.450+0000 7fd0b9ffb700 1 -- 172.21.15.8:0/590563860 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0c8017040 con 0x55be467943e0 2023-10-06T23:14:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.450+0000 7fd0b9ffb700 1 -- 172.21.15.8:0/590563860 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8016030 con 0x55be467943e0 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/590563860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be467943e0 msgr2=0x55be46789250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be467943e0 0x55be46789250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8011800 tx=0x7fd0c800b500 comp rx=0 tx=0).stop 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/590563860 shutdown_connections 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be46794da0 0x55be467aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467932d0 0x55be467947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/590563860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be467943e0 0x55be46789250 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/590563860 >> 172.21.15.8:0/590563860 conn(0x55be46703200 msgr2=0x55be467b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/590563860 shutdown_connections 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.451+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/590563860 wait complete. 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.452+0000 7fd0ed06eb80 1 -- start start 2023-10-06T23:14:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.452+0000 7fd0ed06eb80 1 Processor -- start 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467920a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be467925e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0ed06eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be467ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be467ff610 con 0x55be46794da0 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be467ff750 con 0x55be467932d0 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0ed06eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be467ff8e0 con 0x55be467943e0 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0ed06eb80 10 client.0 _ll_register_callbacks cb 0x7fd0c800bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d27fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be467925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467920a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d27fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be467925e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45512/0 (socket says 172.21.15.8:45512) 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d27fc700 1 -- 172.21.15.8:0/1608305787 learned_addr learned my addr 172.21.15.8:0/1608305787 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d37fe700 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be467ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d27fc700 1 -- 172.21.15.8:0/1608305787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 msgr2=0x55be467920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467920a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d27fc700 1 -- 172.21.15.8:0/1608305787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 msgr2=0x55be467ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be467ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d27fc700 1 -- 172.21.15.8:0/1608305787 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be464f5c00 con 0x55be467943e0 2023-10-06T23:14:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.453+0000 7fd0d37fe700 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be467ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:14:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.454+0000 7fd0d27fc700 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be467925e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8005810 tx=0x7fd0c80044a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eac0b19276a0575 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.454+0000 7fd0b6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:14:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.454+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/1608305787 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8011ea0 con 0x55be467943e0 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.454+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1608305787 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0c4099c00 con 0x55be467943e0 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.454+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/1608305787 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0c801fe40 con 0x55be467943e0 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.454+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/1608305787 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0c8016040 con 0x55be467943e0 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.454+0000 7fd0ed06eb80 10 client.25474 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.454+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1608305787 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fd0c80115a0 con 0x55be467943e0 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/1608305787 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0c4099c00 con 0x55be467943e0 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/1608305787 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd0c8028510 con 0x55be467943e0 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0ed06eb80 10 client.25474 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0ed06eb80 10 client.25474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0ed06eb80 20 client.25474 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be468013a0 0x55be468037c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0ed06eb80 4 client.25474 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:14:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1608305787 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55be466daad0 con 0x55be468013a0 2023-10-06T23:14:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.455+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be468013a0 0x55be468037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.456+0000 7fd0d2ffd700 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be468013a0 0x55be468037c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37c7eb996d5a6363 server_cookie=f4d2966707d9fc09 in_seq=0 out_seq=0 2023-10-06T23:14:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.456+0000 7fd0b6ff5700 10 client.25474 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0b6ff5700 1 -- 172.21.15.8:0/1608305787 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55be466daad0 con 0x55be468013a0 2023-10-06T23:14:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0b6ff5700 10 client.25474 handle_command_reply: tid=0 2023-10-06T23:14:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 client.25474 shutdown 2023-10-06T23:14:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1608305787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 msgr2=0x55be467925e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be467925e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8005810 tx=0x7fd0c80044a0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1608305787 shutdown_connections 2023-10-06T23:14:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be468013a0 0x55be468037c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be46794da0 0x55be467ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be467932d0 0x55be467920a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0b6ff5700 0 client.25474 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 --2- 172.21.15.8:0/1608305787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be467943e0 0x55be467925e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.468+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1608305787 >> 172.21.15.8:0/1608305787 conn(0x55be46703200 msgr2=0x55be467aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.469+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1608305787 shutdown_connections 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.469+0000 7fd0ed06eb80 1 -- 172.21.15.8:0/1608305787 wait complete. 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.469+0000 7fd0ed06eb80 20 client.25474 trim_cache size 0 max 16384 2023-10-06T23:14:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:14:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:14:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:14:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:14:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.469+0000 7fd0d97ff700 1 -- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0bc0a1500 msgr2=0x7fd0bc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.469+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0bc0a1500 0x7fd0bc0a39c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55be46793070 tx=0x7fd0cc00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.469+0000 7fd0d97ff700 1 -- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4100f10 msgr2=0x7fd0d4196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.469+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4100f10 0x7fd0d4196d70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400e9f0 tx=0x7fd0c400ed00 comp rx=0 tx=0).stop 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.470+0000 7fd0d97ff700 1 -- 172.21.15.8:0/119661691 shutdown_connections 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.470+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0bc0a1500 0x7fd0bc0a39c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.470+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0d4100f10 0x7fd0d4196d70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.470+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0d4102a20 0x7fd0d4197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.470+0000 7fd0d97ff700 1 --2- 172.21.15.8:0/119661691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0d4102060 0x7fd0d41972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.470+0000 7fd0d97ff700 1 -- 172.21.15.8:0/119661691 >> 172.21.15.8:0/119661691 conn(0x7fd0d40fc460 msgr2=0x7fd0d4105630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.470+0000 7fd0d97ff700 1 -- 172.21.15.8:0/119661691 shutdown_connections 2023-10-06T23:14:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:28.470+0000 7fd0d97ff700 1 -- 172.21.15.8:0/119661691 wait complete. 2023-10-06T23:14:29.861 INFO:teuthology.orchestra.run.smithi008.stderr:3200000 of 3200000 tuples (100%) done (elapsed 53.33 s, remaining 0.00 s) 2023-10-06T23:14:29.952 INFO:teuthology.orchestra.run.smithi008.stderr:vacuum... 2023-10-06T23:14:30.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:30 smithi156 ceph-mon[102862]: pgmap v398: 97 pgs: 97 active+clean; 708 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-10-06T23:14:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:30 smithi008 ceph-mon[98532]: pgmap v398: 97 pgs: 97 active+clean; 708 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-10-06T23:14:30.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:30 smithi190 ceph-mon[102658]: pgmap v398: 97 pgs: 97 active+clean; 708 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-10-06T23:14:32.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:32 smithi156 ceph-mon[102862]: pgmap v399: 97 pgs: 97 active+clean; 754 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2023-10-06T23:14:32.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:14:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:32 smithi008 ceph-mon[98532]: pgmap v399: 97 pgs: 97 active+clean; 754 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2023-10-06T23:14:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:14:32.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:32 smithi190 ceph-mon[102658]: pgmap v399: 97 pgs: 97 active+clean; 754 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 24 op/s 2023-10-06T23:14:32.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:14:33.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:33 smithi156 ceph-mon[102862]: pgmap v400: 97 pgs: 97 active+clean; 768 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 30 op/s 2023-10-06T23:14:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:33 smithi008 ceph-mon[98532]: pgmap v400: 97 pgs: 97 active+clean; 768 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 30 op/s 2023-10-06T23:14:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:33.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:33 smithi190 ceph-mon[102658]: pgmap v400: 97 pgs: 97 active+clean; 768 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 30 op/s 2023-10-06T23:14:34.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:14:34.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:14:34.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:34.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:14:34.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:14:34.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:34.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:14:34.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:14:34.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:14:35.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:35 smithi190 ceph-mon[102658]: pgmap v401: 97 pgs: 97 active+clean; 774 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-10-06T23:14:35.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:35 smithi156 ceph-mon[102862]: pgmap v401: 97 pgs: 97 active+clean; 774 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-10-06T23:14:35.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:35 smithi008 ceph-mon[98532]: pgmap v401: 97 pgs: 97 active+clean; 774 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-10-06T23:14:38.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:38 smithi156 ceph-mon[102862]: pgmap v402: 97 pgs: 97 active+clean; 774 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 31 op/s 2023-10-06T23:14:38.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:38 smithi008 ceph-mon[98532]: pgmap v402: 97 pgs: 97 active+clean; 774 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 31 op/s 2023-10-06T23:14:38.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:38 smithi190 ceph-mon[102658]: pgmap v402: 97 pgs: 97 active+clean; 774 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 31 op/s 2023-10-06T23:14:40.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:40 smithi156 ceph-mon[102862]: pgmap v403: 97 pgs: 97 active+clean; 774 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-10-06T23:14:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:40 smithi008 ceph-mon[98532]: pgmap v403: 97 pgs: 97 active+clean; 774 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-10-06T23:14:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:40 smithi190 ceph-mon[102658]: pgmap v403: 97 pgs: 97 active+clean; 774 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-10-06T23:14:41.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 -- 172.21.15.8:0/252083643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b0100140 msgr2=0x7fe2b01005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/252083643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b0100140 0x7fe2b01005c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40098f0 tx=0x7fe2a4009c00 comp rx=0 tx=0).stop 2023-10-06T23:14:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 -- 172.21.15.8:0/252083643 shutdown_connections 2023-10-06T23:14:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/252083643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b0100b00 0x7fe2b0100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/252083643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2b00ff7e0 0x7fe2b00ffc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/252083643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b0100140 0x7fe2b01005c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 -- 172.21.15.8:0/252083643 >> 172.21.15.8:0/252083643 conn(0x7fe2b00fb340 msgr2=0x7fe2b00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 -- 172.21.15.8:0/252083643 shutdown_connections 2023-10-06T23:14:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.640+0000 7fe2b5dff700 1 -- 172.21.15.8:0/252083643 wait complete. 2023-10-06T23:14:41.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.641+0000 7fe2b5dff700 1 Processor -- start 2023-10-06T23:14:41.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.641+0000 7fe2b5dff700 1 -- start start 2023-10-06T23:14:41.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2b5dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b00ff7e0 0x7fe2b0198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2b5dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b0100140 0x7fe2b0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2b5dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2b0100b00 0x7fe2b019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2b5dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b019a840 con 0x7fe2b0100140 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2b5dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b019a9b0 con 0x7fe2b0100b00 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2b5dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b019ab70 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2aeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b0100140 0x7fe2b0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2af7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b00ff7e0 0x7fe2b0198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2af7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b00ff7e0 0x7fe2b0198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55952/0 (socket says 172.21.15.8:55952) 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2af7fe700 1 -- 172.21.15.8:0/4198401184 learned_addr learned my addr 172.21.15.8:0/4198401184 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.642+0000 7fe2affff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2b0100b00 0x7fe2b019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2af7fe700 1 -- 172.21.15.8:0/4198401184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2b0100b00 msgr2=0x7fe2b019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2b0100b00 0x7fe2b019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2af7fe700 1 -- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b0100140 msgr2=0x7fe2b0199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b0100140 0x7fe2b0199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2af7fe700 1 -- 172.21.15.8:0/4198401184 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a00095f0 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b00ff7e0 0x7fe2b0198e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000ec10 tx=0x7fe2a000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2acff9700 1 -- 172.21.15.8:0/4198401184 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000cc90 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2acff9700 1 -- 172.21.15.8:0/4198401184 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2a000cdf0 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2b5dff700 1 -- 172.21.15.8:0/4198401184 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a4009520 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.643+0000 7fe2acff9700 1 -- 172.21.15.8:0/4198401184 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003e80 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.644+0000 7fe2b5dff700 1 -- 172.21.15.8:0/4198401184 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b01a1560 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.648+0000 7fe2acff9700 1 -- 172.21.15.8:0/4198401184 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe2a0004000 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2c96cdb80 1 Processor -- start 2023-10-06T23:14:41.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2c96cdb80 1 -- start start 2023-10-06T23:14:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ac22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ac3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac3990 0x55fcb6aca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6a2a400 con 0x55fcb6ac2fd0 2023-10-06T23:14:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6a1bbc0 con 0x55fcb6ac3990 2023-10-06T23:14:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6a194e0 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.649+0000 7fe2acff9700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe2980a1500 0x7fe2980a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2acff9700 1 -- 172.21.15.8:0/4198401184 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe2a0014070 con 0x7fe2b00ff7e0 2023-10-06T23:14:41.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2affff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ac22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ac3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2affff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ac22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55962/0 (socket says 172.21.15.8:55962) 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2affff700 1 -- 172.21.15.8:0/1989956504 learned_addr learned my addr 172.21.15.8:0/1989956504 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2aeffd700 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac3990 0x55fcb6aca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2affff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe2980a1500 0x7fe2980a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2af7fe700 1 -- 172.21.15.8:0/1989956504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 msgr2=0x55fcb6ac22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ac22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2af7fe700 1 -- 172.21.15.8:0/1989956504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac3990 msgr2=0x55fcb6aca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac3990 0x55fcb6aca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2af7fe700 1 -- 172.21.15.8:0/1989956504 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcb683fd80 con 0x55fcb6ac2fd0 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2affff700 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ac22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.650+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ac3450 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c5b0 tx=0x7fe2a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c653f9244ce1fb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.651+0000 7fe2affff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe2980a1500 0x7fe2980a39c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009550 tx=0x7fe2a800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.651+0000 7fe295ffb700 1 -- 172.21.15.8:0/1989956504 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a009ab00 con 0x55fcb6ac2fd0 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.651+0000 7fe295ffb700 1 -- 172.21.15.8:0/1989956504 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2a009a400 con 0x55fcb6ac2fd0 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.651+0000 7fe295ffb700 1 -- 172.21.15.8:0/1989956504 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00987c0 con 0x55fcb6ac2fd0 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1989956504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac2fd0 msgr2=0x55fcb6ac3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ac3450 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c5b0 tx=0x7fe2a000cf60 comp rx=0 tx=0).stop 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1989956504 shutdown_connections 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac3990 0x55fcb6aca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ac22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1989956504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ac3450 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1989956504 >> 172.21.15.8:0/1989956504 conn(0x55fcb6a36200 msgr2=0x55fcb6abcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1989956504 shutdown_connections 2023-10-06T23:14:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1989956504 wait complete. 2023-10-06T23:14:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.652+0000 7fe2c96cdb80 1 -- start start 2023-10-06T23:14:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.653+0000 7fe2c96cdb80 1 Processor -- start 2023-10-06T23:14:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.653+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6acbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.653+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6acc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.653+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac3990 0x55fcb6ad31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.653+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6a14dd0 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.653+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb69b16b0 con 0x55fcb6ac2fd0 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.653+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb69b1350 con 0x55fcb6ac3990 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.653+0000 7fe2c96cdb80 10 client.0 _ll_register_callbacks cb 0x55fcb680e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6acbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2aeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6acc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2affff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac3990 0x55fcb6ad31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6acbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41144/0 (socket says 172.21.15.8:41144) 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2aeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6acc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59250/0 (socket says 172.21.15.8:59250) 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2af7fe700 1 -- 172.21.15.8:0/1724362169 learned_addr learned my addr 172.21.15.8:0/1724362169 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2af7fe700 1 -- 172.21.15.8:0/1724362169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac3990 msgr2=0x55fcb6ad31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac3990 0x55fcb6ad31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2af7fe700 1 -- 172.21.15.8:0/1724362169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 msgr2=0x55fcb6acc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6acc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2af7fe700 1 -- 172.21.15.8:0/1724362169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a8008b50 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.654+0000 7fe2aeffd700 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6acc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6acbc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00cd280 tx=0x7fe2a009ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf95dac11056c3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe28effd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe28effd700 1 -- 172.21.15.8:0/1724362169 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003700 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe28effd700 1 -- 172.21.15.8:0/1724362169 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe2a00042b0 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1724362169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcb6ab4d50 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe28effd700 1 -- 172.21.15.8:0/1724362169 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2a0004470 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe2c96cdb80 10 client.15660 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1724362169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fe2b01a1560 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.655+0000 7fe28effd700 1 -- 172.21.15.8:0/1724362169 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2a00a6080 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.656+0000 7fe28effd700 1 -- 172.21.15.8:0/1724362169 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe2a00998f0 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.656+0000 7fe2c96cdb80 10 client.15660 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.656+0000 7fe2c96cdb80 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.656+0000 7fe2c96cdb80 20 client.15660 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.656+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fcb6ad7680 0x55fcb6ad9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.656+0000 7fe2c96cdb80 4 client.15660 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.656+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1724362169 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcb6a0ddb0 con 0x55fcb6ad7680 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.656+0000 7fe2aeffd700 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fcb6ad7680 0x55fcb6ad9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.657+0000 7fe2aeffd700 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fcb6ad7680 0x55fcb6ad9aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3dea694ed9d2bc3 server_cookie=741f287502b7502d in_seq=0 out_seq=0 2023-10-06T23:14:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.657+0000 7fe28effd700 10 client.15660 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:41.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe28effd700 1 -- 172.21.15.8:0/1724362169 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fcb6a0ddb0 con 0x55fcb6ad7680 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe28effd700 10 client.15660 handle_command_reply: tid=0 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 client.15660 shutdown 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1724362169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac1ec0 msgr2=0x55fcb6acbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6acbc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00cd280 tx=0x7fe2a009ab90 comp rx=0 tx=0).stop 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1724362169 shutdown_connections 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fcb6ad7680 0x55fcb6ad9aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6acbc30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac3990 0x55fcb6ad31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/1724362169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6acc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1724362169 >> 172.21.15.8:0/1724362169 conn(0x55fcb6a36200 msgr2=0x55fcb6abc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:41.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe28effd700 0 client.15660 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:41.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1724362169 shutdown_connections 2023-10-06T23:14:41.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.658+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/1724362169 wait complete. 2023-10-06T23:14:41.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.659+0000 7fe2c96cdb80 20 client.15660 trim_cache size 0 max 16384 2023-10-06T23:14:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.681+0000 7fe2c96cdb80 1 Processor -- start 2023-10-06T23:14:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.681+0000 7fe2c96cdb80 1 -- start start 2023-10-06T23:14:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.681+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6aca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.681+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.681+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6ad9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.681+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb68958c0 con 0x55fcb6ac3990 2023-10-06T23:14:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.681+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6ab7200 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.681+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6ac9c30 con 0x55fcb6ac2fd0 2023-10-06T23:14:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2affff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6ad9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2aeffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2af7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6aca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2aeffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55968/0 (socket says 172.21.15.8:55968) 2023-10-06T23:14:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2aeffd700 1 -- 172.21.15.8:0/3767844689 learned_addr learned my addr 172.21.15.8:0/3767844689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2af7fe700 1 -- 172.21.15.8:0/3767844689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac2fd0 msgr2=0x55fcb6ad3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/3767844689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2af7fe700 1 -- 172.21.15.8:0/3767844689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 msgr2=0x55fcb6ad9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/3767844689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6ad9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2af7fe700 1 -- 172.21.15.8:0/3767844689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcb6828c00 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.682+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/3767844689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6aca8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00caf50 tx=0x7fe2a000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ef8da294ba7b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.683+0000 7fe2967fc700 1 -- 172.21.15.8:0/3767844689 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0099f40 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.683+0000 7fe2967fc700 1 -- 172.21.15.8:0/3767844689 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fcb6ab4d50 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.683+0000 7fe2967fc700 1 -- 172.21.15.8:0/3767844689 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00998f0 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.683+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/3767844689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac1ec0 msgr2=0x55fcb6aca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.683+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/3767844689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6aca8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00caf50 tx=0x7fe2a000cf60 comp rx=0 tx=0).stop 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/3767844689 shutdown_connections 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/3767844689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6ad9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/3767844689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6aca8d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/3767844689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/3767844689 >> 172.21.15.8:0/3767844689 conn(0x55fcb6a36200 msgr2=0x55fcb6ade3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/3767844689 shutdown_connections 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/3767844689 wait complete. 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 -- start start 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.684+0000 7fe2c96cdb80 1 Processor -- start 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ad0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2c96cdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6b29450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6ad0c30 con 0x55fcb6ac3990 2023-10-06T23:14:41.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6b29990 con 0x55fcb6ac2fd0 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2c96cdb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcb6b29ad0 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2c96cdb80 10 client.0 _ll_register_callbacks cb 0x7fe2a80097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2af7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ad0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2aeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2af7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ad0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55976/0 (socket says 172.21.15.8:55976) 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2af7fe700 1 -- 172.21.15.8:0/312299757 learned_addr learned my addr 172.21.15.8:0/312299757 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.685+0000 7fe2affff700 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6b29450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2af7fe700 1 -- 172.21.15.8:0/312299757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 msgr2=0x55fcb6ad0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2af7fe700 1 -- 172.21.15.8:0/312299757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 msgr2=0x55fcb6b29450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:41.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6b29450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2af7fe700 1 -- 172.21.15.8:0/312299757 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b01a1560 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2aeffd700 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2affff700 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6b29450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2af7fe700 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ad0010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0096820 tx=0x7fe2a0098960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e550f56c3700f293 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe28effd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe28effd700 1 -- 172.21.15.8:0/312299757 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0099f40 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe28effd700 1 -- 172.21.15.8:0/312299757 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe2a00a7060 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.686+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/312299757 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2a009a400 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe28effd700 1 -- 172.21.15.8:0/312299757 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2a00a2790 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe2c96cdb80 10 client.25492 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:41.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/312299757 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fcb68661f0 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe28effd700 1 -- 172.21.15.8:0/312299757 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2a009a400 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe28effd700 1 -- 172.21.15.8:0/312299757 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe2a00ab070 con 0x55fcb6ac1ec0 2023-10-06T23:14:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe2c96cdb80 10 client.25492 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe2c96cdb80 10 client.25492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe2c96cdb80 20 client.25492 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fcb6b2afe0 0x55fcb6b2d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe2c96cdb80 4 client.25492 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:14:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.687+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/312299757 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fcb6a0dad0 con 0x55fcb6b2afe0 2023-10-06T23:14:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.688+0000 7fe2aeffd700 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fcb6b2afe0 0x55fcb6b2d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.688+0000 7fe2aeffd700 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fcb6b2afe0 0x55fcb6b2d400 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f746040d4e53e42e server_cookie=f87d210f5c1a4e01 in_seq=0 out_seq=0 2023-10-06T23:14:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.688+0000 7fe28effd700 10 client.25492 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.702+0000 7fe28effd700 1 -- 172.21.15.8:0/312299757 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fcb6a0dad0 con 0x55fcb6b2afe0 2023-10-06T23:14:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe28effd700 10 client.25492 handle_command_reply: tid=0 2023-10-06T23:14:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 client.25492 shutdown 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/312299757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 msgr2=0x55fcb6ad0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ad0010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0096820 tx=0x7fe2a0098960 comp rx=0 tx=0).stop 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/312299757 shutdown_connections 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fcb6b2afe0 0x55fcb6b2d400 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fcb6ac3990 0x55fcb6b29450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb6ac1ec0 0x55fcb6ad0010 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 --2- 172.21.15.8:0/312299757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcb6ac2fd0 0x55fcb6ad0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe28effd700 0 client.25492 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.703+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/312299757 >> 172.21.15.8:0/312299757 conn(0x55fcb6a36200 msgr2=0x55fcb6aca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.704+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/312299757 shutdown_connections 2023-10-06T23:14:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.704+0000 7fe2c96cdb80 1 -- 172.21.15.8:0/312299757 wait complete. 2023-10-06T23:14:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.704+0000 7fe2c96cdb80 20 client.25492 trim_cache size 0 max 16384 2023-10-06T23:14:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:14:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:14:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:14:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:14:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.705+0000 7fe2b5dff700 1 -- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe2980a1500 msgr2=0x7fe2980a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.705+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe2980a1500 0x7fe2980a39c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009550 tx=0x7fe2a800b040 comp rx=0 tx=0).stop 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.705+0000 7fe2b5dff700 1 -- 172.21.15.8:0/4198401184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b00ff7e0 msgr2=0x7fe2b0198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.705+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b00ff7e0 0x7fe2b0198e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000ec10 tx=0x7fe2a000ef20 comp rx=0 tx=0).stop 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.706+0000 7fe2b5dff700 1 -- 172.21.15.8:0/4198401184 shutdown_connections 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.706+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe2980a1500 0x7fe2980a39c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.706+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2b0100b00 0x7fe2b019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.706+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b00ff7e0 0x7fe2b0198e50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.706+0000 7fe2b5dff700 1 --2- 172.21.15.8:0/4198401184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2b0100140 0x7fe2b0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.706+0000 7fe2b5dff700 1 -- 172.21.15.8:0/4198401184 >> 172.21.15.8:0/4198401184 conn(0x7fe2b00fb340 msgr2=0x7fe2b00fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.706+0000 7fe2b5dff700 1 -- 172.21.15.8:0/4198401184 shutdown_connections 2023-10-06T23:14:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:41.706+0000 7fe2b5dff700 1 -- 172.21.15.8:0/4198401184 wait complete. 2023-10-06T23:14:42.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:42 smithi156 ceph-mon[102862]: pgmap v404: 97 pgs: 97 active+clean; 774 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 MiB/s wr, 35 op/s 2023-10-06T23:14:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:42 smithi008 ceph-mon[98532]: pgmap v404: 97 pgs: 97 active+clean; 774 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 MiB/s wr, 35 op/s 2023-10-06T23:14:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:42 smithi190 ceph-mon[102658]: pgmap v404: 97 pgs: 97 active+clean; 774 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 MiB/s wr, 35 op/s 2023-10-06T23:14:42.940 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:14:43.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 -- 172.21.15.8:0/2112139906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 msgr2=0x7f13ec102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 --2- 172.21.15.8:0/2112139906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 0x7f13ec102500 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009990 tx=0x7f13e0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 -- 172.21.15.8:0/2112139906 shutdown_connections 2023-10-06T23:14:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 --2- 172.21.15.8:0/2112139906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13ec102a40 0x7f13ec109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 --2- 172.21.15.8:0/2112139906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13ec100ea0 0x7f13ec1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 --2- 172.21.15.8:0/2112139906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 0x7f13ec102500 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 -- 172.21.15.8:0/2112139906 >> 172.21.15.8:0/2112139906 conn(0x7f13ec0fc460 msgr2=0x7f13ec0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:43.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 -- 172.21.15.8:0/2112139906 shutdown_connections 2023-10-06T23:14:43.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.170+0000 7f13f11ff700 1 -- 172.21.15.8:0/2112139906 wait complete. 2023-10-06T23:14:43.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.171+0000 7f13f11ff700 1 Processor -- start 2023-10-06T23:14:43.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13f11ff700 1 -- start start 2023-10-06T23:14:43.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13f11ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13ec100ea0 0x7f13ec196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13f11ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 0x7f13ec197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13f11ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13ec102a40 0x7f13ec19e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13f11ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec19e6b0 con 0x7f13ec102080 2023-10-06T23:14:43.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13f11ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec19e7f0 con 0x7f13ec102a40 2023-10-06T23:14:43.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13f11ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec19e980 con 0x7f13ec100ea0 2023-10-06T23:14:43.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13ead9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13ec100ea0 0x7f13ec196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13ea59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 0x7f13ec197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13ead9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13ec100ea0 0x7f13ec196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55996/0 (socket says 172.21.15.8:55996) 2023-10-06T23:14:43.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13ead9d700 1 -- 172.21.15.8:0/1895065530 learned_addr learned my addr 172.21.15.8:0/1895065530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:43.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.172+0000 7f13eb59e700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13ec102a40 0x7f13ec19e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13eb59e700 1 -- 172.21.15.8:0/1895065530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13ec100ea0 msgr2=0x7f13ec196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13eb59e700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13ec100ea0 0x7f13ec196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13eb59e700 1 -- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 msgr2=0x7f13ec197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13eb59e700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 0x7f13ec197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13eb59e700 1 -- 172.21.15.8:0/1895065530 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00095f0 con 0x7f13ec102a40 2023-10-06T23:14:43.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13ead9d700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13ec100ea0 0x7f13ec196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13ea59c700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 0x7f13ec197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13eb59e700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13ec102a40 0x7f13ec19e0e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13e400efc0 tx=0x7f13e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.173+0000 7f13d3fff700 1 -- 172.21.15.8:0/1895065530 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4018070 con 0x7f13ec102a40 2023-10-06T23:14:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.174+0000 7f13f11ff700 1 -- 172.21.15.8:0/1895065530 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec19ec00 con 0x7f13ec102a40 2023-10-06T23:14:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.174+0000 7f13d3fff700 1 -- 172.21.15.8:0/1895065530 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13e400f040 con 0x7f13ec102a40 2023-10-06T23:14:43.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.174+0000 7f13d3fff700 1 -- 172.21.15.8:0/1895065530 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400cba0 con 0x7f13ec102a40 2023-10-06T23:14:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.174+0000 7f13f11ff700 1 -- 172.21.15.8:0/1895065530 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec19f110 con 0x7f13ec102a40 2023-10-06T23:14:43.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.178+0000 7f1404b79b80 1 Processor -- start 2023-10-06T23:14:43.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.178+0000 7f13d3fff700 1 -- 172.21.15.8:0/1895065530 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f13e4003a00 con 0x7f13ec102a40 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f1404b79b80 1 -- start start 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f9229a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 0x5627f922a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f922b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f1404b79b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f918d460 con 0x5627f9229fd0 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f1404b79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f917ec20 con 0x5627f922ae70 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f1404b79b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f917c540 con 0x5627f9229670 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f13ea59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f9229a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f13ea59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f9229a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55998/0 (socket says 172.21.15.8:55998) 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f13ea59c700 1 -- 172.21.15.8:0/777456406 learned_addr learned my addr 172.21.15.8:0/777456406 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.179+0000 7f13ea59c700 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f922b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13ead9d700 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 0x5627f922a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13ea59c700 1 -- 172.21.15.8:0/777456406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 msgr2=0x5627f922b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13ea59c700 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f922b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13ea59c700 1 -- 172.21.15.8:0/777456406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 msgr2=0x5627f922a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13ea59c700 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 0x5627f922a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13ea59c700 1 -- 172.21.15.8:0/777456406 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627f8fa2de0 con 0x5627f9229670 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13ea59c700 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f9229a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009990 tx=0x7f13e001a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=687a2414b3c69ed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13d3fff700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13d40a1500 0x7f13d40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13d3fff700 1 -- 172.21.15.8:0/1895065530 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f13e40cc7f0 con 0x7f13ec102a40 2023-10-06T23:14:43.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.180+0000 7f13d17fa700 1 -- 172.21.15.8:0/777456406 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0003d10 con 0x5627f9229670 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.181+0000 7f13d17fa700 1 -- 172.21.15.8:0/777456406 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13e0004110 con 0x5627f9229670 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.181+0000 7f13d17fa700 1 -- 172.21.15.8:0/777456406 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0004b80 con 0x5627f9229670 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.181+0000 7f13ead9d700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13d40a1500 0x7f13d40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.181+0000 7f13ead9d700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13d40a1500 0x7f13d40a39c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0096b0 tx=0x7f13dc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.181+0000 7f1404b79b80 1 -- 172.21.15.8:0/777456406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 msgr2=0x5627f9229a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.181+0000 7f1404b79b80 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f9229a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009990 tx=0x7f13e001a040 comp rx=0 tx=0).stop 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.181+0000 7f1404b79b80 1 -- 172.21.15.8:0/777456406 shutdown_connections 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.181+0000 7f1404b79b80 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f922b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.182+0000 7f1404b79b80 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f9229a90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.182+0000 7f1404b79b80 1 --2- 172.21.15.8:0/777456406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 0x5627f922a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.182+0000 7f1404b79b80 1 -- 172.21.15.8:0/777456406 >> 172.21.15.8:0/777456406 conn(0x5627f9199260 msgr2=0x5627f9220140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:43.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.182+0000 7f1404b79b80 1 -- 172.21.15.8:0/777456406 shutdown_connections 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.182+0000 7f1404b79b80 1 -- 172.21.15.8:0/777456406 wait complete. 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.182+0000 7f1404b79b80 1 -- start start 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.183+0000 7f1404b79b80 1 Processor -- start 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.183+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9233400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.183+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 0x5627f9233940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.183+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f923a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.183+0000 7f1404b79b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f9177e30 con 0x5627f9229670 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.183+0000 7f1404b79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f9114710 con 0x5627f9229fd0 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.183+0000 7f1404b79b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f91143b0 con 0x5627f922ae70 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.183+0000 7f1404b79b80 10 client.0 _ll_register_callbacks cb 0x5627f8f71800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13ea59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 0x5627f9233940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13ead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9233400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f923a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f923a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:56000/0 (socket says 172.21.15.8:56000) 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 -- 172.21.15.8:0/1518356279 learned_addr learned my addr 172.21.15.8:0/1518356279 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13ead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9233400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41208/0 (socket says 172.21.15.8:41208) 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 -- 172.21.15.8:0/1518356279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 msgr2=0x5627f9233940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 0x5627f9233940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 -- 172.21.15.8:0/1518356279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 msgr2=0x5627f9233400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9233400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 -- 172.21.15.8:0/1518356279 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e0020040 con 0x5627f922ae70 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13eb59e700 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f923a980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13e40965c0 tx=0x7f13e40994b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=134650c78da9c597 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.184+0000 7f13ceff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f13ceff5700 1 -- 172.21.15.8:0/1518356279 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e401b320 con 0x5627f922ae70 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f13ceff5700 1 -- 172.21.15.8:0/1518356279 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f13e409a250 con 0x5627f922ae70 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f1404b79b80 1 -- 172.21.15.8:0/1518356279 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627f9217f10 con 0x5627f922ae70 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f13ceff5700 1 -- 172.21.15.8:0/1518356279 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13e40b2020 con 0x5627f922ae70 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f1404b79b80 10 client.25504 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f1404b79b80 1 -- 172.21.15.8:0/1518356279 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5627f8f8bc60 con 0x5627f922ae70 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f13ceff5700 1 -- 172.21.15.8:0/1518356279 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13e40b6070 con 0x5627f922ae70 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f13ceff5700 1 -- 172.21.15.8:0/1518356279 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f13e4099040 con 0x5627f922ae70 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.185+0000 7f1404b79b80 10 client.25504 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.186+0000 7f1404b79b80 10 client.25504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.186+0000 7f1404b79b80 20 client.25504 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:43.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.186+0000 7f1404b79b80 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627f923f360 0x5627f9241780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.186+0000 7f1404b79b80 4 client.25504 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.186+0000 7f1404b79b80 1 -- 172.21.15.8:0/1518356279 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627f9170e10 con 0x5627f923f360 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.186+0000 7f13ead9d700 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627f923f360 0x5627f9241780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.186+0000 7f13ead9d700 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627f923f360 0x5627f9241780 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5097ded902f0cefe server_cookie=b610920b9b88e1c4 in_seq=0 out_seq=0 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.186+0000 7f13ceff5700 10 client.25504 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.187+0000 7f13ceff5700 1 -- 172.21.15.8:0/1518356279 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627f9170e10 con 0x5627f923f360 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.187+0000 7f13ceff5700 10 client.25504 handle_command_reply: tid=0 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.187+0000 7f1404b79b80 1 client.25504 shutdown 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 -- 172.21.15.8:0/1518356279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 msgr2=0x5627f923a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f923a980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13e40965c0 tx=0x7f13e40994b0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 -- 172.21.15.8:0/1518356279 shutdown_connections 2023-10-06T23:14:43.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627f923f360 0x5627f9241780 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9233400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f923a980 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 --2- 172.21.15.8:0/1518356279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 0x5627f9233940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f13ceff5700 0 client.25504 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:43.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 -- 172.21.15.8:0/1518356279 >> 172.21.15.8:0/1518356279 conn(0x5627f9199260 msgr2=0x5627f921ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:43.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 -- 172.21.15.8:0/1518356279 shutdown_connections 2023-10-06T23:14:43.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 1 -- 172.21.15.8:0/1518356279 wait complete. 2023-10-06T23:14:43.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.188+0000 7f1404b79b80 20 client.25504 trim_cache size 0 max 16384 2023-10-06T23:14:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.208+0000 7f1404b79b80 1 Processor -- start 2023-10-06T23:14:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.208+0000 7f1404b79b80 1 -- start start 2023-10-06T23:14:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f921ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 0x5627f923a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f9231200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f1404b79b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f8ff8920 con 0x5627f9229fd0 2023-10-06T23:14:43.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f1404b79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f921ca20 con 0x5627f922ae70 2023-10-06T23:14:43.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f1404b79b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f921a540 con 0x5627f9229670 2023-10-06T23:14:43.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f13ea59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 0x5627f923a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f13ead9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f921ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f13eb59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f9231200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f13eb59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f9231200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59292/0 (socket says 172.21.15.8:59292) 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f13eb59e700 1 -- 172.21.15.8:0/239250106 learned_addr learned my addr 172.21.15.8:0/239250106 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.209+0000 7f13ead9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f921ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:56008/0 (socket says 172.21.15.8:56008) 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13eb59e700 1 -- 172.21.15.8:0/239250106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 msgr2=0x5627f921ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13eb59e700 1 --2- 172.21.15.8:0/239250106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f921ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13eb59e700 1 -- 172.21.15.8:0/239250106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 msgr2=0x5627f923a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13eb59e700 1 --2- 172.21.15.8:0/239250106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 0x5627f923a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13eb59e700 1 -- 172.21.15.8:0/239250106 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627f8fc9250 con 0x5627f922ae70 2023-10-06T23:14:43.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13ead9d700 1 --2- 172.21.15.8:0/239250106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f921ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13eb59e700 1 --2- 172.21.15.8:0/239250106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f9231200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13e4096050 tx=0x7f13e4004c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8a1d621af5f1d00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13d1ffb700 1 -- 172.21.15.8:0/239250106 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e409a250 con 0x5627f922ae70 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13d1ffb700 1 -- 172.21.15.8:0/239250106 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13e40b6030 con 0x5627f922ae70 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.210+0000 7f13d1ffb700 1 -- 172.21.15.8:0/239250106 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4099b50 con 0x5627f922ae70 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 -- 172.21.15.8:0/239250106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 msgr2=0x5627f9231200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 --2- 172.21.15.8:0/239250106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f9231200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13e4096050 tx=0x7f13e4004c50 comp rx=0 tx=0).stop 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 -- 172.21.15.8:0/239250106 shutdown_connections 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 --2- 172.21.15.8:0/239250106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f922ae70 0x5627f9231200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 --2- 172.21.15.8:0/239250106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f9229670 0x5627f921ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 --2- 172.21.15.8:0/239250106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229fd0 0x5627f923a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 -- 172.21.15.8:0/239250106 >> 172.21.15.8:0/239250106 conn(0x5627f9199260 msgr2=0x5627f921ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:43.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 -- 172.21.15.8:0/239250106 shutdown_connections 2023-10-06T23:14:43.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.211+0000 7f1404b79b80 1 -- 172.21.15.8:0/239250106 wait complete. 2023-10-06T23:14:43.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.212+0000 7f1404b79b80 1 -- start start 2023-10-06T23:14:43.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.212+0000 7f1404b79b80 1 Processor -- start 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.212+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9236b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.212+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 0x5627f92370b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.212+0000 7f1404b79b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f92399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.212+0000 7f1404b79b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f9239f50 con 0x5627f9229670 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.212+0000 7f1404b79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f923a0c0 con 0x5627f9229fd0 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.212+0000 7f1404b79b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f923a280 con 0x5627f922ae70 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f1404b79b80 10 client.0 _ll_register_callbacks cb 0x7f13e4099920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9236b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9236b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41226/0 (socket says 172.21.15.8:41226) 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ead9d700 1 -- 172.21.15.8:0/3643240974 learned_addr learned my addr 172.21.15.8:0/3643240974 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:43.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13eb59e700 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f92399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ea59c700 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 0x5627f92370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ead9d700 1 -- 172.21.15.8:0/3643240974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 msgr2=0x5627f92399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ead9d700 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f92399e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ead9d700 1 -- 172.21.15.8:0/3643240974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 msgr2=0x5627f92370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ead9d700 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 0x5627f92370b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13ead9d700 1 -- 172.21.15.8:0/3643240974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc011560 con 0x5627f9229670 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.213+0000 7f13eb59e700 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f92399e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.214+0000 7f13ead9d700 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9236b70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5627f9242020 tx=0x7f13dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e740a44fecc82e78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.214+0000 7f13ceff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.214+0000 7f13ceff5700 1 -- 172.21.15.8:0/3643240974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc025040 con 0x5627f9229670 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.214+0000 7f1404b79b80 1 -- 172.21.15.8:0/3643240974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13e0004110 con 0x5627f9229670 2023-10-06T23:14:43.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.214+0000 7f13ceff5700 1 -- 172.21.15.8:0/3643240974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f13dc02a570 con 0x5627f9229670 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.214+0000 7f13ceff5700 1 -- 172.21.15.8:0/3643240974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13dc017070 con 0x5627f9229670 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.214+0000 7f1404b79b80 10 client.15684 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.214+0000 7f1404b79b80 1 -- 172.21.15.8:0/3643240974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5627f8f8bc60 con 0x5627f9229670 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f13ceff5700 1 -- 172.21.15.8:0/3643240974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13e0004110 con 0x5627f9229670 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f13ceff5700 1 -- 172.21.15.8:0/3643240974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f13dc01f6d0 con 0x5627f9229670 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f1404b79b80 10 client.15684 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f1404b79b80 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f1404b79b80 20 client.15684 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f1404b79b80 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627f9294020 0x5627f9296440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f1404b79b80 4 client.15684 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:14:43.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f1404b79b80 1 -- 172.21.15.8:0/3643240974 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5627f9170b30 con 0x5627f9294020 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.215+0000 7f13ea59c700 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627f9294020 0x5627f9296440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f13ceff5700 10 client.15684 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f13ea59c700 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627f9294020 0x5627f9296440 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d20434efdc51854a server_cookie=78d468381ebcce05 in_seq=0 out_seq=0 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f13ceff5700 1 -- 172.21.15.8:0/3643240974 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5627f9170b30 con 0x5627f9294020 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f13ceff5700 10 client.15684 handle_command_reply: tid=0 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f1404b79b80 1 client.15684 shutdown 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f1404b79b80 1 -- 172.21.15.8:0/3643240974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 msgr2=0x5627f9236b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f1404b79b80 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9236b70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5627f9242020 tx=0x7f13dc004750 comp rx=0 tx=0).stop 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f1404b79b80 1 -- 172.21.15.8:0/3643240974 shutdown_connections 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.216+0000 7f1404b79b80 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627f9294020 0x5627f9296440 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.217+0000 7f1404b79b80 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627f9229670 0x5627f9236b70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.217+0000 7f1404b79b80 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627f922ae70 0x5627f92399e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.217+0000 7f13ceff5700 0 client.15684 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:43.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.217+0000 7f1404b79b80 1 --2- 172.21.15.8:0/3643240974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627f9229fd0 0x5627f92370b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.217+0000 7f1404b79b80 1 -- 172.21.15.8:0/3643240974 >> 172.21.15.8:0/3643240974 conn(0x5627f9199260 msgr2=0x5627f922dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:43.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.217+0000 7f1404b79b80 1 -- 172.21.15.8:0/3643240974 shutdown_connections 2023-10-06T23:14:43.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.217+0000 7f1404b79b80 1 -- 172.21.15.8:0/3643240974 wait complete. 2023-10-06T23:14:43.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.217+0000 7f1404b79b80 20 client.15684 trim_cache size 0 max 16384 2023-10-06T23:14:43.223 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:14:43.223 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-06T23:14:43.223 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:14:43.223 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:14:43.223 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:14:43.223 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:14:43.224 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:14:43.224 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:14:43.224 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:14:43.224 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:14:43.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 -- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13d40a1500 msgr2=0x7f13d40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13d40a1500 0x7f13d40a39c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0096b0 tx=0x7f13dc009260 comp rx=0 tx=0).stop 2023-10-06T23:14:43.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 -- 172.21.15.8:0/1895065530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13ec102a40 msgr2=0x7f13ec19e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:43.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13ec102a40 0x7f13ec19e0e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13e400efc0 tx=0x7f13e400c3a0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 -- 172.21.15.8:0/1895065530 shutdown_connections 2023-10-06T23:14:43.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13d40a1500 0x7f13d40a39c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13ec102a40 0x7f13ec19e0e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13ec100ea0 0x7f13ec196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 --2- 172.21.15.8:0/1895065530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13ec102080 0x7f13ec197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:43.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 -- 172.21.15.8:0/1895065530 >> 172.21.15.8:0/1895065530 conn(0x7f13ec0fc460 msgr2=0x7f13ec0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:43.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 -- 172.21.15.8:0/1895065530 shutdown_connections 2023-10-06T23:14:43.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:14:43.218+0000 7f13f11ff700 1 -- 172.21.15.8:0/1895065530 wait complete. 2023-10-06T23:14:43.241 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:14:43.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:43 smithi156 ceph-mon[102862]: pgmap v405: 97 pgs: 97 active+clean; 783 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 MiB/s wr, 35 op/s 2023-10-06T23:14:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:43 smithi008 ceph-mon[98532]: pgmap v405: 97 pgs: 97 active+clean; 783 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 MiB/s wr, 35 op/s 2023-10-06T23:14:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:43 smithi190 ceph-mon[102658]: pgmap v405: 97 pgs: 97 active+clean; 783 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 MiB/s wr, 35 op/s 2023-10-06T23:14:44.567 INFO:teuthology.orchestra.run.smithi008.stderr:set primary keys... 2023-10-06T23:14:46.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:46 smithi156 ceph-mon[102862]: pgmap v406: 97 pgs: 97 active+clean; 787 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 28 op/s 2023-10-06T23:14:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:46 smithi008 ceph-mon[98532]: pgmap v406: 97 pgs: 97 active+clean; 787 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 28 op/s 2023-10-06T23:14:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:46 smithi190 ceph-mon[102658]: pgmap v406: 97 pgs: 97 active+clean; 787 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 28 op/s 2023-10-06T23:14:48.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:48 smithi156 ceph-mon[102862]: pgmap v407: 97 pgs: 97 active+clean; 807 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 35 op/s 2023-10-06T23:14:48.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:48 smithi008 ceph-mon[98532]: pgmap v407: 97 pgs: 97 active+clean; 807 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 35 op/s 2023-10-06T23:14:48.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:48 smithi190 ceph-mon[102658]: pgmap v407: 97 pgs: 97 active+clean; 807 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 35 op/s 2023-10-06T23:14:50.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:50 smithi156 ceph-mon[102862]: pgmap v408: 97 pgs: 97 active+clean; 815 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-10-06T23:14:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:50 smithi008 ceph-mon[98532]: pgmap v408: 97 pgs: 97 active+clean; 815 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-10-06T23:14:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:50 smithi190 ceph-mon[102658]: pgmap v408: 97 pgs: 97 active+clean; 815 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-10-06T23:14:52.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:52 smithi156 ceph-mon[102862]: pgmap v409: 97 pgs: 97 active+clean; 852 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-10-06T23:14:52.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:52 smithi008 ceph-mon[98532]: pgmap v409: 97 pgs: 97 active+clean; 852 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-10-06T23:14:52.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:52 smithi190 ceph-mon[102658]: pgmap v409: 97 pgs: 97 active+clean; 852 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-10-06T23:14:53.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:53 smithi156 ceph-mon[102862]: pgmap v410: 97 pgs: 97 active+clean; 868 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-10-06T23:14:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:53 smithi008 ceph-mon[98532]: pgmap v410: 97 pgs: 97 active+clean; 868 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-10-06T23:14:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:53 smithi190 ceph-mon[102658]: pgmap v410: 97 pgs: 97 active+clean; 868 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-10-06T23:14:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:done. 2023-10-06T23:14:53.709 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-10-06T23:14:54.004 INFO:teuthology.orchestra.run.smithi008.stderr:starting vacuum...end. 2023-10-06T23:14:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.924+0000 7fd8d5dff700 1 -- 172.21.15.8:0/1429380494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d0107eb0 msgr2=0x7fd8d010a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.924+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/1429380494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d0107eb0 0x7fd8d010a2e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00098f0 tx=0x7fd8c0009c00 comp rx=0 tx=0).stop 2023-10-06T23:14:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.925+0000 7fd8d5dff700 1 -- 172.21.15.8:0/1429380494 shutdown_connections 2023-10-06T23:14:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.925+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/1429380494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8d010d1f0 0x7fd8d010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.925+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/1429380494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d0107eb0 0x7fd8d010a2e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.925+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/1429380494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d010a820 0x7fd8d010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.925+0000 7fd8d5dff700 1 -- 172.21.15.8:0/1429380494 >> 172.21.15.8:0/1429380494 conn(0x7fd8d006dd10 msgr2=0x7fd8d0070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.925+0000 7fd8d5dff700 1 -- 172.21.15.8:0/1429380494 shutdown_connections 2023-10-06T23:14:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.925+0000 7fd8d5dff700 1 -- 172.21.15.8:0/1429380494 wait complete. 2023-10-06T23:14:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.926+0000 7fd8d5dff700 1 Processor -- start 2023-10-06T23:14:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.926+0000 7fd8d5dff700 1 -- start start 2023-10-06T23:14:54.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.927+0000 7fd8d5dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d0107eb0 0x7fd8d019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.927+0000 7fd8d5dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d010a820 0x7fd8d019d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.927+0000 7fd8d5dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8d010d1f0 0x7fd8d019e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8d5dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d019ec70 con 0x7fd8d010d1f0 2023-10-06T23:14:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8d5dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d019ede0 con 0x7fd8d0107eb0 2023-10-06T23:14:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8d5dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d019efa0 con 0x7fd8d010a820 2023-10-06T23:14:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d010a820 0x7fd8d019d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d010a820 0x7fd8d019d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:48640/0 (socket says 172.21.15.8:48640) 2023-10-06T23:14:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8c7fff700 1 -- 172.21.15.8:0/374808549 learned_addr learned my addr 172.21.15.8:0/374808549 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d0107eb0 0x7fd8d019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/374808549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d010a820 msgr2=0x7fd8d019d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d010a820 0x7fd8d019d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.928+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8d010d1f0 msgr2=0x7fd8d019e610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.929+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8d010d1f0 0x7fd8d019e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.929+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/374808549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c0009520 con 0x7fd8d0107eb0 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.929+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d0107eb0 0x7fd8d019d250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000c00 tx=0x7fd8c000b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.929+0000 7fd8cd7fa700 1 -- 172.21.15.8:0/374808549 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c001c070 con 0x7fd8d0107eb0 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.930+0000 7fd8cd7fa700 1 -- 172.21.15.8:0/374808549 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8c000f7d0 con 0x7fd8d0107eb0 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.930+0000 7fd8cd7fa700 1 -- 172.21.15.8:0/374808549 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00038e0 con 0x7fd8d0107eb0 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.930+0000 7fd8d5dff700 1 -- 172.21.15.8:0/374808549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d019f220 con 0x7fd8d0107eb0 2023-10-06T23:14:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.930+0000 7fd8d5dff700 1 -- 172.21.15.8:0/374808549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d01a5a40 con 0x7fd8d0107eb0 2023-10-06T23:14:54.937 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.936+0000 7fd8cd7fa700 1 -- 172.21.15.8:0/374808549 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd8c0020030 con 0x7fd8d0107eb0 2023-10-06T23:14:54.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.936+0000 7fd8e976fb80 1 Processor -- start 2023-10-06T23:14:54.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.937+0000 7fd8e976fb80 1 -- start start 2023-10-06T23:14:54.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.937+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ec82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.937+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ec9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.937+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ed0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.937+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36e30400 con 0x559f36ec8fd0 2023-10-06T23:14:54.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.937+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36e21bc0 con 0x559f36ec7ec0 2023-10-06T23:14:54.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.937+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36e1f4e0 con 0x559f36ec9990 2023-10-06T23:14:54.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.938+0000 7fd8cffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ec82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.938+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ed0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.938+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ed0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:48652/0 (socket says 172.21.15.8:48652) 2023-10-06T23:14:54.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.938+0000 7fd8c7fff700 1 -- 172.21.15.8:0/2006788553 learned_addr learned my addr 172.21.15.8:0/2006788553 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:54.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.938+0000 7fd8c7fff700 1 -- 172.21.15.8:0/2006788553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 msgr2=0x559f36ec82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:54.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.938+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/2006788553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ec82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.938+0000 7fd8c7fff700 1 -- 172.21.15.8:0/2006788553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 msgr2=0x559f36ec9450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T23:14:54.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.939+0000 7fd8cd7fa700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8bc0a1600 0x7fd8bc0a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.940+0000 7fd8cffff700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8bc0a1600 0x7fd8bc0a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.941+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/2006788553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ec9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.941+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/2006788553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ec9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.941+0000 7fd8c7fff700 1 -- 172.21.15.8:0/2006788553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f36c45d80 con 0x559f36ec9990 2023-10-06T23:14:54.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.942+0000 7fd8cd7fa700 1 -- 172.21.15.8:0/374808549 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd8c00cdbb0 con 0x7fd8d0107eb0 2023-10-06T23:14:54.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.942+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/2006788553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ed0220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8b801ae40 tx=0x7fd8b8022730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5a08909e68b2682 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:54.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.942+0000 7fd8cffff700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8bc0a1600 0x7fd8bc0a3ac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x559f36ec7c60 tx=0x7fd8c800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:54.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.943+0000 7fd8c5ffb700 1 -- 172.21.15.8:0/2006788553 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b801f5d0 con 0x559f36ec9990 2023-10-06T23:14:54.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.943+0000 7fd8c5ffb700 1 -- 172.21.15.8:0/2006788553 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8b801fbc0 con 0x559f36ec9990 2023-10-06T23:14:54.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.943+0000 7fd8c5ffb700 1 -- 172.21.15.8:0/2006788553 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b802ac50 con 0x559f36ec9990 2023-10-06T23:14:54.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.944+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2006788553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 msgr2=0x559f36ed0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:54.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.944+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/2006788553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ed0220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8b801ae40 tx=0x7fd8b8022730 comp rx=0 tx=0).stop 2023-10-06T23:14:54.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.945+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2006788553 shutdown_connections 2023-10-06T23:14:54.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.945+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/2006788553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ed0220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.945+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/2006788553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ec82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.945+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/2006788553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ec9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.945+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2006788553 >> 172.21.15.8:0/2006788553 conn(0x559f36e3c200 msgr2=0x559f36ec2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:54.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.945+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2006788553 shutdown_connections 2023-10-06T23:14:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.945+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2006788553 wait complete. 2023-10-06T23:14:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.946+0000 7fd8e976fb80 1 -- start start 2023-10-06T23:14:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.947+0000 7fd8e976fb80 1 Processor -- start 2023-10-06T23:14:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.947+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec7ec0 0x559f36ed1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.947+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec8fd0 0x559f36ed2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.947+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec9990 0x559f36ed91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.947+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36e1add0 con 0x559f36ec9990 2023-10-06T23:14:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.947+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36db76b0 con 0x559f36ec8fd0 2023-10-06T23:14:54.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.947+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36db7350 con 0x559f36ec7ec0 2023-10-06T23:14:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.947+0000 7fd8e976fb80 10 client.0 _ll_register_callbacks cb 0x559f36c147a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cf7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec7ec0 0x559f36ed1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cf7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec7ec0 0x559f36ed1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:48662/0 (socket says 172.21.15.8:48662) 2023-10-06T23:14:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/1408016702 learned_addr learned my addr 172.21.15.8:0/1408016702 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cffff700 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec9990 0x559f36ed91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec8fd0 0x559f36ed2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/1408016702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec8fd0 msgr2=0x559f36ed2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec8fd0 0x559f36ed2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/1408016702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec9990 msgr2=0x559f36ed91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec9990 0x559f36ed91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.948+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/1408016702 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b801aa70 con 0x559f36ec7ec0 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.949+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec7ec0 0x559f36ed1c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000f9b0 tx=0x7fd8c009adb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed74c4f7648f5bc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.949+0000 7fd8aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.949+0000 7fd8aeffd700 1 -- 172.21.15.8:0/1408016702 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c009af70 con 0x559f36ec7ec0 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.949+0000 7fd8aeffd700 1 -- 172.21.15.8:0/1408016702 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd8c009f0c0 con 0x559f36ec7ec0 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.949+0000 7fd8e976fb80 1 -- 172.21.15.8:0/1408016702 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f36ebad50 con 0x559f36ec7ec0 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.950+0000 7fd8aeffd700 1 -- 172.21.15.8:0/1408016702 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8c00a3270 con 0x559f36ec7ec0 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.950+0000 7fd8e976fb80 10 client.25522 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.950+0000 7fd8e976fb80 1 -- 172.21.15.8:0/1408016702 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559f36c2ec00 con 0x559f36ec7ec0 2023-10-06T23:14:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.950+0000 7fd8aeffd700 1 -- 172.21.15.8:0/1408016702 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8c00b2030 con 0x559f36ec7ec0 2023-10-06T23:14:54.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.951+0000 7fd8aeffd700 1 -- 172.21.15.8:0/1408016702 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd8c0097680 con 0x559f36ec7ec0 2023-10-06T23:14:54.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.951+0000 7fd8e976fb80 10 client.25522 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.951+0000 7fd8e976fb80 10 client.25522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.951+0000 7fd8e976fb80 20 client.25522 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.951+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559f36edd470 0x559f36edf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.951+0000 7fd8e976fb80 4 client.25522 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:14:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.951+0000 7fd8e976fb80 1 -- 172.21.15.8:0/1408016702 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f36e13db0 con 0x559f36edd470 2023-10-06T23:14:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.952+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559f36edd470 0x559f36edf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.952+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559f36edd470 0x559f36edf890 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e34268562c99e61b server_cookie=1f8daf061f854d66 in_seq=0 out_seq=0 2023-10-06T23:14:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.952+0000 7fd8aeffd700 10 client.25522 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.953+0000 7fd8aeffd700 1 -- 172.21.15.8:0/1408016702 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559f36e13db0 con 0x559f36edd470 2023-10-06T23:14:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.953+0000 7fd8aeffd700 10 client.25522 handle_command_reply: tid=0 2023-10-06T23:14:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.954+0000 7fd8e976fb80 1 client.25522 shutdown 2023-10-06T23:14:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.954+0000 7fd8e976fb80 1 -- 172.21.15.8:0/1408016702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec7ec0 msgr2=0x559f36ed1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.954+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec7ec0 0x559f36ed1c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000f9b0 tx=0x7fd8c009adb0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8e976fb80 1 -- 172.21.15.8:0/1408016702 shutdown_connections 2023-10-06T23:14:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559f36edd470 0x559f36edf890 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec9990 0x559f36ed91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec7ec0 0x559f36ed1c30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/1408016702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec8fd0 0x559f36ed2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8e976fb80 1 -- 172.21.15.8:0/1408016702 >> 172.21.15.8:0/1408016702 conn(0x559f36e3c200 msgr2=0x559f36ec2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8aeffd700 0 client.25522 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:54.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8e976fb80 1 -- 172.21.15.8:0/1408016702 shutdown_connections 2023-10-06T23:14:54.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.955+0000 7fd8e976fb80 1 -- 172.21.15.8:0/1408016702 wait complete. 2023-10-06T23:14:54.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.956+0000 7fd8e976fb80 20 client.25522 trim_cache size 0 max 16384 2023-10-06T23:14:54.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.982+0000 7fd8e976fb80 1 Processor -- start 2023-10-06T23:14:54.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.982+0000 7fd8e976fb80 1 -- start start 2023-10-06T23:14:54.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.982+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ed0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.982+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ed9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ecfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36c9b8c0 con 0x559f36ec8fd0 2023-10-06T23:14:54.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ec3f50 con 0x559f36ec7ec0 2023-10-06T23:14:54.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ed17a0 con 0x559f36ec9990 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ed9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8cf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ed0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8cf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ed0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:34988/0 (socket says 172.21.15.8:34988) 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/2704728698 learned_addr learned my addr 172.21.15.8:0/2704728698 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ed9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42978/0 (socket says 172.21.15.8:42978) 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.983+0000 7fd8cffff700 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ecfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.984+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/2704728698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 msgr2=0x559f36ecfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.984+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ecfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.984+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/2704728698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 msgr2=0x559f36ed9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:54.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.984+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ed9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.984+0000 7fd8cf7fe700 1 -- 172.21.15.8:0/2704728698 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f36c6c1f0 con 0x559f36ec7ec0 2023-10-06T23:14:54.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.984+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ed0860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009810 tx=0x7fd8c000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca4cb1ccb92a6a9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:54.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.984+0000 7fd8c67fc700 1 -- 172.21.15.8:0/2704728698 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00a3270 con 0x559f36ec7ec0 2023-10-06T23:14:54.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.985+0000 7fd8c67fc700 1 -- 172.21.15.8:0/2704728698 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8c00b2070 con 0x559f36ec7ec0 2023-10-06T23:14:54.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.985+0000 7fd8c67fc700 1 -- 172.21.15.8:0/2704728698 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0097680 con 0x559f36ec7ec0 2023-10-06T23:14:54.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.985+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2704728698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 msgr2=0x559f36ed0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:54.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.985+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ed0860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009810 tx=0x7fd8c000bec0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.985+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2704728698 shutdown_connections 2023-10-06T23:14:54.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.985+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec9990 0x559f36ecfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.986+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec7ec0 0x559f36ed0860 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.986+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/2704728698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ec8fd0 0x559f36ed9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.986+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2704728698 >> 172.21.15.8:0/2704728698 conn(0x559f36e3c200 msgr2=0x559f36ec2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.986+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2704728698 shutdown_connections 2023-10-06T23:14:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.986+0000 7fd8e976fb80 1 -- 172.21.15.8:0/2704728698 wait complete. 2023-10-06T23:14:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.987+0000 7fd8e976fb80 1 -- start start 2023-10-06T23:14:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.987+0000 7fd8e976fb80 1 Processor -- start 2023-10-06T23:14:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec8fd0 0x559f36ed6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec9990 0x559f36ed7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8e976fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ed8260 0x559f36ed86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ed8c20 con 0x559f36ed8260 2023-10-06T23:14:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ed8d90 con 0x559f36ec9990 2023-10-06T23:14:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8e976fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f36ed8f50 con 0x559f36ec8fd0 2023-10-06T23:14:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8e976fb80 10 client.0 _ll_register_callbacks cb 0x559f36c147a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:14:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec9990 0x559f36ed7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec9990 0x559f36ed7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35000/0 (socket says 172.21.15.8:35000) 2023-10-06T23:14:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.988+0000 7fd8c7fff700 1 -- 172.21.15.8:0/4227027129 learned_addr learned my addr 172.21.15.8:0/4227027129 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:14:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec8fd0 0x559f36ed6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8cffff700 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ed8260 0x559f36ed86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8c7fff700 1 -- 172.21.15.8:0/4227027129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec8fd0 msgr2=0x559f36ed6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec8fd0 0x559f36ed6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8c7fff700 1 -- 172.21.15.8:0/4227027129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ed8260 msgr2=0x559f36ed86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:14:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ed8260 0x559f36ed86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8c7fff700 1 -- 172.21.15.8:0/4227027129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c00be030 con 0x559f36ec9990 2023-10-06T23:14:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8c7fff700 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec9990 0x559f36ed7250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8022b30 tx=0x7fd8b801a850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11c4fe8bf1338c59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:14:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.989+0000 7fd8aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:14:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.990+0000 7fd8aeffd700 1 -- 172.21.15.8:0/4227027129 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b803c070 con 0x559f36ec9990 2023-10-06T23:14:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.990+0000 7fd8e976fb80 1 -- 172.21.15.8:0/4227027129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8b801fbc0 con 0x559f36ec9990 2023-10-06T23:14:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.990+0000 7fd8aeffd700 1 -- 172.21.15.8:0/4227027129 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd8b801f920 con 0x559f36ec9990 2023-10-06T23:14:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.990+0000 7fd8aeffd700 1 -- 172.21.15.8:0/4227027129 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8b802a860 con 0x559f36ec9990 2023-10-06T23:14:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.990+0000 7fd8e976fb80 10 client.25484 fetch_fsmap learned FSMap version 27 2023-10-06T23:14:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.990+0000 7fd8e976fb80 1 -- 172.21.15.8:0/4227027129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559f36c44250 con 0x559f36ec9990 2023-10-06T23:14:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.991+0000 7fd8aeffd700 1 -- 172.21.15.8:0/4227027129 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8b801fbc0 con 0x559f36ec9990 2023-10-06T23:14:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.991+0000 7fd8aeffd700 1 -- 172.21.15.8:0/4227027129 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd8b80054d0 con 0x559f36ec9990 2023-10-06T23:14:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.991+0000 7fd8e976fb80 10 client.25484 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:14:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.991+0000 7fd8e976fb80 10 client.25484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:14:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.991+0000 7fd8e976fb80 20 client.25484 populate_metadata read hostname 'smithi008' 2023-10-06T23:14:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.991+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559f36f323c0 0x559f36f347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:14:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.991+0000 7fd8e976fb80 4 client.25484 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:14:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.991+0000 7fd8e976fb80 1 -- 172.21.15.8:0/4227027129 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559f36e13ad0 con 0x559f36f323c0 2023-10-06T23:14:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.992+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559f36f323c0 0x559f36f347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:14:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.993+0000 7fd8cf7fe700 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559f36f323c0 0x559f36f347e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc8beeea5bb88200 server_cookie=468a9b5e51935220 in_seq=0 out_seq=0 2023-10-06T23:14:54.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:54.993+0000 7fd8aeffd700 10 client.25484 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:55.009 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.008+0000 7fd8aeffd700 1 -- 172.21.15.8:0/4227027129 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559f36e13ad0 con 0x559f36f323c0 2023-10-06T23:14:55.009 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.008+0000 7fd8aeffd700 10 client.25484 handle_command_reply: tid=0 2023-10-06T23:14:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.008+0000 7fd8e976fb80 1 client.25484 shutdown 2023-10-06T23:14:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 -- 172.21.15.8:0/4227027129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec9990 msgr2=0x559f36ed7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec9990 0x559f36ed7250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8022b30 tx=0x7fd8b801a850 comp rx=0 tx=0).stop 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 -- 172.21.15.8:0/4227027129 shutdown_connections 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559f36f323c0 0x559f36f347e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559f36ed8260 0x559f36ed86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f36ec8fd0 0x559f36ed6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 --2- 172.21.15.8:0/4227027129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559f36ec9990 0x559f36ed7250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 -- 172.21.15.8:0/4227027129 >> 172.21.15.8:0/4227027129 conn(0x559f36e3c200 msgr2=0x559f36ed0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8aeffd700 0 client.25484 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 -- 172.21.15.8:0/4227027129 shutdown_connections 2023-10-06T23:14:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.009+0000 7fd8e976fb80 1 -- 172.21.15.8:0/4227027129 wait complete. 2023-10-06T23:14:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.010+0000 7fd8e976fb80 20 client.25484 trim_cache size 0 max 16384 2023-10-06T23:14:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:14:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:14:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:14:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:14:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.010+0000 7fd8d5dff700 1 -- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8bc0a1600 msgr2=0x7fd8bc0a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.010+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8bc0a1600 0x7fd8bc0a3ac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x559f36ec7c60 tx=0x7fd8c800b040 comp rx=0 tx=0).stop 2023-10-06T23:14:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.010+0000 7fd8d5dff700 1 -- 172.21.15.8:0/374808549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d0107eb0 msgr2=0x7fd8d019d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:14:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.010+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d0107eb0 0x7fd8d019d250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000c00 tx=0x7fd8c000b790 comp rx=0 tx=0).stop 2023-10-06T23:14:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.011+0000 7fd8d5dff700 1 -- 172.21.15.8:0/374808549 shutdown_connections 2023-10-06T23:14:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.011+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd8bc0a1600 0x7fd8bc0a3ac0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.011+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8d010d1f0 0x7fd8d019e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.011+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8d0107eb0 0x7fd8d019d250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.011+0000 7fd8d5dff700 1 --2- 172.21.15.8:0/374808549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8d010a820 0x7fd8d019d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:14:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.011+0000 7fd8d5dff700 1 -- 172.21.15.8:0/374808549 >> 172.21.15.8:0/374808549 conn(0x7fd8d006dd10 msgr2=0x7fd8d01089d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:14:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.011+0000 7fd8d5dff700 1 -- 172.21.15.8:0/374808549 shutdown_connections 2023-10-06T23:14:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:14:55.011+0000 7fd8d5dff700 1 -- 172.21.15.8:0/374808549 wait complete. 2023-10-06T23:14:56.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:56 smithi156 ceph-mon[102862]: pgmap v411: 97 pgs: 97 active+clean; 920 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 48 op/s 2023-10-06T23:14:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:56 smithi008 ceph-mon[98532]: pgmap v411: 97 pgs: 97 active+clean; 920 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 48 op/s 2023-10-06T23:14:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:56 smithi190 ceph-mon[102658]: pgmap v411: 97 pgs: 97 active+clean; 920 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 48 op/s 2023-10-06T23:14:58.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:14:58 smithi156 ceph-mon[102862]: pgmap v412: 97 pgs: 97 active+clean; 945 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 55 op/s 2023-10-06T23:14:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:14:58 smithi008 ceph-mon[98532]: pgmap v412: 97 pgs: 97 active+clean; 945 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 55 op/s 2023-10-06T23:14:58.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:14:58 smithi190 ceph-mon[102658]: pgmap v412: 97 pgs: 97 active+clean; 945 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 55 op/s 2023-10-06T23:14:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 5.0 s, 561.2 tps, lat 159.404 ms stddev 227.456 2023-10-06T23:15:00.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:00 smithi156 ceph-mon[102862]: pgmap v413: 97 pgs: 97 active+clean; 949 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-10-06T23:15:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:00 smithi008 ceph-mon[98532]: pgmap v413: 97 pgs: 97 active+clean; 949 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-10-06T23:15:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:00 smithi190 ceph-mon[102658]: pgmap v413: 97 pgs: 97 active+clean; 949 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-10-06T23:15:02.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:02 smithi156 ceph-mon[102862]: pgmap v414: 97 pgs: 97 active+clean; 946 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 24 MiB/s wr, 139 op/s 2023-10-06T23:15:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:02 smithi008 ceph-mon[98532]: pgmap v414: 97 pgs: 97 active+clean; 946 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 24 MiB/s wr, 139 op/s 2023-10-06T23:15:02.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:02 smithi190 ceph-mon[102658]: pgmap v414: 97 pgs: 97 active+clean; 946 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 24 MiB/s wr, 139 op/s 2023-10-06T23:15:03.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:03 smithi156 ceph-mon[102862]: pgmap v415: 97 pgs: 97 active+clean; 957 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 163 op/s 2023-10-06T23:15:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:03 smithi008 ceph-mon[98532]: pgmap v415: 97 pgs: 97 active+clean; 957 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 163 op/s 2023-10-06T23:15:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:03 smithi190 ceph-mon[102658]: pgmap v415: 97 pgs: 97 active+clean; 957 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 163 op/s 2023-10-06T23:15:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 10.0 s, 696.2 tps, lat 143.716 ms stddev 206.936 2023-10-06T23:15:06.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:06 smithi156 ceph-mon[102862]: pgmap v416: 97 pgs: 97 active+clean; 965 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 185 op/s 2023-10-06T23:15:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:06 smithi008 ceph-mon[98532]: pgmap v416: 97 pgs: 97 active+clean; 965 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 185 op/s 2023-10-06T23:15:06.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:06 smithi190 ceph-mon[102658]: pgmap v416: 97 pgs: 97 active+clean; 965 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 185 op/s 2023-10-06T23:15:08.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.247+0000 7f0d28dff700 1 -- 172.21.15.8:0/3880202954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d240ff760 msgr2=0x7f0d24101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.247+0000 7f0d28dff700 1 --2- 172.21.15.8:0/3880202954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d240ff760 0x7f0d24101b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d140098f0 tx=0x7f0d14009c00 comp rx=0 tx=0).stop 2023-10-06T23:15:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.247+0000 7f0d28dff700 1 -- 172.21.15.8:0/3880202954 shutdown_connections 2023-10-06T23:15:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.247+0000 7f0d28dff700 1 --2- 172.21.15.8:0/3880202954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d240ff760 0x7f0d24101b90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.247+0000 7f0d28dff700 1 --2- 172.21.15.8:0/3880202954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d24104aa0 0x7f0d24104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.247+0000 7f0d28dff700 1 --2- 172.21.15.8:0/3880202954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d241020d0 0x7f0d24104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.247+0000 7f0d28dff700 1 -- 172.21.15.8:0/3880202954 >> 172.21.15.8:0/3880202954 conn(0x7f0d240fb340 msgr2=0x7f0d240fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:08.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.248+0000 7f0d28dff700 1 -- 172.21.15.8:0/3880202954 shutdown_connections 2023-10-06T23:15:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.248+0000 7f0d28dff700 1 -- 172.21.15.8:0/3880202954 wait complete. 2023-10-06T23:15:08.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.249+0000 7f0d28dff700 1 Processor -- start 2023-10-06T23:15:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.250+0000 7f0d28dff700 1 -- start start 2023-10-06T23:15:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.250+0000 7f0d28dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d240ff760 0x7f0d2406f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.250+0000 7f0d28dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d241020d0 0x7f0d2406fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.250+0000 7f0d28dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d24104aa0 0x7f0d24070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.250+0000 7f0d28dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24071300 con 0x7f0d241020d0 2023-10-06T23:15:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.250+0000 7f0d28dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24071470 con 0x7f0d240ff760 2023-10-06T23:15:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.250+0000 7f0d28dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24071630 con 0x7f0d24104aa0 2023-10-06T23:15:08.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.251+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d240ff760 0x7f0d2406f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.251+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d240ff760 0x7f0d2406f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:56358/0 (socket says 172.21.15.8:56358) 2023-10-06T23:15:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.251+0000 7f0d2259c700 1 -- 172.21.15.8:0/2765431923 learned_addr learned my addr 172.21.15.8:0/2765431923 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.251+0000 7f0d22d9d700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d24104aa0 0x7f0d24070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.251+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d241020d0 0x7f0d2406fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.252+0000 7f0d22d9d700 1 -- 172.21.15.8:0/2765431923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d240ff760 msgr2=0x7f0d2406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.252+0000 7f0d22d9d700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d240ff760 0x7f0d2406f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.252+0000 7f0d22d9d700 1 -- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d241020d0 msgr2=0x7f0d2406fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.252+0000 7f0d22d9d700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d241020d0 0x7f0d2406fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.252+0000 7f0d22d9d700 1 -- 172.21.15.8:0/2765431923 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18009520 con 0x7f0d24104aa0 2023-10-06T23:15:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.252+0000 7f0d22d9d700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d24104aa0 0x7f0d24070ca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00efc0 tx=0x7f0d1c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:08.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.253+0000 7f0d137fe700 1 -- 172.21.15.8:0/2765431923 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c018070 con 0x7f0d24104aa0 2023-10-06T23:15:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.253+0000 7f0d137fe700 1 -- 172.21.15.8:0/2765431923 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d1c00f040 con 0x7f0d24104aa0 2023-10-06T23:15:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.253+0000 7f0d137fe700 1 -- 172.21.15.8:0/2765431923 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00cba0 con 0x7f0d24104aa0 2023-10-06T23:15:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.253+0000 7f0d28dff700 1 -- 172.21.15.8:0/2765431923 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14009520 con 0x7f0d24104aa0 2023-10-06T23:15:08.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.253+0000 7f0d28dff700 1 -- 172.21.15.8:0/2765431923 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d24071ee0 con 0x7f0d24104aa0 2023-10-06T23:15:08.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.260+0000 7f0d3c7f5b80 1 Processor -- start 2023-10-06T23:15:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.262+0000 7f0d137fe700 1 -- 172.21.15.8:0/2765431923 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0d1c00cd00 con 0x7f0d24104aa0 2023-10-06T23:15:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.262+0000 7f0d3c7f5b80 1 -- start start 2023-10-06T23:15:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.263+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f1ec0 0x561e346f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.263+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346f3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.263+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f3990 0x561e346fa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.263+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3465a400 con 0x561e346f1ec0 2023-10-06T23:15:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.263+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3464bbc0 con 0x561e346f3990 2023-10-06T23:15:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.263+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e346494e0 con 0x561e346f2fd0 2023-10-06T23:15:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.264+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.264+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39580/0 (socket says 172.21.15.8:39580) 2023-10-06T23:15:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.264+0000 7f0d2259c700 1 -- 172.21.15.8:0/3634871845 learned_addr learned my addr 172.21.15.8:0/3634871845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.264+0000 7f0d2259c700 1 -- 172.21.15.8:0/3634871845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f3990 msgr2=0x561e346fa220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T23:15:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.264+0000 7f0d2259c700 1 --2- 172.21.15.8:0/3634871845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f3990 0x561e346fa220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.264+0000 7f0d2259c700 1 -- 172.21.15.8:0/3634871845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f1ec0 msgr2=0x561e346f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.264+0000 7f0d2259c700 1 --2- 172.21.15.8:0/3634871845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f1ec0 0x561e346f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.264+0000 7f0d2259c700 1 -- 172.21.15.8:0/3634871845 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3446fd80 con 0x561e346f2fd0 2023-10-06T23:15:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.265+0000 7f0d2259c700 1 --2- 172.21.15.8:0/3634871845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346f3450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009230 tx=0x7f0d14005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc46b4be9b03c49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.265+0000 7f0d10ff9700 1 -- 172.21.15.8:0/3634871845 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400f460 con 0x561e346f2fd0 2023-10-06T23:15:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.265+0000 7f0d10ff9700 1 -- 172.21.15.8:0/3634871845 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d1401d040 con 0x561e346f2fd0 2023-10-06T23:15:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.265+0000 7f0d10ff9700 1 -- 172.21.15.8:0/3634871845 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d140052a0 con 0x561e346f2fd0 2023-10-06T23:15:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.266+0000 7f0d137fe700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d0c0a15d0 0x7f0d0c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d137fe700 1 -- 172.21.15.8:0/2765431923 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0d1c0cc740 con 0x7f0d24104aa0 2023-10-06T23:15:08.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/3634871845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 msgr2=0x561e346f3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/3634871845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346f3450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009230 tx=0x7f0d14005dc0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d0c0a15d0 0x7f0d0c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/3634871845 shutdown_connections 2023-10-06T23:15:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/3634871845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f1ec0 0x561e346f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/3634871845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f3990 0x561e346fa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/3634871845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346f3450 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.267+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/3634871845 >> 172.21.15.8:0/3634871845 conn(0x561e34666200 msgr2=0x561e346ecbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:08.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.268+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/3634871845 shutdown_connections 2023-10-06T23:15:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.268+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/3634871845 wait complete. 2023-10-06T23:15:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.269+0000 7f0d3c7f5b80 1 -- start start 2023-10-06T23:15:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.269+0000 7f0d3c7f5b80 1 Processor -- start 2023-10-06T23:15:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e346fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 0x561e34703100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e34644dd0 con 0x561e346f3990 2023-10-06T23:15:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e345e16b0 con 0x561e346f1ec0 2023-10-06T23:15:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e345e1350 con 0x561e346f2fd0 2023-10-06T23:15:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d3c7f5b80 10 client.0 _ll_register_callbacks cb 0x561e3443e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e346fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.270+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d0c0a15d0 0x7f0d0c0a3a90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x561e346f1c60 tx=0x7f0d18004750 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.271+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e346fbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:56382/0 (socket says 172.21.15.8:56382) 2023-10-06T23:15:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.271+0000 7f0d2259c700 1 -- 172.21.15.8:0/1309155103 learned_addr learned my addr 172.21.15.8:0/1309155103 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:08.275 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.271+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.272+0000 7f0d2259c700 1 -- 172.21.15.8:0/1309155103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 msgr2=0x561e346fc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:08.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.272+0000 7f0d2259c700 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346fc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.272+0000 7f0d2259c700 1 -- 172.21.15.8:0/1309155103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 msgr2=0x561e34703100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.272+0000 7f0d2259c700 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 0x561e34703100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.272+0000 7f0d2259c700 1 -- 172.21.15.8:0/1309155103 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d24105a50 con 0x561e346f1ec0 2023-10-06T23:15:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.272+0000 7f0d2259c700 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e346fbb80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400f9d0 tx=0x7f0d14005290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=113f471e5daf7da9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.272+0000 7f0d09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:15:08.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.273+0000 7f0d09ffb700 1 -- 172.21.15.8:0/1309155103 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14003880 con 0x561e346f1ec0 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.273+0000 7f0d09ffb700 1 -- 172.21.15.8:0/1309155103 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0d140056b0 con 0x561e346f1ec0 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.273+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/1309155103 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e346e4d50 con 0x561e346f1ec0 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.273+0000 7f0d09ffb700 1 -- 172.21.15.8:0/1309155103 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d1400f460 con 0x561e346f1ec0 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.273+0000 7f0d3c7f5b80 10 client.25493 fetch_fsmap learned FSMap version 27 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.273+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/1309155103 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561e34458c00 con 0x561e346f1ec0 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.274+0000 7f0d09ffb700 1 -- 172.21.15.8:0/1309155103 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e346e4d50 con 0x561e346f1ec0 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.274+0000 7f0d09ffb700 1 -- 172.21.15.8:0/1309155103 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0d14009c70 con 0x561e346f1ec0 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.275+0000 7f0d3c7f5b80 10 client.25493 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.275+0000 7f0d3c7f5b80 10 client.25493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.275+0000 7f0d3c7f5b80 20 client.25493 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.275+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561e34707550 0x561e34709970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.275+0000 7f0d3c7f5b80 4 client.25493 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:15:08.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.275+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/1309155103 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e3463ddb0 con 0x561e34707550 2023-10-06T23:15:08.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.275+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561e34707550 0x561e34709970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.276+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561e34707550 0x561e34709970 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a8069e23f4e9458 server_cookie=4a698f7a06f03a31 in_seq=0 out_seq=0 2023-10-06T23:15:08.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.276+0000 7f0d09ffb700 10 client.25493 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:08.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.277+0000 7f0d09ffb700 1 -- 172.21.15.8:0/1309155103 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e3463ddb0 con 0x561e34707550 2023-10-06T23:15:08.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.277+0000 7f0d09ffb700 10 client.25493 handle_command_reply: tid=0 2023-10-06T23:15:08.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.277+0000 7f0d3c7f5b80 1 client.25493 shutdown 2023-10-06T23:15:08.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.278+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/1309155103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 msgr2=0x561e346fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.278+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e346fbb80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400f9d0 tx=0x7f0d14005290 comp rx=0 tx=0).stop 2023-10-06T23:15:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.278+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/1309155103 shutdown_connections 2023-10-06T23:15:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.278+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561e34707550 0x561e34709970 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.278+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 0x561e34703100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.278+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e346fbb80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.283 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.278+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/1309155103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f2fd0 0x561e346fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.278+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/1309155103 >> 172.21.15.8:0/1309155103 conn(0x561e34666200 msgr2=0x561e346ec250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.279+0000 7f0d09ffb700 0 client.25493 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.279+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/1309155103 shutdown_connections 2023-10-06T23:15:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.279+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/1309155103 wait complete. 2023-10-06T23:15:08.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.280+0000 7f0d3c7f5b80 20 client.25493 trim_cache size 0 max 16384 2023-10-06T23:15:08.310 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.309+0000 7f0d3c7f5b80 1 Processor -- start 2023-10-06T23:15:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.309+0000 7f0d3c7f5b80 1 -- start start 2023-10-06T23:15:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.310+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f1ec0 0x561e346fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.310+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f2fd0 0x561e347030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.310+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 0x561e34709560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.310+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e344c58c0 con 0x561e346f3990 2023-10-06T23:15:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.310+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e346f6450 con 0x561e346f2fd0 2023-10-06T23:15:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.310+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e346f24f0 con 0x561e346f1ec0 2023-10-06T23:15:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.310+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f1ec0 0x561e346fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f1ec0 0x561e346fb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39588/0 (socket says 172.21.15.8:39588) 2023-10-06T23:15:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d2259c700 1 -- 172.21.15.8:0/4019992709 learned_addr learned my addr 172.21.15.8:0/4019992709 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f2fd0 0x561e347030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d22d9d700 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 0x561e34709560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d2259c700 1 -- 172.21.15.8:0/4019992709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f2fd0 msgr2=0x561e347030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:08.314 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d2259c700 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f2fd0 0x561e347030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d2259c700 1 -- 172.21.15.8:0/4019992709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 msgr2=0x561e34709560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d2259c700 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 0x561e34709560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.315 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d2259c700 1 -- 172.21.15.8:0/4019992709 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e344961f0 con 0x561e346f1ec0 2023-10-06T23:15:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.311+0000 7f0d2259c700 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f1ec0 0x561e346fb270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d14005430 tx=0x7f0d14009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ab9081788a10c6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.312+0000 7f0d117fa700 1 -- 172.21.15.8:0/4019992709 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400bab0 con 0x561e346f1ec0 2023-10-06T23:15:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.312+0000 7f0d117fa700 1 -- 172.21.15.8:0/4019992709 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d14009c00 con 0x561e346f1ec0 2023-10-06T23:15:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.312+0000 7f0d117fa700 1 -- 172.21.15.8:0/4019992709 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d140038e0 con 0x561e346f1ec0 2023-10-06T23:15:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/4019992709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f1ec0 msgr2=0x561e346fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f1ec0 0x561e346fb270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d14005430 tx=0x7f0d14009fd0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/4019992709 shutdown_connections 2023-10-06T23:15:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f3990 0x561e34709560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f1ec0 0x561e346fb270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/4019992709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f2fd0 0x561e347030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/4019992709 >> 172.21.15.8:0/4019992709 conn(0x561e34666200 msgr2=0x561e346fa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/4019992709 shutdown_connections 2023-10-06T23:15:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.313+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/4019992709 wait complete. 2023-10-06T23:15:08.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.314+0000 7f0d3c7f5b80 1 -- start start 2023-10-06T23:15:08.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.314+0000 7f0d3c7f5b80 1 Processor -- start 2023-10-06T23:15:08.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e347003e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f2fd0 0x561e34700920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d3c7f5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f3990 0x561e34701890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e34701dd0 con 0x561e346f2fd0 2023-10-06T23:15:08.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e34701f40 con 0x561e346f1ec0 2023-10-06T23:15:08.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d3c7f5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e34702100 con 0x561e346f3990 2023-10-06T23:15:08.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d3c7f5b80 10 client.0 _ll_register_callbacks cb 0x7f0d14009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e347003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d2259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e347003e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:56410/0 (socket says 172.21.15.8:56410) 2023-10-06T23:15:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d2259c700 1 -- 172.21.15.8:0/2709311828 learned_addr learned my addr 172.21.15.8:0/2709311828 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d22d9d700 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f3990 0x561e34701890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.315+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f2fd0 0x561e34700920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.316+0000 7f0d2259c700 1 -- 172.21.15.8:0/2709311828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f3990 msgr2=0x561e34701890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.316+0000 7f0d2259c700 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f3990 0x561e34701890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.316+0000 7f0d2259c700 1 -- 172.21.15.8:0/2709311828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f2fd0 msgr2=0x561e34700920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.316+0000 7f0d2259c700 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f2fd0 0x561e34700920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.316+0000 7f0d2259c700 1 -- 172.21.15.8:0/2709311828 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e34458c00 con 0x561e346f1ec0 2023-10-06T23:15:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.316+0000 7f0d2259c700 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e347003e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c010 tx=0x7f0d1400f870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faca289671389263 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.316+0000 7f0d09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:15:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.316+0000 7f0d09ffb700 1 -- 172.21.15.8:0/2709311828 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14003680 con 0x561e346f1ec0 2023-10-06T23:15:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.317+0000 7f0d09ffb700 1 -- 172.21.15.8:0/2709311828 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0d14000e40 con 0x561e346f1ec0 2023-10-06T23:15:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.317+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/2709311828 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d1401d040 con 0x561e346f1ec0 2023-10-06T23:15:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.317+0000 7f0d09ffb700 1 -- 172.21.15.8:0/2709311828 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d140037e0 con 0x561e346f1ec0 2023-10-06T23:15:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.317+0000 7f0d3c7f5b80 10 client.25499 fetch_fsmap learned FSMap version 28 2023-10-06T23:15:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.317+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/2709311828 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x561e3446e250 con 0x561e346f1ec0 2023-10-06T23:15:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.318+0000 7f0d09ffb700 1 -- 172.21.15.8:0/2709311828 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d1401d040 con 0x561e346f1ec0 2023-10-06T23:15:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.319+0000 7f0d09ffb700 1 -- 172.21.15.8:0/2709311828 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 28) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0d14020070 con 0x561e346f1ec0 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.319+0000 7f0d3c7f5b80 10 client.25499 fetch_fsmap finished waiting for FSMap version 28 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.319+0000 7f0d3c7f5b80 10 client.25499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.319+0000 7f0d3c7f5b80 20 client.25499 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.319+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561e3475b530 0x561e3475d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.319+0000 7f0d3c7f5b80 4 client.25499 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.319+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/2709311828 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561e3463dad0 con 0x561e3475b530 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.320+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561e3475b530 0x561e3475d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.321+0000 7f0d21d9b700 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561e3475b530 0x561e3475d920 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a26f6a15f7a4870 server_cookie=4d8d7c46d17f97ac in_seq=0 out_seq=0 2023-10-06T23:15:08.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.321+0000 7f0d09ffb700 10 client.25499 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:08.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:08 smithi156 ceph-mon[102862]: pgmap v417: 97 pgs: 97 active+clean; 997 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 22 MiB/s wr, 262 op/s 2023-10-06T23:15:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.355+0000 7f0d09ffb700 1 -- 172.21.15.8:0/2709311828 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561e3463dad0 con 0x561e3475b530 2023-10-06T23:15:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.355+0000 7f0d09ffb700 10 client.25499 handle_command_reply: tid=0 2023-10-06T23:15:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.355+0000 7f0d3c7f5b80 1 client.25499 shutdown 2023-10-06T23:15:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.355+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/2709311828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 msgr2=0x561e347003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.355+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e347003e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c010 tx=0x7f0d1400f870 comp rx=0 tx=0).stop 2023-10-06T23:15:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/2709311828 shutdown_connections 2023-10-06T23:15:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561e3475b530 0x561e3475d920 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e346f3990 0x561e34701890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561e346f1ec0 0x561e347003e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 1 --2- 172.21.15.8:0/2709311828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e346f2fd0 0x561e34700920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/2709311828 >> 172.21.15.8:0/2709311828 conn(0x561e34666200 msgr2=0x561e34709560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d09ffb700 0 client.25499 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/2709311828 shutdown_connections 2023-10-06T23:15:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 1 -- 172.21.15.8:0/2709311828 wait complete. 2023-10-06T23:15:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.356+0000 7f0d3c7f5b80 20 client.25499 trim_cache size 0 max 16384 2023-10-06T23:15:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:15:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:15:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:15:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:15:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.357+0000 7f0d28dff700 1 -- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d0c0a15d0 msgr2=0x7f0d0c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.357+0000 7f0d28dff700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d0c0a15d0 0x7f0d0c0a3a90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x561e346f1c60 tx=0x7f0d18004750 comp rx=0 tx=0).stop 2023-10-06T23:15:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.357+0000 7f0d28dff700 1 -- 172.21.15.8:0/2765431923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d24104aa0 msgr2=0x7f0d24070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.357+0000 7f0d28dff700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d24104aa0 0x7f0d24070ca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00efc0 tx=0x7f0d1c00c3a0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.358+0000 7f0d28dff700 1 -- 172.21.15.8:0/2765431923 shutdown_connections 2023-10-06T23:15:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.358+0000 7f0d28dff700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d0c0a15d0 0x7f0d0c0a3a90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.358+0000 7f0d28dff700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d24104aa0 0x7f0d24070ca0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.358+0000 7f0d28dff700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d240ff760 0x7f0d2406f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.358+0000 7f0d28dff700 1 --2- 172.21.15.8:0/2765431923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d241020d0 0x7f0d2406fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.358+0000 7f0d28dff700 1 -- 172.21.15.8:0/2765431923 >> 172.21.15.8:0/2765431923 conn(0x7f0d240fb340 msgr2=0x7f0d24103620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.358+0000 7f0d28dff700 1 -- 172.21.15.8:0/2765431923 shutdown_connections 2023-10-06T23:15:08.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:08.358+0000 7f0d28dff700 1 -- 172.21.15.8:0/2765431923 wait complete. 2023-10-06T23:15:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:08 smithi008 ceph-mon[98532]: pgmap v417: 97 pgs: 97 active+clean; 997 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 22 MiB/s wr, 262 op/s 2023-10-06T23:15:08.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:08 smithi190 ceph-mon[102658]: pgmap v417: 97 pgs: 97 active+clean; 997 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 22 MiB/s wr, 262 op/s 2023-10-06T23:15:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 15.0 s, 818.2 tps, lat 121.974 ms stddev 156.707 2023-10-06T23:15:09.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:09 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:15:09.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:09 smithi156 ceph-mon[102862]: pgmap v418: 97 pgs: 97 active+clean; 1017 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 283 op/s 2023-10-06T23:15:09.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:09 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:15:09.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:09 smithi008 ceph-mon[98532]: pgmap v418: 97 pgs: 97 active+clean; 1017 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 283 op/s 2023-10-06T23:15:09.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:09 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:15:09.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:09 smithi190 ceph-mon[102658]: pgmap v418: 97 pgs: 97 active+clean; 1017 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 283 op/s 2023-10-06T23:15:12.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:12 smithi156 ceph-mon[102862]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 23 MiB/s wr, 315 op/s 2023-10-06T23:15:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:12 smithi008 ceph-mon[98532]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 23 MiB/s wr, 315 op/s 2023-10-06T23:15:12.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:12 smithi190 ceph-mon[102658]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 23 MiB/s wr, 315 op/s 2023-10-06T23:15:13.242 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:15:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.577+0000 7f01b29ff700 1 -- 172.21.15.8:0/3832603675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ac107eb0 msgr2=0x7f01ac10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.577+0000 7f01b29ff700 1 --2- 172.21.15.8:0/3832603675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ac107eb0 0x7f01ac10a2e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f019c00b0a0 tx=0x7f019c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.578+0000 7f01b29ff700 1 -- 172.21.15.8:0/3832603675 shutdown_connections 2023-10-06T23:15:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.578+0000 7f01b29ff700 1 --2- 172.21.15.8:0/3832603675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac10d1f0 0x7f01ac10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.578+0000 7f01b29ff700 1 --2- 172.21.15.8:0/3832603675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ac107eb0 0x7f01ac10a2e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.578+0000 7f01b29ff700 1 --2- 172.21.15.8:0/3832603675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ac10a820 0x7f01ac10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.578+0000 7f01b29ff700 1 -- 172.21.15.8:0/3832603675 >> 172.21.15.8:0/3832603675 conn(0x7f01ac06dc90 msgr2=0x7f01ac0700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.578+0000 7f01b29ff700 1 -- 172.21.15.8:0/3832603675 shutdown_connections 2023-10-06T23:15:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.578+0000 7f01b29ff700 1 -- 172.21.15.8:0/3832603675 wait complete. 2023-10-06T23:15:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.580+0000 7f01b29ff700 1 Processor -- start 2023-10-06T23:15:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.580+0000 7f01b29ff700 1 -- start start 2023-10-06T23:15:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.580+0000 7f01b29ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ac107eb0 0x7f01ac1a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.580+0000 7f01b29ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ac10a820 0x7f01ac1a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.580+0000 7f01b29ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac10d1f0 0x7f01ac1ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.580+0000 7f01b29ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac1ad640 con 0x7f01ac10d1f0 2023-10-06T23:15:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.580+0000 7f01b29ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac1ad780 con 0x7f01ac10a820 2023-10-06T23:15:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.580+0000 7f01b29ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac1ad910 con 0x7f01ac107eb0 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ac10a820 0x7f01ac1a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ac10a820 0x7f01ac1a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49518/0 (socket says 172.21.15.8:49518) 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01a3fff700 1 -- 172.21.15.8:0/821594764 learned_addr learned my addr 172.21.15.8:0/821594764 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01abfff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ac107eb0 0x7f01ac1a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01a3fff700 1 -- 172.21.15.8:0/821594764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ac107eb0 msgr2=0x7f01ac1a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01a3fff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ac107eb0 0x7f01ac1a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01a3fff700 1 -- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac10d1f0 msgr2=0x7f01ac1ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01a3fff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac10d1f0 0x7f01ac1ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.581+0000 7f01a3fff700 1 -- 172.21.15.8:0/821594764 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c009d00 con 0x7f01ac10a820 2023-10-06T23:15:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.582+0000 7f01a3fff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ac10a820 0x7f01ac1a6000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f019400c970 tx=0x7f019400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.582+0000 7f01a9ffb700 1 -- 172.21.15.8:0/821594764 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194004220 con 0x7f01ac10a820 2023-10-06T23:15:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.582+0000 7f01a9ffb700 1 -- 172.21.15.8:0/821594764 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0194007d30 con 0x7f01ac10a820 2023-10-06T23:15:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.582+0000 7f01a9ffb700 1 -- 172.21.15.8:0/821594764 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194003bf0 con 0x7f01ac10a820 2023-10-06T23:15:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.582+0000 7f01b29ff700 1 -- 172.21.15.8:0/821594764 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac1adbf0 con 0x7f01ac10a820 2023-10-06T23:15:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.583+0000 7f01b29ff700 1 -- 172.21.15.8:0/821594764 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac1ae0b0 con 0x7f01ac10a820 2023-10-06T23:15:13.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.590+0000 7f01c6397b80 1 Processor -- start 2023-10-06T23:15:13.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.590+0000 7f01a9ffb700 1 -- 172.21.15.8:0/821594764 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0194003d50 con 0x7f01ac10a820 2023-10-06T23:15:13.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.591+0000 7f01c6397b80 1 -- start start 2023-10-06T23:15:13.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.591+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.591+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a4bc0 0x55a9f42a5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.591+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a5a60 0x55a9f42a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.591+0000 7f01c6397b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f420c460 con 0x55a9f42a5a60 2023-10-06T23:15:13.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.591+0000 7f01c6397b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f41fdc20 con 0x55a9f42a4260 2023-10-06T23:15:13.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.591+0000 7f01c6397b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f41fb540 con 0x55a9f42a4bc0 2023-10-06T23:15:13.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01b0f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01b0f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49534/0 (socket says 172.21.15.8:49534) 2023-10-06T23:15:13.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01b0f9c700 1 -- 172.21.15.8:0/1541429610 learned_addr learned my addr 172.21.15.8:0/1541429610 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:13.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01abfff700 1 --2- 172.21.15.8:0/1541429610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a4bc0 0x55a9f42a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01b0f9c700 1 -- 172.21.15.8:0/1541429610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a4bc0 msgr2=0x55a9f42a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:13.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/1541429610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a4bc0 0x55a9f42a5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01b0f9c700 1 -- 172.21.15.8:0/1541429610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a5a60 msgr2=0x55a9f42a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:13.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/1541429610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a5a60 0x55a9f42a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.592+0000 7f01b0f9c700 1 -- 172.21.15.8:0/1541429610 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9f4021de0 con 0x55a9f42a4260 2023-10-06T23:15:13.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.593+0000 7f01a9ffb700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01980a1500 0x7f01980a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.593+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/1541429610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42a4680 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01a400bb10 tx=0x7f01a400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af8c1f5d7290aac9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:13.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.593+0000 7f01a9ffb700 1 -- 172.21.15.8:0/821594764 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f01940ccbf0 con 0x7f01ac10a820 2023-10-06T23:15:13.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.593+0000 7f01abfff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01980a1500 0x7f01980a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.594+0000 7f01a27fc700 1 -- 172.21.15.8:0/1541429610 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400d890 con 0x55a9f42a4260 2023-10-06T23:15:13.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.594+0000 7f01a27fc700 1 -- 172.21.15.8:0/1541429610 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01a400de80 con 0x55a9f42a4260 2023-10-06T23:15:13.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.594+0000 7f01a27fc700 1 -- 172.21.15.8:0/1541429610 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40053e0 con 0x55a9f42a4260 2023-10-06T23:15:13.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.594+0000 7f01c6397b80 1 -- 172.21.15.8:0/1541429610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 msgr2=0x55a9f42a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.594+0000 7f01abfff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01980a1500 0x7f01980a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f019c009fd0 tx=0x7f019c00b7f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:13.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.594+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1541429610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42a4680 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01a400bb10 tx=0x7f01a400be20 comp rx=0 tx=0).stop 2023-10-06T23:15:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.595+0000 7f01c6397b80 1 -- 172.21.15.8:0/1541429610 shutdown_connections 2023-10-06T23:15:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.595+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1541429610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a5a60 0x55a9f42a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.595+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1541429610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42a4680 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.595+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1541429610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a4bc0 0x55a9f42a5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.595+0000 7f01c6397b80 1 -- 172.21.15.8:0/1541429610 >> 172.21.15.8:0/1541429610 conn(0x55a9f4218260 msgr2=0x55a9f429f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.595+0000 7f01c6397b80 1 -- 172.21.15.8:0/1541429610 shutdown_connections 2023-10-06T23:15:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.595+0000 7f01c6397b80 1 -- 172.21.15.8:0/1541429610 wait complete. 2023-10-06T23:15:13.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.596+0000 7f01c6397b80 1 -- start start 2023-10-06T23:15:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.596+0000 7f01c6397b80 1 Processor -- start 2023-10-06T23:15:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.597+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.597+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.597+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.597+0000 7f01c6397b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f41f6e30 con 0x55a9f42a4bc0 2023-10-06T23:15:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.597+0000 7f01c6397b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f4193710 con 0x55a9f42a4260 2023-10-06T23:15:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.597+0000 7f01c6397b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f41933b0 con 0x55a9f42a5a60 2023-10-06T23:15:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.597+0000 7f01c6397b80 10 client.0 _ll_register_callbacks cb 0x55a9f3ff0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:13.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:13 smithi156 ceph-mon[102862]: pgmap v420: 97 pgs: 97 active+clean; 1.0 GiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 18 MiB/s wr, 269 op/s 2023-10-06T23:15:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.597+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52348/0 (socket says 172.21.15.8:52348) 2023-10-06T23:15:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01a3fff700 1 -- 172.21.15.8:0/1751868105 learned_addr learned my addr 172.21.15.8:0/1751868105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01abfff700 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01a3fff700 1 -- 172.21.15.8:0/1751868105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 msgr2=0x55a9f42b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01a3fff700 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01a3fff700 1 -- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 msgr2=0x55a9f42ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01a3fff700 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01a3fff700 1 -- 172.21.15.8:0/1751868105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a400b740 con 0x55a9f42a4bc0 2023-10-06T23:15:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.598+0000 7f01abfff700 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:15:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.599+0000 7f01a3fff700 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42ae680 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0194000c00 tx=0x7f0194099a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1940229720ed24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.599+0000 7f018b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:15:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.600+0000 7f018b7fe700 1 -- 172.21.15.8:0/1751868105 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019409a380 con 0x55a9f42a4bc0 2023-10-06T23:15:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.600+0000 7f018b7fe700 1 -- 172.21.15.8:0/1751868105 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f019409a620 con 0x55a9f42a4bc0 2023-10-06T23:15:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.600+0000 7f01c6397b80 1 -- 172.21.15.8:0/1751868105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9f41efe10 con 0x55a9f42a4bc0 2023-10-06T23:15:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.600+0000 7f018b7fe700 1 -- 172.21.15.8:0/1751868105 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0194099f20 con 0x55a9f42a4bc0 2023-10-06T23:15:13.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.601+0000 7f01c6397b80 10 client.15714 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:13.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.601+0000 7f01c6397b80 1 -- 172.21.15.8:0/1751868105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55a9f400ac60 con 0x55a9f42a4bc0 2023-10-06T23:15:13.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.601+0000 7f018b7fe700 1 -- 172.21.15.8:0/1751868105 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a9f41efe10 con 0x55a9f42a4bc0 2023-10-06T23:15:13.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.602+0000 7f018b7fe700 1 -- 172.21.15.8:0/1751868105 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f019409d070 con 0x55a9f42a4bc0 2023-10-06T23:15:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.602+0000 7f01c6397b80 10 client.15714 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.602+0000 7f01c6397b80 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.602+0000 7f01c6397b80 20 client.15714 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.602+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a9f42b9fd0 0x55a9f42bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.602+0000 7f01c6397b80 4 client.15714 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:15:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.602+0000 7f01c6397b80 1 -- 172.21.15.8:0/1751868105 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9f41efb30 con 0x55a9f42b9fd0 2023-10-06T23:15:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.602+0000 7f01abfff700 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a9f42b9fd0 0x55a9f42bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.603+0000 7f01abfff700 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a9f42b9fd0 0x55a9f42bc3f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9993c9a884ebed48 server_cookie=7f37cc15d3920b19 in_seq=0 out_seq=0 2023-10-06T23:15:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.603+0000 7f018b7fe700 10 client.15714 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.604+0000 7f018b7fe700 1 -- 172.21.15.8:0/1751868105 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a9f41efb30 con 0x55a9f42b9fd0 2023-10-06T23:15:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.604+0000 7f018b7fe700 10 client.15714 handle_command_reply: tid=0 2023-10-06T23:15:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.604+0000 7f01c6397b80 1 client.15714 shutdown 2023-10-06T23:15:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f01c6397b80 1 -- 172.21.15.8:0/1751868105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 msgr2=0x55a9f42ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42ae680 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0194000c00 tx=0x7f0194099a60 comp rx=0 tx=0).stop 2023-10-06T23:15:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f01c6397b80 1 -- 172.21.15.8:0/1751868105 shutdown_connections 2023-10-06T23:15:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a9f42b9fd0 0x55a9f42bc3f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f01c6397b80 1 --2- 172.21.15.8:0/1751868105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42ae680 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f01c6397b80 1 -- 172.21.15.8:0/1751868105 >> 172.21.15.8:0/1751868105 conn(0x55a9f4218260 msgr2=0x55a9f429ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.605+0000 7f018b7fe700 0 client.15714 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:13.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.606+0000 7f01c6397b80 1 -- 172.21.15.8:0/1751868105 shutdown_connections 2023-10-06T23:15:13.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.606+0000 7f01c6397b80 1 -- 172.21.15.8:0/1751868105 wait complete. 2023-10-06T23:15:13.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.606+0000 7f01c6397b80 20 client.15714 trim_cache size 0 max 16384 2023-10-06T23:15:13.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.637+0000 7f01c6397b80 1 Processor -- start 2023-10-06T23:15:13.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.637+0000 7f01c6397b80 1 -- start start 2023-10-06T23:15:13.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.637+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.637+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.637+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.637+0000 7f01c6397b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f42add10 con 0x55a9f42a4bc0 2023-10-06T23:15:13.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.637+0000 7f01c6397b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f4077920 con 0x55a9f42a4260 2023-10-06T23:15:13.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.637+0000 7f01c6397b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f42acb20 con 0x55a9f42a5a60 2023-10-06T23:15:13.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52350/0 (socket says 172.21.15.8:52350) 2023-10-06T23:15:13.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01a3fff700 1 -- 172.21.15.8:0/2552085668 learned_addr learned my addr 172.21.15.8:0/2552085668 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:13.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01abfff700 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01b0f9c700 1 -- 172.21.15.8:0/2552085668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 msgr2=0x55a9f42b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:13.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01b0f9c700 1 -- 172.21.15.8:0/2552085668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 msgr2=0x55a9f42b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:13.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.638+0000 7f01b0f9c700 1 -- 172.21.15.8:0/2552085668 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9f4048250 con 0x55a9f42a5a60 2023-10-06T23:15:13.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.639+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42ae140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005d60 tx=0x7f01a4005c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad3b46ea686f3e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:13.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.639+0000 7f01a2ffd700 1 -- 172.21.15.8:0/2552085668 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4004970 con 0x55a9f42a5a60 2023-10-06T23:15:13.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.639+0000 7f01a2ffd700 1 -- 172.21.15.8:0/2552085668 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01a40044d0 con 0x55a9f42a5a60 2023-10-06T23:15:13.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.639+0000 7f01a2ffd700 1 -- 172.21.15.8:0/2552085668 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400dcf0 con 0x55a9f42a5a60 2023-10-06T23:15:13.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.640+0000 7f01c6397b80 1 -- 172.21.15.8:0/2552085668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 msgr2=0x55a9f42ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.640+0000 7f01c6397b80 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42ae140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005d60 tx=0x7f01a4005c10 comp rx=0 tx=0).stop 2023-10-06T23:15:13.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.640+0000 7f01c6397b80 1 -- 172.21.15.8:0/2552085668 shutdown_connections 2023-10-06T23:15:13.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.640+0000 7f01c6397b80 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42ae140 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.640+0000 7f01c6397b80 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4260 0x55a9f42b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.640+0000 7f01c6397b80 1 --2- 172.21.15.8:0/2552085668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.640+0000 7f01c6397b80 1 -- 172.21.15.8:0/2552085668 >> 172.21.15.8:0/2552085668 conn(0x55a9f4218260 msgr2=0x55a9f429ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:13.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.641+0000 7f01c6397b80 1 -- 172.21.15.8:0/2552085668 shutdown_connections 2023-10-06T23:15:13.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.641+0000 7f01c6397b80 1 -- 172.21.15.8:0/2552085668 wait complete. 2023-10-06T23:15:13.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.641+0000 7f01c6397b80 1 -- start start 2023-10-06T23:15:13.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.642+0000 7f01c6397b80 1 Processor -- start 2023-10-06T23:15:13.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.642+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4260 0x55a9f42b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.642+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.642+0000 7f01c6397b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.642+0000 7f01c6397b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f42b4c00 con 0x55a9f42a4260 2023-10-06T23:15:13.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.642+0000 7f01c6397b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f42b4d70 con 0x55a9f42a4bc0 2023-10-06T23:15:13.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.642+0000 7f01c6397b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f42b4f30 con 0x55a9f42a5a60 2023-10-06T23:15:13.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.642+0000 7f01c6397b80 10 client.0 _ll_register_callbacks cb 0x55a9f3ff0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:13.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4260 0x55a9f42b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01a3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49568/0 (socket says 172.21.15.8:49568) 2023-10-06T23:15:13.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4260 0x55a9f42b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52366/0 (socket says 172.21.15.8:52366) 2023-10-06T23:15:13.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01a3fff700 1 -- 172.21.15.8:0/4042451950 learned_addr learned my addr 172.21.15.8:0/4042451950 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01b0f9c700 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01abfff700 1 -- 172.21.15.8:0/4042451950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 msgr2=0x55a9f42b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01abfff700 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01abfff700 1 -- 172.21.15.8:0/4042451950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4bc0 msgr2=0x55a9f42b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01abfff700 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01abfff700 1 -- 172.21.15.8:0/4042451950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9f4021de0 con 0x55a9f42a4260 2023-10-06T23:15:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.643+0000 7f01a3fff700 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:15:13.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.644+0000 7f01abfff700 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4260 0x55a9f42b1160 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f019c00b070 tx=0x7f019c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65688b6fcfcf8b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:13.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.644+0000 7f018b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:15:13.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:13 smithi008 ceph-mon[98532]: pgmap v420: 97 pgs: 97 active+clean; 1.0 GiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 18 MiB/s wr, 269 op/s 2023-10-06T23:15:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.644+0000 7f018b7fe700 1 -- 172.21.15.8:0/4042451950 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c02f040 con 0x55a9f42a4260 2023-10-06T23:15:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.644+0000 7f018b7fe700 1 -- 172.21.15.8:0/4042451950 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f019c030d90 con 0x55a9f42a4260 2023-10-06T23:15:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.644+0000 7f01c6397b80 1 -- 172.21.15.8:0/4042451950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9f4296f10 con 0x55a9f42a4260 2023-10-06T23:15:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.645+0000 7f018b7fe700 1 -- 172.21.15.8:0/4042451950 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f019c00e040 con 0x55a9f42a4260 2023-10-06T23:15:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.645+0000 7f01c6397b80 10 client.15720 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.645+0000 7f01c6397b80 1 -- 172.21.15.8:0/4042451950 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55a9f40202b0 con 0x55a9f42a4260 2023-10-06T23:15:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.646+0000 7f018b7fe700 1 -- 172.21.15.8:0/4042451950 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f019c040020 con 0x55a9f42a4260 2023-10-06T23:15:13.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.646+0000 7f018b7fe700 1 -- 172.21.15.8:0/4042451950 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f019c0056c0 con 0x55a9f42a4260 2023-10-06T23:15:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.646+0000 7f01c6397b80 10 client.15720 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.646+0000 7f01c6397b80 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.646+0000 7f01c6397b80 20 client.15720 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.646+0000 7f01c6397b80 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a9f431fbc0 0x55a9f4321fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.646+0000 7f01c6397b80 4 client.15720 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:15:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.646+0000 7f01c6397b80 1 -- 172.21.15.8:0/4042451950 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a9f4042f70 con 0x55a9f431fbc0 2023-10-06T23:15:13.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.647+0000 7f01a3fff700 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a9f431fbc0 0x55a9f4321fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.647+0000 7f01a3fff700 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a9f431fbc0 0x55a9f4321fe0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=851ab42da3edb1ba server_cookie=89105d637e874166 in_seq=0 out_seq=0 2023-10-06T23:15:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.647+0000 7f018b7fe700 10 client.15720 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f018b7fe700 1 -- 172.21.15.8:0/4042451950 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a9f4042f70 con 0x55a9f431fbc0 2023-10-06T23:15:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f018b7fe700 10 client.15720 handle_command_reply: tid=0 2023-10-06T23:15:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 client.15720 shutdown 2023-10-06T23:15:13.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 -- 172.21.15.8:0/4042451950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4260 msgr2=0x55a9f42b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4260 0x55a9f42b1160 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f019c00b070 tx=0x7f019c021000 comp rx=0 tx=0).stop 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 -- 172.21.15.8:0/4042451950 shutdown_connections 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a9f431fbc0 0x55a9f4321fe0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9f42a4260 0x55a9f42b1160 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f42a5a60 0x55a9f42b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 --2- 172.21.15.8:0/4042451950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a9f42a4bc0 0x55a9f42b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f01c6397b80 1 -- 172.21.15.8:0/4042451950 >> 172.21.15.8:0/4042451950 conn(0x55a9f4218260 msgr2=0x55a9f42b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.648+0000 7f018b7fe700 0 client.15720 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.649+0000 7f01c6397b80 1 -- 172.21.15.8:0/4042451950 shutdown_connections 2023-10-06T23:15:13.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.649+0000 7f01c6397b80 1 -- 172.21.15.8:0/4042451950 wait complete. 2023-10-06T23:15:13.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.649+0000 7f01c6397b80 20 client.15720 trim_cache size 0 max 16384 2023-10-06T23:15:13.652 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:15:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:15:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:15:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 -- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01980a1500 msgr2=0x7f01980a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01980a1500 0x7f01980a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f019c009fd0 tx=0x7f019c00b7f0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 -- 172.21.15.8:0/821594764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ac10a820 msgr2=0x7f01ac1a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ac10a820 0x7f01ac1a6000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f019400c970 tx=0x7f019400cc80 comp rx=0 tx=0).stop 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 -- 172.21.15.8:0/821594764 shutdown_connections 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f01980a1500 0x7f01980a39c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ac10d1f0 0x7f01ac1ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01ac107eb0 0x7f01ac1a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 --2- 172.21.15.8:0/821594764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01ac10a820 0x7f01ac1a6000 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.650+0000 7f01b29ff700 1 -- 172.21.15.8:0/821594764 >> 172.21.15.8:0/821594764 conn(0x7f01ac06dc90 msgr2=0x7f01ac10b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.651+0000 7f01b29ff700 1 -- 172.21.15.8:0/821594764 shutdown_connections 2023-10-06T23:15:13.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:13.651+0000 7f01b29ff700 1 -- 172.21.15.8:0/821594764 wait complete. 2023-10-06T23:15:13.680 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:15:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:13 smithi190 ceph-mon[102658]: pgmap v420: 97 pgs: 97 active+clean; 1.0 GiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 18 MiB/s wr, 269 op/s 2023-10-06T23:15:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 20.0 s, 702.6 tps, lat 141.995 ms stddev 183.427 2023-10-06T23:15:14.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:14 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:15:14.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:14 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:15:14.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:14 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:15:15.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:15 smithi156 ceph-mon[102862]: pgmap v421: 97 pgs: 97 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 20 MiB/s wr, 340 op/s 2023-10-06T23:15:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:15 smithi008 ceph-mon[98532]: pgmap v421: 97 pgs: 97 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 20 MiB/s wr, 340 op/s 2023-10-06T23:15:15.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:15 smithi190 ceph-mon[102658]: pgmap v421: 97 pgs: 97 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 20 MiB/s wr, 340 op/s 2023-10-06T23:15:18.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:18 smithi156 ceph-mon[102862]: pgmap v422: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 23 MiB/s wr, 512 op/s 2023-10-06T23:15:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:18 smithi008 ceph-mon[98532]: pgmap v422: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 23 MiB/s wr, 512 op/s 2023-10-06T23:15:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:18 smithi190 ceph-mon[102658]: pgmap v422: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 23 MiB/s wr, 512 op/s 2023-10-06T23:15:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 25.0 s, 362.8 tps, lat 267.762 ms stddev 205.877 2023-10-06T23:15:20.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:20 smithi156 ceph-mon[102862]: pgmap v423: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 17 MiB/s wr, 504 op/s 2023-10-06T23:15:20.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:20 smithi008 ceph-mon[98532]: pgmap v423: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 17 MiB/s wr, 504 op/s 2023-10-06T23:15:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:20 smithi190 ceph-mon[102658]: pgmap v423: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 17 MiB/s wr, 504 op/s 2023-10-06T23:15:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.574+0000 7f25a6dff700 1 -- 172.21.15.8:0/365311750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0100ea0 msgr2=0x7f25a01012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.574+0000 7f25a6dff700 1 --2- 172.21.15.8:0/365311750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0100ea0 0x7f25a01012c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2594009990 tx=0x7f2594009ca0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.574+0000 7f25a6dff700 1 -- 172.21.15.8:0/365311750 shutdown_connections 2023-10-06T23:15:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.574+0000 7f25a6dff700 1 --2- 172.21.15.8:0/365311750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0102a40 0x7f25a0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.574+0000 7f25a6dff700 1 --2- 172.21.15.8:0/365311750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0100ea0 0x7f25a01012c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.574+0000 7f25a6dff700 1 --2- 172.21.15.8:0/365311750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25a0102080 0x7f25a0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.574+0000 7f25a6dff700 1 -- 172.21.15.8:0/365311750 >> 172.21.15.8:0/365311750 conn(0x7f25a00fc460 msgr2=0x7f25a00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:21.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.574+0000 7f25a6dff700 1 -- 172.21.15.8:0/365311750 shutdown_connections 2023-10-06T23:15:21.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.575+0000 7f25a6dff700 1 -- 172.21.15.8:0/365311750 wait complete. 2023-10-06T23:15:21.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.576+0000 7f25a6dff700 1 Processor -- start 2023-10-06T23:15:21.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.576+0000 7f25a6dff700 1 -- start start 2023-10-06T23:15:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a6dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0100ea0 0x7f25a00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a6dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0102080 0x7f25a00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a6dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25a0102a40 0x7f25a0073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a6dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01a0b60 con 0x7f25a0102a40 2023-10-06T23:15:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a6dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01a0ca0 con 0x7f25a0100ea0 2023-10-06T23:15:21.578 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a6dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01a0de0 con 0x7f25a0102080 2023-10-06T23:15:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f259ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0102080 0x7f25a00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0100ea0 0x7f25a00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0100ea0 0x7f25a00732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:55012/0 (socket says 172.21.15.8:55012) 2023-10-06T23:15:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a4b9b700 1 -- 172.21.15.8:0/1631944838 learned_addr learned my addr 172.21.15.8:0/1631944838 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f259ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0102080 0x7f25a00737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60098/0 (socket says 172.21.15.8:60098) 2023-10-06T23:15:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.577+0000 7f25a539c700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25a0102a40 0x7f25a0073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259ffff700 1 -- 172.21.15.8:0/1631944838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0100ea0 msgr2=0x7f25a00732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259ffff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0100ea0 0x7f25a00732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259ffff700 1 -- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25a0102a40 msgr2=0x7f25a0073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259ffff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25a0102a40 0x7f25a0073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259ffff700 1 -- 172.21.15.8:0/1631944838 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940095f0 con 0x7f25a0102080 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259ffff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0102080 0x7f25a00737e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c940 tx=0x7f258c00cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259dffb700 1 -- 172.21.15.8:0/1631944838 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c004230 con 0x7f25a0102080 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f25a6dff700 1 -- 172.21.15.8:0/1631944838 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a01a1070 con 0x7f25a0102080 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259dffb700 1 -- 172.21.15.8:0/1631944838 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f258c004390 con 0x7f25a0102080 2023-10-06T23:15:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.578+0000 7f259dffb700 1 -- 172.21.15.8:0/1631944838 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c003aa0 con 0x7f25a0102080 2023-10-06T23:15:21.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.579+0000 7f25a6dff700 1 -- 172.21.15.8:0/1631944838 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a01a15d0 con 0x7f25a0102080 2023-10-06T23:15:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.582+0000 7f259dffb700 1 -- 172.21.15.8:0/1631944838 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f258c003c00 con 0x7f25a0102080 2023-10-06T23:15:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.584+0000 7f259dffb700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25900a1580 0x7f25900a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.584+0000 7f25ba68fb80 1 Processor -- start 2023-10-06T23:15:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.584+0000 7f259dffb700 1 -- 172.21.15.8:0/1631944838 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f258c013070 con 0x7f25a0102080 2023-10-06T23:15:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.585+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25900a1580 0x7f25900a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.585+0000 7f25ba68fb80 1 -- start start 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.585+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e7ec0 0x5566293e82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.585+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e8fd0 0x5566293e9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.585+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566293f0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.585+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629350400 con 0x5566293e7ec0 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.585+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629341bc0 con 0x5566293e8fd0 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.585+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55662933f4e0 con 0x5566293e9990 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f25a4b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e7ec0 0x5566293e82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e8fd0 0x5566293e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e8fd0 0x5566293e9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:55026/0 (socket says 172.21.15.8:55026) 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 -- 172.21.15.8:0/2395001551 learned_addr learned my addr 172.21.15.8:0/2395001551 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f25a539c700 1 --2- 172.21.15.8:0/2395001551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566293f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 -- 172.21.15.8:0/2395001551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 msgr2=0x5566293f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 --2- 172.21.15.8:0/2395001551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566293f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 -- 172.21.15.8:0/2395001551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e7ec0 msgr2=0x5566293e82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 --2- 172.21.15.8:0/2395001551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e7ec0 0x5566293e82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 -- 172.21.15.8:0/2395001551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556629165d80 con 0x5566293e8fd0 2023-10-06T23:15:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25900a1580 0x7f25900a3a40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f259400b5c0 tx=0x7f259400b8b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.586+0000 7f259ffff700 1 --2- 172.21.15.8:0/2395001551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e8fd0 0x5566293e9450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f258c096700 tx=0x7f258c0998d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a6d6225bcd83e28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.587+0000 7f258affd700 1 -- 172.21.15.8:0/2395001551 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c0b1070 con 0x5566293e8fd0 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.587+0000 7f258affd700 1 -- 172.21.15.8:0/2395001551 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f258c09a390 con 0x5566293e8fd0 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.587+0000 7f258affd700 1 -- 172.21.15.8:0/2395001551 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c004590 con 0x5566293e8fd0 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.587+0000 7f25ba68fb80 1 -- 172.21.15.8:0/2395001551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e8fd0 msgr2=0x5566293e9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.587+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/2395001551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e8fd0 0x5566293e9450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f258c096700 tx=0x7f258c0998d0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.588+0000 7f25ba68fb80 1 -- 172.21.15.8:0/2395001551 shutdown_connections 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.588+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/2395001551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e7ec0 0x5566293e82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.588+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/2395001551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566293f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.588+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/2395001551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e8fd0 0x5566293e9450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.588+0000 7f25ba68fb80 1 -- 172.21.15.8:0/2395001551 >> 172.21.15.8:0/2395001551 conn(0x55662935c200 msgr2=0x5566293e2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.588+0000 7f25ba68fb80 1 -- 172.21.15.8:0/2395001551 shutdown_connections 2023-10-06T23:15:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.588+0000 7f25ba68fb80 1 -- 172.21.15.8:0/2395001551 wait complete. 2023-10-06T23:15:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.588+0000 7f25ba68fb80 1 -- start start 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.589+0000 7f25ba68fb80 1 Processor -- start 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.589+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.589+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293fa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.589+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x556629401860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.589+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55662933add0 con 0x5566293e8fd0 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.589+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566292d76b0 con 0x5566293e7ec0 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.589+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566292d7350 con 0x5566293e9990 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.589+0000 7f25ba68fb80 10 client.0 _ll_register_callbacks cb 0x5566291347a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49852/0 (socket says 172.21.15.8:49852) 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 -- 172.21.15.8:0/3389884580 learned_addr learned my addr 172.21.15.8:0/3389884580 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f25a539c700 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x556629401860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 -- 172.21.15.8:0/3389884580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 msgr2=0x556629401860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x556629401860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 -- 172.21.15.8:0/3389884580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 msgr2=0x5566293fa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 -- 172.21.15.8:0/3389884580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a01a15d0 con 0x5566293e8fd0 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f25a539c700 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x556629401860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f259ffff700 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293fa820 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f258c00cfd0 tx=0x7f258c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573aaa2ebc0c9ea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.590+0000 7f257ffff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:15:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.591+0000 7f257ffff700 1 -- 172.21.15.8:0/3389884580 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c0b1070 con 0x5566293e8fd0 2023-10-06T23:15:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.591+0000 7f257ffff700 1 -- 172.21.15.8:0/3389884580 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f258c09dde0 con 0x5566293e8fd0 2023-10-06T23:15:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.591+0000 7f25ba68fb80 1 -- 172.21.15.8:0/3389884580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566293dad50 con 0x5566293e8fd0 2023-10-06T23:15:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.591+0000 7f257ffff700 1 -- 172.21.15.8:0/3389884580 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f258c0b2250 con 0x5566293e8fd0 2023-10-06T23:15:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.591+0000 7f25ba68fb80 10 client.15729 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.591+0000 7f25ba68fb80 1 -- 172.21.15.8:0/3389884580 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55662914ec00 con 0x5566293e8fd0 2023-10-06T23:15:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.592+0000 7f257ffff700 1 -- 172.21.15.8:0/3389884580 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5566293dad50 con 0x5566293e8fd0 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.592+0000 7f257ffff700 1 -- 172.21.15.8:0/3389884580 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f258c080070 con 0x5566293e8fd0 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.592+0000 7f25ba68fb80 10 client.15729 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.592+0000 7f25ba68fb80 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.593+0000 7f25ba68fb80 20 client.15729 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.593+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556629405e70 0x556629408290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.593+0000 7f25ba68fb80 4 client.15729 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.593+0000 7f25ba68fb80 1 -- 172.21.15.8:0/3389884580 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556629333db0 con 0x556629405e70 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.593+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556629405e70 0x556629408290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.593+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556629405e70 0x556629408290 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=588c25ef4fede728 server_cookie=79d254d558378b6b in_seq=0 out_seq=0 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.593+0000 7f257ffff700 10 client.15729 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.594+0000 7f257ffff700 1 -- 172.21.15.8:0/3389884580 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556629333db0 con 0x556629405e70 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.594+0000 7f257ffff700 10 client.15729 handle_command_reply: tid=0 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.594+0000 7f25ba68fb80 1 client.15729 shutdown 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 -- 172.21.15.8:0/3389884580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 msgr2=0x5566293fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293fa820 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f258c00cfd0 tx=0x7f258c004750 comp rx=0 tx=0).stop 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 -- 172.21.15.8:0/3389884580 shutdown_connections 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556629405e70 0x556629408290 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x556629401860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/3389884580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293fa820 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 -- 172.21.15.8:0/3389884580 >> 172.21.15.8:0/3389884580 conn(0x55662935c200 msgr2=0x5566293e2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f257ffff700 0 client.15729 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 -- 172.21.15.8:0/3389884580 shutdown_connections 2023-10-06T23:15:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.595+0000 7f25ba68fb80 1 -- 172.21.15.8:0/3389884580 wait complete. 2023-10-06T23:15:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.596+0000 7f25ba68fb80 20 client.15729 trim_cache size 0 max 16384 2023-10-06T23:15:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.617+0000 7f25ba68fb80 1 Processor -- start 2023-10-06T23:15:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.617+0000 7f25ba68fb80 1 -- start start 2023-10-06T23:15:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.617+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.617+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x556629401820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566293fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566291bb8c0 con 0x5566293e8fd0 2023-10-06T23:15:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566293f9790 con 0x5566293e7ec0 2023-10-06T23:15:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566293f9e50 con 0x5566293e9990 2023-10-06T23:15:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f259ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x556629401820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f259ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x556629401820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49860/0 (socket says 172.21.15.8:49860) 2023-10-06T23:15:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f25a4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f259ffff700 1 -- 172.21.15.8:0/221922862 learned_addr learned my addr 172.21.15.8:0/221922862 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f25a539c700 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566293fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f259ffff700 1 -- 172.21.15.8:0/221922862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 msgr2=0x5566293fa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f259ffff700 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566293fa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f259ffff700 1 -- 172.21.15.8:0/221922862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 msgr2=0x5566293fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f259ffff700 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f259ffff700 1 -- 172.21.15.8:0/221922862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55662918c1f0 con 0x5566293e8fd0 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.618+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.619+0000 7f259ffff700 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x556629401820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f258c004000 tx=0x7f258c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702315aa5e3dc80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.619+0000 7f258b7fe700 1 -- 172.21.15.8:0/221922862 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c0b1070 con 0x5566293e8fd0 2023-10-06T23:15:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.619+0000 7f258b7fe700 1 -- 172.21.15.8:0/221922862 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f258c09dde0 con 0x5566293e8fd0 2023-10-06T23:15:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.619+0000 7f258b7fe700 1 -- 172.21.15.8:0/221922862 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00dc60 con 0x5566293e8fd0 2023-10-06T23:15:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 -- 172.21.15.8:0/221922862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 msgr2=0x556629401820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x556629401820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f258c004000 tx=0x7f258c003eb0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 -- 172.21.15.8:0/221922862 shutdown_connections 2023-10-06T23:15:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566293fa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/221922862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x556629401820 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 -- 172.21.15.8:0/221922862 >> 172.21.15.8:0/221922862 conn(0x55662935c200 msgr2=0x5566293f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 -- 172.21.15.8:0/221922862 shutdown_connections 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.620+0000 7f25ba68fb80 1 -- 172.21.15.8:0/221922862 wait complete. 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.621+0000 7f25ba68fb80 1 -- start start 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.621+0000 7f25ba68fb80 1 Processor -- start 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.621+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293ff350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293ff890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25ba68fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566294008a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629400de0 con 0x5566293e8fd0 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629400f50 con 0x5566293e7ec0 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25ba68fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629401110 con 0x5566293e9990 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25ba68fb80 10 client.0 _ll_register_callbacks cb 0x7f2598003a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293ff350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293ff350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:55056/0 (socket says 172.21.15.8:55056) 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a4b9b700 1 -- 172.21.15.8:0/4007048338 learned_addr learned my addr 172.21.15.8:0/4007048338 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f259ffff700 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a539c700 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566294008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a4b9b700 1 -- 172.21.15.8:0/4007048338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 msgr2=0x5566294008a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566294008a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a4b9b700 1 -- 172.21.15.8:0/4007048338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 msgr2=0x5566293ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293ff890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.622+0000 7f25a4b9b700 1 -- 172.21.15.8:0/4007048338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a0109c90 con 0x5566293e7ec0 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.623+0000 7f25a4b9b700 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293ff350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2594000c00 tx=0x7f2594009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=589fad23d3c2d9e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.623+0000 7f257ffff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:15:21.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.623+0000 7f257ffff700 1 -- 172.21.15.8:0/4007048338 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594036150 con 0x5566293e7ec0 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.623+0000 7f25ba68fb80 1 -- 172.21.15.8:0/4007048338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f258c09a390 con 0x5566293e7ec0 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.623+0000 7f257ffff700 1 -- 172.21.15.8:0/4007048338 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25940362b0 con 0x5566293e7ec0 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.623+0000 7f257ffff700 1 -- 172.21.15.8:0/4007048338 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f259400b670 con 0x5566293e7ec0 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.623+0000 7f25ba68fb80 10 client.25532 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.623+0000 7f25ba68fb80 1 -- 172.21.15.8:0/4007048338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55662914ec00 con 0x5566293e7ec0 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f257ffff700 1 -- 172.21.15.8:0/4007048338 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f258c09a390 con 0x5566293e7ec0 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f257ffff700 1 -- 172.21.15.8:0/4007048338 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f259400f460 con 0x5566293e7ec0 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f25ba68fb80 10 client.25532 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f25ba68fb80 10 client.25532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f25ba68fb80 20 client.25532 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:21.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55662945a9e0 0x55662945ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f25ba68fb80 4 client.25532 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:15:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f25ba68fb80 1 -- 172.21.15.8:0/4007048338 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556629333ad0 con 0x55662945a9e0 2023-10-06T23:15:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.624+0000 7f259ffff700 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55662945a9e0 0x55662945ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.625+0000 7f259ffff700 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55662945a9e0 0x55662945ce00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3568e7f79f076e20 server_cookie=56bf99ee9f28ea05 in_seq=0 out_seq=0 2023-10-06T23:15:21.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.625+0000 7f257ffff700 10 client.25532 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f257ffff700 1 -- 172.21.15.8:0/4007048338 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556629333ad0 con 0x55662945a9e0 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f257ffff700 10 client.25532 handle_command_reply: tid=0 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 client.25532 shutdown 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 -- 172.21.15.8:0/4007048338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 msgr2=0x5566293ff350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293ff350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2594000c00 tx=0x7f2594009ca0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 -- 172.21.15.8:0/4007048338 shutdown_connections 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55662945a9e0 0x55662945ce00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566293e9990 0x5566294008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5566293e7ec0 0x5566293ff350 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f257ffff700 0 client.25532 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 --2- 172.21.15.8:0/4007048338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5566293e8fd0 0x5566293ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 -- 172.21.15.8:0/4007048338 >> 172.21.15.8:0/4007048338 conn(0x55662935c200 msgr2=0x5566293fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 -- 172.21.15.8:0/4007048338 shutdown_connections 2023-10-06T23:15:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 1 -- 172.21.15.8:0/4007048338 wait complete. 2023-10-06T23:15:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.659+0000 7f25ba68fb80 20 client.25532 trim_cache size 0 max 16384 2023-10-06T23:15:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:15:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:15:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:15:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:15:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 -- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25900a1580 msgr2=0x7f25900a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25900a1580 0x7f25900a3a40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f259400b5c0 tx=0x7f259400b8b0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 -- 172.21.15.8:0/1631944838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0102080 msgr2=0x7f25a00737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0102080 0x7f25a00737e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c940 tx=0x7f258c00cc50 comp rx=0 tx=0).stop 2023-10-06T23:15:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 -- 172.21.15.8:0/1631944838 shutdown_connections 2023-10-06T23:15:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f25900a1580 0x7f25900a3a40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25a0102a40 0x7f25a0073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25a0100ea0 0x7f25a00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 --2- 172.21.15.8:0/1631944838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25a0102080 0x7f25a00737e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 -- 172.21.15.8:0/1631944838 >> 172.21.15.8:0/1631944838 conn(0x7f25a00fc460 msgr2=0x7f25a00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 -- 172.21.15.8:0/1631944838 shutdown_connections 2023-10-06T23:15:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:21.660+0000 7f25a6dff700 1 -- 172.21.15.8:0/1631944838 wait complete. 2023-10-06T23:15:22.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:22 smithi156 ceph-mon[102862]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 16 MiB/s wr, 626 op/s 2023-10-06T23:15:22.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:22 smithi008 ceph-mon[98532]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 16 MiB/s wr, 626 op/s 2023-10-06T23:15:22.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:22 smithi190 ceph-mon[102658]: pgmap v424: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 16 MiB/s wr, 626 op/s 2023-10-06T23:15:23.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:23 smithi156 ceph-mon[102862]: pgmap v425: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 13 MiB/s wr, 674 op/s 2023-10-06T23:15:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:23 smithi008 ceph-mon[98532]: pgmap v425: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 13 MiB/s wr, 674 op/s 2023-10-06T23:15:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:23 smithi190 ceph-mon[102658]: pgmap v425: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 13 MiB/s wr, 674 op/s 2023-10-06T23:15:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 30.0 s, 216.2 tps, lat 436.140 ms stddev 255.096 2023-10-06T23:15:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:26 smithi156 ceph-mon[102862]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 13 MiB/s wr, 748 op/s 2023-10-06T23:15:26.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:26 smithi008 ceph-mon[98532]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 13 MiB/s wr, 748 op/s 2023-10-06T23:15:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:26 smithi190 ceph-mon[102658]: pgmap v426: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 13 MiB/s wr, 748 op/s 2023-10-06T23:15:28.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:28 smithi156 ceph-mon[102862]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 12 MiB/s wr, 735 op/s 2023-10-06T23:15:28.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:28 smithi008 ceph-mon[98532]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 12 MiB/s wr, 735 op/s 2023-10-06T23:15:28.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:28 smithi190 ceph-mon[102658]: pgmap v427: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 12 MiB/s wr, 735 op/s 2023-10-06T23:15:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 35.0 s, 177.6 tps, lat 580.688 ms stddev 185.714 2023-10-06T23:15:30.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:30 smithi156 ceph-mon[102862]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 7.6 MiB/s wr, 590 op/s 2023-10-06T23:15:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:30 smithi008 ceph-mon[98532]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 7.6 MiB/s wr, 590 op/s 2023-10-06T23:15:30.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:30 smithi190 ceph-mon[102658]: pgmap v428: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 7.6 MiB/s wr, 590 op/s 2023-10-06T23:15:32.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:32 smithi156 ceph-mon[102862]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.9 MiB/s wr, 616 op/s 2023-10-06T23:15:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:32 smithi008 ceph-mon[98532]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.9 MiB/s wr, 616 op/s 2023-10-06T23:15:32.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:32 smithi190 ceph-mon[102658]: pgmap v429: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.9 MiB/s wr, 616 op/s 2023-10-06T23:15:33.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:33 smithi156 ceph-mon[102862]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 6.2 MiB/s wr, 511 op/s 2023-10-06T23:15:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:33 smithi008 ceph-mon[98532]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 6.2 MiB/s wr, 511 op/s 2023-10-06T23:15:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:33 smithi190 ceph-mon[102658]: pgmap v430: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 6.2 MiB/s wr, 511 op/s 2023-10-06T23:15:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 40.0 s, 211.2 tps, lat 492.478 ms stddev 317.487 2023-10-06T23:15:34.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:15:34.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:15:34.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:15:34.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.886+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/3441411602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 msgr2=0x7fbb68101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.886+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/3441411602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 0x7fbb68101b90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009990 tx=0x7fbb58009ca0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.887+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/3441411602 shutdown_connections 2023-10-06T23:15:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.887+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/3441411602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb68104aa0 0x7fbb68104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.887+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/3441411602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 0x7fbb68101b90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.887+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/3441411602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb681020d0 0x7fbb68104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.887+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/3441411602 >> 172.21.15.8:0/3441411602 conn(0x7fbb680fb340 msgr2=0x7fbb680fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.887+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/3441411602 shutdown_connections 2023-10-06T23:15:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.887+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/3441411602 wait complete. 2023-10-06T23:15:34.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.889+0000 7fbb6c9ff700 1 Processor -- start 2023-10-06T23:15:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.889+0000 7fbb6c9ff700 1 -- start start 2023-10-06T23:15:34.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.889+0000 7fbb6c9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 0x7fbb6819d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.889+0000 7fbb6c9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb681020d0 0x7fbb6819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.889+0000 7fbb6c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb68104aa0 0x7fbb6819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.889+0000 7fbb6c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6819ed10 con 0x7fbb68104aa0 2023-10-06T23:15:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.889+0000 7fbb6c9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6819ee80 con 0x7fbb680ff760 2023-10-06T23:15:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.889+0000 7fbb6c9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6819f040 con 0x7fbb681020d0 2023-10-06T23:15:34.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.890+0000 7fbb65d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb681020d0 0x7fbb6819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.890+0000 7fbb65d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb681020d0 0x7fbb6819d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58174/0 (socket says 172.21.15.8:58174) 2023-10-06T23:15:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.890+0000 7fbb65d9b700 1 -- 172.21.15.8:0/49986795 learned_addr learned my addr 172.21.15.8:0/49986795 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.890+0000 7fbb6659c700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 0x7fbb6819d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.890+0000 7fbb66d9d700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb68104aa0 0x7fbb6819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb6659c700 1 -- 172.21.15.8:0/49986795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb681020d0 msgr2=0x7fbb6819d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb6659c700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb681020d0 0x7fbb6819d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb6659c700 1 -- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb68104aa0 msgr2=0x7fbb6819e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb6659c700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb68104aa0 0x7fbb6819e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb6659c700 1 -- 172.21.15.8:0/49986795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580095f0 con 0x7fbb680ff760 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb6659c700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 0x7fbb6819d2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb58004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb577fe700 1 -- 172.21.15.8:0/49986795 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5801d070 con 0x7fbb680ff760 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb577fe700 1 -- 172.21.15.8:0/49986795 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb5800be30 con 0x7fbb680ff760 2023-10-06T23:15:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb577fe700 1 -- 172.21.15.8:0/49986795 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58022dc0 con 0x7fbb680ff760 2023-10-06T23:15:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.891+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/49986795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6819f2c0 con 0x7fbb680ff760 2023-10-06T23:15:34.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.892+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/49986795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6819f510 con 0x7fbb680ff760 2023-10-06T23:15:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.897+0000 7fbb577fe700 1 -- 172.21.15.8:0/49986795 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbb58022470 con 0x7fbb680ff760 2023-10-06T23:15:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.898+0000 7fbb80375b80 1 Processor -- start 2023-10-06T23:15:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.898+0000 7fbb80375b80 1 -- start start 2023-10-06T23:15:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 0x563b246ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246d5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb80375b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b24635400 con 0x563b246ce990 2023-10-06T23:15:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb80375b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b24626bc0 con 0x563b246ccec0 2023-10-06T23:15:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb80375b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b246244e0 con 0x563b246cdfd0 2023-10-06T23:15:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb66d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb66d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:51650/0 (socket says 172.21.15.8:51650) 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.899+0000 7fbb66d9d700 1 -- 172.21.15.8:0/21430200 learned_addr learned my addr 172.21.15.8:0/21430200 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.900+0000 7fbb577fe700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbb500a1580 0x7fbb500a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.900+0000 7fbb577fe700 1 -- 172.21.15.8:0/49986795 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbb580cde70 con 0x7fbb680ff760 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.900+0000 7fbb66d9d700 1 -- 172.21.15.8:0/21430200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 msgr2=0x563b246ce450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.900+0000 7fbb66d9d700 1 --2- 172.21.15.8:0/21430200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 0x563b246ce450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.900+0000 7fbb66d9d700 1 -- 172.21.15.8:0/21430200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 msgr2=0x563b246d5220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.900+0000 7fbb66d9d700 1 --2- 172.21.15.8:0/21430200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246d5220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.900+0000 7fbb66d9d700 1 -- 172.21.15.8:0/21430200 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b2444ad80 con 0x563b246ccec0 2023-10-06T23:15:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.900+0000 7fbb66d9d700 1 --2- 172.21.15.8:0/21430200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246cd2e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000a5d0 tx=0x7fbb6000a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2267493e4c568c82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.901+0000 7fbb66d9d700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbb500a1580 0x7fbb500a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.901+0000 7fbb54ff9700 1 -- 172.21.15.8:0/21430200 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb60015890 con 0x563b246ccec0 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.901+0000 7fbb54ff9700 1 -- 172.21.15.8:0/21430200 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb60015e80 con 0x563b246ccec0 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.901+0000 7fbb54ff9700 1 -- 172.21.15.8:0/21430200 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6001e5e0 con 0x563b246ccec0 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.902+0000 7fbb66d9d700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbb500a1580 0x7fbb500a3a40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009fd0 tx=0x7fbb60016e20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.902+0000 7fbb80375b80 1 -- 172.21.15.8:0/21430200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 msgr2=0x563b246cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.902+0000 7fbb80375b80 1 --2- 172.21.15.8:0/21430200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246cd2e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000a5d0 tx=0x7fbb6000a8e0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.902+0000 7fbb80375b80 1 -- 172.21.15.8:0/21430200 shutdown_connections 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.902+0000 7fbb80375b80 1 --2- 172.21.15.8:0/21430200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246d5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.902+0000 7fbb80375b80 1 --2- 172.21.15.8:0/21430200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246cd2e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.902+0000 7fbb80375b80 1 --2- 172.21.15.8:0/21430200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 0x563b246ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.902+0000 7fbb80375b80 1 -- 172.21.15.8:0/21430200 >> 172.21.15.8:0/21430200 conn(0x563b24641200 msgr2=0x563b246c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.903+0000 7fbb80375b80 1 -- 172.21.15.8:0/21430200 shutdown_connections 2023-10-06T23:15:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.903+0000 7fbb80375b80 1 -- 172.21.15.8:0/21430200 wait complete. 2023-10-06T23:15:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.904+0000 7fbb80375b80 1 -- start start 2023-10-06T23:15:34.905 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.904+0000 7fbb80375b80 1 Processor -- start 2023-10-06T23:15:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246d6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246cdfd0 0x563b246d70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246de0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb80375b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2461fdd0 con 0x563b246ce990 2023-10-06T23:15:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb80375b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b245bc6b0 con 0x563b246cdfd0 2023-10-06T23:15:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb80375b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b245bc350 con 0x563b246ccec0 2023-10-06T23:15:34.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb80375b80 10 client.0 _ll_register_callbacks cb 0x563b244197a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb65d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246cdfd0 0x563b246d70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb6659c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246d6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb65d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246cdfd0 0x563b246d70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:51652/0 (socket says 172.21.15.8:51652) 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.905+0000 7fbb65d9b700 1 -- 172.21.15.8:0/3430024214 learned_addr learned my addr 172.21.15.8:0/3430024214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb66d9d700 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246de0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb6659c700 1 -- 172.21.15.8:0/3430024214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246cdfd0 msgr2=0x563b246d70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb6659c700 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246cdfd0 0x563b246d70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb6659c700 1 -- 172.21.15.8:0/3430024214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 msgr2=0x563b246de0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb6659c700 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246de0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb6659c700 1 -- 172.21.15.8:0/3430024214 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb60009cb0 con 0x563b246ccec0 2023-10-06T23:15:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246cdfd0 0x563b246d70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:15:34.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb6659c700 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246d6b70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb580cb920 tx=0x7fbb5800bd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37bfe12f4db6fb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:34.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:15:34.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.906+0000 7fbb4dffb700 1 -- 172.21.15.8:0/3430024214 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5809a8c0 con 0x563b246ccec0 2023-10-06T23:15:34.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.907+0000 7fbb4dffb700 1 -- 172.21.15.8:0/3430024214 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbb5809b8d0 con 0x563b246ccec0 2023-10-06T23:15:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.907+0000 7fbb80375b80 1 -- 172.21.15.8:0/3430024214 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b24618db0 con 0x563b246ccec0 2023-10-06T23:15:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.907+0000 7fbb4dffb700 1 -- 172.21.15.8:0/3430024214 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb5809ab30 con 0x563b246ccec0 2023-10-06T23:15:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.907+0000 7fbb80375b80 10 client.25588 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.907+0000 7fbb80375b80 1 -- 172.21.15.8:0/3430024214 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563b24433c00 con 0x563b246ccec0 2023-10-06T23:15:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.907+0000 7fbb4dffb700 1 -- 172.21.15.8:0/3430024214 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563b24618db0 con 0x563b246ccec0 2023-10-06T23:15:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.908+0000 7fbb4dffb700 1 -- 172.21.15.8:0/3430024214 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fbb580a3040 con 0x563b246ccec0 2023-10-06T23:15:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.908+0000 7fbb80375b80 10 client.25588 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.908+0000 7fbb80375b80 10 client.25588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.908+0000 7fbb80375b80 20 client.25588 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.908+0000 7fbb80375b80 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b246e2610 0x563b246e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.908+0000 7fbb80375b80 4 client.25588 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.908+0000 7fbb80375b80 1 -- 172.21.15.8:0/3430024214 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b24618ad0 con 0x563b246e2610 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.908+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b246e2610 0x563b246e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.909+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b246e2610 0x563b246e4a30 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5549e853797f0e0 server_cookie=404ec161e3ba133e in_seq=0 out_seq=0 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.909+0000 7fbb4dffb700 10 client.25588 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.910+0000 7fbb4dffb700 1 -- 172.21.15.8:0/3430024214 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563b24618ad0 con 0x563b246e2610 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.910+0000 7fbb4dffb700 10 client.25588 handle_command_reply: tid=0 2023-10-06T23:15:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.910+0000 7fbb80375b80 1 client.25588 shutdown 2023-10-06T23:15:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.910+0000 7fbb80375b80 1 -- 172.21.15.8:0/3430024214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 msgr2=0x563b246d6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.910+0000 7fbb80375b80 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246d6b70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb580cb920 tx=0x7fbb5800bd50 comp rx=0 tx=0).stop 2023-10-06T23:15:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 1 -- 172.21.15.8:0/3430024214 shutdown_connections 2023-10-06T23:15:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b246e2610 0x563b246e4a30 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246de0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246d6b70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 1 --2- 172.21.15.8:0/3430024214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246cdfd0 0x563b246d70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 1 -- 172.21.15.8:0/3430024214 >> 172.21.15.8:0/3430024214 conn(0x563b24641200 msgr2=0x563b246c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb4dffb700 0 client.25588 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 1 -- 172.21.15.8:0/3430024214 shutdown_connections 2023-10-06T23:15:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 1 -- 172.21.15.8:0/3430024214 wait complete. 2023-10-06T23:15:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.911+0000 7fbb80375b80 20 client.25588 trim_cache size 0 max 16384 2023-10-06T23:15:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.941+0000 7fbb80375b80 1 Processor -- start 2023-10-06T23:15:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.942+0000 7fbb80375b80 1 -- start start 2023-10-06T23:15:34.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.942+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246e4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.942+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246cdfd0 0x563b246de0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.942+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ce990 0x563b246d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.942+0000 7fbb80375b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b244a08c0 con 0x563b246cdfd0 2023-10-06T23:15:34.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.942+0000 7fbb80375b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b246d6710 con 0x563b246ce990 2023-10-06T23:15:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.942+0000 7fbb80375b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b246cee60 con 0x563b246ccec0 2023-10-06T23:15:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb66d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ce990 0x563b246d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb6659c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb6659c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246e4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58196/0 (socket says 172.21.15.8:58196) 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb6659c700 1 -- 172.21.15.8:0/192027211 learned_addr learned my addr 172.21.15.8:0/192027211 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246cdfd0 0x563b246de0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb6659c700 1 -- 172.21.15.8:0/192027211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ce990 msgr2=0x563b246d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb6659c700 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ce990 0x563b246d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb6659c700 1 -- 172.21.15.8:0/192027211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246cdfd0 msgr2=0x563b246de0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb6659c700 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246cdfd0 0x563b246de0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb6659c700 1 -- 172.21.15.8:0/192027211 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b244711f0 con 0x563b246ccec0 2023-10-06T23:15:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.943+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246cdfd0 0x563b246de0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:15:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.944+0000 7fbb6659c700 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246e4620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb58005910 tx=0x7fbb58004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7c3d1a332e3bb64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.944+0000 7fbb557fa700 1 -- 172.21.15.8:0/192027211 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5809f120 con 0x563b246ccec0 2023-10-06T23:15:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.944+0000 7fbb557fa700 1 -- 172.21.15.8:0/192027211 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb5809ab30 con 0x563b246ccec0 2023-10-06T23:15:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.944+0000 7fbb557fa700 1 -- 172.21.15.8:0/192027211 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580b92c0 con 0x563b246ccec0 2023-10-06T23:15:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.945+0000 7fbb80375b80 1 -- 172.21.15.8:0/192027211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 msgr2=0x563b246e4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.945+0000 7fbb80375b80 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246e4620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb58005910 tx=0x7fbb58004320 comp rx=0 tx=0).stop 2023-10-06T23:15:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.945+0000 7fbb80375b80 1 -- 172.21.15.8:0/192027211 shutdown_connections 2023-10-06T23:15:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.945+0000 7fbb80375b80 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ce990 0x563b246d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.945+0000 7fbb80375b80 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246ccec0 0x563b246e4620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.945+0000 7fbb80375b80 1 --2- 172.21.15.8:0/192027211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246cdfd0 0x563b246de0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.945+0000 7fbb80375b80 1 -- 172.21.15.8:0/192027211 >> 172.21.15.8:0/192027211 conn(0x563b24641200 msgr2=0x563b246d4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:34.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.946+0000 7fbb80375b80 1 -- 172.21.15.8:0/192027211 shutdown_connections 2023-10-06T23:15:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.946+0000 7fbb80375b80 1 -- 172.21.15.8:0/192027211 wait complete. 2023-10-06T23:15:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.946+0000 7fbb80375b80 1 -- start start 2023-10-06T23:15:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.947+0000 7fbb80375b80 1 Processor -- start 2023-10-06T23:15:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246db770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 0x563b246dbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb80375b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246dccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb80375b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b246dd200 con 0x563b246ce990 2023-10-06T23:15:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb80375b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b246dd370 con 0x563b246ccec0 2023-10-06T23:15:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb80375b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b246dd530 con 0x563b246cdfd0 2023-10-06T23:15:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb80375b80 10 client.0 _ll_register_callbacks cb 0x563b244197a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb6659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246db770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb6659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246db770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:51678/0 (socket says 172.21.15.8:51678) 2023-10-06T23:15:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb6659c700 1 -- 172.21.15.8:0/700530823 learned_addr learned my addr 172.21.15.8:0/700530823 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb66d9d700 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246dccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.948+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 0x563b246dbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.949+0000 7fbb6659c700 1 -- 172.21.15.8:0/700530823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 msgr2=0x563b246dbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.949+0000 7fbb6659c700 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 0x563b246dbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.949+0000 7fbb6659c700 1 -- 172.21.15.8:0/700530823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 msgr2=0x563b246dccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.949+0000 7fbb6659c700 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246dccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.949+0000 7fbb6659c700 1 -- 172.21.15.8:0/700530823 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b24433c00 con 0x563b246ccec0 2023-10-06T23:15:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.949+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 0x563b246dbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:15:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.949+0000 7fbb6659c700 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246db770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800b9c0 tx=0x7fbb5809f420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2429d2415aaeb22e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.950+0000 7fbb4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:15:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.950+0000 7fbb4dffb700 1 -- 172.21.15.8:0/700530823 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5809a8c0 con 0x563b246ccec0 2023-10-06T23:15:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.950+0000 7fbb4dffb700 1 -- 172.21.15.8:0/700530823 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbb5809b8d0 con 0x563b246ccec0 2023-10-06T23:15:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.950+0000 7fbb80375b80 1 -- 172.21.15.8:0/700530823 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b246bfd50 con 0x563b246ccec0 2023-10-06T23:15:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.950+0000 7fbb4dffb700 1 -- 172.21.15.8:0/700530823 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb5809b1d0 con 0x563b246ccec0 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.950+0000 7fbb80375b80 10 client.25547 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.950+0000 7fbb80375b80 1 -- 172.21.15.8:0/700530823 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563b24449250 con 0x563b246ccec0 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.951+0000 7fbb4dffb700 1 -- 172.21.15.8:0/700530823 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb58080020 con 0x563b246ccec0 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.951+0000 7fbb4dffb700 1 -- 172.21.15.8:0/700530823 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fbb58004960 con 0x563b246ccec0 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.951+0000 7fbb80375b80 10 client.25547 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.951+0000 7fbb80375b80 10 client.25547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.951+0000 7fbb80375b80 20 client.25547 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.951+0000 7fbb80375b80 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b24736720 0x563b24738b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.951+0000 7fbb80375b80 4 client.25547 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:15:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.951+0000 7fbb80375b80 1 -- 172.21.15.8:0/700530823 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563b2446bf10 con 0x563b24736720 2023-10-06T23:15:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.952+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b24736720 0x563b24738b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.953+0000 7fbb65d9b700 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b24736720 0x563b24738b10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95987dc7c67418ce server_cookie=2b689fd096069398 in_seq=0 out_seq=0 2023-10-06T23:15:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.953+0000 7fbb4dffb700 10 client.25547 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.966+0000 7fbb4dffb700 1 -- 172.21.15.8:0/700530823 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563b2446bf10 con 0x563b24736720 2023-10-06T23:15:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.966+0000 7fbb4dffb700 10 client.25547 handle_command_reply: tid=0 2023-10-06T23:15:34.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.967+0000 7fbb80375b80 1 client.25547 shutdown 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.967+0000 7fbb80375b80 1 -- 172.21.15.8:0/700530823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 msgr2=0x563b246db770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.967+0000 7fbb80375b80 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246db770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800b9c0 tx=0x7fbb5809f420 comp rx=0 tx=0).stop 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.967+0000 7fbb80375b80 1 -- 172.21.15.8:0/700530823 shutdown_connections 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.967+0000 7fbb80375b80 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b24736720 0x563b24738b10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.968+0000 7fbb80375b80 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b246ce990 0x563b246dccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.968+0000 7fbb80375b80 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b246ccec0 0x563b246db770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.968+0000 7fbb80375b80 1 --2- 172.21.15.8:0/700530823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b246cdfd0 0x563b246dbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.968+0000 7fbb80375b80 1 -- 172.21.15.8:0/700530823 >> 172.21.15.8:0/700530823 conn(0x563b24641200 msgr2=0x563b246e4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:34.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.968+0000 7fbb4dffb700 0 client.25547 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.968+0000 7fbb80375b80 1 -- 172.21.15.8:0/700530823 shutdown_connections 2023-10-06T23:15:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.968+0000 7fbb80375b80 1 -- 172.21.15.8:0/700530823 wait complete. 2023-10-06T23:15:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.968+0000 7fbb80375b80 20 client.25547 trim_cache size 0 max 16384 2023-10-06T23:15:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:15:34.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:15:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:15:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:15:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbb500a1580 msgr2=0x7fbb500a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbb500a1580 0x7fbb500a3a40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009fd0 tx=0x7fbb60016e20 comp rx=0 tx=0).stop 2023-10-06T23:15:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/49986795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 msgr2=0x7fbb6819d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 0x7fbb6819d2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb58004730 comp rx=0 tx=0).stop 2023-10-06T23:15:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/49986795 shutdown_connections 2023-10-06T23:15:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbb500a1580 0x7fbb500a3a40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb68104aa0 0x7fbb6819e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb680ff760 0x7fbb6819d2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 --2- 172.21.15.8:0/49986795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb681020d0 0x7fbb6819d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.969+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/49986795 >> 172.21.15.8:0/49986795 conn(0x7fbb680fb340 msgr2=0x7fbb68102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.970+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/49986795 shutdown_connections 2023-10-06T23:15:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:34.970+0000 7fbb6c9ff700 1 -- 172.21.15.8:0/49986795 wait complete. 2023-10-06T23:15:35.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:35 smithi156 ceph-mon[102862]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 6.5 MiB/s wr, 505 op/s 2023-10-06T23:15:35.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:15:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:15:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:35 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:15:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:35 smithi008 ceph-mon[98532]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 6.5 MiB/s wr, 505 op/s 2023-10-06T23:15:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:15:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:15:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:35 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:15:35.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:35 smithi190 ceph-mon[102658]: pgmap v431: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 6.5 MiB/s wr, 505 op/s 2023-10-06T23:15:35.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:15:35.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:15:35.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:35 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:15:38.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:38 smithi156 ceph-mon[102862]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 7.4 MiB/s wr, 518 op/s 2023-10-06T23:15:38.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:38 smithi008 ceph-mon[98532]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 7.4 MiB/s wr, 518 op/s 2023-10-06T23:15:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:38 smithi190 ceph-mon[102658]: pgmap v432: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 7.4 MiB/s wr, 518 op/s 2023-10-06T23:15:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 45.0 s, 274.4 tps, lat 354.197 ms stddev 40.492 2023-10-06T23:15:40.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:40 smithi156 ceph-mon[102862]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 6.2 MiB/s wr, 493 op/s 2023-10-06T23:15:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:40 smithi008 ceph-mon[98532]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 6.2 MiB/s wr, 493 op/s 2023-10-06T23:15:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:40 smithi190 ceph-mon[102658]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 6.2 MiB/s wr, 493 op/s 2023-10-06T23:15:42.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:42 smithi156 ceph-mon[102862]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 6.6 MiB/s wr, 534 op/s 2023-10-06T23:15:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:42 smithi008 ceph-mon[98532]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 6.6 MiB/s wr, 534 op/s 2023-10-06T23:15:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:42 smithi190 ceph-mon[102658]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 6.6 MiB/s wr, 534 op/s 2023-10-06T23:15:43.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:43 smithi156 ceph-mon[102862]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 5.8 MiB/s wr, 458 op/s 2023-10-06T23:15:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:43 smithi008 ceph-mon[98532]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 5.8 MiB/s wr, 458 op/s 2023-10-06T23:15:43.681 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:15:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:43 smithi190 ceph-mon[102658]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 5.8 MiB/s wr, 458 op/s 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.978+0000 7fdcd1fff700 1 -- 172.21.15.8:0/3867499694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc100e90 msgr2=0x7fdccc1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.978+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/3867499694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc100e90 0x7fdccc1012b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0098f0 tx=0x7fdcbc009c00 comp rx=0 tx=0).stop 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.978+0000 7fdcd1fff700 1 -- 172.21.15.8:0/3867499694 shutdown_connections 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.978+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/3867499694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdccc102a30 0x7fdccc109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.978+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/3867499694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc100e90 0x7fdccc1012b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.978+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/3867499694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdccc102070 0x7fdccc1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.978+0000 7fdcd1fff700 1 -- 172.21.15.8:0/3867499694 >> 172.21.15.8:0/3867499694 conn(0x7fdccc0fc430 msgr2=0x7fdccc0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.978+0000 7fdcd1fff700 1 -- 172.21.15.8:0/3867499694 shutdown_connections 2023-10-06T23:15:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.979+0000 7fdcd1fff700 1 -- 172.21.15.8:0/3867499694 wait complete. 2023-10-06T23:15:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.980+0000 7fdcd1fff700 1 Processor -- start 2023-10-06T23:15:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.980+0000 7fdcd1fff700 1 -- start start 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdcd1fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdccc100e90 0x7fdccc196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdcd1fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc102070 0x7fdccc197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdcd1fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdccc102a30 0x7fdccc19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdcd1fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc19e760 con 0x7fdccc102a30 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdcd1fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc06a8d0 con 0x7fdccc100e90 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdcd1fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc06aa60 con 0x7fdccc102070 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc102070 0x7fdccc197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdccbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdccc102a30 0x7fdccc19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc102070 0x7fdccc197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40906/0 (socket says 172.21.15.8:40906) 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.981+0000 7fdccb7fe700 1 -- 172.21.15.8:0/2758179164 learned_addr learned my addr 172.21.15.8:0/2758179164 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.982+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdccc100e90 0x7fdccc196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.982+0000 7fdccb7fe700 1 -- 172.21.15.8:0/2758179164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdccc100e90 msgr2=0x7fdccc196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.982+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdccc100e90 0x7fdccc196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.982+0000 7fdccb7fe700 1 -- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdccc102a30 msgr2=0x7fdccc19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.982+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdccc102a30 0x7fdccc19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.982+0000 7fdccb7fe700 1 -- 172.21.15.8:0/2758179164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009520 con 0x7fdccc102070 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.982+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc102070 0x7fdccc197120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400e9f0 tx=0x7fdcb400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.983+0000 7fdcc97fa700 1 -- 172.21.15.8:0/2758179164 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4004220 con 0x7fdccc102070 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.983+0000 7fdcd1fff700 1 -- 172.21.15.8:0/2758179164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc06ad40 con 0x7fdccc102070 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.983+0000 7fdcd1fff700 1 -- 172.21.15.8:0/2758179164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc06b2a0 con 0x7fdccc102070 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.983+0000 7fdcc97fa700 1 -- 172.21.15.8:0/2758179164 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcb4004380 con 0x7fdccc102070 2023-10-06T23:15:43.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.983+0000 7fdcc97fa700 1 -- 172.21.15.8:0/2758179164 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4003a80 con 0x7fdccc102070 2023-10-06T23:15:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.988+0000 7fdcc97fa700 1 -- 172.21.15.8:0/2758179164 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdcb4003ce0 con 0x7fdccc102070 2023-10-06T23:15:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.990+0000 7fdce586eb80 1 Processor -- start 2023-10-06T23:15:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.990+0000 7fdce586eb80 1 -- start start 2023-10-06T23:15:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.990+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f48a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.990+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f49890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.990+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f4a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdce586eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733eac460 con 0x557733f48fd0 2023-10-06T23:15:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdce586eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733e9dc20 con 0x557733f49e70 2023-10-06T23:15:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdce586eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733e9b540 con 0x557733f48670 2023-10-06T23:15:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f4a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f4a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37206/0 (socket says 172.21.15.8:37206) 2023-10-06T23:15:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1503724798 learned_addr learned my addr 172.21.15.8:0/1503724798 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdccbfff700 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f48a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f49890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdcc97fa700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdcb80a1500 0x7fdcb80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1503724798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 msgr2=0x557733f48a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f48a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.991+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1503724798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 msgr2=0x557733f49890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f49890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1503724798 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557733cc1de0 con 0x557733f49e70 2023-10-06T23:15:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdcc97fa700 1 -- 172.21.15.8:0/2758179164 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcb4014070 con 0x7fdccc102070 2023-10-06T23:15:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f49890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:15:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdccbfff700 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f48a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:15:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f4a2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4096ad0 tx=0x7fdcb4020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e16cb5b3ca8b698 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdccbfff700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdcb80a1500 0x7fdcb80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdcc1ffb700 1 -- 172.21.15.8:0/1503724798 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40999c0 con 0x557733f49e70 2023-10-06T23:15:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdcc1ffb700 1 -- 172.21.15.8:0/1503724798 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcb40044f0 con 0x557733f49e70 2023-10-06T23:15:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.992+0000 7fdcc1ffb700 1 -- 172.21.15.8:0/1503724798 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400a2e0 con 0x557733f49e70 2023-10-06T23:15:43.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.993+0000 7fdce586eb80 1 -- 172.21.15.8:0/1503724798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 msgr2=0x557733f4a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.993+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f4a2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4096ad0 tx=0x7fdcb4020000 comp rx=0 tx=0).stop 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.993+0000 7fdce586eb80 1 -- 172.21.15.8:0/1503724798 shutdown_connections 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.993+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f4a2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.993+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f48a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.993+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1503724798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f49890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.993+0000 7fdce586eb80 1 -- 172.21.15.8:0/1503724798 >> 172.21.15.8:0/1503724798 conn(0x557733eb8260 msgr2=0x557733f3f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.994+0000 7fdce586eb80 1 -- 172.21.15.8:0/1503724798 shutdown_connections 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.994+0000 7fdccbfff700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdcb80a1500 0x7fdcb80a39c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009ec0 tx=0x7fdcc4009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:43.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.994+0000 7fdce586eb80 1 -- 172.21.15.8:0/1503724798 wait complete. 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.995+0000 7fdce586eb80 1 -- start start 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.995+0000 7fdce586eb80 1 Processor -- start 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f453f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f45930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f46940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdce586eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733e96e30 con 0x557733f48fd0 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdce586eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733e33710 con 0x557733f49e70 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdce586eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733e333b0 con 0x557733f48670 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdce586eb80 10 client.0 _ll_register_callbacks cb 0x557733c90800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:43.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdccbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f46940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdccbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f46940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37214/0 (socket says 172.21.15.8:37214) 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdccbfff700 1 -- 172.21.15.8:0/421366367 learned_addr learned my addr 172.21.15.8:0/421366367 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdcc37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.996+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f45930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdccbfff700 1 -- 172.21.15.8:0/421366367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 msgr2=0x557733f453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdccbfff700 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdccbfff700 1 -- 172.21.15.8:0/421366367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 msgr2=0x557733f45930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdccbfff700 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f45930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdccbfff700 1 -- 172.21.15.8:0/421366367 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc06b2a0 con 0x557733f49e70 2023-10-06T23:15:43.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f45930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:15:44.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdccbfff700 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f46940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4006070 tx=0x7fdcc4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4269349e08575a64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdcaaffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdcaaffd700 1 -- 172.21.15.8:0/421366367 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400e040 con 0x557733f49e70 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdce586eb80 1 -- 172.21.15.8:0/421366367 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557733f36f10 con 0x557733f49e70 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.997+0000 7fdcaaffd700 1 -- 172.21.15.8:0/421366367 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcc4019b20 con 0x557733f49e70 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.998+0000 7fdcaaffd700 1 -- 172.21.15.8:0/421366367 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcc4019320 con 0x557733f49e70 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.998+0000 7fdce586eb80 10 client.25559 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.998+0000 7fdce586eb80 1 -- 172.21.15.8:0/421366367 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557733caac60 con 0x557733f49e70 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.998+0000 7fdcaaffd700 1 -- 172.21.15.8:0/421366367 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557733f36f10 con 0x557733f49e70 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.998+0000 7fdcaaffd700 1 -- 172.21.15.8:0/421366367 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fdcc4017c60 con 0x557733f49e70 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.999+0000 7fdce586eb80 10 client.25559 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:44.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.999+0000 7fdce586eb80 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:44.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.999+0000 7fdce586eb80 20 client.25559 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:44.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.999+0000 7fdce586eb80 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557733f626f0 0x557733f64b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:44.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.999+0000 7fdce586eb80 4 client.25559 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:15:44.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.999+0000 7fdce586eb80 1 -- 172.21.15.8:0/421366367 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557733e8fe10 con 0x557733f626f0 2023-10-06T23:15:44.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:43.999+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557733f626f0 0x557733f64b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:44.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.000+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557733f626f0 0x557733f64b10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3907821953bf65ab server_cookie=69f7ca506e2bf24 in_seq=0 out_seq=0 2023-10-06T23:15:44.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.000+0000 7fdcaaffd700 10 client.25559 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:44.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdcaaffd700 1 -- 172.21.15.8:0/421366367 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557733e8fe10 con 0x557733f626f0 2023-10-06T23:15:44.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdcaaffd700 10 client.25559 handle_command_reply: tid=0 2023-10-06T23:15:44.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 client.25559 shutdown 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 -- 172.21.15.8:0/421366367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 msgr2=0x557733f46940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f46940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4006070 tx=0x7fdcc4004ad0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 -- 172.21.15.8:0/421366367 shutdown_connections 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557733f626f0 0x557733f64b10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f49e70 0x557733f46940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48670 0x557733f453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 --2- 172.21.15.8:0/421366367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48fd0 0x557733f45930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdce586eb80 1 -- 172.21.15.8:0/421366367 >> 172.21.15.8:0/421366367 conn(0x557733eb8260 msgr2=0x557733f3ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.001+0000 7fdcaaffd700 0 client.25559 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.002+0000 7fdce586eb80 1 -- 172.21.15.8:0/421366367 shutdown_connections 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.002+0000 7fdce586eb80 1 -- 172.21.15.8:0/421366367 wait complete. 2023-10-06T23:15:44.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.002+0000 7fdce586eb80 20 client.25559 trim_cache size 0 max 16384 2023-10-06T23:15:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 50.0 s, 206.4 tps, lat 490.485 ms stddev 278.177 2023-10-06T23:15:44.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.033+0000 7fdce586eb80 1 Processor -- start 2023-10-06T23:15:44.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdce586eb80 1 -- start start 2023-10-06T23:15:44.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48670 0x557733f40020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:44.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48fd0 0x557733f4ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:44.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f49e70 0x557733f47230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:44.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdce586eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733d17920 con 0x557733f49e70 2023-10-06T23:15:44.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdce586eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733f48250 con 0x557733f48670 2023-10-06T23:15:44.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdce586eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733f40ea0 con 0x557733f48fd0 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48fd0 0x557733f4ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48fd0 0x557733f4ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40930/0 (socket says 172.21.15.8:40930) 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.034+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1500527834 learned_addr learned my addr 172.21.15.8:0/1500527834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.035+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48670 0x557733f40020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.035+0000 7fdccbfff700 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f49e70 0x557733f47230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.035+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1500527834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48670 msgr2=0x557733f40020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.035+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48670 0x557733f40020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.035+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1500527834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f49e70 msgr2=0x557733f47230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.035+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f49e70 0x557733f47230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.035+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1500527834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557733ce8250 con 0x557733f48fd0 2023-10-06T23:15:44.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.035+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48fd0 0x557733f4ead0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4099ff0 tx=0x7fdcb40a2540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2450f33e6bdfb278 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:44.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.036+0000 7fdcc27fc700 1 -- 172.21.15.8:0/1500527834 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40999c0 con 0x557733f48fd0 2023-10-06T23:15:44.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.036+0000 7fdcc27fc700 1 -- 172.21.15.8:0/1500527834 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcb409a760 con 0x557733f48fd0 2023-10-06T23:15:44.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.036+0000 7fdcc27fc700 1 -- 172.21.15.8:0/1500527834 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40d01c0 con 0x557733f48fd0 2023-10-06T23:15:44.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.036+0000 7fdce586eb80 1 -- 172.21.15.8:0/1500527834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48fd0 msgr2=0x557733f4ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:44.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.036+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48fd0 0x557733f4ead0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4099ff0 tx=0x7fdcb40a2540 comp rx=0 tx=0).stop 2023-10-06T23:15:44.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.037+0000 7fdce586eb80 1 -- 172.21.15.8:0/1500527834 shutdown_connections 2023-10-06T23:15:44.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.037+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f49e70 0x557733f47230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.037+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48670 0x557733f40020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.037+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1500527834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f48fd0 0x557733f4ead0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.037+0000 7fdce586eb80 1 -- 172.21.15.8:0/1500527834 >> 172.21.15.8:0/1500527834 conn(0x557733eb8260 msgr2=0x557733f69470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:44.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.037+0000 7fdce586eb80 1 -- 172.21.15.8:0/1500527834 shutdown_connections 2023-10-06T23:15:44.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.037+0000 7fdce586eb80 1 -- 172.21.15.8:0/1500527834 wait complete. 2023-10-06T23:15:44.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.038+0000 7fdce586eb80 1 -- start start 2023-10-06T23:15:44.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.038+0000 7fdce586eb80 1 Processor -- start 2023-10-06T23:15:44.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48670 0x557733f4dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:44.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48fd0 0x557733f4e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdce586eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f49e70 0x557733fb49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdce586eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733fb4f00 con 0x557733f48670 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdce586eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733fb5070 con 0x557733f48fd0 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdce586eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557733fb5230 con 0x557733f49e70 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdce586eb80 10 client.0 _ll_register_callbacks cb 0x7fdcc4003e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48fd0 0x557733f4e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48fd0 0x557733f4e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37232/0 (socket says 172.21.15.8:37232) 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdccb7fe700 1 -- 172.21.15.8:0/1919229380 learned_addr learned my addr 172.21.15.8:0/1919229380 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48670 0x557733f4dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:44.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.039+0000 7fdccbfff700 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f49e70 0x557733fb49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:44.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.040+0000 7fdcc37fe700 1 -- 172.21.15.8:0/1919229380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f49e70 msgr2=0x557733fb49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:44.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.040+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f49e70 0x557733fb49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.040+0000 7fdcc37fe700 1 -- 172.21.15.8:0/1919229380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48fd0 msgr2=0x557733f4e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:44.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.040+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48fd0 0x557733f4e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.040+0000 7fdcc37fe700 1 -- 172.21.15.8:0/1919229380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557733cc1de0 con 0x557733f48670 2023-10-06T23:15:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.040+0000 7fdcc37fe700 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48670 0x557733f4dfe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc00bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abecf285f29f84b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.041+0000 7fdcaaffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:15:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.041+0000 7fdcaaffd700 1 -- 172.21.15.8:0/1919229380 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc01c040 con 0x557733f48670 2023-10-06T23:15:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.041+0000 7fdcaaffd700 1 -- 172.21.15.8:0/1919229380 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcbc026c70 con 0x557733f48670 2023-10-06T23:15:44.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.041+0000 7fdce586eb80 1 -- 172.21.15.8:0/1919229380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdcb40044f0 con 0x557733f48670 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.042+0000 7fdcaaffd700 1 -- 172.21.15.8:0/1919229380 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcbc026e30 con 0x557733f48670 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.042+0000 7fdce586eb80 10 client.15762 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.042+0000 7fdce586eb80 1 -- 172.21.15.8:0/1919229380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557733cc02b0 con 0x557733f48670 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.042+0000 7fdcaaffd700 1 -- 172.21.15.8:0/1919229380 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcb40044f0 con 0x557733f48670 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.042+0000 7fdcaaffd700 1 -- 172.21.15.8:0/1919229380 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fdcbc015020 con 0x557733f48670 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.043+0000 7fdce586eb80 10 client.15762 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.043+0000 7fdce586eb80 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.043+0000 7fdce586eb80 20 client.15762 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:44.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.043+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557733fb6c20 0x557733fb9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.043+0000 7fdce586eb80 4 client.15762 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:15:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.043+0000 7fdce586eb80 1 -- 172.21.15.8:0/1919229380 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557733e8fb30 con 0x557733fb6c20 2023-10-06T23:15:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.043+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557733fb6c20 0x557733fb9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.044+0000 7fdccb7fe700 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557733fb6c20 0x557733fb9040 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49865799ffaa7288 server_cookie=f43f78b41520ccb4 in_seq=0 out_seq=0 2023-10-06T23:15:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.044+0000 7fdcaaffd700 10 client.15762 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:44.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.044+0000 7fdcaaffd700 1 -- 172.21.15.8:0/1919229380 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557733e8fb30 con 0x557733fb6c20 2023-10-06T23:15:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.044+0000 7fdcaaffd700 10 client.15762 handle_command_reply: tid=0 2023-10-06T23:15:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.044+0000 7fdce586eb80 1 client.15762 shutdown 2023-10-06T23:15:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 -- 172.21.15.8:0/1919229380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48670 msgr2=0x557733f4dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48670 0x557733f4dfe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc00bfb0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 -- 172.21.15.8:0/1919229380 shutdown_connections 2023-10-06T23:15:44.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557733fb6c20 0x557733fb9040 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557733f48670 0x557733f4dfe0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557733f49e70 0x557733fb49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 --2- 172.21.15.8:0/1919229380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557733f48fd0 0x557733f4e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 -- 172.21.15.8:0/1919229380 >> 172.21.15.8:0/1919229380 conn(0x557733eb8260 msgr2=0x557733f47230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:44.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdcaaffd700 0 client.15762 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.045+0000 7fdce586eb80 1 -- 172.21.15.8:0/1919229380 shutdown_connections 2023-10-06T23:15:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.046+0000 7fdce586eb80 1 -- 172.21.15.8:0/1919229380 wait complete. 2023-10-06T23:15:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.046+0000 7fdce586eb80 20 client.15762 trim_cache size 0 max 16384 2023-10-06T23:15:44.048 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:15:44.048 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:15:44.048 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:15:44.048 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:15:44.049 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:15:44.049 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:15:44.049 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:15:44.049 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:15:44.049 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:15:44.049 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 -- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdcb80a1500 msgr2=0x7fdcb80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdcb80a1500 0x7fdcb80a39c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009ec0 tx=0x7fdcc4009040 comp rx=0 tx=0).stop 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 -- 172.21.15.8:0/2758179164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc102070 msgr2=0x7fdccc197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc102070 0x7fdccc197120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400e9f0 tx=0x7fdcb400ed00 comp rx=0 tx=0).stop 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 -- 172.21.15.8:0/2758179164 shutdown_connections 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdcb80a1500 0x7fdcb80a39c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdccc102a30 0x7fdccc19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdccc100e90 0x7fdccc196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 --2- 172.21.15.8:0/2758179164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdccc102070 0x7fdccc197120 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400e9f0 tx=0x7fdcb400ed00 comp rx=0 tx=0).stop 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.047+0000 7fdcd1fff700 1 -- 172.21.15.8:0/2758179164 >> 172.21.15.8:0/2758179164 conn(0x7fdccc0fc430 msgr2=0x7fdccc0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:44.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.048+0000 7fdcd1fff700 1 -- 172.21.15.8:0/2758179164 shutdown_connections 2023-10-06T23:15:44.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:15:44.048+0000 7fdcd1fff700 1 -- 172.21.15.8:0/2758179164 wait complete. 2023-10-06T23:15:44.076 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:15:46.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:46 smithi156 ceph-mon[102862]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2023-10-06T23:15:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:46 smithi008 ceph-mon[98532]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2023-10-06T23:15:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:46 smithi190 ceph-mon[102658]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2023-10-06T23:15:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 -- 172.21.15.8:0/2842445646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7c0100f10 msgr2=0x7fc7c0101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/2842445646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7c0100f10 0x7fc7c0101330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009990 tx=0x7fc7b0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 -- 172.21.15.8:0/2842445646 shutdown_connections 2023-10-06T23:15:48.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/2842445646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7c0100f10 0x7fc7c0101330 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/2842445646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7c0102a20 0x7fc7c0109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/2842445646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c0102060 0x7fc7c01024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 -- 172.21.15.8:0/2842445646 >> 172.21.15.8:0/2842445646 conn(0x7fc7c00fc460 msgr2=0x7fc7c00fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:48.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 -- 172.21.15.8:0/2842445646 shutdown_connections 2023-10-06T23:15:48.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.167+0000 7fc7c59ff700 1 -- 172.21.15.8:0/2842445646 wait complete. 2023-10-06T23:15:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.168+0000 7fc7c59ff700 1 Processor -- start 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.168+0000 7fc7c59ff700 1 -- start start 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.168+0000 7fc7c59ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7c0100f10 0x7fc7c0198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.168+0000 7fc7c59ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c0102060 0x7fc7c0199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7c59ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7c0102a20 0x7fc7c019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7c59ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c019a8c0 con 0x7fc7c0102a20 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7c59ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c019aa30 con 0x7fc7c0102060 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7c59ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c019abf0 con 0x7fc7c0100f10 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7beffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7c0100f10 0x7fc7c0198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7beffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7c0100f10 0x7fc7c0198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40966/0 (socket says 172.21.15.8:40966) 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7beffd700 1 -- 172.21.15.8:0/3120785724 learned_addr learned my addr 172.21.15.8:0/3120785724 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c0102060 0x7fc7c0199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7bf7fe700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7c0102a20 0x7fc7c019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7beffd700 1 -- 172.21.15.8:0/3120785724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c0102060 msgr2=0x7fc7c0199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c0102060 0x7fc7c0199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7beffd700 1 -- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7c0102a20 msgr2=0x7fc7c019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7c0102a20 0x7fc7c019a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7beffd700 1 -- 172.21.15.8:0/3120785724 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00095f0 con 0x7fc7c0100f10 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.169+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c0102060 0x7fc7c0199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.170+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7c0100f10 0x7fc7c0198ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00098e0 tx=0x7fc7b0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.170+0000 7fc7c49fd700 1 -- 172.21.15.8:0/3120785724 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b001d070 con 0x7fc7c0100f10 2023-10-06T23:15:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.170+0000 7fc7c59ff700 1 -- 172.21.15.8:0/3120785724 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c019ae70 con 0x7fc7c0100f10 2023-10-06T23:15:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.170+0000 7fc7c49fd700 1 -- 172.21.15.8:0/3120785724 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7b000bdd0 con 0x7fc7c0100f10 2023-10-06T23:15:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.170+0000 7fc7c49fd700 1 -- 172.21.15.8:0/3120785724 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0022db0 con 0x7fc7c0100f10 2023-10-06T23:15:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.170+0000 7fc7c59ff700 1 -- 172.21.15.8:0/3120785724 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c01a15e0 con 0x7fc7c0100f10 2023-10-06T23:15:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.176+0000 7fc7c49fd700 1 -- 172.21.15.8:0/3120785724 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc7b0022470 con 0x7fc7c0100f10 2023-10-06T23:15:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.177+0000 7fc7d92bab80 1 Processor -- start 2023-10-06T23:15:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.177+0000 7fc7d92bab80 1 -- start start 2023-10-06T23:15:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.177+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e0892e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.177+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e089fd0 0x557a1e08a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.177+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e08a990 0x557a1e091220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.178+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1dff1400 con 0x557a1e089fd0 2023-10-06T23:15:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.178+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1dfe2bc0 con 0x557a1e088ec0 2023-10-06T23:15:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.178+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1dfe04e0 con 0x557a1e08a990 2023-10-06T23:15:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.178+0000 7fc7be7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e08a990 0x557a1e091220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.178+0000 7fc7be7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e08a990 0x557a1e091220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40968/0 (socket says 172.21.15.8:40968) 2023-10-06T23:15:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.178+0000 7fc7be7fc700 1 -- 172.21.15.8:0/3836989761 learned_addr learned my addr 172.21.15.8:0/3836989761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.178+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e089fd0 0x557a1e08a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.178+0000 7fc7bf7fe700 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e0892e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.179+0000 7fc7be7fc700 1 -- 172.21.15.8:0/3836989761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 msgr2=0x557a1e0892e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.179+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e0892e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.179+0000 7fc7be7fc700 1 -- 172.21.15.8:0/3836989761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e089fd0 msgr2=0x557a1e08a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.179+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e089fd0 0x557a1e08a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.179+0000 7fc7be7fc700 1 -- 172.21.15.8:0/3836989761 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a1de06d80 con 0x557a1e08a990 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.179+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e08a990 0x557a1e091220 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009de0 tx=0x7fc7b40116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3792bb84a65fffc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.179+0000 7fc7c49fd700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7a80a1500 0x7fc7a80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.179+0000 7fc7a5ffb700 1 -- 172.21.15.8:0/3836989761 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4011e70 con 0x557a1e08a990 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.180+0000 7fc7a5ffb700 1 -- 172.21.15.8:0/3836989761 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7b40128e0 con 0x557a1e08a990 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.180+0000 7fc7a5ffb700 1 -- 172.21.15.8:0/3836989761 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400f7c0 con 0x557a1e08a990 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.180+0000 7fc7c49fd700 1 -- 172.21.15.8:0/3120785724 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc7b00ce300 con 0x7fc7c0100f10 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.180+0000 7fc7bf7fe700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7a80a1500 0x7fc7a80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7bf7fe700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7a80a1500 0x7fc7a80a39c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009fd0 tx=0x7fc7b800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3836989761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e08a990 msgr2=0x557a1e091220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e08a990 0x557a1e091220 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009de0 tx=0x7fc7b40116c0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3836989761 shutdown_connections 2023-10-06T23:15:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e08a990 0x557a1e091220 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e0892e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3836989761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e089fd0 0x557a1e08a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3836989761 >> 172.21.15.8:0/3836989761 conn(0x557a1dffd200 msgr2=0x557a1e083bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3836989761 shutdown_connections 2023-10-06T23:15:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3836989761 wait complete. 2023-10-06T23:15:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.181+0000 7fc7d92bab80 1 -- start start 2023-10-06T23:15:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7d92bab80 1 Processor -- start 2023-10-06T23:15:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e092ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e093010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e09a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1dfdbdd0 con 0x557a1e08a990 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1df786b0 con 0x557a1e088ec0 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1df78350 con 0x557a1e089fd0 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7d92bab80 10 client.0 _ll_register_callbacks cb 0x557a1ddd57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e09a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7be7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e093010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e09a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54404/0 (socket says 172.21.15.8:54404) 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.182+0000 7fc7bf7fe700 1 -- 172.21.15.8:0/3285141855 learned_addr learned my addr 172.21.15.8:0/3285141855 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e092ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc7be7fc700 1 -- 172.21.15.8:0/3285141855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 msgr2=0x557a1e092ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e092ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc7be7fc700 1 -- 172.21.15.8:0/3285141855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 msgr2=0x557a1e09a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e09a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc7be7fc700 1 -- 172.21.15.8:0/3285141855 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b4009a10 con 0x557a1e089fd0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc7bf7fe700 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e09a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e093010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009db0 tx=0x7fc7b4012d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74c5cbc8f8768320 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.183+0000 7fc79effd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.184+0000 7fc79effd700 1 -- 172.21.15.8:0/3285141855 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4004040 con 0x557a1e089fd0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.184+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3285141855 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a1e07bd50 con 0x557a1e089fd0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.184+0000 7fc79effd700 1 -- 172.21.15.8:0/3285141855 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc7b40041a0 con 0x557a1e089fd0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.184+0000 7fc79effd700 1 -- 172.21.15.8:0/3285141855 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7b4004360 con 0x557a1e089fd0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.184+0000 7fc7d92bab80 10 client.25624 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.184+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3285141855 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557a1ddefc00 con 0x557a1e089fd0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.184+0000 7fc79effd700 1 -- 172.21.15.8:0/3285141855 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a1e07bd50 con 0x557a1e089fd0 2023-10-06T23:15:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.184+0000 7fc79effd700 1 -- 172.21.15.8:0/3285141855 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fc7b400f540 con 0x557a1e089fd0 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.185+0000 7fc7d92bab80 10 client.25624 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.185+0000 7fc7d92bab80 10 client.25624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.185+0000 7fc7d92bab80 20 client.25624 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.185+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557a1e09e9a0 0x557a1e0a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.185+0000 7fc7d92bab80 4 client.25624 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.185+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3285141855 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a1dfd4db0 con 0x557a1e09e9a0 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.185+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557a1e09e9a0 0x557a1e0a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.186+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557a1e09e9a0 0x557a1e0a0dc0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c81decbba8cdbe75 server_cookie=8b29ff4937c88064 in_seq=0 out_seq=0 2023-10-06T23:15:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.186+0000 7fc79effd700 10 client.25624 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc79effd700 1 -- 172.21.15.8:0/3285141855 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557a1dfd4db0 con 0x557a1e09e9a0 2023-10-06T23:15:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc79effd700 10 client.25624 handle_command_reply: tid=0 2023-10-06T23:15:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 client.25624 shutdown 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3285141855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 msgr2=0x557a1e093010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e093010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009db0 tx=0x7fc7b4012d00 comp rx=0 tx=0).stop 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3285141855 shutdown_connections 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557a1e09e9a0 0x557a1e0a0dc0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e09a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e092ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3285141855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e093010 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc79effd700 0 client.25624 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3285141855 >> 172.21.15.8:0/3285141855 conn(0x557a1dffd200 msgr2=0x557a1e083250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3285141855 shutdown_connections 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.187+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3285141855 wait complete. 2023-10-06T23:15:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.188+0000 7fc7d92bab80 20 client.25624 trim_cache size 0 max 16384 2023-10-06T23:15:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.211+0000 7fc7d92bab80 1 Processor -- start 2023-10-06T23:15:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.211+0000 7fc7d92bab80 1 -- start start 2023-10-06T23:15:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e088ec0 0x557a1e091910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e089fd0 0x557a1e09a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e092ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1de5c8c0 con 0x557a1e08a990 2023-10-06T23:15:48.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e090aa0 con 0x557a1e089fd0 2023-10-06T23:15:48.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e08e3b0 con 0x557a1e088ec0 2023-10-06T23:15:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7be7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e089fd0 0x557a1e09a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7beffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e088ec0 0x557a1e091910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7be7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e089fd0 0x557a1e09a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37288/0 (socket says 172.21.15.8:37288) 2023-10-06T23:15:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7beffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e088ec0 0x557a1e091910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40980/0 (socket says 172.21.15.8:40980) 2023-10-06T23:15:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.212+0000 7fc7beffd700 1 -- 172.21.15.8:0/3252206958 learned_addr learned my addr 172.21.15.8:0/3252206958 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.213+0000 7fc7bf7fe700 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e092ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.213+0000 7fc7beffd700 1 -- 172.21.15.8:0/3252206958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e089fd0 msgr2=0x557a1e09a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:48.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.213+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e089fd0 0x557a1e09a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.213+0000 7fc7beffd700 1 -- 172.21.15.8:0/3252206958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 msgr2=0x557a1e092ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.213+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e092ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.213+0000 7fc7beffd700 1 -- 172.21.15.8:0/3252206958 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a1de2d1f0 con 0x557a1e088ec0 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.213+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e089fd0 0x557a1e09a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.213+0000 7fc7beffd700 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e088ec0 0x557a1e091910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0005f50 tx=0x7fc7b00bb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96105bb53faac870 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.214+0000 7fc7a67fc700 1 -- 172.21.15.8:0/3252206958 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b009b430 con 0x557a1e088ec0 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.214+0000 7fc7a67fc700 1 -- 172.21.15.8:0/3252206958 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7b009b1a0 con 0x557a1e088ec0 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.214+0000 7fc7a67fc700 1 -- 172.21.15.8:0/3252206958 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00a3960 con 0x557a1e088ec0 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3252206958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e088ec0 msgr2=0x557a1e091910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e088ec0 0x557a1e091910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0005f50 tx=0x7fc7b00bb040 comp rx=0 tx=0).stop 2023-10-06T23:15:48.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3252206958 shutdown_connections 2023-10-06T23:15:48.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e092ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e088ec0 0x557a1e091910 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/3252206958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e089fd0 0x557a1e09a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3252206958 >> 172.21.15.8:0/3252206958 conn(0x557a1dffd200 msgr2=0x557a1e0a5720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:48.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3252206958 shutdown_connections 2023-10-06T23:15:48.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 -- 172.21.15.8:0/3252206958 wait complete. 2023-10-06T23:15:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.215+0000 7fc7d92bab80 1 -- start start 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.216+0000 7fc7d92bab80 1 Processor -- start 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.216+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e097f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.216+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e098490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.216+0000 7fc7d92bab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e0994a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.216+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e0999e0 con 0x557a1e08a990 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.216+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e099b50 con 0x557a1e088ec0 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.216+0000 7fc7d92bab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e099d10 con 0x557a1e089fd0 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.216+0000 7fc7d92bab80 10 client.0 _ll_register_callbacks cb 0x557a1ddd57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e097f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e0994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e097f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37300/0 (socket says 172.21.15.8:37300) 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7beffd700 1 -- 172.21.15.8:0/1038355929 learned_addr learned my addr 172.21.15.8:0/1038355929 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e098490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7beffd700 1 -- 172.21.15.8:0/1038355929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 msgr2=0x557a1e098490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7beffd700 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e098490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7beffd700 1 -- 172.21.15.8:0/1038355929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 msgr2=0x557a1e0994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7beffd700 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e0994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.217+0000 7fc7beffd700 1 -- 172.21.15.8:0/1038355929 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a1ddefc00 con 0x557a1e088ec0 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.218+0000 7fc7beffd700 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e097f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc7b009b360 tx=0x7fc7b0005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee14cfd3f86155a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.218+0000 7fc79effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.218+0000 7fc79effd700 1 -- 172.21.15.8:0/1038355929 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b009b430 con 0x557a1e088ec0 2023-10-06T23:15:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.218+0000 7fc79effd700 1 -- 172.21.15.8:0/1038355929 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc7b009bd60 con 0x557a1e088ec0 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.218+0000 7fc7d92bab80 1 -- 172.21.15.8:0/1038355929 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7b40128e0 con 0x557a1e088ec0 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.218+0000 7fc79effd700 1 -- 172.21.15.8:0/1038355929 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7b00a3960 con 0x557a1e088ec0 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.218+0000 7fc7d92bab80 10 client.25583 fetch_fsmap learned FSMap version 29 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.218+0000 7fc7d92bab80 1 -- 172.21.15.8:0/1038355929 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fc7c01a15e0 con 0x557a1e088ec0 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc79effd700 1 -- 172.21.15.8:0/1038355929 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7b40128e0 con 0x557a1e088ec0 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc79effd700 1 -- 172.21.15.8:0/1038355929 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fc7b009ac70 con 0x557a1e088ec0 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc7d92bab80 10 client.25583 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc7d92bab80 10 client.25583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc7d92bab80 20 client.25583 populate_metadata read hostname 'smithi008' 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557a1e0fbcc0 0x557a1e0fe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc7d92bab80 4 client.25583 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:15:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc7d92bab80 1 -- 172.21.15.8:0/1038355929 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a1dfd4ad0 con 0x557a1e0fbcc0 2023-10-06T23:15:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.219+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557a1e0fbcc0 0x557a1e0fe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:15:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.220+0000 7fc7be7fc700 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557a1e0fbcc0 0x557a1e0fe0e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a372a0b6e76b86d server_cookie=6f77f49a9adb08b in_seq=0 out_seq=0 2023-10-06T23:15:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.220+0000 7fc79effd700 10 client.25583 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.235+0000 7fc79effd700 1 -- 172.21.15.8:0/1038355929 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a1dfd4ad0 con 0x557a1e0fbcc0 2023-10-06T23:15:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.235+0000 7fc79effd700 10 client.25583 handle_command_reply: tid=0 2023-10-06T23:15:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.235+0000 7fc7d92bab80 1 client.25583 shutdown 2023-10-06T23:15:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 -- 172.21.15.8:0/1038355929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 msgr2=0x557a1e097f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e097f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc7b009b360 tx=0x7fc7b0005a00 comp rx=0 tx=0).stop 2023-10-06T23:15:48.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 -- 172.21.15.8:0/1038355929 shutdown_connections 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557a1e0fbcc0 0x557a1e0fe0e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a1e08a990 0x557a1e0994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a1e088ec0 0x557a1e097f50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 --2- 172.21.15.8:0/1038355929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557a1e089fd0 0x557a1e098490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc79effd700 0 client.25583 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 -- 172.21.15.8:0/1038355929 >> 172.21.15.8:0/1038355929 conn(0x557a1dffd200 msgr2=0x557a1e08d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 -- 172.21.15.8:0/1038355929 shutdown_connections 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 1 -- 172.21.15.8:0/1038355929 wait complete. 2023-10-06T23:15:48.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.236+0000 7fc7d92bab80 20 client.25583 trim_cache size 0 max 16384 2023-10-06T23:15:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:15:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:15:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:15:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 -- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7a80a1500 msgr2=0x7fc7a80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7a80a1500 0x7fc7a80a39c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009fd0 tx=0x7fc7b800b040 comp rx=0 tx=0).stop 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 -- 172.21.15.8:0/3120785724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7c0100f10 msgr2=0x7fc7c0198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7c0100f10 0x7fc7c0198ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00098e0 tx=0x7fc7b0004730 comp rx=0 tx=0).stop 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 -- 172.21.15.8:0/3120785724 shutdown_connections 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7a80a1500 0x7fc7a80a39c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7c0102a20 0x7fc7c019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7c0100f10 0x7fc7c0198ed0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 --2- 172.21.15.8:0/3120785724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7c0102060 0x7fc7c0199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 -- 172.21.15.8:0/3120785724 >> 172.21.15.8:0/3120785724 conn(0x7fc7c00fc460 msgr2=0x7fc7c00fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:15:48.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 -- 172.21.15.8:0/3120785724 shutdown_connections 2023-10-06T23:15:48.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:15:48.237+0000 7fc7c59ff700 1 -- 172.21.15.8:0/3120785724 wait complete. 2023-10-06T23:15:48.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:48 smithi156 ceph-mon[102862]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 7.2 MiB/s wr, 537 op/s 2023-10-06T23:15:48.397 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:48 smithi008 ceph-mon[98532]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 7.2 MiB/s wr, 537 op/s 2023-10-06T23:15:48.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:48 smithi190 ceph-mon[102658]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 7.2 MiB/s wr, 537 op/s 2023-10-06T23:15:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 55.0 s, 262.6 tps, lat 381.490 ms stddev 69.042 2023-10-06T23:15:50.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:50 smithi156 ceph-mon[102862]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-06T23:15:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:50 smithi008 ceph-mon[98532]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-06T23:15:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:50 smithi190 ceph-mon[102658]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-06T23:15:52.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:52 smithi156 ceph-mon[102862]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 6.7 MiB/s wr, 565 op/s 2023-10-06T23:15:52.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:52 smithi008 ceph-mon[98532]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 6.7 MiB/s wr, 565 op/s 2023-10-06T23:15:52.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:52 smithi190 ceph-mon[102658]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 6.7 MiB/s wr, 565 op/s 2023-10-06T23:15:53.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:53 smithi156 ceph-mon[102862]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 5.8 MiB/s wr, 490 op/s 2023-10-06T23:15:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:53 smithi008 ceph-mon[98532]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 5.8 MiB/s wr, 490 op/s 2023-10-06T23:15:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:53 smithi190 ceph-mon[102658]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 5.8 MiB/s wr, 490 op/s 2023-10-06T23:15:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 60.0 s, 220.6 tps, lat 456.195 ms stddev 245.221 2023-10-06T23:15:56.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:56 smithi156 ceph-mon[102862]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 8.5 MiB/s wr, 633 op/s 2023-10-06T23:15:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:56 smithi008 ceph-mon[98532]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 8.5 MiB/s wr, 633 op/s 2023-10-06T23:15:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:56 smithi190 ceph-mon[102658]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 8.5 MiB/s wr, 633 op/s 2023-10-06T23:15:58.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:15:58 smithi156 ceph-mon[102862]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 7.0 MiB/s wr, 599 op/s 2023-10-06T23:15:58.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:15:58 smithi008 ceph-mon[98532]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 7.0 MiB/s wr, 599 op/s 2023-10-06T23:15:58.445 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:15:58 smithi190 ceph-mon[102658]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 7.0 MiB/s wr, 599 op/s 2023-10-06T23:15:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 65.0 s, 271.4 tps, lat 367.381 ms stddev 70.686 2023-10-06T23:16:00.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:00 smithi156 ceph-mon[102862]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 6.9 MiB/s wr, 563 op/s 2023-10-06T23:16:00.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:00 smithi008 ceph-mon[98532]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 6.9 MiB/s wr, 563 op/s 2023-10-06T23:16:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:00 smithi190 ceph-mon[102658]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 6.9 MiB/s wr, 563 op/s 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.433+0000 7f0665bff700 1 -- 172.21.15.8:0/3596812992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660100eb0 msgr2=0x7f06601012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.433+0000 7f0665bff700 1 --2- 172.21.15.8:0/3596812992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660100eb0 0x7f06601012d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0650009990 tx=0x7f0650009ca0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.433+0000 7f0665bff700 1 -- 172.21.15.8:0/3596812992 shutdown_connections 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.433+0000 7f0665bff700 1 --2- 172.21.15.8:0/3596812992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660100eb0 0x7f06601012d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.434+0000 7f0665bff700 1 --2- 172.21.15.8:0/3596812992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0660102a50 0x7f0660109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.434+0000 7f0665bff700 1 --2- 172.21.15.8:0/3596812992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0660102090 0x7f0660102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.434+0000 7f0665bff700 1 -- 172.21.15.8:0/3596812992 >> 172.21.15.8:0/3596812992 conn(0x7f06600fc430 msgr2=0x7f06600fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.434+0000 7f0665bff700 1 -- 172.21.15.8:0/3596812992 shutdown_connections 2023-10-06T23:16:01.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.434+0000 7f0665bff700 1 -- 172.21.15.8:0/3596812992 wait complete. 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f0665bff700 1 Processor -- start 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f0665bff700 1 -- start start 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f0665bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0660100eb0 0x7f0660198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f0665bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660102090 0x7f0660199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f0665bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0660102a50 0x7f066019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f0665bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066019a8d0 con 0x7f0660102090 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f0665bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066019aa40 con 0x7f0660100eb0 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f0665bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066019ac00 con 0x7f0660102a50 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f065f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660102090 0x7f0660199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f06577fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0660100eb0 0x7f0660198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f06577fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0660100eb0 0x7f0660198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:46532/0 (socket says 172.21.15.8:46532) 2023-10-06T23:16:01.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f065ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0660102a50 0x7f066019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.435+0000 7f06577fe700 1 -- 172.21.15.8:0/3592783486 learned_addr learned my addr 172.21.15.8:0/3592783486 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065f7fe700 1 -- 172.21.15.8:0/3592783486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0660102a50 msgr2=0x7f066019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065f7fe700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0660102a50 0x7f066019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065f7fe700 1 -- 172.21.15.8:0/3592783486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0660100eb0 msgr2=0x7f0660198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065f7fe700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0660100eb0 0x7f0660198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065f7fe700 1 -- 172.21.15.8:0/3592783486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500095f0 con 0x7f0660102090 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065f7fe700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660102090 0x7f0660199420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f064800e9c0 tx=0x7f064800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065d7fa700 1 -- 172.21.15.8:0/3592783486 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648004220 con 0x7f0660102090 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065d7fa700 1 -- 172.21.15.8:0/3592783486 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0648004380 con 0x7f0660102090 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f0665bff700 1 -- 172.21.15.8:0/3592783486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066019aee0 con 0x7f0660102090 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.436+0000 7f065d7fa700 1 -- 172.21.15.8:0/3592783486 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648003b40 con 0x7f0660102090 2023-10-06T23:16:01.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.437+0000 7f0665bff700 1 -- 172.21.15.8:0/3592783486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06601a16a0 con 0x7f0660102090 2023-10-06T23:16:01.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.442+0000 7f065d7fa700 1 -- 172.21.15.8:0/3592783486 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0648003ca0 con 0x7f0660102090 2023-10-06T23:16:01.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.442+0000 7f0679544b80 1 Processor -- start 2023-10-06T23:16:01.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.443+0000 7f0679544b80 1 -- start start 2023-10-06T23:16:01.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.443+0000 7f0679544b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df102e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.443+0000 7f0679544b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df11450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.443+0000 7f0679544b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df18220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.443+0000 7f0679544b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2de78400 con 0x556d2df0fec0 2023-10-06T23:16:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.443+0000 7f0679544b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2de69bc0 con 0x556d2df10fd0 2023-10-06T23:16:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.443+0000 7f0679544b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2de674e0 con 0x556d2df11990 2023-10-06T23:16:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f06577fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df11450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f06577fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df11450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:46538/0 (socket says 172.21.15.8:46538) 2023-10-06T23:16:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f06577fe700 1 -- 172.21.15.8:0/1850303203 learned_addr learned my addr 172.21.15.8:0/1850303203 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f065ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f065f7fe700 1 --2- 172.21.15.8:0/1850303203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df18220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f06577fe700 1 -- 172.21.15.8:0/1850303203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 msgr2=0x556d2df18220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f06577fe700 1 --2- 172.21.15.8:0/1850303203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df18220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f06577fe700 1 -- 172.21.15.8:0/1850303203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 msgr2=0x556d2df102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f06577fe700 1 --2- 172.21.15.8:0/1850303203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df102e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f065d7fa700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f064c0a1500 0x7f064c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.444+0000 7f06577fe700 1 -- 172.21.15.8:0/1850303203 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d2dc8dd80 con 0x556d2df10fd0 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.445+0000 7f065d7fa700 1 -- 172.21.15.8:0/3592783486 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0648014070 con 0x7f0660102090 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.445+0000 7f06577fe700 1 --2- 172.21.15.8:0/1850303203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df11450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0650005f20 tx=0x7f0650005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938ae570399146e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.445+0000 7f065ffff700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f064c0a1500 0x7f064c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.445+0000 7f0655ffb700 1 -- 172.21.15.8:0/1850303203 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065001d070 con 0x556d2df10fd0 2023-10-06T23:16:01.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.445+0000 7f0655ffb700 1 -- 172.21.15.8:0/1850303203 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f065001e040 con 0x556d2df10fd0 2023-10-06T23:16:01.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.445+0000 7f0655ffb700 1 -- 172.21.15.8:0/1850303203 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000b970 con 0x556d2df10fd0 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.446+0000 7f065ffff700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f064c0a1500 0x7f064c0a39c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x556d2df0fc60 tx=0x7f065800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.446+0000 7f0679544b80 1 -- 172.21.15.8:0/1850303203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 msgr2=0x556d2df11450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.446+0000 7f0679544b80 1 --2- 172.21.15.8:0/1850303203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df11450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0650005f20 tx=0x7f0650005bc0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.447+0000 7f0679544b80 1 -- 172.21.15.8:0/1850303203 shutdown_connections 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.447+0000 7f0679544b80 1 --2- 172.21.15.8:0/1850303203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.447+0000 7f0679544b80 1 --2- 172.21.15.8:0/1850303203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df18220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.447+0000 7f0679544b80 1 --2- 172.21.15.8:0/1850303203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df11450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.447+0000 7f0679544b80 1 -- 172.21.15.8:0/1850303203 >> 172.21.15.8:0/1850303203 conn(0x556d2de84200 msgr2=0x556d2df0abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.447+0000 7f0679544b80 1 -- 172.21.15.8:0/1850303203 shutdown_connections 2023-10-06T23:16:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.447+0000 7f0679544b80 1 -- 172.21.15.8:0/1850303203 wait complete. 2023-10-06T23:16:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.447+0000 7f0679544b80 1 -- start start 2023-10-06T23:16:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.448+0000 7f0679544b80 1 Processor -- start 2023-10-06T23:16:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f0679544b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df0fec0 0x556d2df222c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f0679544b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df22800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f0679544b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df11990 0x556d2df29840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f0679544b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2de62dd0 con 0x556d2df11990 2023-10-06T23:16:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f0679544b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2ddff6b0 con 0x556d2df10fd0 2023-10-06T23:16:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f0679544b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2ddff350 con 0x556d2df0fec0 2023-10-06T23:16:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f0679544b80 10 client.0 _ll_register_callbacks cb 0x556d2dc5c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f06577fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df0fec0 0x556d2df222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f06577fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df0fec0 0x556d2df222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44784/0 (socket says 172.21.15.8:44784) 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f06577fe700 1 -- 172.21.15.8:0/1180382490 learned_addr learned my addr 172.21.15.8:0/1180382490 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f065ffff700 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df11990 0x556d2df29840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.449+0000 7f065f7fe700 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df22800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.450+0000 7f06577fe700 1 -- 172.21.15.8:0/1180382490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 msgr2=0x556d2df22800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.450+0000 7f06577fe700 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df22800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.450+0000 7f06577fe700 1 -- 172.21.15.8:0/1180382490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df11990 msgr2=0x556d2df29840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.450+0000 7f06577fe700 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df11990 0x556d2df29840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.450+0000 7f06577fe700 1 -- 172.21.15.8:0/1180382490 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660109ca0 con 0x556d2df0fec0 2023-10-06T23:16:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.450+0000 7f06577fe700 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df0fec0 0x556d2df222c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0650009350 tx=0x7f06500059f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cee538191a06b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.450+0000 7f063effd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:16:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.450+0000 7f063effd700 1 -- 172.21.15.8:0/1180382490 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065001d030 con 0x556d2df0fec0 2023-10-06T23:16:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.451+0000 7f063effd700 1 -- 172.21.15.8:0/1180382490 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f065000b710 con 0x556d2df0fec0 2023-10-06T23:16:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.451+0000 7f0679544b80 1 -- 172.21.15.8:0/1180382490 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d2df02d50 con 0x556d2df0fec0 2023-10-06T23:16:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.451+0000 7f063effd700 1 -- 172.21.15.8:0/1180382490 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f065000b8d0 con 0x556d2df0fec0 2023-10-06T23:16:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.451+0000 7f0679544b80 10 client.25642 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.451+0000 7f0679544b80 1 -- 172.21.15.8:0/1180382490 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556d2dc76c00 con 0x556d2df0fec0 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.451+0000 7f063effd700 1 -- 172.21.15.8:0/1180382490 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556d2df02d50 con 0x556d2df0fec0 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.452+0000 7f063effd700 1 -- 172.21.15.8:0/1180382490 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f0650004b10 con 0x556d2df0fec0 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.452+0000 7f0679544b80 10 client.25642 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.452+0000 7f0679544b80 10 client.25642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.452+0000 7f0679544b80 20 client.25642 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.452+0000 7f0679544b80 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556d2df2dcc0 0x556d2df300e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.452+0000 7f0679544b80 4 client.25642 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.452+0000 7f0679544b80 1 -- 172.21.15.8:0/1180382490 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d2de5bdb0 con 0x556d2df2dcc0 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.452+0000 7f065f7fe700 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556d2df2dcc0 0x556d2df300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.453+0000 7f063effd700 10 client.25642 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.453+0000 7f065f7fe700 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556d2df2dcc0 0x556d2df300e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73b4e9b905e6f968 server_cookie=f47a3c6a3843c332 in_seq=0 out_seq=0 2023-10-06T23:16:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.454+0000 7f063effd700 1 -- 172.21.15.8:0/1180382490 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556d2de5bdb0 con 0x556d2df2dcc0 2023-10-06T23:16:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.454+0000 7f063effd700 10 client.25642 handle_command_reply: tid=0 2023-10-06T23:16:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.454+0000 7f0679544b80 1 client.25642 shutdown 2023-10-06T23:16:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 -- 172.21.15.8:0/1180382490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df0fec0 msgr2=0x556d2df222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df0fec0 0x556d2df222c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0650009350 tx=0x7f06500059f0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 -- 172.21.15.8:0/1180382490 shutdown_connections 2023-10-06T23:16:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556d2df2dcc0 0x556d2df300e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df11990 0x556d2df29840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df0fec0 0x556d2df222c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 --2- 172.21.15.8:0/1180382490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df10fd0 0x556d2df22800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f063effd700 0 client.25642 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 -- 172.21.15.8:0/1180382490 >> 172.21.15.8:0/1180382490 conn(0x556d2de84200 msgr2=0x556d2df0a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 -- 172.21.15.8:0/1180382490 shutdown_connections 2023-10-06T23:16:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 1 -- 172.21.15.8:0/1180382490 wait complete. 2023-10-06T23:16:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.455+0000 7f0679544b80 20 client.25642 trim_cache size 0 max 16384 2023-10-06T23:16:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.481+0000 7f0679544b80 1 Processor -- start 2023-10-06T23:16:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.481+0000 7f0679544b80 1 -- start start 2023-10-06T23:16:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.481+0000 7f0679544b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df0fec0 0x556d2df187f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.481+0000 7f0679544b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df10fd0 0x556d2df29800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.481+0000 7f0679544b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df0ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.481+0000 7f0679544b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2dce38c0 con 0x556d2df10fd0 2023-10-06T23:16:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.481+0000 7f0679544b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2df0bc70 con 0x556d2df0fec0 2023-10-06T23:16:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.481+0000 7f0679544b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2df234c0 con 0x556d2df11990 2023-10-06T23:16:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f06577fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df0fec0 0x556d2df187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f065ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df0ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f06577fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df0fec0 0x556d2df187f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:46548/0 (socket says 172.21.15.8:46548) 2023-10-06T23:16:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f06577fe700 1 -- 172.21.15.8:0/817307223 learned_addr learned my addr 172.21.15.8:0/817307223 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f065ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df0ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44798/0 (socket says 172.21.15.8:44798) 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f065f7fe700 1 --2- 172.21.15.8:0/817307223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df10fd0 0x556d2df29800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f06577fe700 1 -- 172.21.15.8:0/817307223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 msgr2=0x556d2df0ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f06577fe700 1 --2- 172.21.15.8:0/817307223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df0ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f06577fe700 1 -- 172.21.15.8:0/817307223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df10fd0 msgr2=0x556d2df29800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f06577fe700 1 --2- 172.21.15.8:0/817307223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df10fd0 0x556d2df29800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.482+0000 7f06577fe700 1 -- 172.21.15.8:0/817307223 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d2dcb41f0 con 0x556d2df0fec0 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.483+0000 7f06577fe700 1 --2- 172.21.15.8:0/817307223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df0fec0 0x556d2df187f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06500098e0 tx=0x7f0650005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f29e35f5191dd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.483+0000 7f06567fc700 1 -- 172.21.15.8:0/817307223 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065001d040 con 0x556d2df0fec0 2023-10-06T23:16:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.483+0000 7f06567fc700 1 -- 172.21.15.8:0/817307223 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0650005180 con 0x556d2df0fec0 2023-10-06T23:16:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.483+0000 7f06567fc700 1 -- 172.21.15.8:0/817307223 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000ba90 con 0x556d2df0fec0 2023-10-06T23:16:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 -- 172.21.15.8:0/817307223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df0fec0 msgr2=0x556d2df187f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 --2- 172.21.15.8:0/817307223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df0fec0 0x556d2df187f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06500098e0 tx=0x7f0650005ec0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 -- 172.21.15.8:0/817307223 shutdown_connections 2023-10-06T23:16:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 --2- 172.21.15.8:0/817307223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df11990 0x556d2df0ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 --2- 172.21.15.8:0/817307223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df0fec0 0x556d2df187f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 --2- 172.21.15.8:0/817307223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df10fd0 0x556d2df29800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 -- 172.21.15.8:0/817307223 >> 172.21.15.8:0/817307223 conn(0x556d2de84200 msgr2=0x556d2df34a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 -- 172.21.15.8:0/817307223 shutdown_connections 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 -- 172.21.15.8:0/817307223 wait complete. 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.484+0000 7f0679544b80 1 -- start start 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.485+0000 7f0679544b80 1 Processor -- start 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.485+0000 7f0679544b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df25280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.485+0000 7f0679544b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df10fd0 0x556d2df257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.485+0000 7f0679544b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df11990 0x556d2df287e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.485+0000 7f0679544b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2df28d20 con 0x556d2df0fec0 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.485+0000 7f0679544b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2df28e90 con 0x556d2df11990 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.485+0000 7f0679544b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2df29050 con 0x556d2df10fd0 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.485+0000 7f0679544b80 10 client.0 _ll_register_callbacks cb 0x7f0660199ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f06577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df25280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f06577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df25280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43530/0 (socket says 172.21.15.8:43530) 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f06577fe700 1 -- 172.21.15.8:0/72178942 learned_addr learned my addr 172.21.15.8:0/72178942 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f065f7fe700 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df10fd0 0x556d2df257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f065ffff700 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df11990 0x556d2df287e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f06577fe700 1 -- 172.21.15.8:0/72178942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df10fd0 msgr2=0x556d2df257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f06577fe700 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df10fd0 0x556d2df257c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f06577fe700 1 -- 172.21.15.8:0/72178942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df11990 msgr2=0x556d2df287e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f06577fe700 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df11990 0x556d2df287e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.486+0000 7f06577fe700 1 -- 172.21.15.8:0/72178942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d2dc76c00 con 0x556d2df0fec0 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.487+0000 7f06577fe700 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df25280 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0650004f20 tx=0x7f0650009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5360efe8b4f5822 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.487+0000 7f063effd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:16:01.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.487+0000 7f063effd700 1 -- 172.21.15.8:0/72178942 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065001d040 con 0x556d2df0fec0 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.487+0000 7f063effd700 1 -- 172.21.15.8:0/72178942 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0650000e40 con 0x556d2df0fec0 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.487+0000 7f0679544b80 1 -- 172.21.15.8:0/72178942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d2de5bad0 con 0x556d2df0fec0 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.487+0000 7f063effd700 1 -- 172.21.15.8:0/72178942 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0650005180 con 0x556d2df0fec0 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.487+0000 7f0679544b80 10 client.15798 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.487+0000 7f0679544b80 1 -- 172.21.15.8:0/72178942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556d2dc8c250 con 0x556d2df0fec0 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.488+0000 7f063effd700 1 -- 172.21.15.8:0/72178942 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556d2de5bad0 con 0x556d2df0fec0 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.488+0000 7f063effd700 1 -- 172.21.15.8:0/72178942 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f06500048f0 con 0x556d2df0fec0 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.488+0000 7f0679544b80 10 client.15798 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.488+0000 7f0679544b80 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.488+0000 7f0679544b80 20 client.15798 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.488+0000 7f0679544b80 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556d2df1df00 0x556d2df20320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.488+0000 7f0679544b80 4 client.15798 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:16:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.488+0000 7f0679544b80 1 -- 172.21.15.8:0/72178942 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556d2dcaef10 con 0x556d2df1df00 2023-10-06T23:16:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.489+0000 7f065f7fe700 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556d2df1df00 0x556d2df20320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.489+0000 7f065f7fe700 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556d2df1df00 0x556d2df20320 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a1b0ad8c2604549 server_cookie=9af6a64202623f93 in_seq=0 out_seq=0 2023-10-06T23:16:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.489+0000 7f063effd700 10 client.15798 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f063effd700 1 -- 172.21.15.8:0/72178942 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556d2dcaef10 con 0x556d2df1df00 2023-10-06T23:16:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f063effd700 10 client.15798 handle_command_reply: tid=0 2023-10-06T23:16:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 client.15798 shutdown 2023-10-06T23:16:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 -- 172.21.15.8:0/72178942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 msgr2=0x556d2df25280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df25280 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0650004f20 tx=0x7f0650009310 comp rx=0 tx=0).stop 2023-10-06T23:16:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 -- 172.21.15.8:0/72178942 shutdown_connections 2023-10-06T23:16:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556d2df1df00 0x556d2df20320 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556d2df0fec0 0x556d2df25280 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2df11990 0x556d2df287e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 --2- 172.21.15.8:0/72178942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2df10fd0 0x556d2df257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.507+0000 7f0679544b80 1 -- 172.21.15.8:0/72178942 >> 172.21.15.8:0/72178942 conn(0x556d2de84200 msgr2=0x556d2df0ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.508+0000 7f063effd700 0 client.15798 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.508+0000 7f0679544b80 1 -- 172.21.15.8:0/72178942 shutdown_connections 2023-10-06T23:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.508+0000 7f0679544b80 1 -- 172.21.15.8:0/72178942 wait complete. 2023-10-06T23:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.508+0000 7f0679544b80 20 client.15798 trim_cache size 0 max 16384 2023-10-06T23:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 -- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f064c0a1500 msgr2=0x7f064c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f064c0a1500 0x7f064c0a39c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x556d2df0fc60 tx=0x7f065800b040 comp rx=0 tx=0).stop 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 -- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660102090 msgr2=0x7f0660199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660102090 0x7f0660199420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f064800e9c0 tx=0x7f064800ecd0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 -- 172.21.15.8:0/3592783486 shutdown_connections 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f064c0a1500 0x7f064c0a39c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0660102a50 0x7f066019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0660100eb0 0x7f0660198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 --2- 172.21.15.8:0/3592783486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0660102090 0x7f0660199420 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 -- 172.21.15.8:0/3592783486 >> 172.21.15.8:0/3592783486 conn(0x7f06600fc430 msgr2=0x7f06600fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.509+0000 7f0665bff700 1 -- 172.21.15.8:0/3592783486 shutdown_connections 2023-10-06T23:16:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:01.510+0000 7f0665bff700 1 -- 172.21.15.8:0/3592783486 wait complete. 2023-10-06T23:16:02.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:02 smithi156 ceph-mon[102862]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 7.0 MiB/s wr, 591 op/s 2023-10-06T23:16:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:02 smithi008 ceph-mon[98532]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 7.0 MiB/s wr, 591 op/s 2023-10-06T23:16:02.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:02 smithi190 ceph-mon[102658]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 7.0 MiB/s wr, 591 op/s 2023-10-06T23:16:03.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:03 smithi156 ceph-mon[102862]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 6.2 MiB/s wr, 499 op/s 2023-10-06T23:16:03.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:03 smithi008 ceph-mon[98532]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 6.2 MiB/s wr, 499 op/s 2023-10-06T23:16:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:03 smithi190 ceph-mon[102658]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 6.2 MiB/s wr, 499 op/s 2023-10-06T23:16:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 70.0 s, 189.0 tps, lat 445.576 ms stddev 154.721 2023-10-06T23:16:06.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:06 smithi156 ceph-mon[102862]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 7.3 MiB/s wr, 606 op/s 2023-10-06T23:16:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:06 smithi008 ceph-mon[98532]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 7.3 MiB/s wr, 606 op/s 2023-10-06T23:16:06.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:06 smithi190 ceph-mon[102658]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 7.3 MiB/s wr, 606 op/s 2023-10-06T23:16:08.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:08 smithi156 ceph-mon[102862]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 6.1 MiB/s wr, 560 op/s 2023-10-06T23:16:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:08 smithi008 ceph-mon[98532]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 6.1 MiB/s wr, 560 op/s 2023-10-06T23:16:08.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:08 smithi190 ceph-mon[102658]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 6.1 MiB/s wr, 560 op/s 2023-10-06T23:16:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 75.0 s, 236.8 tps, lat 489.977 ms stddev 259.636 2023-10-06T23:16:10.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:10 smithi156 ceph-mon[102862]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2023-10-06T23:16:10.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:10 smithi008 ceph-mon[98532]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2023-10-06T23:16:10.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:10 smithi190 ceph-mon[102658]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2023-10-06T23:16:12.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:12 smithi156 ceph-mon[102862]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 6.0 MiB/s wr, 527 op/s 2023-10-06T23:16:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:12 smithi008 ceph-mon[98532]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 6.0 MiB/s wr, 527 op/s 2023-10-06T23:16:12.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:12 smithi190 ceph-mon[102658]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 6.0 MiB/s wr, 527 op/s 2023-10-06T23:16:13.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:13 smithi156 ceph-mon[102862]: pgmap v450: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 5.4 MiB/s wr, 459 op/s 2023-10-06T23:16:13.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:13 smithi008 ceph-mon[98532]: pgmap v450: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 5.4 MiB/s wr, 459 op/s 2023-10-06T23:16:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:13 smithi190 ceph-mon[102658]: pgmap v450: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 5.4 MiB/s wr, 459 op/s 2023-10-06T23:16:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 80.0 s, 274.4 tps, lat 362.811 ms stddev 119.947 2023-10-06T23:16:14.076 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:16:14.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 -- 172.21.15.8:0/1850266202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20100f40 msgr2=0x7fef20101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 --2- 172.21.15.8:0/1850266202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20100f40 0x7fef20101360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0098f0 tx=0x7fef1c009c00 comp rx=0 tx=0).stop 2023-10-06T23:16:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 -- 172.21.15.8:0/1850266202 shutdown_connections 2023-10-06T23:16:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 --2- 172.21.15.8:0/1850266202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20100f40 0x7fef20101360 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 --2- 172.21.15.8:0/1850266202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef20102a50 0x7fef20109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 --2- 172.21.15.8:0/1850266202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef20102090 0x7fef20102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 -- 172.21.15.8:0/1850266202 >> 172.21.15.8:0/1850266202 conn(0x7fef200fc4d0 msgr2=0x7fef200fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 -- 172.21.15.8:0/1850266202 shutdown_connections 2023-10-06T23:16:14.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.318+0000 7fef27bff700 1 -- 172.21.15.8:0/1850266202 wait complete. 2023-10-06T23:16:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.319+0000 7fef27bff700 1 Processor -- start 2023-10-06T23:16:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.319+0000 7fef27bff700 1 -- start start 2023-10-06T23:16:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef27bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef20100f40 0x7fef2006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef27bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef20102090 0x7fef2006ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef27bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20102a50 0x7fef20071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef27bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef20072250 con 0x7fef20102a50 2023-10-06T23:16:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef27bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200723c0 con 0x7fef20100f40 2023-10-06T23:16:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef27bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef20072580 con 0x7fef20102090 2023-10-06T23:16:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef2599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef20100f40 0x7fef2006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef2519a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef20102090 0x7fef2006ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef2599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef20100f40 0x7fef2006e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35466/0 (socket says 172.21.15.8:35466) 2023-10-06T23:16:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef2599b700 1 -- 172.21.15.8:0/424299371 learned_addr learned my addr 172.21.15.8:0/424299371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.320+0000 7fef2619c700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20102a50 0x7fef20071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef2599b700 1 -- 172.21.15.8:0/424299371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef20102090 msgr2=0x7fef2006ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef2599b700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef20102090 0x7fef2006ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef2599b700 1 -- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20102a50 msgr2=0x7fef20071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef2599b700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20102a50 0x7fef20071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef2599b700 1 -- 172.21.15.8:0/424299371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009520 con 0x7fef20100f40 2023-10-06T23:16:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef2519a700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef20102090 0x7fef2006ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef2619c700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20102a50 0x7fef20071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:16:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef2599b700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef20100f40 0x7fef2006e6f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009fd0 tx=0x7fef1c00b500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef16ffd700 1 -- 172.21.15.8:0/424299371 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c01c070 con 0x7fef20100f40 2023-10-06T23:16:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef16ffd700 1 -- 172.21.15.8:0/424299371 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef1c005040 con 0x7fef20100f40 2023-10-06T23:16:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef27bff700 1 -- 172.21.15.8:0/424299371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef200727a0 con 0x7fef20100f40 2023-10-06T23:16:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.321+0000 7fef16ffd700 1 -- 172.21.15.8:0/424299371 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c004910 con 0x7fef20100f40 2023-10-06T23:16:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.322+0000 7fef27bff700 1 -- 172.21.15.8:0/424299371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef20072ca0 con 0x7fef20100f40 2023-10-06T23:16:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.327+0000 7fef16ffd700 1 -- 172.21.15.8:0/424299371 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fef1c020070 con 0x7fef20100f40 2023-10-06T23:16:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.329+0000 7fef3b5cab80 1 Processor -- start 2023-10-06T23:16:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.329+0000 7fef3b5cab80 1 -- start start 2023-10-06T23:16:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.329+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32130 0x564a47f32550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.329+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f33db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47e9d460 con 0x564a47f32a90 2023-10-06T23:16:14.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47e8ec20 con 0x564a47f32130 2023-10-06T23:16:14.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47e8c540 con 0x564a47f33930 2023-10-06T23:16:14.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef2619c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32130 0x564a47f32550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef2619c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32130 0x564a47f32550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35476/0 (socket says 172.21.15.8:35476) 2023-10-06T23:16:14.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef2619c700 1 -- 172.21.15.8:0/1826261361 learned_addr learned my addr 172.21.15.8:0/1826261361 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef2599b700 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.330+0000 7fef2519a700 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f33db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef2619c700 1 -- 172.21.15.8:0/1826261361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 msgr2=0x564a47f33db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef2619c700 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f33db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef2619c700 1 -- 172.21.15.8:0/1826261361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 msgr2=0x564a47f333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef2619c700 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef2619c700 1 -- 172.21.15.8:0/1826261361 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a47cb2de0 con 0x564a47f32130 2023-10-06T23:16:14.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef16ffd700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fef0c0a1580 0x7fef0c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef16ffd700 1 -- 172.21.15.8:0/424299371 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fef1c0cdae0 con 0x7fef20100f40 2023-10-06T23:16:14.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef2619c700 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32130 0x564a47f32550 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef18009440 tx=0x7fef18009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3ac6528079c713c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.331+0000 7fef0bfff700 1 -- 172.21.15.8:0/1826261361 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800e070 con 0x564a47f32130 2023-10-06T23:16:14.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.332+0000 7fef0bfff700 1 -- 172.21.15.8:0/1826261361 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef1800f040 con 0x564a47f32130 2023-10-06T23:16:14.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.332+0000 7fef0bfff700 1 -- 172.21.15.8:0/1826261361 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18015b90 con 0x564a47f32130 2023-10-06T23:16:14.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.332+0000 7fef2599b700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fef0c0a1580 0x7fef0c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1826261361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32130 msgr2=0x564a47f32550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32130 0x564a47f32550 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef18009440 tx=0x7fef18009920 comp rx=0 tx=0).stop 2023-10-06T23:16:14.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1826261361 shutdown_connections 2023-10-06T23:16:14.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f33db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32130 0x564a47f32550 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1826261361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1826261361 >> 172.21.15.8:0/1826261361 conn(0x564a47ea9260 msgr2=0x564a47f30140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1826261361 shutdown_connections 2023-10-06T23:16:14.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef2599b700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fef0c0a1580 0x7fef0c0a3a40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fef1c097340 tx=0x7fef1c0d0f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.333+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1826261361 wait complete. 2023-10-06T23:16:14.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.334+0000 7fef3b5cab80 1 -- start start 2023-10-06T23:16:14.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.334+0000 7fef3b5cab80 1 Processor -- start 2023-10-06T23:16:14.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.335+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f500c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.335+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f50600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.335+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f57640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.335+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47e87e30 con 0x564a47f32130 2023-10-06T23:16:14.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.335+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47e24710 con 0x564a47f32a90 2023-10-06T23:16:14.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.335+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47e243b0 con 0x564a47f33930 2023-10-06T23:16:14.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.335+0000 7fef3b5cab80 10 client.0 _ll_register_callbacks cb 0x564a47c81800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:14.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2619c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f50600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2619c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58814/0 (socket says 172.21.15.8:58814) 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f50600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35486/0 (socket says 172.21.15.8:35486) 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2619c700 1 -- 172.21.15.8:0/1188250817 learned_addr learned my addr 172.21.15.8:0/1188250817 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2619c700 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f57640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2519a700 1 -- 172.21.15.8:0/1188250817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 msgr2=0x564a47f57640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2519a700 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f57640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2519a700 1 -- 172.21.15.8:0/1188250817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 msgr2=0x564a47f500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2519a700 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.336+0000 7fef2519a700 1 -- 172.21.15.8:0/1188250817 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef180090f0 con 0x564a47f32a90 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.337+0000 7fef2519a700 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f50600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef10012cf0 tx=0x7fef100058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=450f476047f20f2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.337+0000 7fef097fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.337+0000 7fef097fa700 1 -- 172.21.15.8:0/1188250817 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10017070 con 0x564a47f32a90 2023-10-06T23:16:14.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.337+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1188250817 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a47f27f10 con 0x564a47f32a90 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.337+0000 7fef097fa700 1 -- 172.21.15.8:0/1188250817 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fef10004050 con 0x564a47f32a90 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.337+0000 7fef097fa700 1 -- 172.21.15.8:0/1188250817 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef10022030 con 0x564a47f32a90 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.337+0000 7fef3b5cab80 10 client.25613 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.337+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1188250817 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564a47c9bc60 con 0x564a47f32a90 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.338+0000 7fef097fa700 1 -- 172.21.15.8:0/1188250817 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a47f27f10 con 0x564a47f32a90 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.338+0000 7fef097fa700 1 -- 172.21.15.8:0/1188250817 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fef10003680 con 0x564a47f32a90 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.338+0000 7fef3b5cab80 10 client.25613 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.338+0000 7fef3b5cab80 10 client.25613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:14.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.338+0000 7fef3b5cab80 20 client.25613 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:14.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.338+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564a47f5bea0 0x564a47f5e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.338+0000 7fef3b5cab80 4 client.25613 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:16:14.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.338+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1188250817 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a47e80e10 con 0x564a47f5bea0 2023-10-06T23:16:14.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.339+0000 7fef2619c700 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564a47f5bea0 0x564a47f5e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.339+0000 7fef2619c700 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564a47f5bea0 0x564a47f5e2c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa8ab6b7c79b73aa server_cookie=f38f7d7ad4b40286 in_seq=0 out_seq=0 2023-10-06T23:16:14.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.339+0000 7fef097fa700 10 client.25613 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:14.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.340+0000 7fef097fa700 1 -- 172.21.15.8:0/1188250817 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564a47e80e10 con 0x564a47f5bea0 2023-10-06T23:16:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.340+0000 7fef097fa700 10 client.25613 handle_command_reply: tid=0 2023-10-06T23:16:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.340+0000 7fef3b5cab80 1 client.25613 shutdown 2023-10-06T23:16:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.340+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1188250817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 msgr2=0x564a47f50600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.340+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f50600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef10012cf0 tx=0x7fef100058e0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1188250817 shutdown_connections 2023-10-06T23:16:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564a47f5bea0 0x564a47f5e2c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f57640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1188250817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f50600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef097fa700 0 client.25613 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:14.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1188250817 >> 172.21.15.8:0/1188250817 conn(0x564a47ea9260 msgr2=0x564a47f2ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1188250817 shutdown_connections 2023-10-06T23:16:14.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1188250817 wait complete. 2023-10-06T23:16:14.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.341+0000 7fef3b5cab80 20 client.25613 trim_cache size 0 max 16384 2023-10-06T23:16:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef3b5cab80 1 Processor -- start 2023-10-06T23:16:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef3b5cab80 1 -- start start 2023-10-06T23:16:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f32130 0x564a47f4eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f57600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f33930 0x564a47f57f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47d08920 con 0x564a47f32a90 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47f592b0 con 0x564a47f33930 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47f31d70 con 0x564a47f32130 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef2519a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.366+0000 7fef2619c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f32130 0x564a47f4eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f32130 0x564a47f4eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37352/0 (socket says 172.21.15.8:37352) 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 -- 172.21.15.8:0/1395370140 learned_addr learned my addr 172.21.15.8:0/1395370140 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f33930 0x564a47f57f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 -- 172.21.15.8:0/1395370140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f33930 msgr2=0x564a47f57f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f33930 0x564a47f57f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 -- 172.21.15.8:0/1395370140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 msgr2=0x564a47f57600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f57600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 -- 172.21.15.8:0/1395370140 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a47cd9250 con 0x564a47f32130 2023-10-06T23:16:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2519a700 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f57600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.367+0000 7fef2619c700 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f32130 0x564a47f4eed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef180093e0 tx=0x7fef1800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77e0086b4b1334c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef14bff700 1 -- 172.21.15.8:0/1395370140 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800e070 con 0x564a47f32130 2023-10-06T23:16:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef14bff700 1 -- 172.21.15.8:0/1395370140 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef1802bcb0 con 0x564a47f32130 2023-10-06T23:16:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef14bff700 1 -- 172.21.15.8:0/1395370140 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18013840 con 0x564a47f32130 2023-10-06T23:16:14.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1395370140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f32130 msgr2=0x564a47f4eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f32130 0x564a47f4eed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef180093e0 tx=0x7fef1800b040 comp rx=0 tx=0).stop 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1395370140 shutdown_connections 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f33930 0x564a47f57f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f32130 0x564a47f4eed0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.368+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/1395370140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32a90 0x564a47f57600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.369+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1395370140 >> 172.21.15.8:0/1395370140 conn(0x564a47ea9260 msgr2=0x564a47f62c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.369+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1395370140 shutdown_connections 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.369+0000 7fef3b5cab80 1 -- 172.21.15.8:0/1395370140 wait complete. 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.369+0000 7fef3b5cab80 1 -- start start 2023-10-06T23:16:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.370+0000 7fef3b5cab80 1 Processor -- start 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.370+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f56e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.370+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.370+0000 7fef3b5cab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f53910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.370+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47f53e90 con 0x564a47f32130 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.370+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47f54000 con 0x564a47f32a90 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.370+0000 7fef3b5cab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a47f541c0 con 0x564a47f33930 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.370+0000 7fef3b5cab80 10 client.0 _ll_register_callbacks cb 0x7fef100127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35502/0 (socket says 172.21.15.8:35502) 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2519a700 1 -- 172.21.15.8:0/4185902312 learned_addr learned my addr 172.21.15.8:0/4185902312 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2619c700 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f53910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2619c700 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f56e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2519a700 1 -- 172.21.15.8:0/4185902312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 msgr2=0x564a47f53910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2519a700 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f53910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2519a700 1 -- 172.21.15.8:0/4185902312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 msgr2=0x564a47f56e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2519a700 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f56e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2519a700 1 -- 172.21.15.8:0/4185902312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a47c9bc60 con 0x564a47f32a90 2023-10-06T23:16:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.371+0000 7fef2619c700 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f53910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:16:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.372+0000 7fef2519a700 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f573b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fef100039e0 tx=0x7fef10009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e0a251b9fecd108 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.372+0000 7fef097fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:16:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.372+0000 7fef097fa700 1 -- 172.21.15.8:0/4185902312 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10022040 con 0x564a47f32a90 2023-10-06T23:16:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.372+0000 7fef097fa700 1 -- 172.21.15.8:0/4185902312 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fef10023070 con 0x564a47f32a90 2023-10-06T23:16:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.372+0000 7fef3b5cab80 1 -- 172.21.15.8:0/4185902312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef1800f040 con 0x564a47f32a90 2023-10-06T23:16:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.372+0000 7fef097fa700 1 -- 172.21.15.8:0/4185902312 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef10017040 con 0x564a47f32a90 2023-10-06T23:16:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef3b5cab80 10 client.25619 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef3b5cab80 1 -- 172.21.15.8:0/4185902312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fef1802b040 con 0x564a47f32a90 2023-10-06T23:16:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef097fa700 1 -- 172.21.15.8:0/4185902312 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef1800f040 con 0x564a47f32a90 2023-10-06T23:16:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef097fa700 1 -- 172.21.15.8:0/4185902312 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fef10010430 con 0x564a47f32a90 2023-10-06T23:16:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef3b5cab80 10 client.25619 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef3b5cab80 10 client.25619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef3b5cab80 20 client.25619 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564a47fb1210 0x564a47fb3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef3b5cab80 4 client.25619 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:16:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.373+0000 7fef3b5cab80 1 -- 172.21.15.8:0/4185902312 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564a47e80b30 con 0x564a47fb1210 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.374+0000 7fef2619c700 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564a47fb1210 0x564a47fb3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.374+0000 7fef2619c700 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564a47fb1210 0x564a47fb3630 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c717baf8b2d92d server_cookie=bbd856140097eba7 in_seq=0 out_seq=0 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.374+0000 7fef097fa700 10 client.25619 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef097fa700 1 -- 172.21.15.8:0/4185902312 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564a47e80b30 con 0x564a47fb1210 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef097fa700 10 client.25619 handle_command_reply: tid=0 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 client.25619 shutdown 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 -- 172.21.15.8:0/4185902312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 msgr2=0x564a47f573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f573b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fef100039e0 tx=0x7fef10009f80 comp rx=0 tx=0).stop 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 -- 172.21.15.8:0/4185902312 shutdown_connections 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564a47fb1210 0x564a47fb3630 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a47f32130 0x564a47f56e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564a47f33930 0x564a47f53910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef097fa700 0 client.25619 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 --2- 172.21.15.8:0/4185902312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a47f32a90 0x564a47f573b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.375+0000 7fef3b5cab80 1 -- 172.21.15.8:0/4185902312 >> 172.21.15.8:0/4185902312 conn(0x564a47ea9260 msgr2=0x564a47f4e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.376+0000 7fef3b5cab80 1 -- 172.21.15.8:0/4185902312 shutdown_connections 2023-10-06T23:16:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.376+0000 7fef3b5cab80 1 -- 172.21.15.8:0/4185902312 wait complete. 2023-10-06T23:16:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.376+0000 7fef3b5cab80 20 client.25619 trim_cache size 0 max 16384 2023-10-06T23:16:14.383 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:16:14.383 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:16:14.384 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:16:14.384 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:16:14.384 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:16:14.384 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:16:14.384 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:16:14.384 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:16:14.384 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:16:14.385 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:16:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 -- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fef0c0a1580 msgr2=0x7fef0c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fef0c0a1580 0x7fef0c0a3a40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fef1c097340 tx=0x7fef1c0d0f90 comp rx=0 tx=0).stop 2023-10-06T23:16:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 -- 172.21.15.8:0/424299371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef20100f40 msgr2=0x7fef2006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef20100f40 0x7fef2006e6f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009fd0 tx=0x7fef1c00b500 comp rx=0 tx=0).stop 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 -- 172.21.15.8:0/424299371 shutdown_connections 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fef0c0a1580 0x7fef0c0a3a40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef20102a50 0x7fef20071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef20100f40 0x7fef2006e6f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 --2- 172.21.15.8:0/424299371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef20102090 0x7fef2006ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 -- 172.21.15.8:0/424299371 >> 172.21.15.8:0/424299371 conn(0x7fef200fc4d0 msgr2=0x7fef200fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.377+0000 7fef27bff700 1 -- 172.21.15.8:0/424299371 shutdown_connections 2023-10-06T23:16:14.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:14.378+0000 7fef27bff700 1 -- 172.21.15.8:0/424299371 wait complete. 2023-10-06T23:16:14.403 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:16:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.735+0000 7f6e135ff700 1 -- 172.21.15.8:0/1620965887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c100eb0 msgr2=0x7f6e0c1012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.735+0000 7f6e135ff700 1 --2- 172.21.15.8:0/1620965887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c100eb0 0x7f6e0c1012d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009990 tx=0x7f6e08009ca0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.736+0000 7f6e135ff700 1 -- 172.21.15.8:0/1620965887 shutdown_connections 2023-10-06T23:16:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.736+0000 7f6e135ff700 1 --2- 172.21.15.8:0/1620965887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e0c102a50 0x7f6e0c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.736+0000 7f6e135ff700 1 --2- 172.21.15.8:0/1620965887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c100eb0 0x7f6e0c1012d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.736+0000 7f6e135ff700 1 --2- 172.21.15.8:0/1620965887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e0c102090 0x7f6e0c102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.736+0000 7f6e135ff700 1 -- 172.21.15.8:0/1620965887 >> 172.21.15.8:0/1620965887 conn(0x7f6e0c0fc430 msgr2=0x7f6e0c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.736+0000 7f6e135ff700 1 -- 172.21.15.8:0/1620965887 shutdown_connections 2023-10-06T23:16:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.736+0000 7f6e135ff700 1 -- 172.21.15.8:0/1620965887 wait complete. 2023-10-06T23:16:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.737+0000 7f6e135ff700 1 Processor -- start 2023-10-06T23:16:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.737+0000 7f6e135ff700 1 -- start start 2023-10-06T23:16:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e135ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e0c100eb0 0x7f6e0c198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e135ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c102090 0x7f6e0c199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e135ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e0c102a50 0x7f6e0c19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e135ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c19a860 con 0x7f6e0c100eb0 2023-10-06T23:16:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e135ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c19a9d0 con 0x7f6e0c102a50 2023-10-06T23:16:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e135ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c19ab90 con 0x7f6e0c102090 2023-10-06T23:16:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e11b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e0c102a50 0x7f6e0c19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e10b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c102090 0x7f6e0c199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e11b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e0c102a50 0x7f6e0c19a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35510/0 (socket says 172.21.15.8:35510) 2023-10-06T23:16:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e11b9c700 1 -- 172.21.15.8:0/4583340 learned_addr learned my addr 172.21.15.8:0/4583340 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.738+0000 7f6e1139b700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e0c100eb0 0x7f6e0c198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e10b9a700 1 -- 172.21.15.8:0/4583340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e0c102a50 msgr2=0x7f6e0c19a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e0c102a50 0x7f6e0c19a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e10b9a700 1 -- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e0c100eb0 msgr2=0x7f6e0c198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e0c100eb0 0x7f6e0c198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e10b9a700 1 -- 172.21.15.8:0/4583340 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc009520 con 0x7f6e0c102090 2023-10-06T23:16:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c102090 0x7f6e0c199420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00e9c0 tx=0x7f6dfc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e027fc700 1 -- 172.21.15.8:0/4583340 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc00cb70 con 0x7f6e0c102090 2023-10-06T23:16:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e027fc700 1 -- 172.21.15.8:0/4583340 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6dfc00ee60 con 0x7f6e0c102090 2023-10-06T23:16:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.739+0000 7f6e027fc700 1 -- 172.21.15.8:0/4583340 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc018680 con 0x7f6e0c102090 2023-10-06T23:16:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.740+0000 7f6e135ff700 1 -- 172.21.15.8:0/4583340 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e080095f0 con 0x7f6e0c102090 2023-10-06T23:16:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.740+0000 7f6e135ff700 1 -- 172.21.15.8:0/4583340 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c19afc0 con 0x7f6e0c102090 2023-10-06T23:16:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.746+0000 7f6e027fc700 1 -- 172.21.15.8:0/4583340 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6dfc010430 con 0x7f6e0c102090 2023-10-06T23:16:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.746+0000 7f6e26f22b80 1 Processor -- start 2023-10-06T23:16:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.747+0000 7f6e26f22b80 1 -- start start 2023-10-06T23:16:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.747+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae51e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.747+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51efd0 0x55f5ae51f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.747+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51f990 0x55f5ae526220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.747+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae486400 con 0x55f5ae51efd0 2023-10-06T23:16:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.747+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae477bc0 con 0x55f5ae51f990 2023-10-06T23:16:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.747+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae4754e0 con 0x55f5ae51dec0 2023-10-06T23:16:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.748+0000 7f6e11b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae51e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.748+0000 7f6e11b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae51e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37384/0 (socket says 172.21.15.8:37384) 2023-10-06T23:16:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.748+0000 7f6e11b9c700 1 -- 172.21.15.8:0/3601198184 learned_addr learned my addr 172.21.15.8:0/3601198184 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.748+0000 7f6e1139b700 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51efd0 0x55f5ae51f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.748+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51f990 0x55f5ae526220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e11b9c700 1 -- 172.21.15.8:0/3601198184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51f990 msgr2=0x55f5ae526220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51f990 0x55f5ae526220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e11b9c700 1 -- 172.21.15.8:0/3601198184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51efd0 msgr2=0x55f5ae51f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51efd0 0x55f5ae51f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e11b9c700 1 -- 172.21.15.8:0/3601198184 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5ae29bd80 con 0x55f5ae51dec0 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e1139b700 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51efd0 0x55f5ae51f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e027fc700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6df80a1480 0x7f6df80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e027fc700 1 -- 172.21.15.8:0/4583340 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6dfc014070 con 0x7f6e0c102090 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae51e2e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400e5e0 tx=0x7f6e04009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfae62b244ed449e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.749+0000 7f6e1139b700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6df80a1480 0x7f6df80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.750+0000 7f6df77fe700 1 -- 172.21.15.8:0/3601198184 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400e040 con 0x55f5ae51dec0 2023-10-06T23:16:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.750+0000 7f6df77fe700 1 -- 172.21.15.8:0/3601198184 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e0400f040 con 0x55f5ae51dec0 2023-10-06T23:16:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.750+0000 7f6df77fe700 1 -- 172.21.15.8:0/3601198184 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04004530 con 0x55f5ae51dec0 2023-10-06T23:16:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3601198184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 msgr2=0x55f5ae51e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae51e2e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400e5e0 tx=0x7f6e04009920 comp rx=0 tx=0).stop 2023-10-06T23:16:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e1139b700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6df80a1480 0x7f6df80a3940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e080098e0 tx=0x7f6e0800b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3601198184 shutdown_connections 2023-10-06T23:16:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51f990 0x55f5ae526220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae51e2e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3601198184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51efd0 0x55f5ae51f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3601198184 >> 172.21.15.8:0/3601198184 conn(0x55f5ae492200 msgr2=0x55f5ae518bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3601198184 shutdown_connections 2023-10-06T23:16:14.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.751+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3601198184 wait complete. 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.752+0000 7f6e26f22b80 1 -- start start 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.752+0000 7f6e26f22b80 1 Processor -- start 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.752+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51dec0 0x55f5ae527b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.752+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51efd0 0x55f5ae5280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.752+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae52f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.752+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae470dd0 con 0x55f5ae51f990 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.752+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae40d6b0 con 0x55f5ae51dec0 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.752+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae40d350 con 0x55f5ae51efd0 2023-10-06T23:16:14.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.753+0000 7f6e26f22b80 10 client.0 _ll_register_callbacks cb 0x55f5ae26a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.753+0000 7f6e11b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae52f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.753+0000 7f6e1139b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51dec0 0x55f5ae527b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.753+0000 7f6e11b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae52f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58876/0 (socket says 172.21.15.8:58876) 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.753+0000 7f6e11b9c700 1 -- 172.21.15.8:0/1713326897 learned_addr learned my addr 172.21.15.8:0/1713326897 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.753+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51efd0 0x55f5ae5280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.754+0000 7f6e1139b700 1 -- 172.21.15.8:0/1713326897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51efd0 msgr2=0x55f5ae5280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.754+0000 7f6e1139b700 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51efd0 0x55f5ae5280c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.754+0000 7f6e1139b700 1 -- 172.21.15.8:0/1713326897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 msgr2=0x55f5ae52f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.754+0000 7f6e1139b700 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae52f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.754+0000 7f6e1139b700 1 -- 172.21.15.8:0/1713326897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c109ca0 con 0x55f5ae51dec0 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.754+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae52f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.754+0000 7f6e1139b700 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51dec0 0x55f5ae527b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e08003f60 tx=0x7f6e08009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3f6d0c5d244300 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.754+0000 7f6df4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:16:14.758 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.755+0000 7f6df4ff9700 1 -- 172.21.15.8:0/1713326897 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800be80 con 0x55f5ae51dec0 2023-10-06T23:16:14.758 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.755+0000 7f6df4ff9700 1 -- 172.21.15.8:0/1713326897 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e08004500 con 0x55f5ae51dec0 2023-10-06T23:16:14.758 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.755+0000 7f6e26f22b80 1 -- 172.21.15.8:0/1713326897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5ae510d50 con 0x55f5ae51dec0 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.755+0000 7f6df4ff9700 1 -- 172.21.15.8:0/1713326897 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e08003d80 con 0x55f5ae51dec0 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.755+0000 7f6e26f22b80 10 client.25631 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.755+0000 7f6e26f22b80 1 -- 172.21.15.8:0/1713326897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f6e0400e2c0 con 0x55f5ae51dec0 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.756+0000 7f6df4ff9700 1 -- 172.21.15.8:0/1713326897 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f5ae510d50 con 0x55f5ae51dec0 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.756+0000 7f6df4ff9700 1 -- 172.21.15.8:0/1713326897 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6e080266c0 con 0x55f5ae51dec0 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.756+0000 7f6e26f22b80 10 client.25631 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.756+0000 7f6e26f22b80 10 client.25631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.756+0000 7f6e26f22b80 20 client.25631 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.756+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f5ae533810 0x55f5ae535c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.756+0000 7f6e26f22b80 4 client.25631 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:16:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.756+0000 7f6e26f22b80 1 -- 172.21.15.8:0/1713326897 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5ae469db0 con 0x55f5ae533810 2023-10-06T23:16:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.757+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f5ae533810 0x55f5ae535c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.757+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f5ae533810 0x55f5ae535c30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=320aaee0ee9466ab server_cookie=ed50e7d8000a5200 in_seq=0 out_seq=0 2023-10-06T23:16:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.757+0000 7f6df4ff9700 10 client.25631 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.758+0000 7f6df4ff9700 1 -- 172.21.15.8:0/1713326897 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f5ae469db0 con 0x55f5ae533810 2023-10-06T23:16:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.758+0000 7f6df4ff9700 10 client.25631 handle_command_reply: tid=0 2023-10-06T23:16:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.758+0000 7f6e26f22b80 1 client.25631 shutdown 2023-10-06T23:16:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 -- 172.21.15.8:0/1713326897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51dec0 msgr2=0x55f5ae527b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51dec0 0x55f5ae527b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e08003f60 tx=0x7f6e08009310 comp rx=0 tx=0).stop 2023-10-06T23:16:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 -- 172.21.15.8:0/1713326897 shutdown_connections 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f5ae533810 0x55f5ae535c30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae52f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51dec0 0x55f5ae527b80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6df4ff9700 0 client.25631 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/1713326897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51efd0 0x55f5ae5280c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 -- 172.21.15.8:0/1713326897 >> 172.21.15.8:0/1713326897 conn(0x55f5ae492200 msgr2=0x55f5ae518250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 -- 172.21.15.8:0/1713326897 shutdown_connections 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.759+0000 7f6e26f22b80 1 -- 172.21.15.8:0/1713326897 wait complete. 2023-10-06T23:16:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.760+0000 7f6e26f22b80 20 client.25631 trim_cache size 0 max 16384 2023-10-06T23:16:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.782+0000 7f6e26f22b80 1 Processor -- start 2023-10-06T23:16:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.782+0000 7f6e26f22b80 1 -- start start 2023-10-06T23:16:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.783+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae519aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.783+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.783+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae518b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.783+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae2f18c0 con 0x55f5ae51f990 2023-10-06T23:16:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.783+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae522450 con 0x55f5ae51efd0 2023-10-06T23:16:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.783+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae5276f0 con 0x55f5ae51dec0 2023-10-06T23:16:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.783+0000 7f6e1139b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae519aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e10b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e1139b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae519aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37394/0 (socket says 172.21.15.8:37394) 2023-10-06T23:16:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e1139b700 1 -- 172.21.15.8:0/3793069331 learned_addr learned my addr 172.21.15.8:0/3793069331 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae518b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e10b9a700 1 -- 172.21.15.8:0/3793069331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 msgr2=0x55f5ae519aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae519aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e10b9a700 1 -- 172.21.15.8:0/3793069331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 msgr2=0x55f5ae518b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae518b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e10b9a700 1 -- 172.21.15.8:0/3793069331 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5ae284c00 con 0x55f5ae51efd0 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae518b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e1139b700 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae519aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.784+0000 7f6e10b9a700 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52f0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0caba0 tx=0x7f6dfc0d0920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd8618d3877acaf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.785+0000 7f6df7fff700 1 -- 172.21.15.8:0/3793069331 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc09a140 con 0x55f5ae51efd0 2023-10-06T23:16:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.785+0000 7f6df7fff700 1 -- 172.21.15.8:0/3793069331 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6dfc099eb0 con 0x55f5ae51efd0 2023-10-06T23:16:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.785+0000 7f6df7fff700 1 -- 172.21.15.8:0/3793069331 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc09e4c0 con 0x55f5ae51efd0 2023-10-06T23:16:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3793069331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 msgr2=0x55f5ae52f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52f0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0caba0 tx=0x7f6dfc0d0920 comp rx=0 tx=0).stop 2023-10-06T23:16:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3793069331 shutdown_connections 2023-10-06T23:16:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51f990 0x55f5ae518b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51dec0 0x55f5ae519aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3793069331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52f0c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3793069331 >> 172.21.15.8:0/3793069331 conn(0x55f5ae492200 msgr2=0x55f5ae5268d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3793069331 shutdown_connections 2023-10-06T23:16:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.786+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3793069331 wait complete. 2023-10-06T23:16:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.787+0000 7f6e26f22b80 1 -- start start 2023-10-06T23:16:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.787+0000 7f6e26f22b80 1 Processor -- start 2023-10-06T23:16:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51dec0 0x55f5ae52cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e26f22b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51f990 0x55f5ae52e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae52e7c0 con 0x55f5ae51dec0 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae52e930 con 0x55f5ae51efd0 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e26f22b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5ae52eaf0 con 0x55f5ae51f990 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e26f22b80 10 client.0 _ll_register_callbacks cb 0x7f6e08003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e10b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e10b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35540/0 (socket says 172.21.15.8:35540) 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e10b9a700 1 -- 172.21.15.8:0/3488102512 learned_addr learned my addr 172.21.15.8:0/3488102512 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.788+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51f990 0x55f5ae52e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.789+0000 7f6e1139b700 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51dec0 0x55f5ae52cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.789+0000 7f6e11b9c700 1 -- 172.21.15.8:0/3488102512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 msgr2=0x55f5ae52d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.789+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.789+0000 7f6e11b9c700 1 -- 172.21.15.8:0/3488102512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51dec0 msgr2=0x55f5ae52cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:14.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.789+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51dec0 0x55f5ae52cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.789+0000 7f6e11b9c700 1 -- 172.21.15.8:0/3488102512 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0400e2c0 con 0x55f5ae51f990 2023-10-06T23:16:14.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.789+0000 7f6e1139b700 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51dec0 0x55f5ae52cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.790+0000 7f6e11b9c700 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51f990 0x55f5ae52e280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009c10 tx=0x7f6e04005440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c505c292e63e906e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.790+0000 7f6df4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.790+0000 7f6df4ff9700 1 -- 172.21.15.8:0/3488102512 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400e040 con 0x55f5ae51f990 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.790+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3488102512 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e0400f040 con 0x55f5ae51f990 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.790+0000 7f6df4ff9700 1 -- 172.21.15.8:0/3488102512 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e04009350 con 0x55f5ae51f990 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.790+0000 7f6df4ff9700 1 -- 172.21.15.8:0/3488102512 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e0402e030 con 0x55f5ae51f990 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6e26f22b80 10 client.25684 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3488102512 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f6e0c19afc0 con 0x55f5ae51f990 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6df4ff9700 1 -- 172.21.15.8:0/3488102512 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e0400f040 con 0x55f5ae51f990 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6df4ff9700 1 -- 172.21.15.8:0/3488102512 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6e04028480 con 0x55f5ae51f990 2023-10-06T23:16:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6e26f22b80 10 client.25684 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:14.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6e26f22b80 10 client.25684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:14.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6e26f22b80 20 client.25684 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:14.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f5ae5883d0 0x55f5ae58a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:14.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6e26f22b80 4 client.25684 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:16:14.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.791+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3488102512 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f5ae469ad0 con 0x55f5ae5883d0 2023-10-06T23:16:14.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.792+0000 7f6e1139b700 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f5ae5883d0 0x55f5ae58a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:14.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.793+0000 7f6df4ff9700 10 client.25684 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:14.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.793+0000 7f6e1139b700 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f5ae5883d0 0x55f5ae58a7f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e88a1d07e4d3b36 server_cookie=80514caeb1c2d8f in_seq=0 out_seq=0 2023-10-06T23:16:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.806+0000 7f6df4ff9700 1 -- 172.21.15.8:0/3488102512 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f5ae469ad0 con 0x55f5ae5883d0 2023-10-06T23:16:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.806+0000 7f6df4ff9700 10 client.25684 handle_command_reply: tid=0 2023-10-06T23:16:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.806+0000 7f6e26f22b80 1 client.25684 shutdown 2023-10-06T23:16:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3488102512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51f990 msgr2=0x55f5ae52e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51f990 0x55f5ae52e280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009c10 tx=0x7f6e04005440 comp rx=0 tx=0).stop 2023-10-06T23:16:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3488102512 shutdown_connections 2023-10-06T23:16:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f5ae5883d0 0x55f5ae58a7f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f5ae51dec0 0x55f5ae52cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5ae51f990 0x55f5ae52e280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 --2- 172.21.15.8:0/3488102512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5ae51efd0 0x55f5ae52d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3488102512 >> 172.21.15.8:0/3488102512 conn(0x55f5ae492200 msgr2=0x55f5ae5198b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6df4ff9700 0 client.25684 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3488102512 shutdown_connections 2023-10-06T23:16:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 1 -- 172.21.15.8:0/3488102512 wait complete. 2023-10-06T23:16:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:16:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:16:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:16:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.807+0000 7f6e26f22b80 20 client.25684 trim_cache size 0 max 16384 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 -- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6df80a1480 msgr2=0x7f6df80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6df80a1480 0x7f6df80a3940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e080098e0 tx=0x7f6e0800b260 comp rx=0 tx=0).stop 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 -- 172.21.15.8:0/4583340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c102090 msgr2=0x7f6e0c199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c102090 0x7f6e0c199420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00e9c0 tx=0x7f6dfc00ecd0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 -- 172.21.15.8:0/4583340 shutdown_connections 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6df80a1480 0x7f6df80a3940 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e0c100eb0 0x7f6e0c198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e0c102a50 0x7f6e0c19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 --2- 172.21.15.8:0/4583340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e0c102090 0x7f6e0c199420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.808+0000 7f6e135ff700 1 -- 172.21.15.8:0/4583340 >> 172.21.15.8:0/4583340 conn(0x7f6e0c0fc430 msgr2=0x7f6e0c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.809+0000 7f6e135ff700 1 -- 172.21.15.8:0/4583340 shutdown_connections 2023-10-06T23:16:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:14.809+0000 7f6e135ff700 1 -- 172.21.15.8:0/4583340 wait complete. 2023-10-06T23:16:16.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:16 smithi156 ceph-mon[102862]: pgmap v451: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 6.4 MiB/s wr, 559 op/s 2023-10-06T23:16:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:16 smithi008 ceph-mon[98532]: pgmap v451: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 6.4 MiB/s wr, 559 op/s 2023-10-06T23:16:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:16 smithi190 ceph-mon[102658]: pgmap v451: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 6.4 MiB/s wr, 559 op/s 2023-10-06T23:16:18.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:18 smithi156 ceph-mon[102862]: pgmap v452: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 6.6 MiB/s wr, 521 op/s 2023-10-06T23:16:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:18 smithi008 ceph-mon[98532]: pgmap v452: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 6.6 MiB/s wr, 521 op/s 2023-10-06T23:16:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:18 smithi190 ceph-mon[102658]: pgmap v452: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 6.6 MiB/s wr, 521 op/s 2023-10-06T23:16:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 85.0 s, 220.8 tps, lat 448.993 ms stddev 236.925 2023-10-06T23:16:20.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:20 smithi156 ceph-mon[102862]: pgmap v453: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.8 MiB/s wr, 500 op/s 2023-10-06T23:16:20.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:20 smithi008 ceph-mon[98532]: pgmap v453: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.8 MiB/s wr, 500 op/s 2023-10-06T23:16:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:20 smithi190 ceph-mon[102658]: pgmap v453: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.8 MiB/s wr, 500 op/s 2023-10-06T23:16:22.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:22 smithi156 ceph-mon[102862]: pgmap v454: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 5.9 MiB/s wr, 519 op/s 2023-10-06T23:16:22.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:22 smithi008 ceph-mon[98532]: pgmap v454: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 5.9 MiB/s wr, 519 op/s 2023-10-06T23:16:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:22 smithi190 ceph-mon[102658]: pgmap v454: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 5.9 MiB/s wr, 519 op/s 2023-10-06T23:16:23.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:23 smithi156 ceph-mon[102862]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.1 MiB/s wr, 507 op/s 2023-10-06T23:16:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:23 smithi008 ceph-mon[98532]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.1 MiB/s wr, 507 op/s 2023-10-06T23:16:23.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:23 smithi190 ceph-mon[102658]: pgmap v455: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.1 MiB/s wr, 507 op/s 2023-10-06T23:16:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 90.0 s, 264.2 tps, lat 384.220 ms stddev 85.643 2023-10-06T23:16:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:26 smithi156 ceph-mon[102862]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 6.4 MiB/s wr, 564 op/s 2023-10-06T23:16:26.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:26 smithi008 ceph-mon[98532]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 6.4 MiB/s wr, 564 op/s 2023-10-06T23:16:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:26 smithi190 ceph-mon[102658]: pgmap v456: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 6.4 MiB/s wr, 564 op/s 2023-10-06T23:16:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.010+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/509262428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8810d4d0 msgr2=0x7fdd8810f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.010+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/509262428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8810d4d0 0x7fdd8810f8c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000b0a0 tx=0x7fdd8000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.011+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/509262428 shutdown_connections 2023-10-06T23:16:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.011+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/509262428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd8810d4d0 0x7fdd8810f8c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.011+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/509262428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd88074ef0 0x7fdd88073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.011+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/509262428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd88073910 0x7fdd88073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.011+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/509262428 >> 172.21.15.8:0/509262428 conn(0x7fdd880fc430 msgr2=0x7fdd880fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.011+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/509262428 shutdown_connections 2023-10-06T23:16:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.011+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/509262428 wait complete. 2023-10-06T23:16:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.012+0000 7fdd8f5ff700 1 Processor -- start 2023-10-06T23:16:28.014 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8f5ff700 1 -- start start 2023-10-06T23:16:28.015 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8f5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd88073910 0x7fdd8806f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.015 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8f5ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd88074ef0 0x7fdd8806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.015 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8f5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8810d4d0 0x7fdd88070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.015 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8f5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880713e0 con 0x7fdd88073910 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8f5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88071550 con 0x7fdd8810d4d0 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8f5ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88071710 con 0x7fdd88074ef0 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8d39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd88073910 0x7fdd8806f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8d39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd88073910 0x7fdd8806f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34904/0 (socket says 172.21.15.8:34904) 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8d39b700 1 -- 172.21.15.8:0/2556186319 learned_addr learned my addr 172.21.15.8:0/2556186319 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.013+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd88074ef0 0x7fdd8806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.014+0000 7fdd8db9c700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8810d4d0 0x7fdd88070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.014+0000 7fdd8d39b700 1 -- 172.21.15.8:0/2556186319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd88074ef0 msgr2=0x7fdd8806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.014+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd88074ef0 0x7fdd8806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.014+0000 7fdd8d39b700 1 -- 172.21.15.8:0/2556186319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8810d4d0 msgr2=0x7fdd88070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.014+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8810d4d0 0x7fdd88070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.014+0000 7fdd8d39b700 1 -- 172.21.15.8:0/2556186319 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009d00 con 0x7fdd88073910 2023-10-06T23:16:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.014+0000 7fdd8db9c700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8810d4d0 0x7fdd88070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:16:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.014+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd88073910 0x7fdd8806f970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400e9a0 tx=0x7fdd8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.015+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2556186319 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84009790 con 0x7fdd88073910 2023-10-06T23:16:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.015+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2556186319 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd8400cbd0 con 0x7fdd88073910 2023-10-06T23:16:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.015+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2556186319 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84018680 con 0x7fdd88073910 2023-10-06T23:16:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.015+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/2556186319 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd880719f0 con 0x7fdd88073910 2023-10-06T23:16:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.015+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/2556186319 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd880721a0 con 0x7fdd88073910 2023-10-06T23:16:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.019+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2556186319 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdd8400cd40 con 0x7fdd88073910 2023-10-06T23:16:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.021+0000 7fdda2e3cb80 1 Processor -- start 2023-10-06T23:16:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.021+0000 7fdda2e3cb80 1 -- start start 2023-10-06T23:16:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.021+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b5ec0 0x55624c0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.021+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0b7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.021+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0be220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.021+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c01e400 con 0x55624c0b6fd0 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.021+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c00fbc0 con 0x55624c0b5ec0 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.021+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c00d4e0 con 0x55624c0b7990 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8cb9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8db9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b5ec0 0x55624c0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8cb9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0be220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:36210/0 (socket says 172.21.15.8:36210) 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8cb9a700 1 -- 172.21.15.8:0/1780654770 learned_addr learned my addr 172.21.15.8:0/1780654770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd7e7fc700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdd740a1580 0x7fdd740a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd7e7fc700 1 -- 172.21.15.8:0/2556186319 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdd84014070 con 0x7fdd88073910 2023-10-06T23:16:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/1780654770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8cb9a700 1 -- 172.21.15.8:0/1780654770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b5ec0 msgr2=0x55624c0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/1780654770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b5ec0 0x55624c0b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8db9c700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdd740a1580 0x7fdd740a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8cb9a700 1 -- 172.21.15.8:0/1780654770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 msgr2=0x55624c0b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/1780654770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.022+0000 7fdd8cb9a700 1 -- 172.21.15.8:0/1780654770 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55624be33d80 con 0x55624c0b7990 2023-10-06T23:16:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.023+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/1780654770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0be220 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009cf0 tx=0x7fdd78011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1841c454aaa2dcf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.023+0000 7fdd737fe700 1 -- 172.21.15.8:0/1780654770 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78011d20 con 0x55624c0b7990 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.023+0000 7fdd737fe700 1 -- 172.21.15.8:0/1780654770 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd78011e80 con 0x55624c0b7990 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.023+0000 7fdd737fe700 1 -- 172.21.15.8:0/1780654770 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78005020 con 0x55624c0b7990 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.024+0000 7fdd8db9c700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdd740a1580 0x7fdd740a3a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000b780 tx=0x7fdd8000b3b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.024+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1780654770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 msgr2=0x55624c0be220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.024+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/1780654770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0be220 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009cf0 tx=0x7fdd78011440 comp rx=0 tx=0).stop 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.024+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1780654770 shutdown_connections 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.024+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/1780654770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0be220 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.024+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/1780654770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b5ec0 0x55624c0b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.024+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/1780654770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.024+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1780654770 >> 172.21.15.8:0/1780654770 conn(0x55624c02a200 msgr2=0x55624c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.025+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1780654770 shutdown_connections 2023-10-06T23:16:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.025+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1780654770 wait complete. 2023-10-06T23:16:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.025+0000 7fdda2e3cb80 1 -- start start 2023-10-06T23:16:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.026+0000 7fdda2e3cb80 1 Processor -- start 2023-10-06T23:16:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.026+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.026+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.026+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.026+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c008dd0 con 0x55624c0b5ec0 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.026+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624bfa56b0 con 0x55624c0b6fd0 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.026+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624bfa5350 con 0x55624c0b7990 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.026+0000 7fdda2e3cb80 10 client.0 _ll_register_callbacks cb 0x55624be027a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8d39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8d39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0bfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34912/0 (socket says 172.21.15.8:34912) 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8d39b700 1 -- 172.21.15.8:0/3490730977 learned_addr learned my addr 172.21.15.8:0/3490730977 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8db9c700 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8d39b700 1 -- 172.21.15.8:0/3490730977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 msgr2=0x55624c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8d39b700 1 -- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 msgr2=0x55624c0c0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8d39b700 1 -- 172.21.15.8:0/3490730977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd78009920 con 0x55624c0b5ec0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.027+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.028+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0bfc50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400c5b0 tx=0x7fdd8409a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f89f52bb656c4b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.028+0000 7fdd70ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.028+0000 7fdd70ff9700 1 -- 172.21.15.8:0/3490730977 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8409e370 con 0x55624c0b5ec0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.028+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/3490730977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55624c001db0 con 0x55624c0b5ec0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.028+0000 7fdd70ff9700 1 -- 172.21.15.8:0/3490730977 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdd8409a410 con 0x55624c0b5ec0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.028+0000 7fdd70ff9700 1 -- 172.21.15.8:0/3490730977 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd8409e560 con 0x55624c0b5ec0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.028+0000 7fdda2e3cb80 10 client.15846 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.028+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/3490730977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55624be1cc00 con 0x55624c0b5ec0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdd70ff9700 1 -- 172.21.15.8:0/3490730977 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55624c001db0 con 0x55624c0b5ec0 2023-10-06T23:16:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdd70ff9700 1 -- 172.21.15.8:0/3490730977 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fdd84096200 con 0x55624c0b5ec0 2023-10-06T23:16:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdda2e3cb80 10 client.15846 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdda2e3cb80 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdda2e3cb80 20 client.15846 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55624c0cba80 0x55624c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdda2e3cb80 4 client.15846 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:16:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/3490730977 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55624c001ad0 con 0x55624c0cba80 2023-10-06T23:16:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.029+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55624c0cba80 0x55624c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.030+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55624c0cba80 0x55624c0cdea0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e36e0129087419c server_cookie=69cf2c2d197f80c9 in_seq=0 out_seq=0 2023-10-06T23:16:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.030+0000 7fdd70ff9700 10 client.15846 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.031+0000 7fdd70ff9700 1 -- 172.21.15.8:0/3490730977 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55624c001ad0 con 0x55624c0cba80 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.031+0000 7fdd70ff9700 10 client.15846 handle_command_reply: tid=0 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.031+0000 7fdda2e3cb80 1 client.15846 shutdown 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/3490730977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 msgr2=0x55624c0bfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0bfc50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400c5b0 tx=0x7fdd8409a950 comp rx=0 tx=0).stop 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/3490730977 shutdown_connections 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55624c0cba80 0x55624c0cdea0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0bfc50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdd70ff9700 0 client.15846 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/3490730977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/3490730977 >> 172.21.15.8:0/3490730977 conn(0x55624c02a200 msgr2=0x55624c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:28.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/3490730977 shutdown_connections 2023-10-06T23:16:28.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/3490730977 wait complete. 2023-10-06T23:16:28.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.032+0000 7fdda2e3cb80 20 client.15846 trim_cache size 0 max 16384 2023-10-06T23:16:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.053+0000 7fdda2e3cb80 1 Processor -- start 2023-10-06T23:16:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.053+0000 7fdda2e3cb80 1 -- start start 2023-10-06T23:16:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b5ec0 0x55624c0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b7990 0x55624c0c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624be898c0 con 0x55624c0b6fd0 2023-10-06T23:16:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c001db0 con 0x55624c0b7990 2023-10-06T23:16:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c0bf150 con 0x55624c0b5ec0 2023-10-06T23:16:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdd8cb9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdd8d39b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b5ec0 0x55624c0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdd8d39b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b5ec0 0x55624c0b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:36228/0 (socket says 172.21.15.8:36228) 2023-10-06T23:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdd8d39b700 1 -- 172.21.15.8:0/1084488390 learned_addr learned my addr 172.21.15.8:0/1084488390 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdd8db9c700 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b7990 0x55624c0c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.054+0000 7fdd8cb9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34914/0 (socket says 172.21.15.8:34914) 2023-10-06T23:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.055+0000 7fdd8cb9a700 1 -- 172.21.15.8:0/1084488390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b5ec0 msgr2=0x55624c0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.055+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b5ec0 0x55624c0b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.055+0000 7fdd8cb9a700 1 -- 172.21.15.8:0/1084488390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b7990 msgr2=0x55624c0c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.055+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b7990 0x55624c0c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.055+0000 7fdd8cb9a700 1 -- 172.21.15.8:0/1084488390 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55624be5a1f0 con 0x55624c0b6fd0 2023-10-06T23:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.055+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b5ec0 0x55624c0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.055+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0c7190 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdd78004c60 tx=0x7fdd78005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c76d86c4b527bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.055+0000 7fdd73fff700 1 -- 172.21.15.8:0/1084488390 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78004870 con 0x55624c0b6fd0 2023-10-06T23:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.056+0000 7fdd73fff700 1 -- 172.21.15.8:0/1084488390 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd780049d0 con 0x55624c0b6fd0 2023-10-06T23:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.056+0000 7fdd73fff700 1 -- 172.21.15.8:0/1084488390 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780042a0 con 0x55624c0b6fd0 2023-10-06T23:16:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.056+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1084488390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 msgr2=0x55624c0c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0c7190 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdd78004c60 tx=0x7fdd78005fa0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1084488390 shutdown_connections 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b7990 0x55624c0c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b5ec0 0x55624c0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/1084488390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b6fd0 0x55624c0c7190 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1084488390 >> 172.21.15.8:0/1084488390 conn(0x55624c02a200 msgr2=0x55624c0be8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1084488390 shutdown_connections 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/1084488390 wait complete. 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.057+0000 7fdda2e3cb80 1 -- start start 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.058+0000 7fdda2e3cb80 1 Processor -- start 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.058+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.058+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.058+0000 7fdda2e3cb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.058+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c0c64f0 con 0x55624c0b5ec0 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.058+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c0c6660 con 0x55624c0b6fd0 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.058+0000 7fdda2e3cb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55624c0c6820 con 0x55624c0b7990 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.058+0000 7fdda2e3cb80 10 client.0 _ll_register_callbacks cb 0x7fdd8409a1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8db9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8db9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:36242/0 (socket says 172.21.15.8:36242) 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8db9c700 1 -- 172.21.15.8:0/468578349 learned_addr learned my addr 172.21.15.8:0/468578349 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8d39b700 1 -- 172.21.15.8:0/468578349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 msgr2=0x55624c0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8d39b700 1 -- 172.21.15.8:0/468578349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 msgr2=0x55624c0c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8d39b700 1 -- 172.21.15.8:0/468578349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55624be1cc00 con 0x55624c0b5ec0 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8db9c700 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd8d39b700 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0c4a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd84098760 tx=0x7fdd84096750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e75f961acbab11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.059+0000 7fdd70ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:16:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.060+0000 7fdd70ff9700 1 -- 172.21.15.8:0/468578349 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84099d70 con 0x55624c0b5ec0 2023-10-06T23:16:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.060+0000 7fdd70ff9700 1 -- 172.21.15.8:0/468578349 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdd8409a410 con 0x55624c0b5ec0 2023-10-06T23:16:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.060+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/468578349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55624c0a8d50 con 0x55624c0b5ec0 2023-10-06T23:16:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.060+0000 7fdd70ff9700 1 -- 172.21.15.8:0/468578349 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd8409e560 con 0x55624c0b5ec0 2023-10-06T23:16:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.060+0000 7fdda2e3cb80 10 client.15852 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.060+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/468578349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55624be33d80 con 0x55624c0b5ec0 2023-10-06T23:16:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.060+0000 7fdd70ff9700 1 -- 172.21.15.8:0/468578349 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55624c0a8d50 con 0x55624c0b5ec0 2023-10-06T23:16:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.061+0000 7fdd70ff9700 1 -- 172.21.15.8:0/468578349 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fdd8409f2a0 con 0x55624c0b5ec0 2023-10-06T23:16:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.061+0000 7fdda2e3cb80 10 client.15852 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.061+0000 7fdda2e3cb80 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.061+0000 7fdda2e3cb80 20 client.15852 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.061+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55624c120170 0x55624c122590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.061+0000 7fdda2e3cb80 4 client.15852 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:16:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.061+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/468578349 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55624be54f10 con 0x55624c120170 2023-10-06T23:16:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.061+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55624c120170 0x55624c122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.062+0000 7fdd8cb9a700 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55624c120170 0x55624c122590 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b98dd3d93738c4 server_cookie=18341479a588b3bf in_seq=0 out_seq=0 2023-10-06T23:16:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.062+0000 7fdd70ff9700 10 client.15852 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdd70ff9700 1 -- 172.21.15.8:0/468578349 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55624be54f10 con 0x55624c120170 2023-10-06T23:16:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdd70ff9700 10 client.15852 handle_command_reply: tid=0 2023-10-06T23:16:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 client.15852 shutdown 2023-10-06T23:16:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/468578349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 msgr2=0x55624c0c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0c4a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd84098760 tx=0x7fdd84096750 comp rx=0 tx=0).stop 2023-10-06T23:16:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/468578349 shutdown_connections 2023-10-06T23:16:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55624c120170 0x55624c122590 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55624c0b5ec0 0x55624c0c4a60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55624c0b7990 0x55624c0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 --2- 172.21.15.8:0/468578349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55624c0b6fd0 0x55624c0c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/468578349 >> 172.21.15.8:0/468578349 conn(0x55624c02a200 msgr2=0x55624c0b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.080+0000 7fdd70ff9700 0 client.15852 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.081+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/468578349 shutdown_connections 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.081+0000 7fdda2e3cb80 1 -- 172.21.15.8:0/468578349 wait complete. 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.081+0000 7fdda2e3cb80 20 client.15852 trim_cache size 0 max 16384 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:16:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:16:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdd740a1580 msgr2=0x7fdd740a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdd740a1580 0x7fdd740a3a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000b780 tx=0x7fdd8000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd88073910 msgr2=0x7fdd8806f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd88073910 0x7fdd8806f970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400e9a0 tx=0x7fdd8400ecb0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/2556186319 shutdown_connections 2023-10-06T23:16:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fdd740a1580 0x7fdd740a3a40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd88073910 0x7fdd8806f970 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd8810d4d0 0x7fdd88070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 --2- 172.21.15.8:0/2556186319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd88074ef0 0x7fdd8806feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/2556186319 >> 172.21.15.8:0/2556186319 conn(0x7fdd880fc430 msgr2=0x7fdd880fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/2556186319 shutdown_connections 2023-10-06T23:16:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:28.082+0000 7fdd8f5ff700 1 -- 172.21.15.8:0/2556186319 wait complete. 2023-10-06T23:16:28.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:28 smithi156 ceph-mon[102862]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 6.3 MiB/s wr, 542 op/s 2023-10-06T23:16:28.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:28 smithi008 ceph-mon[98532]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 6.3 MiB/s wr, 542 op/s 2023-10-06T23:16:28.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:28 smithi190 ceph-mon[102658]: pgmap v457: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 6.3 MiB/s wr, 542 op/s 2023-10-06T23:16:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 95.0 s, 197.0 tps, lat 424.672 ms stddev 140.917 2023-10-06T23:16:30.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:30 smithi156 ceph-mon[102862]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-06T23:16:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:30 smithi008 ceph-mon[98532]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-06T23:16:30.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:30 smithi190 ceph-mon[102658]: pgmap v458: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-06T23:16:32.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:32 smithi156 ceph-mon[102862]: pgmap v459: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 5.9 MiB/s wr, 546 op/s 2023-10-06T23:16:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:32 smithi008 ceph-mon[98532]: pgmap v459: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 5.9 MiB/s wr, 546 op/s 2023-10-06T23:16:32.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:32 smithi190 ceph-mon[102658]: pgmap v459: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 5.9 MiB/s wr, 546 op/s 2023-10-06T23:16:33.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:33 smithi156 ceph-mon[102862]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 6.2 MiB/s wr, 555 op/s 2023-10-06T23:16:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:33 smithi008 ceph-mon[98532]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 6.2 MiB/s wr, 555 op/s 2023-10-06T23:16:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:33 smithi190 ceph-mon[102658]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 6.2 MiB/s wr, 555 op/s 2023-10-06T23:16:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 100.0 s, 266.4 tps, lat 425.136 ms stddev 221.778 2023-10-06T23:16:36.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:36 smithi156 ceph-mon[102862]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 6.5 MiB/s wr, 583 op/s 2023-10-06T23:16:36.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:36 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:16:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:36 smithi008 ceph-mon[98532]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 6.5 MiB/s wr, 583 op/s 2023-10-06T23:16:36.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:36 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:16:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:36 smithi190 ceph-mon[102658]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 6.5 MiB/s wr, 583 op/s 2023-10-06T23:16:36.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:36 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:16:37.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:16:37.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:16:37.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:16:37.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:16:37.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:16:37.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:16:37.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:16:37.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:16:37.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:16:38.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:38 smithi156 ceph-mon[102862]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 6.1 MiB/s wr, 520 op/s 2023-10-06T23:16:38.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:38 smithi008 ceph-mon[98532]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 6.1 MiB/s wr, 520 op/s 2023-10-06T23:16:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:38 smithi190 ceph-mon[102658]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 6.1 MiB/s wr, 520 op/s 2023-10-06T23:16:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 105.0 s, 245.0 tps, lat 412.559 ms stddev 81.937 2023-10-06T23:16:40.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:40 smithi156 ceph-mon[102862]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 6.2 MiB/s wr, 544 op/s 2023-10-06T23:16:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:40 smithi008 ceph-mon[98532]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 6.2 MiB/s wr, 544 op/s 2023-10-06T23:16:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:40 smithi190 ceph-mon[102658]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 6.2 MiB/s wr, 544 op/s 2023-10-06T23:16:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 -- 172.21.15.8:0/30451627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab0101970 msgr2=0x7f8ab0103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/30451627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab0101970 0x7f8ab0103d60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009990 tx=0x7f8aa8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 -- 172.21.15.8:0/30451627 shutdown_connections 2023-10-06T23:16:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/30451627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0106bd0 0x7f8ab0109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/30451627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab0101970 0x7f8ab0103d60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/30451627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ab01042a0 0x7f8ab0106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 -- 172.21.15.8:0/30451627 >> 172.21.15.8:0/30451627 conn(0x7f8ab00fb340 msgr2=0x7f8ab00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 -- 172.21.15.8:0/30451627 shutdown_connections 2023-10-06T23:16:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.283+0000 7f8ab6bff700 1 -- 172.21.15.8:0/30451627 wait complete. 2023-10-06T23:16:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.285+0000 7f8ab6bff700 1 Processor -- start 2023-10-06T23:16:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.285+0000 7f8ab6bff700 1 -- start start 2023-10-06T23:16:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.285+0000 7f8ab6bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ab0101970 0x7f8ab0198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.285+0000 7f8ab6bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab01042a0 0x7f8ab0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.285+0000 7f8ab6bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0106bd0 0x7f8ab019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.285+0000 7f8ab6bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab019a820 con 0x7f8ab0101970 2023-10-06T23:16:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.285+0000 7f8ab6bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab019a990 con 0x7f8ab01042a0 2023-10-06T23:16:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.285+0000 7f8ab6bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab019ab50 con 0x7f8ab0106bd0 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8aaffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab01042a0 0x7f8ab0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8ab499b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ab0101970 0x7f8ab0198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8ab519c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0106bd0 0x7f8ab019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8aaffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab01042a0 0x7f8ab0199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58286/0 (socket says 172.21.15.8:58286) 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8aaffff700 1 -- 172.21.15.8:0/4025768963 learned_addr learned my addr 172.21.15.8:0/4025768963 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8aaffff700 1 -- 172.21.15.8:0/4025768963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0106bd0 msgr2=0x7f8ab019a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8aaffff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0106bd0 0x7f8ab019a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8aaffff700 1 -- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ab0101970 msgr2=0x7f8ab0198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8aaffff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ab0101970 0x7f8ab0198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8aaffff700 1 -- 172.21.15.8:0/4025768963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80095f0 con 0x7f8ab01042a0 2023-10-06T23:16:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.286+0000 7f8ab519c700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0106bd0 0x7f8ab019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.287+0000 7f8aaffff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab01042a0 0x7f8ab0199370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800e9a0 tx=0x7f8a9800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.287+0000 7f8aadffb700 1 -- 172.21.15.8:0/4025768963 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98009790 con 0x7f8ab01042a0 2023-10-06T23:16:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.287+0000 7f8aadffb700 1 -- 172.21.15.8:0/4025768963 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a98010430 con 0x7f8ab01042a0 2023-10-06T23:16:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.287+0000 7f8aadffb700 1 -- 172.21.15.8:0/4025768963 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9800cea0 con 0x7f8ab01042a0 2023-10-06T23:16:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.287+0000 7f8ab6bff700 1 -- 172.21.15.8:0/4025768963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab019ae30 con 0x7f8ab01042a0 2023-10-06T23:16:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.287+0000 7f8ab6bff700 1 -- 172.21.15.8:0/4025768963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab01a1540 con 0x7f8ab01042a0 2023-10-06T23:16:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.293+0000 7f8aadffb700 1 -- 172.21.15.8:0/4025768963 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8a980105a0 con 0x7f8ab01042a0 2023-10-06T23:16:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.294+0000 7f8aca447b80 1 Processor -- start 2023-10-06T23:16:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.294+0000 7f8aca447b80 1 -- start start 2023-10-06T23:16:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbc92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc9fd0 0x5604ddbca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8aca447b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddb31400 con 0x5604ddbca990 2023-10-06T23:16:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8aca447b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddb22bc0 con 0x5604ddbc9fd0 2023-10-06T23:16:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8aca447b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddb204e0 con 0x5604ddbc8ec0 2023-10-06T23:16:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8ab519c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbc92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8ab519c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbc92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:57940/0 (socket says 172.21.15.8:57940) 2023-10-06T23:16:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8ab519c700 1 -- 172.21.15.8:0/2182267583 learned_addr learned my addr 172.21.15.8:0/2182267583 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.295+0000 7f8ab499b700 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc9fd0 0x5604ddbca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.296+0000 7f8ab519c700 1 -- 172.21.15.8:0/2182267583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc9fd0 msgr2=0x5604ddbca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.296+0000 7f8ab519c700 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc9fd0 0x5604ddbca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.296+0000 7f8ab519c700 1 -- 172.21.15.8:0/2182267583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 msgr2=0x5604ddbd1220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T23:16:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.296+0000 7f8aaffff700 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.296+0000 7f8ab519c700 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.296+0000 7f8ab519c700 1 -- 172.21.15.8:0/2182267583 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604dd946d80 con 0x5604ddbc8ec0 2023-10-06T23:16:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.296+0000 7f8aaffff700 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:16:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.297+0000 7f8ab519c700 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbc92e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0003e00 tx=0x7f8aa0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f7df8b270ae933c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.297+0000 7f8aadffb700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a900a1580 0x7f8a900a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.297+0000 7f8aa6ffd700 1 -- 172.21.15.8:0/2182267583 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00092d0 con 0x5604ddbc8ec0 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.297+0000 7f8aadffb700 1 -- 172.21.15.8:0/4025768963 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8a98014070 con 0x7f8ab01042a0 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.297+0000 7f8ab499b700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a900a1580 0x7f8a900a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.297+0000 7f8aa6ffd700 1 -- 172.21.15.8:0/2182267583 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8aa000f040 con 0x5604ddbc8ec0 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.297+0000 7f8aa6ffd700 1 -- 172.21.15.8:0/2182267583 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000e750 con 0x5604ddbc8ec0 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.298+0000 7f8aca447b80 1 -- 172.21.15.8:0/2182267583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 msgr2=0x5604ddbc92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.298+0000 7f8aca447b80 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbc92e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0003e00 tx=0x7f8aa0009920 comp rx=0 tx=0).stop 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.298+0000 7f8ab499b700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a900a1580 0x7f8a900a3a40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8006010 tx=0x7f8aa8005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.298+0000 7f8aca447b80 1 -- 172.21.15.8:0/2182267583 shutdown_connections 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.298+0000 7f8aca447b80 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.298+0000 7f8aca447b80 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbc92e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.298+0000 7f8aca447b80 1 --2- 172.21.15.8:0/2182267583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc9fd0 0x5604ddbca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.298+0000 7f8aca447b80 1 -- 172.21.15.8:0/2182267583 >> 172.21.15.8:0/2182267583 conn(0x5604ddb3d200 msgr2=0x5604ddbc3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.299+0000 7f8aca447b80 1 -- 172.21.15.8:0/2182267583 shutdown_connections 2023-10-06T23:16:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.299+0000 7f8aca447b80 1 -- 172.21.15.8:0/2182267583 wait complete. 2023-10-06T23:16:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.299+0000 7f8aca447b80 1 -- start start 2023-10-06T23:16:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.300+0000 7f8aca447b80 1 Processor -- start 2023-10-06T23:16:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.300+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.300+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.300+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbca990 0x5604ddbda130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8aca447b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddb1bdd0 con 0x5604ddbc9fd0 2023-10-06T23:16:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8aca447b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddab86b0 con 0x5604ddbca990 2023-10-06T23:16:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8aca447b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddab8350 con 0x5604ddbc8ec0 2023-10-06T23:16:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8aca447b80 10 client.0 _ll_register_callbacks cb 0x5604dd9157a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8ab499b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8ab499b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:57956/0 (socket says 172.21.15.8:57956) 2023-10-06T23:16:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8ab499b700 1 -- 172.21.15.8:0/3510834006 learned_addr learned my addr 172.21.15.8:0/3510834006 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8ab519c700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbca990 0x5604ddbda130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8ab499b700 1 -- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbca990 msgr2=0x5604ddbda130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8ab499b700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbca990 0x5604ddbda130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8ab499b700 1 -- 172.21.15.8:0/3510834006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbc9fd0 msgr2=0x5604ddbd30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.301+0000 7f8aaffff700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8ab499b700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8ab499b700 1 -- 172.21.15.8:0/3510834006 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa0003ae0 con 0x5604ddbc8ec0 2023-10-06T23:16:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8ab519c700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbca990 0x5604ddbda130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:16:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8aaffff700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:16:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8ab499b700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd2bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8015000 tx=0x7f8aa8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4806bc20443b259 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8a9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:16:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3510834006 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8004500 con 0x5604ddbc8ec0 2023-10-06T23:16:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8aca447b80 1 -- 172.21.15.8:0/3510834006 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604ddbbbd50 con 0x5604ddbc8ec0 2023-10-06T23:16:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.302+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3510834006 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8aa8004660 con 0x5604ddbc8ec0 2023-10-06T23:16:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.303+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3510834006 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa8004820 con 0x5604ddbc8ec0 2023-10-06T23:16:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.303+0000 7f8aca447b80 10 client.25714 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.303+0000 7f8aca447b80 1 -- 172.21.15.8:0/3510834006 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5604dd92fc00 con 0x5604ddbc8ec0 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.303+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3510834006 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604ddbbbd50 con 0x5604ddbc8ec0 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.303+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3510834006 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8aa80268a0 con 0x5604ddbc8ec0 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.304+0000 7f8aca447b80 10 client.25714 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.304+0000 7f8aca447b80 10 client.25714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.304+0000 7f8aca447b80 20 client.25714 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.304+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5604ddbde860 0x5604ddbe0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.304+0000 7f8aca447b80 4 client.25714 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.304+0000 7f8aca447b80 1 -- 172.21.15.8:0/3510834006 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604ddb14db0 con 0x5604ddbde860 2023-10-06T23:16:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.304+0000 7f8aaffff700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5604ddbde860 0x5604ddbe0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.305+0000 7f8aaffff700 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5604ddbde860 0x5604ddbe0c80 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc8fbd54af988fe server_cookie=a7c2f451c1630d54 in_seq=0 out_seq=0 2023-10-06T23:16:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.305+0000 7f8a9ffff700 10 client.25714 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.305+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3510834006 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5604ddb14db0 con 0x5604ddbde860 2023-10-06T23:16:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.305+0000 7f8a9ffff700 10 client.25714 handle_command_reply: tid=0 2023-10-06T23:16:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.305+0000 7f8aca447b80 1 client.25714 shutdown 2023-10-06T23:16:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.306+0000 7f8aca447b80 1 -- 172.21.15.8:0/3510834006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 msgr2=0x5604ddbd2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.306+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd2bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8015000 tx=0x7f8aa8009310 comp rx=0 tx=0).stop 2023-10-06T23:16:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.306+0000 7f8aca447b80 1 -- 172.21.15.8:0/3510834006 shutdown_connections 2023-10-06T23:16:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.306+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5604ddbde860 0x5604ddbe0c80 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.306+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbca990 0x5604ddbda130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.306+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd2bb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.306+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3510834006 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.306+0000 7f8aca447b80 1 -- 172.21.15.8:0/3510834006 >> 172.21.15.8:0/3510834006 conn(0x5604ddb3d200 msgr2=0x5604ddbc3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.307+0000 7f8a9ffff700 0 client.25714 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.307+0000 7f8aca447b80 1 -- 172.21.15.8:0/3510834006 shutdown_connections 2023-10-06T23:16:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.307+0000 7f8aca447b80 1 -- 172.21.15.8:0/3510834006 wait complete. 2023-10-06T23:16:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.307+0000 7f8aca447b80 20 client.25714 trim_cache size 0 max 16384 2023-10-06T23:16:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.327+0000 7f8aca447b80 1 Processor -- start 2023-10-06T23:16:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.327+0000 7f8aca447b80 1 -- start start 2023-10-06T23:16:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbcd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbcde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbda0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8aca447b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604dd99c8c0 con 0x5604ddbca990 2023-10-06T23:16:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8aca447b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddb14db0 con 0x5604ddbc8ec0 2023-10-06T23:16:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8aca447b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddbc4a00 con 0x5604ddbc9fd0 2023-10-06T23:16:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8ab499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbcd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8ab499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbcd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58310/0 (socket says 172.21.15.8:58310) 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8ab499b700 1 -- 172.21.15.8:0/21675099 learned_addr learned my addr 172.21.15.8:0/21675099 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8aaffff700 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbcde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.328+0000 7f8ab519c700 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbda0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8ab499b700 1 -- 172.21.15.8:0/21675099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 msgr2=0x5604ddbcde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8ab499b700 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbcde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8ab499b700 1 -- 172.21.15.8:0/21675099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 msgr2=0x5604ddbda0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8ab499b700 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbda0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8ab499b700 1 -- 172.21.15.8:0/21675099 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604dd96d1f0 con 0x5604ddbc8ec0 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8aaffff700 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbcde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8ab499b700 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbcd8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8005930 tx=0x7f8aa800bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada326382dba737c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8aa77fe700 1 -- 172.21.15.8:0/21675099 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8026460 con 0x5604ddbc8ec0 2023-10-06T23:16:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8aa77fe700 1 -- 172.21.15.8:0/21675099 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8aa801e040 con 0x5604ddbc8ec0 2023-10-06T23:16:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.329+0000 7f8aa77fe700 1 -- 172.21.15.8:0/21675099 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8004b50 con 0x5604ddbc8ec0 2023-10-06T23:16:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.330+0000 7f8aca447b80 1 -- 172.21.15.8:0/21675099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 msgr2=0x5604ddbcd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.330+0000 7f8aca447b80 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbcd8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8005930 tx=0x7f8aa800bab0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.330+0000 7f8aca447b80 1 -- 172.21.15.8:0/21675099 shutdown_connections 2023-10-06T23:16:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.330+0000 7f8aca447b80 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbda0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.330+0000 7f8aca447b80 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbcd8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.330+0000 7f8aca447b80 1 --2- 172.21.15.8:0/21675099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbcde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.330+0000 7f8aca447b80 1 -- 172.21.15.8:0/21675099 >> 172.21.15.8:0/21675099 conn(0x5604ddb3d200 msgr2=0x5604ddbd0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.331+0000 7f8aca447b80 1 -- 172.21.15.8:0/21675099 shutdown_connections 2023-10-06T23:16:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.331+0000 7f8aca447b80 1 -- 172.21.15.8:0/21675099 wait complete. 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.331+0000 7f8aca447b80 1 -- start start 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.331+0000 7f8aca447b80 1 Processor -- start 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8aca447b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8aca447b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddbd9790 con 0x5604ddbca990 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8aca447b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddbd9900 con 0x5604ddbc8ec0 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8aca447b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604ddbd9ac0 con 0x5604ddbc9fd0 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8aca447b80 10 client.0 _ll_register_callbacks cb 0x7f8aa8003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8ab499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8ab499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58318/0 (socket says 172.21.15.8:58318) 2023-10-06T23:16:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8ab499b700 1 -- 172.21.15.8:0/3500124135 learned_addr learned my addr 172.21.15.8:0/3500124135 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.332+0000 7f8aaffff700 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8ab519c700 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8ab499b700 1 -- 172.21.15.8:0/3500124135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 msgr2=0x5604ddbd8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8ab499b700 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8ab499b700 1 -- 172.21.15.8:0/3500124135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 msgr2=0x5604ddbd9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8ab499b700 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8ab499b700 1 -- 172.21.15.8:0/3500124135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab01a1540 con 0x5604ddbc8ec0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8ab519c700 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8ab499b700 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd7d00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8004250 tx=0x7f8aa8027f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c45ca2c62d9be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.333+0000 7f8a9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.334+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3500124135 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8026870 con 0x5604ddbc8ec0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.334+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3500124135 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8aa80048d0 con 0x5604ddbc8ec0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.334+0000 7f8aca447b80 1 -- 172.21.15.8:0/3500124135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8aa000f040 con 0x5604ddbc8ec0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.334+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3500124135 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa80269d0 con 0x5604ddbc8ec0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.334+0000 7f8aca447b80 10 client.25670 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.334+0000 7f8aca447b80 1 -- 172.21.15.8:0/3500124135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5604dd92fc00 con 0x5604ddbc8ec0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3500124135 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8aa8053020 con 0x5604ddbc8ec0 2023-10-06T23:16:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3500124135 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8aa8043020 con 0x5604ddbc8ec0 2023-10-06T23:16:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8aca447b80 10 client.25670 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8aca447b80 10 client.25670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8aca447b80 20 client.25670 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5604ddc3b8d0 0x5604ddc3dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8aca447b80 4 client.25670 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:16:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8aca447b80 1 -- 172.21.15.8:0/3500124135 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5604ddb14ad0 con 0x5604ddc3b8d0 2023-10-06T23:16:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.335+0000 7f8aaffff700 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5604ddc3b8d0 0x5604ddc3dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.336+0000 7f8aaffff700 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5604ddc3b8d0 0x5604ddc3dcf0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89310f57c30a8e0f server_cookie=284c00fd0a7a6cc4 in_seq=0 out_seq=0 2023-10-06T23:16:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.336+0000 7f8a9ffff700 10 client.25670 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8a9ffff700 1 -- 172.21.15.8:0/3500124135 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5604ddb14ad0 con 0x5604ddc3b8d0 2023-10-06T23:16:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8a9ffff700 10 client.25670 handle_command_reply: tid=0 2023-10-06T23:16:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 client.25670 shutdown 2023-10-06T23:16:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 -- 172.21.15.8:0/3500124135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 msgr2=0x5604ddbd7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd7d00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8004250 tx=0x7f8aa8027f70 comp rx=0 tx=0).stop 2023-10-06T23:16:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 -- 172.21.15.8:0/3500124135 shutdown_connections 2023-10-06T23:16:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5604ddc3b8d0 0x5604ddc3dcf0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604ddbca990 0x5604ddbd9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ddbc8ec0 0x5604ddbd7d00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8a9ffff700 0 client.25670 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 --2- 172.21.15.8:0/3500124135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604ddbc9fd0 0x5604ddbd8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 -- 172.21.15.8:0/3500124135 >> 172.21.15.8:0/3500124135 conn(0x5604ddb3d200 msgr2=0x5604ddbcd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 -- 172.21.15.8:0/3500124135 shutdown_connections 2023-10-06T23:16:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.351+0000 7f8aca447b80 1 -- 172.21.15.8:0/3500124135 wait complete. 2023-10-06T23:16:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.352+0000 7f8aca447b80 20 client.25670 trim_cache size 0 max 16384 2023-10-06T23:16:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:16:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:16:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:16:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:16:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 -- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a900a1580 msgr2=0x7f8a900a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a900a1580 0x7f8a900a3a40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8006010 tx=0x7f8aa8005960 comp rx=0 tx=0).stop 2023-10-06T23:16:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 -- 172.21.15.8:0/4025768963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab01042a0 msgr2=0x7f8ab0199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab01042a0 0x7f8ab0199370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800e9a0 tx=0x7f8a9800ecb0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 -- 172.21.15.8:0/4025768963 shutdown_connections 2023-10-06T23:16:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8a900a1580 0x7f8a900a3a40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ab0101970 0x7f8ab0198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0106bd0 0x7f8ab019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 --2- 172.21.15.8:0/4025768963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8ab01042a0 0x7f8ab0199370 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.353+0000 7f8ab6bff700 1 -- 172.21.15.8:0/4025768963 >> 172.21.15.8:0/4025768963 conn(0x7f8ab00fb340 msgr2=0x7f8ab01025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.354+0000 7f8ab6bff700 1 -- 172.21.15.8:0/4025768963 shutdown_connections 2023-10-06T23:16:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:41.354+0000 7f8ab6bff700 1 -- 172.21.15.8:0/4025768963 wait complete. 2023-10-06T23:16:42.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:42 smithi156 ceph-mon[102862]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 6.5 MiB/s wr, 566 op/s 2023-10-06T23:16:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:42 smithi008 ceph-mon[98532]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 6.5 MiB/s wr, 566 op/s 2023-10-06T23:16:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:42 smithi190 ceph-mon[102658]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 6.5 MiB/s wr, 566 op/s 2023-10-06T23:16:43.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:43 smithi156 ceph-mon[102862]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 5.4 MiB/s wr, 484 op/s 2023-10-06T23:16:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:43 smithi008 ceph-mon[98532]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 5.4 MiB/s wr, 484 op/s 2023-10-06T23:16:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:43 smithi190 ceph-mon[102658]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 5.4 MiB/s wr, 484 op/s 2023-10-06T23:16:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 110.0 s, 205.4 tps, lat 497.863 ms stddev 245.219 2023-10-06T23:16:44.405 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:16:44.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 -- 172.21.15.8:0/3838882741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 msgr2=0x7f17f4106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3838882741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 0x7f17f4106660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098f0 tx=0x7f17e4009c00 comp rx=0 tx=0).stop 2023-10-06T23:16:44.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 -- 172.21.15.8:0/3838882741 shutdown_connections 2023-10-06T23:16:44.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3838882741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f4106ba0 0x7f17f4109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3838882741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17f4101940 0x7f17f4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3838882741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 0x7f17f4106660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 -- 172.21.15.8:0/3838882741 >> 172.21.15.8:0/3838882741 conn(0x7f17f40fb330 msgr2=0x7f17f40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:44.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 -- 172.21.15.8:0/3838882741 shutdown_connections 2023-10-06T23:16:44.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.706+0000 7f17fbdff700 1 -- 172.21.15.8:0/3838882741 wait complete. 2023-10-06T23:16:44.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17fbdff700 1 Processor -- start 2023-10-06T23:16:44.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17fbdff700 1 -- start start 2023-10-06T23:16:44.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17fbdff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17f4101940 0x7f17f4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17fbdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 0x7f17f41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17fbdff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f4106ba0 0x7f17f41a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17fbdff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41a08f0 con 0x7f17f4106ba0 2023-10-06T23:16:44.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17fbdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41a0a60 con 0x7f17f4104270 2023-10-06T23:16:44.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17fbdff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41a0c20 con 0x7f17f4101940 2023-10-06T23:16:44.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17f939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 0x7f17f41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17f939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 0x7f17f41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58328/0 (socket says 172.21.15.8:58328) 2023-10-06T23:16:44.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.708+0000 7f17f939a700 1 -- 172.21.15.8:0/3704986466 learned_addr learned my addr 172.21.15.8:0/3704986466 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:44.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.709+0000 7f17fa39c700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f4106ba0 0x7f17f41a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.709+0000 7f17f939a700 1 -- 172.21.15.8:0/3704986466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17f4101940 msgr2=0x7f17f4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.709+0000 7f17f939a700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17f4101940 0x7f17f4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.709+0000 7f17f939a700 1 -- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f4106ba0 msgr2=0x7f17f41a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.709+0000 7f17f939a700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f4106ba0 0x7f17f41a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.709+0000 7f17f939a700 1 -- 172.21.15.8:0/3704986466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4009520 con 0x7f17f4104270 2023-10-06T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.709+0000 7f17fa39c700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f4106ba0 0x7f17f41a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.709+0000 7f17f939a700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 0x7f17f41992f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009fd0 tx=0x7f17e400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.710+0000 7f17eaffd700 1 -- 172.21.15.8:0/3704986466 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e401c070 con 0x7f17f4104270 2023-10-06T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.710+0000 7f17eaffd700 1 -- 172.21.15.8:0/3704986466 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17e400f7d0 con 0x7f17f4104270 2023-10-06T23:16:44.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.710+0000 7f17eaffd700 1 -- 172.21.15.8:0/3704986466 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4004b90 con 0x7f17f4104270 2023-10-06T23:16:44.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.710+0000 7f17fbdff700 1 -- 172.21.15.8:0/3704986466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f41a0ea0 con 0x7f17f4104270 2023-10-06T23:16:44.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.710+0000 7f17fbdff700 1 -- 172.21.15.8:0/3704986466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f41a1210 con 0x7f17f4104270 2023-10-06T23:16:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.714+0000 7f17eaffd700 1 -- 172.21.15.8:0/3704986466 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f17e4020070 con 0x7f17f4104270 2023-10-06T23:16:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.715+0000 7f180f7bfb80 1 Processor -- start 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.715+0000 7f180f7bfb80 1 -- start start 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.715+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4260 0x55b6df5f4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.715+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5f5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.715+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 0x55b6df5f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.715+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df55c460 con 0x55b6df5f5a60 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.715+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df54dc20 con 0x55b6df5f4bc0 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.715+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df54b540 con 0x55b6df5f4260 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17fa39c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4260 0x55b6df5f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17f9b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17fa39c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4260 0x55b6df5f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58012/0 (socket says 172.21.15.8:58012) 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17fa39c700 1 -- 172.21.15.8:0/1444970208 learned_addr learned my addr 172.21.15.8:0/1444970208 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17f939a700 1 --2- 172.21.15.8:0/1444970208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 0x55b6df5f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17f9b9b700 1 -- 172.21.15.8:0/1444970208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4260 msgr2=0x55b6df5f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/1444970208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4260 0x55b6df5f4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17f9b9b700 1 -- 172.21.15.8:0/1444970208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 msgr2=0x55b6df5f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/1444970208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 0x55b6df5f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.716+0000 7f17f9b9b700 1 -- 172.21.15.8:0/1444970208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6df371de0 con 0x55b6df5f4bc0 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.717+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/1444970208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5f5480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17f0005fd0 tx=0x7f17f0009e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=525094aa875f93d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.717+0000 7f17eaffd700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f17e00a1580 0x7f17e00a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.717+0000 7f17dffff700 1 -- 172.21.15.8:0/1444970208 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0004230 con 0x55b6df5f4bc0 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.717+0000 7f17dffff700 1 -- 172.21.15.8:0/1444970208 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f000ed10 con 0x55b6df5f4bc0 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.717+0000 7f17dffff700 1 -- 172.21.15.8:0/1444970208 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0005020 con 0x55b6df5f4bc0 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.717+0000 7f17eaffd700 1 -- 172.21.15.8:0/3704986466 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f17e40cdc30 con 0x7f17f4104270 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f17fa39c700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f17e00a1580 0x7f17e00a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1444970208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 msgr2=0x55b6df5f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1444970208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5f5480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17f0005fd0 tx=0x7f17f0009e60 comp rx=0 tx=0).stop 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1444970208 shutdown_connections 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1444970208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 0x55b6df5f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1444970208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4260 0x55b6df5f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1444970208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5f5480 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1444970208 >> 172.21.15.8:0/1444970208 conn(0x55b6df568260 msgr2=0x55b6df5ef140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.718+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1444970208 shutdown_connections 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.719+0000 7f17fa39c700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f17e00a1580 0x7f17e00a3a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009690 tx=0x7f17ec004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.719+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1444970208 wait complete. 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.719+0000 7f180f7bfb80 1 -- start start 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.720+0000 7f180f7bfb80 1 Processor -- start 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.720+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 0x55b6df5fe000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.720+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5fe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.720+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f5a60 0x55b6df605580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.720+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df546e30 con 0x55b6df5f4260 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.720+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df4e3710 con 0x55b6df5f4bc0 2023-10-06T23:16:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.720+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df4e33b0 con 0x55b6df5f5a60 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.720+0000 7f180f7bfb80 10 client.0 _ll_register_callbacks cb 0x55b6df340800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5fe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5fe540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58338/0 (socket says 172.21.15.8:58338) 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 -- 172.21.15.8:0/1141119486 learned_addr learned my addr 172.21.15.8:0/1141119486 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 0x55b6df5fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17fa39c700 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f5a60 0x55b6df605580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 -- 172.21.15.8:0/1141119486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f5a60 msgr2=0x55b6df605580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f5a60 0x55b6df605580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 -- 172.21.15.8:0/1141119486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 msgr2=0x55b6df5fe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 0x55b6df5fe000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 -- 172.21.15.8:0/1141119486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f00097f0 con 0x55b6df5f4bc0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17f939a700 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5fe540 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17e409ac90 tx=0x7f17e40972d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8118ec8f92441ff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.721+0000 7f17dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.722+0000 7f17dd7fa700 1 -- 172.21.15.8:0/1141119486 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e409a8f0 con 0x55b6df5f4bc0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.722+0000 7f17dd7fa700 1 -- 172.21.15.8:0/1141119486 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f17e409b690 con 0x55b6df5f4bc0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.722+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1141119486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6df5e6f10 con 0x55b6df5f4bc0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.722+0000 7f17dd7fa700 1 -- 172.21.15.8:0/1141119486 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17e409af90 con 0x55b6df5f4bc0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.722+0000 7f180f7bfb80 10 client.25682 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.722+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1141119486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b6df35ac60 con 0x55b6df5f4bc0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.722+0000 7f17dd7fa700 1 -- 172.21.15.8:0/1141119486 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b6df5e6f10 con 0x55b6df5f4bc0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.722+0000 7f17dd7fa700 1 -- 172.21.15.8:0/1141119486 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f17e409b1f0 con 0x55b6df5f4bc0 2023-10-06T23:16:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.723+0000 7f180f7bfb80 10 client.25682 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.723+0000 7f180f7bfb80 10 client.25682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.723+0000 7f180f7bfb80 20 client.25682 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.723+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b6df609aa0 0x55b6df60bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.723+0000 7f180f7bfb80 4 client.25682 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.723+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1141119486 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6df53fe10 con 0x55b6df609aa0 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.723+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b6df609aa0 0x55b6df60bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.724+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b6df609aa0 0x55b6df60bec0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fb3fa11c2ffee90 server_cookie=8d1c531c48b9b661 in_seq=0 out_seq=0 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.724+0000 7f17dd7fa700 10 client.25682 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f17dd7fa700 1 -- 172.21.15.8:0/1141119486 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b6df53fe10 con 0x55b6df609aa0 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f17dd7fa700 10 client.25682 handle_command_reply: tid=0 2023-10-06T23:16:44.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 client.25682 shutdown 2023-10-06T23:16:44.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1141119486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 msgr2=0x55b6df5fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5fe540 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17e409ac90 tx=0x7f17e40972d0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1141119486 shutdown_connections 2023-10-06T23:16:44.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b6df609aa0 0x55b6df60bec0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 0x55b6df5fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f5a60 0x55b6df605580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/1141119486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4bc0 0x55b6df5fe540 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1141119486 >> 172.21.15.8:0/1141119486 conn(0x55b6df568260 msgr2=0x55b6df5eef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:44.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.725+0000 7f17dd7fa700 0 client.25682 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:44.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.726+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1141119486 shutdown_connections 2023-10-06T23:16:44.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.726+0000 7f180f7bfb80 1 -- 172.21.15.8:0/1141119486 wait complete. 2023-10-06T23:16:44.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.726+0000 7f180f7bfb80 20 client.25682 trim_cache size 0 max 16384 2023-10-06T23:16:44.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.753+0000 7f180f7bfb80 1 Processor -- start 2023-10-06T23:16:44.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f180f7bfb80 1 -- start start 2023-10-06T23:16:44.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4260 0x55b6df5f8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df605540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 0x55b6df5f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df3c7920 con 0x55b6df5f5a60 2023-10-06T23:16:44.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df5f0850 con 0x55b6df5f4260 2023-10-06T23:16:44.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df5fcb20 con 0x55b6df5f4bc0 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f17f939a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df605540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f17f9b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4260 0x55b6df5f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.754+0000 7f17fa39c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 0x55b6df5f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.755+0000 7f17f939a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df605540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58044/0 (socket says 172.21.15.8:58044) 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.755+0000 7f17f939a700 1 -- 172.21.15.8:0/748245101 learned_addr learned my addr 172.21.15.8:0/748245101 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.755+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/748245101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4260 0x55b6df5f8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58342/0 (socket says 172.21.15.8:58342) 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.755+0000 7f17f939a700 1 -- 172.21.15.8:0/748245101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4260 msgr2=0x55b6df5f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.755+0000 7f17f939a700 1 --2- 172.21.15.8:0/748245101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4260 0x55b6df5f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.755+0000 7f17f939a700 1 -- 172.21.15.8:0/748245101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 msgr2=0x55b6df5f8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:44.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.755+0000 7f17f939a700 1 --2- 172.21.15.8:0/748245101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 0x55b6df5f8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.755+0000 7f17f939a700 1 -- 172.21.15.8:0/748245101 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6df398250 con 0x55b6df5f4bc0 2023-10-06T23:16:44.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.756+0000 7f17f939a700 1 --2- 172.21.15.8:0/748245101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df605540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17e400f9d0 tx=0x7f17e40d12a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502ea4760ba544f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.756+0000 7f17e8bff700 1 -- 172.21.15.8:0/748245101 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4079ea0 con 0x55b6df5f4bc0 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.756+0000 7f17e8bff700 1 -- 172.21.15.8:0/748245101 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17e409b690 con 0x55b6df5f4bc0 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.756+0000 7f17e8bff700 1 -- 172.21.15.8:0/748245101 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e409b1f0 con 0x55b6df5f4bc0 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.757+0000 7f180f7bfb80 1 -- 172.21.15.8:0/748245101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 msgr2=0x55b6df605540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.757+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/748245101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df605540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17e400f9d0 tx=0x7f17e40d12a0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.757+0000 7f180f7bfb80 1 -- 172.21.15.8:0/748245101 shutdown_connections 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.757+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/748245101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f5a60 0x55b6df5f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.757+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/748245101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f4260 0x55b6df5f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.757+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/748245101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df605540 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.757+0000 7f180f7bfb80 1 -- 172.21.15.8:0/748245101 >> 172.21.15.8:0/748245101 conn(0x55b6df568260 msgr2=0x55b6df5fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:44.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.758+0000 7f180f7bfb80 1 -- 172.21.15.8:0/748245101 shutdown_connections 2023-10-06T23:16:44.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.758+0000 7f180f7bfb80 1 -- 172.21.15.8:0/748245101 wait complete. 2023-10-06T23:16:44.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.758+0000 7f180f7bfb80 1 -- start start 2023-10-06T23:16:44.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.758+0000 7f180f7bfb80 1 Processor -- start 2023-10-06T23:16:44.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.759+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 0x55b6df601530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.759+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df601a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.759+0000 7f180f7bfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f5a60 0x55b6df604a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.759+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df604fd0 con 0x55b6df5f4260 2023-10-06T23:16:44.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.759+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df605140 con 0x55b6df5f5a60 2023-10-06T23:16:44.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.759+0000 7f180f7bfb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6df605300 con 0x55b6df5f4bc0 2023-10-06T23:16:44.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.759+0000 7f180f7bfb80 10 client.0 _ll_register_callbacks cb 0x55b6df340800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:44.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.760+0000 7f17fa39c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f5a60 0x55b6df604a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.760+0000 7f17fa39c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f5a60 0x55b6df604a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58352/0 (socket says 172.21.15.8:58352) 2023-10-06T23:16:44.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.760+0000 7f17fa39c700 1 -- 172.21.15.8:0/3959817190 learned_addr learned my addr 172.21.15.8:0/3959817190 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:44.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.760+0000 7f17f939a700 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df601a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.760+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 0x55b6df601530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.760+0000 7f17f939a700 1 -- 172.21.15.8:0/3959817190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f5a60 msgr2=0x55b6df604a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:44.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.760+0000 7f17f939a700 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f5a60 0x55b6df604a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.760+0000 7f17f939a700 1 -- 172.21.15.8:0/3959817190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 msgr2=0x55b6df601530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:44.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.761+0000 7f17f939a700 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 0x55b6df601530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.761+0000 7f17f939a700 1 -- 172.21.15.8:0/3959817190 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6df35ac60 con 0x55b6df5f4bc0 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.761+0000 7f17fa39c700 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f5a60 0x55b6df604a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.761+0000 7f17f939a700 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df601a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17e40a2d60 tx=0x7f17e40d1310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68dd2cf37df14cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.761+0000 7f17dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.761+0000 7f17dd7fa700 1 -- 172.21.15.8:0/3959817190 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4079ea0 con 0x55b6df5f4bc0 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.761+0000 7f17dd7fa700 1 -- 172.21.15.8:0/3959817190 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f17e409af90 con 0x55b6df5f4bc0 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.761+0000 7f180f7bfb80 1 -- 172.21.15.8:0/3959817190 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17f000ed10 con 0x55b6df5f4bc0 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.762+0000 7f17dd7fa700 1 -- 172.21.15.8:0/3959817190 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17e40a2e00 con 0x55b6df5f4bc0 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.762+0000 7f180f7bfb80 10 client.25735 fetch_fsmap learned FSMap version 29 2023-10-06T23:16:44.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.762+0000 7f180f7bfb80 1 -- 172.21.15.8:0/3959817190 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b6df3702b0 con 0x55b6df5f4bc0 2023-10-06T23:16:44.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.763+0000 7f17dd7fa700 1 -- 172.21.15.8:0/3959817190 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f000ed10 con 0x55b6df5f4bc0 2023-10-06T23:16:44.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.763+0000 7f17dd7fa700 1 -- 172.21.15.8:0/3959817190 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f17e4095c70 con 0x55b6df5f4bc0 2023-10-06T23:16:44.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.763+0000 7f180f7bfb80 10 client.25735 fetch_fsmap finished waiting for FSMap version 29 2023-10-06T23:16:44.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.763+0000 7f180f7bfb80 10 client.25735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:44.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.763+0000 7f180f7bfb80 20 client.25735 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:44.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.763+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b6df666c90 0x55b6df6690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:44.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.763+0000 7f180f7bfb80 4 client.25735 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:16:44.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.763+0000 7f180f7bfb80 1 -- 172.21.15.8:0/3959817190 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b6df53fb30 con 0x55b6df666c90 2023-10-06T23:16:44.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.764+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b6df666c90 0x55b6df6690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:44.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.765+0000 7f17f9b9b700 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b6df666c90 0x55b6df6690b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10a9be1fad92ca7 server_cookie=affdb179b12a83a in_seq=0 out_seq=0 2023-10-06T23:16:44.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.765+0000 7f17dd7fa700 10 client.25735 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:44.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f17dd7fa700 1 -- 172.21.15.8:0/3959817190 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b6df53fb30 con 0x55b6df666c90 2023-10-06T23:16:44.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f17dd7fa700 10 client.25735 handle_command_reply: tid=0 2023-10-06T23:16:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f180f7bfb80 1 client.25735 shutdown 2023-10-06T23:16:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f180f7bfb80 1 -- 172.21.15.8:0/3959817190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 msgr2=0x55b6df601a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df601a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17e40a2d60 tx=0x7f17e40d1310 comp rx=0 tx=0).stop 2023-10-06T23:16:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f180f7bfb80 1 -- 172.21.15.8:0/3959817190 shutdown_connections 2023-10-06T23:16:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b6df666c90 0x55b6df6690b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b6df5f4260 0x55b6df601530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b6df5f5a60 0x55b6df604a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.766+0000 7f180f7bfb80 1 --2- 172.21.15.8:0/3959817190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6df5f4bc0 0x55b6df601a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.767+0000 7f180f7bfb80 1 -- 172.21.15.8:0/3959817190 >> 172.21.15.8:0/3959817190 conn(0x55b6df568260 msgr2=0x55b6df5f8930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.767+0000 7f17dd7fa700 0 client.25735 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.767+0000 7f180f7bfb80 1 -- 172.21.15.8:0/3959817190 shutdown_connections 2023-10-06T23:16:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.767+0000 7f180f7bfb80 1 -- 172.21.15.8:0/3959817190 wait complete. 2023-10-06T23:16:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.767+0000 7f180f7bfb80 20 client.25735 trim_cache size 0 max 16384 2023-10-06T23:16:44.770 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:16:44.770 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:16:44.770 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:16:44.770 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:16:44.770 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:16:44.770 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:16:44.770 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:16:44.771 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:16:44.771 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:16:44.771 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:16:44.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 -- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f17e00a1580 msgr2=0x7f17e00a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f17e00a1580 0x7f17e00a3a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009690 tx=0x7f17ec004ad0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 -- 172.21.15.8:0/3704986466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 msgr2=0x7f17f41992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 0x7f17f41992f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009fd0 tx=0x7f17e400b840 comp rx=0 tx=0).stop 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 -- 172.21.15.8:0/3704986466 shutdown_connections 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f17e00a1580 0x7f17e00a3a40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17f4106ba0 0x7f17f41a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17f4101940 0x7f17f4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 --2- 172.21.15.8:0/3704986466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17f4104270 0x7f17f41992f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 -- 172.21.15.8:0/3704986466 >> 172.21.15.8:0/3704986466 conn(0x7f17f40fb330 msgr2=0x7f17f4102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 -- 172.21.15.8:0/3704986466 shutdown_connections 2023-10-06T23:16:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:16:44.768+0000 7f17fbdff700 1 -- 172.21.15.8:0/3704986466 wait complete. 2023-10-06T23:16:44.796 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:16:46.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:46 smithi156 ceph-mon[102862]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 5.8 MiB/s wr, 567 op/s 2023-10-06T23:16:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:46 smithi008 ceph-mon[98532]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 5.8 MiB/s wr, 567 op/s 2023-10-06T23:16:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:46 smithi190 ceph-mon[102658]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 5.8 MiB/s wr, 567 op/s 2023-10-06T23:16:48.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:48 smithi156 ceph-mon[102862]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 5.9 MiB/s wr, 550 op/s 2023-10-06T23:16:48.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:48 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:16:48.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:48 smithi008 ceph-mon[98532]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 5.9 MiB/s wr, 550 op/s 2023-10-06T23:16:48.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:48 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:16:48.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:48 smithi190 ceph-mon[102658]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 5.9 MiB/s wr, 550 op/s 2023-10-06T23:16:48.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:48 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:16:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 115.0 s, 238.4 tps, lat 416.850 ms stddev 87.254 2023-10-06T23:16:50.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:50 smithi156 ceph-mon[102862]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2023-10-06T23:16:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:50 smithi008 ceph-mon[98532]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2023-10-06T23:16:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:50 smithi190 ceph-mon[102658]: pgmap v468: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.5 MiB/s wr, 605 op/s 2023-10-06T23:16:52.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:52 smithi156 ceph-mon[102862]: pgmap v469: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2023-10-06T23:16:52.398 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:52 smithi008 ceph-mon[98532]: pgmap v469: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2023-10-06T23:16:52.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:52 smithi190 ceph-mon[102658]: pgmap v469: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2023-10-06T23:16:53.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:53 smithi156 ceph-mon[102862]: pgmap v470: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 5.9 MiB/s wr, 529 op/s 2023-10-06T23:16:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:53 smithi008 ceph-mon[98532]: pgmap v470: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 5.9 MiB/s wr, 529 op/s 2023-10-06T23:16:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:53 smithi190 ceph-mon[102658]: pgmap v470: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 5.9 MiB/s wr, 529 op/s 2023-10-06T23:16:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 120.0 s, 236.6 tps, lat 419.078 ms stddev 106.917 2023-10-06T23:16:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.533+0000 7f3380bff700 1 -- 172.21.15.8:0/1957849434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f337c073910 msgr2=0x7f337c073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.533+0000 7f3380bff700 1 --2- 172.21.15.8:0/1957849434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f337c073910 0x7f337c073d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3364009990 tx=0x7f3364009ca0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.534+0000 7f3380bff700 1 -- 172.21.15.8:0/1957849434 shutdown_connections 2023-10-06T23:16:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.534+0000 7f3380bff700 1 --2- 172.21.15.8:0/1957849434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c10d4d0 0x7f337c10f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.534+0000 7f3380bff700 1 --2- 172.21.15.8:0/1957849434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c074ef0 0x7f337c073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.534+0000 7f3380bff700 1 --2- 172.21.15.8:0/1957849434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f337c073910 0x7f337c073d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.534+0000 7f3380bff700 1 -- 172.21.15.8:0/1957849434 >> 172.21.15.8:0/1957849434 conn(0x7f337c0fc430 msgr2=0x7f337c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.534+0000 7f3380bff700 1 -- 172.21.15.8:0/1957849434 shutdown_connections 2023-10-06T23:16:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.534+0000 7f3380bff700 1 -- 172.21.15.8:0/1957849434 wait complete. 2023-10-06T23:16:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.535+0000 7f3380bff700 1 Processor -- start 2023-10-06T23:16:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.536+0000 7f3380bff700 1 -- start start 2023-10-06T23:16:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.536+0000 7f3380bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f337c073910 0x7f337c19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.536+0000 7f3380bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c074ef0 0x7f337c19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.536+0000 7f3380bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c10d4d0 0x7f337c19e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.536+0000 7f3380bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c19eca0 con 0x7f337c10d4d0 2023-10-06T23:16:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.536+0000 7f3380bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c19ee10 con 0x7f337c073910 2023-10-06T23:16:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.536+0000 7f3380bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c19efd0 con 0x7f337c074ef0 2023-10-06T23:16:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c10d4d0 0x7f337c19e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c074ef0 0x7f337c19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c074ef0 0x7f337c19d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54114/0 (socket says 172.21.15.8:54114) 2023-10-06T23:16:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337a59c700 1 -- 172.21.15.8:0/1832451045 learned_addr learned my addr 172.21.15.8:0/1832451045 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337259c700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f337c073910 0x7f337c19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337a59c700 1 -- 172.21.15.8:0/1832451045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f337c073910 msgr2=0x7f337c19d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337a59c700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f337c073910 0x7f337c19d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337a59c700 1 -- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c10d4d0 msgr2=0x7f337c19e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337a59c700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c10d4d0 0x7f337c19e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.537+0000 7f337a59c700 1 -- 172.21.15.8:0/1832451045 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c009520 con 0x7f337c074ef0 2023-10-06T23:16:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.538+0000 7f337a59c700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c074ef0 0x7f337c19d7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33640098e0 tx=0x7f3364004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.538+0000 7f3373fff700 1 -- 172.21.15.8:0/1832451045 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336401d070 con 0x7f337c074ef0 2023-10-06T23:16:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.538+0000 7f3373fff700 1 -- 172.21.15.8:0/1832451045 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f336400be30 con 0x7f337c074ef0 2023-10-06T23:16:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.538+0000 7f3380bff700 1 -- 172.21.15.8:0/1832451045 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3374009c40 con 0x7f337c074ef0 2023-10-06T23:16:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.538+0000 7f3373fff700 1 -- 172.21.15.8:0/1832451045 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364022d80 con 0x7f337c074ef0 2023-10-06T23:16:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.539+0000 7f3380bff700 1 -- 172.21.15.8:0/1832451045 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33640095f0 con 0x7f337c074ef0 2023-10-06T23:16:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.545+0000 7f33944a1b80 1 Processor -- start 2023-10-06T23:16:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.545+0000 7f33944a1b80 1 -- start start 2023-10-06T23:16:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b46fd0 0x561595b47450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 0x561595b4e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f33944a1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595aae400 con 0x561595b45ec0 2023-10-06T23:16:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f33944a1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595a9fbc0 con 0x561595b46fd0 2023-10-06T23:16:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f33944a1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595a9d4e0 con 0x561595b47990 2023-10-06T23:16:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f337259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b46fd0 0x561595b47450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f337259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b46fd0 0x561595b47450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37538/0 (socket says 172.21.15.8:37538) 2023-10-06T23:16:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.546+0000 7f337259c700 1 -- 172.21.15.8:0/926439270 learned_addr learned my addr 172.21.15.8:0/926439270 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:54.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.547+0000 7f337ad9d700 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.547+0000 7f3373fff700 1 -- 172.21.15.8:0/1832451045 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3364022470 con 0x7f337c074ef0 2023-10-06T23:16:54.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.547+0000 7f337259c700 1 -- 172.21.15.8:0/926439270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 msgr2=0x561595b4e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:54.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.547+0000 7f337259c700 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 0x561595b4e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.547+0000 7f337259c700 1 -- 172.21.15.8:0/926439270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 msgr2=0x561595b462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:54.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.547+0000 7f337259c700 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.547+0000 7f337259c700 1 -- 172.21.15.8:0/926439270 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615958c3d80 con 0x561595b46fd0 2023-10-06T23:16:54.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.547+0000 7f337ad9d700 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:16:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.548+0000 7f337259c700 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b46fd0 0x561595b47450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f336c009f10 tx=0x7f336c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6cf95baf1dada6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.548+0000 7f3370d99700 1 -- 172.21.15.8:0/926439270 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c019630 con 0x561595b46fd0 2023-10-06T23:16:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.548+0000 7f3370d99700 1 -- 172.21.15.8:0/926439270 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f336c019c20 con 0x561595b46fd0 2023-10-06T23:16:54.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.548+0000 7f3370d99700 1 -- 172.21.15.8:0/926439270 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c00ebd0 con 0x561595b46fd0 2023-10-06T23:16:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.549+0000 7f33944a1b80 1 -- 172.21.15.8:0/926439270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b46fd0 msgr2=0x561595b47450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.549+0000 7f3373fff700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33680a1650 0x7f33680a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.549+0000 7f33944a1b80 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b46fd0 0x561595b47450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f336c009f10 tx=0x7f336c011720 comp rx=0 tx=0).stop 2023-10-06T23:16:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.549+0000 7f3373fff700 1 -- 172.21.15.8:0/1832451045 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f33640ce0d0 con 0x7f337c074ef0 2023-10-06T23:16:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.549+0000 7f337ad9d700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33680a1650 0x7f33680a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.550+0000 7f33944a1b80 1 -- 172.21.15.8:0/926439270 shutdown_connections 2023-10-06T23:16:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.550+0000 7f33944a1b80 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.550+0000 7f33944a1b80 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 0x561595b4e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.550+0000 7f33944a1b80 1 --2- 172.21.15.8:0/926439270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b46fd0 0x561595b47450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.550+0000 7f33944a1b80 1 -- 172.21.15.8:0/926439270 >> 172.21.15.8:0/926439270 conn(0x561595aba200 msgr2=0x561595b40bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.550+0000 7f33944a1b80 1 -- 172.21.15.8:0/926439270 shutdown_connections 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.550+0000 7f33944a1b80 1 -- 172.21.15.8:0/926439270 wait complete. 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.551+0000 7f337ad9d700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33680a1650 0x7f33680a3b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x561595b45c60 tx=0x7f337400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.551+0000 7f33944a1b80 1 -- start start 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.551+0000 7f33944a1b80 1 Processor -- start 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b45ec0 0x561595b4fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 0x561595b50170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f33944a1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595a98dd0 con 0x561595b46fd0 2023-10-06T23:16:54.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f33944a1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595a356b0 con 0x561595b47990 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f33944a1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595a35350 con 0x561595b45ec0 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f33944a1b80 10 client.0 _ll_register_callbacks cb 0x5615958927a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f337259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b45ec0 0x561595b4fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f337259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b45ec0 0x561595b4fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54140/0 (socket says 172.21.15.8:54140) 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.552+0000 7f337259c700 1 -- 172.21.15.8:0/1269744243 learned_addr learned my addr 172.21.15.8:0/1269744243 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.553+0000 7f337ad9d700 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.553+0000 7f337a59c700 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 0x561595b50170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.553+0000 7f337259c700 1 -- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 msgr2=0x561595b571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.553+0000 7f337259c700 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.553+0000 7f337259c700 1 -- 172.21.15.8:0/1269744243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 msgr2=0x561595b50170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.553+0000 7f337259c700 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 0x561595b50170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.553+0000 7f337259c700 1 -- 172.21.15.8:0/1269744243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c009b70 con 0x561595b45ec0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.553+0000 7f337ad9d700 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.554+0000 7f337259c700 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b45ec0 0x561595b4fc30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f336c00edb0 tx=0x7f336c00ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7084b05bec9bca41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.554+0000 7f3361ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.554+0000 7f3361ffb700 1 -- 172.21.15.8:0/1269744243 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c019630 con 0x561595b45ec0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.554+0000 7f3361ffb700 1 -- 172.21.15.8:0/1269744243 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f336c019790 con 0x561595b45ec0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.554+0000 7f33944a1b80 1 -- 172.21.15.8:0/1269744243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561595b38d50 con 0x561595b45ec0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.554+0000 7f3361ffb700 1 -- 172.21.15.8:0/1269744243 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f336c019950 con 0x561595b45ec0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.554+0000 7f33944a1b80 10 client.25744 fetch_fsmap learned FSMap version 30 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.554+0000 7f33944a1b80 1 -- 172.21.15.8:0/1269744243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5615958acc00 con 0x561595b45ec0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.555+0000 7f3361ffb700 1 -- 172.21.15.8:0/1269744243 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561595b38d50 con 0x561595b45ec0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.555+0000 7f3361ffb700 1 -- 172.21.15.8:0/1269744243 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f336c028020 con 0x561595b45ec0 2023-10-06T23:16:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.555+0000 7f33944a1b80 10 client.25744 fetch_fsmap finished waiting for FSMap version 30 2023-10-06T23:16:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.555+0000 7f33944a1b80 10 client.25744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.555+0000 7f33944a1b80 20 client.25744 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.555+0000 7f33944a1b80 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561595b5b990 0x561595b5ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.555+0000 7f33944a1b80 4 client.25744 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:16:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.555+0000 7f33944a1b80 1 -- 172.21.15.8:0/1269744243 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561595a91db0 con 0x561595b5b990 2023-10-06T23:16:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.556+0000 7f337a59c700 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561595b5b990 0x561595b5ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.556+0000 7f3361ffb700 10 client.25744 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.556+0000 7f337a59c700 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561595b5b990 0x561595b5ddb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=face392a86e1192f server_cookie=d0ff9c4536dde1d0 in_seq=0 out_seq=0 2023-10-06T23:16:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.557+0000 7f3361ffb700 1 -- 172.21.15.8:0/1269744243 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561595a91db0 con 0x561595b5b990 2023-10-06T23:16:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.557+0000 7f3361ffb700 10 client.25744 handle_command_reply: tid=0 2023-10-06T23:16:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.557+0000 7f33944a1b80 1 client.25744 shutdown 2023-10-06T23:16:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.557+0000 7f33944a1b80 1 -- 172.21.15.8:0/1269744243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b45ec0 msgr2=0x561595b4fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.557+0000 7f33944a1b80 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b45ec0 0x561595b4fc30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f336c00edb0 tx=0x7f336c00ee90 comp rx=0 tx=0).stop 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 1 -- 172.21.15.8:0/1269744243 shutdown_connections 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561595b5b990 0x561595b5ddb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b45ec0 0x561595b4fc30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f3361ffb700 0 client.25744 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 1 --2- 172.21.15.8:0/1269744243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 0x561595b50170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 1 -- 172.21.15.8:0/1269744243 >> 172.21.15.8:0/1269744243 conn(0x561595aba200 msgr2=0x561595b40250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 1 -- 172.21.15.8:0/1269744243 shutdown_connections 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 1 -- 172.21.15.8:0/1269744243 wait complete. 2023-10-06T23:16:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.558+0000 7f33944a1b80 20 client.25744 trim_cache size 0 max 16384 2023-10-06T23:16:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.578+0000 7f33944a1b80 1 Processor -- start 2023-10-06T23:16:54.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.578+0000 7f33944a1b80 1 -- start start 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b4f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b46fd0 0x561595b57170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b4de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f33944a1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615959198c0 con 0x561595b45ec0 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f33944a1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595b3b260 con 0x561595b47990 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f33944a1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595b4a480 con 0x561595b46fd0 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f337259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b4f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f337259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b4f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38262/0 (socket says 172.21.15.8:38262) 2023-10-06T23:16:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f337ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b4de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f337259c700 1 -- 172.21.15.8:0/2799613513 learned_addr learned my addr 172.21.15.8:0/2799613513 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:54.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f337a59c700 1 --2- 172.21.15.8:0/2799613513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b46fd0 0x561595b57170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f337ad9d700 1 -- 172.21.15.8:0/2799613513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b46fd0 msgr2=0x561595b57170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:54.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.579+0000 7f337ad9d700 1 --2- 172.21.15.8:0/2799613513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b46fd0 0x561595b57170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.580+0000 7f337ad9d700 1 -- 172.21.15.8:0/2799613513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 msgr2=0x561595b4f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:54.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.580+0000 7f337ad9d700 1 --2- 172.21.15.8:0/2799613513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b4f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.580+0000 7f337ad9d700 1 -- 172.21.15.8:0/2799613513 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615958ea1f0 con 0x561595b47990 2023-10-06T23:16:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.580+0000 7f337ad9d700 1 --2- 172.21.15.8:0/2799613513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b4de00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33740164b0 tx=0x7f3374016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd696990f1812a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:54.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.580+0000 7f337159a700 1 -- 172.21.15.8:0/2799613513 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400e040 con 0x561595b47990 2023-10-06T23:16:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.580+0000 7f337159a700 1 -- 172.21.15.8:0/2799613513 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f337400f040 con 0x561595b47990 2023-10-06T23:16:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.580+0000 7f337159a700 1 -- 172.21.15.8:0/2799613513 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374024420 con 0x561595b47990 2023-10-06T23:16:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.581+0000 7f33944a1b80 1 -- 172.21.15.8:0/2799613513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 msgr2=0x561595b4de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.581+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2799613513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b4de00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33740164b0 tx=0x7f3374016000 comp rx=0 tx=0).stop 2023-10-06T23:16:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.581+0000 7f33944a1b80 1 -- 172.21.15.8:0/2799613513 shutdown_connections 2023-10-06T23:16:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.581+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2799613513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b45ec0 0x561595b4f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.581+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2799613513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b47990 0x561595b4de00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.581+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2799613513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b46fd0 0x561595b57170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.581+0000 7f33944a1b80 1 -- 172.21.15.8:0/2799613513 >> 172.21.15.8:0/2799613513 conn(0x561595aba200 msgr2=0x561595b4e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.581+0000 7f33944a1b80 1 -- 172.21.15.8:0/2799613513 shutdown_connections 2023-10-06T23:16:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.582+0000 7f33944a1b80 1 -- 172.21.15.8:0/2799613513 wait complete. 2023-10-06T23:16:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.582+0000 7f33944a1b80 1 -- start start 2023-10-06T23:16:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.582+0000 7f33944a1b80 1 Processor -- start 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b45ec0 0x561595b56a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 0x561595b56f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f33944a1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 0x561595b55020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f33944a1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595b55560 con 0x561595b46fd0 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f33944a1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595b556d0 con 0x561595b45ec0 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f33944a1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561595b55840 con 0x561595b47990 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f33944a1b80 10 client.0 _ll_register_callbacks cb 0x7f336c009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f337259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b45ec0 0x561595b56a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f337259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b45ec0 0x561595b56a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37562/0 (socket says 172.21.15.8:37562) 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f337259c700 1 -- 172.21.15.8:0/2100887366 learned_addr learned my addr 172.21.15.8:0/2100887366 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:16:54.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.583+0000 7f337ad9d700 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 0x561595b55020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f337a59c700 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 0x561595b56f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f337259c700 1 -- 172.21.15.8:0/2100887366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 msgr2=0x561595b55020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f337259c700 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 0x561595b55020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f337259c700 1 -- 172.21.15.8:0/2100887366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 msgr2=0x561595b56f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f337259c700 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 0x561595b56f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f337259c700 1 -- 172.21.15.8:0/2100887366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3374007cd0 con 0x561595b45ec0 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f337259c700 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b45ec0 0x561595b56a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f336c00efd0 tx=0x7f336c009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=843dee29eac867af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f3361ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.584+0000 7f3361ffb700 1 -- 172.21.15.8:0/2100887366 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c019840 con 0x561595b45ec0 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.585+0000 7f33944a1b80 1 -- 172.21.15.8:0/2100887366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f336c019c20 con 0x561595b45ec0 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.585+0000 7f3361ffb700 1 -- 172.21.15.8:0/2100887366 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f336c000e40 con 0x561595b45ec0 2023-10-06T23:16:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.585+0000 7f3361ffb700 1 -- 172.21.15.8:0/2100887366 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f336c0199a0 con 0x561595b45ec0 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.585+0000 7f33944a1b80 10 client.25706 fetch_fsmap learned FSMap version 30 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.585+0000 7f33944a1b80 1 -- 172.21.15.8:0/2100887366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5615958c2250 con 0x561595b45ec0 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f3361ffb700 1 -- 172.21.15.8:0/2100887366 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f336c019c20 con 0x561595b45ec0 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f3361ffb700 1 -- 172.21.15.8:0/2100887366 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f336c011840 con 0x561595b45ec0 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f33944a1b80 10 client.25706 fetch_fsmap finished waiting for FSMap version 30 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f33944a1b80 10 client.25706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f33944a1b80 20 client.25706 populate_metadata read hostname 'smithi008' 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561595bb05e0 0x561595bb2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f33944a1b80 4 client.25706 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f33944a1b80 1 -- 172.21.15.8:0/2100887366 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561595a91ad0 con 0x561595bb05e0 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.586+0000 7f337a59c700 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561595bb05e0 0x561595bb2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:16:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.587+0000 7f337a59c700 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561595bb05e0 0x561595bb2a00 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad2c4937b8499e4 server_cookie=3c7ecf9c60e5da17 in_seq=0 out_seq=0 2023-10-06T23:16:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.587+0000 7f3361ffb700 10 client.25706 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.603+0000 7f3361ffb700 1 -- 172.21.15.8:0/2100887366 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561595a91ad0 con 0x561595bb05e0 2023-10-06T23:16:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.603+0000 7f3361ffb700 10 client.25706 handle_command_reply: tid=0 2023-10-06T23:16:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 client.25706 shutdown 2023-10-06T23:16:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 -- 172.21.15.8:0/2100887366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b45ec0 msgr2=0x561595b56a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b45ec0 0x561595b56a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f336c00efd0 tx=0x7f336c009300 comp rx=0 tx=0).stop 2023-10-06T23:16:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 -- 172.21.15.8:0/2100887366 shutdown_connections 2023-10-06T23:16:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561595bb05e0 0x561595bb2a00 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561595b47990 0x561595b55020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561595b45ec0 0x561595b56a10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 --2- 172.21.15.8:0/2100887366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561595b46fd0 0x561595b56f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 -- 172.21.15.8:0/2100887366 >> 172.21.15.8:0/2100887366 conn(0x561595aba200 msgr2=0x561595b4de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f3361ffb700 0 client.25706 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.604+0000 7f33944a1b80 1 -- 172.21.15.8:0/2100887366 shutdown_connections 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.605+0000 7f33944a1b80 1 -- 172.21.15.8:0/2100887366 wait complete. 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.605+0000 7f33944a1b80 20 client.25706 trim_cache size 0 max 16384 2023-10-06T23:16:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:16:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:16:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:16:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:16:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 -- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33680a1650 msgr2=0x7f33680a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33680a1650 0x7f33680a3b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x561595b45c60 tx=0x7f337400b040 comp rx=0 tx=0).stop 2023-10-06T23:16:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 -- 172.21.15.8:0/1832451045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c074ef0 msgr2=0x7f337c19d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:16:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c074ef0 0x7f337c19d7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33640098e0 tx=0x7f3364004730 comp rx=0 tx=0).stop 2023-10-06T23:16:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 -- 172.21.15.8:0/1832451045 shutdown_connections 2023-10-06T23:16:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33680a1650 0x7f33680a3b10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c10d4d0 0x7f337c19e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f337c073910 0x7f337c19d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:16:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 --2- 172.21.15.8:0/1832451045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f337c074ef0 0x7f337c19d7c0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33640098e0 tx=0x7f3364004730 comp rx=0 tx=0).stop 2023-10-06T23:16:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 -- 172.21.15.8:0/1832451045 >> 172.21.15.8:0/1832451045 conn(0x7f337c0fc430 msgr2=0x7f337c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:16:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 -- 172.21.15.8:0/1832451045 shutdown_connections 2023-10-06T23:16:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:16:54.606+0000 7f3380bff700 1 -- 172.21.15.8:0/1832451045 wait complete. 2023-10-06T23:16:56.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:56 smithi156 ceph-mon[102862]: pgmap v471: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-06T23:16:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:56 smithi008 ceph-mon[98532]: pgmap v471: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-06T23:16:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:56 smithi190 ceph-mon[102658]: pgmap v471: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-06T23:16:58.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:16:58 smithi156 ceph-mon[102862]: pgmap v472: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 5.0 MiB/s wr, 497 op/s 2023-10-06T23:16:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:16:58 smithi008 ceph-mon[98532]: pgmap v472: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 5.0 MiB/s wr, 497 op/s 2023-10-06T23:16:58.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:16:58 smithi190 ceph-mon[102658]: pgmap v472: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 5.0 MiB/s wr, 497 op/s 2023-10-06T23:16:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 125.0 s, 201.0 tps, lat 423.242 ms stddev 90.144 2023-10-06T23:17:00.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:00 smithi156 ceph-mon[102862]: pgmap v473: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 4.3 MiB/s wr, 503 op/s 2023-10-06T23:17:00.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:00 smithi008 ceph-mon[98532]: pgmap v473: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 4.3 MiB/s wr, 503 op/s 2023-10-06T23:17:00.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:00 smithi190 ceph-mon[102658]: pgmap v473: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 4.3 MiB/s wr, 503 op/s 2023-10-06T23:17:02.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:02 smithi156 ceph-mon[102862]: pgmap v474: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2023-10-06T23:17:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:02 smithi008 ceph-mon[98532]: pgmap v474: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2023-10-06T23:17:02.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:02 smithi190 ceph-mon[102658]: pgmap v474: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2023-10-06T23:17:03.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:03 smithi156 ceph-mon[102862]: pgmap v475: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-06T23:17:03.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:03 smithi008 ceph-mon[98532]: pgmap v475: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-06T23:17:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:03 smithi190 ceph-mon[102658]: pgmap v475: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-06T23:17:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 130.0 s, 253.0 tps, lat 454.698 ms stddev 237.311 2023-10-06T23:17:06.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:06 smithi156 ceph-mon[102862]: pgmap v476: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.7 MiB/s wr, 616 op/s 2023-10-06T23:17:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:06 smithi008 ceph-mon[98532]: pgmap v476: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.7 MiB/s wr, 616 op/s 2023-10-06T23:17:06.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:06 smithi190 ceph-mon[102658]: pgmap v476: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.7 MiB/s wr, 616 op/s 2023-10-06T23:17:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.813+0000 7f2032fff700 1 -- 172.21.15.8:0/3546293127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f202c0ff5c0 msgr2=0x7f202c1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.813+0000 7f2032fff700 1 --2- 172.21.15.8:0/3546293127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f202c0ff5c0 0x7f202c1065c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2018009990 tx=0x7f2018009ca0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.813+0000 7f2032fff700 1 -- 172.21.15.8:0/3546293127 shutdown_connections 2023-10-06T23:17:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.813+0000 7f2032fff700 1 --2- 172.21.15.8:0/3546293127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c106b90 0x7f202c109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.813+0000 7f2032fff700 1 --2- 172.21.15.8:0/3546293127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f202c0fec60 0x7f202c0ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.813+0000 7f2032fff700 1 --2- 172.21.15.8:0/3546293127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f202c0ff5c0 0x7f202c1065c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.813+0000 7f2032fff700 1 -- 172.21.15.8:0/3546293127 >> 172.21.15.8:0/3546293127 conn(0x7f202c0fa690 msgr2=0x7f202c0fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.814+0000 7f2032fff700 1 -- 172.21.15.8:0/3546293127 shutdown_connections 2023-10-06T23:17:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.814+0000 7f2032fff700 1 -- 172.21.15.8:0/3546293127 wait complete. 2023-10-06T23:17:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.815+0000 7f2032fff700 1 Processor -- start 2023-10-06T23:17:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.815+0000 7f2032fff700 1 -- start start 2023-10-06T23:17:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2032fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f202c0fec60 0x7f202c198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2032fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c0ff5c0 0x7f202c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2032fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f202c106b90 0x7f202c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2032fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c19a870 con 0x7f202c0ff5c0 2023-10-06T23:17:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2032fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c19a9e0 con 0x7f202c106b90 2023-10-06T23:17:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2032fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c19aba0 con 0x7f202c0fec60 2023-10-06T23:17:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2030d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f202c0fec60 0x7f202c198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2030d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f202c0fec60 0x7f202c198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60510/0 (socket says 172.21.15.8:60510) 2023-10-06T23:17:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f2030d9b700 1 -- 172.21.15.8:0/2772905956 learned_addr learned my addr 172.21.15.8:0/2772905956 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f202bfff700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c0ff5c0 0x7f202c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.816+0000 7f203159c700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f202c106b90 0x7f202c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.817+0000 7f2030d9b700 1 -- 172.21.15.8:0/2772905956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f202c106b90 msgr2=0x7f202c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.817+0000 7f2030d9b700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f202c106b90 0x7f202c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.817+0000 7f2030d9b700 1 -- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c0ff5c0 msgr2=0x7f202c199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.819 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.817+0000 7f2030d9b700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c0ff5c0 0x7f202c199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.817+0000 7f2030d9b700 1 -- 172.21.15.8:0/2772905956 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20180095f0 con 0x7f202c0fec60 2023-10-06T23:17:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.817+0000 7f2030d9b700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f202c0fec60 0x7f202c198ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f202000e9a0 tx=0x7f202000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.818+0000 7f2029ffb700 1 -- 172.21.15.8:0/2772905956 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020009790 con 0x7f202c0fec60 2023-10-06T23:17:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.818+0000 7f2029ffb700 1 -- 172.21.15.8:0/2772905956 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2020010430 con 0x7f202c0fec60 2023-10-06T23:17:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.818+0000 7f2029ffb700 1 -- 172.21.15.8:0/2772905956 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000cea0 con 0x7f202c0fec60 2023-10-06T23:17:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.818+0000 7f2032fff700 1 -- 172.21.15.8:0/2772905956 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c19ae80 con 0x7f202c0fec60 2023-10-06T23:17:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.818+0000 7f2032fff700 1 -- 172.21.15.8:0/2772905956 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c1a15a0 con 0x7f202c0fec60 2023-10-06T23:17:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.823+0000 7f2029ffb700 1 -- 172.21.15.8:0/2772905956 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f202000ca10 con 0x7f202c0fec60 2023-10-06T23:17:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.825+0000 7f20468c1b80 1 Processor -- start 2023-10-06T23:17:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.825+0000 7f20468c1b80 1 -- start start 2023-10-06T23:17:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f2029ffb700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f201c0a1500 0x7f201c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd77af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd78c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f20468c1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbcd7400 con 0x5630cbd787e0 2023-10-06T23:17:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f20468c1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbcc8bc0 con 0x5630cbd776d0 2023-10-06T23:17:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f20468c1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbcc64e0 con 0x5630cbd791a0 2023-10-06T23:17:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f2029ffb700 1 -- 172.21.15.8:0/2772905956 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2020014070 con 0x7f202c0fec60 2023-10-06T23:17:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f2030d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd77af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f203159c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f203159c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60514/0 (socket says 172.21.15.8:60514) 2023-10-06T23:17:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.826+0000 7f203159c700 1 -- 172.21.15.8:0/630262161 learned_addr learned my addr 172.21.15.8:0/630262161 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.827+0000 7f202bfff700 1 --2- 172.21.15.8:0/630262161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd78c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.827+0000 7f203159c700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f201c0a1500 0x7f201c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.827+0000 7f203159c700 1 -- 172.21.15.8:0/630262161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 msgr2=0x5630cbd77af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.827+0000 7f203159c700 1 --2- 172.21.15.8:0/630262161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd77af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.827+0000 7f203159c700 1 -- 172.21.15.8:0/630262161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 msgr2=0x5630cbd78c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.827+0000 7f203159c700 1 --2- 172.21.15.8:0/630262161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd78c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.827+0000 7f203159c700 1 -- 172.21.15.8:0/630262161 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630cbaecd80 con 0x5630cbd791a0 2023-10-06T23:17:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.828+0000 7f203159c700 1 --2- 172.21.15.8:0/630262161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7fa30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2024007860 tx=0x7f2024007b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f59696eb0cc5aefa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.828+0000 7f2016ffd700 1 -- 172.21.15.8:0/630262161 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024019ce0 con 0x5630cbd791a0 2023-10-06T23:17:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.828+0000 7f2016ffd700 1 -- 172.21.15.8:0/630262161 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f202401e070 con 0x5630cbd791a0 2023-10-06T23:17:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.829+0000 7f2016ffd700 1 -- 172.21.15.8:0/630262161 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240173d0 con 0x5630cbd791a0 2023-10-06T23:17:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.829+0000 7f20468c1b80 1 -- 172.21.15.8:0/630262161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 msgr2=0x5630cbd7fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f20468c1b80 1 --2- 172.21.15.8:0/630262161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7fa30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2024007860 tx=0x7f2024007b70 comp rx=0 tx=0).stop 2023-10-06T23:17:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f203159c700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f201c0a1500 0x7f201c0a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2024021000 tx=0x7f202401e000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f20468c1b80 1 -- 172.21.15.8:0/630262161 shutdown_connections 2023-10-06T23:17:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f20468c1b80 1 --2- 172.21.15.8:0/630262161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7fa30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f20468c1b80 1 --2- 172.21.15.8:0/630262161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd77af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f20468c1b80 1 --2- 172.21.15.8:0/630262161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd78c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f20468c1b80 1 -- 172.21.15.8:0/630262161 >> 172.21.15.8:0/630262161 conn(0x5630cbce3200 msgr2=0x5630cbd69b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f20468c1b80 1 -- 172.21.15.8:0/630262161 shutdown_connections 2023-10-06T23:17:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.830+0000 7f20468c1b80 1 -- 172.21.15.8:0/630262161 wait complete. 2023-10-06T23:17:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.831+0000 7f20468c1b80 1 -- start start 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.831+0000 7f20468c1b80 1 Processor -- start 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.831+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd776d0 0x5630cbd81350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.831+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd787e0 0x5630cbd81890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.831+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd791a0 0x5630cbd888d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f20468c1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbcc1dd0 con 0x5630cbd791a0 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f20468c1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbc5e6b0 con 0x5630cbd787e0 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f20468c1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbc5e350 con 0x5630cbd776d0 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f20468c1b80 10 client.0 _ll_register_callbacks cb 0x5630cbabb7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f202bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd787e0 0x5630cbd81890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f202bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd787e0 0x5630cbd81890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:34974/0 (socket says 172.21.15.8:34974) 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f202bfff700 1 -- 172.21.15.8:0/921904014 learned_addr learned my addr 172.21.15.8:0/921904014 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f203159c700 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd791a0 0x5630cbd888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.832+0000 7f2030d9b700 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd776d0 0x5630cbd81350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f202bfff700 1 -- 172.21.15.8:0/921904014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd776d0 msgr2=0x5630cbd81350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f202bfff700 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd776d0 0x5630cbd81350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f202bfff700 1 -- 172.21.15.8:0/921904014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd791a0 msgr2=0x5630cbd888d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f202bfff700 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd791a0 0x5630cbd888d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f202bfff700 1 -- 172.21.15.8:0/921904014 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2024011040 con 0x5630cbd787e0 2023-10-06T23:17:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f2030d9b700 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd776d0 0x5630cbd81350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:17:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f202bfff700 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd787e0 0x5630cbd81890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2018009990 tx=0x7f2018005390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d658f70d7c2990f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f200bfff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:17:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f200bfff700 1 -- 172.21.15.8:0/921904014 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201801d070 con 0x5630cbd787e0 2023-10-06T23:17:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.833+0000 7f20468c1b80 1 -- 172.21.15.8:0/921904014 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630cbd61d50 con 0x5630cbd787e0 2023-10-06T23:17:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.834+0000 7f200bfff700 1 -- 172.21.15.8:0/921904014 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2018003a90 con 0x5630cbd787e0 2023-10-06T23:17:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.834+0000 7f200bfff700 1 -- 172.21.15.8:0/921904014 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2018003c50 con 0x5630cbd787e0 2023-10-06T23:17:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.834+0000 7f20468c1b80 10 client.25718 fetch_fsmap learned FSMap version 31 2023-10-06T23:17:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.834+0000 7f20468c1b80 1 -- 172.21.15.8:0/921904014 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5630cbad5c00 con 0x5630cbd787e0 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.834+0000 7f200bfff700 1 -- 172.21.15.8:0/921904014 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5630cbd61d50 con 0x5630cbd787e0 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.835+0000 7f200bfff700 1 -- 172.21.15.8:0/921904014 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 31) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2018004770 con 0x5630cbd787e0 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.835+0000 7f20468c1b80 10 client.25718 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.835+0000 7f20468c1b80 10 client.25718 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.835+0000 7f20468c1b80 20 client.25718 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.835+0000 7f20468c1b80 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5630cbd8d250 0x5630cbd8f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.835+0000 7f20468c1b80 4 client.25718 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.835+0000 7f20468c1b80 1 -- 172.21.15.8:0/921904014 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630cbcbadb0 con 0x5630cbd8d250 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.835+0000 7f2030d9b700 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5630cbd8d250 0x5630cbd8f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.836+0000 7f200bfff700 10 client.25718 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.836+0000 7f2030d9b700 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5630cbd8d250 0x5630cbd8f670 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13769dcbd3095696 server_cookie=a2483930de270d2b in_seq=0 out_seq=0 2023-10-06T23:17:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.837+0000 7f200bfff700 1 -- 172.21.15.8:0/921904014 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5630cbcbadb0 con 0x5630cbd8d250 2023-10-06T23:17:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.837+0000 7f200bfff700 10 client.25718 handle_command_reply: tid=0 2023-10-06T23:17:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.837+0000 7f20468c1b80 1 client.25718 shutdown 2023-10-06T23:17:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.837+0000 7f20468c1b80 1 -- 172.21.15.8:0/921904014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd787e0 msgr2=0x5630cbd81890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.837+0000 7f20468c1b80 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd787e0 0x5630cbd81890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2018009990 tx=0x7f2018005390 comp rx=0 tx=0).stop 2023-10-06T23:17:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 1 -- 172.21.15.8:0/921904014 shutdown_connections 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5630cbd8d250 0x5630cbd8f670 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd791a0 0x5630cbd888d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd776d0 0x5630cbd81350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 1 --2- 172.21.15.8:0/921904014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd787e0 0x5630cbd81890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 1 -- 172.21.15.8:0/921904014 >> 172.21.15.8:0/921904014 conn(0x5630cbce3200 msgr2=0x5630cbd69250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f200bfff700 0 client.25718 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 1 -- 172.21.15.8:0/921904014 shutdown_connections 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 1 -- 172.21.15.8:0/921904014 wait complete. 2023-10-06T23:17:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.838+0000 7f20468c1b80 20 client.25718 trim_cache size 0 max 16384 2023-10-06T23:17:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.860+0000 7f20468c1b80 1 Processor -- start 2023-10-06T23:17:07.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.860+0000 7f20468c1b80 1 -- start start 2023-10-06T23:17:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd8f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd88890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f20468c1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbd80f20 con 0x5630cbd787e0 2023-10-06T23:17:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f20468c1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbb428c0 con 0x5630cbd776d0 2023-10-06T23:17:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f20468c1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbd795f0 con 0x5630cbd791a0 2023-10-06T23:17:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f2030d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd8f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f2030d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd8f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:34990/0 (socket says 172.21.15.8:34990) 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f2030d9b700 1 -- 172.21.15.8:0/2094464865 learned_addr learned my addr 172.21.15.8:0/2094464865 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.861+0000 7f202bfff700 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd88890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f203159c700 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f2030d9b700 1 -- 172.21.15.8:0/2094464865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 msgr2=0x5630cbd7f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f2030d9b700 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f2030d9b700 1 -- 172.21.15.8:0/2094464865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 msgr2=0x5630cbd88890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f2030d9b700 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd88890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f2030d9b700 1 -- 172.21.15.8:0/2094464865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630cbb131f0 con 0x5630cbd776d0 2023-10-06T23:17:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f2030d9b700 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd8f260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f20200ca8f0 tx=0x7f2020096450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6361c724c32cec3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f20177fe700 1 -- 172.21.15.8:0/2094464865 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20200bc070 con 0x5630cbd776d0 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f20177fe700 1 -- 172.21.15.8:0/2094464865 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f202000ccc0 con 0x5630cbd776d0 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.862+0000 7f20177fe700 1 -- 172.21.15.8:0/2094464865 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20200a2510 con 0x5630cbd776d0 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.863+0000 7f20468c1b80 1 -- 172.21.15.8:0/2094464865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 msgr2=0x5630cbd8f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.863+0000 7f20468c1b80 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd8f260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f20200ca8f0 tx=0x7f2020096450 comp rx=0 tx=0).stop 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.863+0000 7f20468c1b80 1 -- 172.21.15.8:0/2094464865 shutdown_connections 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.863+0000 7f20468c1b80 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd791a0 0x5630cbd7f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.863+0000 7f20468c1b80 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd776d0 0x5630cbd8f260 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f20200ca8f0 tx=0x7f2020096450 comp rx=0 tx=0).stop 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.863+0000 7f20468c1b80 1 --2- 172.21.15.8:0/2094464865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd88890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.864+0000 7f20468c1b80 1 -- 172.21.15.8:0/2094464865 >> 172.21.15.8:0/2094464865 conn(0x5630cbce3200 msgr2=0x5630cbd89160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.864+0000 7f20468c1b80 1 -- 172.21.15.8:0/2094464865 shutdown_connections 2023-10-06T23:17:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.864+0000 7f20468c1b80 1 -- 172.21.15.8:0/2094464865 wait complete. 2023-10-06T23:17:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.864+0000 7f20468c1b80 1 -- start start 2023-10-06T23:17:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.865+0000 7f20468c1b80 1 Processor -- start 2023-10-06T23:17:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.865+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd861a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.865+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd791a0 0x5630cbd866e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.865+0000 7f20468c1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd876f0 0x5630cbd87b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.865+0000 7f20468c1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbd880b0 con 0x5630cbd787e0 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.865+0000 7f20468c1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbd88220 con 0x5630cbd791a0 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.865+0000 7f20468c1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cbd883e0 con 0x5630cbd876f0 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.865+0000 7f20468c1b80 10 client.0 _ll_register_callbacks cb 0x7f2018005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f203159c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd876f0 0x5630cbd87b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f203159c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd876f0 0x5630cbd87b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60550/0 (socket says 172.21.15.8:60550) 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f203159c700 1 -- 172.21.15.8:0/3411167301 learned_addr learned my addr 172.21.15.8:0/3411167301 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f202bfff700 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd791a0 0x5630cbd866e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f2030d9b700 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd861a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f203159c700 1 -- 172.21.15.8:0/3411167301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd791a0 msgr2=0x5630cbd866e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f203159c700 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd791a0 0x5630cbd866e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f203159c700 1 -- 172.21.15.8:0/3411167301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 msgr2=0x5630cbd861a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f203159c700 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd861a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.866+0000 7f203159c700 1 -- 172.21.15.8:0/3411167301 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c1a15a0 con 0x5630cbd876f0 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.867+0000 7f203159c700 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd876f0 0x5630cbd87b70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2024007860 tx=0x7f20240097e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e43cec65a6980217 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.867+0000 7f200bfff700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.867+0000 7f200bfff700 1 -- 172.21.15.8:0/3411167301 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024003e10 con 0x5630cbd876f0 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.867+0000 7f20468c1b80 1 -- 172.21.15.8:0/3411167301 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f202401e070 con 0x5630cbd876f0 2023-10-06T23:17:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.867+0000 7f200bfff700 1 -- 172.21.15.8:0/3411167301 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2024017690 con 0x5630cbd876f0 2023-10-06T23:17:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f200bfff700 1 -- 172.21.15.8:0/3411167301 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2024017850 con 0x5630cbd876f0 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f20468c1b80 10 client.25765 fetch_fsmap learned FSMap version 31 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f20468c1b80 1 -- 172.21.15.8:0/3411167301 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5630cbaeb250 con 0x5630cbd876f0 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f200bfff700 1 -- 172.21.15.8:0/3411167301 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f202401e070 con 0x5630cbd876f0 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f200bfff700 1 -- 172.21.15.8:0/3411167301 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 31) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2024004460 con 0x5630cbd876f0 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f20468c1b80 10 client.25765 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f20468c1b80 10 client.25765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f20468c1b80 20 client.25765 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f20468c1b80 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5630cbde1f90 0x5630cbde43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f20468c1b80 4 client.25765 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:17:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.868+0000 7f20468c1b80 1 -- 172.21.15.8:0/3411167301 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5630cbcbaad0 con 0x5630cbde1f90 2023-10-06T23:17:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.869+0000 7f2030d9b700 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5630cbde1f90 0x5630cbde43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.869+0000 7f2030d9b700 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5630cbde1f90 0x5630cbde43b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ca7827aa0311803 server_cookie=64ce4ccbb4f004f8 in_seq=0 out_seq=0 2023-10-06T23:17:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.869+0000 7f200bfff700 10 client.25765 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.886+0000 7f200bfff700 1 -- 172.21.15.8:0/3411167301 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5630cbcbaad0 con 0x5630cbde1f90 2023-10-06T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.886+0000 7f200bfff700 10 client.25765 handle_command_reply: tid=0 2023-10-06T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.886+0000 7f20468c1b80 1 client.25765 shutdown 2023-10-06T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 -- 172.21.15.8:0/3411167301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd876f0 msgr2=0x5630cbd87b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd876f0 0x5630cbd87b70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2024007860 tx=0x7f20240097e0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 -- 172.21.15.8:0/3411167301 shutdown_connections 2023-10-06T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5630cbde1f90 0x5630cbde43b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5630cbd787e0 0x5630cbd861a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630cbd876f0 0x5630cbd87b70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 --2- 172.21.15.8:0/3411167301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5630cbd791a0 0x5630cbd866e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f200bfff700 0 client.25765 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 -- 172.21.15.8:0/3411167301 >> 172.21.15.8:0/3411167301 conn(0x5630cbce3200 msgr2=0x5630cbd8f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 -- 172.21.15.8:0/3411167301 shutdown_connections 2023-10-06T23:17:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.887+0000 7f20468c1b80 1 -- 172.21.15.8:0/3411167301 wait complete. 2023-10-06T23:17:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.888+0000 7f20468c1b80 20 client.25765 trim_cache size 0 max 16384 2023-10-06T23:17:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:17:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:17:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:17:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:17:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.888+0000 7f2032fff700 1 -- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f201c0a1500 msgr2=0x7f201c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.888+0000 7f2032fff700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f201c0a1500 0x7f201c0a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2024021000 tx=0x7f202401e000 comp rx=0 tx=0).stop 2023-10-06T23:17:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.888+0000 7f2032fff700 1 -- 172.21.15.8:0/2772905956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f202c0fec60 msgr2=0x7f202c198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.888+0000 7f2032fff700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f202c0fec60 0x7f202c198ef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f202000e9a0 tx=0x7f202000ecb0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.889+0000 7f2032fff700 1 -- 172.21.15.8:0/2772905956 shutdown_connections 2023-10-06T23:17:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.889+0000 7f2032fff700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f201c0a1500 0x7f201c0a39c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.889+0000 7f2032fff700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f202c106b90 0x7f202c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.889+0000 7f2032fff700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f202c0fec60 0x7f202c198ef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.889+0000 7f2032fff700 1 --2- 172.21.15.8:0/2772905956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c0ff5c0 0x7f202c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.889+0000 7f2032fff700 1 -- 172.21.15.8:0/2772905956 >> 172.21.15.8:0/2772905956 conn(0x7f202c0fa690 msgr2=0x7f202c0fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.889+0000 7f2032fff700 1 -- 172.21.15.8:0/2772905956 shutdown_connections 2023-10-06T23:17:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:07.889+0000 7f2032fff700 1 -- 172.21.15.8:0/2772905956 wait complete. 2023-10-06T23:17:08.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:08 smithi156 ceph-mon[102862]: pgmap v477: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 6.3 MiB/s wr, 554 op/s 2023-10-06T23:17:08.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:08 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:08 smithi008 ceph-mon[98532]: pgmap v477: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 6.3 MiB/s wr, 554 op/s 2023-10-06T23:17:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:08 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:08.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:08 smithi190 ceph-mon[102658]: pgmap v477: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 6.3 MiB/s wr, 554 op/s 2023-10-06T23:17:08.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:08 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 135.0 s, 252.6 tps, lat 398.432 ms stddev 70.798 2023-10-06T23:17:10.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:10 smithi156 ceph-mon[102862]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2023-10-06T23:17:10.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:10 smithi008 ceph-mon[98532]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2023-10-06T23:17:10.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:10 smithi190 ceph-mon[102658]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2023-10-06T23:17:12.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:12 smithi156 ceph-mon[102862]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 6.3 MiB/s wr, 566 op/s 2023-10-06T23:17:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:12 smithi008 ceph-mon[98532]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 6.3 MiB/s wr, 566 op/s 2023-10-06T23:17:12.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:12 smithi190 ceph-mon[102658]: pgmap v479: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 6.3 MiB/s wr, 566 op/s 2023-10-06T23:17:13.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:13 smithi156 ceph-mon[102862]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 4.6 MiB/s wr, 466 op/s 2023-10-06T23:17:13.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:13 smithi008 ceph-mon[98532]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 4.6 MiB/s wr, 466 op/s 2023-10-06T23:17:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:13 smithi190 ceph-mon[102658]: pgmap v480: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 4.6 MiB/s wr, 466 op/s 2023-10-06T23:17:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 140.0 s, 240.4 tps, lat 414.354 ms stddev 116.569 2023-10-06T23:17:14.797 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:17:15.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 -- 172.21.15.8:0/148706142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4c100ea0 msgr2=0x7f7d4c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 --2- 172.21.15.8:0/148706142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4c100ea0 0x7f7d4c1012c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009990 tx=0x7f7d3c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 -- 172.21.15.8:0/148706142 shutdown_connections 2023-10-06T23:17:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 --2- 172.21.15.8:0/148706142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4c100ea0 0x7f7d4c1012c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 --2- 172.21.15.8:0/148706142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d4c102a40 0x7f7d4c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 --2- 172.21.15.8:0/148706142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d4c102080 0x7f7d4c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 -- 172.21.15.8:0/148706142 >> 172.21.15.8:0/148706142 conn(0x7f7d4c0fc460 msgr2=0x7f7d4c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 -- 172.21.15.8:0/148706142 shutdown_connections 2023-10-06T23:17:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.087+0000 7f7d51dff700 1 -- 172.21.15.8:0/148706142 wait complete. 2023-10-06T23:17:15.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.088+0000 7f7d51dff700 1 Processor -- start 2023-10-06T23:17:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.089+0000 7f7d51dff700 1 -- start start 2023-10-06T23:17:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.089+0000 7f7d51dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d4c100ea0 0x7f7d4c107140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.089+0000 7f7d51dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d4c102080 0x7f7d4c107680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.089+0000 7f7d51dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4c102a40 0x7f7d4c103cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.089+0000 7f7d51dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c104470 con 0x7f7d4c102a40 2023-10-06T23:17:15.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.089+0000 7f7d51dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1045e0 con 0x7f7d4c102080 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.089+0000 7f7d51dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1047a0 con 0x7f7d4c100ea0 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.089+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d4c100ea0 0x7f7d4c107140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d4c100ea0 0x7f7d4c107140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55158/0 (socket says 172.21.15.8:55158) 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3350640895 learned_addr learned my addr 172.21.15.8:0/3350640895 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4affd700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d4c102080 0x7f7d4c107680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4bfff700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4c102a40 0x7f7d4c103cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3350640895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d4c102080 msgr2=0x7f7d4c107680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d4c102080 0x7f7d4c107680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4c102a40 msgr2=0x7f7d4c103cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4c102a40 0x7f7d4c103cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3350640895 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d40009520 con 0x7f7d4c100ea0 2023-10-06T23:17:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4affd700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d4c102080 0x7f7d4c107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:17:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.090+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d4c100ea0 0x7f7d4c107140 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0059d0 tx=0x7f7d3c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.091+0000 7f7d48ff9700 1 -- 172.21.15.8:0/3350640895 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c01d070 con 0x7f7d4c100ea0 2023-10-06T23:17:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.091+0000 7f7d48ff9700 1 -- 172.21.15.8:0/3350640895 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d3c00be30 con 0x7f7d4c100ea0 2023-10-06T23:17:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.091+0000 7f7d48ff9700 1 -- 172.21.15.8:0/3350640895 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c022df0 con 0x7f7d4c100ea0 2023-10-06T23:17:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.091+0000 7f7d51dff700 1 -- 172.21.15.8:0/3350640895 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3c0095f0 con 0x7f7d4c100ea0 2023-10-06T23:17:15.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.091+0000 7f7d51dff700 1 -- 172.21.15.8:0/3350640895 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c198c30 con 0x7f7d4c100ea0 2023-10-06T23:17:15.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.095+0000 7f7d48ff9700 1 -- 172.21.15.8:0/3350640895 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7d3c022570 con 0x7f7d4c100ea0 2023-10-06T23:17:15.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.096+0000 7f7d48ff9700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7d340a1500 0x7f7d340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.097+0000 7f7d48ff9700 1 -- 172.21.15.8:0/3350640895 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7d3c0ce350 con 0x7f7d4c100ea0 2023-10-06T23:17:15.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.097+0000 7f7d4affd700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7d340a1500 0x7f7d340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.097+0000 7f7d657a6b80 1 Processor -- start 2023-10-06T23:17:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.097+0000 7f7d657a6b80 1 -- start start 2023-10-06T23:17:15.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d4affd700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7d340a1500 0x7f7d340a39c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c100bc0 tx=0x7f7d40009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86260 0x557b12f86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f87480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f87ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12eee460 con 0x557b12f86260 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12edfc20 con 0x557b12f86bc0 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12edd540 con 0x557b12f87a60 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86260 0x557b12f86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f87480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86260 0x557b12f86680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39430/0 (socket says 172.21.15.8:39430) 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3201174178 learned_addr learned my addr 172.21.15.8:0/3201174178 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:15.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.098+0000 7f7d4bfff700 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f87ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3201174178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 msgr2=0x557b12f87ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f87ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3201174178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 msgr2=0x557b12f87480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:15.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f87480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3201174178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b12d03de0 con 0x557b12f86260 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d4bfff700 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f87ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86260 0x557b12f86680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0a35a0 tx=0x7f7d3c09b130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f91b2b1ce907824 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d31ffb700 1 -- 172.21.15.8:0/3201174178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c09b7d0 con 0x557b12f86260 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d31ffb700 1 -- 172.21.15.8:0/3201174178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d3c09f920 con 0x557b12f86260 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.099+0000 7f7d31ffb700 1 -- 172.21.15.8:0/3201174178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0a3840 con 0x557b12f86260 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3201174178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86260 msgr2=0x557b12f86680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86260 0x557b12f86680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0a35a0 tx=0x7f7d3c09b130 comp rx=0 tx=0).stop 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3201174178 shutdown_connections 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86260 0x557b12f86680 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f87ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3201174178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f87480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3201174178 >> 172.21.15.8:0/3201174178 conn(0x557b12efa260 msgr2=0x557b12f81140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3201174178 shutdown_connections 2023-10-06T23:17:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.100+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3201174178 wait complete. 2023-10-06T23:17:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.101+0000 7f7d657a6b80 1 -- start start 2023-10-06T23:17:15.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.101+0000 7f7d657a6b80 1 Processor -- start 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86260 0x557b12f8fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f86bc0 0x557b12f90230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f87a60 0x557b12f97270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12ed8e30 con 0x557b12f87a60 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12e75710 con 0x557b12f86260 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12e753b0 con 0x557b12f86bc0 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d657a6b80 10 client.0 _ll_register_callbacks cb 0x557b12cd2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86260 0x557b12f8fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d4bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f87a60 0x557b12f97270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86260 0x557b12f8fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59980/0 (socket says 172.21.15.8:59980) 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/2320196089 learned_addr learned my addr 172.21.15.8:0/2320196089 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d4affd700 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f86bc0 0x557b12f90230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/2320196089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f86bc0 msgr2=0x557b12f90230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.102+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f86bc0 0x557b12f90230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/2320196089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f87a60 msgr2=0x557b12f97270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f87a60 0x557b12f97270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/2320196089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d44011230 con 0x557b12f86260 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d4bfff700 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f87a60 0x557b12f97270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86260 0x557b12f8fcf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c005910 tx=0x7f7d3c097450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2aa2a9c59017d42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d2affd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:17:15.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d2affd700 1 -- 172.21.15.8:0/2320196089 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00bba0 con 0x557b12f86260 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d2affd700 1 -- 172.21.15.8:0/2320196089 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7d3c09af30 con 0x557b12f86260 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d657a6b80 1 -- 172.21.15.8:0/2320196089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b12f78f10 con 0x557b12f86260 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d2affd700 1 -- 172.21.15.8:0/2320196089 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d3c09b7d0 con 0x557b12f86260 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d657a6b80 10 client.25736 fetch_fsmap learned FSMap version 31 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.103+0000 7f7d657a6b80 1 -- 172.21.15.8:0/2320196089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f7d4c198c30 con 0x557b12f86260 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d2affd700 1 -- 172.21.15.8:0/2320196089 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d3c0a7070 con 0x557b12f86260 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d2affd700 1 -- 172.21.15.8:0/2320196089 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 31) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7d3c0a3d20 con 0x557b12f86260 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d657a6b80 10 client.25736 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d657a6b80 10 client.25736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d657a6b80 20 client.25736 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557b12f9b6c0 0x557b12f9dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d657a6b80 4 client.25736 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:17:15.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d657a6b80 1 -- 172.21.15.8:0/2320196089 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b12ed1e10 con 0x557b12f9b6c0 2023-10-06T23:17:15.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.104+0000 7f7d4affd700 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557b12f9b6c0 0x557b12f9dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.105+0000 7f7d2affd700 10 client.25736 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:15.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.105+0000 7f7d4affd700 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557b12f9b6c0 0x557b12f9dae0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48c06b56fe8ddd5f server_cookie=1e6e34ab30d16a3 in_seq=0 out_seq=0 2023-10-06T23:17:15.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d2affd700 1 -- 172.21.15.8:0/2320196089 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557b12ed1e10 con 0x557b12f9b6c0 2023-10-06T23:17:15.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d2affd700 10 client.25736 handle_command_reply: tid=0 2023-10-06T23:17:15.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 client.25736 shutdown 2023-10-06T23:17:15.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 -- 172.21.15.8:0/2320196089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86260 msgr2=0x557b12f8fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86260 0x557b12f8fcf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c005910 tx=0x7f7d3c097450 comp rx=0 tx=0).stop 2023-10-06T23:17:15.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 -- 172.21.15.8:0/2320196089 shutdown_connections 2023-10-06T23:17:15.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557b12f9b6c0 0x557b12f9dae0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f87a60 0x557b12f97270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86260 0x557b12f8fcf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/2320196089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f86bc0 0x557b12f90230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 -- 172.21.15.8:0/2320196089 >> 172.21.15.8:0/2320196089 conn(0x557b12efa260 msgr2=0x557b12f80f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d2affd700 0 client.25736 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 -- 172.21.15.8:0/2320196089 shutdown_connections 2023-10-06T23:17:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.106+0000 7f7d657a6b80 1 -- 172.21.15.8:0/2320196089 wait complete. 2023-10-06T23:17:15.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.107+0000 7f7d657a6b80 20 client.25736 trim_cache size 0 max 16384 2023-10-06T23:17:15.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d657a6b80 1 Processor -- start 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d657a6b80 1 -- start start 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86bc0 0x557b12f8a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f8ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f7fbc0 0x557b12f97230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12d59920 con 0x557b12f86bc0 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12f7b7b0 con 0x557b12f7fbc0 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12f7b300 con 0x557b12f87a60 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86bc0 0x557b12f8a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f8ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f8ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55194/0 (socket says 172.21.15.8:55194) 2023-10-06T23:17:15.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d4affd700 1 -- 172.21.15.8:0/1912832560 learned_addr learned my addr 172.21.15.8:0/1912832560 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:15.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.129+0000 7f7d4bfff700 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f7fbc0 0x557b12f97230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d4affd700 1 -- 172.21.15.8:0/1912832560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f7fbc0 msgr2=0x557b12f97230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:15.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d4affd700 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f7fbc0 0x557b12f97230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d4affd700 1 -- 172.21.15.8:0/1912832560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86bc0 msgr2=0x557b12f8a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d4affd700 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86bc0 0x557b12f8a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d4affd700 1 -- 172.21.15.8:0/1912832560 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b12cecc60 con 0x557b12f87a60 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86bc0 0x557b12f8a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d4affd700 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f8ae70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d400098c0 tx=0x7f7d40014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41c1a45f9917ac27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d327fc700 1 -- 172.21.15.8:0/1912832560 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4002e070 con 0x557b12f87a60 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d327fc700 1 -- 172.21.15.8:0/1912832560 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d40016070 con 0x557b12f87a60 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.130+0000 7f7d327fc700 1 -- 172.21.15.8:0/1912832560 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40025040 con 0x557b12f87a60 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.131+0000 7f7d657a6b80 1 -- 172.21.15.8:0/1912832560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 msgr2=0x557b12f8ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.131+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f8ae70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d400098c0 tx=0x7f7d40014000 comp rx=0 tx=0).stop 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.131+0000 7f7d657a6b80 1 -- 172.21.15.8:0/1912832560 shutdown_connections 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.131+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f86bc0 0x557b12f8a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.131+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f7fbc0 0x557b12f97230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.131+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/1912832560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f8ae70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.131+0000 7f7d657a6b80 1 -- 172.21.15.8:0/1912832560 >> 172.21.15.8:0/1912832560 conn(0x557b12efa260 msgr2=0x557b12f97b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.131+0000 7f7d657a6b80 1 -- 172.21.15.8:0/1912832560 shutdown_connections 2023-10-06T23:17:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.132+0000 7f7d657a6b80 1 -- 172.21.15.8:0/1912832560 wait complete. 2023-10-06T23:17:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.132+0000 7f7d657a6b80 1 -- start start 2023-10-06T23:17:15.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.132+0000 7f7d657a6b80 1 Processor -- start 2023-10-06T23:17:15.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f7fbc0 0x557b12f93000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f93540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d657a6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f96560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12f96aa0 con 0x557b12f7fbc0 2023-10-06T23:17:15.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12f96c10 con 0x557b12f86bc0 2023-10-06T23:17:15.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d657a6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12f96dd0 con 0x557b12f87a60 2023-10-06T23:17:15.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d657a6b80 10 client.0 _ll_register_callbacks cb 0x7f7d40009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:15.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f7fbc0 0x557b12f93000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f7fbc0 0x557b12f93000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39460/0 (socket says 172.21.15.8:39460) 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d4b7fe700 1 -- 172.21.15.8:0/3204671992 learned_addr learned my addr 172.21.15.8:0/3204671992 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d4affd700 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f93540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.133+0000 7f7d4bfff700 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f96560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d4affd700 1 -- 172.21.15.8:0/3204671992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 msgr2=0x557b12f96560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d4affd700 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f96560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d4affd700 1 -- 172.21.15.8:0/3204671992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f7fbc0 msgr2=0x557b12f93000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d4affd700 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f7fbc0 0x557b12f93000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d4affd700 1 -- 172.21.15.8:0/3204671992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c198c30 con 0x557b12f86bc0 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f7fbc0 0x557b12f93000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d4affd700 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f93540 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d40004360 tx=0x7f7d40009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57f25496ed571975 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:15.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d2affd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d2affd700 1 -- 172.21.15.8:0/3204671992 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4002e040 con 0x557b12f86bc0 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d2affd700 1 -- 172.21.15.8:0/3204671992 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7d40018070 con 0x557b12f86bc0 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.134+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3204671992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d3c09f920 con 0x557b12f86bc0 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d2affd700 1 -- 172.21.15.8:0/3204671992 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d40025040 con 0x557b12f86bc0 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d657a6b80 10 client.25742 fetch_fsmap learned FSMap version 31 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3204671992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f7d40009b80 con 0x557b12f86bc0 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d2affd700 1 -- 172.21.15.8:0/3204671992 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d40041020 con 0x557b12f86bc0 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d2affd700 1 -- 172.21.15.8:0/3204671992 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 31) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7d400038b0 con 0x557b12f86bc0 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d657a6b80 10 client.25742 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d657a6b80 10 client.25742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:15.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d657a6b80 20 client.25742 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557b12ff04c0 0x557b12ff2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d657a6b80 4 client.25742 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.135+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3204671992 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557b12ed1b30 con 0x557b12ff04c0 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.136+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557b12ff04c0 0x557b12ff2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.136+0000 7f7d4b7fe700 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557b12ff04c0 0x557b12ff2900 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816be2b11e326a76 server_cookie=1979f3b4c4f66d1b in_seq=0 out_seq=0 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.136+0000 7f7d2affd700 10 client.25742 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d2affd700 1 -- 172.21.15.8:0/3204671992 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557b12ed1b30 con 0x557b12ff04c0 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d2affd700 10 client.25742 handle_command_reply: tid=0 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 client.25742 shutdown 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 msgr2=0x557b12f93540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f93540 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d40004360 tx=0x7f7d40009f50 comp rx=0 tx=0).stop 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3204671992 shutdown_connections 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557b12ff04c0 0x557b12ff2900 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557b12f7fbc0 0x557b12f93000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b12f87a60 0x557b12f96560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 --2- 172.21.15.8:0/3204671992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b12f86bc0 0x557b12f93540 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3204671992 >> 172.21.15.8:0/3204671992 conn(0x557b12efa260 msgr2=0x557b12f8a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d2affd700 0 client.25742 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3204671992 shutdown_connections 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 1 -- 172.21.15.8:0/3204671992 wait complete. 2023-10-06T23:17:15.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.137+0000 7f7d657a6b80 20 client.25742 trim_cache size 0 max 16384 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:17:15.144 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:17:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 -- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7d340a1500 msgr2=0x7f7d340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7d340a1500 0x7f7d340a39c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c100bc0 tx=0x7f7d40009260 comp rx=0 tx=0).stop 2023-10-06T23:17:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 -- 172.21.15.8:0/3350640895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d4c100ea0 msgr2=0x7f7d4c107140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d4c100ea0 0x7f7d4c107140 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0059d0 tx=0x7f7d3c004730 comp rx=0 tx=0).stop 2023-10-06T23:17:15.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 -- 172.21.15.8:0/3350640895 shutdown_connections 2023-10-06T23:17:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7d340a1500 0x7f7d340a39c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4c102a40 0x7f7d4c103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d4c100ea0 0x7f7d4c107140 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 --2- 172.21.15.8:0/3350640895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d4c102080 0x7f7d4c107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 -- 172.21.15.8:0/3350640895 >> 172.21.15.8:0/3350640895 conn(0x7f7d4c0fc460 msgr2=0x7f7d4c0fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 -- 172.21.15.8:0/3350640895 shutdown_connections 2023-10-06T23:17:15.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:15.138+0000 7f7d51dff700 1 -- 172.21.15.8:0/3350640895 wait complete. 2023-10-06T23:17:15.161 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:17:16.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:16 smithi156 ceph-mon[102862]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 4.9 MiB/s wr, 539 op/s 2023-10-06T23:17:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:16 smithi008 ceph-mon[98532]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 4.9 MiB/s wr, 539 op/s 2023-10-06T23:17:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:16 smithi190 ceph-mon[102658]: pgmap v481: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 4.9 MiB/s wr, 539 op/s 2023-10-06T23:17:18.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:18 smithi156 ceph-mon[102862]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 4.7 MiB/s wr, 531 op/s 2023-10-06T23:17:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:18 smithi008 ceph-mon[98532]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 4.7 MiB/s wr, 531 op/s 2023-10-06T23:17:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:18 smithi190 ceph-mon[102658]: pgmap v482: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 4.7 MiB/s wr, 531 op/s 2023-10-06T23:17:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 145.0 s, 233.6 tps, lat 426.088 ms stddev 244.304 2023-10-06T23:17:20.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:20 smithi156 ceph-mon[102862]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 6.3 MiB/s wr, 613 op/s 2023-10-06T23:17:20.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:20 smithi008 ceph-mon[98532]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 6.3 MiB/s wr, 613 op/s 2023-10-06T23:17:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:20 smithi190 ceph-mon[102658]: pgmap v483: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 6.3 MiB/s wr, 613 op/s 2023-10-06T23:17:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.082+0000 7fce1bfff700 1 -- 172.21.15.8:0/142469115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 msgr2=0x7fce140ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.082+0000 7fce1bfff700 1 --2- 172.21.15.8:0/142469115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 0x7fce140ffb80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009990 tx=0x7fce0c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.082+0000 7fce1bfff700 1 -- 172.21.15.8:0/142469115 shutdown_connections 2023-10-06T23:17:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.082+0000 7fce1bfff700 1 --2- 172.21.15.8:0/142469115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce14100a80 0x7fce14100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.082+0000 7fce1bfff700 1 --2- 172.21.15.8:0/142469115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 0x7fce140ffb80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.082+0000 7fce1bfff700 1 --2- 172.21.15.8:0/142469115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce141000c0 0x7fce14100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.082+0000 7fce1bfff700 1 -- 172.21.15.8:0/142469115 >> 172.21.15.8:0/142469115 conn(0x7fce140fb340 msgr2=0x7fce140fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.083+0000 7fce1bfff700 1 -- 172.21.15.8:0/142469115 shutdown_connections 2023-10-06T23:17:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.083+0000 7fce1bfff700 1 -- 172.21.15.8:0/142469115 wait complete. 2023-10-06T23:17:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.084+0000 7fce1bfff700 1 Processor -- start 2023-10-06T23:17:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.084+0000 7fce1bfff700 1 -- start start 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 0x7fce14198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce141000c0 0x7fce141993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce14100a80 0x7fce1419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1bfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1419a860 con 0x7fce14100a80 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1bfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1419a9d0 con 0x7fce140ff760 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1bfff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1419ab90 con 0x7fce141000c0 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1959a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce141000c0 0x7fce141993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce19d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 0x7fce14198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1959a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce141000c0 0x7fce141993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52340/0 (socket says 172.21.15.8:52340) 2023-10-06T23:17:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1959a700 1 -- 172.21.15.8:0/1909397619 learned_addr learned my addr 172.21.15.8:0/1909397619 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce19d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 0x7fce14198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50902/0 (socket says 172.21.15.8:50902) 2023-10-06T23:17:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.085+0000 7fce1a59c700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce14100a80 0x7fce1419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.086+0000 7fce19d9b700 1 -- 172.21.15.8:0/1909397619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce141000c0 msgr2=0x7fce141993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.086+0000 7fce19d9b700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce141000c0 0x7fce141993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.086+0000 7fce19d9b700 1 -- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce14100a80 msgr2=0x7fce1419a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.086+0000 7fce19d9b700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce14100a80 0x7fce1419a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.086+0000 7fce19d9b700 1 -- 172.21.15.8:0/1909397619 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0095f0 con 0x7fce140ff760 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.086+0000 7fce1959a700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce141000c0 0x7fce141993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.086+0000 7fce1a59c700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce14100a80 0x7fce1419a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.086+0000 7fce19d9b700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 0x7fce14198e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0098e0 tx=0x7fce0c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.087+0000 7fce12ffd700 1 -- 172.21.15.8:0/1909397619 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c01d070 con 0x7fce140ff760 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.087+0000 7fce1bfff700 1 -- 172.21.15.8:0/1909397619 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1419ae10 con 0x7fce140ff760 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.087+0000 7fce12ffd700 1 -- 172.21.15.8:0/1909397619 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce0c00bdb0 con 0x7fce140ff760 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.087+0000 7fce12ffd700 1 -- 172.21.15.8:0/1909397619 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c022d10 con 0x7fce140ff760 2023-10-06T23:17:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.087+0000 7fce1bfff700 1 -- 172.21.15.8:0/1909397619 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce141a1580 con 0x7fce140ff760 2023-10-06T23:17:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.091+0000 7fce12ffd700 1 -- 172.21.15.8:0/1909397619 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fce0c022470 con 0x7fce140ff760 2023-10-06T23:17:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.093+0000 7fce2f96bb80 1 Processor -- start 2023-10-06T23:17:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce2f96bb80 1 -- start start 2023-10-06T23:17:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce12ffd700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcdfc0a1480 0x7fcdfc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce12ffd700 1 -- 172.21.15.8:0/1909397619 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fce0c0ce290 con 0x7fce140ff760 2023-10-06T23:17:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69047af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69048c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 0x55cf6904fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf68fa7400 con 0x55cf690491a0 2023-10-06T23:17:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf68f98bc0 con 0x55cf690476d0 2023-10-06T23:17:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.094+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf68f964e0 con 0x55cf690487e0 2023-10-06T23:17:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1959a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69048c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1959a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69048c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52348/0 (socket says 172.21.15.8:52348) 2023-10-06T23:17:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1959a700 1 -- 172.21.15.8:0/1080550027 learned_addr learned my addr 172.21.15.8:0/1080550027 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce19d9b700 1 --2- 172.21.15.8:0/1080550027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69047af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1a59c700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcdfc0a1480 0x7fcdfc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1959a700 1 -- 172.21.15.8:0/1080550027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 msgr2=0x55cf69047af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1959a700 1 --2- 172.21.15.8:0/1080550027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69047af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1959a700 1 -- 172.21.15.8:0/1080550027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 msgr2=0x55cf6904fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1959a700 1 --2- 172.21.15.8:0/1080550027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 0x55cf6904fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.095+0000 7fce1959a700 1 -- 172.21.15.8:0/1080550027 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf68dbcd80 con 0x55cf690487e0 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.096+0000 7fce1959a700 1 --2- 172.21.15.8:0/1080550027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69048c60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fce080117e0 tx=0x7fce08011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab7f53ae3aa2f766 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.096+0000 7fce1a59c700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcdfc0a1480 0x7fcdfc0a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fce04009fd0 tx=0x7fce04009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.096+0000 7fcdfbfff700 1 -- 172.21.15.8:0/1080550027 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08019410 con 0x55cf690487e0 2023-10-06T23:17:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.096+0000 7fcdfbfff700 1 -- 172.21.15.8:0/1080550027 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce08019a00 con 0x55cf690487e0 2023-10-06T23:17:21.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.096+0000 7fcdfbfff700 1 -- 172.21.15.8:0/1080550027 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08018950 con 0x55cf690487e0 2023-10-06T23:17:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.097+0000 7fce2f96bb80 1 -- 172.21.15.8:0/1080550027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 msgr2=0x55cf69048c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.097+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/1080550027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69048c60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fce080117e0 tx=0x7fce08011af0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.098+0000 7fce2f96bb80 1 -- 172.21.15.8:0/1080550027 shutdown_connections 2023-10-06T23:17:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.098+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/1080550027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 0x55cf6904fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.098+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/1080550027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69047af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.098+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/1080550027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69048c60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.098+0000 7fce2f96bb80 1 -- 172.21.15.8:0/1080550027 >> 172.21.15.8:0/1080550027 conn(0x55cf68fb3200 msgr2=0x55cf69039b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.098+0000 7fce2f96bb80 1 -- 172.21.15.8:0/1080550027 shutdown_connections 2023-10-06T23:17:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.098+0000 7fce2f96bb80 1 -- 172.21.15.8:0/1080550027 wait complete. 2023-10-06T23:17:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.099+0000 7fce2f96bb80 1 -- start start 2023-10-06T23:17:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.099+0000 7fce2f96bb80 1 Processor -- start 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.099+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf690513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69051910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf69058950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf68f91dd0 con 0x55cf690487e0 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf68f2e6b0 con 0x55cf690476d0 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf68f2e350 con 0x55cf690491a0 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce2f96bb80 10 client.0 _ll_register_callbacks cb 0x55cf68d8b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce19d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf690513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce19d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf690513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50918/0 (socket says 172.21.15.8:50918) 2023-10-06T23:17:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce19d9b700 1 -- 172.21.15.8:0/2120700901 learned_addr learned my addr 172.21.15.8:0/2120700901 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce1959a700 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69051910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce1a59c700 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf69058950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce19d9b700 1 -- 172.21.15.8:0/2120700901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 msgr2=0x55cf69058950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce19d9b700 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf69058950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce19d9b700 1 -- 172.21.15.8:0/2120700901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 msgr2=0x55cf69051910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.100+0000 7fce19d9b700 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69051910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fce19d9b700 1 -- 172.21.15.8:0/2120700901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce08011440 con 0x55cf690476d0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fce1a59c700 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf69058950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fce19d9b700 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf690513d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fce0c098180 tx=0x7fce0c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=303a131a28908848 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fcdf97fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fcdf97fa700 1 -- 172.21.15.8:0/2120700901 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0a3780 con 0x55cf690476d0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fcdf97fa700 1 -- 172.21.15.8:0/2120700901 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fce0c09be10 con 0x55cf690476d0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fce2f96bb80 1 -- 172.21.15.8:0/2120700901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf69031d50 con 0x55cf690476d0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fcdf97fa700 1 -- 172.21.15.8:0/2120700901 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce0c09b710 con 0x55cf690476d0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fce2f96bb80 10 client.25754 fetch_fsmap learned FSMap version 31 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.101+0000 7fce2f96bb80 1 -- 172.21.15.8:0/2120700901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55cf68da5c00 con 0x55cf690476d0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fcdf97fa700 1 -- 172.21.15.8:0/2120700901 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cf69031d50 con 0x55cf690476d0 2023-10-06T23:17:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fcdf97fa700 1 -- 172.21.15.8:0/2120700901 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 31) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fce0c097690 con 0x55cf690476d0 2023-10-06T23:17:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fce2f96bb80 10 client.25754 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T23:17:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fce2f96bb80 10 client.25754 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fce2f96bb80 20 client.25754 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cf6905ce60 0x55cf6905f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fce2f96bb80 4 client.25754 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:17:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fce2f96bb80 1 -- 172.21.15.8:0/2120700901 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf68f8adb0 con 0x55cf6905ce60 2023-10-06T23:17:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.102+0000 7fce1959a700 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cf6905ce60 0x55cf6905f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.103+0000 7fcdf97fa700 10 client.25754 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.103+0000 7fce1959a700 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cf6905ce60 0x55cf6905f280 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0ecb801669909ab server_cookie=e21c0c5c367260a9 in_seq=0 out_seq=0 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.104+0000 7fcdf97fa700 1 -- 172.21.15.8:0/2120700901 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cf68f8adb0 con 0x55cf6905ce60 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.104+0000 7fcdf97fa700 10 client.25754 handle_command_reply: tid=0 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.104+0000 7fce2f96bb80 1 client.25754 shutdown 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 -- 172.21.15.8:0/2120700901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 msgr2=0x55cf690513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf690513d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fce0c098180 tx=0x7fce0c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 -- 172.21.15.8:0/2120700901 shutdown_connections 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cf6905ce60 0x55cf6905f280 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf69058950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf690513d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/2120700901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69051910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 -- 172.21.15.8:0/2120700901 >> 172.21.15.8:0/2120700901 conn(0x55cf68fb3200 msgr2=0x55cf69039250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fcdf97fa700 0 client.25754 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 -- 172.21.15.8:0/2120700901 shutdown_connections 2023-10-06T23:17:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.105+0000 7fce2f96bb80 1 -- 172.21.15.8:0/2120700901 wait complete. 2023-10-06T23:17:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.106+0000 7fce2f96bb80 20 client.25754 trim_cache size 0 max 16384 2023-10-06T23:17:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.127+0000 7fce2f96bb80 1 Processor -- start 2023-10-06T23:17:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.127+0000 7fce2f96bb80 1 -- start start 2023-10-06T23:17:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.127+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69048bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.127+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69058910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.127+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf6904f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.127+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf68e128c0 con 0x55cf690487e0 2023-10-06T23:17:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.127+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf69047f50 con 0x55cf690476d0 2023-10-06T23:17:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.127+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf69050f40 con 0x55cf690491a0 2023-10-06T23:17:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1959a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69058910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf6904f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf6904f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52370/0 (socket says 172.21.15.8:52370) 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1959a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69058910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41526/0 (socket says 172.21.15.8:41526) 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1a59c700 1 -- 172.21.15.8:0/623124619 learned_addr learned my addr 172.21.15.8:0/623124619 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce19d9b700 1 --2- 172.21.15.8:0/623124619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69048bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1a59c700 1 -- 172.21.15.8:0/623124619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 msgr2=0x55cf69048bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1a59c700 1 --2- 172.21.15.8:0/623124619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69048bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1a59c700 1 -- 172.21.15.8:0/623124619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 msgr2=0x55cf69058910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1a59c700 1 --2- 172.21.15.8:0/623124619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69058910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.128+0000 7fce1a59c700 1 -- 172.21.15.8:0/623124619 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf68de31f0 con 0x55cf690491a0 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.129+0000 7fce1a59c700 1 --2- 172.21.15.8:0/623124619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf6904f590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fce04004cc0 tx=0x7fce04016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=975c3ca673b5226e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.129+0000 7fce10ff9700 1 -- 172.21.15.8:0/623124619 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400eb60 con 0x55cf690491a0 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.129+0000 7fce10ff9700 1 -- 172.21.15.8:0/623124619 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce0400f040 con 0x55cf690491a0 2023-10-06T23:17:21.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.129+0000 7fce10ff9700 1 -- 172.21.15.8:0/623124619 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040196e0 con 0x55cf690491a0 2023-10-06T23:17:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 -- 172.21.15.8:0/623124619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 msgr2=0x55cf6904f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/623124619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf6904f590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fce04004cc0 tx=0x7fce04016000 comp rx=0 tx=0).stop 2023-10-06T23:17:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 -- 172.21.15.8:0/623124619 shutdown_connections 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/623124619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690491a0 0x55cf6904f590 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/623124619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69048bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/623124619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690487e0 0x55cf69058910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 -- 172.21.15.8:0/623124619 >> 172.21.15.8:0/623124619 conn(0x55cf68fb3200 msgr2=0x55cf690500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 -- 172.21.15.8:0/623124619 shutdown_connections 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.130+0000 7fce2f96bb80 1 -- 172.21.15.8:0/623124619 wait complete. 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.131+0000 7fce2f96bb80 1 -- start start 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.131+0000 7fce2f96bb80 1 Processor -- start 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69056590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69056ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce2f96bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 0x55cf69057ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf69058020 con 0x55cf690491a0 2023-10-06T23:17:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf69058190 con 0x55cf690476d0 2023-10-06T23:17:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce2f96bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf69058350 con 0x55cf690487e0 2023-10-06T23:17:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce2f96bb80 10 client.0 _ll_register_callbacks cb 0x55cf68d8b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce1959a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69056ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce1a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 0x55cf69057ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce1959a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69056ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52386/0 (socket says 172.21.15.8:52386) 2023-10-06T23:17:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce1959a700 1 -- 172.21.15.8:0/79805040 learned_addr learned my addr 172.21.15.8:0/79805040 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce19d9b700 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69056590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce1959a700 1 -- 172.21.15.8:0/79805040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 msgr2=0x55cf69056590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.132+0000 7fce1959a700 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69056590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.133+0000 7fce1959a700 1 -- 172.21.15.8:0/79805040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 msgr2=0x55cf69057ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.133+0000 7fce1959a700 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 0x55cf69057ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.133+0000 7fce1959a700 1 -- 172.21.15.8:0/79805040 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce04008df0 con 0x55cf690487e0 2023-10-06T23:17:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.133+0000 7fce1959a700 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69056ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce080117e0 tx=0x7fce08009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a87cd7d3168a1602 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.133+0000 7fcdf97fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:17:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.133+0000 7fcdf97fa700 1 -- 172.21.15.8:0/79805040 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08028d50 con 0x55cf690487e0 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.133+0000 7fce2f96bb80 1 -- 172.21.15.8:0/79805040 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce08019a00 con 0x55cf690487e0 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.133+0000 7fcdf97fa700 1 -- 172.21.15.8:0/79805040 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fce080281c0 con 0x55cf690487e0 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fcdf97fa700 1 -- 172.21.15.8:0/79805040 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce08028380 con 0x55cf690487e0 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fce2f96bb80 10 client.25801 fetch_fsmap learned FSMap version 31 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fce2f96bb80 1 -- 172.21.15.8:0/79805040 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55cf68dbb250 con 0x55cf690487e0 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fcdf97fa700 1 -- 172.21.15.8:0/79805040 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce08019a00 con 0x55cf690487e0 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fcdf97fa700 1 -- 172.21.15.8:0/79805040 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 31) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fce0803a070 con 0x55cf690487e0 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fce2f96bb80 10 client.25801 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T23:17:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fce2f96bb80 10 client.25801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fce2f96bb80 20 client.25801 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.134+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cf690b1c10 0x55cf690b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.135+0000 7fce2f96bb80 4 client.25801 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:17:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.135+0000 7fce2f96bb80 1 -- 172.21.15.8:0/79805040 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cf68f8aad0 con 0x55cf690b1c10 2023-10-06T23:17:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.135+0000 7fce19d9b700 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cf690b1c10 0x55cf690b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.136+0000 7fce19d9b700 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cf690b1c10 0x55cf690b4030 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee2f3843037452d2 server_cookie=16a3ff5df715440c in_seq=0 out_seq=0 2023-10-06T23:17:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.136+0000 7fcdf97fa700 10 client.25801 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fcdf97fa700 1 -- 172.21.15.8:0/79805040 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cf68f8aad0 con 0x55cf690b1c10 2023-10-06T23:17:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fcdf97fa700 10 client.25801 handle_command_reply: tid=0 2023-10-06T23:17:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 client.25801 shutdown 2023-10-06T23:17:21.153 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 -- 172.21.15.8:0/79805040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 msgr2=0x55cf69056ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69056ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce080117e0 tx=0x7fce08009fd0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 -- 172.21.15.8:0/79805040 shutdown_connections 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cf690b1c10 0x55cf690b4030 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf690491a0 0x55cf69057ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf690476d0 0x55cf69056590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 --2- 172.21.15.8:0/79805040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf690487e0 0x55cf69056ad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 -- 172.21.15.8:0/79805040 >> 172.21.15.8:0/79805040 conn(0x55cf68fb3200 msgr2=0x55cf6904f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fcdf97fa700 0 client.25801 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.151+0000 7fce2f96bb80 1 -- 172.21.15.8:0/79805040 shutdown_connections 2023-10-06T23:17:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.152+0000 7fce2f96bb80 1 -- 172.21.15.8:0/79805040 wait complete. 2023-10-06T23:17:21.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.152+0000 7fce2f96bb80 20 client.25801 trim_cache size 0 max 16384 2023-10-06T23:17:21.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:17:21.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:17:21.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:17:21.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:17:21.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 -- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcdfc0a1480 msgr2=0x7fcdfc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcdfc0a1480 0x7fcdfc0a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fce04009fd0 tx=0x7fce04009920 comp rx=0 tx=0).stop 2023-10-06T23:17:21.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 -- 172.21.15.8:0/1909397619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 msgr2=0x7fce14198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:21.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 0x7fce14198e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0098e0 tx=0x7fce0c005740 comp rx=0 tx=0).stop 2023-10-06T23:17:21.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 -- 172.21.15.8:0/1909397619 shutdown_connections 2023-10-06T23:17:21.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcdfc0a1480 0x7fcdfc0a3940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce14100a80 0x7fce1419a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce140ff760 0x7fce14198e70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 --2- 172.21.15.8:0/1909397619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce141000c0 0x7fce141993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:21.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 -- 172.21.15.8:0/1909397619 >> 172.21.15.8:0/1909397619 conn(0x7fce140fb340 msgr2=0x7fce140fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:21.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.153+0000 7fce1bfff700 1 -- 172.21.15.8:0/1909397619 shutdown_connections 2023-10-06T23:17:21.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:21.154+0000 7fce1bfff700 1 -- 172.21.15.8:0/1909397619 wait complete. 2023-10-06T23:17:22.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:22 smithi008 ceph-mon[98532]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.1 MiB/s wr, 571 op/s 2023-10-06T23:17:22.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:22 smithi190 ceph-mon[102658]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.1 MiB/s wr, 571 op/s 2023-10-06T23:17:22.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:22 smithi156 ceph-mon[102862]: pgmap v484: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.1 MiB/s wr, 571 op/s 2023-10-06T23:17:23.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:23 smithi156 ceph-mon[102862]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 6.0 MiB/s wr, 531 op/s 2023-10-06T23:17:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:23 smithi008 ceph-mon[98532]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 6.0 MiB/s wr, 531 op/s 2023-10-06T23:17:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:23 smithi190 ceph-mon[102658]: pgmap v485: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 6.0 MiB/s wr, 531 op/s 2023-10-06T23:17:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 150.0 s, 244.8 tps, lat 409.935 ms stddev 84.330 2023-10-06T23:17:26.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:26 smithi156 ceph-mon[102862]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 6.4 MiB/s wr, 572 op/s 2023-10-06T23:17:26.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:26 smithi008 ceph-mon[98532]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 6.4 MiB/s wr, 572 op/s 2023-10-06T23:17:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:26 smithi190 ceph-mon[102658]: pgmap v486: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 6.4 MiB/s wr, 572 op/s 2023-10-06T23:17:28.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:28 smithi156 ceph-mon[102862]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 6.1 MiB/s wr, 558 op/s 2023-10-06T23:17:28.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:28 smithi008 ceph-mon[98532]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 6.1 MiB/s wr, 558 op/s 2023-10-06T23:17:28.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:28 smithi190 ceph-mon[102658]: pgmap v487: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 6.1 MiB/s wr, 558 op/s 2023-10-06T23:17:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 155.0 s, 255.0 tps, lat 392.970 ms stddev 72.890 2023-10-06T23:17:30.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:30 smithi156 ceph-mon[102862]: pgmap v488: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 5.0 MiB/s wr, 469 op/s 2023-10-06T23:17:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:30 smithi008 ceph-mon[98532]: pgmap v488: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 5.0 MiB/s wr, 469 op/s 2023-10-06T23:17:30.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:30 smithi190 ceph-mon[102658]: pgmap v488: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 5.0 MiB/s wr, 469 op/s 2023-10-06T23:17:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:32 smithi008 ceph-mon[98532]: pgmap v489: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2023-10-06T23:17:32.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:32 smithi190 ceph-mon[102658]: pgmap v489: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2023-10-06T23:17:32.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:32 smithi156 ceph-mon[102862]: pgmap v489: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2023-10-06T23:17:33.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:33 smithi156 ceph-mon[102862]: pgmap v490: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 3.8 MiB/s wr, 462 op/s 2023-10-06T23:17:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:33 smithi008 ceph-mon[98532]: pgmap v490: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 3.8 MiB/s wr, 462 op/s 2023-10-06T23:17:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:33 smithi190 ceph-mon[102658]: pgmap v490: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 3.8 MiB/s wr, 462 op/s 2023-10-06T23:17:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 160.0 s, 196.2 tps, lat 508.859 ms stddev 276.257 2023-10-06T23:17:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.368+0000 7f02fd3ff700 1 -- 172.21.15.8:0/2100557591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8108dc0 msgr2=0x7f02f810b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.368+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/2100557591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8108dc0 0x7f02f810b230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f02f000b0a0 tx=0x7f02f000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.369+0000 7f02fd3ff700 1 -- 172.21.15.8:0/2100557591 shutdown_connections 2023-10-06T23:17:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.369+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/2100557591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8108dc0 0x7f02f810b230 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.369+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/2100557591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8074e90 0x7f02f80732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.369+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/2100557591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02f80738b0 0x7f02f8073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.369+0000 7f02fd3ff700 1 -- 172.21.15.8:0/2100557591 >> 172.21.15.8:0/2100557591 conn(0x7f02f80fc480 msgr2=0x7f02f80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.369+0000 7f02fd3ff700 1 -- 172.21.15.8:0/2100557591 shutdown_connections 2023-10-06T23:17:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.369+0000 7f02fd3ff700 1 -- 172.21.15.8:0/2100557591 wait complete. 2023-10-06T23:17:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.370+0000 7f02fd3ff700 1 Processor -- start 2023-10-06T23:17:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.370+0000 7f02fd3ff700 1 -- start start 2023-10-06T23:17:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02fd3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f80738b0 0x7f02f8194a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02fd3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8074e90 0x7f02f8194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02fd3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02f8108dc0 0x7f02f8195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02fd3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81964a0 con 0x7f02f8108dc0 2023-10-06T23:17:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02fd3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f8196610 con 0x7f02f80738b0 2023-10-06T23:17:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02fd3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81967d0 con 0x7f02f8074e90 2023-10-06T23:17:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02f67fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8074e90 0x7f02f8194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f80738b0 0x7f02f8194a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02f67fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8074e90 0x7f02f8194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58234/0 (socket says 172.21.15.8:58234) 2023-10-06T23:17:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02f67fc700 1 -- 172.21.15.8:0/1979532488 learned_addr learned my addr 172.21.15.8:0/1979532488 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.371+0000 7f02f77fe700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02f8108dc0 0x7f02f8195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.372+0000 7f02f6ffd700 1 -- 172.21.15.8:0/1979532488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8074e90 msgr2=0x7f02f8194f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.372+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8074e90 0x7f02f8194f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.372+0000 7f02f6ffd700 1 -- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02f8108dc0 msgr2=0x7f02f8195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.372+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02f8108dc0 0x7f02f8195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.372+0000 7f02f6ffd700 1 -- 172.21.15.8:0/1979532488 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009520 con 0x7f02f80738b0 2023-10-06T23:17:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.372+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f80738b0 0x7f02f8194a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02e800e9f0 tx=0x7f02e800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.372+0000 7f02dffff700 1 -- 172.21.15.8:0/1979532488 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800cb70 con 0x7f02f80738b0 2023-10-06T23:17:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.373+0000 7f02fd3ff700 1 -- 172.21.15.8:0/1979532488 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f0009d00 con 0x7f02f80738b0 2023-10-06T23:17:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.373+0000 7f02dffff700 1 -- 172.21.15.8:0/1979532488 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02e80044b0 con 0x7f02f80738b0 2023-10-06T23:17:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.373+0000 7f02dffff700 1 -- 172.21.15.8:0/1979532488 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8003c70 con 0x7f02f80738b0 2023-10-06T23:17:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.373+0000 7f02fd3ff700 1 -- 172.21.15.8:0/1979532488 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f819b280 con 0x7f02f80738b0 2023-10-06T23:17:34.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.378+0000 7f02dffff700 1 -- 172.21.15.8:0/1979532488 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f02e8003e10 con 0x7f02f80738b0 2023-10-06T23:17:34.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.380+0000 7f0310c67b80 1 Processor -- start 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.380+0000 7f0310c67b80 1 -- start start 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.380+0000 7f02dffff700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02e00a1500 0x7f02e00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.380+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd155192e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1551a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15521220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02dffff700 1 -- 172.21.15.8:0/1979532488 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f02e8014070 con 0x7f02f80738b0 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f0310c67b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd15481400 con 0x55fd15519fd0 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f0310c67b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd15472bc0 con 0x55fd15518ec0 2023-10-06T23:17:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f0310c67b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd154704e0 con 0x55fd1551a990 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd155192e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd155192e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:55924/0 (socket says 172.21.15.8:55924) 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f6ffd700 1 -- 172.21.15.8:0/320198616 learned_addr learned my addr 172.21.15.8:0/320198616 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f77fe700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02e00a1500 0x7f02e00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f77fe700 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15521220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f67fc700 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1551a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f6ffd700 1 -- 172.21.15.8:0/320198616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 msgr2=0x55fd15521220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15521220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f6ffd700 1 -- 172.21.15.8:0/320198616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 msgr2=0x55fd1551a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.381+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1551a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.382+0000 7f02f6ffd700 1 -- 172.21.15.8:0/320198616 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd15296d80 con 0x55fd15518ec0 2023-10-06T23:17:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.382+0000 7f02f67fc700 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1551a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:17:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.382+0000 7f02f77fe700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02e00a1500 0x7f02e00a39c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009fd0 tx=0x7f02f0009320 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.382+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd155192e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f02e8096d90 tx=0x7f02e8096760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e37f09b5c4c86b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.382+0000 7f02dd7fa700 1 -- 172.21.15.8:0/320198616 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8099c80 con 0x55fd15518ec0 2023-10-06T23:17:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.383+0000 7f02dd7fa700 1 -- 172.21.15.8:0/320198616 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02e800ccd0 con 0x55fd15518ec0 2023-10-06T23:17:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.383+0000 7f02dd7fa700 1 -- 172.21.15.8:0/320198616 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e80a2720 con 0x55fd15518ec0 2023-10-06T23:17:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.383+0000 7f0310c67b80 1 -- 172.21.15.8:0/320198616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 msgr2=0x55fd155192e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.383+0000 7f0310c67b80 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd155192e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f02e8096d90 tx=0x7f02e8096760 comp rx=0 tx=0).stop 2023-10-06T23:17:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.384+0000 7f0310c67b80 1 -- 172.21.15.8:0/320198616 shutdown_connections 2023-10-06T23:17:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.384+0000 7f0310c67b80 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15521220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.384+0000 7f0310c67b80 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd155192e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.384+0000 7f0310c67b80 1 --2- 172.21.15.8:0/320198616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1551a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.384+0000 7f0310c67b80 1 -- 172.21.15.8:0/320198616 >> 172.21.15.8:0/320198616 conn(0x55fd1548d200 msgr2=0x55fd15513bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.384+0000 7f0310c67b80 1 -- 172.21.15.8:0/320198616 shutdown_connections 2023-10-06T23:17:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.384+0000 7f0310c67b80 1 -- 172.21.15.8:0/320198616 wait complete. 2023-10-06T23:17:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.385+0000 7f0310c67b80 1 -- start start 2023-10-06T23:17:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.385+0000 7f0310c67b80 1 Processor -- start 2023-10-06T23:17:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15522b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd155230b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 0x55fd1552a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f0310c67b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1546bdd0 con 0x55fd1551a990 2023-10-06T23:17:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f0310c67b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd154086b0 con 0x55fd15519fd0 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f0310c67b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd15408350 con 0x55fd15518ec0 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f0310c67b80 10 client.0 _ll_register_callbacks cb 0x55fd152657a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15522b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f02f67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd155230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15522b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58250/0 (socket says 172.21.15.8:58250) 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f02f6ffd700 1 -- 172.21.15.8:0/1355184831 learned_addr learned my addr 172.21.15.8:0/1355184831 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.386+0000 7f02f77fe700 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 0x55fd1552a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02f67fc700 1 -- 172.21.15.8:0/1355184831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 msgr2=0x55fd15522b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02f67fc700 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15522b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02f67fc700 1 -- 172.21.15.8:0/1355184831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 msgr2=0x55fd1552a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02f67fc700 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 0x55fd1552a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02f67fc700 1 -- 172.21.15.8:0/1355184831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f819b280 con 0x55fd15519fd0 2023-10-06T23:17:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02f67fc700 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd155230b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0096b0 tx=0x7f02ec0129b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d53d22e7ec93ebc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02daff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02daff5700 1 -- 172.21.15.8:0/1355184831 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec004460 con 0x55fd15519fd0 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f02daff5700 1 -- 172.21.15.8:0/1355184831 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f02ec004830 con 0x55fd15519fd0 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.387+0000 7f0310c67b80 1 -- 172.21.15.8:0/1355184831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd1550bd50 con 0x55fd15519fd0 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f02daff5700 1 -- 172.21.15.8:0/1355184831 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02ec0049f0 con 0x55fd15519fd0 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f0310c67b80 10 client.25772 fetch_fsmap learned FSMap version 31 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f0310c67b80 1 -- 172.21.15.8:0/1355184831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55fd1527fc00 con 0x55fd15519fd0 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f02daff5700 1 -- 172.21.15.8:0/1355184831 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fd1550bd50 con 0x55fd15519fd0 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f02daff5700 1 -- 172.21.15.8:0/1355184831 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 31) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f02ec0106c0 con 0x55fd15519fd0 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f0310c67b80 10 client.25772 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T23:17:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f0310c67b80 10 client.25772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f0310c67b80 20 client.25772 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fd1552e9c0 0x55fd15530de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f0310c67b80 4 client.25772 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.388+0000 7f0310c67b80 1 -- 172.21.15.8:0/1355184831 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd15464db0 con 0x55fd1552e9c0 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.389+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fd1552e9c0 0x55fd15530de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.390+0000 7f02daff5700 10 client.25772 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.390+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fd1552e9c0 0x55fd15530de0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0ec62511aa7a7ad server_cookie=ae3ff1a617268be9 in_seq=0 out_seq=0 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.390+0000 7f02daff5700 1 -- 172.21.15.8:0/1355184831 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fd15464db0 con 0x55fd1552e9c0 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.390+0000 7f02daff5700 10 client.25772 handle_command_reply: tid=0 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.390+0000 7f0310c67b80 1 client.25772 shutdown 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 -- 172.21.15.8:0/1355184831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 msgr2=0x55fd155230b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd155230b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0096b0 tx=0x7f02ec0129b0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 -- 172.21.15.8:0/1355184831 shutdown_connections 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fd1552e9c0 0x55fd15530de0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 0x55fd1552a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15522b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f02daff5700 0 client.25772 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1355184831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd155230b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 -- 172.21.15.8:0/1355184831 >> 172.21.15.8:0/1355184831 conn(0x55fd1548d200 msgr2=0x55fd15513250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 -- 172.21.15.8:0/1355184831 shutdown_connections 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 1 -- 172.21.15.8:0/1355184831 wait complete. 2023-10-06T23:17:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.391+0000 7f0310c67b80 20 client.25772 trim_cache size 0 max 16384 2023-10-06T23:17:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.414+0000 7f0310c67b80 1 Processor -- start 2023-10-06T23:17:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f0310c67b80 1 -- start start 2023-10-06T23:17:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd15522220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1552a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15520e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f0310c67b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd152ec8c0 con 0x55fd15519fd0 2023-10-06T23:17:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f0310c67b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd15519770 con 0x55fd15518ec0 2023-10-06T23:17:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f0310c67b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd1552a550 con 0x55fd1551a990 2023-10-06T23:17:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd15522220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f02f77fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15520e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd15522220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:55930/0 (socket says 172.21.15.8:55930) 2023-10-06T23:17:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.415+0000 7f02f6ffd700 1 -- 172.21.15.8:0/704255937 learned_addr learned my addr 172.21.15.8:0/704255937 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.416+0000 7f02f67fc700 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1552a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.416+0000 7f02f6ffd700 1 -- 172.21.15.8:0/704255937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 msgr2=0x55fd15520e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.416+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15520e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.416+0000 7f02f6ffd700 1 -- 172.21.15.8:0/704255937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 msgr2=0x55fd1552a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.416+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1552a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.416+0000 7f02f6ffd700 1 -- 172.21.15.8:0/704255937 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd152bd1f0 con 0x55fd15518ec0 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.416+0000 7f02f77fe700 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15520e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.416+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd15522220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f02e8096820 tx=0x7f02e809e470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd3218f153419991 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.417+0000 7f02ddffb700 1 -- 172.21.15.8:0/704255937 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e809a3a0 con 0x55fd15518ec0 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.417+0000 7f02ddffb700 1 -- 172.21.15.8:0/704255937 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02e809aa20 con 0x55fd15518ec0 2023-10-06T23:17:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.417+0000 7f02ddffb700 1 -- 172.21.15.8:0/704255937 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e809e230 con 0x55fd15518ec0 2023-10-06T23:17:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 -- 172.21.15.8:0/704255937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 msgr2=0x55fd15522220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd15522220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f02e8096820 tx=0x7f02e809e470 comp rx=0 tx=0).stop 2023-10-06T23:17:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 -- 172.21.15.8:0/704255937 shutdown_connections 2023-10-06T23:17:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd1551a990 0x55fd15520e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15518ec0 0x55fd15522220 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 --2- 172.21.15.8:0/704255937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd15519fd0 0x55fd1552a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 -- 172.21.15.8:0/704255937 >> 172.21.15.8:0/704255937 conn(0x55fd1548d200 msgr2=0x55fd155217f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 -- 172.21.15.8:0/704255937 shutdown_connections 2023-10-06T23:17:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.418+0000 7f0310c67b80 1 -- 172.21.15.8:0/704255937 wait complete. 2023-10-06T23:17:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.419+0000 7f0310c67b80 1 -- start start 2023-10-06T23:17:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.419+0000 7f0310c67b80 1 Processor -- start 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.419+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15527680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd15527bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f0310c67b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 0x55fd15528bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f0310c67b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd15529110 con 0x55fd1551a990 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f0310c67b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd15529280 con 0x55fd15519fd0 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f0310c67b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd15529440 con 0x55fd15518ec0 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f0310c67b80 10 client.0 _ll_register_callbacks cb 0x7f02ec009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15527680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f6ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15527680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58268/0 (socket says 172.21.15.8:58268) 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f6ffd700 1 -- 172.21.15.8:0/1301752008 learned_addr learned my addr 172.21.15.8:0/1301752008 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f77fe700 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 0x55fd15528bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f67fc700 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd15527bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f6ffd700 1 -- 172.21.15.8:0/1301752008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 msgr2=0x55fd15527bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd15527bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f6ffd700 1 -- 172.21.15.8:0/1301752008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 msgr2=0x55fd15528bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 0x55fd15528bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.420+0000 7f02f6ffd700 1 -- 172.21.15.8:0/1301752008 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd15296d80 con 0x55fd15518ec0 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.421+0000 7f02f6ffd700 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15527680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02e8003730 tx=0x7f02e80a26b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1192a5fb9f5400e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.421+0000 7f02daff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.421+0000 7f02daff5700 1 -- 172.21.15.8:0/1301752008 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e809a3a0 con 0x55fd15518ec0 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.421+0000 7f02daff5700 1 -- 172.21.15.8:0/1301752008 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f02e801fe00 con 0x55fd15518ec0 2023-10-06T23:17:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.421+0000 7f0310c67b80 1 -- 172.21.15.8:0/1301752008 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02e800ccd0 con 0x55fd15518ec0 2023-10-06T23:17:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f02daff5700 1 -- 172.21.15.8:0/1301752008 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02e80cab80 con 0x55fd15518ec0 2023-10-06T23:17:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f0310c67b80 10 client.25819 fetch_fsmap learned FSMap version 31 2023-10-06T23:17:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f0310c67b80 1 -- 172.21.15.8:0/1301752008 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55fd15295250 con 0x55fd15518ec0 2023-10-06T23:17:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f02daff5700 1 -- 172.21.15.8:0/1301752008 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02e800ccd0 con 0x55fd15518ec0 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f02daff5700 1 -- 172.21.15.8:0/1301752008 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 31) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f02e8099910 con 0x55fd15518ec0 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f0310c67b80 10 client.25819 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f0310c67b80 10 client.25819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f0310c67b80 20 client.25819 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fd15582c40 0x55fd15585030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f0310c67b80 4 client.25819 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.422+0000 7f0310c67b80 1 -- 172.21.15.8:0/1301752008 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fd15464ad0 con 0x55fd15582c40 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.423+0000 7f02f67fc700 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fd15582c40 0x55fd15585030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.424+0000 7f02daff5700 10 client.25819 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.424+0000 7f02f67fc700 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fd15582c40 0x55fd15585030 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3826b78a0b47fa7 server_cookie=2ec21111d2d5d877 in_seq=0 out_seq=0 2023-10-06T23:17:34.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.437+0000 7f02daff5700 1 -- 172.21.15.8:0/1301752008 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fd15464ad0 con 0x55fd15582c40 2023-10-06T23:17:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.437+0000 7f02daff5700 10 client.25819 handle_command_reply: tid=0 2023-10-06T23:17:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.437+0000 7f0310c67b80 1 client.25819 shutdown 2023-10-06T23:17:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 -- 172.21.15.8:0/1301752008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 msgr2=0x55fd15527680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15527680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02e8003730 tx=0x7f02e80a26b0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 -- 172.21.15.8:0/1301752008 shutdown_connections 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fd15582c40 0x55fd15585030 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fd1551a990 0x55fd15528bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd15518ec0 0x55fd15527680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 --2- 172.21.15.8:0/1301752008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd15519fd0 0x55fd15527bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 -- 172.21.15.8:0/1301752008 >> 172.21.15.8:0/1301752008 conn(0x55fd1548d200 msgr2=0x55fd15520e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f02daff5700 0 client.25819 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 -- 172.21.15.8:0/1301752008 shutdown_connections 2023-10-06T23:17:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 1 -- 172.21.15.8:0/1301752008 wait complete. 2023-10-06T23:17:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.438+0000 7f0310c67b80 20 client.25819 trim_cache size 0 max 16384 2023-10-06T23:17:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:17:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:17:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:17:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:17:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 -- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02e00a1500 msgr2=0x7f02e00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02e00a1500 0x7f02e00a39c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009fd0 tx=0x7f02f0009320 comp rx=0 tx=0).stop 2023-10-06T23:17:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 -- 172.21.15.8:0/1979532488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f80738b0 msgr2=0x7f02f8194a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f80738b0 0x7f02f8194a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02e800e9f0 tx=0x7f02e800ed00 comp rx=0 tx=0).stop 2023-10-06T23:17:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 -- 172.21.15.8:0/1979532488 shutdown_connections 2023-10-06T23:17:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f02e00a1500 0x7f02e00a39c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02f8108dc0 0x7f02f8195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f80738b0 0x7f02f8194a30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 --2- 172.21.15.8:0/1979532488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f8074e90 0x7f02f8194f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 -- 172.21.15.8:0/1979532488 >> 172.21.15.8:0/1979532488 conn(0x7f02f80fc480 msgr2=0x7f02f80fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.439+0000 7f02fd3ff700 1 -- 172.21.15.8:0/1979532488 shutdown_connections 2023-10-06T23:17:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:34.440+0000 7f02fd3ff700 1 -- 172.21.15.8:0/1979532488 wait complete. 2023-10-06T23:17:36.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:36 smithi156 ceph-mon[102862]: pgmap v491: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 5.7 MiB/s wr, 563 op/s 2023-10-06T23:17:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:36 smithi008 ceph-mon[98532]: pgmap v491: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 5.7 MiB/s wr, 563 op/s 2023-10-06T23:17:36.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:36 smithi190 ceph-mon[102658]: pgmap v491: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 5.7 MiB/s wr, 563 op/s 2023-10-06T23:17:37.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:37 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:17:37.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:37 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:17:37.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:37 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:17:38.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:38 smithi008 ceph-mon[98532]: pgmap v492: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.7 MiB/s wr, 548 op/s 2023-10-06T23:17:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:38 smithi190 ceph-mon[102658]: pgmap v492: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.7 MiB/s wr, 548 op/s 2023-10-06T23:17:38.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:38 smithi156 ceph-mon[102862]: pgmap v492: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.7 MiB/s wr, 548 op/s 2023-10-06T23:17:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 165.0 s, 203.2 tps, lat 429.843 ms stddev 142.071 2023-10-06T23:17:39.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:17:39.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:17:39.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:17:39.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:39 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:39.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:17:39.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:17:39.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:17:39.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:39 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:39.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:39 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:17:39.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:39 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:17:39.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:39 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:17:39.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:39 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:40 smithi008 ceph-mon[98532]: pgmap v493: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 5.8 MiB/s wr, 534 op/s 2023-10-06T23:17:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:40 smithi190 ceph-mon[102658]: pgmap v493: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 5.8 MiB/s wr, 534 op/s 2023-10-06T23:17:40.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:40 smithi156 ceph-mon[102862]: pgmap v493: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 5.8 MiB/s wr, 534 op/s 2023-10-06T23:17:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:42 smithi008 ceph-mon[98532]: pgmap v494: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 6.2 MiB/s wr, 582 op/s 2023-10-06T23:17:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:42 smithi190 ceph-mon[102658]: pgmap v494: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 6.2 MiB/s wr, 582 op/s 2023-10-06T23:17:42.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:42 smithi156 ceph-mon[102862]: pgmap v494: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 6.2 MiB/s wr, 582 op/s 2023-10-06T23:17:43.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:43 smithi156 ceph-mon[102862]: pgmap v495: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2023-10-06T23:17:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:43 smithi008 ceph-mon[98532]: pgmap v495: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2023-10-06T23:17:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:43 smithi190 ceph-mon[102658]: pgmap v495: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2023-10-06T23:17:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 170.0 s, 230.2 tps, lat 488.579 ms stddev 984.529 2023-10-06T23:17:45.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:17:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.477+0000 7f31875ff700 1 -- 172.21.15.8:0/2299408816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 msgr2=0x7f3180100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.477+0000 7f31875ff700 1 --2- 172.21.15.8:0/2299408816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 0x7f3180100bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f316c0098f0 tx=0x7f316c009c00 comp rx=0 tx=0).stop 2023-10-06T23:17:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.477+0000 7f31875ff700 1 -- 172.21.15.8:0/2299408816 shutdown_connections 2023-10-06T23:17:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.477+0000 7f31875ff700 1 --2- 172.21.15.8:0/2299408816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31800ff580 0x7f31800ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.477+0000 7f31875ff700 1 --2- 172.21.15.8:0/2299408816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3180101110 0x7f31801079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.477+0000 7f31875ff700 1 --2- 172.21.15.8:0/2299408816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 0x7f3180100bd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.477+0000 7f31875ff700 1 -- 172.21.15.8:0/2299408816 >> 172.21.15.8:0/2299408816 conn(0x7f31800faaf0 msgr2=0x7f31800fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.477+0000 7f31875ff700 1 -- 172.21.15.8:0/2299408816 shutdown_connections 2023-10-06T23:17:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.478+0000 7f31875ff700 1 -- 172.21.15.8:0/2299408816 wait complete. 2023-10-06T23:17:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.479+0000 7f31875ff700 1 Processor -- start 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.479+0000 7f31875ff700 1 -- start start 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f31875ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31800ff580 0x7f318019d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f31875ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 0x7f318019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f31875ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3180101110 0x7f31801a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f31875ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31801a4df0 con 0x7f3180101110 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f31875ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318006a8d0 con 0x7f31800ff580 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f31875ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318006aa60 con 0x7f3180100770 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f3184b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 0x7f318019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f3184b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 0x7f318019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45950/0 (socket says 172.21.15.8:45950) 2023-10-06T23:17:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f3184b9a700 1 -- 172.21.15.8:0/2013695518 learned_addr learned my addr 172.21.15.8:0/2013695518 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.480+0000 7f318539b700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31800ff580 0x7f318019d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f3184b9a700 1 -- 172.21.15.8:0/2013695518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31800ff580 msgr2=0x7f318019d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f3184b9a700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31800ff580 0x7f318019d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f3185b9c700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3180101110 0x7f31801a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f3184b9a700 1 -- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3180101110 msgr2=0x7f31801a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f3184b9a700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3180101110 0x7f31801a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f3184b9a700 1 -- 172.21.15.8:0/2013695518 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3174009d00 con 0x7f3180100770 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f3185b9c700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3180101110 0x7f31801a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f3184b9a700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 0x7f318019d7b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f316c00b790 tx=0x7f316c00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f317e7fc700 1 -- 172.21.15.8:0/2013695518 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c01c070 con 0x7f3180100770 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.481+0000 7f31875ff700 1 -- 172.21.15.8:0/2013695518 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c009520 con 0x7f3180100770 2023-10-06T23:17:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.482+0000 7f317e7fc700 1 -- 172.21.15.8:0/2013695518 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f316c00f7d0 con 0x7f3180100770 2023-10-06T23:17:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.482+0000 7f317e7fc700 1 -- 172.21.15.8:0/2013695518 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c004a90 con 0x7f3180100770 2023-10-06T23:17:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.482+0000 7f31875ff700 1 -- 172.21.15.8:0/2013695518 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318006afd0 con 0x7f3180100770 2023-10-06T23:17:45.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.486+0000 7f317e7fc700 1 -- 172.21.15.8:0/2013695518 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f316c020070 con 0x7f3180100770 2023-10-06T23:17:45.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.488+0000 7f319afb4b80 1 Processor -- start 2023-10-06T23:17:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.488+0000 7f319afb4b80 1 -- start start 2023-10-06T23:17:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72dc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 0x5603b72dd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dda60 0x5603b72ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f319afb4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b7244460 con 0x5603b72dcbc0 2023-10-06T23:17:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f319afb4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b7235c20 con 0x5603b72dda60 2023-10-06T23:17:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f319afb4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b7233540 con 0x5603b72dc260 2023-10-06T23:17:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f3185b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f3185b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72dc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45956/0 (socket says 172.21.15.8:45956) 2023-10-06T23:17:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.489+0000 7f3185b9c700 1 -- 172.21.15.8:0/666328693 learned_addr learned my addr 172.21.15.8:0/666328693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f3185b9c700 1 -- 172.21.15.8:0/666328693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dda60 msgr2=0x5603b72ddee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f317e7fc700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31700a1500 0x7f31700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f3184b9a700 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dda60 0x5603b72ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f3185b9c700 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dda60 0x5603b72ddee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f3185b9c700 1 -- 172.21.15.8:0/666328693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 msgr2=0x5603b72dd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f3185b9c700 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 0x5603b72dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f3185b9c700 1 -- 172.21.15.8:0/666328693 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603b7059de0 con 0x5603b72dc260 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f3184b9a700 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dda60 0x5603b72ddee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.490+0000 7f317e7fc700 1 -- 172.21.15.8:0/2013695518 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f316c0cdb50 con 0x7f3180100770 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.491+0000 7f3185b9c700 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72dc680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f317800ac30 tx=0x7f317800af40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d6bc86e88b9d174 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.491+0000 7f316b7fe700 1 -- 172.21.15.8:0/666328693 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3178018440 con 0x5603b72dc260 2023-10-06T23:17:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.491+0000 7f3185b9c700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31700a1500 0x7f31700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.491+0000 7f316b7fe700 1 -- 172.21.15.8:0/666328693 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3178019c40 con 0x5603b72dc260 2023-10-06T23:17:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.491+0000 7f316b7fe700 1 -- 172.21.15.8:0/666328693 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3178017df0 con 0x5603b72dc260 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 -- 172.21.15.8:0/666328693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 msgr2=0x5603b72dc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f3185b9c700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31700a1500 0x7f31700a39c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f317800afd0 tx=0x7f3178017f50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72dc680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f317800ac30 tx=0x7f317800af40 comp rx=0 tx=0).stop 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 -- 172.21.15.8:0/666328693 shutdown_connections 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dda60 0x5603b72ddee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72dc680 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 --2- 172.21.15.8:0/666328693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 0x5603b72dd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 -- 172.21.15.8:0/666328693 >> 172.21.15.8:0/666328693 conn(0x5603b7250260 msgr2=0x5603b72d7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 -- 172.21.15.8:0/666328693 shutdown_connections 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.492+0000 7f319afb4b80 1 -- 172.21.15.8:0/666328693 wait complete. 2023-10-06T23:17:45.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.493+0000 7f319afb4b80 1 -- start start 2023-10-06T23:17:45.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.493+0000 7f319afb4b80 1 Processor -- start 2023-10-06T23:17:45.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.494+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.494+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72e6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.494+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 0x5603b72ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.494+0000 7f319afb4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b722ee30 con 0x5603b72dda60 2023-10-06T23:17:45.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.494+0000 7f319afb4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b71cb710 con 0x5603b72dcbc0 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.494+0000 7f319afb4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b71cb3b0 con 0x5603b72dc260 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.494+0000 7f319afb4b80 10 client.0 _ll_register_callbacks cb 0x5603b7028800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f318539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3184b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72e6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f318539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45958/0 (socket says 172.21.15.8:45958) 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3184b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72e6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:52628/0 (socket says 172.21.15.8:52628) 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f318539b700 1 -- 172.21.15.8:0/674815027 learned_addr learned my addr 172.21.15.8:0/674815027 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3184b9a700 1 -- 172.21.15.8:0/674815027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 msgr2=0x5603b72e6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3184b9a700 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3184b9a700 1 -- 172.21.15.8:0/674815027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 msgr2=0x5603b72ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3184b9a700 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 0x5603b72ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3184b9a700 1 -- 172.21.15.8:0/674815027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317800a910 con 0x5603b72dcbc0 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f318539b700 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3184b9a700 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72e6570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f316c097920 tx=0x7f316c09a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c0915edc0ef4b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.495+0000 7f3168ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.496+0000 7f3168ff9700 1 -- 172.21.15.8:0/674815027 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c09b5b0 con 0x5603b72dcbc0 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.496+0000 7f3168ff9700 1 -- 172.21.15.8:0/674815027 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f316c09aeb0 con 0x5603b72dcbc0 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.496+0000 7f319afb4b80 1 -- 172.21.15.8:0/674815027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603b72cef10 con 0x5603b72dcbc0 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.496+0000 7f3168ff9700 1 -- 172.21.15.8:0/674815027 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f316c09f000 con 0x5603b72dcbc0 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.496+0000 7f319afb4b80 10 client.25787 fetch_fsmap learned FSMap version 32 2023-10-06T23:17:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.496+0000 7f319afb4b80 1 -- 172.21.15.8:0/674815027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5603b7042c60 con 0x5603b72dcbc0 2023-10-06T23:17:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.496+0000 7f3168ff9700 1 -- 172.21.15.8:0/674815027 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5603b72cef10 con 0x5603b72dcbc0 2023-10-06T23:17:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.498+0000 7f3168ff9700 1 -- 172.21.15.8:0/674815027 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f316c09b110 con 0x5603b72dcbc0 2023-10-06T23:17:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.498+0000 7f319afb4b80 10 client.25787 fetch_fsmap finished waiting for FSMap version 32 2023-10-06T23:17:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.498+0000 7f319afb4b80 10 client.25787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.498+0000 7f319afb4b80 20 client.25787 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.498+0000 7f319afb4b80 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5603b72f19e0 0x5603b72f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.498+0000 7f319afb4b80 4 client.25787 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:17:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.498+0000 7f319afb4b80 1 -- 172.21.15.8:0/674815027 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603b7227e10 con 0x5603b72f19e0 2023-10-06T23:17:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.498+0000 7f318539b700 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5603b72f19e0 0x5603b72f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.499+0000 7f3168ff9700 10 client.25787 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.499+0000 7f318539b700 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5603b72f19e0 0x5603b72f3e00 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=706cb8b1a1f1f35f server_cookie=62c91294f2a309ff in_seq=0 out_seq=0 2023-10-06T23:17:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.500+0000 7f3168ff9700 1 -- 172.21.15.8:0/674815027 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5603b7227e10 con 0x5603b72f19e0 2023-10-06T23:17:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.500+0000 7f3168ff9700 10 client.25787 handle_command_reply: tid=0 2023-10-06T23:17:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.500+0000 7f319afb4b80 1 client.25787 shutdown 2023-10-06T23:17:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 -- 172.21.15.8:0/674815027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 msgr2=0x5603b72e6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72e6570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f316c097920 tx=0x7f316c09a890 comp rx=0 tx=0).stop 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 -- 172.21.15.8:0/674815027 shutdown_connections 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5603b72f19e0 0x5603b72f3e00 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 0x5603b72ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f3168ff9700 0 client.25787 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 --2- 172.21.15.8:0/674815027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72e6570 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 -- 172.21.15.8:0/674815027 >> 172.21.15.8:0/674815027 conn(0x5603b7250260 msgr2=0x5603b72d6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 -- 172.21.15.8:0/674815027 shutdown_connections 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.501+0000 7f319afb4b80 1 -- 172.21.15.8:0/674815027 wait complete. 2023-10-06T23:17:45.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.502+0000 7f319afb4b80 20 client.25787 trim_cache size 0 max 16384 2023-10-06T23:17:45.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.526+0000 7f319afb4b80 1 Processor -- start 2023-10-06T23:17:45.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.526+0000 7f319afb4b80 1 -- start start 2023-10-06T23:17:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.526+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.526+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72ed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.526+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 0x5603b72e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.526+0000 7f319afb4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b70af920 con 0x5603b72dda60 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.526+0000 7f319afb4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b7227e10 con 0x5603b72dcbc0 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.526+0000 7f319afb4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b72d1570 con 0x5603b72dc260 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f318539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f318539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45968/0 (socket says 172.21.15.8:45968) 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f318539b700 1 -- 172.21.15.8:0/2405951435 learned_addr learned my addr 172.21.15.8:0/2405951435 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f3184b9a700 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f3185b9c700 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 0x5603b72e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f318539b700 1 -- 172.21.15.8:0/2405951435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 msgr2=0x5603b72ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f318539b700 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f318539b700 1 -- 172.21.15.8:0/2405951435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 msgr2=0x5603b72e0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:45.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f318539b700 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 0x5603b72e0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.527+0000 7f318539b700 1 -- 172.21.15.8:0/2405951435 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603b7080250 con 0x5603b72dc260 2023-10-06T23:17:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.528+0000 7f318539b700 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e09d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5603b72f46e0 tx=0x7f3174007890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb3cdfa0460d655 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.528+0000 7f316bfff700 1 -- 172.21.15.8:0/2405951435 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174020070 con 0x5603b72dc260 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.528+0000 7f316bfff700 1 -- 172.21.15.8:0/2405951435 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f317400f040 con 0x5603b72dc260 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.528+0000 7f316bfff700 1 -- 172.21.15.8:0/2405951435 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317400e040 con 0x5603b72dc260 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 -- 172.21.15.8:0/2405951435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 msgr2=0x5603b72e09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e09d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5603b72f46e0 tx=0x7f3174007890 comp rx=0 tx=0).stop 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 -- 172.21.15.8:0/2405951435 shutdown_connections 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dda60 0x5603b72e0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dc260 0x5603b72e09d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 --2- 172.21.15.8:0/2405951435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dcbc0 0x5603b72ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 -- 172.21.15.8:0/2405951435 >> 172.21.15.8:0/2405951435 conn(0x5603b7250260 msgr2=0x5603b72e4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 -- 172.21.15.8:0/2405951435 shutdown_connections 2023-10-06T23:17:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.529+0000 7f319afb4b80 1 -- 172.21.15.8:0/2405951435 wait complete. 2023-10-06T23:17:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.530+0000 7f319afb4b80 1 -- start start 2023-10-06T23:17:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.530+0000 7f319afb4b80 1 Processor -- start 2023-10-06T23:17:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dc260 0x5603b72ece10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 0x5603b72ed350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f319afb4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dda60 0x5603b72eb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f319afb4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b72eba40 con 0x5603b72dcbc0 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f319afb4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b72ebbb0 con 0x5603b72dc260 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f319afb4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603b72ebd70 con 0x5603b72dda60 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f319afb4b80 10 client.0 _ll_register_callbacks cb 0x7f316c09ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f318539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dc260 0x5603b72ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f318539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dc260 0x5603b72ece10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:52652/0 (socket says 172.21.15.8:52652) 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.531+0000 7f318539b700 1 -- 172.21.15.8:0/3969663102 learned_addr learned my addr 172.21.15.8:0/3969663102 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f3185b9c700 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dda60 0x5603b72eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f3184b9a700 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 0x5603b72ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f318539b700 1 -- 172.21.15.8:0/3969663102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dda60 msgr2=0x5603b72eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f318539b700 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dda60 0x5603b72eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f318539b700 1 -- 172.21.15.8:0/3969663102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 msgr2=0x5603b72ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f318539b700 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 0x5603b72ed350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f318539b700 1 -- 172.21.15.8:0/3969663102 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31740075c0 con 0x5603b72dc260 2023-10-06T23:17:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f318539b700 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dc260 0x5603b72ece10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3174004ed0 tx=0x7f3174007f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81d00d857d1189ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.532+0000 7f3168ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:17:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.533+0000 7f3168ff9700 1 -- 172.21.15.8:0/3969663102 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174020040 con 0x5603b72dc260 2023-10-06T23:17:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.533+0000 7f319afb4b80 1 -- 172.21.15.8:0/3969663102 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3178019c40 con 0x5603b72dc260 2023-10-06T23:17:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.533+0000 7f3168ff9700 1 -- 172.21.15.8:0/3969663102 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f31740055b0 con 0x5603b72dc260 2023-10-06T23:17:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.533+0000 7f3168ff9700 1 -- 172.21.15.8:0/3969663102 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f317400e040 con 0x5603b72dc260 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.533+0000 7f319afb4b80 10 client.25793 fetch_fsmap learned FSMap version 32 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.533+0000 7f319afb4b80 1 -- 172.21.15.8:0/3969663102 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5603b70582b0 con 0x5603b72dc260 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.533+0000 7f3168ff9700 1 -- 172.21.15.8:0/3969663102 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3178019c40 con 0x5603b72dc260 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.534+0000 7f3168ff9700 1 -- 172.21.15.8:0/3969663102 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3174025cd0 con 0x5603b72dc260 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.534+0000 7f319afb4b80 10 client.25793 fetch_fsmap finished waiting for FSMap version 32 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.534+0000 7f319afb4b80 10 client.25793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.534+0000 7f319afb4b80 20 client.25793 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.534+0000 7f319afb4b80 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5603b7346b50 0x5603b7348f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.534+0000 7f319afb4b80 4 client.25793 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.534+0000 7f319afb4b80 1 -- 172.21.15.8:0/3969663102 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5603b7227b30 con 0x5603b7346b50 2023-10-06T23:17:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.534+0000 7f3184b9a700 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5603b7346b50 0x5603b7348f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.535+0000 7f3184b9a700 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5603b7346b50 0x5603b7348f70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeaa40a61c4e6256 server_cookie=4983c4ccadccda9e in_seq=0 out_seq=0 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.535+0000 7f3168ff9700 10 client.25793 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.535+0000 7f3168ff9700 1 -- 172.21.15.8:0/3969663102 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5603b7227b30 con 0x5603b7346b50 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.535+0000 7f3168ff9700 10 client.25793 handle_command_reply: tid=0 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.535+0000 7f319afb4b80 1 client.25793 shutdown 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 -- 172.21.15.8:0/3969663102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dc260 msgr2=0x5603b72ece10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dc260 0x5603b72ece10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3174004ed0 tx=0x7f3174007f10 comp rx=0 tx=0).stop 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 -- 172.21.15.8:0/3969663102 shutdown_connections 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5603b7346b50 0x5603b7348f70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5603b72dda60 0x5603b72eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603b72dc260 0x5603b72ece10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 --2- 172.21.15.8:0/3969663102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5603b72dcbc0 0x5603b72ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f3168ff9700 0 client.25793 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 -- 172.21.15.8:0/3969663102 >> 172.21.15.8:0/3969663102 conn(0x5603b7250260 msgr2=0x5603b72e09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 -- 172.21.15.8:0/3969663102 shutdown_connections 2023-10-06T23:17:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 1 -- 172.21.15.8:0/3969663102 wait complete. 2023-10-06T23:17:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.536+0000 7f319afb4b80 20 client.25793 trim_cache size 0 max 16384 2023-10-06T23:17:45.541 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:17:45.542 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:17:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 -- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31700a1500 msgr2=0x7f31700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31700a1500 0x7f31700a39c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f317800afd0 tx=0x7f3178017f50 comp rx=0 tx=0).stop 2023-10-06T23:17:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 -- 172.21.15.8:0/2013695518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 msgr2=0x7f318019d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 0x7f318019d7b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f316c00b790 tx=0x7f316c00b870 comp rx=0 tx=0).stop 2023-10-06T23:17:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 -- 172.21.15.8:0/2013695518 shutdown_connections 2023-10-06T23:17:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31700a1500 0x7f31700a39c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3180101110 0x7f31801a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31800ff580 0x7f318019d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 --2- 172.21.15.8:0/2013695518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3180100770 0x7f318019d7b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 -- 172.21.15.8:0/2013695518 >> 172.21.15.8:0/2013695518 conn(0x7f31800faaf0 msgr2=0x7f318010cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.537+0000 7f31875ff700 1 -- 172.21.15.8:0/2013695518 shutdown_connections 2023-10-06T23:17:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:17:45.538+0000 7f31875ff700 1 -- 172.21.15.8:0/2013695518 wait complete. 2023-10-06T23:17:45.563 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:17:46.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:46 smithi156 ceph-mon[102862]: pgmap v496: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 6.7 MiB/s wr, 624 op/s 2023-10-06T23:17:46.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:46 smithi008 ceph-mon[98532]: pgmap v496: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 6.7 MiB/s wr, 624 op/s 2023-10-06T23:17:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:46 smithi190 ceph-mon[102658]: pgmap v496: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 6.7 MiB/s wr, 624 op/s 2023-10-06T23:17:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.639+0000 7f556a3ff700 1 -- 172.21.15.8:0/287455074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5564102080 msgr2=0x7f5564102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.639+0000 7f556a3ff700 1 --2- 172.21.15.8:0/287455074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5564102080 0x7f5564102500 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f554c00b0a0 tx=0x7f554c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.640+0000 7f556a3ff700 1 -- 172.21.15.8:0/287455074 shutdown_connections 2023-10-06T23:17:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.640+0000 7f556a3ff700 1 --2- 172.21.15.8:0/287455074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5564102a40 0x7f5564109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.640+0000 7f556a3ff700 1 --2- 172.21.15.8:0/287455074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5564100f30 0x7f5564101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.640+0000 7f556a3ff700 1 --2- 172.21.15.8:0/287455074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5564102080 0x7f5564102500 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.640+0000 7f556a3ff700 1 -- 172.21.15.8:0/287455074 >> 172.21.15.8:0/287455074 conn(0x7f55640fc480 msgr2=0x7f55640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.640+0000 7f556a3ff700 1 -- 172.21.15.8:0/287455074 shutdown_connections 2023-10-06T23:17:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.640+0000 7f556a3ff700 1 -- 172.21.15.8:0/287455074 wait complete. 2023-10-06T23:17:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.641+0000 7f556a3ff700 1 Processor -- start 2023-10-06T23:17:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.642+0000 7f556a3ff700 1 -- start start 2023-10-06T23:17:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.642+0000 7f556a3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5564100f30 0x7f5564198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.642+0000 7f556a3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5564102080 0x7f55641992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.642+0000 7f556a3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5564102a40 0x7f556419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.642+0000 7f556a3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556419a7a0 con 0x7f5564102a40 2023-10-06T23:17:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.642+0000 7f556a3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556419a910 con 0x7f5564100f30 2023-10-06T23:17:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.642+0000 7f556a3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556419aad0 con 0x7f5564102080 2023-10-06T23:17:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f5563fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5564100f30 0x7f5564198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f5563fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5564100f30 0x7f5564198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:52666/0 (socket says 172.21.15.8:52666) 2023-10-06T23:17:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f5563fff700 1 -- 172.21.15.8:0/2781327364 learned_addr learned my addr 172.21.15.8:0/2781327364 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f555bfff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5564102080 0x7f55641992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f556899c700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5564102a40 0x7f556419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f5563fff700 1 -- 172.21.15.8:0/2781327364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5564102080 msgr2=0x7f55641992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f5563fff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5564102080 0x7f55641992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f5563fff700 1 -- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5564102a40 msgr2=0x7f556419a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f5563fff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5564102a40 0x7f556419a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.643+0000 7f5563fff700 1 -- 172.21.15.8:0/2781327364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5554009520 con 0x7f5564100f30 2023-10-06T23:17:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.644+0000 7f5563fff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5564100f30 0x7f5564198db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f555400eb30 tx=0x7f555400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.644+0000 7f5561ffb700 1 -- 172.21.15.8:0/2781327364 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554009880 con 0x7f5564100f30 2023-10-06T23:17:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.644+0000 7f5561ffb700 1 -- 172.21.15.8:0/2781327364 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55540044b0 con 0x7f5564100f30 2023-10-06T23:17:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.644+0000 7f5561ffb700 1 -- 172.21.15.8:0/2781327364 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554003ce0 con 0x7f5564100f30 2023-10-06T23:17:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.644+0000 7f556a3ff700 1 -- 172.21.15.8:0/2781327364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c009d00 con 0x7f5564100f30 2023-10-06T23:17:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.644+0000 7f556a3ff700 1 -- 172.21.15.8:0/2781327364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556419af00 con 0x7f5564100f30 2023-10-06T23:17:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.649+0000 7f5561ffb700 1 -- 172.21.15.8:0/2781327364 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5554003e40 con 0x7f5564100f30 2023-10-06T23:17:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.650+0000 7f557dd27b80 1 Processor -- start 2023-10-06T23:17:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.651+0000 7f557dd27b80 1 -- start start 2023-10-06T23:17:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.651+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c26d0 0x55597b7c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.651+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.651+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.651+0000 7f557dd27b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b722400 con 0x55597b7c41a0 2023-10-06T23:17:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.651+0000 7f557dd27b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b713bc0 con 0x55597b7c26d0 2023-10-06T23:17:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.651+0000 7f557dd27b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b7114e0 con 0x55597b7c37e0 2023-10-06T23:17:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f556899c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c26d0 0x55597b7c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f556899c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c26d0 0x55597b7c2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:52672/0 (socket says 172.21.15.8:52672) 2023-10-06T23:17:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f556899c700 1 -- 172.21.15.8:0/2816209948 learned_addr learned my addr 172.21.15.8:0/2816209948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f5561ffb700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55500a1580 0x7f55500a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f555bfff700 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f5561ffb700 1 -- 172.21.15.8:0/2781327364 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5554014070 con 0x7f5564100f30 2023-10-06T23:17:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f5563fff700 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f556899c700 1 -- 172.21.15.8:0/2816209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 msgr2=0x55597b7c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f556899c700 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f556899c700 1 -- 172.21.15.8:0/2816209948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 msgr2=0x55597b7caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f556899c700 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.652+0000 7f556899c700 1 -- 172.21.15.8:0/2816209948 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55597b537d80 con 0x55597b7c26d0 2023-10-06T23:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.653+0000 7f5563fff700 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.653+0000 7f555bfff700 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.653+0000 7f556899c700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55500a1580 0x7f55500a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.653+0000 7f556899c700 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c26d0 0x55597b7c2af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f555c009e00 tx=0x7f555c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbcea89e0a096c19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.654+0000 7f555a7fc700 1 -- 172.21.15.8:0/2816209948 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c003880 con 0x55597b7c26d0 2023-10-06T23:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.654+0000 7f555a7fc700 1 -- 172.21.15.8:0/2816209948 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f555c003e70 con 0x55597b7c26d0 2023-10-06T23:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.654+0000 7f555a7fc700 1 -- 172.21.15.8:0/2816209948 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00fbb0 con 0x55597b7c26d0 2023-10-06T23:17:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f557dd27b80 1 -- 172.21.15.8:0/2816209948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c26d0 msgr2=0x55597b7c2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f556899c700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55500a1580 0x7f55500a3a40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f555c023000 tx=0x7f555c024000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c26d0 0x55597b7c2af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f555c009e00 tx=0x7f555c011720 comp rx=0 tx=0).stop 2023-10-06T23:17:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f557dd27b80 1 -- 172.21.15.8:0/2816209948 shutdown_connections 2023-10-06T23:17:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c26d0 0x55597b7c2af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2816209948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f557dd27b80 1 -- 172.21.15.8:0/2816209948 >> 172.21.15.8:0/2816209948 conn(0x55597b72e200 msgr2=0x55597b7b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.655+0000 7f557dd27b80 1 -- 172.21.15.8:0/2816209948 shutdown_connections 2023-10-06T23:17:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.656+0000 7f557dd27b80 1 -- 172.21.15.8:0/2816209948 wait complete. 2023-10-06T23:17:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.656+0000 7f557dd27b80 1 -- start start 2023-10-06T23:17:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.657+0000 7f557dd27b80 1 Processor -- start 2023-10-06T23:17:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.657+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c26d0 0x55597b7cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.657+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.657+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.657+0000 7f557dd27b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b70cdd0 con 0x55597b7c41a0 2023-10-06T23:17:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.657+0000 7f557dd27b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b6a96b0 con 0x55597b7c37e0 2023-10-06T23:17:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.657+0000 7f557dd27b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b6a9350 con 0x55597b7c26d0 2023-10-06T23:17:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.657+0000 7f557dd27b80 10 client.0 _ll_register_callbacks cb 0x55597b5067a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f5563fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c26d0 0x55597b7cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f5563fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c26d0 0x55597b7cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:46014/0 (socket says 172.21.15.8:46014) 2023-10-06T23:17:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f5563fff700 1 -- 172.21.15.8:0/3326287383 learned_addr learned my addr 172.21.15.8:0/3326287383 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f555bfff700 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f556899c700 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f5563fff700 1 -- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 msgr2=0x55597b7cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f5563fff700 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f5563fff700 1 -- 172.21.15.8:0/3326287383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 msgr2=0x55597b7d39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f5563fff700 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7d39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f5563fff700 1 -- 172.21.15.8:0/3326287383 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5564109c90 con 0x55597b7c26d0 2023-10-06T23:17:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.658+0000 7f555bfff700 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.659+0000 7f5563fff700 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c26d0 0x55597b7cc460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55540a2100 tx=0x7f555400cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acac8fd0377bc06f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.659+0000 7f55437fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:17:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.659+0000 7f55437fe700 1 -- 172.21.15.8:0/3326287383 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555400cbd0 con 0x55597b7c26d0 2023-10-06T23:17:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.659+0000 7f55437fe700 1 -- 172.21.15.8:0/3326287383 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f555406aa40 con 0x55597b7c26d0 2023-10-06T23:17:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.659+0000 7f557dd27b80 1 -- 172.21.15.8:0/3326287383 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55597b7acd50 con 0x55597b7c26d0 2023-10-06T23:17:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.659+0000 7f55437fe700 1 -- 172.21.15.8:0/3326287383 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f555409a2a0 con 0x55597b7c26d0 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.659+0000 7f557dd27b80 10 client.25846 fetch_fsmap learned FSMap version 32 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.659+0000 7f557dd27b80 1 -- 172.21.15.8:0/3326287383 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f555c009980 con 0x55597b7c26d0 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.660+0000 7f55437fe700 1 -- 172.21.15.8:0/3326287383 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55597b7acd50 con 0x55597b7c26d0 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.660+0000 7f55437fe700 1 -- 172.21.15.8:0/3326287383 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 32) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f555409a500 con 0x55597b7c26d0 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.660+0000 7f557dd27b80 10 client.25846 fetch_fsmap finished waiting for FSMap version 32 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.660+0000 7f557dd27b80 10 client.25846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.660+0000 7f557dd27b80 20 client.25846 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.660+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55597b7d8230 0x55597b7da650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.660+0000 7f557dd27b80 4 client.25846 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:17:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.660+0000 7f557dd27b80 1 -- 172.21.15.8:0/3326287383 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55597b705db0 con 0x55597b7d8230 2023-10-06T23:17:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.661+0000 7f555bfff700 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55597b7d8230 0x55597b7da650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.661+0000 7f555bfff700 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55597b7d8230 0x55597b7da650 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64e53ca8f84fb397 server_cookie=3016624d5ac6c787 in_seq=0 out_seq=0 2023-10-06T23:17:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.662+0000 7f55437fe700 10 client.25846 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.662+0000 7f55437fe700 1 -- 172.21.15.8:0/3326287383 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55597b705db0 con 0x55597b7d8230 2023-10-06T23:17:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.662+0000 7f55437fe700 10 client.25846 handle_command_reply: tid=0 2023-10-06T23:17:47.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.663+0000 7f557dd27b80 1 client.25846 shutdown 2023-10-06T23:17:47.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.663+0000 7f557dd27b80 1 -- 172.21.15.8:0/3326287383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c26d0 msgr2=0x55597b7cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.663+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c26d0 0x55597b7cc460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55540a2100 tx=0x7f555400cdd0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.663+0000 7f557dd27b80 1 -- 172.21.15.8:0/3326287383 shutdown_connections 2023-10-06T23:17:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55597b7d8230 0x55597b7da650 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c41a0 0x55597b7d39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c26d0 0x55597b7cc460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f55437fe700 0 client.25846 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3326287383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f557dd27b80 1 -- 172.21.15.8:0/3326287383 >> 172.21.15.8:0/3326287383 conn(0x55597b72e200 msgr2=0x55597b7b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f557dd27b80 1 -- 172.21.15.8:0/3326287383 shutdown_connections 2023-10-06T23:17:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f557dd27b80 1 -- 172.21.15.8:0/3326287383 wait complete. 2023-10-06T23:17:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.664+0000 7f557dd27b80 20 client.25846 trim_cache size 0 max 16384 2023-10-06T23:17:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.689+0000 7f557dd27b80 1 Processor -- start 2023-10-06T23:17:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.689+0000 7f557dd27b80 1 -- start start 2023-10-06T23:17:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c41a0 0x55597b7b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f557dd27b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b58d8c0 con 0x55597b7c26d0 2023-10-06T23:17:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f557dd27b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b7c3460 con 0x55597b7c37e0 2023-10-06T23:17:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f557dd27b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b7b62f0 con 0x55597b7c41a0 2023-10-06T23:17:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f5563fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f5563fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60946/0 (socket says 172.21.15.8:60946) 2023-10-06T23:17:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f5563fff700 1 -- 172.21.15.8:0/3602887054 learned_addr learned my addr 172.21.15.8:0/3602887054 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f556899c700 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c41a0 0x55597b7b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.690+0000 7f555bfff700 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f556899c700 1 -- 172.21.15.8:0/3602887054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 msgr2=0x55597b7d39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f556899c700 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7d39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f556899c700 1 -- 172.21.15.8:0/3602887054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 msgr2=0x55597b7cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f556899c700 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f556899c700 1 -- 172.21.15.8:0/3602887054 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55597b520c00 con 0x55597b7c41a0 2023-10-06T23:17:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f556899c700 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c41a0 0x55597b7b4980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f555c009dd0 tx=0x7f555c01e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434be7e54b9c82d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f555affd700 1 -- 172.21.15.8:0/3602887054 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c003680 con 0x55597b7c41a0 2023-10-06T23:17:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f555affd700 1 -- 172.21.15.8:0/3602887054 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f555c003c70 con 0x55597b7c41a0 2023-10-06T23:17:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.691+0000 7f555affd700 1 -- 172.21.15.8:0/3602887054 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00f3c0 con 0x55597b7c41a0 2023-10-06T23:17:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.692+0000 7f557dd27b80 1 -- 172.21.15.8:0/3602887054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c41a0 msgr2=0x55597b7b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.692+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c41a0 0x55597b7b4980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f555c009dd0 tx=0x7f555c01e000 comp rx=0 tx=0).stop 2023-10-06T23:17:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.693+0000 7f557dd27b80 1 -- 172.21.15.8:0/3602887054 shutdown_connections 2023-10-06T23:17:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.693+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.693+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c41a0 0x55597b7b4980 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.693+0000 7f557dd27b80 1 --2- 172.21.15.8:0/3602887054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c37e0 0x55597b7d39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.700 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.693+0000 7f557dd27b80 1 -- 172.21.15.8:0/3602887054 >> 172.21.15.8:0/3602887054 conn(0x55597b72e200 msgr2=0x55597b7b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.693+0000 7f557dd27b80 1 -- 172.21.15.8:0/3602887054 shutdown_connections 2023-10-06T23:17:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.693+0000 7f557dd27b80 1 -- 172.21.15.8:0/3602887054 wait complete. 2023-10-06T23:17:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.694+0000 7f557dd27b80 1 -- start start 2023-10-06T23:17:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.694+0000 7f557dd27b80 1 Processor -- start 2023-10-06T23:17:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.694+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.694+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.702 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.694+0000 7f557dd27b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c41a0 0x55597b7d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.702 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.694+0000 7f557dd27b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b7d30c0 con 0x55597b7c26d0 2023-10-06T23:17:47.702 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.694+0000 7f557dd27b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b7d3230 con 0x55597b7c41a0 2023-10-06T23:17:47.702 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.694+0000 7f557dd27b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597b7d33f0 con 0x55597b7c37e0 2023-10-06T23:17:47.702 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f557dd27b80 10 client.0 _ll_register_callbacks cb 0x7f5554099de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:17:47.702 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f5563fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.702 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f556899c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c41a0 0x55597b7d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f5563fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60960/0 (socket says 172.21.15.8:60960) 2023-10-06T23:17:47.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f5563fff700 1 -- 172.21.15.8:0/2679120690 learned_addr learned my addr 172.21.15.8:0/2679120690 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:17:47.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f555bfff700 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f556899c700 1 -- 172.21.15.8:0/2679120690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 msgr2=0x55597b7d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:47.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f556899c700 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f556899c700 1 -- 172.21.15.8:0/2679120690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 msgr2=0x55597b7d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:17:47.703 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f556899c700 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f556899c700 1 -- 172.21.15.8:0/2679120690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55597b537d80 con 0x55597b7c41a0 2023-10-06T23:17:47.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.695+0000 7f5563fff700 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:17:47.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.696+0000 7f556899c700 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c41a0 0x55597b7d2b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f555c011a70 tx=0x7f555c005d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ee17c44afe3097 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:17:47.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.696+0000 7f55437fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:17:47.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.696+0000 7f55437fe700 1 -- 172.21.15.8:0/2679120690 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c041070 con 0x55597b7c41a0 2023-10-06T23:17:47.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.696+0000 7f557dd27b80 1 -- 172.21.15.8:0/2679120690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f555c003e70 con 0x55597b7c41a0 2023-10-06T23:17:47.704 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.696+0000 7f55437fe700 1 -- 172.21.15.8:0/2679120690 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f555c003890 con 0x55597b7c41a0 2023-10-06T23:17:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.696+0000 7f55437fe700 1 -- 172.21.15.8:0/2679120690 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f555c003a50 con 0x55597b7c41a0 2023-10-06T23:17:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.696+0000 7f557dd27b80 10 client.25811 fetch_fsmap learned FSMap version 32 2023-10-06T23:17:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.696+0000 7f557dd27b80 1 -- 172.21.15.8:0/2679120690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55597b55e1f0 con 0x55597b7c41a0 2023-10-06T23:17:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f55437fe700 1 -- 172.21.15.8:0/2679120690 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f555c04c080 con 0x55597b7c41a0 2023-10-06T23:17:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f55437fe700 1 -- 172.21.15.8:0/2679120690 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f555c044020 con 0x55597b7c41a0 2023-10-06T23:17:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f557dd27b80 10 client.25811 fetch_fsmap finished waiting for FSMap version 32 2023-10-06T23:17:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f557dd27b80 10 client.25811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:17:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f557dd27b80 20 client.25811 populate_metadata read hostname 'smithi008' 2023-10-06T23:17:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55597b82cc40 0x55597b82f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:17:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f557dd27b80 4 client.25811 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:17:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f557dd27b80 1 -- 172.21.15.8:0/2679120690 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55597b705ad0 con 0x55597b82cc40 2023-10-06T23:17:47.706 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.697+0000 7f5563fff700 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55597b82cc40 0x55597b82f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:17:47.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.698+0000 7f55437fe700 10 client.25811 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:47.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.698+0000 7f5563fff700 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55597b82cc40 0x55597b82f060 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=700b60bfb5cdb107 server_cookie=70491b15ddffd1c8 in_seq=0 out_seq=0 2023-10-06T23:17:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.712+0000 7f55437fe700 1 -- 172.21.15.8:0/2679120690 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55597b705ad0 con 0x55597b82cc40 2023-10-06T23:17:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.712+0000 7f55437fe700 10 client.25811 handle_command_reply: tid=0 2023-10-06T23:17:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.712+0000 7f557dd27b80 1 client.25811 shutdown 2023-10-06T23:17:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.712+0000 7f557dd27b80 1 -- 172.21.15.8:0/2679120690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c41a0 msgr2=0x55597b7d2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.712+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c41a0 0x55597b7d2b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f555c011a70 tx=0x7f555c005d10 comp rx=0 tx=0).stop 2023-10-06T23:17:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f557dd27b80 1 -- 172.21.15.8:0/2679120690 shutdown_connections 2023-10-06T23:17:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55597b82cc40 0x55597b82f060 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55597b7c26d0 0x55597b7d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55597b7c41a0 0x55597b7d2b80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f557dd27b80 1 --2- 172.21.15.8:0/2679120690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55597b7c37e0 0x55597b7d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f557dd27b80 1 -- 172.21.15.8:0/2679120690 >> 172.21.15.8:0/2679120690 conn(0x55597b72e200 msgr2=0x55597b7ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f55437fe700 0 client.25811 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:17:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f557dd27b80 1 -- 172.21.15.8:0/2679120690 shutdown_connections 2023-10-06T23:17:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.713+0000 7f557dd27b80 1 -- 172.21.15.8:0/2679120690 wait complete. 2023-10-06T23:17:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.714+0000 7f557dd27b80 20 client.25811 trim_cache size 0 max 16384 2023-10-06T23:17:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:17:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:17:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:17:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:17:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 -- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55500a1580 msgr2=0x7f55500a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55500a1580 0x7f55500a3a40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f555c023000 tx=0x7f555c024000 comp rx=0 tx=0).stop 2023-10-06T23:17:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 -- 172.21.15.8:0/2781327364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5564100f30 msgr2=0x7f5564198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:17:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5564100f30 0x7f5564198db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f555400eb30 tx=0x7f555400ee40 comp rx=0 tx=0).stop 2023-10-06T23:17:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 -- 172.21.15.8:0/2781327364 shutdown_connections 2023-10-06T23:17:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55500a1580 0x7f55500a3a40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5564102a40 0x7f556419a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5564100f30 0x7f5564198db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 --2- 172.21.15.8:0/2781327364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5564102080 0x7f55641992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:17:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 -- 172.21.15.8:0/2781327364 >> 172.21.15.8:0/2781327364 conn(0x7f55640fc480 msgr2=0x7f55640fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:17:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 -- 172.21.15.8:0/2781327364 shutdown_connections 2023-10-06T23:17:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:17:47.715+0000 7f556a3ff700 1 -- 172.21.15.8:0/2781327364 wait complete. 2023-10-06T23:17:48.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:48 smithi008 ceph-mon[98532]: pgmap v497: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 4.7 MiB/s wr, 535 op/s 2023-10-06T23:17:48.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:48 smithi190 ceph-mon[102658]: pgmap v497: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 4.7 MiB/s wr, 535 op/s 2023-10-06T23:17:48.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:48 smithi156 ceph-mon[102862]: pgmap v497: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 4.7 MiB/s wr, 535 op/s 2023-10-06T23:17:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 175.0 s, 224.0 tps, lat 444.753 ms stddev 120.204 2023-10-06T23:17:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:50 smithi008 ceph-mon[98532]: pgmap v498: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 4.1 MiB/s wr, 497 op/s 2023-10-06T23:17:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:50 smithi190 ceph-mon[102658]: pgmap v498: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 4.1 MiB/s wr, 497 op/s 2023-10-06T23:17:50.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:50 smithi156 ceph-mon[102862]: pgmap v498: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 4.1 MiB/s wr, 497 op/s 2023-10-06T23:17:52.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:52 smithi008 ceph-mon[98532]: pgmap v499: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 5.0 MiB/s wr, 593 op/s 2023-10-06T23:17:52.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:52 smithi190 ceph-mon[102658]: pgmap v499: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 5.0 MiB/s wr, 593 op/s 2023-10-06T23:17:52.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:52 smithi156 ceph-mon[102862]: pgmap v499: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 5.0 MiB/s wr, 593 op/s 2023-10-06T23:17:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:53 smithi008 ceph-mon[98532]: pgmap v500: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 4.2 MiB/s wr, 514 op/s 2023-10-06T23:17:53.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:53 smithi190 ceph-mon[102658]: pgmap v500: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 4.2 MiB/s wr, 514 op/s 2023-10-06T23:17:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:53 smithi156 ceph-mon[102862]: pgmap v500: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 4.2 MiB/s wr, 514 op/s 2023-10-06T23:17:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 180.0 s, 227.2 tps, lat 443.367 ms stddev 237.120 2023-10-06T23:17:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:56 smithi008 ceph-mon[98532]: pgmap v501: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.8 MiB/s wr, 610 op/s 2023-10-06T23:17:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:56 smithi190 ceph-mon[102658]: pgmap v501: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.8 MiB/s wr, 610 op/s 2023-10-06T23:17:56.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:56 smithi156 ceph-mon[102862]: pgmap v501: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.8 MiB/s wr, 610 op/s 2023-10-06T23:17:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:58 smithi008 ceph-mon[98532]: pgmap v502: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 5.7 MiB/s wr, 542 op/s 2023-10-06T23:17:58.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:58 smithi190 ceph-mon[102658]: pgmap v502: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 5.7 MiB/s wr, 542 op/s 2023-10-06T23:17:58.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:58 smithi156 ceph-mon[102862]: pgmap v502: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 5.7 MiB/s wr, 542 op/s 2023-10-06T23:17:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 185.0 s, 235.2 tps, lat 422.582 ms stddev 83.876 2023-10-06T23:17:59.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:59 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:59.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:17:59 smithi008 ceph-mon[98532]: pgmap v503: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 5.8 MiB/s wr, 528 op/s 2023-10-06T23:17:59.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:59 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:59.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:17:59 smithi190 ceph-mon[102658]: pgmap v503: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 5.8 MiB/s wr, 528 op/s 2023-10-06T23:17:59.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:59 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:17:59.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:17:59 smithi156 ceph-mon[102862]: pgmap v503: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 5.8 MiB/s wr, 528 op/s 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 -- 172.21.15.8:0/1290371177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e4106bd0 msgr2=0x7f29e4109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1290371177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e4106bd0 0x7f29e4109040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009990 tx=0x7f29dc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 -- 172.21.15.8:0/1290371177 shutdown_connections 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1290371177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e4106bd0 0x7f29e4109040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1290371177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e4101970 0x7f29e4103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1290371177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e41042a0 0x7f29e4106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 -- 172.21.15.8:0/1290371177 >> 172.21.15.8:0/1290371177 conn(0x7f29e40fb340 msgr2=0x7f29e40fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 -- 172.21.15.8:0/1290371177 shutdown_connections 2023-10-06T23:18:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.940+0000 7f29e93ff700 1 -- 172.21.15.8:0/1290371177 wait complete. 2023-10-06T23:18:00.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.942+0000 7f29e93ff700 1 Processor -- start 2023-10-06T23:18:00.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.942+0000 7f29e93ff700 1 -- start start 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.942+0000 7f29e93ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4101970 0x7f29e4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.942+0000 7f29e93ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e41042a0 0x7f29e4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.942+0000 7f29e93ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e4106bd0 0x7f29e419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.942+0000 7f29e93ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e419a7b0 con 0x7f29e4101970 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.942+0000 7f29e93ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e419a920 con 0x7f29e41042a0 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.942+0000 7f29e93ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e419aae0 con 0x7f29e4106bd0 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e41042a0 0x7f29e4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e41042a0 0x7f29e4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42190/0 (socket says 172.21.15.8:42190) 2023-10-06T23:18:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e27fc700 1 -- 172.21.15.8:0/1406743309 learned_addr learned my addr 172.21.15.8:0/1406743309 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e37fe700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e4106bd0 0x7f29e419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4101970 0x7f29e4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e27fc700 1 -- 172.21.15.8:0/1406743309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e4106bd0 msgr2=0x7f29e419a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e27fc700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e4106bd0 0x7f29e419a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e27fc700 1 -- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4101970 msgr2=0x7f29e4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e27fc700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4101970 0x7f29e4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.943+0000 7f29e27fc700 1 -- 172.21.15.8:0/1406743309 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0095f0 con 0x7f29e41042a0 2023-10-06T23:18:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.944+0000 7f29e27fc700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e41042a0 0x7f29e4199300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e9a0 tx=0x7f29d800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.944+0000 7f29cbfff700 1 -- 172.21.15.8:0/1406743309 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8009790 con 0x7f29e41042a0 2023-10-06T23:18:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.944+0000 7f29cbfff700 1 -- 172.21.15.8:0/1406743309 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29d8010430 con 0x7f29e41042a0 2023-10-06T23:18:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.944+0000 7f29cbfff700 1 -- 172.21.15.8:0/1406743309 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d800cea0 con 0x7f29e41042a0 2023-10-06T23:18:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.944+0000 7f29e93ff700 1 -- 172.21.15.8:0/1406743309 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e419adc0 con 0x7f29e41042a0 2023-10-06T23:18:00.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.944+0000 7f29e93ff700 1 -- 172.21.15.8:0/1406743309 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e41a1500 con 0x7f29e41042a0 2023-10-06T23:18:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.951+0000 7f29cbfff700 1 -- 172.21.15.8:0/1406743309 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f29d80105a0 con 0x7f29e41042a0 2023-10-06T23:18:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.951+0000 7f29fcd84b80 1 Processor -- start 2023-10-06T23:18:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.951+0000 7f29fcd84b80 1 -- start start 2023-10-06T23:18:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae81faaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae81fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae815a400 con 0x557ae81fa6d0 2023-10-06T23:18:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae814bbc0 con 0x557ae81fc1a0 2023-10-06T23:18:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae81494e0 con 0x557ae81fb7e0 2023-10-06T23:18:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29e2ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae81fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29e27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29e2ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae81fbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60774/0 (socket says 172.21.15.8:60774) 2023-10-06T23:18:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.952+0000 7f29e2ffd700 1 -- 172.21.15.8:0/4052676971 learned_addr learned my addr 172.21.15.8:0/4052676971 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29e37fe700 1 --2- 172.21.15.8:0/4052676971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae81faaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29e2ffd700 1 -- 172.21.15.8:0/4052676971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 msgr2=0x557ae8202a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/4052676971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29cbfff700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29cc0a15d0 0x7f29cc0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29e2ffd700 1 -- 172.21.15.8:0/4052676971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 msgr2=0x557ae81faaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/4052676971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae81faaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29e2ffd700 1 -- 172.21.15.8:0/4052676971 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ae7f6fd80 con 0x557ae81fb7e0 2023-10-06T23:18:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29cbfff700 1 -- 172.21.15.8:0/1406743309 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f29d8014070 con 0x7f29e41042a0 2023-10-06T23:18:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.953+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/4052676971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae81fbc60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f29d40115f0 tx=0x7f29d4009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8da47cc61d67c011 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.954+0000 7f29e37fe700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29cc0a15d0 0x7f29cc0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.954+0000 7f29c97fa700 1 -- 172.21.15.8:0/4052676971 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400e040 con 0x557ae81fb7e0 2023-10-06T23:18:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.954+0000 7f29c97fa700 1 -- 172.21.15.8:0/4052676971 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29d400f040 con 0x557ae81fb7e0 2023-10-06T23:18:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.954+0000 7f29c97fa700 1 -- 172.21.15.8:0/4052676971 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4015810 con 0x557ae81fb7e0 2023-10-06T23:18:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.955+0000 7f29fcd84b80 1 -- 172.21.15.8:0/4052676971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 msgr2=0x557ae81fbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.955+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/4052676971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae81fbc60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f29d40115f0 tx=0x7f29d4009920 comp rx=0 tx=0).stop 2023-10-06T23:18:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.955+0000 7f29e37fe700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29cc0a15d0 0x7f29cc0a3a90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x557ae81fa470 tx=0x7f29dc01a040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.956+0000 7f29fcd84b80 1 -- 172.21.15.8:0/4052676971 shutdown_connections 2023-10-06T23:18:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.956+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/4052676971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae81faaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.956+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/4052676971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.956+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/4052676971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae81fbc60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.956+0000 7f29fcd84b80 1 -- 172.21.15.8:0/4052676971 >> 172.21.15.8:0/4052676971 conn(0x557ae8166200 msgr2=0x557ae81ecb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.956+0000 7f29fcd84b80 1 -- 172.21.15.8:0/4052676971 shutdown_connections 2023-10-06T23:18:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.956+0000 7f29fcd84b80 1 -- 172.21.15.8:0/4052676971 wait complete. 2023-10-06T23:18:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.956+0000 7f29fcd84b80 1 -- start start 2023-10-06T23:18:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.957+0000 7f29fcd84b80 1 Processor -- start 2023-10-06T23:18:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.957+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fa6d0 0x557ae8204380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.957+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fb7e0 0x557ae82048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.957+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fc1a0 0x557ae820b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.957+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae8144dd0 con 0x557ae81fb7e0 2023-10-06T23:18:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.957+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae80e16b0 con 0x557ae81fa6d0 2023-10-06T23:18:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.957+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae80e1350 con 0x557ae81fc1a0 2023-10-06T23:18:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.958+0000 7f29fcd84b80 10 client.0 _ll_register_callbacks cb 0x557ae7f3e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.958+0000 7f29e2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fa6d0 0x557ae8204380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.958+0000 7f29e2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fa6d0 0x557ae8204380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42212/0 (socket says 172.21.15.8:42212) 2023-10-06T23:18:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.958+0000 7f29e2ffd700 1 -- 172.21.15.8:0/194919571 learned_addr learned my addr 172.21.15.8:0/194919571 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.958+0000 7f29e37fe700 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fc1a0 0x557ae820b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.958+0000 7f29e27fc700 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fb7e0 0x557ae82048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29e37fe700 1 -- 172.21.15.8:0/194919571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fa6d0 msgr2=0x557ae8204380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29e37fe700 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fa6d0 0x557ae8204380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29e37fe700 1 -- 172.21.15.8:0/194919571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fb7e0 msgr2=0x557ae82048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29e37fe700 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fb7e0 0x557ae82048c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29e37fe700 1 -- 172.21.15.8:0/194919571 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d40112d0 con 0x557ae81fc1a0 2023-10-06T23:18:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fa6d0 0x557ae8204380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:18:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29e37fe700 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fc1a0 0x557ae820b900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29dc006010 tx=0x7f29dc00b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc0eb73c8433a56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29c6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:18:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.959+0000 7f29c6ff5700 1 -- 172.21.15.8:0/194919571 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc01d030 con 0x557ae81fc1a0 2023-10-06T23:18:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.960+0000 7f29c6ff5700 1 -- 172.21.15.8:0/194919571 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f29dc00b920 con 0x557ae81fc1a0 2023-10-06T23:18:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.960+0000 7f29fcd84b80 1 -- 172.21.15.8:0/194919571 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ae81e4d50 con 0x557ae81fc1a0 2023-10-06T23:18:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.960+0000 7f29c6ff5700 1 -- 172.21.15.8:0/194919571 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29dc003d40 con 0x557ae81fc1a0 2023-10-06T23:18:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.960+0000 7f29fcd84b80 10 client.25864 fetch_fsmap learned FSMap version 33 2023-10-06T23:18:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.960+0000 7f29fcd84b80 1 -- 172.21.15.8:0/194919571 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x557ae7f58c00 con 0x557ae81fc1a0 2023-10-06T23:18:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.960+0000 7f29c6ff5700 1 -- 172.21.15.8:0/194919571 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557ae81e4d50 con 0x557ae81fc1a0 2023-10-06T23:18:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.961+0000 7f29c6ff5700 1 -- 172.21.15.8:0/194919571 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 33) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f29dc004c90 con 0x557ae81fc1a0 2023-10-06T23:18:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.961+0000 7f29fcd84b80 10 client.25864 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T23:18:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.961+0000 7f29fcd84b80 10 client.25864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.961+0000 7f29fcd84b80 20 client.25864 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.961+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557ae8210200 0x557ae8212620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.961+0000 7f29fcd84b80 4 client.25864 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:18:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.961+0000 7f29fcd84b80 1 -- 172.21.15.8:0/194919571 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ae813ddb0 con 0x557ae8210200 2023-10-06T23:18:00.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.961+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557ae8210200 0x557ae8212620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.962+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557ae8210200 0x557ae8212620 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2fe5c9486ea18ee server_cookie=2f87e23b460c8bc1 in_seq=0 out_seq=0 2023-10-06T23:18:00.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.962+0000 7f29c6ff5700 10 client.25864 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:00.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.963+0000 7f29c6ff5700 1 -- 172.21.15.8:0/194919571 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557ae813ddb0 con 0x557ae8210200 2023-10-06T23:18:00.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.963+0000 7f29c6ff5700 10 client.25864 handle_command_reply: tid=0 2023-10-06T23:18:00.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.963+0000 7f29fcd84b80 1 client.25864 shutdown 2023-10-06T23:18:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 -- 172.21.15.8:0/194919571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fc1a0 msgr2=0x557ae820b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fc1a0 0x557ae820b900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29dc006010 tx=0x7f29dc00b260 comp rx=0 tx=0).stop 2023-10-06T23:18:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 -- 172.21.15.8:0/194919571 shutdown_connections 2023-10-06T23:18:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557ae8210200 0x557ae8212620 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fc1a0 0x557ae820b900 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fa6d0 0x557ae8204380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/194919571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fb7e0 0x557ae82048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 -- 172.21.15.8:0/194919571 >> 172.21.15.8:0/194919571 conn(0x557ae8166200 msgr2=0x557ae81ec250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29c6ff5700 0 client.25864 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 -- 172.21.15.8:0/194919571 shutdown_connections 2023-10-06T23:18:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.964+0000 7f29fcd84b80 1 -- 172.21.15.8:0/194919571 wait complete. 2023-10-06T23:18:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.965+0000 7f29fcd84b80 20 client.25864 trim_cache size 0 max 16384 2023-10-06T23:18:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.993+0000 7f29fcd84b80 1 Processor -- start 2023-10-06T23:18:00.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29fcd84b80 1 -- start start 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae8202550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae820b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae7fc58c0 con 0x557ae81fa6d0 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae81fc5c0 con 0x557ae81fc1a0 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae81faf50 con 0x557ae81fb7e0 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29e27fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae820b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42216/0 (socket says 172.21.15.8:42216) 2023-10-06T23:18:00.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.994+0000 7f29e37fe700 1 -- 172.21.15.8:0/1581325378 learned_addr learned my addr 172.21.15.8:0/1581325378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.995+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/1581325378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae8202550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.995+0000 7f29e37fe700 1 -- 172.21.15.8:0/1581325378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 msgr2=0x557ae820b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.995+0000 7f29e37fe700 1 --2- 172.21.15.8:0/1581325378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae820b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.995+0000 7f29e37fe700 1 -- 172.21.15.8:0/1581325378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 msgr2=0x557ae8202550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.995+0000 7f29e37fe700 1 --2- 172.21.15.8:0/1581325378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae8202550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.995+0000 7f29e37fe700 1 -- 172.21.15.8:0/1581325378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ae7f961f0 con 0x557ae81fc1a0 2023-10-06T23:18:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.995+0000 7f29e37fe700 1 --2- 172.21.15.8:0/1581325378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0041e0 tx=0x7f29dc009390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d6074eab9b72140 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.996+0000 7f29c9ffb700 1 -- 172.21.15.8:0/1581325378 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc005c70 con 0x557ae81fc1a0 2023-10-06T23:18:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.996+0000 7f29c9ffb700 1 -- 172.21.15.8:0/1581325378 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29dc028070 con 0x557ae81fc1a0 2023-10-06T23:18:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.996+0000 7f29c9ffb700 1 -- 172.21.15.8:0/1581325378 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00be60 con 0x557ae81fc1a0 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 -- 172.21.15.8:0/1581325378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 msgr2=0x557ae8202a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/1581325378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0041e0 tx=0x7f29dc009390 comp rx=0 tx=0).stop 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 -- 172.21.15.8:0/1581325378 shutdown_connections 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/1581325378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae8202550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/1581325378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae8202a90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/1581325378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae820b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 -- 172.21.15.8:0/1581325378 >> 172.21.15.8:0/1581325378 conn(0x557ae8166200 msgr2=0x557ae82030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 -- 172.21.15.8:0/1581325378 shutdown_connections 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.997+0000 7f29fcd84b80 1 -- 172.21.15.8:0/1581325378 wait complete. 2023-10-06T23:18:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.998+0000 7f29fcd84b80 1 -- start start 2023-10-06T23:18:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.998+0000 7f29fcd84b80 1 Processor -- start 2023-10-06T23:18:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae8209210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:01.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae8209750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29fcd84b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae820a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae820ac40 con 0x557ae81fa6d0 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae820adb0 con 0x557ae81fc1a0 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29fcd84b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae820af20 con 0x557ae81fb7e0 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29fcd84b80 10 client.0 _ll_register_callbacks cb 0x7f29dc005e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae820a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29e37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae820a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42224/0 (socket says 172.21.15.8:42224) 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29e27fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae8209750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:01.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:00.999+0000 7f29e37fe700 1 -- 172.21.15.8:0/45697942 learned_addr learned my addr 172.21.15.8:0/45697942 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:01.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.000+0000 7f29e37fe700 1 -- 172.21.15.8:0/45697942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 msgr2=0x557ae8209750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:01.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.000+0000 7f29e37fe700 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae8209750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.000+0000 7f29e37fe700 1 -- 172.21.15.8:0/45697942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 msgr2=0x557ae8209210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.000+0000 7f29e37fe700 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae8209210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.000+0000 7f29e37fe700 1 -- 172.21.15.8:0/45697942 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ae7f58c00 con 0x557ae81fc1a0 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.000+0000 7f29e37fe700 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae820a700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29dc003e60 tx=0x7f29dc00f7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8368fc1a355c7fda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.000+0000 7f29c6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.001+0000 7f29c6ff5700 1 -- 172.21.15.8:0/45697942 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00fa80 con 0x557ae81fc1a0 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.001+0000 7f29c6ff5700 1 -- 172.21.15.8:0/45697942 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f29dc00fbe0 con 0x557ae81fc1a0 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.001+0000 7f29fcd84b80 1 -- 172.21.15.8:0/45697942 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29d400f040 con 0x557ae81fc1a0 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.001+0000 7f29c6ff5700 1 -- 172.21.15.8:0/45697942 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29dc00fda0 con 0x557ae81fc1a0 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.001+0000 7f29fcd84b80 10 client.25829 fetch_fsmap learned FSMap version 33 2023-10-06T23:18:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.001+0000 7f29fcd84b80 1 -- 172.21.15.8:0/45697942 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x557ae7f6e250 con 0x557ae81fc1a0 2023-10-06T23:18:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29c6ff5700 1 -- 172.21.15.8:0/45697942 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29d400f040 con 0x557ae81fc1a0 2023-10-06T23:18:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29c6ff5700 1 -- 172.21.15.8:0/45697942 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f29dc04c070 con 0x557ae81fc1a0 2023-10-06T23:18:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29fcd84b80 10 client.25829 fetch_fsmap finished waiting for FSMap version 33 2023-10-06T23:18:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29fcd84b80 10 client.25829 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29fcd84b80 20 client.25829 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557ae81ef280 0x557ae81f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29fcd84b80 4 client.25829 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:18:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29fcd84b80 1 -- 172.21.15.8:0/45697942 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557ae813dad0 con 0x557ae81ef280 2023-10-06T23:18:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.002+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557ae81ef280 0x557ae81f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.003+0000 7f29e2ffd700 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557ae81ef280 0x557ae81f16a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e4b489f27f1490 server_cookie=fea1488aa2c1f081 in_seq=0 out_seq=0 2023-10-06T23:18:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.003+0000 7f29c6ff5700 10 client.25829 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.017+0000 7f29c6ff5700 1 -- 172.21.15.8:0/45697942 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557ae813dad0 con 0x557ae81ef280 2023-10-06T23:18:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.017+0000 7f29c6ff5700 10 client.25829 handle_command_reply: tid=0 2023-10-06T23:18:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.017+0000 7f29fcd84b80 1 client.25829 shutdown 2023-10-06T23:18:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.017+0000 7f29fcd84b80 1 -- 172.21.15.8:0/45697942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 msgr2=0x557ae820a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.017+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae820a700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29dc003e60 tx=0x7f29dc00f7d0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 1 -- 172.21.15.8:0/45697942 shutdown_connections 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x557ae81ef280 0x557ae81f16a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ae81fa6d0 0x557ae8209210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ae81fc1a0 0x557ae820a700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 1 --2- 172.21.15.8:0/45697942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ae81fb7e0 0x557ae8209750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 1 -- 172.21.15.8:0/45697942 >> 172.21.15.8:0/45697942 conn(0x557ae8166200 msgr2=0x557ae8202550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29c6ff5700 0 client.25829 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 1 -- 172.21.15.8:0/45697942 shutdown_connections 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 1 -- 172.21.15.8:0/45697942 wait complete. 2023-10-06T23:18:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.018+0000 7f29fcd84b80 20 client.25829 trim_cache size 0 max 16384 2023-10-06T23:18:01.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:18:01.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:18:01.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:18:01.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 -- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29cc0a15d0 msgr2=0x7f29cc0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29cc0a15d0 0x7f29cc0a3a90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x557ae81fa470 tx=0x7f29dc01a040 comp rx=0 tx=0).stop 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 -- 172.21.15.8:0/1406743309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e41042a0 msgr2=0x7f29e4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e41042a0 0x7f29e4199300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e9a0 tx=0x7f29d800ecb0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 -- 172.21.15.8:0/1406743309 shutdown_connections 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29cc0a15d0 0x7f29cc0a3a90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e4101970 0x7f29e4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29e4106bd0 0x7f29e419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 --2- 172.21.15.8:0/1406743309 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29e41042a0 0x7f29e4199300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.019+0000 7f29e93ff700 1 -- 172.21.15.8:0/1406743309 >> 172.21.15.8:0/1406743309 conn(0x7f29e40fb340 msgr2=0x7f29e4102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.020+0000 7f29e93ff700 1 -- 172.21.15.8:0/1406743309 shutdown_connections 2023-10-06T23:18:01.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:01.020+0000 7f29e93ff700 1 -- 172.21.15.8:0/1406743309 wait complete. 2023-10-06T23:18:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:02 smithi008 ceph-mon[98532]: pgmap v504: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 6.3 MiB/s wr, 581 op/s 2023-10-06T23:18:02.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:02 smithi190 ceph-mon[102658]: pgmap v504: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 6.3 MiB/s wr, 581 op/s 2023-10-06T23:18:02.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:02 smithi156 ceph-mon[102862]: pgmap v504: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 6.3 MiB/s wr, 581 op/s 2023-10-06T23:18:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:03 smithi008 ceph-mon[98532]: pgmap v505: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.8 MiB/s wr, 435 op/s 2023-10-06T23:18:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:03 smithi190 ceph-mon[102658]: pgmap v505: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.8 MiB/s wr, 435 op/s 2023-10-06T23:18:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:03 smithi156 ceph-mon[102862]: pgmap v505: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.8 MiB/s wr, 435 op/s 2023-10-06T23:18:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 190.0 s, 239.4 tps, lat 418.749 ms stddev 80.736 2023-10-06T23:18:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:06 smithi008 ceph-mon[98532]: pgmap v506: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 5.7 MiB/s wr, 543 op/s 2023-10-06T23:18:06.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:06 smithi190 ceph-mon[102658]: pgmap v506: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 5.7 MiB/s wr, 543 op/s 2023-10-06T23:18:06.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:06 smithi156 ceph-mon[102862]: pgmap v506: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 5.7 MiB/s wr, 543 op/s 2023-10-06T23:18:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:08 smithi008 ceph-mon[98532]: pgmap v507: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2023-10-06T23:18:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:08 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:18:08.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:08 smithi190 ceph-mon[102658]: pgmap v507: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2023-10-06T23:18:08.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:08 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:18:08.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:08 smithi156 ceph-mon[102862]: pgmap v507: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 4.9 MiB/s wr, 526 op/s 2023-10-06T23:18:08.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:08 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:18:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 195.0 s, 243.6 tps, lat 412.337 ms stddev 112.281 2023-10-06T23:18:10.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:10 smithi008 ceph-mon[98532]: pgmap v508: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 3.8 MiB/s wr, 486 op/s 2023-10-06T23:18:10.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:10 smithi190 ceph-mon[102658]: pgmap v508: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 3.8 MiB/s wr, 486 op/s 2023-10-06T23:18:10.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:10 smithi156 ceph-mon[102862]: pgmap v508: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 3.8 MiB/s wr, 486 op/s 2023-10-06T23:18:11.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:11 smithi190 ceph-mon[102658]: pgmap v509: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.0 MiB/s wr, 511 op/s 2023-10-06T23:18:11.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:11 smithi156 ceph-mon[102862]: pgmap v509: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.0 MiB/s wr, 511 op/s 2023-10-06T23:18:11.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:11 smithi008 ceph-mon[98532]: pgmap v509: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.0 MiB/s wr, 511 op/s 2023-10-06T23:18:13.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:13 smithi008 ceph-mon[98532]: pgmap v510: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 4.5 MiB/s wr, 537 op/s 2023-10-06T23:18:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:13 smithi190 ceph-mon[102658]: pgmap v510: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 4.5 MiB/s wr, 537 op/s 2023-10-06T23:18:13.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:13 smithi156 ceph-mon[102862]: pgmap v510: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 4.5 MiB/s wr, 537 op/s 2023-10-06T23:18:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 200.0 s, 220.4 tps, lat 430.209 ms stddev 256.601 2023-10-06T23:18:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.227+0000 7f38269ff700 1 -- 172.21.15.8:0/1192442951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3820103090 msgr2=0x7f38201034b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.227+0000 7f38269ff700 1 --2- 172.21.15.8:0/1192442951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3820103090 0x7f38201034b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f38080099c0 tx=0x7f3808009cd0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.227+0000 7f38269ff700 1 -- 172.21.15.8:0/1192442951 shutdown_connections 2023-10-06T23:18:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.227+0000 7f38269ff700 1 --2- 172.21.15.8:0/1192442951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3820103090 0x7f38201034b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.227+0000 7f38269ff700 1 --2- 172.21.15.8:0/1192442951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3820104c20 0x7f382010b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.227+0000 7f38269ff700 1 --2- 172.21.15.8:0/1192442951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3820104280 0x7f38201046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.227+0000 7f38269ff700 1 -- 172.21.15.8:0/1192442951 >> 172.21.15.8:0/1192442951 conn(0x7f38200fe600 msgr2=0x7f3820100a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.228+0000 7f38269ff700 1 -- 172.21.15.8:0/1192442951 shutdown_connections 2023-10-06T23:18:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.228+0000 7f38269ff700 1 -- 172.21.15.8:0/1192442951 wait complete. 2023-10-06T23:18:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.229+0000 7f38269ff700 1 Processor -- start 2023-10-06T23:18:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.229+0000 7f38269ff700 1 -- start start 2023-10-06T23:18:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f38269ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3820103090 0x7f3820198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f38269ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3820104280 0x7f3820199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f38269ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3820104c20 0x7f38201a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f38269ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201a0860 con 0x7f3820104c20 2023-10-06T23:18:14.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f38269ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201a09d0 con 0x7f3820103090 2023-10-06T23:18:14.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f38269ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201a0b90 con 0x7f3820104280 2023-10-06T23:18:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f381ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3820103090 0x7f3820198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3820104280 0x7f3820199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f3824f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3820104c20 0x7f38201a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3820104280 0x7f3820199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:33930/0 (socket says 172.21.15.8:33930) 2023-10-06T23:18:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.231+0000 7f381f7fe700 1 -- 172.21.15.8:0/1885260174 learned_addr learned my addr 172.21.15.8:0/1885260174 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.230+0000 7f381ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3820103090 0x7f3820198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47554/0 (socket says 172.21.15.8:47554) 2023-10-06T23:18:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.231+0000 7f381f7fe700 1 -- 172.21.15.8:0/1885260174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3820103090 msgr2=0x7f3820198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.231+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3820103090 0x7f3820198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.231+0000 7f381f7fe700 1 -- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3820104c20 msgr2=0x7f38201a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.231+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3820104c20 0x7f38201a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.231+0000 7f381f7fe700 1 -- 172.21.15.8:0/1885260174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080095f0 con 0x7f3820104280 2023-10-06T23:18:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.231+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3820104280 0x7f3820199260 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f381000e9a0 tx=0x7f381000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.232+0000 7f381d7fa700 1 -- 172.21.15.8:0/1885260174 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810009790 con 0x7f3820104280 2023-10-06T23:18:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.232+0000 7f381d7fa700 1 -- 172.21.15.8:0/1885260174 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3810010430 con 0x7f3820104280 2023-10-06T23:18:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.232+0000 7f381d7fa700 1 -- 172.21.15.8:0/1885260174 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000cea0 con 0x7f3820104280 2023-10-06T23:18:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.232+0000 7f38269ff700 1 -- 172.21.15.8:0/1885260174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38201a0e70 con 0x7f3820104280 2023-10-06T23:18:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.232+0000 7f38269ff700 1 -- 172.21.15.8:0/1885260174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38200752f0 con 0x7f3820104280 2023-10-06T23:18:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.237+0000 7f381d7fa700 1 -- 172.21.15.8:0/1885260174 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f38100105a0 con 0x7f3820104280 2023-10-06T23:18:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.238+0000 7f383a3c6b80 1 Processor -- start 2023-10-06T23:18:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.238+0000 7f383a3c6b80 1 -- start start 2023-10-06T23:18:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86930fec0 0x55c8693102e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869310fd0 0x55c869311450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869311990 0x55c869318220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c869278400 con 0x55c86930fec0 2023-10-06T23:18:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c869269bc0 con 0x55c869311990 2023-10-06T23:18:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8692674e0 con 0x55c869310fd0 2023-10-06T23:18:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869311990 0x55c869318220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f381ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869310fd0 0x55c869311450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f381ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869310fd0 0x55c869311450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:33942/0 (socket says 172.21.15.8:33942) 2023-10-06T23:18:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869311990 0x55c869318220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47562/0 (socket says 172.21.15.8:47562) 2023-10-06T23:18:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.239+0000 7f381ffff700 1 -- 172.21.15.8:0/3584379489 learned_addr learned my addr 172.21.15.8:0/3584379489 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f3824f9c700 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86930fec0 0x55c8693102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f381f7fe700 1 -- 172.21.15.8:0/3584379489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869310fd0 msgr2=0x55c869311450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f381f7fe700 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869310fd0 0x55c869311450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f381f7fe700 1 -- 172.21.15.8:0/3584379489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86930fec0 msgr2=0x55c8693102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f381f7fe700 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86930fec0 0x55c8693102e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f381f7fe700 1 -- 172.21.15.8:0/3584379489 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c86908dd80 con 0x55c869311990 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f3824f9c700 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86930fec0 0x55c8693102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f381d7fa700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f380c0a1500 0x7f380c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.240+0000 7f381f7fe700 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869311990 0x55c869318220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38100ca8c0 tx=0x7f38100d0ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327c4ac1322f15df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.241+0000 7f3824f9c700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f380c0a1500 0x7f380c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.241+0000 7f38167fc700 1 -- 172.21.15.8:0/3584379489 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810096480 con 0x55c869311990 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.241+0000 7f38167fc700 1 -- 172.21.15.8:0/3584379489 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3810099f10 con 0x55c869311990 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.241+0000 7f38167fc700 1 -- 172.21.15.8:0/3584379489 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381001fd50 con 0x55c869311990 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.241+0000 7f381d7fa700 1 -- 172.21.15.8:0/1885260174 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3810014070 con 0x7f3820104280 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.242+0000 7f383a3c6b80 1 -- 172.21.15.8:0/3584379489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869311990 msgr2=0x55c869318220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.242+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869311990 0x55c869318220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38100ca8c0 tx=0x7f38100d0ec0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.242+0000 7f383a3c6b80 1 -- 172.21.15.8:0/3584379489 shutdown_connections 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.242+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86930fec0 0x55c8693102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.242+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869311990 0x55c869318220 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.242+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/3584379489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869310fd0 0x55c869311450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.242+0000 7f383a3c6b80 1 -- 172.21.15.8:0/3584379489 >> 172.21.15.8:0/3584379489 conn(0x55c869284200 msgr2=0x55c86930abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.242+0000 7f3824f9c700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f380c0a1500 0x7f380c0a39c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55c86930fc60 tx=0x7f381800b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.243+0000 7f383a3c6b80 1 -- 172.21.15.8:0/3584379489 shutdown_connections 2023-10-06T23:18:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.243+0000 7f383a3c6b80 1 -- 172.21.15.8:0/3584379489 wait complete. 2023-10-06T23:18:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.244+0000 7f383a3c6b80 1 -- start start 2023-10-06T23:18:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.244+0000 7f383a3c6b80 1 Processor -- start 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c86930fec0 0x55c869319aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869310fd0 0x55c869319fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869311990 0x55c869321020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c869262dd0 con 0x55c869311990 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8691ff6b0 con 0x55c869310fd0 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8691ff350 con 0x55c86930fec0 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f383a3c6b80 10 client.0 _ll_register_callbacks cb 0x55c86905c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869310fd0 0x55c869319fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f381ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c86930fec0 0x55c869319aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869310fd0 0x55c869319fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47578/0 (socket says 172.21.15.8:47578) 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f381ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c86930fec0 0x55c869319aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:33958/0 (socket says 172.21.15.8:33958) 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f381f7fe700 1 -- 172.21.15.8:0/1262397612 learned_addr learned my addr 172.21.15.8:0/1262397612 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.245+0000 7f3824f9c700 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869311990 0x55c869321020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f381f7fe700 1 -- 172.21.15.8:0/1262397612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c86930fec0 msgr2=0x55c869319aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c86930fec0 0x55c869319aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f381f7fe700 1 -- 172.21.15.8:0/1262397612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869311990 msgr2=0x55c869321020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869311990 0x55c869321020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f381f7fe700 1 -- 172.21.15.8:0/1262397612 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38200752f0 con 0x55c869310fd0 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f381ffff700 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c86930fec0 0x55c869319aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:18:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869310fd0 0x55c869319fe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f381009a080 tx=0x7f38100d0630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc5d8001eb8b68b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f37ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1262397612 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38100d01e0 con 0x55c869310fd0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1262397612 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f381009a840 con 0x55c869310fd0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.246+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1262397612 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c869302d50 con 0x55c869310fd0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.247+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1262397612 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38100b7020 con 0x55c869310fd0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.247+0000 7f383a3c6b80 10 client.25841 fetch_fsmap learned FSMap version 34 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.247+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1262397612 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c869076c00 con 0x55c869310fd0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.247+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1262397612 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f381007c080 con 0x55c869310fd0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.247+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1262397612 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 34) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f38100ca9a0 con 0x55c869310fd0 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.247+0000 7f383a3c6b80 10 client.25841 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.247+0000 7f383a3c6b80 10 client.25841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.247+0000 7f383a3c6b80 20 client.25841 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.248+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c8693254d0 0x55c8693278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.248+0000 7f383a3c6b80 4 client.25841 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:18:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.248+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1262397612 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c86925bdb0 con 0x55c8693254d0 2023-10-06T23:18:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.248+0000 7f381ffff700 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c8693254d0 0x55c8693278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.249+0000 7f381ffff700 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c8693254d0 0x55c8693278f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d68ce2049c650f5d server_cookie=432971561efb1059 in_seq=0 out_seq=0 2023-10-06T23:18:14.253 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.249+0000 7f37ff7fe700 10 client.25841 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1262397612 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c86925bdb0 con 0x55c8693254d0 2023-10-06T23:18:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f37ff7fe700 10 client.25841 handle_command_reply: tid=0 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 client.25841 shutdown 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1262397612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869310fd0 msgr2=0x55c869319fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869310fd0 0x55c869319fe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f381009a080 tx=0x7f38100d0630 comp rx=0 tx=0).stop 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1262397612 shutdown_connections 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c8693254d0 0x55c8693278f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869311990 0x55c869321020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c86930fec0 0x55c869319aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f37ff7fe700 0 client.25841 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1262397612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c869310fd0 0x55c869319fe0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.250+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1262397612 >> 172.21.15.8:0/1262397612 conn(0x55c869284200 msgr2=0x55c86930a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.251+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1262397612 shutdown_connections 2023-10-06T23:18:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.251+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1262397612 wait complete. 2023-10-06T23:18:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.251+0000 7f383a3c6b80 20 client.25841 trim_cache size 0 max 16384 2023-10-06T23:18:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.272+0000 7f383a3c6b80 1 Processor -- start 2023-10-06T23:18:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.272+0000 7f383a3c6b80 1 -- start start 2023-10-06T23:18:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.272+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c869319a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.272+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 0x55c869320fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.272+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 0x55c869319fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.272+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8690e38c0 con 0x55c869310fd0 2023-10-06T23:18:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.272+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c869319670 con 0x55c86930fec0 2023-10-06T23:18:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.272+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c869307860 con 0x55c869311990 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c869319a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f3824f9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 0x55c869319fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c869319a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47584/0 (socket says 172.21.15.8:47584) 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381ffff700 1 -- 172.21.15.8:0/1722750394 learned_addr learned my addr 172.21.15.8:0/1722750394 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1722750394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 0x55c869320fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381ffff700 1 -- 172.21.15.8:0/1722750394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 msgr2=0x55c869319fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381ffff700 1 --2- 172.21.15.8:0/1722750394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 0x55c869319fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381ffff700 1 -- 172.21.15.8:0/1722750394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 msgr2=0x55c869320fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381ffff700 1 --2- 172.21.15.8:0/1722750394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 0x55c869320fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.273+0000 7f381ffff700 1 -- 172.21.15.8:0/1722750394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8690b41f0 con 0x55c86930fec0 2023-10-06T23:18:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.274+0000 7f381ffff700 1 --2- 172.21.15.8:0/1722750394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c869319a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f380800bf10 tx=0x7f380800bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bbffd2b440edc61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.274+0000 7f3816ffd700 1 -- 172.21.15.8:0/1722750394 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380802c070 con 0x55c86930fec0 2023-10-06T23:18:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.274+0000 7f3816ffd700 1 -- 172.21.15.8:0/1722750394 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f380801e040 con 0x55c86930fec0 2023-10-06T23:18:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.274+0000 7f3816ffd700 1 -- 172.21.15.8:0/1722750394 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808005600 con 0x55c86930fec0 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.275+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1722750394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 msgr2=0x55c869319a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.275+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1722750394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c869319a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f380800bf10 tx=0x7f380800bc70 comp rx=0 tx=0).stop 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.275+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1722750394 shutdown_connections 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.275+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1722750394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 0x55c869319fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.275+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1722750394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c869319a80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.275+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1722750394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 0x55c869320fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.275+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1722750394 >> 172.21.15.8:0/1722750394 conn(0x55c869284200 msgr2=0x55c869314980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.276+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1722750394 shutdown_connections 2023-10-06T23:18:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.276+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1722750394 wait complete. 2023-10-06T23:18:14.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.276+0000 7f383a3c6b80 1 -- start start 2023-10-06T23:18:14.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.276+0000 7f383a3c6b80 1 Processor -- start 2023-10-06T23:18:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.277+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c86931eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.277+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 0x55c86931f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.277+0000 7f383a3c6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 0x55c869320070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.277+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8693205b0 con 0x55c869310fd0 2023-10-06T23:18:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.277+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c869320720 con 0x55c86930fec0 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.277+0000 7f383a3c6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8693208e0 con 0x55c869311990 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.277+0000 7f383a3c6b80 10 client.0 _ll_register_callbacks cb 0x7f38180097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c86931eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 0x55c86931f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c86931eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47588/0 (socket says 172.21.15.8:47588) 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381ffff700 1 -- 172.21.15.8:0/1510464294 learned_addr learned my addr 172.21.15.8:0/1510464294 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f3824f9c700 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 0x55c869320070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381ffff700 1 -- 172.21.15.8:0/1510464294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 msgr2=0x55c869320070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381ffff700 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 0x55c869320070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381ffff700 1 -- 172.21.15.8:0/1510464294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 msgr2=0x55c86931f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:14.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381ffff700 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 0x55c86931f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.278+0000 7f381ffff700 1 -- 172.21.15.8:0/1510464294 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382010be20 con 0x55c86930fec0 2023-10-06T23:18:14.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.279+0000 7f381ffff700 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c86931eb20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3808006010 tx=0x7f38080050b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0cc294bf4284473 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:14.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.279+0000 7f37ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:18:14.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.279+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1510464294 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380802c040 con 0x55c86930fec0 2023-10-06T23:18:14.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.279+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1510464294 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3810099f10 con 0x55c86930fec0 2023-10-06T23:18:14.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.279+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1510464294 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3808005580 con 0x55c86930fec0 2023-10-06T23:18:14.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.280+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1510464294 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3808028e70 con 0x55c86930fec0 2023-10-06T23:18:14.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.280+0000 7f383a3c6b80 10 client.25847 fetch_fsmap learned FSMap version 34 2023-10-06T23:18:14.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.280+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1510464294 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c86908c250 con 0x55c86930fec0 2023-10-06T23:18:14.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.280+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1510464294 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3810099f10 con 0x55c86930fec0 2023-10-06T23:18:14.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.280+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1510464294 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 34) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f380803b070 con 0x55c86930fec0 2023-10-06T23:18:14.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.281+0000 7f383a3c6b80 10 client.25847 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T23:18:14.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.281+0000 7f383a3c6b80 10 client.25847 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:14.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.281+0000 7f383a3c6b80 20 client.25847 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:14.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.281+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c869379b90 0x55c86937bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:14.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.281+0000 7f383a3c6b80 4 client.25847 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:18:14.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.281+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1510464294 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c86925bad0 con 0x55c869379b90 2023-10-06T23:18:14.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.281+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c869379b90 0x55c86937bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:14.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.282+0000 7f37ff7fe700 10 client.25847 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:14.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.282+0000 7f381f7fe700 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c869379b90 0x55c86937bfb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1820ad87b274310 server_cookie=beefa88654865b6c in_seq=0 out_seq=0 2023-10-06T23:18:14.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.298+0000 7f37ff7fe700 1 -- 172.21.15.8:0/1510464294 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c86925bad0 con 0x55c869379b90 2023-10-06T23:18:14.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.298+0000 7f37ff7fe700 10 client.25847 handle_command_reply: tid=0 2023-10-06T23:18:14.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.298+0000 7f383a3c6b80 1 client.25847 shutdown 2023-10-06T23:18:14.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.298+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1510464294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 msgr2=0x55c86931eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.298+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c86931eb20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3808006010 tx=0x7f38080050b0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1510464294 shutdown_connections 2023-10-06T23:18:14.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c869379b90 0x55c86937bfb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c869311990 0x55c869320070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86930fec0 0x55c86931eb20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f37ff7fe700 0 client.25847 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:14.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 1 --2- 172.21.15.8:0/1510464294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c869310fd0 0x55c86931f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1510464294 >> 172.21.15.8:0/1510464294 conn(0x55c869284200 msgr2=0x55c869319a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:14.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1510464294 shutdown_connections 2023-10-06T23:18:14.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 1 -- 172.21.15.8:0/1510464294 wait complete. 2023-10-06T23:18:14.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.299+0000 7f383a3c6b80 20 client.25847 trim_cache size 0 max 16384 2023-10-06T23:18:14.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:18:14.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:18:14.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:18:14.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:18:14.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 -- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f380c0a1500 msgr2=0x7f380c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f380c0a1500 0x7f380c0a39c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55c86930fc60 tx=0x7f381800b040 comp rx=0 tx=0).stop 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 -- 172.21.15.8:0/1885260174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3820104280 msgr2=0x7f3820199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3820104280 0x7f3820199260 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f381000e9a0 tx=0x7f381000ecb0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 -- 172.21.15.8:0/1885260174 shutdown_connections 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f380c0a1500 0x7f380c0a39c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3820104c20 0x7f38201a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3820103090 0x7f3820198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 --2- 172.21.15.8:0/1885260174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3820104280 0x7f3820199260 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 -- 172.21.15.8:0/1885260174 >> 172.21.15.8:0/1885260174 conn(0x7f38200fe600 msgr2=0x7f3820107860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 -- 172.21.15.8:0/1885260174 shutdown_connections 2023-10-06T23:18:14.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:14.300+0000 7f38269ff700 1 -- 172.21.15.8:0/1885260174 wait complete. 2023-10-06T23:18:15.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:18:15.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/872962442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b241042d0 msgr2=0x7f8b241066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/872962442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b241042d0 0x7f8b241066c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009990 tx=0x7f8b14009ca0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/872962442 shutdown_connections 2023-10-06T23:18:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/872962442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b241019a0 0x7f8b24103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/872962442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b24106c00 0x7f8b24109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/872962442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b241042d0 0x7f8b241066c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/872962442 >> 172.21.15.8:0/872962442 conn(0x7f8b240fb330 msgr2=0x7f8b240fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/872962442 shutdown_connections 2023-10-06T23:18:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.845+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/872962442 wait complete. 2023-10-06T23:18:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.846+0000 7f8b2b3ff700 1 Processor -- start 2023-10-06T23:18:15.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.846+0000 7f8b2b3ff700 1 -- start start 2023-10-06T23:18:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2b3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b241019a0 0x7f8b24196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2b3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b241042d0 0x7f8b24197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2b3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b24106c00 0x7f8b2419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2b3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2419e6a0 con 0x7f8b24106c00 2023-10-06T23:18:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2b3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2419e7e0 con 0x7f8b241042d0 2023-10-06T23:18:15.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2b3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2419e970 con 0x7f8b241019a0 2023-10-06T23:18:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b241019a0 0x7f8b24196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2999c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b24106c00 0x7f8b2419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2999c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b24106c00 0x7f8b2419e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48314/0 (socket says 172.21.15.8:48314) 2023-10-06T23:18:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.847+0000 7f8b2999c700 1 -- 172.21.15.8:0/3500718460 learned_addr learned my addr 172.21.15.8:0/3500718460 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:15.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.848+0000 7f8b2899a700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b241042d0 0x7f8b24197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.848+0000 7f8b2999c700 1 -- 172.21.15.8:0/3500718460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b241019a0 msgr2=0x7f8b24196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.848+0000 7f8b2999c700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b241019a0 0x7f8b24196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.848+0000 7f8b2999c700 1 -- 172.21.15.8:0/3500718460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b241042d0 msgr2=0x7f8b24197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.848+0000 7f8b2999c700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b241042d0 0x7f8b24197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.848+0000 7f8b2999c700 1 -- 172.21.15.8:0/3500718460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140095f0 con 0x7f8b24106c00 2023-10-06T23:18:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.848+0000 7f8b2999c700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b24106c00 0x7f8b2419e0d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007ee0 tx=0x7f8b1c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.849+0000 7f8b1a7fc700 1 -- 172.21.15.8:0/3500718460 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c017070 con 0x7f8b24106c00 2023-10-06T23:18:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.849+0000 7f8b1a7fc700 1 -- 172.21.15.8:0/3500718460 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b1c00f040 con 0x7f8b24106c00 2023-10-06T23:18:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.849+0000 7f8b1a7fc700 1 -- 172.21.15.8:0/3500718460 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c005710 con 0x7f8b24106c00 2023-10-06T23:18:15.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.849+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/3500718460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2419ec50 con 0x7f8b24106c00 2023-10-06T23:18:15.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.849+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/3500718460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2419f110 con 0x7f8b24106c00 2023-10-06T23:18:15.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.855+0000 7f8b1a7fc700 1 -- 172.21.15.8:0/3500718460 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8b1c005870 con 0x7f8b24106c00 2023-10-06T23:18:15.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.856+0000 7f8b3ee12b80 1 Processor -- start 2023-10-06T23:18:15.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.856+0000 7f8b3ee12b80 1 -- start start 2023-10-06T23:18:15.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc522680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc522bc0 0x5627cc523480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc523a60 0x5627cc523ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc48a460 con 0x5627cc523a60 2023-10-06T23:18:15.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc47bc20 con 0x5627cc522bc0 2023-10-06T23:18:15.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc479540 con 0x5627cc522260 2023-10-06T23:18:15.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc522bc0 0x5627cc523480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc522bc0 0x5627cc523480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47604/0 (socket says 172.21.15.8:47604) 2023-10-06T23:18:15.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b2919b700 1 -- 172.21.15.8:0/2487019457 learned_addr learned my addr 172.21.15.8:0/2487019457 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:15.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.857+0000 7f8b2899a700 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc522680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b2919b700 1 -- 172.21.15.8:0/2487019457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 msgr2=0x5627cc522680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:15.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b2919b700 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc522680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b2919b700 1 -- 172.21.15.8:0/2487019457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc523a60 msgr2=0x5627cc523ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b2919b700 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc523a60 0x5627cc523ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b2919b700 1 -- 172.21.15.8:0/2487019457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cc29fde0 con 0x5627cc522bc0 2023-10-06T23:18:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b1a7fc700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8b100a15d0 0x7f8b100a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b2899a700 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc522680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:18:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b1a7fc700 1 -- 172.21.15.8:0/3500718460 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8b1c0cc3e0 con 0x7f8b24106c00 2023-10-06T23:18:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b2919b700 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc522bc0 0x5627cc523480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007d70 tx=0x7f8b200106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22d273ddc257a00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b0f7fe700 1 -- 172.21.15.8:0/2487019457 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20010e10 con 0x5627cc522bc0 2023-10-06T23:18:15.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b0f7fe700 1 -- 172.21.15.8:0/2487019457 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b20015070 con 0x5627cc522bc0 2023-10-06T23:18:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.858+0000 7f8b0f7fe700 1 -- 172.21.15.8:0/2487019457 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20003dc0 con 0x5627cc522bc0 2023-10-06T23:18:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.859+0000 7f8b2899a700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8b100a15d0 0x7f8b100a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.859+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/2487019457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc522bc0 msgr2=0x5627cc523480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.859+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc522bc0 0x5627cc523480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007d70 tx=0x7f8b200106b0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/2487019457 shutdown_connections 2023-10-06T23:18:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc523a60 0x5627cc523ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc522680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/2487019457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc522bc0 0x5627cc523480 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b2899a700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8b100a15d0 0x7f8b100a3a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400b5c0 tx=0x7f8b140056b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:15.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/2487019457 >> 172.21.15.8:0/2487019457 conn(0x5627cc496260 msgr2=0x5627cc51d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:15.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/2487019457 shutdown_connections 2023-10-06T23:18:15.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/2487019457 wait complete. 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.860+0000 7f8b3ee12b80 1 -- start start 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.861+0000 7f8b3ee12b80 1 Processor -- start 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.861+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.861+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 0x5627cc52c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.861+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc533500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.861+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc474e30 con 0x5627cc522bc0 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.861+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc411710 con 0x5627cc523a60 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.861+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc4113b0 con 0x5627cc522260 2023-10-06T23:18:15.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b3ee12b80 10 client.0 _ll_register_callbacks cb 0x5627cc26e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2999c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc533500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2999c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc533500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47614/0 (socket says 172.21.15.8:47614) 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34004/0 (socket says 172.21.15.8:34004) 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2999c700 1 -- 172.21.15.8:0/3389093523 learned_addr learned my addr 172.21.15.8:0/3389093523 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2999c700 1 -- 172.21.15.8:0/3389093523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 msgr2=0x5627cc52bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2999c700 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2999c700 1 -- 172.21.15.8:0/3389093523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 msgr2=0x5627cc52c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2999c700 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 0x5627cc52c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.862+0000 7f8b2999c700 1 -- 172.21.15.8:0/3389093523 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b24109c00 con 0x5627cc523a60 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.863+0000 7f8b2999c700 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc533500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c095c10 tx=0x7f8b1c0992d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d180cec57a94cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:15.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.863+0000 7f8b0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.863+0000 7f8b0cff9700 1 -- 172.21.15.8:0/3389093523 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c022250 con 0x5627cc523a60 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.863+0000 7f8b0cff9700 1 -- 172.21.15.8:0/3389093523 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8b1c099e10 con 0x5627cc523a60 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.863+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/3389093523 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627cc514f10 con 0x5627cc523a60 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.863+0000 7f8b0cff9700 1 -- 172.21.15.8:0/3389093523 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b1c099710 con 0x5627cc523a60 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.863+0000 7f8b3ee12b80 10 client.25859 fetch_fsmap learned FSMap version 34 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.863+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/3389093523 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f8b200079a0 con 0x5627cc523a60 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.864+0000 7f8b0cff9700 1 -- 172.21.15.8:0/3389093523 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5627cc514f10 con 0x5627cc523a60 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.864+0000 7f8b0cff9700 1 -- 172.21.15.8:0/3389093523 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 34) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f8b1c0b5030 con 0x5627cc523a60 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.864+0000 7f8b3ee12b80 10 client.25859 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.864+0000 7f8b3ee12b80 10 client.25859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.864+0000 7f8b3ee12b80 20 client.25859 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:15.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.864+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627cc53c1b0 0x5627cc53e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.864+0000 7f8b3ee12b80 4 client.25859 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:18:15.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.864+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/3389093523 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627cc46de10 con 0x5627cc53c1b0 2023-10-06T23:18:15.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.865+0000 7f8b2919b700 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627cc53c1b0 0x5627cc53e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.865+0000 7f8b2919b700 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627cc53c1b0 0x5627cc53e5d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecbbb0c079b864c server_cookie=d9aa26417cc60331 in_seq=0 out_seq=0 2023-10-06T23:18:15.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.865+0000 7f8b0cff9700 10 client.25859 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.866+0000 7f8b0cff9700 1 -- 172.21.15.8:0/3389093523 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627cc46de10 con 0x5627cc53c1b0 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.866+0000 7f8b0cff9700 10 client.25859 handle_command_reply: tid=0 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 client.25859 shutdown 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/3389093523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 msgr2=0x5627cc533500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc533500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c095c10 tx=0x7f8b1c0992d0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/3389093523 shutdown_connections 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627cc53c1b0 0x5627cc53e5d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc533500 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/3389093523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 0x5627cc52c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/3389093523 >> 172.21.15.8:0/3389093523 conn(0x5627cc496260 msgr2=0x5627cc51cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:15.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.867+0000 7f8b0cff9700 0 client.25859 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:15.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.868+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/3389093523 shutdown_connections 2023-10-06T23:18:15.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.868+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/3389093523 wait complete. 2023-10-06T23:18:15.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.868+0000 7f8b3ee12b80 20 client.25859 trim_cache size 0 max 16384 2023-10-06T23:18:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.892+0000 7f8b3ee12b80 1 Processor -- start 2023-10-06T23:18:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.892+0000 7f8b3ee12b80 1 -- start start 2023-10-06T23:18:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522bc0 0x5627cc52c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc5334c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc52bb50 con 0x5627cc522260 2023-10-06T23:18:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc2f5920 con 0x5627cc523a60 2023-10-06T23:18:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc5395d0 con 0x5627cc522bc0 2023-10-06T23:18:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b2899a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522bc0 0x5627cc52c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48340/0 (socket says 172.21.15.8:48340) 2023-10-06T23:18:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b2919b700 1 -- 172.21.15.8:0/801213196 learned_addr learned my addr 172.21.15.8:0/801213196 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.893+0000 7f8b2999c700 1 --2- 172.21.15.8:0/801213196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc5334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.894+0000 7f8b2919b700 1 -- 172.21.15.8:0/801213196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522bc0 msgr2=0x5627cc52c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.894+0000 7f8b2919b700 1 --2- 172.21.15.8:0/801213196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522bc0 0x5627cc52c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.894+0000 7f8b2919b700 1 -- 172.21.15.8:0/801213196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 msgr2=0x5627cc5334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.894+0000 7f8b2919b700 1 --2- 172.21.15.8:0/801213196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc5334c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.894+0000 7f8b2919b700 1 -- 172.21.15.8:0/801213196 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627cc288c60 con 0x5627cc522260 2023-10-06T23:18:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.894+0000 7f8b2919b700 1 --2- 172.21.15.8:0/801213196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522260 0x5627cc52bf80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007d70 tx=0x7f8b20007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f0e2308563f28b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.895+0000 7f8b0ffff700 1 -- 172.21.15.8:0/801213196 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20010db0 con 0x5627cc522260 2023-10-06T23:18:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.895+0000 7f8b0ffff700 1 -- 172.21.15.8:0/801213196 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b2001f040 con 0x5627cc522260 2023-10-06T23:18:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.895+0000 7f8b0ffff700 1 -- 172.21.15.8:0/801213196 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20027290 con 0x5627cc522260 2023-10-06T23:18:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.895+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/801213196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522260 msgr2=0x5627cc52bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.895+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/801213196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522260 0x5627cc52bf80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007d70 tx=0x7f8b20007ec0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.896+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/801213196 shutdown_connections 2023-10-06T23:18:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.896+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/801213196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522260 0x5627cc52bf80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.896+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/801213196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc5334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.896+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/801213196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522bc0 0x5627cc52c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.896+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/801213196 >> 172.21.15.8:0/801213196 conn(0x5627cc496260 msgr2=0x5627cc52acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.896+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/801213196 shutdown_connections 2023-10-06T23:18:15.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.896+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/801213196 wait complete. 2023-10-06T23:18:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.896+0000 7f8b3ee12b80 1 -- start start 2023-10-06T23:18:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.897+0000 7f8b3ee12b80 1 Processor -- start 2023-10-06T23:18:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.897+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc532d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.897+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 0x5627cc533240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.897+0000 7f8b3ee12b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc52f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.897+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc52fd70 con 0x5627cc522bc0 2023-10-06T23:18:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.897+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc52feb0 con 0x5627cc523a60 2023-10-06T23:18:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.897+0000 7f8b3ee12b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627cc530070 con 0x5627cc522260 2023-10-06T23:18:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.897+0000 7f8b3ee12b80 10 client.0 _ll_register_callbacks cb 0x7f8b1c095a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc532d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc532d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34016/0 (socket says 172.21.15.8:34016) 2023-10-06T23:18:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 -- 172.21.15.8:0/665815305 learned_addr learned my addr 172.21.15.8:0/665815305 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2899a700 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 0x5627cc533240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2999c700 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc52f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 -- 172.21.15.8:0/665815305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 msgr2=0x5627cc52f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc52f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 -- 172.21.15.8:0/665815305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 msgr2=0x5627cc533240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 0x5627cc533240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 -- 172.21.15.8:0/665815305 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627cc29fde0 con 0x5627cc522260 2023-10-06T23:18:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b2919b700 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc532d00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8b20027fd0 tx=0x7f8b20010db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a7c5ae92a92fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.898+0000 7f8b0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:18:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.899+0000 7f8b0cff9700 1 -- 172.21.15.8:0/665815305 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20027a00 con 0x5627cc522260 2023-10-06T23:18:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.899+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/665815305 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b20015070 con 0x5627cc522260 2023-10-06T23:18:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.899+0000 7f8b0cff9700 1 -- 172.21.15.8:0/665815305 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8b20027b60 con 0x5627cc522260 2023-10-06T23:18:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.899+0000 7f8b0cff9700 1 -- 172.21.15.8:0/665815305 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b20005110 con 0x5627cc522260 2023-10-06T23:18:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.899+0000 7f8b3ee12b80 10 client.25906 fetch_fsmap learned FSMap version 34 2023-10-06T23:18:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.899+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/665815305 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5627cc2c6250 con 0x5627cc522260 2023-10-06T23:18:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b0cff9700 1 -- 172.21.15.8:0/665815305 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b20015070 con 0x5627cc522260 2023-10-06T23:18:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b0cff9700 1 -- 172.21.15.8:0/665815305 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 34) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f8b2002e030 con 0x5627cc522260 2023-10-06T23:18:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b3ee12b80 10 client.25906 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T23:18:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b3ee12b80 10 client.25906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b3ee12b80 20 client.25906 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627cc5a2110 0x5627cc5a4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b3ee12b80 4 client.25906 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:18:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/665815305 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5627cc46db30 con 0x5627cc5a2110 2023-10-06T23:18:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.900+0000 7f8b2899a700 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627cc5a2110 0x5627cc5a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.901+0000 7f8b0cff9700 10 client.25906 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.901+0000 7f8b2899a700 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627cc5a2110 0x5627cc5a4530 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e1fbabd31bbb64d server_cookie=ab3944cf4cc68da8 in_seq=0 out_seq=0 2023-10-06T23:18:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.901+0000 7f8b0cff9700 1 -- 172.21.15.8:0/665815305 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5627cc46db30 con 0x5627cc5a2110 2023-10-06T23:18:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.901+0000 7f8b0cff9700 10 client.25906 handle_command_reply: tid=0 2023-10-06T23:18:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 client.25906 shutdown 2023-10-06T23:18:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/665815305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 msgr2=0x5627cc532d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc532d00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8b20027fd0 tx=0x7f8b20010db0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/665815305 shutdown_connections 2023-10-06T23:18:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5627cc5a2110 0x5627cc5a4530 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5627cc523a60 0x5627cc52f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5627cc522260 0x5627cc532d00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 --2- 172.21.15.8:0/665815305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5627cc522bc0 0x5627cc533240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/665815305 >> 172.21.15.8:0/665815305 conn(0x5627cc496260 msgr2=0x5627cc52bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:15.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b0cff9700 0 client.25906 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:15.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/665815305 shutdown_connections 2023-10-06T23:18:15.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.902+0000 7f8b3ee12b80 1 -- 172.21.15.8:0/665815305 wait complete. 2023-10-06T23:18:15.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.903+0000 7f8b3ee12b80 20 client.25906 trim_cache size 0 max 16384 2023-10-06T23:18:15.915 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:18:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:18:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:18:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:18:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:18:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:18:15.916 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:18:15.917 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:18:15.917 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:18:15.917 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:18:15.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.903+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8b100a15d0 msgr2=0x7f8b100a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.903+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8b100a15d0 0x7f8b100a3a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400b5c0 tx=0x7f8b140056b0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.903+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b24106c00 msgr2=0x7f8b2419e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:15.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.903+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b24106c00 0x7f8b2419e0d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007ee0 tx=0x7f8b1c00d3b0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.904+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/3500718460 shutdown_connections 2023-10-06T23:18:15.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.904+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8b100a15d0 0x7f8b100a3a90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.904+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8b24106c00 0x7f8b2419e0d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.904+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b241019a0 0x7f8b24196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.904+0000 7f8b2b3ff700 1 --2- 172.21.15.8:0/3500718460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b241042d0 0x7f8b24197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:15.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.904+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/3500718460 >> 172.21.15.8:0/3500718460 conn(0x7f8b240fb330 msgr2=0x7f8b24102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:15.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.904+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/3500718460 shutdown_connections 2023-10-06T23:18:15.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:15.904+0000 7f8b2b3ff700 1 -- 172.21.15.8:0/3500718460 wait complete. 2023-10-06T23:18:15.928 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:18:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:16 smithi008 ceph-mon[98532]: pgmap v511: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 6.1 MiB/s wr, 608 op/s 2023-10-06T23:18:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:16 smithi190 ceph-mon[102658]: pgmap v511: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 6.1 MiB/s wr, 608 op/s 2023-10-06T23:18:16.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:16 smithi156 ceph-mon[102862]: pgmap v511: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 6.1 MiB/s wr, 608 op/s 2023-10-06T23:18:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:18 smithi008 ceph-mon[98532]: pgmap v512: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.6 MiB/s wr, 599 op/s 2023-10-06T23:18:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:18 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:18:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:18 smithi190 ceph-mon[102658]: pgmap v512: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.6 MiB/s wr, 599 op/s 2023-10-06T23:18:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:18 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:18:18.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:18 smithi156 ceph-mon[102862]: pgmap v512: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 6.6 MiB/s wr, 599 op/s 2023-10-06T23:18:18.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:18 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:18:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 205.0 s, 247.8 tps, lat 404.303 ms stddev 122.366 2023-10-06T23:18:20.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:20 smithi008 ceph-mon[98532]: pgmap v513: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 5.7 MiB/s wr, 527 op/s 2023-10-06T23:18:20.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:20 smithi190 ceph-mon[102658]: pgmap v513: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 5.7 MiB/s wr, 527 op/s 2023-10-06T23:18:20.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:20 smithi156 ceph-mon[102862]: pgmap v513: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 5.7 MiB/s wr, 527 op/s 2023-10-06T23:18:21.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:21 smithi008 ceph-mon[98532]: pgmap v514: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-10-06T23:18:21.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:21 smithi190 ceph-mon[102658]: pgmap v514: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-10-06T23:18:21.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:21 smithi156 ceph-mon[102862]: pgmap v514: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-10-06T23:18:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:23 smithi008 ceph-mon[98532]: pgmap v515: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 5.6 MiB/s wr, 494 op/s 2023-10-06T23:18:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:23 smithi190 ceph-mon[102658]: pgmap v515: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 5.6 MiB/s wr, 494 op/s 2023-10-06T23:18:23.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:23 smithi156 ceph-mon[102862]: pgmap v515: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 5.6 MiB/s wr, 494 op/s 2023-10-06T23:18:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 210.0 s, 209.4 tps, lat 463.024 ms stddev 137.979 2023-10-06T23:18:26.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:26 smithi008 ceph-mon[98532]: pgmap v516: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 5.5 MiB/s wr, 521 op/s 2023-10-06T23:18:26.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:26 smithi190 ceph-mon[102658]: pgmap v516: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 5.5 MiB/s wr, 521 op/s 2023-10-06T23:18:26.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:26 smithi156 ceph-mon[102862]: pgmap v516: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 5.5 MiB/s wr, 521 op/s 2023-10-06T23:18:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.519+0000 7f5563dff700 1 -- 172.21.15.8:0/1448710552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 msgr2=0x7f555c1012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.519+0000 7f5563dff700 1 --2- 172.21.15.8:0/1448710552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 0x7f555c1012d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5550009990 tx=0x7f5550009ca0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.519+0000 7f5563dff700 1 -- 172.21.15.8:0/1448710552 shutdown_connections 2023-10-06T23:18:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.519+0000 7f5563dff700 1 --2- 172.21.15.8:0/1448710552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f555c102a50 0x7f555c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.519+0000 7f5563dff700 1 --2- 172.21.15.8:0/1448710552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 0x7f555c1012d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.519+0000 7f5563dff700 1 --2- 172.21.15.8:0/1448710552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f555c102090 0x7f555c102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.520+0000 7f5563dff700 1 -- 172.21.15.8:0/1448710552 >> 172.21.15.8:0/1448710552 conn(0x7f555c0fc430 msgr2=0x7f555c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.520+0000 7f5563dff700 1 -- 172.21.15.8:0/1448710552 shutdown_connections 2023-10-06T23:18:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.520+0000 7f5563dff700 1 -- 172.21.15.8:0/1448710552 wait complete. 2023-10-06T23:18:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.521+0000 7f5563dff700 1 Processor -- start 2023-10-06T23:18:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.522+0000 7f5563dff700 1 -- start start 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5563dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 0x7f555c19d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5563dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f555c102090 0x7f555c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5563dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f555c102a50 0x7f555c19e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5563dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c19ebd0 con 0x7f555c102090 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5563dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c19ed40 con 0x7f555c100eb0 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5563dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c19ef00 con 0x7f555c102a50 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 0x7f555c19d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 0x7f555c19d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58816/0 (socket says 172.21.15.8:58816) 2023-10-06T23:18:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.523+0000 7f5561b9b700 1 -- 172.21.15.8:0/1263655090 learned_addr learned my addr 172.21.15.8:0/1263655090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.524+0000 7f556139a700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f555c102090 0x7f555c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.524+0000 7f5561b9b700 1 -- 172.21.15.8:0/1263655090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f555c102a50 msgr2=0x7f555c19e570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.524+0000 7f5561b9b700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f555c102a50 0x7f555c19e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.524+0000 7f5561b9b700 1 -- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f555c102090 msgr2=0x7f555c19d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.524+0000 7f5561b9b700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f555c102090 0x7f555c19d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.524+0000 7f5561b9b700 1 -- 172.21.15.8:0/1263655090 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500095f0 con 0x7f555c100eb0 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.525+0000 7f5561b9b700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 0x7f555c19d1b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5550006010 tx=0x7f55500057d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.525+0000 7f554effd700 1 -- 172.21.15.8:0/1263655090 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555001d070 con 0x7f555c100eb0 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.525+0000 7f554effd700 1 -- 172.21.15.8:0/1263655090 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5550022470 con 0x7f555c100eb0 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.525+0000 7f554effd700 1 -- 172.21.15.8:0/1263655090 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000f6c0 con 0x7f555c100eb0 2023-10-06T23:18:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.525+0000 7f5563dff700 1 -- 172.21.15.8:0/1263655090 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c19f180 con 0x7f555c100eb0 2023-10-06T23:18:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.525+0000 7f5563dff700 1 -- 172.21.15.8:0/1263655090 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c1a59a0 con 0x7f555c100eb0 2023-10-06T23:18:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.531+0000 7f554effd700 1 -- 172.21.15.8:0/1263655090 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f55500225e0 con 0x7f555c100eb0 2023-10-06T23:18:27.534 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.533+0000 7f5577727b80 1 Processor -- start 2023-10-06T23:18:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.534+0000 7f5577727b80 1 -- start start 2023-10-06T23:18:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f554effd700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55480a1580 0x7f55480a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5577727b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe8925a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5577727b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925afd0 0x55fe8925b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5577727b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89262220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5577727b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe891c2400 con 0x55fe8925b990 2023-10-06T23:18:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5577727b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe891b3bc0 con 0x55fe8925afd0 2023-10-06T23:18:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5577727b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe891b14e0 con 0x55fe89259ec0 2023-10-06T23:18:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f554effd700 1 -- 172.21.15.8:0/1263655090 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f55500ce260 con 0x7f555c100eb0 2023-10-06T23:18:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe8925a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f556139a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925afd0 0x55fe8925b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe8925a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55034/0 (socket says 172.21.15.8:55034) 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.535+0000 7f5561b9b700 1 -- 172.21.15.8:0/4113394631 learned_addr learned my addr 172.21.15.8:0/4113394631 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.536+0000 7f556239c700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55480a1580 0x7f55480a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.536+0000 7f556139a700 1 -- 172.21.15.8:0/4113394631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 msgr2=0x55fe8925a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.536+0000 7f556139a700 1 --2- 172.21.15.8:0/4113394631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe8925a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.536+0000 7f556139a700 1 -- 172.21.15.8:0/4113394631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 msgr2=0x55fe89262220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.536+0000 7f556139a700 1 --2- 172.21.15.8:0/4113394631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89262220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.536+0000 7f556139a700 1 -- 172.21.15.8:0/4113394631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe88fd7d80 con 0x55fe8925afd0 2023-10-06T23:18:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.536+0000 7f556139a700 1 --2- 172.21.15.8:0/4113394631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925afd0 0x55fe8925b450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5558009bd0 tx=0x7f5558009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c34f9d3c3607c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.537+0000 7f5547fff700 1 -- 172.21.15.8:0/4113394631 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558011b90 con 0x55fe8925afd0 2023-10-06T23:18:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.537+0000 7f5547fff700 1 -- 172.21.15.8:0/4113394631 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5558011cf0 con 0x55fe8925afd0 2023-10-06T23:18:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.537+0000 7f5547fff700 1 -- 172.21.15.8:0/4113394631 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800f6a0 con 0x55fe8925afd0 2023-10-06T23:18:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f5577727b80 1 -- 172.21.15.8:0/4113394631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925afd0 msgr2=0x55fe8925b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f556239c700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55480a1580 0x7f55480a3a40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f555400d1e0 tx=0x7f55540096e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f5577727b80 1 --2- 172.21.15.8:0/4113394631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925afd0 0x55fe8925b450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5558009bd0 tx=0x7f5558009ee0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f5577727b80 1 -- 172.21.15.8:0/4113394631 shutdown_connections 2023-10-06T23:18:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f5577727b80 1 --2- 172.21.15.8:0/4113394631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89262220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f5577727b80 1 --2- 172.21.15.8:0/4113394631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe8925a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f5577727b80 1 --2- 172.21.15.8:0/4113394631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925afd0 0x55fe8925b450 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f5577727b80 1 -- 172.21.15.8:0/4113394631 >> 172.21.15.8:0/4113394631 conn(0x55fe891ce200 msgr2=0x55fe89254bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.538+0000 7f5577727b80 1 -- 172.21.15.8:0/4113394631 shutdown_connections 2023-10-06T23:18:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.539+0000 7f5577727b80 1 -- 172.21.15.8:0/4113394631 wait complete. 2023-10-06T23:18:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.539+0000 7f5577727b80 1 -- start start 2023-10-06T23:18:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.540+0000 7f5577727b80 1 Processor -- start 2023-10-06T23:18:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.541+0000 7f5577727b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89263a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5577727b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 0x55fe89263fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5577727b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 0x55fe8926aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5577727b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe891acdd0 con 0x55fe8925afd0 2023-10-06T23:18:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5577727b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe891496b0 con 0x55fe8925b990 2023-10-06T23:18:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5577727b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe89149350 con 0x55fe89259ec0 2023-10-06T23:18:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5577727b80 10 client.0 _ll_register_callbacks cb 0x55fe88fa67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89263a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89263a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55040/0 (socket says 172.21.15.8:55040) 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f5561b9b700 1 -- 172.21.15.8:0/965623593 learned_addr learned my addr 172.21.15.8:0/965623593 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f556239c700 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 0x55fe8926aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.542+0000 7f556139a700 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 0x55fe89263fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f5561b9b700 1 -- 172.21.15.8:0/965623593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 msgr2=0x55fe8926aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f5561b9b700 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 0x55fe8926aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f5561b9b700 1 -- 172.21.15.8:0/965623593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 msgr2=0x55fe89263fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f5561b9b700 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 0x55fe89263fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.545 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f5561b9b700 1 -- 172.21.15.8:0/965623593 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5558009830 con 0x55fe89259ec0 2023-10-06T23:18:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f5561b9b700 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89263a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f555009b2c0 tx=0x7f555009bb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82652390f2718a90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f55457fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:18:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f55457fa700 1 -- 172.21.15.8:0/965623593 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55500860b0 con 0x55fe89259ec0 2023-10-06T23:18:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f55457fa700 1 -- 172.21.15.8:0/965623593 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f555009bcc0 con 0x55fe89259ec0 2023-10-06T23:18:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.543+0000 7f5577727b80 1 -- 172.21.15.8:0/965623593 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe8924cd50 con 0x55fe89259ec0 2023-10-06T23:18:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f55457fa700 1 -- 172.21.15.8:0/965623593 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f555009b5c0 con 0x55fe89259ec0 2023-10-06T23:18:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f5577727b80 10 client.25912 fetch_fsmap learned FSMap version 35 2023-10-06T23:18:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f5577727b80 1 -- 172.21.15.8:0/965623593 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55fe88fc0c00 con 0x55fe89259ec0 2023-10-06T23:18:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f55457fa700 1 -- 172.21.15.8:0/965623593 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f555007e080 con 0x55fe89259ec0 2023-10-06T23:18:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f55457fa700 1 -- 172.21.15.8:0/965623593 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f55500a3430 con 0x55fe89259ec0 2023-10-06T23:18:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f5577727b80 10 client.25912 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:18:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f5577727b80 10 client.25912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f5577727b80 20 client.25912 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f5577727b80 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe8926f500 0x55fe89271920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f5577727b80 4 client.25912 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:18:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.544+0000 7f5577727b80 1 -- 172.21.15.8:0/965623593 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe891a5db0 con 0x55fe8926f500 2023-10-06T23:18:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.545+0000 7f556139a700 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe8926f500 0x55fe89271920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.546+0000 7f556139a700 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe8926f500 0x55fe89271920 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6abe685b4a72710a server_cookie=36e3b61b6403720d in_seq=0 out_seq=0 2023-10-06T23:18:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.546+0000 7f55457fa700 10 client.25912 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.547+0000 7f55457fa700 1 -- 172.21.15.8:0/965623593 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fe891a5db0 con 0x55fe8926f500 2023-10-06T23:18:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.547+0000 7f55457fa700 10 client.25912 handle_command_reply: tid=0 2023-10-06T23:18:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.547+0000 7f5577727b80 1 client.25912 shutdown 2023-10-06T23:18:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.547+0000 7f5577727b80 1 -- 172.21.15.8:0/965623593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 msgr2=0x55fe89263a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.547+0000 7f5577727b80 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89263a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f555009b2c0 tx=0x7f555009bb00 comp rx=0 tx=0).stop 2023-10-06T23:18:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 1 -- 172.21.15.8:0/965623593 shutdown_connections 2023-10-06T23:18:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe8926f500 0x55fe89271920 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 0x55fe8926aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89263a70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f55457fa700 0 client.25912 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 1 --2- 172.21.15.8:0/965623593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 0x55fe89263fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 1 -- 172.21.15.8:0/965623593 >> 172.21.15.8:0/965623593 conn(0x55fe891ce200 msgr2=0x55fe89254250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 1 -- 172.21.15.8:0/965623593 shutdown_connections 2023-10-06T23:18:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 1 -- 172.21.15.8:0/965623593 wait complete. 2023-10-06T23:18:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.548+0000 7f5577727b80 20 client.25912 trim_cache size 0 max 16384 2023-10-06T23:18:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.571+0000 7f5577727b80 1 Processor -- start 2023-10-06T23:18:27.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.571+0000 7f5577727b80 1 -- start start 2023-10-06T23:18:27.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.571+0000 7f5577727b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe89259ec0 0x55fe89254250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.571+0000 7f5577727b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe8925afd0 0x55fe8926afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.571+0000 7f5577727b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89254b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.571+0000 7f5577727b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8902d8c0 con 0x55fe8925b990 2023-10-06T23:18:27.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.571+0000 7f5577727b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8925e480 con 0x55fe89259ec0 2023-10-06T23:18:27.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.571+0000 7f5577727b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8926f0f0 con 0x55fe8925afd0 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556239c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89254b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe89259ec0 0x55fe89254250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556139a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe8925afd0 0x55fe8926afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556239c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89254b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36574/0 (socket says 172.21.15.8:36574) 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556239c700 1 -- 172.21.15.8:0/1233211167 learned_addr learned my addr 172.21.15.8:0/1233211167 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556239c700 1 -- 172.21.15.8:0/1233211167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe8925afd0 msgr2=0x55fe8926afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556239c700 1 --2- 172.21.15.8:0/1233211167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe8925afd0 0x55fe8926afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556239c700 1 -- 172.21.15.8:0/1233211167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe89259ec0 msgr2=0x55fe89254250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556239c700 1 --2- 172.21.15.8:0/1233211167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe89259ec0 0x55fe89254250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.572+0000 7f556239c700 1 -- 172.21.15.8:0/1233211167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe88ffe1f0 con 0x55fe8925b990 2023-10-06T23:18:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.573+0000 7f556239c700 1 --2- 172.21.15.8:0/1233211167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89254b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f555400db40 tx=0x7f5554010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898809af5e49f3d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.573+0000 7f554cbff700 1 -- 172.21.15.8:0/1233211167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554024070 con 0x55fe8925b990 2023-10-06T23:18:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.574+0000 7f554cbff700 1 -- 172.21.15.8:0/1233211167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f555401c040 con 0x55fe8925b990 2023-10-06T23:18:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.574+0000 7f554cbff700 1 -- 172.21.15.8:0/1233211167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555401b070 con 0x55fe8925b990 2023-10-06T23:18:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 -- 172.21.15.8:0/1233211167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 msgr2=0x55fe89254b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 --2- 172.21.15.8:0/1233211167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89254b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f555400db40 tx=0x7f5554010000 comp rx=0 tx=0).stop 2023-10-06T23:18:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 -- 172.21.15.8:0/1233211167 shutdown_connections 2023-10-06T23:18:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 --2- 172.21.15.8:0/1233211167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925b990 0x55fe89254b80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 --2- 172.21.15.8:0/1233211167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe89259ec0 0x55fe89254250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 --2- 172.21.15.8:0/1233211167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe8925afd0 0x55fe8926afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 -- 172.21.15.8:0/1233211167 >> 172.21.15.8:0/1233211167 conn(0x55fe891ce200 msgr2=0x55fe892762a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 -- 172.21.15.8:0/1233211167 shutdown_connections 2023-10-06T23:18:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.575+0000 7f5577727b80 1 -- 172.21.15.8:0/1233211167 wait complete. 2023-10-06T23:18:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.576+0000 7f5577727b80 1 -- start start 2023-10-06T23:18:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.576+0000 7f5577727b80 1 Processor -- start 2023-10-06T23:18:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5577727b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89268d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5577727b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 0x55fe892692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5577727b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 0x55fe8926a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5577727b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8926a820 con 0x55fe8925afd0 2023-10-06T23:18:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5577727b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8926a990 con 0x55fe8925b990 2023-10-06T23:18:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5577727b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe8926ab50 con 0x55fe89259ec0 2023-10-06T23:18:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5577727b80 10 client.0 _ll_register_callbacks cb 0x55fe88fa67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89268d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5561b9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89268d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55056/0 (socket says 172.21.15.8:55056) 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f5561b9b700 1 -- 172.21.15.8:0/1951487037 learned_addr learned my addr 172.21.15.8:0/1951487037 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f556239c700 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 0x55fe8926a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.577+0000 7f556139a700 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 0x55fe892692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.578+0000 7f5561b9b700 1 -- 172.21.15.8:0/1951487037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 msgr2=0x55fe8926a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.578+0000 7f5561b9b700 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 0x55fe8926a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.578+0000 7f5561b9b700 1 -- 172.21.15.8:0/1951487037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 msgr2=0x55fe892692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.578+0000 7f5561b9b700 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 0x55fe892692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.578+0000 7f5561b9b700 1 -- 172.21.15.8:0/1951487037 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55540092b0 con 0x55fe89259ec0 2023-10-06T23:18:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.578+0000 7f5561b9b700 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89268d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f555009f170 tx=0x7f555009ae00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5282c7dcc615381e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.578+0000 7f55457fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:18:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.579+0000 7f55457fa700 1 -- 172.21.15.8:0/1951487037 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555009bcc0 con 0x55fe89259ec0 2023-10-06T23:18:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.579+0000 7f55457fa700 1 -- 172.21.15.8:0/1951487037 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f555009b5c0 con 0x55fe89259ec0 2023-10-06T23:18:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.579+0000 7f5577727b80 1 -- 172.21.15.8:0/1951487037 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5558011cf0 con 0x55fe89259ec0 2023-10-06T23:18:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.579+0000 7f55457fa700 1 -- 172.21.15.8:0/1951487037 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f555009f710 con 0x55fe89259ec0 2023-10-06T23:18:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.579+0000 7f5577727b80 10 client.25918 fetch_fsmap learned FSMap version 35 2023-10-06T23:18:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.579+0000 7f5577727b80 1 -- 172.21.15.8:0/1951487037 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55fe88fd6250 con 0x55fe89259ec0 2023-10-06T23:18:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f55457fa700 1 -- 172.21.15.8:0/1951487037 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55500a7080 con 0x55fe89259ec0 2023-10-06T23:18:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f55457fa700 1 -- 172.21.15.8:0/1951487037 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5550083070 con 0x55fe89259ec0 2023-10-06T23:18:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f5577727b80 10 client.25918 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:18:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f5577727b80 10 client.25918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f5577727b80 20 client.25918 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:27.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f5577727b80 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe892c3e20 0x55fe892c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:27.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f5577727b80 4 client.25918 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:18:27.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f5577727b80 1 -- 172.21.15.8:0/1951487037 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fe891a5ad0 con 0x55fe892c3e20 2023-10-06T23:18:27.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.580+0000 7f556139a700 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe892c3e20 0x55fe892c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:27.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.581+0000 7f556139a700 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe892c3e20 0x55fe892c6210 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d31863c2803ddb7 server_cookie=4d399069478acf29 in_seq=0 out_seq=0 2023-10-06T23:18:27.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.581+0000 7f55457fa700 10 client.25918 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:27.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.598+0000 7f55457fa700 1 -- 172.21.15.8:0/1951487037 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fe891a5ad0 con 0x55fe892c3e20 2023-10-06T23:18:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.598+0000 7f55457fa700 10 client.25918 handle_command_reply: tid=0 2023-10-06T23:18:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.598+0000 7f5577727b80 1 client.25918 shutdown 2023-10-06T23:18:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.598+0000 7f5577727b80 1 -- 172.21.15.8:0/1951487037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 msgr2=0x55fe89268d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.598+0000 7f5577727b80 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89268d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f555009f170 tx=0x7f555009ae00 comp rx=0 tx=0).stop 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f5577727b80 1 -- 172.21.15.8:0/1951487037 shutdown_connections 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f5577727b80 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe892c3e20 0x55fe892c6210 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f5577727b80 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe8925b990 0x55fe8926a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f5577727b80 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe89259ec0 0x55fe89268d90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f5577727b80 1 --2- 172.21.15.8:0/1951487037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe8925afd0 0x55fe892692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f55457fa700 0 client.25918 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f5577727b80 1 -- 172.21.15.8:0/1951487037 >> 172.21.15.8:0/1951487037 conn(0x55fe891ce200 msgr2=0x55fe89261da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f5577727b80 1 -- 172.21.15.8:0/1951487037 shutdown_connections 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.599+0000 7f5577727b80 1 -- 172.21.15.8:0/1951487037 wait complete. 2023-10-06T23:18:27.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.600+0000 7f5577727b80 20 client.25918 trim_cache size 0 max 16384 2023-10-06T23:18:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:18:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:18:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:18:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.600+0000 7f5563dff700 1 -- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55480a1580 msgr2=0x7f55480a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.600+0000 7f5563dff700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55480a1580 0x7f55480a3a40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f555400d1e0 tx=0x7f55540096e0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.600+0000 7f5563dff700 1 -- 172.21.15.8:0/1263655090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 msgr2=0x7f555c19d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.600+0000 7f5563dff700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 0x7f555c19d1b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5550006010 tx=0x7f55500057d0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.601+0000 7f5563dff700 1 -- 172.21.15.8:0/1263655090 shutdown_connections 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.601+0000 7f5563dff700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55480a1580 0x7f55480a3a40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.601+0000 7f5563dff700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f555c102a50 0x7f555c19e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.601+0000 7f5563dff700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f555c100eb0 0x7f555c19d1b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.601+0000 7f5563dff700 1 --2- 172.21.15.8:0/1263655090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f555c102090 0x7f555c19d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.601+0000 7f5563dff700 1 -- 172.21.15.8:0/1263655090 >> 172.21.15.8:0/1263655090 conn(0x7f555c0fc430 msgr2=0x7f555c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.601+0000 7f5563dff700 1 -- 172.21.15.8:0/1263655090 shutdown_connections 2023-10-06T23:18:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:27.601+0000 7f5563dff700 1 -- 172.21.15.8:0/1263655090 wait complete. 2023-10-06T23:18:28.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:28 smithi008 ceph-mon[98532]: pgmap v517: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2023-10-06T23:18:28.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:28 smithi190 ceph-mon[102658]: pgmap v517: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2023-10-06T23:18:28.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:28 smithi156 ceph-mon[102862]: pgmap v517: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 4.1 MiB/s wr, 459 op/s 2023-10-06T23:18:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 215.0 s, 235.0 tps, lat 457.872 ms stddev 133.903 2023-10-06T23:18:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:30 smithi008 ceph-mon[98532]: pgmap v518: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-10-06T23:18:30.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:30 smithi190 ceph-mon[102658]: pgmap v518: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-10-06T23:18:30.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:30 smithi156 ceph-mon[102862]: pgmap v518: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-10-06T23:18:32.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:32 smithi008 ceph-mon[98532]: pgmap v519: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 3.8 MiB/s wr, 483 op/s 2023-10-06T23:18:32.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:32 smithi190 ceph-mon[102658]: pgmap v519: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 3.8 MiB/s wr, 483 op/s 2023-10-06T23:18:32.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:32 smithi156 ceph-mon[102862]: pgmap v519: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 3.8 MiB/s wr, 483 op/s 2023-10-06T23:18:33.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:33 smithi008 ceph-mon[98532]: pgmap v520: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 3.5 MiB/s wr, 447 op/s 2023-10-06T23:18:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:33 smithi190 ceph-mon[102658]: pgmap v520: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 3.5 MiB/s wr, 447 op/s 2023-10-06T23:18:33.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:33 smithi156 ceph-mon[102862]: pgmap v520: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 3.5 MiB/s wr, 447 op/s 2023-10-06T23:18:34.008 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 220.0 s, 254.1 tps, lat 394.181 ms stddev 63.754 2023-10-06T23:18:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:36 smithi008 ceph-mon[98532]: pgmap v521: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.9 MiB/s wr, 604 op/s 2023-10-06T23:18:36.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:36 smithi190 ceph-mon[102658]: pgmap v521: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.9 MiB/s wr, 604 op/s 2023-10-06T23:18:36.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:36 smithi156 ceph-mon[102862]: pgmap v521: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.9 MiB/s wr, 604 op/s 2023-10-06T23:18:38.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:38 smithi008 ceph-mon[98532]: pgmap v522: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 4.8 MiB/s wr, 547 op/s 2023-10-06T23:18:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:38 smithi190 ceph-mon[102658]: pgmap v522: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 4.8 MiB/s wr, 547 op/s 2023-10-06T23:18:38.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:38 smithi156 ceph-mon[102862]: pgmap v522: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 4.8 MiB/s wr, 547 op/s 2023-10-06T23:18:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 225.0 s, 210.9 tps, lat 471.809 ms stddev 278.809 2023-10-06T23:18:39.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:39 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:18:39.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:39 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:18:39.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:39 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:18:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:40 smithi008 ceph-mon[98532]: pgmap v523: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 5.5 MiB/s wr, 573 op/s 2023-10-06T23:18:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:18:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:18:40.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:18:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:40 smithi190 ceph-mon[102658]: pgmap v523: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 5.5 MiB/s wr, 573 op/s 2023-10-06T23:18:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:18:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:18:40.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:18:40.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:40 smithi156 ceph-mon[102862]: pgmap v523: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 5.5 MiB/s wr, 573 op/s 2023-10-06T23:18:40.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:18:40.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:18:40.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:18:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.811+0000 7ff9745ff700 1 -- 172.21.15.8:0/3410369047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c100a80 msgr2=0x7ff96c100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.811+0000 7ff9745ff700 1 --2- 172.21.15.8:0/3410369047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c100a80 0x7ff96c100f00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff96400b0a0 tx=0x7ff96400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.812+0000 7ff9745ff700 1 -- 172.21.15.8:0/3410369047 shutdown_connections 2023-10-06T23:18:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.812+0000 7ff9745ff700 1 --2- 172.21.15.8:0/3410369047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c100a80 0x7ff96c100f00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.812+0000 7ff9745ff700 1 --2- 172.21.15.8:0/3410369047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff96c0ff760 0x7ff96c0ffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.812+0000 7ff9745ff700 1 --2- 172.21.15.8:0/3410369047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96c1000c0 0x7ff96c100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.812+0000 7ff9745ff700 1 -- 172.21.15.8:0/3410369047 >> 172.21.15.8:0/3410369047 conn(0x7ff96c0fb340 msgr2=0x7ff96c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.812+0000 7ff9745ff700 1 -- 172.21.15.8:0/3410369047 shutdown_connections 2023-10-06T23:18:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.812+0000 7ff9745ff700 1 -- 172.21.15.8:0/3410369047 wait complete. 2023-10-06T23:18:40.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.813+0000 7ff9745ff700 1 Processor -- start 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.813+0000 7ff9745ff700 1 -- start start 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff9745ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96c0ff760 0x7ff96c101de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff9745ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff96c1000c0 0x7ff96c102320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff9745ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c100a80 0x7ff96c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff9745ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c103850 con 0x7ff96c100a80 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff9745ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c1039c0 con 0x7ff96c1000c0 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff97239b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96c0ff760 0x7ff96c101de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff97239b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96c0ff760 0x7ff96c101de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42882/0 (socket says 172.21.15.8:42882) 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff971b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff96c1000c0 0x7ff96c102320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff97239b700 1 -- 172.21.15.8:0/2112971247 learned_addr learned my addr 172.21.15.8:0/2112971247 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:40.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.814+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c103b80 con 0x7ff96c0ff760 2023-10-06T23:18:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.815+0000 7ff972b9c700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c100a80 0x7ff96c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.815+0000 7ff97239b700 1 -- 172.21.15.8:0/2112971247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff96c1000c0 msgr2=0x7ff96c102320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.815+0000 7ff97239b700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff96c1000c0 0x7ff96c102320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.815+0000 7ff97239b700 1 -- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c100a80 msgr2=0x7ff96c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.815+0000 7ff97239b700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c100a80 0x7ff96c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.815+0000 7ff97239b700 1 -- 172.21.15.8:0/2112971247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff968009520 con 0x7ff96c0ff760 2023-10-06T23:18:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.815+0000 7ff97239b700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96c0ff760 0x7ff96c101de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff96800eb30 tx=0x7ff96800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.815+0000 7ff9637fe700 1 -- 172.21.15.8:0/2112971247 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968009880 con 0x7ff96c0ff760 2023-10-06T23:18:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.816+0000 7ff9637fe700 1 -- 172.21.15.8:0/2112971247 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9680044b0 con 0x7ff96c0ff760 2023-10-06T23:18:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.816+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff964009d00 con 0x7ff96c0ff760 2023-10-06T23:18:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.816+0000 7ff9637fe700 1 -- 172.21.15.8:0/2112971247 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968003ce0 con 0x7ff96c0ff760 2023-10-06T23:18:40.818 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.816+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c104430 con 0x7ff96c0ff760 2023-10-06T23:18:40.821 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.820+0000 7ff9637fe700 1 -- 172.21.15.8:0/2112971247 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff968003e40 con 0x7ff96c0ff760 2023-10-06T23:18:40.823 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.822+0000 7ff987f45b80 1 Processor -- start 2023-10-06T23:18:40.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.823+0000 7ff987f45b80 1 -- start start 2023-10-06T23:18:40.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.823+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.823+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a86450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.823+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a8d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.823+0000 7ff987f45b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1969ed400 con 0x55c196a85fd0 2023-10-06T23:18:40.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.823+0000 7ff987f45b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1969debc0 con 0x55c196a86990 2023-10-06T23:18:40.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.823+0000 7ff987f45b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1969dc4e0 con 0x55c196a84ec0 2023-10-06T23:18:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.824+0000 7ff972b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.824+0000 7ff9637fe700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff9580a1500 0x7ff9580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.824+0000 7ff972b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a852e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42894/0 (socket says 172.21.15.8:42894) 2023-10-06T23:18:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.824+0000 7ff972b9c700 1 -- 172.21.15.8:0/1122551967 learned_addr learned my addr 172.21.15.8:0/1122551967 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.824+0000 7ff971b9a700 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a8d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.824+0000 7ff9637fe700 1 -- 172.21.15.8:0/2112971247 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff968014070 con 0x7ff96c0ff760 2023-10-06T23:18:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.825+0000 7ff97239b700 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a86450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.825+0000 7ff972b9c700 1 -- 172.21.15.8:0/1122551967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 msgr2=0x55c196a8d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.825+0000 7ff972b9c700 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a8d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.825+0000 7ff972b9c700 1 -- 172.21.15.8:0/1122551967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 msgr2=0x55c196a86450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.825+0000 7ff972b9c700 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a86450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.825+0000 7ff972b9c700 1 -- 172.21.15.8:0/1122551967 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c196802d80 con 0x55c196a84ec0 2023-10-06T23:18:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.826+0000 7ff972b9c700 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a852e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff9640079c0 tx=0x7ff964009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6eabc98fe609ea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.826+0000 7ff972b9c700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff9580a1500 0x7ff9580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.827+0000 7ff960bfe700 1 -- 172.21.15.8:0/1122551967 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400e040 con 0x55c196a84ec0 2023-10-06T23:18:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.827+0000 7ff960bfe700 1 -- 172.21.15.8:0/1122551967 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff964007e10 con 0x55c196a84ec0 2023-10-06T23:18:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.827+0000 7ff960bfe700 1 -- 172.21.15.8:0/1122551967 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96401e800 con 0x55c196a84ec0 2023-10-06T23:18:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.828+0000 7ff987f45b80 1 -- 172.21.15.8:0/1122551967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 msgr2=0x55c196a852e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.828+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a852e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff9640079c0 tx=0x7ff964009360 comp rx=0 tx=0).stop 2023-10-06T23:18:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.828+0000 7ff972b9c700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff9580a1500 0x7ff9580a39c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9640062a0 tx=0x7ff96401ee30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.828+0000 7ff987f45b80 1 -- 172.21.15.8:0/1122551967 shutdown_connections 2023-10-06T23:18:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.828+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a8d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.828+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a852e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.828+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1122551967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a86450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.828+0000 7ff987f45b80 1 -- 172.21.15.8:0/1122551967 >> 172.21.15.8:0/1122551967 conn(0x55c1969f9200 msgr2=0x55c196a7fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.829+0000 7ff987f45b80 1 -- 172.21.15.8:0/1122551967 shutdown_connections 2023-10-06T23:18:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.829+0000 7ff987f45b80 1 -- 172.21.15.8:0/1122551967 wait complete. 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.829+0000 7ff987f45b80 1 -- start start 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.830+0000 7ff987f45b80 1 Processor -- start 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a8eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a85fd0 0x55c196a8f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a86990 0x55c196a96220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff987f45b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1969d7dd0 con 0x55c196a86990 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff987f45b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1969746b0 con 0x55c196a85fd0 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff987f45b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c196974350 con 0x55c196a84ec0 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff987f45b80 10 client.0 _ll_register_callbacks cb 0x55c1967d17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff972b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a86990 0x55c196a96220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff972b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a86990 0x55c196a96220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60802/0 (socket says 172.21.15.8:60802) 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff972b9c700 1 -- 172.21.15.8:0/2945538984 learned_addr learned my addr 172.21.15.8:0/2945538984 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff97239b700 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a8eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.831+0000 7ff971b9a700 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a85fd0 0x55c196a8f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.832+0000 7ff972b9c700 1 -- 172.21.15.8:0/2945538984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 msgr2=0x55c196a8eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.832+0000 7ff972b9c700 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a8eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.832+0000 7ff972b9c700 1 -- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a85fd0 msgr2=0x55c196a8f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.832+0000 7ff972b9c700 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a85fd0 0x55c196a8f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.832+0000 7ff972b9c700 1 -- 172.21.15.8:0/2945538984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c10bef0 con 0x55c196a86990 2023-10-06T23:18:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.832+0000 7ff971b9a700 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a85fd0 0x55c196a8f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:18:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.832+0000 7ff972b9c700 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a86990 0x55c196a96220 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff9640093a0 tx=0x7ff964022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c9e71b69a2f81f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.832+0000 7ff955ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:18:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.833+0000 7ff955ffb700 1 -- 172.21.15.8:0/2945538984 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964007c50 con 0x55c196a86990 2023-10-06T23:18:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.833+0000 7ff987f45b80 1 -- 172.21.15.8:0/2945538984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c196a77d50 con 0x55c196a86990 2023-10-06T23:18:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.833+0000 7ff955ffb700 1 -- 172.21.15.8:0/2945538984 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff96400bab0 con 0x55c196a86990 2023-10-06T23:18:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.833+0000 7ff955ffb700 1 -- 172.21.15.8:0/2945538984 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff96400bc70 con 0x55c196a86990 2023-10-06T23:18:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.833+0000 7ff987f45b80 10 client.16056 fetch_fsmap learned FSMap version 35 2023-10-06T23:18:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.833+0000 7ff987f45b80 1 -- 172.21.15.8:0/2945538984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55c1967ebc00 con 0x55c196a86990 2023-10-06T23:18:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.833+0000 7ff955ffb700 1 -- 172.21.15.8:0/2945538984 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c196a77d50 con 0x55c196a86990 2023-10-06T23:18:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.833+0000 7ff955ffb700 1 -- 172.21.15.8:0/2945538984 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff964019030 con 0x55c196a86990 2023-10-06T23:18:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.834+0000 7ff987f45b80 10 client.16056 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:18:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.834+0000 7ff987f45b80 10 client.16056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.834+0000 7ff987f45b80 20 client.16056 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.834+0000 7ff987f45b80 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c196a9a640 0x55c196a9ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.834+0000 7ff987f45b80 4 client.16056 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:18:40.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.834+0000 7ff987f45b80 1 -- 172.21.15.8:0/2945538984 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1969d0db0 con 0x55c196a9a640 2023-10-06T23:18:40.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.834+0000 7ff97239b700 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c196a9a640 0x55c196a9ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.835+0000 7ff97239b700 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c196a9a640 0x55c196a9ca60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3dc22b14365f38e server_cookie=f9aa4b90cfe8dd25 in_seq=0 out_seq=0 2023-10-06T23:18:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.835+0000 7ff955ffb700 10 client.16056 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff955ffb700 1 -- 172.21.15.8:0/2945538984 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c1969d0db0 con 0x55c196a9a640 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff955ffb700 10 client.16056 handle_command_reply: tid=0 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 client.16056 shutdown 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 -- 172.21.15.8:0/2945538984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a86990 msgr2=0x55c196a96220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a86990 0x55c196a96220 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff9640093a0 tx=0x7ff964022000 comp rx=0 tx=0).stop 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 -- 172.21.15.8:0/2945538984 shutdown_connections 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c196a9a640 0x55c196a9ca60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a86990 0x55c196a96220 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a84ec0 0x55c196a8eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 --2- 172.21.15.8:0/2945538984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a85fd0 0x55c196a8f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff987f45b80 1 -- 172.21.15.8:0/2945538984 >> 172.21.15.8:0/2945538984 conn(0x55c1969f9200 msgr2=0x55c196a7f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.836+0000 7ff955ffb700 0 client.16056 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:40.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.837+0000 7ff987f45b80 1 -- 172.21.15.8:0/2945538984 shutdown_connections 2023-10-06T23:18:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.837+0000 7ff987f45b80 1 -- 172.21.15.8:0/2945538984 wait complete. 2023-10-06T23:18:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.837+0000 7ff987f45b80 20 client.16056 trim_cache size 0 max 16384 2023-10-06T23:18:40.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.860+0000 7ff987f45b80 1 Processor -- start 2023-10-06T23:18:40.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.860+0000 7ff987f45b80 1 -- start start 2023-10-06T23:18:40.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a84ec0 0x55c196a8e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.862 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a961e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a86990 0x55c196a8d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff987f45b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1968588c0 con 0x55c196a85fd0 2023-10-06T23:18:40.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff987f45b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c196a8e150 con 0x55c196a84ec0 2023-10-06T23:18:40.863 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff987f45b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c196a7c860 con 0x55c196a86990 2023-10-06T23:18:40.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff971b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff972b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a86990 0x55c196a8d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.864 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff971b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60804/0 (socket says 172.21.15.8:60804) 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.861+0000 7ff971b9a700 1 -- 172.21.15.8:0/44945832 learned_addr learned my addr 172.21.15.8:0/44945832 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.862+0000 7ff97239b700 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a84ec0 0x55c196a8e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.862+0000 7ff97239b700 1 -- 172.21.15.8:0/44945832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a86990 msgr2=0x55c196a8d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.862+0000 7ff97239b700 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a86990 0x55c196a8d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.862+0000 7ff97239b700 1 -- 172.21.15.8:0/44945832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 msgr2=0x55c196a961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.862+0000 7ff97239b700 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.862+0000 7ff97239b700 1 -- 172.21.15.8:0/44945832 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1968291f0 con 0x55c196a84ec0 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.862+0000 7ff971b9a700 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.863+0000 7ff97239b700 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a84ec0 0x55c196a8e350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff9680cace0 tx=0x7ff968085040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47673504f3f83249 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.863+0000 7ff9613ff700 1 -- 172.21.15.8:0/44945832 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800cbd0 con 0x55c196a84ec0 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.863+0000 7ff9613ff700 1 -- 172.21.15.8:0/44945832 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff96809a500 con 0x55c196a84ec0 2023-10-06T23:18:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.863+0000 7ff9613ff700 1 -- 172.21.15.8:0/44945832 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96801fde0 con 0x55c196a84ec0 2023-10-06T23:18:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 -- 172.21.15.8:0/44945832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a84ec0 msgr2=0x55c196a8e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a84ec0 0x55c196a8e350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff9680cace0 tx=0x7ff968085040 comp rx=0 tx=0).stop 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 -- 172.21.15.8:0/44945832 shutdown_connections 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a86990 0x55c196a8d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a84ec0 0x55c196a8e350 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 --2- 172.21.15.8:0/44945832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a85fd0 0x55c196a961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 -- 172.21.15.8:0/44945832 >> 172.21.15.8:0/44945832 conn(0x55c1969f9200 msgr2=0x55c196aa1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 -- 172.21.15.8:0/44945832 shutdown_connections 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 -- 172.21.15.8:0/44945832 wait complete. 2023-10-06T23:18:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.864+0000 7ff987f45b80 1 -- start start 2023-10-06T23:18:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.865+0000 7ff987f45b80 1 Processor -- start 2023-10-06T23:18:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.865+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a84ec0 0x55c196a93ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.865+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a85fd0 0x55c196a94530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.865+0000 7ff987f45b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a95540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.865+0000 7ff987f45b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c196a95a80 con 0x55c196a84ec0 2023-10-06T23:18:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.865+0000 7ff987f45b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c196a95bf0 con 0x55c196a86990 2023-10-06T23:18:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.865+0000 7ff987f45b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c196a95db0 con 0x55c196a85fd0 2023-10-06T23:18:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.865+0000 7ff987f45b80 10 client.0 _ll_register_callbacks cb 0x7ff964009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff971b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a85fd0 0x55c196a94530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff97239b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a84ec0 0x55c196a93ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff971b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a85fd0 0x55c196a94530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42926/0 (socket says 172.21.15.8:42926) 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff971b9a700 1 -- 172.21.15.8:0/1465221646 learned_addr learned my addr 172.21.15.8:0/1465221646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff972b9c700 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a95540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff97239b700 1 -- 172.21.15.8:0/1465221646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a85fd0 msgr2=0x55c196a94530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff97239b700 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a85fd0 0x55c196a94530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff97239b700 1 -- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 msgr2=0x55c196a95540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff97239b700 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a95540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff97239b700 1 -- 172.21.15.8:0/1465221646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95c009870 con 0x55c196a84ec0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff972b9c700 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a95540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.866+0000 7ff971b9a700 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a85fd0 0x55c196a94530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.867+0000 7ff97239b700 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a84ec0 0x55c196a93ff0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff968096f70 tx=0x7ff968098a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd95c9ebf3a3f878 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.867+0000 7ff955ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.867+0000 7ff955ffb700 1 -- 172.21.15.8:0/1465221646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800cbd0 con 0x55c196a84ec0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.867+0000 7ff955ffb700 1 -- 172.21.15.8:0/1465221646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff96809e650 con 0x55c196a84ec0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.867+0000 7ff987f45b80 1 -- 172.21.15.8:0/1465221646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff964007e10 con 0x55c196a84ec0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.867+0000 7ff955ffb700 1 -- 172.21.15.8:0/1465221646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9680a2890 con 0x55c196a84ec0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.867+0000 7ff987f45b80 10 client.16062 fetch_fsmap learned FSMap version 35 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.867+0000 7ff987f45b80 1 -- 172.21.15.8:0/1465221646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7ff96c104430 con 0x55c196a84ec0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff955ffb700 1 -- 172.21.15.8:0/1465221646 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff964007e10 con 0x55c196a84ec0 2023-10-06T23:18:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff955ffb700 1 -- 172.21.15.8:0/1465221646 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff9680a2400 con 0x55c196a84ec0 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff987f45b80 10 client.16062 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff987f45b80 10 client.16062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff987f45b80 20 client.16062 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c196aeeee0 0x55c196af12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff987f45b80 4 client.16062 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff987f45b80 1 -- 172.21.15.8:0/1465221646 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c1969d0ad0 con 0x55c196aeeee0 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.868+0000 7ff971b9a700 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c196aeeee0 0x55c196af12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.869+0000 7ff971b9a700 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c196aeeee0 0x55c196af12d0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6c3abe475896cce server_cookie=415eabded751d377 in_seq=0 out_seq=0 2023-10-06T23:18:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.869+0000 7ff955ffb700 10 client.16062 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff955ffb700 1 -- 172.21.15.8:0/1465221646 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c1969d0ad0 con 0x55c196aeeee0 2023-10-06T23:18:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff955ffb700 10 client.16062 handle_command_reply: tid=0 2023-10-06T23:18:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff987f45b80 1 client.16062 shutdown 2023-10-06T23:18:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff987f45b80 1 -- 172.21.15.8:0/1465221646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a84ec0 msgr2=0x55c196a93ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a84ec0 0x55c196a93ff0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff968096f70 tx=0x7ff968098a80 comp rx=0 tx=0).stop 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff987f45b80 1 -- 172.21.15.8:0/1465221646 shutdown_connections 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c196aeeee0 0x55c196af12d0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c196a84ec0 0x55c196a93ff0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c196a86990 0x55c196a95540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff987f45b80 1 --2- 172.21.15.8:0/1465221646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c196a85fd0 0x55c196a94530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.885+0000 7ff955ffb700 0 client.16062 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.886+0000 7ff987f45b80 1 -- 172.21.15.8:0/1465221646 >> 172.21.15.8:0/1465221646 conn(0x55c1969f9200 msgr2=0x55c196a8d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.886+0000 7ff987f45b80 1 -- 172.21.15.8:0/1465221646 shutdown_connections 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.886+0000 7ff987f45b80 1 -- 172.21.15.8:0/1465221646 wait complete. 2023-10-06T23:18:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.886+0000 7ff987f45b80 20 client.16062 trim_cache size 0 max 16384 2023-10-06T23:18:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:18:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:18:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:18:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:18:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.886+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff9580a1500 msgr2=0x7ff9580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.886+0000 7ff9745ff700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff9580a1500 0x7ff9580a39c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9640062a0 tx=0x7ff96401ee30 comp rx=0 tx=0).stop 2023-10-06T23:18:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.886+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96c0ff760 msgr2=0x7ff96c101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96c0ff760 0x7ff96c101de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff96800eb30 tx=0x7ff96800ee40 comp rx=0 tx=0).stop 2023-10-06T23:18:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 shutdown_connections 2023-10-06T23:18:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff9580a1500 0x7ff9580a39c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c100a80 0x7ff96c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96c0ff760 0x7ff96c101de0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 --2- 172.21.15.8:0/2112971247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff96c1000c0 0x7ff96c102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 >> 172.21.15.8:0/2112971247 conn(0x7ff96c0fb340 msgr2=0x7ff96c0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 shutdown_connections 2023-10-06T23:18:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:40.887+0000 7ff9745ff700 1 -- 172.21.15.8:0/2112971247 wait complete. 2023-10-06T23:18:41.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:41 smithi008 ceph-mon[98532]: pgmap v524: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-10-06T23:18:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:41 smithi190 ceph-mon[102658]: pgmap v524: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-10-06T23:18:41.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:41 smithi156 ceph-mon[102862]: pgmap v524: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-10-06T23:18:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:43 smithi008 ceph-mon[98532]: pgmap v525: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 5.6 MiB/s wr, 531 op/s 2023-10-06T23:18:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:43 smithi190 ceph-mon[102658]: pgmap v525: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 5.6 MiB/s wr, 531 op/s 2023-10-06T23:18:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:43 smithi156 ceph-mon[102862]: pgmap v525: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 5.6 MiB/s wr, 531 op/s 2023-10-06T23:18:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 230.0 s, 226.2 tps, lat 441.944 ms stddev 102.508 2023-10-06T23:18:45.929 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:18:46.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 -- 172.21.15.8:0/797892073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 msgr2=0x7f883810b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 --2- 172.21.15.8:0/797892073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 0x7f883810b290 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f883000b0a0 tx=0x7f883000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 -- 172.21.15.8:0/797892073 shutdown_connections 2023-10-06T23:18:46.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 --2- 172.21.15.8:0/797892073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8838074ef0 0x7f8838073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 --2- 172.21.15.8:0/797892073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 0x7f883810b290 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 --2- 172.21.15.8:0/797892073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8838073910 0x7f8838073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 -- 172.21.15.8:0/797892073 >> 172.21.15.8:0/797892073 conn(0x7f88380fc4d0 msgr2=0x7f88380fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:46.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 -- 172.21.15.8:0/797892073 shutdown_connections 2023-10-06T23:18:46.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.242+0000 7f883e9ff700 1 -- 172.21.15.8:0/797892073 wait complete. 2023-10-06T23:18:46.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.244+0000 7f883e9ff700 1 Processor -- start 2023-10-06T23:18:46.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.244+0000 7f883e9ff700 1 -- start start 2023-10-06T23:18:46.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.244+0000 7f883e9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8838073910 0x7f8838198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.244+0000 7f883e9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8838074ef0 0x7f88381992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.244+0000 7f883e9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 0x7f88381a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.244+0000 7f883e9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88381a08f0 con 0x7f8838074ef0 2023-10-06T23:18:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f883e9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88381a0a60 con 0x7f8838108e00 2023-10-06T23:18:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f883e9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88381a0c20 con 0x7f8838073910 2023-10-06T23:18:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f8837fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8838073910 0x7f8838198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f8837fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8838073910 0x7f8838198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42942/0 (socket says 172.21.15.8:42942) 2023-10-06T23:18:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f8837fff700 1 -- 172.21.15.8:0/2973872575 learned_addr learned my addr 172.21.15.8:0/2973872575 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f883cf9c700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 0x7f88381a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f88377fe700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8838074ef0 0x7f88381992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f8837fff700 1 -- 172.21.15.8:0/2973872575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 msgr2=0x7f88381a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f8837fff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 0x7f88381a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f8837fff700 1 -- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8838074ef0 msgr2=0x7f88381992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f8837fff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8838074ef0 0x7f88381992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.245+0000 7f8837fff700 1 -- 172.21.15.8:0/2973872575 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009d00 con 0x7f8838073910 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.246+0000 7f883cf9c700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 0x7f88381a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.246+0000 7f8837fff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8838073910 0x7f8838198db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f882800d950 tx=0x7f882800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.246+0000 7f88357fa700 1 -- 172.21.15.8:0/2973872575 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828009940 con 0x7f8838073910 2023-10-06T23:18:46.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.247+0000 7f88357fa700 1 -- 172.21.15.8:0/2973872575 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8828010460 con 0x7f8838073910 2023-10-06T23:18:46.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.247+0000 7f88357fa700 1 -- 172.21.15.8:0/2973872575 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800f620 con 0x7f8838073910 2023-10-06T23:18:46.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.247+0000 7f883e9ff700 1 -- 172.21.15.8:0/2973872575 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88381a0f00 con 0x7f8838073910 2023-10-06T23:18:46.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.247+0000 7f883e9ff700 1 -- 172.21.15.8:0/2973872575 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88381a12f0 con 0x7f8838073910 2023-10-06T23:18:46.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.252+0000 7f88357fa700 1 -- 172.21.15.8:0/2973872575 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f88280105d0 con 0x7f8838073910 2023-10-06T23:18:46.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.254+0000 7f8852352b80 1 Processor -- start 2023-10-06T23:18:46.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.254+0000 7f88357fa700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f881c0a1580 0x7f881c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.255+0000 7f88357fa700 1 -- 172.21.15.8:0/2973872575 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f88280ccb10 con 0x7f8838073910 2023-10-06T23:18:46.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.255+0000 7f8852352b80 1 -- start start 2023-10-06T23:18:46.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.256+0000 7f883cf9c700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f881c0a1580 0x7f881c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.256+0000 7f8852352b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27f260 0x558c3a27f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.256+0000 7f8852352b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27fbc0 0x558c3a280480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.256+0000 7f8852352b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a280a60 0x558c3a280ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.256+0000 7f8852352b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a1e7460 con 0x558c3a280a60 2023-10-06T23:18:46.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.256+0000 7f8852352b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a1d8c20 con 0x558c3a27f260 2023-10-06T23:18:46.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.256+0000 7f8852352b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a1d6540 con 0x558c3a27fbc0 2023-10-06T23:18:46.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f88377fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27fbc0 0x558c3a280480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f8837fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27f260 0x558c3a27f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f88377fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27fbc0 0x558c3a280480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42954/0 (socket says 172.21.15.8:42954) 2023-10-06T23:18:46.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f88377fe700 1 -- 172.21.15.8:0/3120492163 learned_addr learned my addr 172.21.15.8:0/3120492163 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:46.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f8837fff700 1 -- 172.21.15.8:0/3120492163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27fbc0 msgr2=0x558c3a280480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:46.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f8837fff700 1 --2- 172.21.15.8:0/3120492163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27fbc0 0x558c3a280480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f8837fff700 1 -- 172.21.15.8:0/3120492163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a280a60 msgr2=0x558c3a280ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:46.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f8837fff700 1 --2- 172.21.15.8:0/3120492163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a280a60 0x558c3a280ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f8837fff700 1 -- 172.21.15.8:0/3120492163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c39ffcde0 con 0x558c3a27f260 2023-10-06T23:18:46.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f883cf9c700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f881c0a1580 0x7f881c0a3a40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f88300079f0 tx=0x7f883000b7f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:46.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.257+0000 7f8837fff700 1 --2- 172.21.15.8:0/3120492163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27f260 0x558c3a27f680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8828099ae0 tx=0x7f8828099740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b061a69cf47ebf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:46.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.258+0000 7f882e7fc700 1 -- 172.21.15.8:0/3120492163 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882809a4e0 con 0x558c3a27f260 2023-10-06T23:18:46.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.258+0000 7f882e7fc700 1 -- 172.21.15.8:0/3120492163 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8828099de0 con 0x558c3a27f260 2023-10-06T23:18:46.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.258+0000 7f882e7fc700 1 -- 172.21.15.8:0/3120492163 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828099530 con 0x558c3a27f260 2023-10-06T23:18:46.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.259+0000 7f8852352b80 1 -- 172.21.15.8:0/3120492163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27f260 msgr2=0x558c3a27f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.259+0000 7f8852352b80 1 --2- 172.21.15.8:0/3120492163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27f260 0x558c3a27f680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8828099ae0 tx=0x7f8828099740 comp rx=0 tx=0).stop 2023-10-06T23:18:46.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.259+0000 7f8852352b80 1 -- 172.21.15.8:0/3120492163 shutdown_connections 2023-10-06T23:18:46.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.259+0000 7f8852352b80 1 --2- 172.21.15.8:0/3120492163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a280a60 0x558c3a280ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.259+0000 7f8852352b80 1 --2- 172.21.15.8:0/3120492163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27f260 0x558c3a27f680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.259+0000 7f8852352b80 1 --2- 172.21.15.8:0/3120492163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27fbc0 0x558c3a280480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.259+0000 7f8852352b80 1 -- 172.21.15.8:0/3120492163 >> 172.21.15.8:0/3120492163 conn(0x558c3a1f3260 msgr2=0x558c3a27a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:46.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.260+0000 7f8852352b80 1 -- 172.21.15.8:0/3120492163 shutdown_connections 2023-10-06T23:18:46.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.260+0000 7f8852352b80 1 -- 172.21.15.8:0/3120492163 wait complete. 2023-10-06T23:18:46.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.260+0000 7f8852352b80 1 -- start start 2023-10-06T23:18:46.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.261+0000 7f8852352b80 1 Processor -- start 2023-10-06T23:18:46.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.261+0000 7f8852352b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.261+0000 7f8852352b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a291c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.261+0000 7f8852352b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a298cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.262+0000 7f8852352b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a1d1e30 con 0x558c3a27f260 2023-10-06T23:18:46.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.262+0000 7f8852352b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a16e710 con 0x558c3a27fbc0 2023-10-06T23:18:46.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.262+0000 7f8852352b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a16e3b0 con 0x558c3a280a60 2023-10-06T23:18:46.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.262+0000 7f8852352b80 10 client.0 _ll_register_callbacks cb 0x558c39fcb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:46.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f88377fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a291c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f883cf9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a298cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f88377fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a291c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50520/0 (socket says 172.21.15.8:50520) 2023-10-06T23:18:46.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f88377fe700 1 -- 172.21.15.8:0/3548108214 learned_addr learned my addr 172.21.15.8:0/3548108214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:46.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f8837fff700 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f883cf9c700 1 -- 172.21.15.8:0/3548108214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 msgr2=0x558c3a291c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:46.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f883cf9c700 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a291c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f883cf9c700 1 -- 172.21.15.8:0/3548108214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 msgr2=0x558c3a291750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:46.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f883cf9c700 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f883cf9c700 1 -- 172.21.15.8:0/3548108214 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88381a12f0 con 0x558c3a280a60 2023-10-06T23:18:46.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.263+0000 7f88377fe700 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a291c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:18:46.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.264+0000 7f883cf9c700 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a298cd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8830009fd0 tx=0x7f883001c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c1e6cb4d26dc278 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:46.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.264+0000 7f881b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:18:46.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.264+0000 7f881b7fe700 1 -- 172.21.15.8:0/3548108214 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000e040 con 0x558c3a280a60 2023-10-06T23:18:46.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.264+0000 7f8852352b80 1 -- 172.21.15.8:0/3548108214 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c3a271f10 con 0x558c3a280a60 2023-10-06T23:18:46.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.264+0000 7f881b7fe700 1 -- 172.21.15.8:0/3548108214 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f883001ce30 con 0x558c3a280a60 2023-10-06T23:18:46.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f881b7fe700 1 -- 172.21.15.8:0/3548108214 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8830005040 con 0x558c3a280a60 2023-10-06T23:18:46.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f8852352b80 10 client.25945 fetch_fsmap learned FSMap version 35 2023-10-06T23:18:46.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f8852352b80 1 -- 172.21.15.8:0/3548108214 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x558c39fe5c60 con 0x558c3a280a60 2023-10-06T23:18:46.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f881b7fe700 1 -- 172.21.15.8:0/3548108214 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8830038020 con 0x558c3a280a60 2023-10-06T23:18:46.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f881b7fe700 1 -- 172.21.15.8:0/3548108214 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f88300346f0 con 0x558c3a280a60 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f8852352b80 10 client.25945 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f8852352b80 10 client.25945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f8852352b80 20 client.25945 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f8852352b80 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c3a2ae570 0x558c3a2b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f8852352b80 4 client.25945 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.265+0000 7f8852352b80 1 -- 172.21.15.8:0/3548108214 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c3a1cae10 con 0x558c3a2ae570 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.266+0000 7f8837fff700 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c3a2ae570 0x558c3a2b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.266+0000 7f8837fff700 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c3a2ae570 0x558c3a2b0990 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7224b5fcc7becf76 server_cookie=c9bcf2bf80d98947 in_seq=0 out_seq=0 2023-10-06T23:18:46.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.266+0000 7f881b7fe700 10 client.25945 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:46.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.267+0000 7f881b7fe700 1 -- 172.21.15.8:0/3548108214 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c3a1cae10 con 0x558c3a2ae570 2023-10-06T23:18:46.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.267+0000 7f881b7fe700 10 client.25945 handle_command_reply: tid=0 2023-10-06T23:18:46.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.267+0000 7f8852352b80 1 client.25945 shutdown 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f8852352b80 1 -- 172.21.15.8:0/3548108214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 msgr2=0x558c3a298cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f8852352b80 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a298cd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8830009fd0 tx=0x7f883001c720 comp rx=0 tx=0).stop 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f8852352b80 1 -- 172.21.15.8:0/3548108214 shutdown_connections 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f8852352b80 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c3a2ae570 0x558c3a2b0990 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f8852352b80 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f8852352b80 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a298cd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f8852352b80 1 --2- 172.21.15.8:0/3548108214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a291c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f8852352b80 1 -- 172.21.15.8:0/3548108214 >> 172.21.15.8:0/3548108214 conn(0x558c3a1f3260 msgr2=0x558c3a279f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.268+0000 7f881b7fe700 0 client.25945 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:46.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.269+0000 7f8852352b80 1 -- 172.21.15.8:0/3548108214 shutdown_connections 2023-10-06T23:18:46.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.269+0000 7f8852352b80 1 -- 172.21.15.8:0/3548108214 wait complete. 2023-10-06T23:18:46.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.270+0000 7f8852352b80 20 client.25945 trim_cache size 0 max 16384 2023-10-06T23:18:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.300+0000 7f8852352b80 1 Processor -- start 2023-10-06T23:18:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.300+0000 7f8852352b80 1 -- start start 2023-10-06T23:18:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f8852352b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f8852352b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a298c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f8852352b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a291c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f8852352b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a052920 con 0x558c3a27f260 2023-10-06T23:18:46.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f8852352b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a1cae10 con 0x558c3a27fbc0 2023-10-06T23:18:46.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f8852352b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a2792e0 con 0x558c3a280a60 2023-10-06T23:18:46.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f88377fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a298c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f883cf9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a291c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f88377fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a298c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50534/0 (socket says 172.21.15.8:50534) 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f8837fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.301+0000 7f88377fe700 1 -- 172.21.15.8:0/1907468144 learned_addr learned my addr 172.21.15.8:0/1907468144 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.302+0000 7f883cf9c700 1 -- 172.21.15.8:0/1907468144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 msgr2=0x558c3a298c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.302+0000 7f883cf9c700 1 --2- 172.21.15.8:0/1907468144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a298c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.302+0000 7f883cf9c700 1 -- 172.21.15.8:0/1907468144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 msgr2=0x558c3a291750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.302+0000 7f883cf9c700 1 --2- 172.21.15.8:0/1907468144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.302+0000 7f883cf9c700 1 -- 172.21.15.8:0/1907468144 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c3a023250 con 0x558c3a280a60 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.302+0000 7f8837fff700 1 --2- 172.21.15.8:0/1907468144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:18:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.302+0000 7f883cf9c700 1 --2- 172.21.15.8:0/1907468144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a291c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8830007a90 tx=0x7f883000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d652a4573dffb420 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:46.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.302+0000 7f882effd700 1 -- 172.21.15.8:0/1907468144 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000e070 con 0x558c3a280a60 2023-10-06T23:18:46.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.303+0000 7f882effd700 1 -- 172.21.15.8:0/1907468144 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8830038040 con 0x558c3a280a60 2023-10-06T23:18:46.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.303+0000 7f882effd700 1 -- 172.21.15.8:0/1907468144 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88300059f0 con 0x558c3a280a60 2023-10-06T23:18:46.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 -- 172.21.15.8:0/1907468144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 msgr2=0x558c3a291c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 --2- 172.21.15.8:0/1907468144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a291c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8830007a90 tx=0x7f883000b8e0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 -- 172.21.15.8:0/1907468144 shutdown_connections 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 --2- 172.21.15.8:0/1907468144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27f260 0x558c3a291750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 --2- 172.21.15.8:0/1907468144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a280a60 0x558c3a291c90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 --2- 172.21.15.8:0/1907468144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a27fbc0 0x558c3a298c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 -- 172.21.15.8:0/1907468144 >> 172.21.15.8:0/1907468144 conn(0x558c3a1f3260 msgr2=0x558c3a290470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 -- 172.21.15.8:0/1907468144 shutdown_connections 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 -- 172.21.15.8:0/1907468144 wait complete. 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.304+0000 7f8852352b80 1 -- start start 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.305+0000 7f8852352b80 1 Processor -- start 2023-10-06T23:18:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.305+0000 7f8852352b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27f260 0x558c3a2984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.305+0000 7f8852352b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27fbc0 0x558c3a2989f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.305+0000 7f8852352b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a280a60 0x558c3a294f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.305+0000 7f8852352b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a2954d0 con 0x558c3a27fbc0 2023-10-06T23:18:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.305+0000 7f8852352b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a295640 con 0x558c3a280a60 2023-10-06T23:18:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.305+0000 7f8852352b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a295800 con 0x558c3a27f260 2023-10-06T23:18:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8852352b80 10 client.0 _ll_register_callbacks cb 0x7f8830003d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8837fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27f260 0x558c3a2984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8837fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27f260 0x558c3a2984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42986/0 (socket says 172.21.15.8:42986) 2023-10-06T23:18:46.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8837fff700 1 -- 172.21.15.8:0/2699528834 learned_addr learned my addr 172.21.15.8:0/2699528834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:46.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f883cf9c700 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a280a60 0x558c3a294f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8837fff700 1 -- 172.21.15.8:0/2699528834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a280a60 msgr2=0x558c3a294f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:46.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8837fff700 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a280a60 0x558c3a294f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8837fff700 1 -- 172.21.15.8:0/2699528834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27fbc0 msgr2=0x558c3a2989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8837fff700 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27fbc0 0x558c3a2989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.306+0000 7f8837fff700 1 -- 172.21.15.8:0/2699528834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88280b1040 con 0x558c3a27f260 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.307+0000 7f8837fff700 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27f260 0x558c3a2984b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8828010c80 tx=0x7f8828096250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c916f7bbe16c2f1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.307+0000 7f881b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.307+0000 7f881b7fe700 1 -- 172.21.15.8:0/2699528834 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828098180 con 0x558c3a27f260 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.307+0000 7f881b7fe700 1 -- 172.21.15.8:0/2699528834 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f88280994e0 con 0x558c3a27f260 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.307+0000 7f8852352b80 1 -- 172.21.15.8:0/2699528834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8828099de0 con 0x558c3a27f260 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.307+0000 7f881b7fe700 1 -- 172.21.15.8:0/2699528834 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88280a1ce0 con 0x558c3a27f260 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.307+0000 7f8852352b80 10 client.25951 fetch_fsmap learned FSMap version 35 2023-10-06T23:18:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f8852352b80 1 -- 172.21.15.8:0/2699528834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x558c39fe5c60 con 0x558c3a27f260 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f881b7fe700 1 -- 172.21.15.8:0/2699528834 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8828099de0 con 0x558c3a27f260 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f881b7fe700 1 -- 172.21.15.8:0/2699528834 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8828098d40 con 0x558c3a27f260 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f8852352b80 10 client.25951 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f8852352b80 10 client.25951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f8852352b80 20 client.25951 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f8852352b80 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c3a303500 0x558c3a305920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f8852352b80 4 client.25951 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.308+0000 7f8852352b80 1 -- 172.21.15.8:0/2699528834 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558c3a1cab30 con 0x558c3a303500 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.309+0000 7f88377fe700 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c3a303500 0x558c3a305920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:46.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.309+0000 7f88377fe700 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c3a303500 0x558c3a305920 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ba910b94299979 server_cookie=72c8133d8fafc65 in_seq=0 out_seq=0 2023-10-06T23:18:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.309+0000 7f881b7fe700 10 client.25951 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.310+0000 7f881b7fe700 1 -- 172.21.15.8:0/2699528834 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558c3a1cab30 con 0x558c3a303500 2023-10-06T23:18:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.310+0000 7f881b7fe700 10 client.25951 handle_command_reply: tid=0 2023-10-06T23:18:46.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.310+0000 7f8852352b80 1 client.25951 shutdown 2023-10-06T23:18:46.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 -- 172.21.15.8:0/2699528834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27f260 msgr2=0x558c3a2984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27f260 0x558c3a2984b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8828010c80 tx=0x7f8828096250 comp rx=0 tx=0).stop 2023-10-06T23:18:46.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 -- 172.21.15.8:0/2699528834 shutdown_connections 2023-10-06T23:18:46.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c3a303500 0x558c3a305920 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c3a280a60 0x558c3a294f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c3a27f260 0x558c3a2984b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 --2- 172.21.15.8:0/2699528834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3a27fbc0 0x558c3a2989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 -- 172.21.15.8:0/2699528834 >> 172.21.15.8:0/2699528834 conn(0x558c3a1f3260 msgr2=0x558c3a283970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f881b7fe700 0 client.25951 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 -- 172.21.15.8:0/2699528834 shutdown_connections 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.311+0000 7f8852352b80 1 -- 172.21.15.8:0/2699528834 wait complete. 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.312+0000 7f8852352b80 20 client.25951 trim_cache size 0 max 16384 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:18:46.316 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:18:46.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:18:46.317 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:18:46.317 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:18:46.317 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:18:46.317 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:18:46.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 -- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f881c0a1580 msgr2=0x7f881c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f881c0a1580 0x7f881c0a3a40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f88300079f0 tx=0x7f883000b7f0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 -- 172.21.15.8:0/2973872575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8838073910 msgr2=0x7f8838198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8838073910 0x7f8838198db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f882800d950 tx=0x7f882800dc60 comp rx=0 tx=0).stop 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 -- 172.21.15.8:0/2973872575 shutdown_connections 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f881c0a1580 0x7f881c0a3a40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8838108e00 0x7f88381a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8838073910 0x7f8838198db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 --2- 172.21.15.8:0/2973872575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8838074ef0 0x7f88381992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 -- 172.21.15.8:0/2973872575 >> 172.21.15.8:0/2973872575 conn(0x7f88380fc4d0 msgr2=0x7f88380fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 -- 172.21.15.8:0/2973872575 shutdown_connections 2023-10-06T23:18:46.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:18:46.313+0000 7f883e9ff700 1 -- 172.21.15.8:0/2973872575 wait complete. 2023-10-06T23:18:46.339 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:46 smithi008 ceph-mon[98532]: pgmap v526: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2023-10-06T23:18:46.342 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:18:46.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:46 smithi190 ceph-mon[102658]: pgmap v526: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2023-10-06T23:18:46.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:46 smithi156 ceph-mon[102862]: pgmap v526: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2023-10-06T23:18:47.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:47 smithi190 ceph-mon[102658]: pgmap v527: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 4.9 MiB/s wr, 478 op/s 2023-10-06T23:18:47.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:47 smithi156 ceph-mon[102862]: pgmap v527: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 4.9 MiB/s wr, 478 op/s 2023-10-06T23:18:47.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:47 smithi008 ceph-mon[98532]: pgmap v527: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 4.9 MiB/s wr, 478 op/s 2023-10-06T23:18:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 235.0 s, 229.6 tps, lat 437.402 ms stddev 91.550 2023-10-06T23:18:50.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:50 smithi008 ceph-mon[98532]: pgmap v528: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2023-10-06T23:18:50.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:50 smithi190 ceph-mon[102658]: pgmap v528: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2023-10-06T23:18:50.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:50 smithi156 ceph-mon[102862]: pgmap v528: 97 pgs: 97 active+clean; 1.3 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2023-10-06T23:18:52.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:52 smithi008 ceph-mon[98532]: pgmap v529: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.7 MiB/s wr, 549 op/s 2023-10-06T23:18:52.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:52 smithi190 ceph-mon[102658]: pgmap v529: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.7 MiB/s wr, 549 op/s 2023-10-06T23:18:52.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:52 smithi156 ceph-mon[102862]: pgmap v529: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.7 MiB/s wr, 549 op/s 2023-10-06T23:18:53.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:53 smithi008 ceph-mon[98532]: pgmap v530: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 4.3 MiB/s wr, 528 op/s 2023-10-06T23:18:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:53 smithi190 ceph-mon[102658]: pgmap v530: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 4.3 MiB/s wr, 528 op/s 2023-10-06T23:18:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:53 smithi156 ceph-mon[102862]: pgmap v530: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 4.3 MiB/s wr, 528 op/s 2023-10-06T23:18:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 240.0 s, 241.4 tps, lat 411.399 ms stddev 73.627 2023-10-06T23:18:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.100+0000 7f42e7fff700 1 -- 172.21.15.8:0/10141734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42e0074e90 msgr2=0x7f42e00732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.100+0000 7f42e7fff700 1 --2- 172.21.15.8:0/10141734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42e0074e90 0x7f42e00732e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009990 tx=0x7f42dc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.101+0000 7f42e7fff700 1 -- 172.21.15.8:0/10141734 shutdown_connections 2023-10-06T23:18:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.101+0000 7f42e7fff700 1 --2- 172.21.15.8:0/10141734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0108e00 0x7f42e010b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.101+0000 7f42e7fff700 1 --2- 172.21.15.8:0/10141734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42e0074e90 0x7f42e00732e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.101+0000 7f42e7fff700 1 --2- 172.21.15.8:0/10141734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e00738b0 0x7f42e0073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.101+0000 7f42e7fff700 1 -- 172.21.15.8:0/10141734 >> 172.21.15.8:0/10141734 conn(0x7f42e00fc480 msgr2=0x7f42e00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.101+0000 7f42e7fff700 1 -- 172.21.15.8:0/10141734 shutdown_connections 2023-10-06T23:18:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.101+0000 7f42e7fff700 1 -- 172.21.15.8:0/10141734 wait complete. 2023-10-06T23:18:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.102+0000 7f42e7fff700 1 Processor -- start 2023-10-06T23:18:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.103+0000 7f42e7fff700 1 -- start start 2023-10-06T23:18:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.103+0000 7f42e7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42e00738b0 0x7f42e0198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.103+0000 7f42e7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e0074e90 0x7f42e01993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.103+0000 7f42e7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0108e00 0x7f42e019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.103+0000 7f42e7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e019a850 con 0x7f42e0074e90 2023-10-06T23:18:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.103+0000 7f42e7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e019a9c0 con 0x7f42e0108e00 2023-10-06T23:18:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.103+0000 7f42e7fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e019ab80 con 0x7f42e00738b0 2023-10-06T23:18:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.105+0000 7f42e559a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e0074e90 0x7f42e01993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.105+0000 7f42e559a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e0074e90 0x7f42e01993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57462/0 (socket says 172.21.15.8:57462) 2023-10-06T23:18:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.105+0000 7f42e559a700 1 -- 172.21.15.8:0/3598056631 learned_addr learned my addr 172.21.15.8:0/3598056631 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.105+0000 7f42e659c700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0108e00 0x7f42e019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.106+0000 7f42e559a700 1 -- 172.21.15.8:0/3598056631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42e00738b0 msgr2=0x7f42e0198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.106+0000 7f42e559a700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42e00738b0 0x7f42e0198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.106+0000 7f42e559a700 1 -- 172.21.15.8:0/3598056631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0108e00 msgr2=0x7f42e019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.106+0000 7f42e559a700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0108e00 0x7f42e019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.106+0000 7f42e559a700 1 -- 172.21.15.8:0/3598056631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0095f0 con 0x7f42e0074e90 2023-10-06T23:18:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.107+0000 7f42e559a700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e0074e90 0x7f42e01993a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f42d000e9a0 tx=0x7f42d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:54.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.107+0000 7f42d6ffd700 1 -- 172.21.15.8:0/3598056631 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0009790 con 0x7f42e0074e90 2023-10-06T23:18:54.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.108+0000 7f42d6ffd700 1 -- 172.21.15.8:0/3598056631 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42d000cbd0 con 0x7f42e0074e90 2023-10-06T23:18:54.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.108+0000 7f42d6ffd700 1 -- 172.21.15.8:0/3598056631 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0018680 con 0x7f42e0074e90 2023-10-06T23:18:54.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.108+0000 7f42e7fff700 1 -- 172.21.15.8:0/3598056631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e019ae60 con 0x7f42e0074e90 2023-10-06T23:18:54.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.108+0000 7f42e7fff700 1 -- 172.21.15.8:0/3598056631 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e006aab0 con 0x7f42e0074e90 2023-10-06T23:18:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.114+0000 7f42d6ffd700 1 -- 172.21.15.8:0/3598056631 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f42d000cd40 con 0x7f42e0074e90 2023-10-06T23:18:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.114+0000 7f42fb9bcb80 1 Processor -- start 2023-10-06T23:18:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.115+0000 7f42fb9bcb80 1 -- start start 2023-10-06T23:18:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.115+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b1722942e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.115+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b172295450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.115+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 0x55b17229c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.115+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1721fc400 con 0x55b172293ec0 2023-10-06T23:18:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.115+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1721edbc0 con 0x55b172294fd0 2023-10-06T23:18:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.115+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1721eb4e0 con 0x55b172295990 2023-10-06T23:18:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42d6ffd700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42cc0a15d0 0x7f42cc0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b1722942e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b172295450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b172295450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43128/0 (socket says 172.21.15.8:43128) 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42d6ffd700 1 -- 172.21.15.8:0/3598056631 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f42d0014070 con 0x7f42e0074e90 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e5d9b700 1 -- 172.21.15.8:0/2299848183 learned_addr learned my addr 172.21.15.8:0/2299848183 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e559a700 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 0x55b17229c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e659c700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42cc0a15d0 0x7f42cc0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e5d9b700 1 -- 172.21.15.8:0/2299848183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 msgr2=0x55b17229c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 0x55b17229c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e5d9b700 1 -- 172.21.15.8:0/2299848183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 msgr2=0x55b1722942e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b1722942e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e5d9b700 1 -- 172.21.15.8:0/2299848183 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b172011d80 con 0x55b172294fd0 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.116+0000 7f42e659c700 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b1722942e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:18:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.117+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b172295450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42dc003f60 tx=0x7f42dc005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5d7d355218af0ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.117+0000 7f42e659c700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42cc0a15d0 0x7f42cc0a3a90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f42d8009ec0 tx=0x7f42d8004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.117+0000 7f42cbfff700 1 -- 172.21.15.8:0/2299848183 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc01d070 con 0x55b172294fd0 2023-10-06T23:18:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.117+0000 7f42cbfff700 1 -- 172.21.15.8:0/2299848183 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42dc004ca0 con 0x55b172294fd0 2023-10-06T23:18:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.117+0000 7f42cbfff700 1 -- 172.21.15.8:0/2299848183 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc005550 con 0x55b172294fd0 2023-10-06T23:18:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2299848183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 msgr2=0x55b172295450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b172295450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42dc003f60 tx=0x7f42dc005c00 comp rx=0 tx=0).stop 2023-10-06T23:18:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2299848183 shutdown_connections 2023-10-06T23:18:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b1722942e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 0x55b17229c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2299848183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b172295450 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2299848183 >> 172.21.15.8:0/2299848183 conn(0x55b172208200 msgr2=0x55b17228ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2299848183 shutdown_connections 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.118+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2299848183 wait complete. 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.119+0000 7f42fb9bcb80 1 -- start start 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.119+0000 7f42fb9bcb80 1 Processor -- start 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b17229da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b17229dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 0x55b1722a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1721e6dd0 con 0x55b172294fd0 2023-10-06T23:18:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1721836b0 con 0x55b172295990 2023-10-06T23:18:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b172183350 con 0x55b172293ec0 2023-10-06T23:18:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42fb9bcb80 10 client.0 _ll_register_callbacks cb 0x55b171fe07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e559a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b17229dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e559a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b17229dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57468/0 (socket says 172.21.15.8:57468) 2023-10-06T23:18:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e559a700 1 -- 172.21.15.8:0/2251767123 learned_addr learned my addr 172.21.15.8:0/2251767123 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e659c700 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 0x55b1722a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b17229da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e559a700 1 -- 172.21.15.8:0/2251767123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 msgr2=0x55b17229da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e559a700 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b17229da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e559a700 1 -- 172.21.15.8:0/2251767123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 msgr2=0x55b1722a4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e559a700 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 0x55b1722a4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.120+0000 7f42e559a700 1 -- 172.21.15.8:0/2251767123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e010be90 con 0x55b172294fd0 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42e559a700 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b17229dfa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f42d000e970 tx=0x7f42d009a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b146c79e79f4c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42c97fa700 1 -- 172.21.15.8:0/2251767123 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d00a22c0 con 0x55b172294fd0 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42c97fa700 1 -- 172.21.15.8:0/2251767123 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f42d009e310 con 0x55b172294fd0 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2251767123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b172286d50 con 0x55b172294fd0 2023-10-06T23:18:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42c97fa700 1 -- 172.21.15.8:0/2251767123 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42d00a2550 con 0x55b172294fd0 2023-10-06T23:18:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42fb9bcb80 10 client.16086 fetch_fsmap learned FSMap version 35 2023-10-06T23:18:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2251767123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55b171ffac00 con 0x55b172294fd0 2023-10-06T23:18:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42c97fa700 1 -- 172.21.15.8:0/2251767123 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42d00a6080 con 0x55b172294fd0 2023-10-06T23:18:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.121+0000 7f42c97fa700 1 -- 172.21.15.8:0/2251767123 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f42d0095fb0 con 0x55b172294fd0 2023-10-06T23:18:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.122+0000 7f42fb9bcb80 10 client.16086 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:18:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.122+0000 7f42fb9bcb80 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.122+0000 7f42fb9bcb80 20 client.16086 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.122+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b1722a9880 0x55b1722abca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.122+0000 7f42fb9bcb80 4 client.16086 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:18:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.122+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2251767123 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1721dfdb0 con 0x55b1722a9880 2023-10-06T23:18:54.461 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.460+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b1722a9880 0x55b1722abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.464+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b1722a9880 0x55b1722abca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60c66384fe477ef5 server_cookie=5d202148dc536039 in_seq=0 out_seq=0 2023-10-06T23:18:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.464+0000 7f42c97fa700 10 client.16086 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.465+0000 7f42c97fa700 1 -- 172.21.15.8:0/2251767123 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b1721dfdb0 con 0x55b1722a9880 2023-10-06T23:18:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.465+0000 7f42c97fa700 10 client.16086 handle_command_reply: tid=0 2023-10-06T23:18:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.465+0000 7f42fb9bcb80 1 client.16086 shutdown 2023-10-06T23:18:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2251767123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 msgr2=0x55b17229dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b17229dfa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f42d000e970 tx=0x7f42d009a700 comp rx=0 tx=0).stop 2023-10-06T23:18:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2251767123 shutdown_connections 2023-10-06T23:18:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b1722a9880 0x55b1722abca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 0x55b1722a4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42c97fa700 0 client.16086 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b17229da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2251767123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b17229dfa0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2251767123 >> 172.21.15.8:0/2251767123 conn(0x55b172208200 msgr2=0x55b17228e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2251767123 shutdown_connections 2023-10-06T23:18:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2251767123 wait complete. 2023-10-06T23:18:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.466+0000 7f42fb9bcb80 20 client.16086 trim_cache size 0 max 16384 2023-10-06T23:18:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.489+0000 7f42fb9bcb80 1 Processor -- start 2023-10-06T23:18:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.489+0000 7f42fb9bcb80 1 -- start start 2023-10-06T23:18:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.489+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b17229d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.489+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b1722a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.489+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 0x55b17228e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.489+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1720678c0 con 0x55b172293ec0 2023-10-06T23:18:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.489+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b172298450 con 0x55b172294fd0 2023-10-06T23:18:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.489+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1722a6cd0 con 0x55b172295990 2023-10-06T23:18:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.490+0000 7f42e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b17229d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.490+0000 7f42e559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b1722a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.490+0000 7f42e559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b1722a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43156/0 (socket says 172.21.15.8:43156) 2023-10-06T23:18:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.490+0000 7f42e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b17229d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57470/0 (socket says 172.21.15.8:57470) 2023-10-06T23:18:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.490+0000 7f42e559a700 1 -- 172.21.15.8:0/2514573375 learned_addr learned my addr 172.21.15.8:0/2514573375 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.490+0000 7f42e659c700 1 --2- 172.21.15.8:0/2514573375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 0x55b17228e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.491+0000 7f42e559a700 1 -- 172.21.15.8:0/2514573375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 msgr2=0x55b17228e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.491+0000 7f42e559a700 1 --2- 172.21.15.8:0/2514573375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 0x55b17228e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.491+0000 7f42e559a700 1 -- 172.21.15.8:0/2514573375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 msgr2=0x55b17229d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.491+0000 7f42e559a700 1 --2- 172.21.15.8:0/2514573375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b17229d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.491+0000 7f42e559a700 1 -- 172.21.15.8:0/2514573375 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1720381f0 con 0x55b172294fd0 2023-10-06T23:18:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.491+0000 7f42e559a700 1 --2- 172.21.15.8:0/2514573375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b1722a4fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42d0096be0 tx=0x7f42d00ccf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b684af0ca82f19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.492+0000 7f42d4ff9700 1 -- 172.21.15.8:0/2514573375 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0096330 con 0x55b172294fd0 2023-10-06T23:18:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.492+0000 7f42d4ff9700 1 -- 172.21.15.8:0/2514573375 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b172286d50 con 0x55b172294fd0 2023-10-06T23:18:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.492+0000 7f42d4ff9700 1 -- 172.21.15.8:0/2514573375 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0010430 con 0x55b172294fd0 2023-10-06T23:18:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.492+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2514573375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 msgr2=0x55b1722a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.492+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2514573375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b1722a4fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42d0096be0 tx=0x7f42d00ccf90 comp rx=0 tx=0).stop 2023-10-06T23:18:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.493+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2514573375 shutdown_connections 2023-10-06T23:18:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.493+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2514573375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172293ec0 0x55b17229d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.493+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2514573375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172295990 0x55b17228e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.493+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2514573375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172294fd0 0x55b1722a4fa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.493+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2514573375 >> 172.21.15.8:0/2514573375 conn(0x55b172208200 msgr2=0x55b1722b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.493+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2514573375 shutdown_connections 2023-10-06T23:18:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.493+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2514573375 wait complete. 2023-10-06T23:18:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.493+0000 7f42fb9bcb80 1 -- start start 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.494+0000 7f42fb9bcb80 1 Processor -- start 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b1722a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b1722a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42fb9bcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 0x55b1722a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1722a4370 con 0x55b172294fd0 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1722a44e0 con 0x55b172295990 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42fb9bcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1722a46a0 con 0x55b172293ec0 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42fb9bcb80 10 client.0 _ll_register_callbacks cb 0x7f42d0099dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:18:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42e5d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b1722a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42e5d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b1722a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54338/0 (socket says 172.21.15.8:54338) 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42e5d9b700 1 -- 172.21.15.8:0/2021366765 learned_addr learned my addr 172.21.15.8:0/2021366765 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42e559a700 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b1722a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.495+0000 7f42e659c700 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 0x55b1722a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.496+0000 7f42e5d9b700 1 -- 172.21.15.8:0/2021366765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 msgr2=0x55b1722a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.496+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 0x55b1722a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.496+0000 7f42e5d9b700 1 -- 172.21.15.8:0/2021366765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 msgr2=0x55b1722a2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.496+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b1722a2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.496+0000 7f42e5d9b700 1 -- 172.21.15.8:0/2021366765 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b171ffac00 con 0x55b172293ec0 2023-10-06T23:18:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.496+0000 7f42e5d9b700 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b1722a28e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0047e0 tx=0x7f42dc005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63259402e39bbe2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:18:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.496+0000 7f42c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:18:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.497+0000 7f42c97fa700 1 -- 172.21.15.8:0/2021366765 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc01d040 con 0x55b172293ec0 2023-10-06T23:18:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.497+0000 7f42c97fa700 1 -- 172.21.15.8:0/2021366765 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f42dc02ea60 con 0x55b172293ec0 2023-10-06T23:18:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.497+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2021366765 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42dc004ca0 con 0x55b172293ec0 2023-10-06T23:18:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.497+0000 7f42c97fa700 1 -- 172.21.15.8:0/2021366765 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42dc004b40 con 0x55b172293ec0 2023-10-06T23:18:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42fb9bcb80 10 client.25966 fetch_fsmap learned FSMap version 35 2023-10-06T23:18:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2021366765 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55b172010250 con 0x55b172293ec0 2023-10-06T23:18:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42c97fa700 1 -- 172.21.15.8:0/2021366765 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42dc03f020 con 0x55b172293ec0 2023-10-06T23:18:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42c97fa700 1 -- 172.21.15.8:0/2021366765 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f42dc005150 con 0x55b172293ec0 2023-10-06T23:18:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42fb9bcb80 10 client.25966 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:18:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42fb9bcb80 10 client.25966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:18:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42fb9bcb80 20 client.25966 populate_metadata read hostname 'smithi008' 2023-10-06T23:18:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b172306630 0x55b172308a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:18:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42fb9bcb80 4 client.25966 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:18:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.498+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2021366765 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b1721dfad0 con 0x55b172306630 2023-10-06T23:18:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.499+0000 7f42e559a700 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b172306630 0x55b172308a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:18:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.499+0000 7f42e559a700 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b172306630 0x55b172308a50 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2f2576ebccdd7d5 server_cookie=3995573b10cf266b in_seq=0 out_seq=0 2023-10-06T23:18:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.499+0000 7f42c97fa700 10 client.25966 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.516+0000 7f42c97fa700 1 -- 172.21.15.8:0/2021366765 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b1721dfad0 con 0x55b172306630 2023-10-06T23:18:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.516+0000 7f42c97fa700 10 client.25966 handle_command_reply: tid=0 2023-10-06T23:18:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.516+0000 7f42fb9bcb80 1 client.25966 shutdown 2023-10-06T23:18:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.516+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2021366765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 msgr2=0x55b1722a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.516+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b1722a28e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0047e0 tx=0x7f42dc005c70 comp rx=0 tx=0).stop 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2021366765 shutdown_connections 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b172306630 0x55b172308a50 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b172295990 0x55b1722a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b172293ec0 0x55b1722a28e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 1 --2- 172.21.15.8:0/2021366765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b172294fd0 0x55b1722a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2021366765 >> 172.21.15.8:0/2021366765 conn(0x55b172208200 msgr2=0x55b17229bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42c97fa700 0 client.25966 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:18:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2021366765 shutdown_connections 2023-10-06T23:18:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 1 -- 172.21.15.8:0/2021366765 wait complete. 2023-10-06T23:18:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.517+0000 7f42fb9bcb80 20 client.25966 trim_cache size 0 max 16384 2023-10-06T23:18:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:18:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:18:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:18:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:18:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.519+0000 7f42e7fff700 1 -- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42cc0a15d0 msgr2=0x7f42cc0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.519+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42cc0a15d0 0x7f42cc0a3a90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f42d8009ec0 tx=0x7f42d8004b40 comp rx=0 tx=0).stop 2023-10-06T23:18:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.520+0000 7f42e7fff700 1 -- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e0074e90 msgr2=0x7f42e01993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:18:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.520+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e0074e90 0x7f42e01993a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f42d000e9a0 tx=0x7f42d000ecb0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.520+0000 7f42e7fff700 1 -- 172.21.15.8:0/3598056631 shutdown_connections 2023-10-06T23:18:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.520+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f42cc0a15d0 0x7f42cc0a3a90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.520+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0108e00 0x7f42e019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.520+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42e00738b0 0x7f42e0198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.520+0000 7f42e7fff700 1 --2- 172.21.15.8:0/3598056631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42e0074e90 0x7f42e01993a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:18:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.520+0000 7f42e7fff700 1 -- 172.21.15.8:0/3598056631 >> 172.21.15.8:0/3598056631 conn(0x7f42e00fc480 msgr2=0x7f42e00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:18:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.521+0000 7f42e7fff700 1 -- 172.21.15.8:0/3598056631 shutdown_connections 2023-10-06T23:18:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:18:54.521+0000 7f42e7fff700 1 -- 172.21.15.8:0/3598056631 wait complete. 2023-10-06T23:18:56.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:56 smithi008 ceph-mon[98532]: pgmap v531: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 4.5 MiB/s wr, 572 op/s 2023-10-06T23:18:56.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:56 smithi190 ceph-mon[102658]: pgmap v531: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 4.5 MiB/s wr, 572 op/s 2023-10-06T23:18:56.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:56 smithi156 ceph-mon[102862]: pgmap v531: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 4.5 MiB/s wr, 572 op/s 2023-10-06T23:18:58.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:58 smithi008 ceph-mon[98532]: pgmap v532: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-10-06T23:18:58.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:58 smithi190 ceph-mon[102658]: pgmap v532: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-10-06T23:18:58.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:58 smithi156 ceph-mon[102862]: pgmap v532: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-10-06T23:18:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 245.0 s, 231.0 tps, lat 440.038 ms stddev 140.523 2023-10-06T23:18:59.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:18:59 smithi190 ceph-mon[102658]: pgmap v533: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 4.6 MiB/s wr, 571 op/s 2023-10-06T23:18:59.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:18:59 smithi156 ceph-mon[102862]: pgmap v533: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 4.6 MiB/s wr, 571 op/s 2023-10-06T23:18:59.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:18:59 smithi008 ceph-mon[98532]: pgmap v533: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 4.6 MiB/s wr, 571 op/s 2023-10-06T23:19:02.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:02 smithi008 ceph-mon[98532]: pgmap v534: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 4.1 MiB/s wr, 534 op/s 2023-10-06T23:19:02.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:02 smithi190 ceph-mon[102658]: pgmap v534: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 4.1 MiB/s wr, 534 op/s 2023-10-06T23:19:02.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:02 smithi156 ceph-mon[102862]: pgmap v534: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 4.1 MiB/s wr, 534 op/s 2023-10-06T23:19:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:03 smithi008 ceph-mon[98532]: pgmap v535: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-10-06T23:19:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:03 smithi190 ceph-mon[102658]: pgmap v535: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-10-06T23:19:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:03 smithi156 ceph-mon[102862]: pgmap v535: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-10-06T23:19:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 250.0 s, 194.8 tps, lat 508.378 ms stddev 353.395 2023-10-06T23:19:06.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:06 smithi008 ceph-mon[98532]: pgmap v536: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-10-06T23:19:06.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:06 smithi190 ceph-mon[102658]: pgmap v536: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-10-06T23:19:06.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:06 smithi156 ceph-mon[102862]: pgmap v536: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-10-06T23:19:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 -- 172.21.15.8:0/1910608684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb68101980 msgr2=0x7feb68108230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 --2- 172.21.15.8:0/1910608684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb68101980 0x7feb68108230 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feb60009fc0 tx=0x7feb6000b330 comp rx=0 tx=0).stop 2023-10-06T23:19:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 -- 172.21.15.8:0/1910608684 shutdown_connections 2023-10-06T23:19:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 --2- 172.21.15.8:0/1910608684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb68101980 0x7feb68108230 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 --2- 172.21.15.8:0/1910608684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb680ffdf0 0x7feb68100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 --2- 172.21.15.8:0/1910608684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb68100fe0 0x7feb68101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 -- 172.21.15.8:0/1910608684 >> 172.21.15.8:0/1910608684 conn(0x7feb680fb340 msgr2=0x7feb680fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 -- 172.21.15.8:0/1910608684 shutdown_connections 2023-10-06T23:19:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.737+0000 7feb6cbff700 1 -- 172.21.15.8:0/1910608684 wait complete. 2023-10-06T23:19:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.739+0000 7feb6cbff700 1 Processor -- start 2023-10-06T23:19:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.739+0000 7feb6cbff700 1 -- start start 2023-10-06T23:19:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.739+0000 7feb6cbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb680ffdf0 0x7feb681023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.739+0000 7feb6cbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb68100fe0 0x7feb68102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.739+0000 7feb6cbff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb68101980 0x7feb68102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.739+0000 7feb6cbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68103f60 con 0x7feb680ffdf0 2023-10-06T23:19:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.739+0000 7feb6cbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb681040d0 con 0x7feb68100fe0 2023-10-06T23:19:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.739+0000 7feb6cbff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68104290 con 0x7feb68101980 2023-10-06T23:19:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb6659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb680ffdf0 0x7feb681023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb66d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb68101980 0x7feb68102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb6659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb680ffdf0 0x7feb681023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58282/0 (socket says 172.21.15.8:58282) 2023-10-06T23:19:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb6659c700 1 -- 172.21.15.8:0/2138104431 learned_addr learned my addr 172.21.15.8:0/2138104431 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb65d9b700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb68100fe0 0x7feb68102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb65d9b700 1 -- 172.21.15.8:0/2138104431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb68101980 msgr2=0x7feb68102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb65d9b700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb68101980 0x7feb68102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb65d9b700 1 -- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb680ffdf0 msgr2=0x7feb681023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb65d9b700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb680ffdf0 0x7feb681023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.740+0000 7feb65d9b700 1 -- 172.21.15.8:0/2138104431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58009520 con 0x7feb68100fe0 2023-10-06T23:19:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.741+0000 7feb66d9d700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb68101980 0x7feb68102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.741+0000 7feb65d9b700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb68100fe0 0x7feb68102900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00e9f0 tx=0x7feb5c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.741+0000 7feb577fe700 1 -- 172.21.15.8:0/2138104431 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c00c9c0 con 0x7feb68100fe0 2023-10-06T23:19:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.741+0000 7feb6cbff700 1 -- 172.21.15.8:0/2138104431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb60009c40 con 0x7feb68100fe0 2023-10-06T23:19:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.741+0000 7feb6cbff700 1 -- 172.21.15.8:0/2138104431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb681a5960 con 0x7feb68100fe0 2023-10-06T23:19:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.742+0000 7feb577fe700 1 -- 172.21.15.8:0/2138104431 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb5c010430 con 0x7feb68100fe0 2023-10-06T23:19:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.742+0000 7feb577fe700 1 -- 172.21.15.8:0/2138104431 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c018680 con 0x7feb68100fe0 2023-10-06T23:19:07.748 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.747+0000 7feb577fe700 1 -- 172.21.15.8:0/2138104431 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7feb5c0105a0 con 0x7feb68100fe0 2023-10-06T23:19:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.748+0000 7feb8043db80 1 Processor -- start 2023-10-06T23:19:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.749+0000 7feb8043db80 1 -- start start 2023-10-06T23:19:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.749+0000 7feb8043db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.749+0000 7feb8043db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f1e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.749+0000 7feb8043db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f25220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.749+0000 7feb8043db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336e85400 con 0x55d336f1cec0 2023-10-06T23:19:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.749+0000 7feb8043db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336e76bc0 con 0x55d336f1dfd0 2023-10-06T23:19:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.749+0000 7feb8043db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336e744e0 con 0x55d336f1e990 2023-10-06T23:19:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.750+0000 7feb66d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.750+0000 7feb66d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58298/0 (socket says 172.21.15.8:58298) 2023-10-06T23:19:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.750+0000 7feb66d9d700 1 -- 172.21.15.8:0/364891613 learned_addr learned my addr 172.21.15.8:0/364891613 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb66d9d700 1 -- 172.21.15.8:0/364891613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 msgr2=0x55d336f25220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb65d9b700 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f25220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb6659c700 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f1e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb66d9d700 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f25220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb66d9d700 1 -- 172.21.15.8:0/364891613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 msgr2=0x55d336f1e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb66d9d700 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f1e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb66d9d700 1 -- 172.21.15.8:0/364891613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d336c9ad80 con 0x55d336f1cec0 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb6659c700 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f1e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb65d9b700 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f25220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:19:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb66d9d700 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1d2e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feb60009bf0 tx=0x7feb60004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5794e4e2828782 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.751+0000 7feb577fe700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb500a1580 0x7feb500a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.752+0000 7feb577fe700 1 -- 172.21.15.8:0/2138104431 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb5c014070 con 0x7feb68100fe0 2023-10-06T23:19:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.752+0000 7feb54ff9700 1 -- 172.21.15.8:0/364891613 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000e040 con 0x55d336f1cec0 2023-10-06T23:19:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.752+0000 7feb6659c700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb500a1580 0x7feb500a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.752+0000 7feb54ff9700 1 -- 172.21.15.8:0/364891613 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb60009400 con 0x55d336f1cec0 2023-10-06T23:19:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.752+0000 7feb54ff9700 1 -- 172.21.15.8:0/364891613 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6001c6a0 con 0x55d336f1cec0 2023-10-06T23:19:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.753+0000 7feb8043db80 1 -- 172.21.15.8:0/364891613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 msgr2=0x55d336f1d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.753+0000 7feb8043db80 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1d2e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feb60009bf0 tx=0x7feb60004de0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.753+0000 7feb6659c700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb500a1580 0x7feb500a3a40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feb68103cd0 tx=0x7feb58009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.753+0000 7feb8043db80 1 -- 172.21.15.8:0/364891613 shutdown_connections 2023-10-06T23:19:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.753+0000 7feb8043db80 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1d2e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.753+0000 7feb8043db80 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f25220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.753+0000 7feb8043db80 1 --2- 172.21.15.8:0/364891613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f1e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.753+0000 7feb8043db80 1 -- 172.21.15.8:0/364891613 >> 172.21.15.8:0/364891613 conn(0x55d336e91200 msgr2=0x55d336f17bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.754+0000 7feb8043db80 1 -- 172.21.15.8:0/364891613 shutdown_connections 2023-10-06T23:19:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.754+0000 7feb8043db80 1 -- 172.21.15.8:0/364891613 wait complete. 2023-10-06T23:19:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.755+0000 7feb8043db80 1 -- start start 2023-10-06T23:19:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.755+0000 7feb8043db80 1 Processor -- start 2023-10-06T23:19:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.755+0000 7feb8043db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1cec0 0x55d336f26b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb8043db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1dfd0 0x55d336f27080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb8043db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1e990 0x55d336f2e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb8043db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336e6fdd0 con 0x55d336f1e990 2023-10-06T23:19:07.757 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb8043db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336e0c6b0 con 0x55d336f1cec0 2023-10-06T23:19:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb8043db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336e0c350 con 0x55d336f1dfd0 2023-10-06T23:19:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb8043db80 10 client.0 _ll_register_callbacks cb 0x55d336c697a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb65d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1dfd0 0x55d336f27080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb65d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1dfd0 0x55d336f27080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:41226/0 (socket says 172.21.15.8:41226) 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb65d9b700 1 -- 172.21.15.8:0/4261168457 learned_addr learned my addr 172.21.15.8:0/4261168457 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb66d9d700 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1e990 0x55d336f2e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.756+0000 7feb6659c700 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1cec0 0x55d336f26b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.757+0000 7feb6659c700 1 -- 172.21.15.8:0/4261168457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1dfd0 msgr2=0x55d336f27080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.757+0000 7feb6659c700 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1dfd0 0x55d336f27080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.757+0000 7feb6659c700 1 -- 172.21.15.8:0/4261168457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1e990 msgr2=0x55d336f2e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.757+0000 7feb6659c700 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1e990 0x55d336f2e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.757+0000 7feb6659c700 1 -- 172.21.15.8:0/4261168457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb68108b80 con 0x55d336f1cec0 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.757+0000 7feb6659c700 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1cec0 0x55d336f26b40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feb58011cb0 tx=0x7feb58004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=decb988295e893f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.757+0000 7feb4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.758+0000 7feb4dffb700 1 -- 172.21.15.8:0/4261168457 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5801dc40 con 0x55d336f1cec0 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.758+0000 7feb4dffb700 1 -- 172.21.15.8:0/4261168457 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb5801dda0 con 0x55d336f1cec0 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.758+0000 7feb8043db80 1 -- 172.21.15.8:0/4261168457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d336e68db0 con 0x55d336f1cec0 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.758+0000 7feb4dffb700 1 -- 172.21.15.8:0/4261168457 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb58005c60 con 0x55d336f1cec0 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.758+0000 7feb8043db80 10 client.25943 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.758+0000 7feb8043db80 1 -- 172.21.15.8:0/4261168457 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d336c83c00 con 0x55d336f1cec0 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb4dffb700 1 -- 172.21.15.8:0/4261168457 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d336e68db0 con 0x55d336f1cec0 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb4dffb700 1 -- 172.21.15.8:0/4261168457 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feb5801b5a0 con 0x55d336f1cec0 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb8043db80 10 client.25943 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb8043db80 10 client.25943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb8043db80 20 client.25943 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb8043db80 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d336f32a10 0x55d336f34e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb8043db80 4 client.25943 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:19:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb8043db80 1 -- 172.21.15.8:0/4261168457 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d336e68ad0 con 0x55d336f32a10 2023-10-06T23:19:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.759+0000 7feb65d9b700 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d336f32a10 0x55d336f34e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.764+0000 7feb65d9b700 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d336f32a10 0x55d336f34e30 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4611626f266a26b server_cookie=405be48720826ca3 in_seq=0 out_seq=0 2023-10-06T23:19:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.766+0000 7feb4dffb700 10 client.25943 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.769+0000 7feb4dffb700 1 -- 172.21.15.8:0/4261168457 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d336e68ad0 con 0x55d336f32a10 2023-10-06T23:19:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.769+0000 7feb4dffb700 10 client.25943 handle_command_reply: tid=0 2023-10-06T23:19:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.769+0000 7feb8043db80 1 client.25943 shutdown 2023-10-06T23:19:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.770+0000 7feb8043db80 1 -- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1cec0 msgr2=0x55d336f26b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.770+0000 7feb8043db80 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1cec0 0x55d336f26b40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feb58011cb0 tx=0x7feb58004750 comp rx=0 tx=0).stop 2023-10-06T23:19:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.770+0000 7feb8043db80 1 -- 172.21.15.8:0/4261168457 shutdown_connections 2023-10-06T23:19:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.770+0000 7feb8043db80 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d336f32a10 0x55d336f34e30 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.771+0000 7feb8043db80 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1e990 0x55d336f2e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.771+0000 7feb8043db80 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1cec0 0x55d336f26b40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.771+0000 7feb8043db80 1 --2- 172.21.15.8:0/4261168457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1dfd0 0x55d336f27080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.771+0000 7feb8043db80 1 -- 172.21.15.8:0/4261168457 >> 172.21.15.8:0/4261168457 conn(0x55d336e91200 msgr2=0x55d336f17250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:07.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.771+0000 7feb4dffb700 0 client.25943 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.771+0000 7feb8043db80 1 -- 172.21.15.8:0/4261168457 shutdown_connections 2023-10-06T23:19:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.772+0000 7feb8043db80 1 -- 172.21.15.8:0/4261168457 wait complete. 2023-10-06T23:19:07.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.772+0000 7feb8043db80 20 client.25943 trim_cache size 0 max 16384 2023-10-06T23:19:07.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.797+0000 7feb8043db80 1 Processor -- start 2023-10-06T23:19:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.797+0000 7feb8043db80 1 -- start start 2023-10-06T23:19:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.797+0000 7feb8043db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.797+0000 7feb8043db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb8043db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f24d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb8043db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336cf08c0 con 0x55d336f1cec0 2023-10-06T23:19:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb8043db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336f2fd50 con 0x55d336f1dfd0 2023-10-06T23:19:07.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb8043db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336f1de20 con 0x55d336f1e990 2023-10-06T23:19:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb6659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb66d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f24d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb6659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58326/0 (socket says 172.21.15.8:58326) 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb6659c700 1 -- 172.21.15.8:0/3938388410 learned_addr learned my addr 172.21.15.8:0/3938388410 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb65d9b700 1 --2- 172.21.15.8:0/3938388410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb6659c700 1 -- 172.21.15.8:0/3938388410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 msgr2=0x55d336f24d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.798+0000 7feb6659c700 1 --2- 172.21.15.8:0/3938388410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f24d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.799+0000 7feb6659c700 1 -- 172.21.15.8:0/3938388410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 msgr2=0x55d336f2e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.799+0000 7feb6659c700 1 --2- 172.21.15.8:0/3938388410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.799+0000 7feb6659c700 1 -- 172.21.15.8:0/3938388410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d336cc11f0 con 0x55d336f1cec0 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.799+0000 7feb6659c700 1 --2- 172.21.15.8:0/3938388410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1e3b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feb58015010 tx=0x7feb58005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412eb71d3f360ed7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.799+0000 7feb557fa700 1 -- 172.21.15.8:0/3938388410 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5801bc40 con 0x55d336f1cec0 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.799+0000 7feb557fa700 1 -- 172.21.15.8:0/3938388410 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb5801bda0 con 0x55d336f1cec0 2023-10-06T23:19:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.799+0000 7feb557fa700 1 -- 172.21.15.8:0/3938388410 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58005280 con 0x55d336f1cec0 2023-10-06T23:19:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.800+0000 7feb8043db80 1 -- 172.21.15.8:0/3938388410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 msgr2=0x55d336f1e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.800+0000 7feb8043db80 1 --2- 172.21.15.8:0/3938388410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1e3b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feb58015010 tx=0x7feb58005c60 comp rx=0 tx=0).stop 2023-10-06T23:19:07.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.801+0000 7feb8043db80 1 -- 172.21.15.8:0/3938388410 shutdown_connections 2023-10-06T23:19:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.801+0000 7feb8043db80 1 --2- 172.21.15.8:0/3938388410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f1e3b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.801+0000 7feb8043db80 1 --2- 172.21.15.8:0/3938388410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f24d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.801+0000 7feb8043db80 1 --2- 172.21.15.8:0/3938388410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.801+0000 7feb8043db80 1 -- 172.21.15.8:0/3938388410 >> 172.21.15.8:0/3938388410 conn(0x55d336e91200 msgr2=0x55d336f2e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.801+0000 7feb8043db80 1 -- 172.21.15.8:0/3938388410 shutdown_connections 2023-10-06T23:19:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.801+0000 7feb8043db80 1 -- 172.21.15.8:0/3938388410 wait complete. 2023-10-06T23:19:07.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.801+0000 7feb8043db80 1 -- start start 2023-10-06T23:19:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.802+0000 7feb8043db80 1 Processor -- start 2023-10-06T23:19:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.802+0000 7feb8043db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f2bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.802+0000 7feb8043db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.802+0000 7feb8043db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f2d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.802+0000 7feb8043db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336f2d6e0 con 0x55d336f1cec0 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.802+0000 7feb8043db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336f2d850 con 0x55d336f1dfd0 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.802+0000 7feb8043db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d336f2da10 con 0x55d336f1e990 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.802+0000 7feb8043db80 10 client.0 _ll_register_callbacks cb 0x7feb58011890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb65d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb6659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f2bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb65d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57552/0 (socket says 172.21.15.8:57552) 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb65d9b700 1 -- 172.21.15.8:0/3006414310 learned_addr learned my addr 172.21.15.8:0/3006414310 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:07.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb66d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f2d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb65d9b700 1 -- 172.21.15.8:0/3006414310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 msgr2=0x55d336f2d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb65d9b700 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f2d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb65d9b700 1 -- 172.21.15.8:0/3006414310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 msgr2=0x55d336f2bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb65d9b700 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f2bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.803+0000 7feb65d9b700 1 -- 172.21.15.8:0/3006414310 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d336c83c00 con 0x55d336f1dfd0 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.804+0000 7feb65d9b700 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2c190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0969d0 tx=0x7feb5c00c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87f219a2af1be776 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.804+0000 7feb4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.804+0000 7feb4dffb700 1 -- 172.21.15.8:0/3006414310 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c09a660 con 0x55d336f1dfd0 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.804+0000 7feb8043db80 1 -- 172.21.15.8:0/3006414310 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d336f0fd50 con 0x55d336f1dfd0 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.804+0000 7feb4dffb700 1 -- 172.21.15.8:0/3006414310 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb5c0cce40 con 0x55d336f1dfd0 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.804+0000 7feb4dffb700 1 -- 172.21.15.8:0/3006414310 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb5c099f60 con 0x55d336f1dfd0 2023-10-06T23:19:07.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.804+0000 7feb8043db80 10 client.25949 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.804+0000 7feb8043db80 1 -- 172.21.15.8:0/3006414310 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d336c99250 con 0x55d336f1dfd0 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.805+0000 7feb4dffb700 1 -- 172.21.15.8:0/3006414310 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb5c0b8030 con 0x55d336f1dfd0 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.805+0000 7feb4dffb700 1 -- 172.21.15.8:0/3006414310 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feb5c099450 con 0x55d336f1dfd0 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.805+0000 7feb8043db80 10 client.25949 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.805+0000 7feb8043db80 10 client.25949 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.805+0000 7feb8043db80 20 client.25949 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.805+0000 7feb8043db80 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d336f87690 0x55d336f89af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.805+0000 7feb8043db80 4 client.25949 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.805+0000 7feb8043db80 1 -- 172.21.15.8:0/3006414310 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d336cbbf10 con 0x55d336f87690 2023-10-06T23:19:07.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.806+0000 7feb6659c700 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d336f87690 0x55d336f89af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.806+0000 7feb6659c700 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d336f87690 0x55d336f89af0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb2849d3b76fa08 server_cookie=3a0109cfcc5304ec in_seq=0 out_seq=0 2023-10-06T23:19:07.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.806+0000 7feb4dffb700 10 client.25949 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb4dffb700 1 -- 172.21.15.8:0/3006414310 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d336cbbf10 con 0x55d336f87690 2023-10-06T23:19:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb4dffb700 10 client.25949 handle_command_reply: tid=0 2023-10-06T23:19:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 client.25949 shutdown 2023-10-06T23:19:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 -- 172.21.15.8:0/3006414310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 msgr2=0x55d336f2c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2c190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0969d0 tx=0x7feb5c00c6e0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 -- 172.21.15.8:0/3006414310 shutdown_connections 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d336f87690 0x55d336f89af0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d336f1cec0 0x55d336f2bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d336f1e990 0x55d336f2d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 --2- 172.21.15.8:0/3006414310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d336f1dfd0 0x55d336f2c190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb4dffb700 0 client.25949 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.823+0000 7feb8043db80 1 -- 172.21.15.8:0/3006414310 >> 172.21.15.8:0/3006414310 conn(0x55d336e91200 msgr2=0x55d336f24d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.824+0000 7feb8043db80 1 -- 172.21.15.8:0/3006414310 shutdown_connections 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.824+0000 7feb8043db80 1 -- 172.21.15.8:0/3006414310 wait complete. 2023-10-06T23:19:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.824+0000 7feb8043db80 20 client.25949 trim_cache size 0 max 16384 2023-10-06T23:19:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:19:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:19:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:19:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:19:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.824+0000 7feb6cbff700 1 -- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb500a1580 msgr2=0x7feb500a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.824+0000 7feb6cbff700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb500a1580 0x7feb500a3a40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feb68103cd0 tx=0x7feb58009260 comp rx=0 tx=0).stop 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.824+0000 7feb6cbff700 1 -- 172.21.15.8:0/2138104431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb68100fe0 msgr2=0x7feb68102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.824+0000 7feb6cbff700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb68100fe0 0x7feb68102900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00e9f0 tx=0x7feb5c00ed00 comp rx=0 tx=0).stop 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.825+0000 7feb6cbff700 1 -- 172.21.15.8:0/2138104431 shutdown_connections 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.825+0000 7feb6cbff700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feb500a1580 0x7feb500a3a40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.825+0000 7feb6cbff700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb680ffdf0 0x7feb681023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.825+0000 7feb6cbff700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb68101980 0x7feb68102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.825+0000 7feb6cbff700 1 --2- 172.21.15.8:0/2138104431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb68100fe0 0x7feb68102900 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.825+0000 7feb6cbff700 1 -- 172.21.15.8:0/2138104431 >> 172.21.15.8:0/2138104431 conn(0x7feb680fb340 msgr2=0x7feb680fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.825+0000 7feb6cbff700 1 -- 172.21.15.8:0/2138104431 shutdown_connections 2023-10-06T23:19:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:07.825+0000 7feb6cbff700 1 -- 172.21.15.8:0/2138104431 wait complete. 2023-10-06T23:19:08.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:08 smithi190 ceph-mon[102658]: pgmap v537: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2023-10-06T23:19:08.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:08 smithi008 ceph-mon[98532]: pgmap v537: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2023-10-06T23:19:08.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:08 smithi156 ceph-mon[102862]: pgmap v537: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 5.0 MiB/s wr, 487 op/s 2023-10-06T23:19:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 255.0 s, 247.8 tps, lat 404.946 ms stddev 68.983 2023-10-06T23:19:09.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:09 smithi008 ceph-mon[98532]: pgmap v538: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 5.7 MiB/s wr, 538 op/s 2023-10-06T23:19:09.427 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:09 smithi190 ceph-mon[102658]: pgmap v538: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 5.7 MiB/s wr, 538 op/s 2023-10-06T23:19:09.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:09 smithi156 ceph-mon[102862]: pgmap v538: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 5.7 MiB/s wr, 538 op/s 2023-10-06T23:19:12.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:12 smithi008 ceph-mon[98532]: pgmap v539: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 5.0 MiB/s wr, 489 op/s 2023-10-06T23:19:12.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:12 smithi190 ceph-mon[102658]: pgmap v539: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 5.0 MiB/s wr, 489 op/s 2023-10-06T23:19:12.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:12 smithi156 ceph-mon[102862]: pgmap v539: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 5.0 MiB/s wr, 489 op/s 2023-10-06T23:19:13.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:13 smithi008 ceph-mon[98532]: pgmap v540: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.7 MiB/s wr, 433 op/s 2023-10-06T23:19:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:13 smithi190 ceph-mon[102658]: pgmap v540: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.7 MiB/s wr, 433 op/s 2023-10-06T23:19:13.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:13 smithi156 ceph-mon[102862]: pgmap v540: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.7 MiB/s wr, 433 op/s 2023-10-06T23:19:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 260.0 s, 244.8 tps, lat 406.426 ms stddev 71.470 2023-10-06T23:19:16.343 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:19:16.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:16 smithi008 ceph-mon[98532]: pgmap v541: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2023-10-06T23:19:16.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:16 smithi190 ceph-mon[102658]: pgmap v541: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2023-10-06T23:19:16.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:16 smithi156 ceph-mon[102862]: pgmap v541: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2023-10-06T23:19:16.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/639222942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a240ff730 msgr2=0x7f3a24101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/639222942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a240ff730 0x7f3a24101b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009990 tx=0x7f3a20009ca0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/639222942 shutdown_connections 2023-10-06T23:19:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/639222942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a24104a70 0x7f3a24104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/639222942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a240ff730 0x7f3a24101b60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/639222942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a241020a0 0x7f3a24104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/639222942 >> 172.21.15.8:0/639222942 conn(0x7f3a240fb330 msgr2=0x7f3a240fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/639222942 shutdown_connections 2023-10-06T23:19:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.650+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/639222942 wait complete. 2023-10-06T23:19:16.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.652+0000 7f3a2c7ff700 1 Processor -- start 2023-10-06T23:19:16.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.652+0000 7f3a2c7ff700 1 -- start start 2023-10-06T23:19:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.652+0000 7f3a2c7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240ff730 0x7f3a2419d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.652+0000 7f3a2c7ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a241020a0 0x7f3a2419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.652+0000 7f3a2c7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a24104a70 0x7f3a241a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a2c7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a241a4cb0 con 0x7f3a240ff730 2023-10-06T23:19:16.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a2c7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a241a4df0 con 0x7f3a24104a70 2023-10-06T23:19:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a2c7ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a241a4f80 con 0x7f3a241020a0 2023-10-06T23:19:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a241020a0 0x7f3a2419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a241020a0 0x7f3a2419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47314/0 (socket says 172.21.15.8:47314) 2023-10-06T23:19:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a29d9a700 1 -- 172.21.15.8:0/3292428298 learned_addr learned my addr 172.21.15.8:0/3292428298 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a2ad9c700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a24104a70 0x7f3a241a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240ff730 0x7f3a2419d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a29d9a700 1 -- 172.21.15.8:0/3292428298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a24104a70 msgr2=0x7f3a241a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a24104a70 0x7f3a241a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a29d9a700 1 -- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240ff730 msgr2=0x7f3a2419d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240ff730 0x7f3a2419d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.653+0000 7f3a29d9a700 1 -- 172.21.15.8:0/3292428298 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200095f0 con 0x7f3a241020a0 2023-10-06T23:19:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.654+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a241020a0 0x7f3a2419d670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400e9a0 tx=0x7f3a1400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.654+0000 7f3a1b7fe700 1 -- 172.21.15.8:0/3292428298 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14009790 con 0x7f3a241020a0 2023-10-06T23:19:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.654+0000 7f3a1b7fe700 1 -- 172.21.15.8:0/3292428298 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a14010430 con 0x7f3a241020a0 2023-10-06T23:19:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.654+0000 7f3a1b7fe700 1 -- 172.21.15.8:0/3292428298 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400cea0 con 0x7f3a241020a0 2023-10-06T23:19:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.654+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/3292428298 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a241a5260 con 0x7f3a241020a0 2023-10-06T23:19:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.655+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/3292428298 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a241a5770 con 0x7f3a241020a0 2023-10-06T23:19:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.659+0000 7f3a1b7fe700 1 -- 172.21.15.8:0/3292428298 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3a140105a0 con 0x7f3a241020a0 2023-10-06T23:19:16.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.661+0000 7f3a4003fb80 1 Processor -- start 2023-10-06T23:19:16.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.661+0000 7f3a1b7fe700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a100a1550 0x7f3a100a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.661+0000 7f3a4003fb80 1 -- start start 2023-10-06T23:19:16.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.661+0000 7f3a1b7fe700 1 -- 172.21.15.8:0/3292428298 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3a14014070 con 0x7f3a241020a0 2023-10-06T23:19:16.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997bfbc0 0x55e5997c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997c0a60 0x55e5997c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e599727460 con 0x55e5997c0a60 2023-10-06T23:19:16.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e599718c20 con 0x55e5997bf260 2023-10-06T23:19:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e599716540 con 0x55e5997bfbc0 2023-10-06T23:19:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a2ad9c700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a100a1550 0x7f3a100a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a2a59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997bfbc0 0x55e5997c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997bfbc0 0x55e5997c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47328/0 (socket says 172.21.15.8:47328) 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.662+0000 7f3a29d9a700 1 -- 172.21.15.8:0/573778867 learned_addr learned my addr 172.21.15.8:0/573778867 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a29d9a700 1 -- 172.21.15.8:0/573778867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 msgr2=0x55e5997bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997bf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a2ad9c700 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997c0a60 0x55e5997c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a29d9a700 1 -- 172.21.15.8:0/573778867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997c0a60 msgr2=0x55e5997c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997c0a60 0x55e5997c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a29d9a700 1 -- 172.21.15.8:0/573778867 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e59953cde0 con 0x55e5997bfbc0 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a2ad9c700 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997c0a60 0x55e5997c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a2ad9c700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a100a1550 0x7f3a100a3a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00f6b0 tx=0x7f3a1c00fa70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.663+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997bfbc0 0x55e5997c0480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a14099e40 tx=0x7f3a14099b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eede58475375e253 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:16.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.664+0000 7f3a18ff9700 1 -- 172.21.15.8:0/573778867 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1409a140 con 0x55e5997bfbc0 2023-10-06T23:19:16.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.664+0000 7f3a18ff9700 1 -- 172.21.15.8:0/573778867 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a1409e290 con 0x55e5997bfbc0 2023-10-06T23:19:16.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.664+0000 7f3a18ff9700 1 -- 172.21.15.8:0/573778867 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a140a2040 con 0x55e5997bfbc0 2023-10-06T23:19:16.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.665+0000 7f3a4003fb80 1 -- 172.21.15.8:0/573778867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997bfbc0 msgr2=0x55e5997c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.665+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997bfbc0 0x55e5997c0480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a14099e40 tx=0x7f3a14099b20 comp rx=0 tx=0).stop 2023-10-06T23:19:16.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.665+0000 7f3a4003fb80 1 -- 172.21.15.8:0/573778867 shutdown_connections 2023-10-06T23:19:16.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.665+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997c0a60 0x55e5997c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.665+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.665+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/573778867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997bfbc0 0x55e5997c0480 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.665+0000 7f3a4003fb80 1 -- 172.21.15.8:0/573778867 >> 172.21.15.8:0/573778867 conn(0x55e599733260 msgr2=0x55e5997ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:16.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.665+0000 7f3a4003fb80 1 -- 172.21.15.8:0/573778867 shutdown_connections 2023-10-06T23:19:16.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.666+0000 7f3a4003fb80 1 -- 172.21.15.8:0/573778867 wait complete. 2023-10-06T23:19:16.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.666+0000 7f3a4003fb80 1 -- start start 2023-10-06T23:19:16.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.667+0000 7f3a4003fb80 1 Processor -- start 2023-10-06T23:19:16.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.668+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.668+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.668+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.668+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e599711e30 con 0x55e5997bfbc0 2023-10-06T23:19:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.668+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5996ae710 con 0x55e5997bf260 2023-10-06T23:19:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.668+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5996ae3b0 con 0x55e5997c0a60 2023-10-06T23:19:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.668+0000 7f3a4003fb80 10 client.0 _ll_register_callbacks cb 0x55e59950b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.669+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.669+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53012/0 (socket says 172.21.15.8:53012) 2023-10-06T23:19:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.669+0000 7f3a29d9a700 1 -- 172.21.15.8:0/862043213 learned_addr learned my addr 172.21.15.8:0/862043213 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.669+0000 7f3a2ad9c700 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.669+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.670+0000 7f3a29d9a700 1 -- 172.21.15.8:0/862043213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 msgr2=0x55e5997d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.670+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.670+0000 7f3a29d9a700 1 -- 172.21.15.8:0/862043213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 msgr2=0x55e5997c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.670+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.670+0000 7f3a29d9a700 1 -- 172.21.15.8:0/862043213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a241a5770 con 0x55e5997bfbc0 2023-10-06T23:19:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.670+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997c95f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3a14096bb0 tx=0x7f3a1409e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdda8e2357eca468 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.674+0000 7f3a0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:19:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.674+0000 7f3a0dffb700 1 -- 172.21.15.8:0/862043213 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1409a140 con 0x55e5997bfbc0 2023-10-06T23:19:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.674+0000 7f3a0dffb700 1 -- 172.21.15.8:0/862043213 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3a140b82c0 con 0x55e5997bfbc0 2023-10-06T23:19:16.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.675+0000 7f3a4003fb80 1 -- 172.21.15.8:0/862043213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5997b1f10 con 0x55e5997bfbc0 2023-10-06T23:19:16.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.676+0000 7f3a0dffb700 1 -- 172.21.15.8:0/862043213 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a1407c030 con 0x55e5997bfbc0 2023-10-06T23:19:16.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.676+0000 7f3a4003fb80 10 client.16119 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:16.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.676+0000 7f3a4003fb80 1 -- 172.21.15.8:0/862043213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55e599525c60 con 0x55e5997bfbc0 2023-10-06T23:19:16.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a0dffb700 1 -- 172.21.15.8:0/862043213 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e5997b1f10 con 0x55e5997bfbc0 2023-10-06T23:19:16.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a0dffb700 1 -- 172.21.15.8:0/862043213 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a14099170 con 0x55e5997bfbc0 2023-10-06T23:19:16.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a4003fb80 10 client.16119 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:16.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a4003fb80 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:16.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a4003fb80 20 client.16119 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:16.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e5997e5a30 0x55e5997e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a4003fb80 4 client.16119 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:19:16.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a4003fb80 1 -- 172.21.15.8:0/862043213 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e59970ae10 con 0x55e5997e5a30 2023-10-06T23:19:16.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.677+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e5997e5a30 0x55e5997e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.678+0000 7f3a0dffb700 10 client.16119 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.678+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e5997e5a30 0x55e5997e7e20 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa48eb27896bebc7 server_cookie=adb4c150b52ed223 in_seq=0 out_seq=0 2023-10-06T23:19:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.679+0000 7f3a0dffb700 1 -- 172.21.15.8:0/862043213 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e59970ae10 con 0x55e5997e5a30 2023-10-06T23:19:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.679+0000 7f3a0dffb700 10 client.16119 handle_command_reply: tid=0 2023-10-06T23:19:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.679+0000 7f3a4003fb80 1 client.16119 shutdown 2023-10-06T23:19:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.679+0000 7f3a4003fb80 1 -- 172.21.15.8:0/862043213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 msgr2=0x55e5997c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.679+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997c95f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3a14096bb0 tx=0x7f3a1409e120 comp rx=0 tx=0).stop 2023-10-06T23:19:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.679+0000 7f3a4003fb80 1 -- 172.21.15.8:0/862043213 shutdown_connections 2023-10-06T23:19:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.679+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e5997e5a30 0x55e5997e7e20 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.680+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.680+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.680+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/862043213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997c95f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.680+0000 7f3a0dffb700 0 client.16119 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.680+0000 7f3a4003fb80 1 -- 172.21.15.8:0/862043213 >> 172.21.15.8:0/862043213 conn(0x55e599733260 msgr2=0x55e5997b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.680+0000 7f3a4003fb80 1 -- 172.21.15.8:0/862043213 shutdown_connections 2023-10-06T23:19:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.680+0000 7f3a4003fb80 1 -- 172.21.15.8:0/862043213 wait complete. 2023-10-06T23:19:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.680+0000 7f3a4003fb80 20 client.16119 trim_cache size 0 max 16384 2023-10-06T23:19:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.710+0000 7f3a4003fb80 1 Processor -- start 2023-10-06T23:19:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.710+0000 7f3a4003fb80 1 -- start start 2023-10-06T23:19:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.710+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bf260 0x55e5997c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.710+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bfbc0 0x55e5997d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.710+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.710+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e599592920 con 0x55e5997bf260 2023-10-06T23:19:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.710+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e59970ae10 con 0x55e5997bfbc0 2023-10-06T23:19:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.710+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5997b4570 con 0x55e5997c0a60 2023-10-06T23:19:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.711+0000 7f3a2a59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bf260 0x55e5997c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.711+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bfbc0 0x55e5997d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.711+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bfbc0 0x55e5997d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41836/0 (socket says 172.21.15.8:41836) 2023-10-06T23:19:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.711+0000 7f3a29d9a700 1 -- 172.21.15.8:0/2563442679 learned_addr learned my addr 172.21.15.8:0/2563442679 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.711+0000 7f3a2ad9c700 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.711+0000 7f3a2a59b700 1 -- 172.21.15.8:0/2563442679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 msgr2=0x55e5997c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:16.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.711+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.712+0000 7f3a2a59b700 1 -- 172.21.15.8:0/2563442679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bfbc0 msgr2=0x55e5997d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:16.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.712+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bfbc0 0x55e5997d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.712+0000 7f3a2a59b700 1 -- 172.21.15.8:0/2563442679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e599563250 con 0x55e5997bf260 2023-10-06T23:19:16.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.712+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bfbc0 0x55e5997d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:16.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.712+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bf260 0x55e5997c3a10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55e5997e8730 tx=0x7f3a20005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33210e69b1eedebd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:16.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.712+0000 7f3a197fa700 1 -- 172.21.15.8:0/2563442679 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2001d040 con 0x55e5997bf260 2023-10-06T23:19:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.712+0000 7f3a197fa700 1 -- 172.21.15.8:0/2563442679 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a2001e040 con 0x55e5997bf260 2023-10-06T23:19:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.713+0000 7f3a197fa700 1 -- 172.21.15.8:0/2563442679 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20003a60 con 0x55e5997bf260 2023-10-06T23:19:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.713+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2563442679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bf260 msgr2=0x55e5997c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.713+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bf260 0x55e5997c3a10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55e5997e8730 tx=0x7f3a20005fd0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.714+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2563442679 shutdown_connections 2023-10-06T23:19:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.714+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bf260 0x55e5997c3a10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.714+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.714+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2563442679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bfbc0 0x55e5997d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.714+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2563442679 >> 172.21.15.8:0/2563442679 conn(0x55e599733260 msgr2=0x55e5997e1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.714+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2563442679 shutdown_connections 2023-10-06T23:19:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.714+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2563442679 wait complete. 2023-10-06T23:19:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.714+0000 7f3a4003fb80 1 -- start start 2023-10-06T23:19:16.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.715+0000 7f3a4003fb80 1 Processor -- start 2023-10-06T23:19:16.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.715+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a4003fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5997cf270 con 0x55e5997bfbc0 2023-10-06T23:19:16.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5997cf3e0 con 0x55e5997bf260 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a4003fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5997cf5a0 con 0x55e5997c0a60 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a4003fb80 10 client.0 _ll_register_callbacks cb 0x55e59950b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a2a59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a29d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a2a59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41850/0 (socket says 172.21.15.8:41850) 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a2a59b700 1 -- 172.21.15.8:0/2928677080 learned_addr learned my addr 172.21.15.8:0/2928677080 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.716+0000 7f3a2ad9c700 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.717+0000 7f3a2a59b700 1 -- 172.21.15.8:0/2928677080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 msgr2=0x55e5997ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.717+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.717+0000 7f3a2a59b700 1 -- 172.21.15.8:0/2928677080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 msgr2=0x55e5997ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.717+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.717+0000 7f3a2a59b700 1 -- 172.21.15.8:0/2928677080 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e599525c60 con 0x55e5997bf260 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.717+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.717+0000 7f3a2a59b700 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997d01e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a2002c040 tx=0x7f3a20005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33483efacb1d5d75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.717+0000 7f3a0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.718+0000 7f3a0dffb700 1 -- 172.21.15.8:0/2928677080 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2001d070 con 0x55e5997bf260 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.718+0000 7f3a0dffb700 1 -- 172.21.15.8:0/2928677080 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3a20029150 con 0x55e5997bf260 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.718+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2928677080 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a1409e290 con 0x55e5997bf260 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.718+0000 7f3a0dffb700 1 -- 172.21.15.8:0/2928677080 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a20029310 con 0x55e5997bf260 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.718+0000 7f3a4003fb80 10 client.25967 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.718+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2928677080 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f3a24105a20 con 0x55e5997bf260 2023-10-06T23:19:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.719+0000 7f3a0dffb700 1 -- 172.21.15.8:0/2928677080 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a1409e290 con 0x55e5997bf260 2023-10-06T23:19:16.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.719+0000 7f3a0dffb700 1 -- 172.21.15.8:0/2928677080 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a2003a070 con 0x55e5997bf260 2023-10-06T23:19:16.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.720+0000 7f3a4003fb80 10 client.25967 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:16.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.720+0000 7f3a4003fb80 10 client.25967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:16.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.720+0000 7f3a4003fb80 20 client.25967 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:16.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.720+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e59983a980 0x55e59983cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:16.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.720+0000 7f3a4003fb80 4 client.25967 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.720+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2928677080 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e59970ab30 con 0x55e59983a980 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.720+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e59983a980 0x55e59983cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a0dffb700 10 client.25967 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a29d9a700 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e59983a980 0x55e59983cda0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=649c37f905d0975 server_cookie=bbb59353ace36004 in_seq=0 out_seq=0 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a0dffb700 1 -- 172.21.15.8:0/2928677080 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55e59970ab30 con 0x55e59983a980 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a0dffb700 10 client.25967 handle_command_reply: tid=0 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a4003fb80 1 client.25967 shutdown 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2928677080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 msgr2=0x55e5997d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997d01e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a2002c040 tx=0x7f3a20005c50 comp rx=0 tx=0).stop 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2928677080 shutdown_connections 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e59983a980 0x55e59983cda0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.721+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e5997c0a60 0x55e5997ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.722+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5997bf260 0x55e5997d01e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.722+0000 7f3a4003fb80 1 --2- 172.21.15.8:0/2928677080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e5997bfbc0 0x55e5997ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.722+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2928677080 >> 172.21.15.8:0/2928677080 conn(0x55e599733260 msgr2=0x55e5997c3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.722+0000 7f3a0dffb700 0 client.25967 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.722+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2928677080 shutdown_connections 2023-10-06T23:19:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.722+0000 7f3a4003fb80 1 -- 172.21.15.8:0/2928677080 wait complete. 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.722+0000 7f3a4003fb80 20 client.25967 trim_cache size 0 max 16384 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:19:16.727 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:19:16.728 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:19:16.728 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:19:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a100a1550 msgr2=0x7f3a100a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a100a1550 0x7f3a100a3a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00f6b0 tx=0x7f3a1c00fa70 comp rx=0 tx=0).stop 2023-10-06T23:19:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/3292428298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a241020a0 msgr2=0x7f3a2419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a241020a0 0x7f3a2419d670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400e9a0 tx=0x7f3a1400ecb0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/3292428298 shutdown_connections 2023-10-06T23:19:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3a100a1550 0x7f3a100a3a10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240ff730 0x7f3a2419d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a24104a70 0x7f3a241a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 --2- 172.21.15.8:0/3292428298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a241020a0 0x7f3a2419d670 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/3292428298 >> 172.21.15.8:0/3292428298 conn(0x7f3a240fb330 msgr2=0x7f3a24102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.723+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/3292428298 shutdown_connections 2023-10-06T23:19:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:16.724+0000 7f3a2c7ff700 1 -- 172.21.15.8:0/3292428298 wait complete. 2023-10-06T23:19:16.749 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:19:18.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:18 smithi008 ceph-mon[98532]: pgmap v542: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 3.8 MiB/s wr, 489 op/s 2023-10-06T23:19:18.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:18 smithi190 ceph-mon[102658]: pgmap v542: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 3.8 MiB/s wr, 489 op/s 2023-10-06T23:19:18.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:18 smithi156 ceph-mon[102862]: pgmap v542: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 3.8 MiB/s wr, 489 op/s 2023-10-06T23:19:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 265.0 s, 251.8 tps, lat 398.545 ms stddev 89.666 2023-10-06T23:19:19.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:19 smithi008 ceph-mon[98532]: pgmap v543: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 3.9 MiB/s wr, 496 op/s 2023-10-06T23:19:19.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:19 smithi190 ceph-mon[102658]: pgmap v543: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 3.9 MiB/s wr, 496 op/s 2023-10-06T23:19:19.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:19 smithi156 ceph-mon[102862]: pgmap v543: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 3.9 MiB/s wr, 496 op/s 2023-10-06T23:19:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/4118906522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c74101970 msgr2=0x7f6c74103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/4118906522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c74101970 0x7f6c74103d60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009990 tx=0x7f6c70009ca0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/4118906522 shutdown_connections 2023-10-06T23:19:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/4118906522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c74106bd0 0x7f6c74109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/4118906522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c74101970 0x7f6c74103d60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/4118906522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c741042a0 0x7f6c74106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/4118906522 >> 172.21.15.8:0/4118906522 conn(0x7f6c740fb340 msgr2=0x7f6c740fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/4118906522 shutdown_connections 2023-10-06T23:19:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.028+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/4118906522 wait complete. 2023-10-06T23:19:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.030+0000 7f6c7c7ff700 1 Processor -- start 2023-10-06T23:19:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.030+0000 7f6c7c7ff700 1 -- start start 2023-10-06T23:19:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7c7ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c74101970 0x7f6c74196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7c7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c741042a0 0x7f6c74197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7c7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c74106bd0 0x7f6c74197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7c7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74198610 con 0x7f6c74106bd0 2023-10-06T23:19:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7c7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74198780 con 0x7f6c741042a0 2023-10-06T23:19:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7c7ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74198940 con 0x7f6c74101970 2023-10-06T23:19:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7a59b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c74101970 0x7f6c74196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7a59b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c74101970 0x7f6c74196bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47148/0 (socket says 172.21.15.8:47148) 2023-10-06T23:19:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7a59b700 1 -- 172.21.15.8:0/768362057 learned_addr learned my addr 172.21.15.8:0/768362057 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c741042a0 0x7f6c74197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.031+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c74106bd0 0x7f6c74197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c7a59b700 1 -- 172.21.15.8:0/768362057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c741042a0 msgr2=0x7f6c74197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c7a59b700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c741042a0 0x7f6c74197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c7a59b700 1 -- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c74106bd0 msgr2=0x7f6c74197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c7a59b700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c74106bd0 0x7f6c74197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c7a59b700 1 -- 172.21.15.8:0/768362057 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c700095f0 con 0x7f6c74101970 2023-10-06T23:19:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c7a59b700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c74101970 0x7f6c74196bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c70005910 tx=0x7f6c70005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c6b7fe700 1 -- 172.21.15.8:0/768362057 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7001d070 con 0x7f6c74101970 2023-10-06T23:19:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c6b7fe700 1 -- 172.21.15.8:0/768362057 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c7000be70 con 0x7f6c74101970 2023-10-06T23:19:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.032+0000 7f6c6b7fe700 1 -- 172.21.15.8:0/768362057 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70022e60 con 0x7f6c74101970 2023-10-06T23:19:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.033+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/768362057 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c74198bc0 con 0x7f6c74101970 2023-10-06T23:19:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.033+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/768362057 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c740ff940 con 0x7f6c74101970 2023-10-06T23:19:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.039+0000 7f6c6b7fe700 1 -- 172.21.15.8:0/768362057 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6c70022600 con 0x7f6c74101970 2023-10-06T23:19:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.040+0000 7f6c9008bb80 1 Processor -- start 2023-10-06T23:19:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.040+0000 7f6c9008bb80 1 -- start start 2023-10-06T23:19:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.040+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884aec0 0x55f3e884b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.040+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e884c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.040+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e8853220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.040+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e87b3400 con 0x55f3e884c990 2023-10-06T23:19:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.040+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e87a4bc0 con 0x55f3e884bfd0 2023-10-06T23:19:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.040+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e87a24e0 con 0x55f3e884aec0 2023-10-06T23:19:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.041+0000 7f6c7ad9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884aec0 0x55f3e884b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.041+0000 7f6c7ad9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884aec0 0x55f3e884b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47164/0 (socket says 172.21.15.8:47164) 2023-10-06T23:19:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.041+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/522813251 learned_addr learned my addr 172.21.15.8:0/522813251 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.041+0000 7f6c7a59b700 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e884c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.041+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e8853220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/522813251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 msgr2=0x55f3e884c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e884c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/522813251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 msgr2=0x55f3e8853220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e8853220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/522813251 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3e85c8d80 con 0x55f3e884aec0 2023-10-06T23:19:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884aec0 0x55f3e884b2e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c011680 tx=0x7f6c6c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5122256aed05ebc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c6b7fe700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c600a1500 0x7f6c600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c6b7fe700 1 -- 172.21.15.8:0/768362057 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c700ce140 con 0x7f6c74101970 2023-10-06T23:19:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.042+0000 7f6c68ff9700 1 -- 172.21.15.8:0/522813251 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00e040 con 0x55f3e884aec0 2023-10-06T23:19:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.043+0000 7f6c68ff9700 1 -- 172.21.15.8:0/522813251 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c00f040 con 0x55f3e884aec0 2023-10-06T23:19:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.043+0000 7f6c68ff9700 1 -- 172.21.15.8:0/522813251 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0046e0 con 0x55f3e884aec0 2023-10-06T23:19:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.043+0000 7f6c7a59b700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c600a1500 0x7f6c600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.043+0000 7f6c9008bb80 1 -- 172.21.15.8:0/522813251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884aec0 msgr2=0x55f3e884b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.043+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884aec0 0x55f3e884b2e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c011680 tx=0x7f6c6c009920 comp rx=0 tx=0).stop 2023-10-06T23:19:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.044+0000 7f6c9008bb80 1 -- 172.21.15.8:0/522813251 shutdown_connections 2023-10-06T23:19:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.044+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e8853220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.044+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884aec0 0x55f3e884b2e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.044+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/522813251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e884c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.044+0000 7f6c9008bb80 1 -- 172.21.15.8:0/522813251 >> 172.21.15.8:0/522813251 conn(0x55f3e87bf200 msgr2=0x55f3e8845bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.044+0000 7f6c7a59b700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c600a1500 0x7f6c600a39c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6c7009b430 tx=0x7f6c700d1ac0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.044+0000 7f6c9008bb80 1 -- 172.21.15.8:0/522813251 shutdown_connections 2023-10-06T23:19:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.044+0000 7f6c9008bb80 1 -- 172.21.15.8:0/522813251 wait complete. 2023-10-06T23:19:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.045+0000 7f6c9008bb80 1 -- start start 2023-10-06T23:19:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.045+0000 7f6c9008bb80 1 Processor -- start 2023-10-06T23:19:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8854c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e8855160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e885c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e879ddd0 con 0x55f3e884c990 2023-10-06T23:19:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e873a6b0 con 0x55f3e884aec0 2023-10-06T23:19:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e873a350 con 0x55f3e884bfd0 2023-10-06T23:19:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c9008bb80 10 client.0 _ll_register_callbacks cb 0x55f3e85977a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c7ad9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8854c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c79d9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e8855160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c79d9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e8855160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47180/0 (socket says 172.21.15.8:47180) 2023-10-06T23:19:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.046+0000 7f6c79d9a700 1 -- 172.21.15.8:0/2607222234 learned_addr learned my addr 172.21.15.8:0/2607222234 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.047+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e885c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.047+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/2607222234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 msgr2=0x55f3e8855160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.047+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e8855160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.047+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/2607222234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 msgr2=0x55f3e885c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.047+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e885c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.047+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/2607222234 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c011330 con 0x55f3e884aec0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.047+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8854c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c011680 tx=0x7f6c6c006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c62e473cf7dc44d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.047+0000 7f6c5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.048+0000 7f6c5dffb700 1 -- 172.21.15.8:0/2607222234 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00e040 con 0x55f3e884aec0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.048+0000 7f6c9008bb80 1 -- 172.21.15.8:0/2607222234 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3e883dd50 con 0x55f3e884aec0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.048+0000 7f6c5dffb700 1 -- 172.21.15.8:0/2607222234 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c6c003e40 con 0x55f3e884aec0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.048+0000 7f6c5dffb700 1 -- 172.21.15.8:0/2607222234 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c6c007500 con 0x55f3e884aec0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.048+0000 7f6c9008bb80 10 client.25979 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.048+0000 7f6c9008bb80 1 -- 172.21.15.8:0/2607222234 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55f3e85b1c00 con 0x55f3e884aec0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.049+0000 7f6c5dffb700 1 -- 172.21.15.8:0/2607222234 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3e883dd50 con 0x55f3e884aec0 2023-10-06T23:19:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.049+0000 7f6c5dffb700 1 -- 172.21.15.8:0/2607222234 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c6c015450 con 0x55f3e884aec0 2023-10-06T23:19:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.049+0000 7f6c9008bb80 10 client.25979 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.049+0000 7f6c9008bb80 10 client.25979 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.049+0000 7f6c9008bb80 20 client.25979 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.049+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f3e8869190 0x55f3e886b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.049+0000 7f6c9008bb80 4 client.25979 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:19:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.049+0000 7f6c9008bb80 1 -- 172.21.15.8:0/2607222234 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3e8796db0 con 0x55f3e8869190 2023-10-06T23:19:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.050+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f3e8869190 0x55f3e886b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.050+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f3e8869190 0x55f3e886b5b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7444dc4ed8e19b7 server_cookie=bda68f280d69eaef in_seq=0 out_seq=0 2023-10-06T23:19:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.050+0000 7f6c5dffb700 10 client.25979 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.051+0000 7f6c5dffb700 1 -- 172.21.15.8:0/2607222234 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f3e8796db0 con 0x55f3e8869190 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.051+0000 7f6c5dffb700 10 client.25979 handle_command_reply: tid=0 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.051+0000 7f6c9008bb80 1 client.25979 shutdown 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 -- 172.21.15.8:0/2607222234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 msgr2=0x55f3e8854c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8854c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c011680 tx=0x7f6c6c006000 comp rx=0 tx=0).stop 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 -- 172.21.15.8:0/2607222234 shutdown_connections 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f3e8869190 0x55f3e886b5b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e885c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8854c20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/2607222234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e8855160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 -- 172.21.15.8:0/2607222234 >> 172.21.15.8:0/2607222234 conn(0x55f3e87bf200 msgr2=0x55f3e8845250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c5dffb700 0 client.25979 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 -- 172.21.15.8:0/2607222234 shutdown_connections 2023-10-06T23:19:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.052+0000 7f6c9008bb80 1 -- 172.21.15.8:0/2607222234 wait complete. 2023-10-06T23:19:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.053+0000 7f6c9008bb80 20 client.25979 trim_cache size 0 max 16384 2023-10-06T23:19:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.078+0000 7f6c9008bb80 1 Processor -- start 2023-10-06T23:19:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.078+0000 7f6c9008bb80 1 -- start start 2023-10-06T23:19:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884aec0 0x55f3e88538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e885c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884c990 0x55f3e885c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e861e8c0 con 0x55f3e884aec0 2023-10-06T23:19:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e88540d0 con 0x55f3e884bfd0 2023-10-06T23:19:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e884b740 con 0x55f3e884c990 2023-10-06T23:19:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c79d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e885c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c79d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e885c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38218/0 (socket says 172.21.15.8:38218) 2023-10-06T23:19:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c79d9a700 1 -- 172.21.15.8:0/1764253350 learned_addr learned my addr 172.21.15.8:0/1764253350 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884aec0 0x55f3e88538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884c990 0x55f3e885c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.079+0000 7f6c79d9a700 1 -- 172.21.15.8:0/1764253350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884c990 msgr2=0x55f3e885c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884c990 0x55f3e885c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c79d9a700 1 -- 172.21.15.8:0/1764253350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884aec0 msgr2=0x55f3e88538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884aec0 0x55f3e88538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c79d9a700 1 -- 172.21.15.8:0/1764253350 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3e85ef1f0 con 0x55f3e884bfd0 2023-10-06T23:19:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884aec0 0x55f3e88538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:19:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e885c160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c640046b0 tx=0x7f6c64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=467e660c8ec33405 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c697fa700 1 -- 172.21.15.8:0/1764253350 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64010c60 con 0x55f3e884bfd0 2023-10-06T23:19:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c697fa700 1 -- 172.21.15.8:0/1764253350 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c64017040 con 0x55f3e884bfd0 2023-10-06T23:19:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.080+0000 7f6c697fa700 1 -- 172.21.15.8:0/1764253350 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64004e70 con 0x55f3e884bfd0 2023-10-06T23:19:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.081+0000 7f6c9008bb80 1 -- 172.21.15.8:0/1764253350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 msgr2=0x55f3e885c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.081+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e885c160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c640046b0 tx=0x7f6c64004750 comp rx=0 tx=0).stop 2023-10-06T23:19:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.082+0000 7f6c9008bb80 1 -- 172.21.15.8:0/1764253350 shutdown_connections 2023-10-06T23:19:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.082+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884aec0 0x55f3e88538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.082+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884c990 0x55f3e885c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.082+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/1764253350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884bfd0 0x55f3e885c160 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.082+0000 7f6c9008bb80 1 -- 172.21.15.8:0/1764253350 >> 172.21.15.8:0/1764253350 conn(0x55f3e87bf200 msgr2=0x55f3e8845b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.082+0000 7f6c9008bb80 1 -- 172.21.15.8:0/1764253350 shutdown_connections 2023-10-06T23:19:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.082+0000 7f6c9008bb80 1 -- 172.21.15.8:0/1764253350 wait complete. 2023-10-06T23:19:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.082+0000 7f6c9008bb80 1 -- start start 2023-10-06T23:19:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.083+0000 7f6c9008bb80 1 Processor -- start 2023-10-06T23:19:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8859e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e885a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c9008bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e885b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e885b8a0 con 0x55f3e884c990 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e885ba10 con 0x55f3e884aec0 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c9008bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e885bbd0 con 0x55f3e884bfd0 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c9008bb80 10 client.0 _ll_register_callbacks cb 0x7f6c6c0046f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c7ad9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8859e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c7ad9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8859e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38230/0 (socket says 172.21.15.8:38230) 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/3540681233 learned_addr learned my addr 172.21.15.8:0/3540681233 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e885b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.084+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e885a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/3540681233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 msgr2=0x55f3e885a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e885a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/3540681233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 msgr2=0x55f3e885b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e885b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c7ad9c700 1 -- 172.21.15.8:0/3540681233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c64009c80 con 0x55f3e884aec0 2023-10-06T23:19:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c7ad9c700 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8859e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c015a50 tx=0x7f6c6c0047a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc2af708610a984 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:19:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c5dffb700 1 -- 172.21.15.8:0/3540681233 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00e040 con 0x55f3e884aec0 2023-10-06T23:19:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c5dffb700 1 -- 172.21.15.8:0/3540681233 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c6c007500 con 0x55f3e884aec0 2023-10-06T23:19:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.085+0000 7f6c9008bb80 1 -- 172.21.15.8:0/3540681233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c6c00f040 con 0x55f3e884aec0 2023-10-06T23:19:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c5dffb700 1 -- 172.21.15.8:0/3540681233 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c6c0076c0 con 0x55f3e884aec0 2023-10-06T23:19:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c9008bb80 10 client.25985 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c9008bb80 1 -- 172.21.15.8:0/3540681233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55f3e85c7250 con 0x55f3e884aec0 2023-10-06T23:19:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c5dffb700 1 -- 172.21.15.8:0/3540681233 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c03d020 con 0x55f3e884aec0 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c5dffb700 1 -- 172.21.15.8:0/3540681233 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c6c02d580 con 0x55f3e884aec0 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c9008bb80 10 client.25985 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c9008bb80 10 client.25985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c9008bb80 20 client.25985 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f3e88bdb70 0x55f3e88bff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c9008bb80 4 client.25985 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.086+0000 7f6c9008bb80 1 -- 172.21.15.8:0/3540681233 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f3e8796ad0 con 0x55f3e88bdb70 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.087+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f3e88bdb70 0x55f3e88bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.088+0000 7f6c79d9a700 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f3e88bdb70 0x55f3e88bff90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6e8109e1fd4309 server_cookie=427dd2529b004e26 in_seq=0 out_seq=0 2023-10-06T23:19:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.088+0000 7f6c5dffb700 10 client.25985 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.102+0000 7f6c5dffb700 1 -- 172.21.15.8:0/3540681233 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f3e8796ad0 con 0x55f3e88bdb70 2023-10-06T23:19:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.102+0000 7f6c5dffb700 10 client.25985 handle_command_reply: tid=0 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.102+0000 7f6c9008bb80 1 client.25985 shutdown 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 -- 172.21.15.8:0/3540681233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 msgr2=0x55f3e8859e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8859e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c015a50 tx=0x7f6c6c0047a0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 -- 172.21.15.8:0/3540681233 shutdown_connections 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f3e88bdb70 0x55f3e88bff90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3e884c990 0x55f3e885b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c5dffb700 0 client.25985 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f3e884aec0 0x55f3e8859e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 --2- 172.21.15.8:0/3540681233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3e884bfd0 0x55f3e885a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 -- 172.21.15.8:0/3540681233 >> 172.21.15.8:0/3540681233 conn(0x55f3e87bf200 msgr2=0x55f3e88538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 -- 172.21.15.8:0/3540681233 shutdown_connections 2023-10-06T23:19:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 1 -- 172.21.15.8:0/3540681233 wait complete. 2023-10-06T23:19:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.103+0000 7f6c9008bb80 20 client.25985 trim_cache size 0 max 16384 2023-10-06T23:19:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:19:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:19:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:19:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:19:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c600a1500 msgr2=0x7f6c600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c600a1500 0x7f6c600a39c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6c7009b430 tx=0x7f6c700d1ac0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/768362057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c74101970 msgr2=0x7f6c74196bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c74101970 0x7f6c74196bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c70005910 tx=0x7f6c70005740 comp rx=0 tx=0).stop 2023-10-06T23:19:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/768362057 shutdown_connections 2023-10-06T23:19:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c600a1500 0x7f6c600a39c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c74106bd0 0x7f6c74197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c74101970 0x7f6c74196bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 --2- 172.21.15.8:0/768362057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c741042a0 0x7f6c74197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/768362057 >> 172.21.15.8:0/768362057 conn(0x7f6c740fb340 msgr2=0x7f6c741025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/768362057 shutdown_connections 2023-10-06T23:19:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:21.104+0000 7f6c7c7ff700 1 -- 172.21.15.8:0/768362057 wait complete. 2023-10-06T23:19:22.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:22 smithi008 ceph-mon[98532]: pgmap v544: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.4 MiB/s wr, 560 op/s 2023-10-06T23:19:22.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:22 smithi190 ceph-mon[102658]: pgmap v544: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.4 MiB/s wr, 560 op/s 2023-10-06T23:19:22.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:22 smithi156 ceph-mon[102862]: pgmap v544: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.4 MiB/s wr, 560 op/s 2023-10-06T23:19:23.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:23 smithi008 ceph-mon[98532]: pgmap v545: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 4.2 MiB/s wr, 526 op/s 2023-10-06T23:19:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:23 smithi190 ceph-mon[102658]: pgmap v545: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 4.2 MiB/s wr, 526 op/s 2023-10-06T23:19:23.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:23 smithi156 ceph-mon[102862]: pgmap v545: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 4.2 MiB/s wr, 526 op/s 2023-10-06T23:19:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 270.0 s, 258.2 tps, lat 388.061 ms stddev 79.000 2023-10-06T23:19:26.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:26 smithi008 ceph-mon[98532]: pgmap v546: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 5.2 MiB/s wr, 637 op/s 2023-10-06T23:19:26.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:26 smithi190 ceph-mon[102658]: pgmap v546: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 5.2 MiB/s wr, 637 op/s 2023-10-06T23:19:26.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:26 smithi156 ceph-mon[102862]: pgmap v546: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 5.2 MiB/s wr, 637 op/s 2023-10-06T23:19:27.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:27 smithi008 ceph-mon[98532]: pgmap v547: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.0 MiB/s wr, 535 op/s 2023-10-06T23:19:27.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:27 smithi190 ceph-mon[102658]: pgmap v547: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.0 MiB/s wr, 535 op/s 2023-10-06T23:19:27.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:27 smithi156 ceph-mon[102862]: pgmap v547: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 4.0 MiB/s wr, 535 op/s 2023-10-06T23:19:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 275.0 s, 237.0 tps, lat 425.331 ms stddev 243.826 2023-10-06T23:19:30.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:30 smithi008 ceph-mon[98532]: pgmap v548: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2023-10-06T23:19:30.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:30 smithi190 ceph-mon[102658]: pgmap v548: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2023-10-06T23:19:30.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:30 smithi156 ceph-mon[102862]: pgmap v548: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2023-10-06T23:19:31.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:31 smithi008 ceph-mon[98532]: pgmap v549: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 7.7 MiB/s wr, 696 op/s 2023-10-06T23:19:31.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:31 smithi190 ceph-mon[102658]: pgmap v549: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 7.7 MiB/s wr, 696 op/s 2023-10-06T23:19:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:31 smithi156 ceph-mon[102862]: pgmap v549: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 7.7 MiB/s wr, 696 op/s 2023-10-06T23:19:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:33 smithi008 ceph-mon[98532]: pgmap v550: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 6.5 MiB/s wr, 558 op/s 2023-10-06T23:19:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:33 smithi190 ceph-mon[102658]: pgmap v550: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 6.5 MiB/s wr, 558 op/s 2023-10-06T23:19:33.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:33 smithi156 ceph-mon[102862]: pgmap v550: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 6.5 MiB/s wr, 558 op/s 2023-10-06T23:19:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 280.0 s, 227.6 tps, lat 438.368 ms stddev 258.861 2023-10-06T23:19:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.336+0000 7f7f583ff700 1 -- 172.21.15.8:0/3787565626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f50100100 msgr2=0x7f7f50100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.336+0000 7f7f583ff700 1 --2- 172.21.15.8:0/3787565626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f50100100 0x7f7f50100580 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009990 tx=0x7f7f40009ca0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.336+0000 7f7f583ff700 1 -- 172.21.15.8:0/3787565626 shutdown_connections 2023-10-06T23:19:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.336+0000 7f7f583ff700 1 --2- 172.21.15.8:0/3787565626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f500ff7a0 0x7f7f500ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.336+0000 7f7f583ff700 1 --2- 172.21.15.8:0/3787565626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f50100ac0 0x7f7f50100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.336+0000 7f7f583ff700 1 --2- 172.21.15.8:0/3787565626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f50100100 0x7f7f50100580 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.336+0000 7f7f583ff700 1 -- 172.21.15.8:0/3787565626 >> 172.21.15.8:0/3787565626 conn(0x7f7f500fb340 msgr2=0x7f7f500fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.336+0000 7f7f583ff700 1 -- 172.21.15.8:0/3787565626 shutdown_connections 2023-10-06T23:19:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.337+0000 7f7f583ff700 1 -- 172.21.15.8:0/3787565626 wait complete. 2023-10-06T23:19:34.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.338+0000 7f7f583ff700 1 Processor -- start 2023-10-06T23:19:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.338+0000 7f7f583ff700 1 -- start start 2023-10-06T23:19:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f583ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f500ff7a0 0x7f7f5010fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f583ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f50100100 0x7f7f501101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f583ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f50100ac0 0x7f7f501110b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f583ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50111710 con 0x7f7f50100100 2023-10-06T23:19:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f583ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50111880 con 0x7f7f500ff7a0 2023-10-06T23:19:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f583ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50111a40 con 0x7f7f50100ac0 2023-10-06T23:19:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f5619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f500ff7a0 0x7f7f5010fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f5619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f500ff7a0 0x7f7f5010fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53662/0 (socket says 172.21.15.8:53662) 2023-10-06T23:19:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f5619b700 1 -- 172.21.15.8:0/265686994 learned_addr learned my addr 172.21.15.8:0/265686994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f5699c700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f50100ac0 0x7f7f501110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.339+0000 7f7f5599a700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f50100100 0x7f7f501101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.340+0000 7f7f5619b700 1 -- 172.21.15.8:0/265686994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f50100ac0 msgr2=0x7f7f501110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.340+0000 7f7f5619b700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f50100ac0 0x7f7f501110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.340+0000 7f7f5619b700 1 -- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f50100100 msgr2=0x7f7f501101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.340+0000 7f7f5619b700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f50100100 0x7f7f501101e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.340+0000 7f7f5619b700 1 -- 172.21.15.8:0/265686994 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f400095f0 con 0x7f7f500ff7a0 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.340+0000 7f7f5619b700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f500ff7a0 0x7f7f5010fca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00ef10 tx=0x7f7f4c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.341+0000 7f7f477fe700 1 -- 172.21.15.8:0/265686994 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00ca70 con 0x7f7f500ff7a0 2023-10-06T23:19:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.341+0000 7f7f583ff700 1 -- 172.21.15.8:0/265686994 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f50111cc0 con 0x7f7f500ff7a0 2023-10-06T23:19:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.341+0000 7f7f583ff700 1 -- 172.21.15.8:0/265686994 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f501144e0 con 0x7f7f500ff7a0 2023-10-06T23:19:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.341+0000 7f7f477fe700 1 -- 172.21.15.8:0/265686994 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f4c00f040 con 0x7f7f500ff7a0 2023-10-06T23:19:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.341+0000 7f7f477fe700 1 -- 172.21.15.8:0/265686994 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c014480 con 0x7f7f500ff7a0 2023-10-06T23:19:34.351 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.348+0000 7f7f477fe700 1 -- 172.21.15.8:0/265686994 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7f4c00cbd0 con 0x7f7f500ff7a0 2023-10-06T23:19:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.349+0000 7f7f6bd10b80 1 Processor -- start 2023-10-06T23:19:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.350+0000 7f7f6bd10b80 1 -- start start 2023-10-06T23:19:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.350+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa8ec0 0x564384fa92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.350+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fa9fd0 0x564384faa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.350+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fb1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.350+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384f11400 con 0x564384fa9fd0 2023-10-06T23:19:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.350+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384f02bc0 con 0x564384fa8ec0 2023-10-06T23:19:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.350+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384f004e0 con 0x564384faa990 2023-10-06T23:19:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5699c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa8ec0 0x564384fa92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5699c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa8ec0 0x564384fa92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53672/0 (socket says 172.21.15.8:53672) 2023-10-06T23:19:34.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5699c700 1 -- 172.21.15.8:0/2586465400 learned_addr learned my addr 172.21.15.8:0/2586465400 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:34.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5619b700 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fa9fd0 0x564384faa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5599a700 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fb1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5599a700 1 -- 172.21.15.8:0/2586465400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa8ec0 msgr2=0x564384fa92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5599a700 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa8ec0 0x564384fa92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5599a700 1 -- 172.21.15.8:0/2586465400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fa9fd0 msgr2=0x564384faa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5599a700 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fa9fd0 0x564384faa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.351+0000 7f7f5599a700 1 -- 172.21.15.8:0/2586465400 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564384d26d80 con 0x564384faa990 2023-10-06T23:19:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.352+0000 7f7f477fe700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7f3c0a15d0 0x7f7f3c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.352+0000 7f7f5599a700 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fb1220 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f40000c00 tx=0x7f7f40005c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=338c9121d4e71201 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.352+0000 7f7f477fe700 1 -- 172.21.15.8:0/265686994 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f4c0ccf90 con 0x7f7f500ff7a0 2023-10-06T23:19:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.352+0000 7f7f5699c700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7f3c0a15d0 0x7f7f3c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.352+0000 7f7f44bfe700 1 -- 172.21.15.8:0/2586465400 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40003680 con 0x564384faa990 2023-10-06T23:19:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.353+0000 7f7f44bfe700 1 -- 172.21.15.8:0/2586465400 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f4001e040 con 0x564384faa990 2023-10-06T23:19:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.353+0000 7f7f44bfe700 1 -- 172.21.15.8:0/2586465400 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000be40 con 0x564384faa990 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f5699c700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7f3c0a15d0 0x7f7f3c0a3a90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x564384fa8c60 tx=0x7f7f48009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/2586465400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 msgr2=0x564384fb1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fb1220 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f40000c00 tx=0x7f7f40005c40 comp rx=0 tx=0).stop 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/2586465400 shutdown_connections 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fb1220 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa8ec0 0x564384fa92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/2586465400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fa9fd0 0x564384faa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/2586465400 >> 172.21.15.8:0/2586465400 conn(0x564384f1d200 msgr2=0x564384fa3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.354+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/2586465400 shutdown_connections 2023-10-06T23:19:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.355+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/2586465400 wait complete. 2023-10-06T23:19:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.355+0000 7f7f6bd10b80 1 -- start start 2023-10-06T23:19:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.356+0000 7f7f6bd10b80 1 Processor -- start 2023-10-06T23:19:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.356+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa8ec0 0x564384fb2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fb3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384faa990 0x564384fba150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384efbdd0 con 0x564384faa990 2023-10-06T23:19:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384e986b0 con 0x564384fa9fd0 2023-10-06T23:19:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384e98350 con 0x564384fa8ec0 2023-10-06T23:19:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f6bd10b80 10 client.0 _ll_register_callbacks cb 0x564384cf57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f5619b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa8ec0 0x564384fb2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f5619b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa8ec0 0x564384fb2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42658/0 (socket says 172.21.15.8:42658) 2023-10-06T23:19:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f5619b700 1 -- 172.21.15.8:0/1340176350 learned_addr learned my addr 172.21.15.8:0/1340176350 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f5599a700 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fb3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.357+0000 7f7f5699c700 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384faa990 0x564384fba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f5619b700 1 -- 172.21.15.8:0/1340176350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 msgr2=0x564384fb3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f5619b700 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fb3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f5619b700 1 -- 172.21.15.8:0/1340176350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384faa990 msgr2=0x564384fba150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f5619b700 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384faa990 0x564384fba150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f5619b700 1 -- 172.21.15.8:0/1340176350 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5010be70 con 0x564384fa8ec0 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f5699c700 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384faa990 0x564384fba150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f5619b700 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa8ec0 0x564384fb2bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c099f60 tx=0x7f7f4c09a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=372da61d4f33d8ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:19:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f39ffb700 1 -- 172.21.15.8:0/1340176350 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c099da0 con 0x564384fa8ec0 2023-10-06T23:19:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.358+0000 7f7f39ffb700 1 -- 172.21.15.8:0/1340176350 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f4c09a960 con 0x564384fa8ec0 2023-10-06T23:19:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.359+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/1340176350 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564384f9bd50 con 0x564384fa8ec0 2023-10-06T23:19:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.359+0000 7f7f39ffb700 1 -- 172.21.15.8:0/1340176350 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f4c099bc0 con 0x564384fa8ec0 2023-10-06T23:19:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.359+0000 7f7f6bd10b80 10 client.26029 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.359+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/1340176350 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564384d0fc00 con 0x564384fa8ec0 2023-10-06T23:19:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.359+0000 7f7f39ffb700 1 -- 172.21.15.8:0/1340176350 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564384f9bd50 con 0x564384fa8ec0 2023-10-06T23:19:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.360+0000 7f7f39ffb700 1 -- 172.21.15.8:0/1340176350 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7f4c0b2d20 con 0x564384fa8ec0 2023-10-06T23:19:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.360+0000 7f7f6bd10b80 10 client.26029 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.360+0000 7f7f6bd10b80 10 client.26029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.360+0000 7f7f6bd10b80 20 client.26029 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.360+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564384fbe9a0 0x564384fc0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.360+0000 7f7f6bd10b80 4 client.26029 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:19:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.360+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/1340176350 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564384ef4db0 con 0x564384fbe9a0 2023-10-06T23:19:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.361+0000 7f7f5599a700 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564384fbe9a0 0x564384fc0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.362+0000 7f7f39ffb700 10 client.26029 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.362+0000 7f7f5599a700 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564384fbe9a0 0x564384fc0dc0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f84b3c6c45c9792 server_cookie=cd861a370833297 in_seq=0 out_seq=0 2023-10-06T23:19:34.365 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.363+0000 7f7f39ffb700 1 -- 172.21.15.8:0/1340176350 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564384ef4db0 con 0x564384fbe9a0 2023-10-06T23:19:34.365 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.363+0000 7f7f39ffb700 10 client.26029 handle_command_reply: tid=0 2023-10-06T23:19:34.365 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.363+0000 7f7f6bd10b80 1 client.26029 shutdown 2023-10-06T23:19:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.363+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/1340176350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa8ec0 msgr2=0x564384fb2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.363+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa8ec0 0x564384fb2bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c099f60 tx=0x7f7f4c09a7a0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/1340176350 shutdown_connections 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564384fbe9a0 0x564384fc0dc0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384faa990 0x564384fba150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa8ec0 0x564384fb2bd0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c099f60 tx=0x7f7f4c09a7a0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/1340176350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fb3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/1340176350 >> 172.21.15.8:0/1340176350 conn(0x564384f1d200 msgr2=0x564384fa3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f39ffb700 0 client.26029 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/1340176350 shutdown_connections 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.364+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/1340176350 wait complete. 2023-10-06T23:19:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.365+0000 7f7f6bd10b80 20 client.26029 trim_cache size 0 max 16384 2023-10-06T23:19:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.397+0000 7f7f6bd10b80 1 Processor -- start 2023-10-06T23:19:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.397+0000 7f7f6bd10b80 1 -- start start 2023-10-06T23:19:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.397+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fade20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 0x564384fba110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384d7c8c0 con 0x564384fc5720 2023-10-06T23:19:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384faae40 con 0x564384fa9fd0 2023-10-06T23:19:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384fa48b0 con 0x564384faa990 2023-10-06T23:19:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f5599a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f5599a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42662/0 (socket says 172.21.15.8:42662) 2023-10-06T23:19:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f5599a700 1 -- 172.21.15.8:0/4116821576 learned_addr learned my addr 172.21.15.8:0/4116821576 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f5619b700 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.398+0000 7f7f5699c700 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 0x564384fba110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.399+0000 7f7f5599a700 1 -- 172.21.15.8:0/4116821576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 msgr2=0x564384fad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.399+0000 7f7f5599a700 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.399+0000 7f7f5599a700 1 -- 172.21.15.8:0/4116821576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 msgr2=0x564384fba110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.399+0000 7f7f5599a700 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 0x564384fba110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.399+0000 7f7f5599a700 1 -- 172.21.15.8:0/4116821576 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564384d4d1f0 con 0x564384faa990 2023-10-06T23:19:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.399+0000 7f7f5619b700 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.399+0000 7f7f5599a700 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fade20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f40004360 tx=0x7f7f40005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d6ae7ea7595d22d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.400+0000 7f7f453ff700 1 -- 172.21.15.8:0/4116821576 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000b990 con 0x564384faa990 2023-10-06T23:19:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.400+0000 7f7f453ff700 1 -- 172.21.15.8:0/4116821576 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f400047e0 con 0x564384faa990 2023-10-06T23:19:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.400+0000 7f7f453ff700 1 -- 172.21.15.8:0/4116821576 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400052a0 con 0x564384faa990 2023-10-06T23:19:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/4116821576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 msgr2=0x564384fade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fade20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f40004360 tx=0x7f7f40005a90 comp rx=0 tx=0).stop 2023-10-06T23:19:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/4116821576 shutdown_connections 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 0x564384fba110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384fa9fd0 0x564384fad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/4116821576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384faa990 0x564384fade20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/4116821576 >> 172.21.15.8:0/4116821576 conn(0x564384f1d200 msgr2=0x564384fb0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/4116821576 shutdown_connections 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.401+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/4116821576 wait complete. 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.402+0000 7f7f6bd10b80 1 -- start start 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.402+0000 7f7f6bd10b80 1 Processor -- start 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa9fd0 0x564384fb7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384faa990 0x564384fb8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f6bd10b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 0x564384fb9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384fb99b0 con 0x564384fc5720 2023-10-06T23:19:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384fb9b20 con 0x564384faa990 2023-10-06T23:19:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f6bd10b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564384fb9ce0 con 0x564384fa9fd0 2023-10-06T23:19:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f6bd10b80 10 client.0 _ll_register_callbacks cb 0x564384cf57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f5619b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa9fd0 0x564384fb7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f5619b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa9fd0 0x564384fb7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42670/0 (socket says 172.21.15.8:42670) 2023-10-06T23:19:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f5619b700 1 -- 172.21.15.8:0/613494429 learned_addr learned my addr 172.21.15.8:0/613494429 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.403+0000 7f7f5599a700 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384faa990 0x564384fb8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.404+0000 7f7f5699c700 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 0x564384fb9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.404+0000 7f7f5599a700 1 -- 172.21.15.8:0/613494429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa9fd0 msgr2=0x564384fb7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.404+0000 7f7f5599a700 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa9fd0 0x564384fb7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.404+0000 7f7f5599a700 1 -- 172.21.15.8:0/613494429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 msgr2=0x564384fb9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.404+0000 7f7f5599a700 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 0x564384fb9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.404+0000 7f7f5599a700 1 -- 172.21.15.8:0/613494429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564384d0fc00 con 0x564384faa990 2023-10-06T23:19:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.404+0000 7f7f5599a700 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384faa990 0x564384fb8460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x564384f9e220 tx=0x7f7f40004140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d58f1775f4be6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.404+0000 7f7f39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:19:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.405+0000 7f7f39ffb700 1 -- 172.21.15.8:0/613494429 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000bb90 con 0x564384faa990 2023-10-06T23:19:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.405+0000 7f7f39ffb700 1 -- 172.21.15.8:0/613494429 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f4000bcf0 con 0x564384faa990 2023-10-06T23:19:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.405+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/613494429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f4001e040 con 0x564384faa990 2023-10-06T23:19:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.405+0000 7f7f39ffb700 1 -- 172.21.15.8:0/613494429 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f4000beb0 con 0x564384faa990 2023-10-06T23:19:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.405+0000 7f7f6bd10b80 10 client.26003 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.405+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/613494429 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564384d26d80 con 0x564384faa990 2023-10-06T23:19:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.406+0000 7f7f39ffb700 1 -- 172.21.15.8:0/613494429 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f4001e040 con 0x564384faa990 2023-10-06T23:19:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.406+0000 7f7f39ffb700 1 -- 172.21.15.8:0/613494429 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7f400052e0 con 0x564384faa990 2023-10-06T23:19:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.406+0000 7f7f6bd10b80 10 client.26003 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.406+0000 7f7f6bd10b80 10 client.26003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.406+0000 7f7f6bd10b80 20 client.26003 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.406+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5643850131e0 0x5643850155d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.406+0000 7f7f6bd10b80 4 client.26003 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:19:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.406+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/613494429 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564384ef4ad0 con 0x5643850131e0 2023-10-06T23:19:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.407+0000 7f7f5619b700 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5643850131e0 0x5643850155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.407+0000 7f7f5619b700 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5643850131e0 0x5643850155d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65e1141e205cdb6b server_cookie=1d8a0dbc2eefcdf1 in_seq=0 out_seq=0 2023-10-06T23:19:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.407+0000 7f7f39ffb700 10 client.26003 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.422+0000 7f7f39ffb700 1 -- 172.21.15.8:0/613494429 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564384ef4ad0 con 0x5643850131e0 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.422+0000 7f7f39ffb700 10 client.26003 handle_command_reply: tid=0 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.422+0000 7f7f6bd10b80 1 client.26003 shutdown 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.423+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384faa990 msgr2=0x564384fb8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.423+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384faa990 0x564384fb8460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x564384f9e220 tx=0x7f7f40004140 comp rx=0 tx=0).stop 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.424+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/613494429 shutdown_connections 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.424+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5643850131e0 0x5643850155d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.424+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564384fc5720 0x564384fb9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.424+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564384fa9fd0 0x564384fb7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.424+0000 7f7f6bd10b80 1 --2- 172.21.15.8:0/613494429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564384faa990 0x564384fb8460 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.424+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/613494429 >> 172.21.15.8:0/613494429 conn(0x564384f1d200 msgr2=0x564384fb0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.424+0000 7f7f39ffb700 0 client.26003 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.425+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/613494429 shutdown_connections 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.425+0000 7f7f6bd10b80 1 -- 172.21.15.8:0/613494429 wait complete. 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.425+0000 7f7f6bd10b80 20 client.26003 trim_cache size 0 max 16384 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:19:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:19:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:19:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 -- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7f3c0a15d0 msgr2=0x7f7f3c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7f3c0a15d0 0x7f7f3c0a3a90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x564384fa8c60 tx=0x7f7f48009260 comp rx=0 tx=0).stop 2023-10-06T23:19:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 -- 172.21.15.8:0/265686994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f500ff7a0 msgr2=0x7f7f5010fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f500ff7a0 0x7f7f5010fca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00ef10 tx=0x7f7f4c00c3a0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 -- 172.21.15.8:0/265686994 shutdown_connections 2023-10-06T23:19:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f7f3c0a15d0 0x7f7f3c0a3a90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f50100ac0 0x7f7f501110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f500ff7a0 0x7f7f5010fca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 --2- 172.21.15.8:0/265686994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f50100100 0x7f7f501101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.426+0000 7f7f583ff700 1 -- 172.21.15.8:0/265686994 >> 172.21.15.8:0/265686994 conn(0x7f7f500fb340 msgr2=0x7f7f500fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.427+0000 7f7f583ff700 1 -- 172.21.15.8:0/265686994 shutdown_connections 2023-10-06T23:19:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:34.427+0000 7f7f583ff700 1 -- 172.21.15.8:0/265686994 wait complete. 2023-10-06T23:19:35.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:35 smithi190 ceph-mon[102658]: pgmap v551: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 9.0 MiB/s wr, 697 op/s 2023-10-06T23:19:35.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:35 smithi156 ceph-mon[102862]: pgmap v551: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 9.0 MiB/s wr, 697 op/s 2023-10-06T23:19:35.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:35 smithi008 ceph-mon[98532]: pgmap v551: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 9.0 MiB/s wr, 697 op/s 2023-10-06T23:19:37.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:37 smithi190 ceph-mon[102658]: pgmap v552: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 8.2 MiB/s wr, 619 op/s 2023-10-06T23:19:37.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:37 smithi156 ceph-mon[102862]: pgmap v552: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 8.2 MiB/s wr, 619 op/s 2023-10-06T23:19:37.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:37 smithi008 ceph-mon[98532]: pgmap v552: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 8.2 MiB/s wr, 619 op/s 2023-10-06T23:19:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 285.0 s, 209.4 tps, lat 470.370 ms stddev 156.796 2023-10-06T23:19:39.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:39 smithi190 ceph-mon[102658]: pgmap v553: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 8.8 MiB/s wr, 580 op/s 2023-10-06T23:19:39.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:39 smithi156 ceph-mon[102862]: pgmap v553: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 8.8 MiB/s wr, 580 op/s 2023-10-06T23:19:39.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:39 smithi008 ceph-mon[98532]: pgmap v553: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 8.8 MiB/s wr, 580 op/s 2023-10-06T23:19:40.444 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:40 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:19:40.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:40 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:19:40.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:40 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:19:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:41 smithi190 ceph-mon[102658]: pgmap v554: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 7.8 MiB/s wr, 576 op/s 2023-10-06T23:19:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:19:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:19:41.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:41 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:19:41.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:41 smithi156 ceph-mon[102862]: pgmap v554: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 7.8 MiB/s wr, 576 op/s 2023-10-06T23:19:41.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:19:41.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:19:41.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:41 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:19:41.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:41 smithi008 ceph-mon[98532]: pgmap v554: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 7.8 MiB/s wr, 576 op/s 2023-10-06T23:19:41.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:19:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:19:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:19:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:41 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:19:42.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:42 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-10-06T23:19:42.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:42 smithi190 ceph-mon[102658]: Unable to set osd_memory_target on smithi008 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-06T23:19:42.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:42 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-10-06T23:19:42.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:42 smithi156 ceph-mon[102862]: Unable to set osd_memory_target on smithi008 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-06T23:19:42.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:42 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-10-06T23:19:42.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:42 smithi008 ceph-mon[98532]: Unable to set osd_memory_target on smithi008 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-06T23:19:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:43 smithi008 ceph-mon[98532]: pgmap v555: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 7.0 MiB/s wr, 524 op/s 2023-10-06T23:19:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:43 smithi190 ceph-mon[102658]: pgmap v555: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 7.0 MiB/s wr, 524 op/s 2023-10-06T23:19:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:43 smithi156 ceph-mon[102862]: pgmap v555: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 7.0 MiB/s wr, 524 op/s 2023-10-06T23:19:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 290.0 s, 189.4 tps, lat 533.200 ms stddev 366.985 2023-10-06T23:19:45.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:45 smithi190 ceph-mon[102658]: pgmap v556: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 9.3 MiB/s wr, 607 op/s 2023-10-06T23:19:45.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:45 smithi156 ceph-mon[102862]: pgmap v556: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 9.3 MiB/s wr, 607 op/s 2023-10-06T23:19:45.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:45 smithi008 ceph-mon[98532]: pgmap v556: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 9.3 MiB/s wr, 607 op/s 2023-10-06T23:19:46.749 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:19:47.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.054+0000 7fc34259d700 1 -- 172.21.15.8:0/2823670437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c104ab0 msgr2=0x7fc33c10b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.054+0000 7fc34259d700 1 --2- 172.21.15.8:0/2823670437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c104ab0 0x7fc33c10b3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc334009990 tx=0x7fc334009ca0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.055+0000 7fc34259d700 1 -- 172.21.15.8:0/2823670437 shutdown_connections 2023-10-06T23:19:47.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.055+0000 7fc34259d700 1 --2- 172.21.15.8:0/2823670437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc33c102f20 0x7fc33c103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.055+0000 7fc34259d700 1 --2- 172.21.15.8:0/2823670437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c104ab0 0x7fc33c10b3d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.055+0000 7fc34259d700 1 --2- 172.21.15.8:0/2823670437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c1040f0 0x7fc33c104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.055+0000 7fc34259d700 1 -- 172.21.15.8:0/2823670437 >> 172.21.15.8:0/2823670437 conn(0x7fc33c0fe4c0 msgr2=0x7fc33c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.055+0000 7fc34259d700 1 -- 172.21.15.8:0/2823670437 shutdown_connections 2023-10-06T23:19:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.055+0000 7fc34259d700 1 -- 172.21.15.8:0/2823670437 wait complete. 2023-10-06T23:19:47.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.056+0000 7fc34259d700 1 Processor -- start 2023-10-06T23:19:47.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34259d700 1 -- start start 2023-10-06T23:19:47.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34259d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c102f20 0x7fc33c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34259d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc33c1040f0 0x7fc33c19d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34259d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c104ab0 0x7fc33c1a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34259d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c1a49f0 con 0x7fc33c1040f0 2023-10-06T23:19:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34259d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c1a4b30 con 0x7fc33c104ab0 2023-10-06T23:19:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34259d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c1a4cc0 con 0x7fc33c102f20 2023-10-06T23:19:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34159b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c102f20 0x7fc33c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34159b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c102f20 0x7fc33c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45352/0 (socket says 172.21.15.8:45352) 2023-10-06T23:19:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.057+0000 7fc34159b700 1 -- 172.21.15.8:0/1621844592 learned_addr learned my addr 172.21.15.8:0/1621844592 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.058+0000 7fc341d9c700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c104ab0 0x7fc33c1a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.058+0000 7fc340d9a700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc33c1040f0 0x7fc33c19d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.058+0000 7fc34159b700 1 -- 172.21.15.8:0/1621844592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c104ab0 msgr2=0x7fc33c1a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.058+0000 7fc34159b700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c104ab0 0x7fc33c1a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.058+0000 7fc34159b700 1 -- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc33c1040f0 msgr2=0x7fc33c19d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.058+0000 7fc34159b700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc33c1040f0 0x7fc33c19d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.058+0000 7fc34159b700 1 -- 172.21.15.8:0/1621844592 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009c40 con 0x7fc33c102f20 2023-10-06T23:19:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.058+0000 7fc34159b700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c102f20 0x7fc33c19ce70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c140 tx=0x7fc33800c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.059+0000 7fc3327fc700 1 -- 172.21.15.8:0/1621844592 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800e050 con 0x7fc33c102f20 2023-10-06T23:19:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.059+0000 7fc3327fc700 1 -- 172.21.15.8:0/1621844592 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc33800f040 con 0x7fc33c102f20 2023-10-06T23:19:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.059+0000 7fc3327fc700 1 -- 172.21.15.8:0/1621844592 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338013400 con 0x7fc33c102f20 2023-10-06T23:19:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.059+0000 7fc34259d700 1 -- 172.21.15.8:0/1621844592 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3340095f0 con 0x7fc33c102f20 2023-10-06T23:19:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.059+0000 7fc34259d700 1 -- 172.21.15.8:0/1621844592 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c1a51b0 con 0x7fc33c102f20 2023-10-06T23:19:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.063+0000 7fc3327fc700 1 -- 172.21.15.8:0/1621844592 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc338007500 con 0x7fc33c102f20 2023-10-06T23:19:47.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.065+0000 7fc357104b80 1 Processor -- start 2023-10-06T23:19:47.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.065+0000 7fc357104b80 1 -- start start 2023-10-06T23:19:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.065+0000 7fc357104b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0410 0x55e4c37b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.065+0000 7fc357104b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0d70 0x55e4c37b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.065+0000 7fc357104b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.065+0000 7fc357104b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c3718460 con 0x55e4c37b1c60 2023-10-06T23:19:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.065+0000 7fc357104b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c3709c20 con 0x55e4c37b0410 2023-10-06T23:19:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.065+0000 7fc357104b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c3707540 con 0x55e4c37b0d70 2023-10-06T23:19:47.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.066+0000 7fc340d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.066+0000 7fc341d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0410 0x55e4c37b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.066+0000 7fc340d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57436/0 (socket says 172.21.15.8:57436) 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.066+0000 7fc340d9a700 1 -- 172.21.15.8:0/3985261472 learned_addr learned my addr 172.21.15.8:0/3985261472 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.066+0000 7fc3327fc700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3280a15a0 0x7fc3280a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.066+0000 7fc34159b700 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0d70 0x55e4c37b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.067+0000 7fc341d9c700 1 -- 172.21.15.8:0/3985261472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0d70 msgr2=0x55e4c37b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.067+0000 7fc341d9c700 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0d70 0x55e4c37b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.067+0000 7fc341d9c700 1 -- 172.21.15.8:0/3985261472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 msgr2=0x55e4c37b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.067+0000 7fc341d9c700 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.067+0000 7fc341d9c700 1 -- 172.21.15.8:0/3985261472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c352dde0 con 0x55e4c37b0410 2023-10-06T23:19:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.067+0000 7fc34159b700 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0d70 0x55e4c37b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.067+0000 7fc3327fc700 1 -- 172.21.15.8:0/1621844592 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc3380ccbf0 con 0x7fc33c102f20 2023-10-06T23:19:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.067+0000 7fc341d9c700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3280a15a0 0x7fc3280a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.068+0000 7fc341d9c700 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0410 0x55e4c37b0830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc334005910 tx=0x7fc334004000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dcfdb9c9b774307 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.068+0000 7fc3277fe700 1 -- 172.21.15.8:0/3985261472 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33401d070 con 0x55e4c37b0410 2023-10-06T23:19:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.068+0000 7fc3277fe700 1 -- 172.21.15.8:0/3985261472 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc33401e040 con 0x55e4c37b0410 2023-10-06T23:19:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.068+0000 7fc3277fe700 1 -- 172.21.15.8:0/3985261472 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400bc50 con 0x55e4c37b0410 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 -- 172.21.15.8:0/3985261472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0410 msgr2=0x55e4c37b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0410 0x55e4c37b0830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc334005910 tx=0x7fc334004000 comp rx=0 tx=0).stop 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc341d9c700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3280a15a0 0x7fc3280a3a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc33402a000 tx=0x7fc33402b000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 -- 172.21.15.8:0/3985261472 shutdown_connections 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0410 0x55e4c37b0830 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 --2- 172.21.15.8:0/3985261472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0d70 0x55e4c37b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 -- 172.21.15.8:0/3985261472 >> 172.21.15.8:0/3985261472 conn(0x55e4c3724260 msgr2=0x55e4c37ab2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 -- 172.21.15.8:0/3985261472 shutdown_connections 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.069+0000 7fc357104b80 1 -- 172.21.15.8:0/3985261472 wait complete. 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.070+0000 7fc357104b80 1 -- start start 2023-10-06T23:19:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.070+0000 7fc357104b80 1 Processor -- start 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc357104b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0410 0x55e4c37ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc357104b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 0x55e4c37ba7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc357104b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b1c60 0x55e4c37c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc357104b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c3702e30 con 0x55e4c37b0410 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc357104b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c369f710 con 0x55e4c37b0d70 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc357104b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c369f3b0 con 0x55e4c37b1c60 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc357104b80 10 client.0 _ll_register_callbacks cb 0x55e4c34fc800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc34159b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0410 0x55e4c37ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc341d9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b1c60 0x55e4c37c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc340d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 0x55e4c37ba7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc34159b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0410 0x55e4c37ba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57452/0 (socket says 172.21.15.8:57452) 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc34159b700 1 -- 172.21.15.8:0/3204748343 learned_addr learned my addr 172.21.15.8:0/3204748343 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.071+0000 7fc341d9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b1c60 0x55e4c37c1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45378/0 (socket says 172.21.15.8:45378) 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc341d9c700 1 -- 172.21.15.8:0/3204748343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 msgr2=0x55e4c37ba7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc341d9c700 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 0x55e4c37ba7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc341d9c700 1 -- 172.21.15.8:0/3204748343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0410 msgr2=0x55e4c37ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc341d9c700 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0410 0x55e4c37ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc341d9c700 1 -- 172.21.15.8:0/3204748343 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c1a51b0 con 0x55e4c37b1c60 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc34159b700 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0410 0x55e4c37ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc341d9c700 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b1c60 0x55e4c37c1800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc334003f60 tx=0x7fc33400bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75209e1f0c595259 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc324ff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc324ff9700 1 -- 172.21.15.8:0/3204748343 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33401d070 con 0x55e4c37b1c60 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.072+0000 7fc357104b80 1 -- 172.21.15.8:0/3204748343 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4c37a3160 con 0x55e4c37b1c60 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.073+0000 7fc324ff9700 1 -- 172.21.15.8:0/3204748343 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc334003880 con 0x55e4c37b1c60 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.073+0000 7fc324ff9700 1 -- 172.21.15.8:0/3204748343 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc334003a40 con 0x55e4c37b1c60 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.073+0000 7fc357104b80 10 client.26047 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.073+0000 7fc357104b80 1 -- 172.21.15.8:0/3204748343 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7fc33c10bd00 con 0x55e4c37b1c60 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.073+0000 7fc324ff9700 1 -- 172.21.15.8:0/3204748343 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc334049080 con 0x55e4c37b1c60 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.074+0000 7fc324ff9700 1 -- 172.21.15.8:0/3204748343 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc334004bc0 con 0x55e4c37b1c60 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.074+0000 7fc357104b80 10 client.26047 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.074+0000 7fc357104b80 10 client.26047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.074+0000 7fc357104b80 20 client.26047 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.074+0000 7fc357104b80 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e4c37c5ba0 0x55e4c37c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.074+0000 7fc357104b80 4 client.26047 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:19:47.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.074+0000 7fc357104b80 1 -- 172.21.15.8:0/3204748343 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4c36fbe10 con 0x55e4c37c5ba0 2023-10-06T23:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.074+0000 7fc34159b700 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e4c37c5ba0 0x55e4c37c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.075+0000 7fc34159b700 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e4c37c5ba0 0x55e4c37c7fc0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f61374901649302c server_cookie=93ad8ec1803aab75 in_seq=0 out_seq=0 2023-10-06T23:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.075+0000 7fc324ff9700 10 client.26047 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.075+0000 7fc324ff9700 1 -- 172.21.15.8:0/3204748343 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e4c36fbe10 con 0x55e4c37c5ba0 2023-10-06T23:19:47.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.075+0000 7fc324ff9700 10 client.26047 handle_command_reply: tid=0 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 client.26047 shutdown 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 -- 172.21.15.8:0/3204748343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b1c60 msgr2=0x55e4c37c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b1c60 0x55e4c37c1800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc334003f60 tx=0x7fc33400bc80 comp rx=0 tx=0).stop 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 -- 172.21.15.8:0/3204748343 shutdown_connections 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e4c37c5ba0 0x55e4c37c7fc0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0410 0x55e4c37ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b1c60 0x55e4c37c1800 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 --2- 172.21.15.8:0/3204748343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 0x55e4c37ba7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 -- 172.21.15.8:0/3204748343 >> 172.21.15.8:0/3204748343 conn(0x55e4c3724260 msgr2=0x55e4c37ab130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc324ff9700 0 client.26047 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:47.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 -- 172.21.15.8:0/3204748343 shutdown_connections 2023-10-06T23:19:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.076+0000 7fc357104b80 1 -- 172.21.15.8:0/3204748343 wait complete. 2023-10-06T23:19:47.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.077+0000 7fc357104b80 20 client.26047 trim_cache size 0 max 16384 2023-10-06T23:19:47.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.104+0000 7fc357104b80 1 Processor -- start 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.104+0000 7fc357104b80 1 -- start start 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc357104b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc357104b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 0x55e4c37c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc357104b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc357104b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c3583920 con 0x55e4c37b1c60 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc357104b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c37bb470 con 0x55e4c37b0d70 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc357104b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c37b9730 con 0x55e4c37b0410 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc34159b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc34159b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45392/0 (socket says 172.21.15.8:45392) 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc34159b700 1 -- 172.21.15.8:0/1525702612 learned_addr learned my addr 172.21.15.8:0/1525702612 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc341d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.105+0000 7fc340d9a700 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 0x55e4c37c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc34159b700 1 -- 172.21.15.8:0/1525702612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 msgr2=0x55e4c37c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc34159b700 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 0x55e4c37c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc34159b700 1 -- 172.21.15.8:0/1525702612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 msgr2=0x55e4c37c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc34159b700 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc34159b700 1 -- 172.21.15.8:0/1525702612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c3516c60 con 0x55e4c37b0410 2023-10-06T23:19:47.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc341d9c700 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc34159b700 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37ab0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc338099bc0 tx=0x7fc3380ca570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25f3ce8d3b2c85fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc327fff700 1 -- 172.21.15.8:0/1525702612 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380d0100 con 0x55e4c37b0410 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc327fff700 1 -- 172.21.15.8:0/1525702612 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc338099a00 con 0x55e4c37b0410 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.106+0000 7fc327fff700 1 -- 172.21.15.8:0/1525702612 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33809e010 con 0x55e4c37b0410 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.107+0000 7fc357104b80 1 -- 172.21.15.8:0/1525702612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 msgr2=0x55e4c37ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.107+0000 7fc357104b80 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37ab0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc338099bc0 tx=0x7fc3380ca570 comp rx=0 tx=0).stop 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.107+0000 7fc357104b80 1 -- 172.21.15.8:0/1525702612 shutdown_connections 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.107+0000 7fc357104b80 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b1c60 0x55e4c37c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.107+0000 7fc357104b80 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37ab0d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.107+0000 7fc357104b80 1 --2- 172.21.15.8:0/1525702612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b0d70 0x55e4c37c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.107+0000 7fc357104b80 1 -- 172.21.15.8:0/1525702612 >> 172.21.15.8:0/1525702612 conn(0x55e4c3724260 msgr2=0x55e4c37c20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.108+0000 7fc357104b80 1 -- 172.21.15.8:0/1525702612 shutdown_connections 2023-10-06T23:19:47.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.108+0000 7fc357104b80 1 -- 172.21.15.8:0/1525702612 wait complete. 2023-10-06T23:19:47.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.108+0000 7fc357104b80 1 -- start start 2023-10-06T23:19:47.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.108+0000 7fc357104b80 1 Processor -- start 2023-10-06T23:19:47.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.109+0000 7fc357104b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.109+0000 7fc357104b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0d70 0x55e4c37bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.109+0000 7fc357104b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b1c60 0x55e4c37c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.109+0000 7fc357104b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c37c1210 con 0x55e4c37b0d70 2023-10-06T23:19:47.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.109+0000 7fc357104b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c37c1380 con 0x55e4c37b1c60 2023-10-06T23:19:47.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.109+0000 7fc357104b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c37c1540 con 0x55e4c37b0410 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.109+0000 7fc357104b80 10 client.0 _ll_register_callbacks cb 0x7fc32c009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.109+0000 7fc34159b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc341d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b1c60 0x55e4c37c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc34159b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45396/0 (socket says 172.21.15.8:45396) 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc34159b700 1 -- 172.21.15.8:0/816009293 learned_addr learned my addr 172.21.15.8:0/816009293 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc340d9a700 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0d70 0x55e4c37bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc341d9c700 1 -- 172.21.15.8:0/816009293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 msgr2=0x55e4c37bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc341d9c700 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc341d9c700 1 -- 172.21.15.8:0/816009293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0d70 msgr2=0x55e4c37bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc341d9c700 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0d70 0x55e4c37bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc341d9c700 1 -- 172.21.15.8:0/816009293 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c10bd00 con 0x55e4c37b1c60 2023-10-06T23:19:47.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.110+0000 7fc341d9c700 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b1c60 0x55e4c37c0cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3340098e0 tx=0x7fc3340268a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168df1a927b1f049 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.111+0000 7fc324ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:19:47.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.111+0000 7fc324ff9700 1 -- 172.21.15.8:0/816009293 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33401d040 con 0x55e4c37b1c60 2023-10-06T23:19:47.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.111+0000 7fc324ff9700 1 -- 172.21.15.8:0/816009293 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc334000e40 con 0x55e4c37b1c60 2023-10-06T23:19:47.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.111+0000 7fc357104b80 1 -- 172.21.15.8:0/816009293 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc33401e040 con 0x55e4c37b1c60 2023-10-06T23:19:47.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.111+0000 7fc324ff9700 1 -- 172.21.15.8:0/816009293 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc334026e30 con 0x55e4c37b1c60 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.111+0000 7fc357104b80 10 client.26021 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.111+0000 7fc357104b80 1 -- 172.21.15.8:0/816009293 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7fc3340095f0 con 0x55e4c37b1c60 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.112+0000 7fc324ff9700 1 -- 172.21.15.8:0/816009293 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc33401e040 con 0x55e4c37b1c60 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.112+0000 7fc324ff9700 1 -- 172.21.15.8:0/816009293 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc334021070 con 0x55e4c37b1c60 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.112+0000 7fc357104b80 10 client.26021 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.112+0000 7fc357104b80 10 client.26021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.112+0000 7fc357104b80 20 client.26021 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.112+0000 7fc357104b80 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e4c381a640 0x55e4c381ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.112+0000 7fc357104b80 4 client.26021 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:19:47.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.112+0000 7fc357104b80 1 -- 172.21.15.8:0/816009293 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e4c36fbb30 con 0x55e4c381a640 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.113+0000 7fc34159b700 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e4c381a640 0x55e4c381ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.113+0000 7fc34159b700 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e4c381a640 0x55e4c381ca30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac01a86611a99d1c server_cookie=6873759c4690867a in_seq=0 out_seq=0 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.113+0000 7fc324ff9700 10 client.26021 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.113+0000 7fc324ff9700 1 -- 172.21.15.8:0/816009293 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55e4c36fbb30 con 0x55e4c381a640 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.113+0000 7fc324ff9700 10 client.26021 handle_command_reply: tid=0 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.113+0000 7fc357104b80 1 client.26021 shutdown 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 -- 172.21.15.8:0/816009293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b1c60 msgr2=0x55e4c37c0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b1c60 0x55e4c37c0cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3340098e0 tx=0x7fc3340268a0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 -- 172.21.15.8:0/816009293 shutdown_connections 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e4c381a640 0x55e4c381ca30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e4c37b1c60 0x55e4c37c0cd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4c37b0410 0x55e4c37bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 --2- 172.21.15.8:0/816009293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e4c37b0d70 0x55e4c37bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 -- 172.21.15.8:0/816009293 >> 172.21.15.8:0/816009293 conn(0x55e4c3724260 msgr2=0x55e4c37c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc324ff9700 0 client.26021 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 -- 172.21.15.8:0/816009293 shutdown_connections 2023-10-06T23:19:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 1 -- 172.21.15.8:0/816009293 wait complete. 2023-10-06T23:19:47.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.114+0000 7fc357104b80 20 client.26021 trim_cache size 0 max 16384 2023-10-06T23:19:47.118 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:19:47.118 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:19:47.119 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:19:47.119 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:19:47.119 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:19:47.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:19:47.119 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:19:47.119 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:19:47.119 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:19:47.119 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:19:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 -- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3280a15a0 msgr2=0x7fc3280a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3280a15a0 0x7fc3280a3a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc33402a000 tx=0x7fc33402b000 comp rx=0 tx=0).stop 2023-10-06T23:19:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 -- 172.21.15.8:0/1621844592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c102f20 msgr2=0x7fc33c19ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c102f20 0x7fc33c19ce70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c140 tx=0x7fc33800c450 comp rx=0 tx=0).stop 2023-10-06T23:19:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 -- 172.21.15.8:0/1621844592 shutdown_connections 2023-10-06T23:19:47.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc3280a15a0 0x7fc3280a3a60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c104ab0 0x7fc33c1a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33c102f20 0x7fc33c19ce70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 --2- 172.21.15.8:0/1621844592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc33c1040f0 0x7fc33c19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 -- 172.21.15.8:0/1621844592 >> 172.21.15.8:0/1621844592 conn(0x7fc33c0fe4c0 msgr2=0x7fc33c077300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 -- 172.21.15.8:0/1621844592 shutdown_connections 2023-10-06T23:19:47.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:19:47.115+0000 7fc34259d700 1 -- 172.21.15.8:0/1621844592 wait complete. 2023-10-06T23:19:47.143 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:19:47.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:47 smithi008 ceph-mon[98532]: pgmap v557: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.9 MiB/s wr, 488 op/s 2023-10-06T23:19:47.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:47 smithi190 ceph-mon[102658]: pgmap v557: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.9 MiB/s wr, 488 op/s 2023-10-06T23:19:47.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:47 smithi156 ceph-mon[102862]: pgmap v557: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.9 MiB/s wr, 488 op/s 2023-10-06T23:19:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 -- 172.21.15.8:0/58701675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 msgr2=0x7fbda4109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/58701675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 0x7fbda4109060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009f90 tx=0x7fbd9c00b330 comp rx=0 tx=0).stop 2023-10-06T23:19:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 -- 172.21.15.8:0/58701675 shutdown_connections 2023-10-06T23:19:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/58701675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 0x7fbda4109060 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/58701675 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda4101a10 0x7fbda4103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/58701675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbda4104340 0x7fbda4106730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 -- 172.21.15.8:0/58701675 >> 172.21.15.8:0/58701675 conn(0x7fbda40fb340 msgr2=0x7fbda40fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 -- 172.21.15.8:0/58701675 shutdown_connections 2023-10-06T23:19:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.638+0000 7fbdab9ff700 1 -- 172.21.15.8:0/58701675 wait complete. 2023-10-06T23:19:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.640+0000 7fbdab9ff700 1 Processor -- start 2023-10-06T23:19:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.640+0000 7fbdab9ff700 1 -- start start 2023-10-06T23:19:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.640+0000 7fbdab9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbda4101a10 0x7fbda4198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbdab9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda4104340 0x7fbda41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbdab9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 0x7fbda419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbdab9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda419a8d0 con 0x7fbda4101a10 2023-10-06T23:19:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbdab9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda419aa40 con 0x7fbda4106c70 2023-10-06T23:19:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbdab9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda419ac00 con 0x7fbda4104340 2023-10-06T23:19:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbda8f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda4104340 0x7fbda41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbda9f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 0x7fbda419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbda979b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbda4101a10 0x7fbda4198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbda8f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda4104340 0x7fbda41993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45420/0 (socket says 172.21.15.8:45420) 2023-10-06T23:19:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbda8f9a700 1 -- 172.21.15.8:0/1064528924 learned_addr learned my addr 172.21.15.8:0/1064528924 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbda8f9a700 1 -- 172.21.15.8:0/1064528924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 msgr2=0x7fbda419a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 0x7fbda419a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.641+0000 7fbda8f9a700 1 -- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbda4101a10 msgr2=0x7fbda4198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.642+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbda4101a10 0x7fbda4198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.642+0000 7fbda8f9a700 1 -- 172.21.15.8:0/1064528924 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c009c40 con 0x7fbda4104340 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.642+0000 7fbda9f9c700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 0x7fbda419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.642+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda4104340 0x7fbda41993f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400e9a0 tx=0x7fbd9400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.643+0000 7fbd9a7fc700 1 -- 172.21.15.8:0/1064528924 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94009790 con 0x7fbda4104340 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.643+0000 7fbdab9ff700 1 -- 172.21.15.8:0/1064528924 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda419aee0 con 0x7fbda4104340 2023-10-06T23:19:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.643+0000 7fbd9a7fc700 1 -- 172.21.15.8:0/1064528924 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd9400ce50 con 0x7fbda4104340 2023-10-06T23:19:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.643+0000 7fbd9a7fc700 1 -- 172.21.15.8:0/1064528924 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94018420 con 0x7fbda4104340 2023-10-06T23:19:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.643+0000 7fbdab9ff700 1 -- 172.21.15.8:0/1064528924 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda4191db0 con 0x7fbda4104340 2023-10-06T23:19:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.648+0000 7fbd9a7fc700 1 -- 172.21.15.8:0/1064528924 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbd94010430 con 0x7fbda4104340 2023-10-06T23:19:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.650+0000 7fbdbf309b80 1 Processor -- start 2023-10-06T23:19:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.650+0000 7fbd9a7fc700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbd900a1500 0x7fbd900a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.650+0000 7fbdbf309b80 1 -- start start 2023-10-06T23:19:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.650+0000 7fbd9a7fc700 1 -- 172.21.15.8:0/1064528924 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbd94014070 con 0x7fbda4104340 2023-10-06T23:19:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda9f9c700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbd900a1500 0x7fbd900a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b113ec0 0x564c2b1142e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b114fd0 0x564c2b115450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b11c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b07c400 con 0x564c2b113ec0 2023-10-06T23:19:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b06dbc0 con 0x564c2b115990 2023-10-06T23:19:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b06b4e0 con 0x564c2b114fd0 2023-10-06T23:19:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda8f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b114fd0 0x564c2b115450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda8f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b114fd0 0x564c2b115450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45434/0 (socket says 172.21.15.8:45434) 2023-10-06T23:19:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda8f9a700 1 -- 172.21.15.8:0/3169784078 learned_addr learned my addr 172.21.15.8:0/3169784078 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda979b700 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b113ec0 0x564c2b1142e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda9f9c700 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b11c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda8f9a700 1 -- 172.21.15.8:0/3169784078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 msgr2=0x564c2b11c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b11c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda8f9a700 1 -- 172.21.15.8:0/3169784078 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b113ec0 msgr2=0x564c2b1142e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b113ec0 0x564c2b1142e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.651+0000 7fbda8f9a700 1 -- 172.21.15.8:0/3169784078 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c2ae91d80 con 0x564c2b114fd0 2023-10-06T23:19:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.652+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b114fd0 0x564c2b115450 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd94096ba0 tx=0x7fbd94010790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a179a797ee12cd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.652+0000 7fbda9f9c700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbd900a1500 0x7fbd900a39c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c007890 tx=0x7fbd9c0075d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.652+0000 7fbd8f7fe700 1 -- 172.21.15.8:0/3169784078 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9409a130 con 0x564c2b114fd0 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.652+0000 7fbd8f7fe700 1 -- 172.21.15.8:0/3169784078 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd9409e280 con 0x564c2b114fd0 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.652+0000 7fbd8f7fe700 1 -- 172.21.15.8:0/3169784078 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd940a2230 con 0x564c2b114fd0 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3169784078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b114fd0 msgr2=0x564c2b115450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b114fd0 0x564c2b115450 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd94096ba0 tx=0x7fbd94010790 comp rx=0 tx=0).stop 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3169784078 shutdown_connections 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b113ec0 0x564c2b1142e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b11c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/3169784078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b114fd0 0x564c2b115450 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3169784078 >> 172.21.15.8:0/3169784078 conn(0x564c2b088200 msgr2=0x564c2b10ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3169784078 shutdown_connections 2023-10-06T23:19:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.653+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3169784078 wait complete. 2023-10-06T23:19:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.654+0000 7fbdbf309b80 1 -- start start 2023-10-06T23:19:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.654+0000 7fbdbf309b80 1 Processor -- start 2023-10-06T23:19:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b11db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b11e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b1250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b066dd0 con 0x564c2b115990 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b0036b0 con 0x564c2b114fd0 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b003350 con 0x564c2b113ec0 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbdbf309b80 10 client.0 _ll_register_callbacks cb 0x564c2ae607a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbda8f9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b11e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbda8f9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b11e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57952/0 (socket says 172.21.15.8:57952) 2023-10-06T23:19:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbda8f9a700 1 -- 172.21.15.8:0/4090664556 learned_addr learned my addr 172.21.15.8:0/4090664556 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.655+0000 7fbda979b700 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b11db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.656+0000 7fbda9f9c700 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b1250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.656+0000 7fbda8f9a700 1 -- 172.21.15.8:0/4090664556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 msgr2=0x564c2b11db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.656+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b11db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.656+0000 7fbda8f9a700 1 -- 172.21.15.8:0/4090664556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 msgr2=0x564c2b1250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.656+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b1250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.656+0000 7fbda8f9a700 1 -- 172.21.15.8:0/4090664556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda4191db0 con 0x564c2b114fd0 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.656+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b11e0b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd940cac80 tx=0x7fbd94010a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6529b2939470c926 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.656+0000 7fbd8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.657+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4090664556 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd940a24c0 con 0x564c2b114fd0 2023-10-06T23:19:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.657+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4090664556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c2b106d50 con 0x564c2b114fd0 2023-10-06T23:19:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.657+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4090664556 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbd9409a130 con 0x564c2b114fd0 2023-10-06T23:19:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.657+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4090664556 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd940b8270 con 0x564c2b114fd0 2023-10-06T23:19:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.657+0000 7fbdbf309b80 10 client.26033 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.657+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4090664556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564c2ae7ac00 con 0x564c2b114fd0 2023-10-06T23:19:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.657+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4090664556 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564c2b106d50 con 0x564c2b114fd0 2023-10-06T23:19:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.658+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4090664556 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd94099090 con 0x564c2b114fd0 2023-10-06T23:19:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.658+0000 7fbdbf309b80 10 client.26033 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.658+0000 7fbdbf309b80 10 client.26033 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.658+0000 7fbdbf309b80 20 client.26033 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.658+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564c2b1297a0 0x564c2b12bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.658+0000 7fbdbf309b80 4 client.26033 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:19:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.658+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4090664556 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c2b05fdb0 con 0x564c2b1297a0 2023-10-06T23:19:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.658+0000 7fbda979b700 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564c2b1297a0 0x564c2b12bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.659+0000 7fbda979b700 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564c2b1297a0 0x564c2b12bbc0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9034dd29bc7689f5 server_cookie=301f2baedc5de23f in_seq=0 out_seq=0 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.659+0000 7fbd8cff9700 10 client.26033 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4090664556 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564c2b05fdb0 con 0x564c2b1297a0 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbd8cff9700 10 client.26033 handle_command_reply: tid=0 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 client.26033 shutdown 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4090664556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 msgr2=0x564c2b11e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b11e0b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd940cac80 tx=0x7fbd94010a80 comp rx=0 tx=0).stop 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4090664556 shutdown_connections 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564c2b1297a0 0x564c2b12bbc0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b1250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b11db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4090664556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b11e0b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4090664556 >> 172.21.15.8:0/4090664556 conn(0x564c2b088200 msgr2=0x564c2b10e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.660+0000 7fbd8cff9700 0 client.26033 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.661+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4090664556 shutdown_connections 2023-10-06T23:19:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.661+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4090664556 wait complete. 2023-10-06T23:19:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.661+0000 7fbdbf309b80 20 client.26033 trim_cache size 0 max 16384 2023-10-06T23:19:47.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.682+0000 7fbdbf309b80 1 Processor -- start 2023-10-06T23:19:47.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.683+0000 7fbdbf309b80 1 -- start start 2023-10-06T23:19:47.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.683+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b10f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.683+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b114fd0 0x564c2b1250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.683+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b12b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.683+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2aee78c0 con 0x564c2b114fd0 2023-10-06T23:19:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.683+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b1102f0 con 0x564c2b115990 2023-10-06T23:19:47.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.683+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b10e980 con 0x564c2b113ec0 2023-10-06T23:19:47.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.683+0000 7fbda9f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b12b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda8f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b114fd0 0x564c2b1250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda9f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b12b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57966/0 (socket says 172.21.15.8:57966) 2023-10-06T23:19:47.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda9f9c700 1 -- 172.21.15.8:0/3829693421 learned_addr learned my addr 172.21.15.8:0/3829693421 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda979b700 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b10f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda8f9a700 1 -- 172.21.15.8:0/3829693421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 msgr2=0x564c2b10f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b10f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda8f9a700 1 -- 172.21.15.8:0/3829693421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 msgr2=0x564c2b12b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b12b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda8f9a700 1 -- 172.21.15.8:0/3829693421 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c2aeb81f0 con 0x564c2b114fd0 2023-10-06T23:19:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda9f9c700 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b12b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:19:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.684+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b114fd0 0x564c2b1250b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbd9409a9e0 tx=0x7fbd94011fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f851cb16a2954a80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.685+0000 7fbd8ffff700 1 -- 172.21.15.8:0/3829693421 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd940a24c0 con 0x564c2b114fd0 2023-10-06T23:19:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.685+0000 7fbd8ffff700 1 -- 172.21.15.8:0/3829693421 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd9409a130 con 0x564c2b114fd0 2023-10-06T23:19:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.685+0000 7fbd8ffff700 1 -- 172.21.15.8:0/3829693421 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94095f20 con 0x564c2b114fd0 2023-10-06T23:19:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3829693421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b114fd0 msgr2=0x564c2b1250b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b114fd0 0x564c2b1250b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbd9409a9e0 tx=0x7fbd94011fe0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3829693421 shutdown_connections 2023-10-06T23:19:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b115990 0x564c2b12b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b10f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/3829693421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b114fd0 0x564c2b1250b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3829693421 >> 172.21.15.8:0/3829693421 conn(0x564c2b088200 msgr2=0x564c2b10eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3829693421 shutdown_connections 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.686+0000 7fbdbf309b80 1 -- 172.21.15.8:0/3829693421 wait complete. 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.687+0000 7fbdbf309b80 1 -- start start 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.687+0000 7fbdbf309b80 1 Processor -- start 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b122510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b122a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbdbf309b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b123a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b123fa0 con 0x564c2b115990 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b124110 con 0x564c2b114fd0 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbdbf309b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2b1242d0 con 0x564c2b113ec0 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbdbf309b80 10 client.0 _ll_register_callbacks cb 0x564c2ae607a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbda979b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b122510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbda979b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b122510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45454/0 (socket says 172.21.15.8:45454) 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.688+0000 7fbda979b700 1 -- 172.21.15.8:0/4233217447 learned_addr learned my addr 172.21.15.8:0/4233217447 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda979b700 1 -- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 msgr2=0x564c2b122a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda979b700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b122a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda9f9c700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b123a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda979b700 1 -- 172.21.15.8:0/4233217447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 msgr2=0x564c2b123a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:19:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda979b700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b123a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda979b700 1 -- 172.21.15.8:0/4233217447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c026050 con 0x564c2b113ec0 2023-10-06T23:19:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b122a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:19:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.689+0000 7fbda9f9c700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b123a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:19:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.690+0000 7fbda979b700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b122510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x564c2b12c460 tx=0x7fbda0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a846667aaacd08b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:19:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.690+0000 7fbd8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:19:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.690+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4233217447 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0025050 con 0x564c2b113ec0 2023-10-06T23:19:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.690+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4233217447 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbda0026a60 con 0x564c2b113ec0 2023-10-06T23:19:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.690+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4233217447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd9409e280 con 0x564c2b113ec0 2023-10-06T23:19:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.690+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4233217447 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbda0019040 con 0x564c2b113ec0 2023-10-06T23:19:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.690+0000 7fbdbf309b80 10 client.26071 fetch_fsmap learned FSMap version 35 2023-10-06T23:19:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.690+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4233217447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564c2ae7ac00 con 0x564c2b113ec0 2023-10-06T23:19:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.691+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4233217447 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd9409e280 con 0x564c2b113ec0 2023-10-06T23:19:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.691+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4233217447 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 35) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbda00203f0 con 0x564c2b113ec0 2023-10-06T23:19:47.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.691+0000 7fbdbf309b80 10 client.26071 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T23:19:47.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.691+0000 7fbdbf309b80 10 client.26071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:19:47.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.691+0000 7fbdbf309b80 20 client.26071 populate_metadata read hostname 'smithi008' 2023-10-06T23:19:47.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.691+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564c2b17dcb0 0x564c2b1800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:19:47.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.692+0000 7fbdbf309b80 4 client.26071 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:19:47.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.692+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4233217447 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564c2b05fad0 con 0x564c2b17dcb0 2023-10-06T23:19:47.697 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.692+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564c2b17dcb0 0x564c2b1800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:19:47.698 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.692+0000 7fbda8f9a700 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564c2b17dcb0 0x564c2b1800a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=487aeb2fd9e29b2c server_cookie=daf2b6797d8c5cb2 in_seq=0 out_seq=0 2023-10-06T23:19:47.698 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.692+0000 7fbd8cff9700 10 client.26071 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbd8cff9700 1 -- 172.21.15.8:0/4233217447 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564c2b05fad0 con 0x564c2b17dcb0 2023-10-06T23:19:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbd8cff9700 10 client.26071 handle_command_reply: tid=0 2023-10-06T23:19:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 client.26071 shutdown 2023-10-06T23:19:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4233217447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 msgr2=0x564c2b122510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b122510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x564c2b12c460 tx=0x7fbda0009310 comp rx=0 tx=0).stop 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4233217447 shutdown_connections 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564c2b17dcb0 0x564c2b1800a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564c2b115990 0x564c2b123a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c2b113ec0 0x564c2b122510 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbd8cff9700 0 client.26071 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 --2- 172.21.15.8:0/4233217447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564c2b114fd0 0x564c2b122a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.710+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4233217447 >> 172.21.15.8:0/4233217447 conn(0x564c2b088200 msgr2=0x564c2b10f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.711+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4233217447 shutdown_connections 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.711+0000 7fbdbf309b80 1 -- 172.21.15.8:0/4233217447 wait complete. 2023-10-06T23:19:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.711+0000 7fbdbf309b80 20 client.26071 trim_cache size 0 max 16384 2023-10-06T23:19:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:19:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:19:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:19:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.711+0000 7fbdab9ff700 1 -- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbd900a1500 msgr2=0x7fbd900a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbd900a1500 0x7fbd900a39c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c007890 tx=0x7fbd9c0075d0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 -- 172.21.15.8:0/1064528924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda4104340 msgr2=0x7fbda41993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda4104340 0x7fbda41993f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400e9a0 tx=0x7fbd9400ecb0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 -- 172.21.15.8:0/1064528924 shutdown_connections 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbd900a1500 0x7fbd900a39c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbda4101a10 0x7fbda4198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbda4106c70 0x7fbda419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 --2- 172.21.15.8:0/1064528924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbda4104340 0x7fbda41993f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:19:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 -- 172.21.15.8:0/1064528924 >> 172.21.15.8:0/1064528924 conn(0x7fbda40fb340 msgr2=0x7fbda4102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:19:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 -- 172.21.15.8:0/1064528924 shutdown_connections 2023-10-06T23:19:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:19:47.712+0000 7fbdab9ff700 1 -- 172.21.15.8:0/1064528924 wait complete. 2023-10-06T23:19:48.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:48 smithi156 ceph-mon[102862]: daemon mds.h restarted 2023-10-06T23:19:48.599 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:19:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-h[139022]: ignoring --setuser ceph since I am not root 2023-10-06T23:19:48.599 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:19:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-h[139022]: ignoring --setgroup ceph since I am not root 2023-10-06T23:19:48.599 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:19:48 smithi156 ceph-mds[139046]: -- 172.21.15.156:0/2069221626 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606493fd1e0 con 0x5606493d2c00 2023-10-06T23:19:48.599 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:19:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-h[139022]: starting mds.h at 2023-10-06T23:19:48.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:48 smithi008 ceph-mon[98532]: daemon mds.h restarted 2023-10-06T23:19:48.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:48 smithi190 ceph-mon[102658]: daemon mds.h restarted 2023-10-06T23:19:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 295.0 s, 215.0 tps, lat 473.817 ms stddev 247.446 2023-10-06T23:19:49.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:49 smithi008 ceph-mon[98532]: osdmap e89: 12 total, 12 up, 12 in 2023-10-06T23:19:49.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:49 smithi008 ceph-mon[98532]: mds.? [v2:172.21.15.156:6836/173803172,v1:172.21.15.156:6837/173803172] up:boot 2023-10-06T23:19:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:49 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-06T23:19:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:49 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-06T23:19:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:49 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:19:49.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:49 smithi008 ceph-mon[98532]: pgmap v559: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 7.6 MiB/s wr, 563 op/s 2023-10-06T23:19:49.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:49 smithi190 ceph-mon[102658]: osdmap e89: 12 total, 12 up, 12 in 2023-10-06T23:19:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:49 smithi190 ceph-mon[102658]: mds.? [v2:172.21.15.156:6836/173803172,v1:172.21.15.156:6837/173803172] up:boot 2023-10-06T23:19:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:49 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-06T23:19:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:49 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-06T23:19:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:49 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:19:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:49 smithi190 ceph-mon[102658]: pgmap v559: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 7.6 MiB/s wr, 563 op/s 2023-10-06T23:19:49.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:49 smithi156 ceph-mon[102862]: osdmap e89: 12 total, 12 up, 12 in 2023-10-06T23:19:49.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:49 smithi156 ceph-mon[102862]: mds.? [v2:172.21.15.156:6836/173803172,v1:172.21.15.156:6837/173803172] up:boot 2023-10-06T23:19:49.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:49 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-10-06T23:19:49.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:49 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-06T23:19:49.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:49 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:19:49.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:49 smithi156 ceph-mon[102862]: pgmap v559: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 7.6 MiB/s wr, 563 op/s 2023-10-06T23:19:51.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:51 smithi190 ceph-mon[102658]: pgmap v560: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 9.3 MiB/s wr, 625 op/s 2023-10-06T23:19:51.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:51 smithi156 ceph-mon[102862]: pgmap v560: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 9.3 MiB/s wr, 625 op/s 2023-10-06T23:19:51.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:51 smithi008 ceph-mon[98532]: pgmap v560: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 9.3 MiB/s wr, 625 op/s 2023-10-06T23:19:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:53 smithi008 ceph-mon[98532]: pgmap v561: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 8.0 MiB/s wr, 533 op/s 2023-10-06T23:19:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:53 smithi190 ceph-mon[102658]: pgmap v561: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 8.0 MiB/s wr, 533 op/s 2023-10-06T23:19:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:53 smithi156 ceph-mon[102862]: pgmap v561: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 8.0 MiB/s wr, 533 op/s 2023-10-06T23:19:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 300.0 s, 256.8 tps, lat 381.584 ms stddev 75.041 2023-10-06T23:19:55.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:55 smithi190 ceph-mon[102658]: pgmap v562: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 5.6 MiB/s wr, 432 op/s 2023-10-06T23:19:55.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:55 smithi156 ceph-mon[102862]: pgmap v562: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 5.6 MiB/s wr, 432 op/s 2023-10-06T23:19:55.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:55 smithi008 ceph-mon[98532]: pgmap v562: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 5.6 MiB/s wr, 432 op/s 2023-10-06T23:19:57.447 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:57 smithi190 ceph-mon[102658]: pgmap v563: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.1 MiB/s wr, 527 op/s 2023-10-06T23:19:57.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:57 smithi156 ceph-mon[102862]: pgmap v563: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.1 MiB/s wr, 527 op/s 2023-10-06T23:19:57.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:57 smithi008 ceph-mon[98532]: pgmap v563: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.1 MiB/s wr, 527 op/s 2023-10-06T23:19:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 305.0 s, 235.0 tps, lat 425.938 ms stddev 220.184 2023-10-06T23:19:59.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:19:59 smithi190 ceph-mon[102658]: pgmap v564: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 6.8 MiB/s wr, 519 op/s 2023-10-06T23:19:59.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:19:59 smithi156 ceph-mon[102862]: pgmap v564: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 6.8 MiB/s wr, 519 op/s 2023-10-06T23:19:59.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:19:59 smithi008 ceph-mon[98532]: pgmap v564: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 6.8 MiB/s wr, 519 op/s 2023-10-06T23:20:00.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:00 smithi190 ceph-mon[102658]: overall HEALTH_OK 2023-10-06T23:20:00.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:00 smithi156 ceph-mon[102862]: overall HEALTH_OK 2023-10-06T23:20:00.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:00 smithi008 ceph-mon[98532]: overall HEALTH_OK 2023-10-06T23:20:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 -- 172.21.15.8:0/3113479245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c106bd0 msgr2=0x7f879c109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3113479245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c106bd0 0x7f879c109040 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f879400f490 tx=0x7f879400f7a0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 -- 172.21.15.8:0/3113479245 shutdown_connections 2023-10-06T23:20:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3113479245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c106bd0 0x7f879c109040 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3113479245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f879c101970 0x7f879c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3113479245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f879c1042a0 0x7f879c106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 -- 172.21.15.8:0/3113479245 >> 172.21.15.8:0/3113479245 conn(0x7f879c0fb340 msgr2=0x7f879c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 -- 172.21.15.8:0/3113479245 shutdown_connections 2023-10-06T23:20:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.908+0000 7f87a13ff700 1 -- 172.21.15.8:0/3113479245 wait complete. 2023-10-06T23:20:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.909+0000 7f87a13ff700 1 Processor -- start 2023-10-06T23:20:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.909+0000 7f87a13ff700 1 -- start start 2023-10-06T23:20:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f87a13ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f879c101970 0x7f879c194ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f87a13ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c1042a0 0x7f879c195000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f87a13ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f879c106bd0 0x7f879c195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f87a13ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c1964e0 con 0x7f879c106bd0 2023-10-06T23:20:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f87a13ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c196650 con 0x7f879c101970 2023-10-06T23:20:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f87a13ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c196810 con 0x7f879c1042a0 2023-10-06T23:20:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f879affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f879c101970 0x7f879c194ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f879c106bd0 0x7f879c195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f879affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f879c101970 0x7f879c194ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35390/0 (socket says 172.21.15.8:35390) 2023-10-06T23:20:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f879affd700 1 -- 172.21.15.8:0/3766933828 learned_addr learned my addr 172.21.15.8:0/3766933828 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f879a7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c1042a0 0x7f879c195000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f879b7fe700 1 -- 172.21.15.8:0/3766933828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c1042a0 msgr2=0x7f879c195000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.910+0000 7f879b7fe700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c1042a0 0x7f879c195000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.911+0000 7f879b7fe700 1 -- 172.21.15.8:0/3766933828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f879c101970 msgr2=0x7f879c194ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.911+0000 7f879b7fe700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f879c101970 0x7f879c194ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.911+0000 7f879b7fe700 1 -- 172.21.15.8:0/3766933828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900095f0 con 0x7f879c106bd0 2023-10-06T23:20:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.911+0000 7f879b7fe700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f879c106bd0 0x7f879c195e80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8794009f30 tx=0x7f8794018f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.911+0000 7f8783fff700 1 -- 172.21.15.8:0/3766933828 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794003c10 con 0x7f879c106bd0 2023-10-06T23:20:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.911+0000 7f87a13ff700 1 -- 172.21.15.8:0/3766933828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8794009c40 con 0x7f879c106bd0 2023-10-06T23:20:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.911+0000 7f8783fff700 1 -- 172.21.15.8:0/3766933828 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8794003d70 con 0x7f879c106bd0 2023-10-06T23:20:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.911+0000 7f8783fff700 1 -- 172.21.15.8:0/3766933828 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940056a0 con 0x7f879c106bd0 2023-10-06T23:20:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.912+0000 7f87a13ff700 1 -- 172.21.15.8:0/3766933828 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c19d0d0 con 0x7f879c106bd0 2023-10-06T23:20:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.915+0000 7f8783fff700 1 -- 172.21.15.8:0/3766933828 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8794007b20 con 0x7f879c106bd0 2023-10-06T23:20:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.917+0000 7f87b4e04b80 1 Processor -- start 2023-10-06T23:20:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.917+0000 7f87b4e04b80 1 -- start start 2023-10-06T23:20:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.917+0000 7f8783fff700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87840a1480 0x7f87840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f8783fff700 1 -- 172.21.15.8:0/3766933828 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f87940d1a40 con 0x7f879c106bd0 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 0x562e29d97450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d9e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29cfe400 con 0x562e29d96fd0 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29cefbc0 con 0x562e29d95ec0 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29ced4e0 con 0x562e29d97990 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879a7fc700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87840a1480 0x7f87840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35406/0 (socket says 172.21.15.8:35406) 2023-10-06T23:20:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879affd700 1 -- 172.21.15.8:0/896560370 learned_addr learned my addr 172.21.15.8:0/896560370 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879b7fe700 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d9e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879a7fc700 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 0x562e29d97450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879affd700 1 -- 172.21.15.8:0/896560370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 msgr2=0x562e29d9e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879affd700 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d9e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879affd700 1 -- 172.21.15.8:0/896560370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 msgr2=0x562e29d97450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879affd700 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 0x562e29d97450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.918+0000 7f879affd700 1 -- 172.21.15.8:0/896560370 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e29b13d80 con 0x562e29d95ec0 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.919+0000 7f879affd700 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d962e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f878c009e50 tx=0x7f878c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177384d1645bf2c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.919+0000 7f879a7fc700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87840a1480 0x7f87840a3940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8790005fd0 tx=0x7f8790009e90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.919+0000 7f87817fa700 1 -- 172.21.15.8:0/896560370 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c004a30 con 0x562e29d95ec0 2023-10-06T23:20:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.919+0000 7f87817fa700 1 -- 172.21.15.8:0/896560370 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f878c0054b0 con 0x562e29d95ec0 2023-10-06T23:20:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.919+0000 7f87817fa700 1 -- 172.21.15.8:0/896560370 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0197d0 con 0x562e29d95ec0 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.920+0000 7f87b4e04b80 1 -- 172.21.15.8:0/896560370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 msgr2=0x562e29d962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.920+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d962e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f878c009e50 tx=0x7f878c011720 comp rx=0 tx=0).stop 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.920+0000 7f87b4e04b80 1 -- 172.21.15.8:0/896560370 shutdown_connections 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.920+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d9e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.920+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d962e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.920+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/896560370 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 0x562e29d97450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.920+0000 7f87b4e04b80 1 -- 172.21.15.8:0/896560370 >> 172.21.15.8:0/896560370 conn(0x562e29d0a200 msgr2=0x562e29d90bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.920+0000 7f87b4e04b80 1 -- 172.21.15.8:0/896560370 shutdown_connections 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.921+0000 7f87b4e04b80 1 -- 172.21.15.8:0/896560370 wait complete. 2023-10-06T23:20:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.921+0000 7f87b4e04b80 1 -- start start 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.921+0000 7f87b4e04b80 1 Processor -- start 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.922+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29da81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.922+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d96fd0 0x562e29da8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.922+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d97990 0x562e29daf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.922+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29ce8dd0 con 0x562e29d97990 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.922+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29c856b0 con 0x562e29d95ec0 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.922+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29c85350 con 0x562e29d96fd0 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.922+0000 7f87b4e04b80 10 client.0 _ll_register_callbacks cb 0x562e29ae27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29da81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d97990 0x562e29daf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d97990 0x562e29daf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58256/0 (socket says 172.21.15.8:58256) 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879b7fe700 1 -- 172.21.15.8:0/3045731005 learned_addr learned my addr 172.21.15.8:0/3045731005 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29da81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35422/0 (socket says 172.21.15.8:35422) 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879a7fc700 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d96fd0 0x562e29da8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879b7fe700 1 -- 172.21.15.8:0/3045731005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d96fd0 msgr2=0x562e29da8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879b7fe700 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d96fd0 0x562e29da8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879b7fe700 1 -- 172.21.15.8:0/3045731005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 msgr2=0x562e29da81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879b7fe700 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29da81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.923+0000 7f879b7fe700 1 -- 172.21.15.8:0/3045731005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c009a80 con 0x562e29d97990 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f879b7fe700 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d97990 0x562e29daf750 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f879401a040 tx=0x7f8794009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421faf1853c32f5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f877eff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f877eff5700 1 -- 172.21.15.8:0/3045731005 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940a2070 con 0x562e29d97990 2023-10-06T23:20:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f87b4e04b80 1 -- 172.21.15.8:0/3045731005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e29d88d50 con 0x562e29d97990 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f877eff5700 1 -- 172.21.15.8:0/3045731005 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f879409f4a0 con 0x562e29d97990 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f877eff5700 1 -- 172.21.15.8:0/3045731005 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f879409e700 con 0x562e29d97990 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f87b4e04b80 10 client.16209 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f87b4e04b80 1 -- 172.21.15.8:0/3045731005 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562e29afcc00 con 0x562e29d97990 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.924+0000 7f877eff5700 1 -- 172.21.15.8:0/3045731005 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e29d88d50 con 0x562e29d97990 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.925+0000 7f877eff5700 1 -- 172.21.15.8:0/3045731005 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8794005800 con 0x562e29d97990 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.925+0000 7f87b4e04b80 10 client.16209 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.925+0000 7f87b4e04b80 10 client.16209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.925+0000 7f87b4e04b80 20 client.16209 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.925+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562e29db3df0 0x562e29db61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.925+0000 7f87b4e04b80 4 client.16209 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:20:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.925+0000 7f87b4e04b80 1 -- 172.21.15.8:0/3045731005 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e29ce1db0 con 0x562e29db3df0 2023-10-06T23:20:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.925+0000 7f879affd700 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562e29db3df0 0x562e29db61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.926+0000 7f879affd700 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562e29db3df0 0x562e29db61e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=800ebe150f89fff8 server_cookie=f43766bd719a77eb in_seq=0 out_seq=0 2023-10-06T23:20:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.926+0000 7f877eff5700 10 client.16209 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.927+0000 7f877eff5700 1 -- 172.21.15.8:0/3045731005 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562e29ce1db0 con 0x562e29db3df0 2023-10-06T23:20:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.927+0000 7f877eff5700 10 client.16209 handle_command_reply: tid=0 2023-10-06T23:20:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.927+0000 7f87b4e04b80 1 client.16209 shutdown 2023-10-06T23:20:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 -- 172.21.15.8:0/3045731005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d97990 msgr2=0x562e29daf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d97990 0x562e29daf750 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f879401a040 tx=0x7f8794009040 comp rx=0 tx=0).stop 2023-10-06T23:20:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 -- 172.21.15.8:0/3045731005 shutdown_connections 2023-10-06T23:20:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562e29db3df0 0x562e29db61e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d97990 0x562e29daf750 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29da81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/3045731005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d96fd0 0x562e29da8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 -- 172.21.15.8:0/3045731005 >> 172.21.15.8:0/3045731005 conn(0x562e29d0a200 msgr2=0x562e29d90250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f877eff5700 0 client.16209 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 -- 172.21.15.8:0/3045731005 shutdown_connections 2023-10-06T23:20:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 1 -- 172.21.15.8:0/3045731005 wait complete. 2023-10-06T23:20:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.928+0000 7f87b4e04b80 20 client.16209 trim_cache size 0 max 16384 2023-10-06T23:20:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.949+0000 7f87b4e04b80 1 Processor -- start 2023-10-06T23:20:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.949+0000 7f87b4e04b80 1 -- start start 2023-10-06T23:20:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 0x562e29daf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d919f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29b698c0 con 0x562e29d96fd0 2023-10-06T23:20:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29d91f60 con 0x562e29d95ec0 2023-10-06T23:20:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29d9db80 con 0x562e29d97990 2023-10-06T23:20:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f879affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f879affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:35426/0 (socket says 172.21.15.8:35426) 2023-10-06T23:20:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f879affd700 1 -- 172.21.15.8:0/2711718240 learned_addr learned my addr 172.21.15.8:0/2711718240 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f879b7fe700 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d919f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.950+0000 7f879a7fc700 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 0x562e29daf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.951+0000 7f879affd700 1 -- 172.21.15.8:0/2711718240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 msgr2=0x562e29d919f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.951+0000 7f879affd700 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d919f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.951+0000 7f879affd700 1 -- 172.21.15.8:0/2711718240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 msgr2=0x562e29daf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.951+0000 7f879affd700 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 0x562e29daf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.951+0000 7f879affd700 1 -- 172.21.15.8:0/2711718240 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e29b3a1f0 con 0x562e29d95ec0 2023-10-06T23:20:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.951+0000 7f879b7fe700 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d919f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:20:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.951+0000 7f879affd700 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d973b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f878c009e50 tx=0x7f878c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=312904e6335dd235 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.952+0000 7f8781ffb700 1 -- 172.21.15.8:0/2711718240 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c029040 con 0x562e29d95ec0 2023-10-06T23:20:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.952+0000 7f8781ffb700 1 -- 172.21.15.8:0/2711718240 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f878c005ce0 con 0x562e29d95ec0 2023-10-06T23:20:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.952+0000 7f8781ffb700 1 -- 172.21.15.8:0/2711718240 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0038e0 con 0x562e29d95ec0 2023-10-06T23:20:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.952+0000 7f87b4e04b80 1 -- 172.21.15.8:0/2711718240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 msgr2=0x562e29d973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.952+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d973b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f878c009e50 tx=0x7f878c011720 comp rx=0 tx=0).stop 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 -- 172.21.15.8:0/2711718240 shutdown_connections 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29d919f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d95ec0 0x562e29d973b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/2711718240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d96fd0 0x562e29daf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 -- 172.21.15.8:0/2711718240 >> 172.21.15.8:0/2711718240 conn(0x562e29d0a200 msgr2=0x562e29dbab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 -- 172.21.15.8:0/2711718240 shutdown_connections 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 -- 172.21.15.8:0/2711718240 wait complete. 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 -- start start 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.953+0000 7f87b4e04b80 1 Processor -- start 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d95ec0 0x562e29dad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d96fd0 0x562e29dada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f87b4e04b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29daea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29daef50 con 0x562e29d95ec0 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29daf0c0 con 0x562e29d96fd0 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f87b4e04b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e29daf280 con 0x562e29d97990 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f87b4e04b80 10 client.0 _ll_register_callbacks cb 0x7f879409b0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f879affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d95ec0 0x562e29dad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f879affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d95ec0 0x562e29dad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58282/0 (socket says 172.21.15.8:58282) 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f879affd700 1 -- 172.21.15.8:0/1291331818 learned_addr learned my addr 172.21.15.8:0/1291331818 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f879a7fc700 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d96fd0 0x562e29dada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.954+0000 7f879b7fe700 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29daea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f879affd700 1 -- 172.21.15.8:0/1291331818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 msgr2=0x562e29daea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f879affd700 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29daea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f879affd700 1 -- 172.21.15.8:0/1291331818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d96fd0 msgr2=0x562e29dada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f879affd700 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d96fd0 0x562e29dada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f879affd700 1 -- 172.21.15.8:0/1291331818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e29b13d80 con 0x562e29d95ec0 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f879affd700 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d95ec0 0x562e29dad4c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f878c006010 tx=0x7f878c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2662576f6b6114b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f877eff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f877eff5700 1 -- 172.21.15.8:0/1291331818 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c029050 con 0x562e29d95ec0 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.955+0000 7f87b4e04b80 1 -- 172.21.15.8:0/1291331818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f878c0054b0 con 0x562e29d95ec0 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f877eff5700 1 -- 172.21.15.8:0/1291331818 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f878c003a90 con 0x562e29d95ec0 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f877eff5700 1 -- 172.21.15.8:0/1291331818 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f878c003c50 con 0x562e29d95ec0 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f87b4e04b80 10 client.16215 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f87b4e04b80 1 -- 172.21.15.8:0/1291331818 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562e29b12250 con 0x562e29d95ec0 2023-10-06T23:20:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f877eff5700 1 -- 172.21.15.8:0/1291331818 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f878c0054b0 con 0x562e29d95ec0 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f877eff5700 1 -- 172.21.15.8:0/1291331818 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f878c011440 con 0x562e29d95ec0 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f87b4e04b80 10 client.16215 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f87b4e04b80 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f87b4e04b80 20 client.16215 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562e29e087b0 0x562e29e0abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f87b4e04b80 4 client.16215 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.956+0000 7f87b4e04b80 1 -- 172.21.15.8:0/1291331818 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562e29ce1ad0 con 0x562e29e087b0 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.957+0000 7f879a7fc700 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562e29e087b0 0x562e29e0abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.957+0000 7f879a7fc700 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562e29e087b0 0x562e29e0abd0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f80382397d84db server_cookie=c9ee1d55b7da9ad5 in_seq=0 out_seq=0 2023-10-06T23:20:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.957+0000 7f877eff5700 10 client.16215 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.974+0000 7f877eff5700 1 -- 172.21.15.8:0/1291331818 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562e29ce1ad0 con 0x562e29e087b0 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.974+0000 7f877eff5700 10 client.16215 handle_command_reply: tid=0 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.974+0000 7f87b4e04b80 1 client.16215 shutdown 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 -- 172.21.15.8:0/1291331818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d95ec0 msgr2=0x562e29dad4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d95ec0 0x562e29dad4c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f878c006010 tx=0x7f878c02bf80 comp rx=0 tx=0).stop 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 -- 172.21.15.8:0/1291331818 shutdown_connections 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562e29e087b0 0x562e29e0abd0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562e29d95ec0 0x562e29dad4c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e29d97990 0x562e29daea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 --2- 172.21.15.8:0/1291331818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e29d96fd0 0x562e29dada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 -- 172.21.15.8:0/1291331818 >> 172.21.15.8:0/1291331818 conn(0x562e29d0a200 msgr2=0x562e29d90b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f877eff5700 0 client.16215 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 -- 172.21.15.8:0/1291331818 shutdown_connections 2023-10-06T23:20:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.975+0000 7f87b4e04b80 1 -- 172.21.15.8:0/1291331818 wait complete. 2023-10-06T23:20:00.978 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.976+0000 7f87b4e04b80 20 client.16215 trim_cache size 0 max 16384 2023-10-06T23:20:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:20:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:20:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:20:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:20:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 -- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87840a1480 msgr2=0x7f87840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87840a1480 0x7f87840a3940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8790005fd0 tx=0x7f8790009e90 comp rx=0 tx=0).stop 2023-10-06T23:20:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 -- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f879c106bd0 msgr2=0x7f879c195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f879c106bd0 0x7f879c195e80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8794009f30 tx=0x7f8794018f80 comp rx=0 tx=0).stop 2023-10-06T23:20:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 -- 172.21.15.8:0/3766933828 shutdown_connections 2023-10-06T23:20:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87840a1480 0x7f87840a3940 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f879c106bd0 0x7f879c195e80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f879c101970 0x7f879c194ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 --2- 172.21.15.8:0/3766933828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c1042a0 0x7f879c195000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 -- 172.21.15.8:0/3766933828 >> 172.21.15.8:0/3766933828 conn(0x7f879c0fb340 msgr2=0x7f879c1025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 -- 172.21.15.8:0/3766933828 shutdown_connections 2023-10-06T23:20:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:00.977+0000 7f87a13ff700 1 -- 172.21.15.8:0/3766933828 wait complete. 2023-10-06T23:20:01.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:01 smithi190 ceph-mon[102658]: pgmap v565: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 9.0 MiB/s wr, 577 op/s 2023-10-06T23:20:01.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:01 smithi156 ceph-mon[102862]: pgmap v565: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 9.0 MiB/s wr, 577 op/s 2023-10-06T23:20:01.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:01 smithi008 ceph-mon[98532]: pgmap v565: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 9.0 MiB/s wr, 577 op/s 2023-10-06T23:20:03.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:03 smithi008 ceph-mon[98532]: pgmap v566: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 6.6 MiB/s wr, 424 op/s 2023-10-06T23:20:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:03 smithi190 ceph-mon[102658]: pgmap v566: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 6.6 MiB/s wr, 424 op/s 2023-10-06T23:20:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:03 smithi156 ceph-mon[102862]: pgmap v566: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 6.6 MiB/s wr, 424 op/s 2023-10-06T23:20:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 310.0 s, 231.4 tps, lat 403.693 ms stddev 117.337 2023-10-06T23:20:05.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:05 smithi190 ceph-mon[102658]: pgmap v567: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 6.7 MiB/s wr, 445 op/s 2023-10-06T23:20:05.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:05 smithi156 ceph-mon[102862]: pgmap v567: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 6.7 MiB/s wr, 445 op/s 2023-10-06T23:20:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:05 smithi008 ceph-mon[98532]: pgmap v567: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 6.7 MiB/s wr, 445 op/s 2023-10-06T23:20:07.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:07 smithi190 ceph-mon[102658]: pgmap v568: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 7.9 MiB/s wr, 534 op/s 2023-10-06T23:20:07.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:07 smithi156 ceph-mon[102862]: pgmap v568: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 7.9 MiB/s wr, 534 op/s 2023-10-06T23:20:07.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:07 smithi008 ceph-mon[98532]: pgmap v568: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 7.9 MiB/s wr, 534 op/s 2023-10-06T23:20:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 315.0 s, 257.6 tps, lat 411.106 ms stddev 238.879 2023-10-06T23:20:09.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:09 smithi190 ceph-mon[102658]: pgmap v569: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 7.4 MiB/s wr, 468 op/s 2023-10-06T23:20:09.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:09 smithi156 ceph-mon[102862]: pgmap v569: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 7.4 MiB/s wr, 468 op/s 2023-10-06T23:20:09.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:09 smithi008 ceph-mon[98532]: pgmap v569: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 7.4 MiB/s wr, 468 op/s 2023-10-06T23:20:11.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:11 smithi190 ceph-mon[102658]: pgmap v570: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 8.2 MiB/s wr, 498 op/s 2023-10-06T23:20:11.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:11 smithi156 ceph-mon[102862]: pgmap v570: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 8.2 MiB/s wr, 498 op/s 2023-10-06T23:20:11.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:11 smithi008 ceph-mon[98532]: pgmap v570: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 8.2 MiB/s wr, 498 op/s 2023-10-06T23:20:13.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:13 smithi008 ceph-mon[98532]: pgmap v571: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 5.2 MiB/s wr, 368 op/s 2023-10-06T23:20:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:13 smithi190 ceph-mon[102658]: pgmap v571: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 5.2 MiB/s wr, 368 op/s 2023-10-06T23:20:13.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:13 smithi156 ceph-mon[102862]: pgmap v571: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 5.2 MiB/s wr, 368 op/s 2023-10-06T23:20:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 320.0 s, 188.0 tps, lat 499.135 ms stddev 268.936 2023-10-06T23:20:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.190+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2958133161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 msgr2=0x7f1ce410b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.190+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2958133161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 0x7f1ce410b570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0098f0 tx=0x7f1cdc009c00 comp rx=0 tx=0).stop 2023-10-06T23:20:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.191+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2958133161 shutdown_connections 2023-10-06T23:20:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.191+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2958133161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 0x7f1ce410b570 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.191+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2958133161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce4103130 0x7f1ce4103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.191+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2958133161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ce4104320 0x7f1ce4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.191+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2958133161 >> 172.21.15.8:0/2958133161 conn(0x7f1ce40fe6a0 msgr2=0x7f1ce4100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.191+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2958133161 shutdown_connections 2023-10-06T23:20:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.191+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2958133161 wait complete. 2023-10-06T23:20:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.192+0000 7f1ce8fff700 1 Processor -- start 2023-10-06T23:20:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.192+0000 7f1ce8fff700 1 -- start start 2023-10-06T23:20:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.193+0000 7f1ce8fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce4103130 0x7f1ce406f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.193+0000 7f1ce8fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ce4104320 0x7f1ce406fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.193+0000 7f1ce8fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 0x7f1ce4070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.193+0000 7f1ce8fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4079430 con 0x7f1ce4104320 2023-10-06T23:20:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.193+0000 7f1ce8fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40795a0 con 0x7f1ce4103130 2023-10-06T23:20:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.193+0000 7f1ce8fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4071180 con 0x7f1ce4104cc0 2023-10-06T23:20:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ce4104320 0x7f1ce406fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ce4104320 0x7f1ce406fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54002/0 (socket says 172.21.15.8:54002) 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1cdbfff700 1 -- 172.21.15.8:0/2032380966 learned_addr learned my addr 172.21.15.8:0/2032380966 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1ce259c700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce4103130 0x7f1ce406f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 0x7f1ce4070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1ce259c700 1 -- 172.21.15.8:0/2032380966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 msgr2=0x7f1ce4070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1ce259c700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 0x7f1ce4070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1ce259c700 1 -- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ce4104320 msgr2=0x7f1ce406fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1ce259c700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ce4104320 0x7f1ce406fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1ce259c700 1 -- 172.21.15.8:0/2032380966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc009520 con 0x7f1ce4103130 2023-10-06T23:20:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.194+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 0x7f1ce4070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:20:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.195+0000 7f1ce259c700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce4103130 0x7f1ce406f7b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400eee0 tx=0x7f1cd400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.195+0000 7f1cdb7fe700 1 -- 172.21.15.8:0/2032380966 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4018070 con 0x7f1ce4103130 2023-10-06T23:20:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.195+0000 7f1cdb7fe700 1 -- 172.21.15.8:0/2032380966 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cd400f040 con 0x7f1ce4103130 2023-10-06T23:20:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.195+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2032380966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce4071400 con 0x7f1ce4103130 2023-10-06T23:20:14.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.195+0000 7f1cdb7fe700 1 -- 172.21.15.8:0/2032380966 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4004280 con 0x7f1ce4103130 2023-10-06T23:20:14.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.195+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2032380966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce4071910 con 0x7f1ce4103130 2023-10-06T23:20:14.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.201+0000 7f1cdb7fe700 1 -- 172.21.15.8:0/2032380966 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1cd400ca70 con 0x7f1ce4103130 2023-10-06T23:20:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.202+0000 7f1cfc83eb80 1 Processor -- start 2023-10-06T23:20:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.203+0000 7f1cfc83eb80 1 -- start start 2023-10-06T23:20:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.203+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c4ec0 0x55e8b87c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.203+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87c6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.203+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c6990 0x55e8b87cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.203+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b872d400 con 0x55e8b87c4ec0 2023-10-06T23:20:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.203+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b871ebc0 con 0x55e8b87c5fd0 2023-10-06T23:20:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.203+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b871c4e0 con 0x55e8b87c6990 2023-10-06T23:20:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.204+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c6990 0x55e8b87cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.204+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c6990 0x55e8b87cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49386/0 (socket says 172.21.15.8:49386) 2023-10-06T23:20:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.204+0000 7f1cdbfff700 1 -- 172.21.15.8:0/3289550344 learned_addr learned my addr 172.21.15.8:0/3289550344 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.204+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c4ec0 0x55e8b87c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.204+0000 7f1ce259c700 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1cdbfff700 1 -- 172.21.15.8:0/3289550344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 msgr2=0x55e8b87c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1cdb7fe700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1cd00a1650 0x7f1cd00a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1cdbfff700 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1cdbfff700 1 -- 172.21.15.8:0/3289550344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c4ec0 msgr2=0x55e8b87c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1cdbfff700 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c4ec0 0x55e8b87c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1cdbfff700 1 -- 172.21.15.8:0/3289550344 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8b8542d80 con 0x55e8b87c6990 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c4ec0 0x55e8b87c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1cdb7fe700 1 -- 172.21.15.8:0/2032380966 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1cd40ccac0 con 0x7f1ce4103130 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1cdbfff700 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c6990 0x55e8b87cd220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009e00 tx=0x7f1ccc011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=777adae9e78ac871 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.205+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1cd00a1650 0x7f1cd00a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.206+0000 7f1cd8ff9700 1 -- 172.21.15.8:0/3289550344 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc019630 con 0x55e8b87c6990 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.206+0000 7f1cd8ff9700 1 -- 172.21.15.8:0/3289550344 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ccc019c20 con 0x55e8b87c6990 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.206+0000 7f1cd8ff9700 1 -- 172.21.15.8:0/3289550344 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00eb90 con 0x55e8b87c6990 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3289550344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c6990 msgr2=0x55e8b87cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c6990 0x55e8b87cd220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009e00 tx=0x7f1ccc011720 comp rx=0 tx=0).stop 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1cd00a1650 0x7f1cd00a3b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009fd0 tx=0x7f1cdc019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3289550344 shutdown_connections 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c4ec0 0x55e8b87c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c6990 0x55e8b87cd220 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/3289550344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3289550344 >> 172.21.15.8:0/3289550344 conn(0x55e8b8739200 msgr2=0x55e8b87bfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3289550344 shutdown_connections 2023-10-06T23:20:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.207+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3289550344 wait complete. 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.208+0000 7f1cfc83eb80 1 -- start start 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.208+0000 7f1cfc83eb80 1 Processor -- start 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.209+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.209+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.209+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.209+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b8717dd0 con 0x55e8b87c6990 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.209+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b86b46b0 con 0x55e8b87c5fd0 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.209+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b86b4350 con 0x55e8b87c4ec0 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.209+0000 7f1cfc83eb80 10 client.0 _ll_register_callbacks cb 0x55e8b85117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49390/0 (socket says 172.21.15.8:49390) 2023-10-06T23:20:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce259c700 1 -- 172.21.15.8:0/76442809 learned_addr learned my addr 172.21.15.8:0/76442809 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1cdbfff700 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce259c700 1 -- 172.21.15.8:0/76442809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 msgr2=0x55e8b87cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce259c700 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce259c700 1 -- 172.21.15.8:0/76442809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 msgr2=0x55e8b87d6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce259c700 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.210+0000 7f1ce259c700 1 -- 172.21.15.8:0/76442809 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce410bec0 con 0x55e8b87c4ec0 2023-10-06T23:20:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.211+0000 7f1ce259c700 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87cec80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4096320 tx=0x7f1cd409a360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac56a6b82889258 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.211+0000 7f1cc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:20:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.211+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/76442809 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4099bf0 con 0x55e8b87c4ec0 2023-10-06T23:20:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.211+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/76442809 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1cd409a520 con 0x55e8b87c4ec0 2023-10-06T23:20:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.211+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/76442809 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8b87b7d50 con 0x55e8b87c4ec0 2023-10-06T23:20:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.211+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/76442809 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cd4099960 con 0x55e8b87c4ec0 2023-10-06T23:20:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.211+0000 7f1cfc83eb80 10 client.26101 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.211+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/76442809 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f1ccc009a30 con 0x55e8b87c4ec0 2023-10-06T23:20:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.212+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/76442809 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cd40b6020 con 0x55e8b87c4ec0 2023-10-06T23:20:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.212+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/76442809 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1cd40a1c90 con 0x55e8b87c4ec0 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.212+0000 7f1cfc83eb80 10 client.26101 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.212+0000 7f1cfc83eb80 10 client.26101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.212+0000 7f1cfc83eb80 20 client.26101 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.212+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e8b87daa30 0x55e8b87dce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.212+0000 7f1cfc83eb80 4 client.26101 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.212+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/76442809 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8b8710db0 con 0x55e8b87daa30 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.213+0000 7f1cdbfff700 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e8b87daa30 0x55e8b87dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.213+0000 7f1cc9ffb700 10 client.26101 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.213+0000 7f1cdbfff700 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e8b87daa30 0x55e8b87dce50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37425d5c6ef60e38 server_cookie=6ad588d4a6c000c1 in_seq=0 out_seq=0 2023-10-06T23:20:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.214+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/76442809 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e8b8710db0 con 0x55e8b87daa30 2023-10-06T23:20:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.214+0000 7f1cc9ffb700 10 client.26101 handle_command_reply: tid=0 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.214+0000 7f1cfc83eb80 1 client.26101 shutdown 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/76442809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 msgr2=0x55e8b87cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87cec80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4096320 tx=0x7f1cd409a360 comp rx=0 tx=0).stop 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/76442809 shutdown_connections 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e8b87daa30 0x55e8b87dce50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87cec80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/76442809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/76442809 >> 172.21.15.8:0/76442809 conn(0x55e8b8739200 msgr2=0x55e8b87bf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cc9ffb700 0 client.26101 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/76442809 shutdown_connections 2023-10-06T23:20:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.215+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/76442809 wait complete. 2023-10-06T23:20:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.216+0000 7f1cfc83eb80 20 client.26101 trim_cache size 0 max 16384 2023-10-06T23:20:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.239+0000 7f1cfc83eb80 1 Processor -- start 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.239+0000 7f1cfc83eb80 1 -- start start 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87bf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87dca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b85988c0 con 0x55e8b87c6990 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b87ba310 con 0x55e8b87c5fd0 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b87ce130 con 0x55e8b87c4ec0 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1cdbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87bf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87bf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49396/0 (socket says 172.21.15.8:49396) 2023-10-06T23:20:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.240+0000 7f1ce259c700 1 -- 172.21.15.8:0/3319820262 learned_addr learned my addr 172.21.15.8:0/3319820262 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.241+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/3319820262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87dca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.241+0000 7f1ce259c700 1 -- 172.21.15.8:0/3319820262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 msgr2=0x55e8b87d61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.241+0000 7f1ce259c700 1 --2- 172.21.15.8:0/3319820262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.241+0000 7f1ce259c700 1 -- 172.21.15.8:0/3319820262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 msgr2=0x55e8b87dca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.241+0000 7f1ce259c700 1 --2- 172.21.15.8:0/3319820262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87dca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.241+0000 7f1ce259c700 1 -- 172.21.15.8:0/3319820262 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8b852bc00 con 0x55e8b87c4ec0 2023-10-06T23:20:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.242+0000 7f1ce259c700 1 --2- 172.21.15.8:0/3319820262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87bf250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40090a0 tx=0x7f1cd4009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=606049dea1a3e0eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.242+0000 7f1cd97fa700 1 -- 172.21.15.8:0/3319820262 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40981c0 con 0x55e8b87c4ec0 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.242+0000 7f1cd97fa700 1 -- 172.21.15.8:0/3319820262 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cd40b6070 con 0x55e8b87c4ec0 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.242+0000 7f1cd97fa700 1 -- 172.21.15.8:0/3319820262 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd409a520 con 0x55e8b87c4ec0 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3319820262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 msgr2=0x55e8b87bf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/3319820262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87bf250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40090a0 tx=0x7f1cd4009600 comp rx=0 tx=0).stop 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3319820262 shutdown_connections 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/3319820262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87dca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/3319820262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87bf250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/3319820262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3319820262 >> 172.21.15.8:0/3319820262 conn(0x55e8b8739200 msgr2=0x55e8b87cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3319820262 shutdown_connections 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/3319820262 wait complete. 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.243+0000 7f1cfc83eb80 1 -- start start 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.244+0000 7f1cfc83eb80 1 Processor -- start 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.244+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.244+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.244+0000 7f1cfc83eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.244+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b87d5040 con 0x55e8b87c6990 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.244+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b87d51b0 con 0x55e8b87c5fd0 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.244+0000 7f1cfc83eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8b87d5370 con 0x55e8b87c4ec0 2023-10-06T23:20:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.244+0000 7f1cfc83eb80 10 client.0 _ll_register_callbacks cb 0x55e8b85117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54050/0 (socket says 172.21.15.8:54050) 2023-10-06T23:20:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce2d9d700 1 -- 172.21.15.8:0/353213163 learned_addr learned my addr 172.21.15.8:0/353213163 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1cdbfff700 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce2d9d700 1 -- 172.21.15.8:0/353213163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 msgr2=0x55e8b87d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce2d9d700 1 -- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 msgr2=0x55e8b87d3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.245+0000 7f1ce2d9d700 1 -- 172.21.15.8:0/353213163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc009a30 con 0x55e8b87c6990 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.246+0000 7f1cdbfff700 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.246+0000 7f1ce259c700 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.246+0000 7f1ce2d9d700 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d4b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0098f0 tx=0x7f1cdc009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bacdd0975279ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.246+0000 7f1cc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.246+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/353213163 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc005590 con 0x55e8b87c6990 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.246+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/353213163 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1cdc0046d0 con 0x55e8b87c6990 2023-10-06T23:20:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.246+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/353213163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ccc019c20 con 0x55e8b87c6990 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.247+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/353213163 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cdc0056f0 con 0x55e8b87c6990 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.247+0000 7f1cfc83eb80 10 client.16233 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.247+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/353213163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e8b85691f0 con 0x55e8b87c6990 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.247+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/353213163 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ccc019c20 con 0x55e8b87c6990 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.247+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/353213163 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1cdc02f890 con 0x55e8b87c6990 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.248+0000 7f1cfc83eb80 10 client.16233 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.248+0000 7f1cfc83eb80 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.248+0000 7f1cfc83eb80 20 client.16233 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.248+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e8b882ee40 0x55e8b8831230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.248+0000 7f1cfc83eb80 4 client.16233 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.248+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/353213163 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e8b8710ad0 con 0x55e8b882ee40 2023-10-06T23:20:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.248+0000 7f1ce259c700 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e8b882ee40 0x55e8b8831230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.249+0000 7f1ce259c700 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e8b882ee40 0x55e8b8831230 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6838b2a123f808b server_cookie=495be66c3b7b3110 in_seq=0 out_seq=0 2023-10-06T23:20:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.249+0000 7f1cc9ffb700 10 client.16233 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:14.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cc9ffb700 1 -- 172.21.15.8:0/353213163 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e8b8710ad0 con 0x55e8b882ee40 2023-10-06T23:20:14.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cc9ffb700 10 client.16233 handle_command_reply: tid=0 2023-10-06T23:20:14.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 client.16233 shutdown 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/353213163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 msgr2=0x55e8b87d4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d4b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0098f0 tx=0x7f1cdc009460 comp rx=0 tx=0).stop 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/353213163 shutdown_connections 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e8b882ee40 0x55e8b8831230 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e8b87c6990 0x55e8b87d4b00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8b87c4ec0 0x55e8b87d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 --2- 172.21.15.8:0/353213163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8b87c5fd0 0x55e8b87d3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/353213163 >> 172.21.15.8:0/353213163 conn(0x55e8b8739200 msgr2=0x55e8b87bf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.266+0000 7f1cc9ffb700 0 client.16233 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.267+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/353213163 shutdown_connections 2023-10-06T23:20:14.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.267+0000 7f1cfc83eb80 1 -- 172.21.15.8:0/353213163 wait complete. 2023-10-06T23:20:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.267+0000 7f1cfc83eb80 20 client.16233 trim_cache size 0 max 16384 2023-10-06T23:20:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:20:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:20:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:20:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1cd00a1650 msgr2=0x7f1cd00a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1cd00a1650 0x7f1cd00a3b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009fd0 tx=0x7f1cdc019040 comp rx=0 tx=0).stop 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2032380966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce4103130 msgr2=0x7f1ce406f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce4103130 0x7f1ce406f7b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400eee0 tx=0x7f1cd400c3a0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2032380966 shutdown_connections 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1cd00a1650 0x7f1cd00a3b10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ce4104cc0 0x7f1ce4070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce4103130 0x7f1ce406f7b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 --2- 172.21.15.8:0/2032380966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ce4104320 0x7f1ce406fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2032380966 >> 172.21.15.8:0/2032380966 conn(0x7f1ce40fe6a0 msgr2=0x7f1ce4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2032380966 shutdown_connections 2023-10-06T23:20:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:14.268+0000 7f1ce8fff700 1 -- 172.21.15.8:0/2032380966 wait complete. 2023-10-06T23:20:15.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:15 smithi190 ceph-mon[102658]: pgmap v572: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 7.4 MiB/s wr, 467 op/s 2023-10-06T23:20:15.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:15 smithi156 ceph-mon[102862]: pgmap v572: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 7.4 MiB/s wr, 467 op/s 2023-10-06T23:20:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:15 smithi008 ceph-mon[98532]: pgmap v572: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 7.4 MiB/s wr, 467 op/s 2023-10-06T23:20:17.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:20:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 -- 172.21.15.8:0/2968739625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 msgr2=0x7fee80104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 --2- 172.21.15.8:0/2968739625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 0x7fee80104ef0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee7800b0a0 tx=0x7fee7800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 -- 172.21.15.8:0/2968739625 shutdown_connections 2023-10-06T23:20:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 --2- 172.21.15.8:0/2968739625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 0x7fee80104ef0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 --2- 172.21.15.8:0/2968739625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee800ff730 0x7fee80101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 --2- 172.21.15.8:0/2968739625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee801020a0 0x7fee80104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 -- 172.21.15.8:0/2968739625 >> 172.21.15.8:0/2968739625 conn(0x7fee800fb330 msgr2=0x7fee800fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 -- 172.21.15.8:0/2968739625 shutdown_connections 2023-10-06T23:20:17.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.439+0000 7fee84dff700 1 -- 172.21.15.8:0/2968739625 wait complete. 2023-10-06T23:20:17.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:17 smithi190 ceph-mon[102658]: pgmap v573: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.5 MiB/s wr, 487 op/s 2023-10-06T23:20:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.440+0000 7fee84dff700 1 Processor -- start 2023-10-06T23:20:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee84dff700 1 -- start start 2023-10-06T23:20:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee84dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee800ff730 0x7fee8019d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee84dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee801020a0 0x7fee8019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee84dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 0x7fee801a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee84dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801a4d60 con 0x7fee801020a0 2023-10-06T23:20:17.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee84dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801a4ea0 con 0x7fee80104a70 2023-10-06T23:20:17.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee84dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801a5030 con 0x7fee800ff730 2023-10-06T23:20:17.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee77fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee801020a0 0x7fee8019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee7e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee800ff730 0x7fee8019d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee77fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee801020a0 0x7fee8019d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54068/0 (socket says 172.21.15.8:54068) 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee77fff700 1 -- 172.21.15.8:0/703634168 learned_addr learned my addr 172.21.15.8:0/703634168 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.441+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 0x7fee801a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.442+0000 7fee77fff700 1 -- 172.21.15.8:0/703634168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee800ff730 msgr2=0x7fee8019d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.442+0000 7fee77fff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee800ff730 0x7fee8019d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.442+0000 7fee77fff700 1 -- 172.21.15.8:0/703634168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 msgr2=0x7fee801a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.442+0000 7fee77fff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 0x7fee801a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.442+0000 7fee77fff700 1 -- 172.21.15.8:0/703634168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78009d00 con 0x7fee801020a0 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.442+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 0x7fee801a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.442+0000 7fee7e59c700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee800ff730 0x7fee8019d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:17.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.442+0000 7fee77fff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee801020a0 0x7fee8019d720 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fee6800e9a0 tx=0x7fee6800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:17.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.443+0000 7fee777fe700 1 -- 172.21.15.8:0/703634168 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68009790 con 0x7fee801020a0 2023-10-06T23:20:17.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.443+0000 7fee84dff700 1 -- 172.21.15.8:0/703634168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee801a5310 con 0x7fee801020a0 2023-10-06T23:20:17.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.443+0000 7fee777fe700 1 -- 172.21.15.8:0/703634168 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee68010430 con 0x7fee801020a0 2023-10-06T23:20:17.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.443+0000 7fee777fe700 1 -- 172.21.15.8:0/703634168 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800cea0 con 0x7fee801020a0 2023-10-06T23:20:17.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.443+0000 7fee84dff700 1 -- 172.21.15.8:0/703634168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee801a5870 con 0x7fee801020a0 2023-10-06T23:20:17.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.448+0000 7fee777fe700 1 -- 172.21.15.8:0/703634168 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fee680105a0 con 0x7fee801020a0 2023-10-06T23:20:17.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.450+0000 7fee98706b80 1 Processor -- start 2023-10-06T23:20:17.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.450+0000 7fee98706b80 1 -- start start 2023-10-06T23:20:17.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.450+0000 7fee98706b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.450+0000 7fee98706b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.450+0000 7fee98706b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee98706b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c832460 con 0x555d3c8cabc0 2023-10-06T23:20:17.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee98706b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c823c20 con 0x555d3c8ca260 2023-10-06T23:20:17.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee98706b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c821540 con 0x555d3c8cba60 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee77fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee7e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee7ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee77fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49440/0 (socket says 172.21.15.8:49440) 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee7ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41848/0 (socket says 172.21.15.8:41848) 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee77fff700 1 -- 172.21.15.8:0/3892837141 learned_addr learned my addr 172.21.15.8:0/3892837141 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.451+0000 7fee777fe700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fee6c0a1500 0x7fee6c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee777fe700 1 -- 172.21.15.8:0/703634168 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fee68014070 con 0x7fee801020a0 2023-10-06T23:20:17.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee7ed9d700 1 -- 172.21.15.8:0/3892837141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 msgr2=0x555d3c8cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:17.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/3892837141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee7ed9d700 1 -- 172.21.15.8:0/3892837141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 msgr2=0x555d3c8cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:17.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/3892837141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee7ed9d700 1 -- 172.21.15.8:0/3892837141 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d3c647de0 con 0x555d3c8ca260 2023-10-06T23:20:17.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee77fff700 1 --2- 172.21.15.8:0/3892837141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:17.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/3892837141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8ca680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fee7800b070 tx=0x7fee78009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcce35f6d93c7161 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:17.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fee6c0a1500 0x7fee6c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.452+0000 7fee74ff9700 1 -- 172.21.15.8:0/3892837141 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800e040 con 0x555d3c8ca260 2023-10-06T23:20:17.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.453+0000 7fee74ff9700 1 -- 172.21.15.8:0/3892837141 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee780076e0 con 0x555d3c8ca260 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.453+0000 7fee74ff9700 1 -- 172.21.15.8:0/3892837141 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78005390 con 0x555d3c8ca260 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 -- 172.21.15.8:0/3892837141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 msgr2=0x555d3c8ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 --2- 172.21.15.8:0/3892837141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8ca680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fee7800b070 tx=0x7fee78009c60 comp rx=0 tx=0).stop 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fee6c0a1500 0x7fee6c0a39c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fee78003fd0 tx=0x7fee780055f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 -- 172.21.15.8:0/3892837141 shutdown_connections 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 --2- 172.21.15.8:0/3892837141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 --2- 172.21.15.8:0/3892837141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8ca680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 --2- 172.21.15.8:0/3892837141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 -- 172.21.15.8:0/3892837141 >> 172.21.15.8:0/3892837141 conn(0x555d3c83e260 msgr2=0x555d3c8c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 -- 172.21.15.8:0/3892837141 shutdown_connections 2023-10-06T23:20:17.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.454+0000 7fee98706b80 1 -- 172.21.15.8:0/3892837141 wait complete. 2023-10-06T23:20:17.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.455+0000 7fee98706b80 1 -- start start 2023-10-06T23:20:17.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.455+0000 7fee98706b80 1 Processor -- start 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee98706b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8ca260 0x555d3c8d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee98706b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee98706b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cba60 0x555d3c8db540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee98706b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c81ce30 con 0x555d3c8cabc0 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee98706b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c7b9710 con 0x555d3c8cba60 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee98706b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c7b93b0 con 0x555d3c8ca260 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee98706b80 10 client.0 _ll_register_callbacks cb 0x555d3c616800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee7e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8ca260 0x555d3c8d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee7e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8ca260 0x555d3c8d3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49456/0 (socket says 172.21.15.8:49456) 2023-10-06T23:20:17.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee7e59c700 1 -- 172.21.15.8:0/286161691 learned_addr learned my addr 172.21.15.8:0/286161691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:17.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.456+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cba60 0x555d3c8db540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee77fff700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee7e59c700 1 -- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cba60 msgr2=0x555d3c8db540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:17.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee7e59c700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cba60 0x555d3c8db540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee7e59c700 1 -- 172.21.15.8:0/286161691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 msgr2=0x555d3c8d4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee7e59c700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee7e59c700 1 -- 172.21.15.8:0/286161691 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee801a5870 con 0x555d3c8ca260 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cba60 0x555d3c8db540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee77fff700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee7e59c700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8ca260 0x555d3c8d3fc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee70012d20 tx=0x7fee7000f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7727c316ca54ec1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.457+0000 7fee65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.458+0000 7fee65ffb700 1 -- 172.21.15.8:0/286161691 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70017070 con 0x555d3c8ca260 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.458+0000 7fee65ffb700 1 -- 172.21.15.8:0/286161691 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fee7000fc30 con 0x555d3c8ca260 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.458+0000 7fee98706b80 1 -- 172.21.15.8:0/286161691 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d3c8bcf10 con 0x555d3c8ca260 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.458+0000 7fee65ffb700 1 -- 172.21.15.8:0/286161691 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee700122e0 con 0x555d3c8ca260 2023-10-06T23:20:17.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.458+0000 7fee98706b80 10 client.26119 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:17.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.458+0000 7fee98706b80 1 -- 172.21.15.8:0/286161691 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7fee80105a20 con 0x555d3c8ca260 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.458+0000 7fee65ffb700 1 -- 172.21.15.8:0/286161691 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555d3c8bcf10 con 0x555d3c8ca260 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.459+0000 7fee65ffb700 1 -- 172.21.15.8:0/286161691 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fee7001c420 con 0x555d3c8ca260 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.459+0000 7fee98706b80 10 client.26119 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.459+0000 7fee98706b80 10 client.26119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.459+0000 7fee98706b80 20 client.26119 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.459+0000 7fee98706b80 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555d3c8dfdf0 0x555d3c8e2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.459+0000 7fee98706b80 4 client.26119 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.459+0000 7fee98706b80 1 -- 172.21.15.8:0/286161691 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d3c815e10 con 0x555d3c8dfdf0 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.459+0000 7fee77fff700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555d3c8dfdf0 0x555d3c8e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.460+0000 7fee77fff700 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555d3c8dfdf0 0x555d3c8e2210 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be1a306a5a5b4e79 server_cookie=ddc86c7d2b7708c3 in_seq=0 out_seq=0 2023-10-06T23:20:17.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.460+0000 7fee65ffb700 10 client.26119 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:17.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee65ffb700 1 -- 172.21.15.8:0/286161691 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555d3c815e10 con 0x555d3c8dfdf0 2023-10-06T23:20:17.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee65ffb700 10 client.26119 handle_command_reply: tid=0 2023-10-06T23:20:17.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 client.26119 shutdown 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 -- 172.21.15.8:0/286161691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8ca260 msgr2=0x555d3c8d3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8ca260 0x555d3c8d3fc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee70012d20 tx=0x7fee7000f6a0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 -- 172.21.15.8:0/286161691 shutdown_connections 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555d3c8dfdf0 0x555d3c8e2210 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cba60 0x555d3c8db540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8ca260 0x555d3c8d3fc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee65ffb700 0 client.26119 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 --2- 172.21.15.8:0/286161691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 -- 172.21.15.8:0/286161691 >> 172.21.15.8:0/286161691 conn(0x555d3c83e260 msgr2=0x555d3c8c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.461+0000 7fee98706b80 1 -- 172.21.15.8:0/286161691 shutdown_connections 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.462+0000 7fee98706b80 1 -- 172.21.15.8:0/286161691 wait complete. 2023-10-06T23:20:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.462+0000 7fee98706b80 20 client.26119 trim_cache size 0 max 16384 2023-10-06T23:20:17.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.486+0000 7fee98706b80 1 Processor -- start 2023-10-06T23:20:17.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee98706b80 1 -- start start 2023-10-06T23:20:17.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee98706b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8ca260 0x555d3c8dbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee98706b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cabc0 0x555d3c8db500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee98706b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee98706b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c8d3b90 con 0x555d3c8ca260 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee98706b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c69d920 con 0x555d3c8cabc0 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee98706b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c8cb180 con 0x555d3c8cba60 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee7e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8ca260 0x555d3c8dbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee7ed9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee77fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cabc0 0x555d3c8db500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee77fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cabc0 0x555d3c8db500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41860/0 (socket says 172.21.15.8:41860) 2023-10-06T23:20:17.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.487+0000 7fee77fff700 1 -- 172.21.15.8:0/2468438037 learned_addr learned my addr 172.21.15.8:0/2468438037 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.488+0000 7fee7ed9d700 1 -- 172.21.15.8:0/2468438037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cabc0 msgr2=0x555d3c8db500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.488+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/2468438037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cabc0 0x555d3c8db500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.488+0000 7fee7ed9d700 1 -- 172.21.15.8:0/2468438037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8ca260 msgr2=0x555d3c8dbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.488+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/2468438037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8ca260 0x555d3c8dbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.488+0000 7fee7ed9d700 1 -- 172.21.15.8:0/2468438037 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d3c630c60 con 0x555d3c8cba60 2023-10-06T23:20:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.488+0000 7fee7e59c700 1 --2- 172.21.15.8:0/2468438037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8ca260 0x555d3c8dbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.488+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/2468438037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8d3d70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee780062a0 tx=0x7fee7802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f53b3c1632e5c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.489+0000 7fee757fa700 1 -- 172.21.15.8:0/2468438037 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800e070 con 0x555d3c8cba60 2023-10-06T23:20:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.489+0000 7fee757fa700 1 -- 172.21.15.8:0/2468438037 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee78005840 con 0x555d3c8cba60 2023-10-06T23:20:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.489+0000 7fee757fa700 1 -- 172.21.15.8:0/2468438037 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78037070 con 0x555d3c8cba60 2023-10-06T23:20:17.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 -- 172.21.15.8:0/2468438037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 msgr2=0x555d3c8d3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 --2- 172.21.15.8:0/2468438037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8d3d70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee780062a0 tx=0x7fee7802e000 comp rx=0 tx=0).stop 2023-10-06T23:20:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 -- 172.21.15.8:0/2468438037 shutdown_connections 2023-10-06T23:20:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 --2- 172.21.15.8:0/2468438037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8ca260 0x555d3c8dbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 --2- 172.21.15.8:0/2468438037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8d3d70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 --2- 172.21.15.8:0/2468438037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8cabc0 0x555d3c8db500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 -- 172.21.15.8:0/2468438037 >> 172.21.15.8:0/2468438037 conn(0x555d3c83e260 msgr2=0x555d3c8d2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 -- 172.21.15.8:0/2468438037 shutdown_connections 2023-10-06T23:20:17.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.490+0000 7fee98706b80 1 -- 172.21.15.8:0/2468438037 wait complete. 2023-10-06T23:20:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.491+0000 7fee98706b80 1 -- start start 2023-10-06T23:20:17.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.491+0000 7fee98706b80 1 Processor -- start 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee98706b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8d9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee98706b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee98706b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8da960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee98706b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c8daea0 con 0x555d3c8cabc0 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee98706b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c8db010 con 0x555d3c8ca260 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee98706b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3c8db1d0 con 0x555d3c8cba60 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee98706b80 10 client.0 _ll_register_callbacks cb 0x7fee700127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee77fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee77fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54104/0 (socket says 172.21.15.8:54104) 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee7e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee77fff700 1 -- 172.21.15.8:0/2049132790 learned_addr learned my addr 172.21.15.8:0/2049132790 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:17.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.492+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8da960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.493+0000 7fee7e59c700 1 -- 172.21.15.8:0/2049132790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 msgr2=0x555d3c8da960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.493+0000 7fee7e59c700 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8da960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.493+0000 7fee7e59c700 1 -- 172.21.15.8:0/2049132790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 msgr2=0x555d3c8d9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.493+0000 7fee7e59c700 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.493+0000 7fee7e59c700 1 -- 172.21.15.8:0/2049132790 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee80105a20 con 0x555d3c8ca260 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.493+0000 7fee7ed9d700 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8da960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.493+0000 7fee7e59c700 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8d9410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fee7001c800 tx=0x7fee700122e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f56bd3af21b0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.493+0000 7fee65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.494+0000 7fee65ffb700 1 -- 172.21.15.8:0/2049132790 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70017040 con 0x555d3c8ca260 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.494+0000 7fee98706b80 1 -- 172.21.15.8:0/2049132790 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee780076e0 con 0x555d3c8ca260 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.494+0000 7fee65ffb700 1 -- 172.21.15.8:0/2049132790 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fee7000fc30 con 0x555d3c8ca260 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.494+0000 7fee65ffb700 1 -- 172.21.15.8:0/2049132790 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee70035030 con 0x555d3c8ca260 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.494+0000 7fee98706b80 10 client.26099 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.494+0000 7fee98706b80 1 -- 172.21.15.8:0/2049132790 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x555d3c647de0 con 0x555d3c8ca260 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.494+0000 7fee65ffb700 1 -- 172.21.15.8:0/2049132790 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee780076e0 con 0x555d3c8ca260 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.495+0000 7fee65ffb700 1 -- 172.21.15.8:0/2049132790 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fee70003680 con 0x555d3c8ca260 2023-10-06T23:20:17.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.495+0000 7fee98706b80 10 client.26099 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:17.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.495+0000 7fee98706b80 10 client.26099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:17.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.495+0000 7fee98706b80 20 client.26099 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:17.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.495+0000 7fee98706b80 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555d3c934d10 0x555d3c937130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:17.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.495+0000 7fee98706b80 4 client.26099 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:20:17.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.495+0000 7fee98706b80 1 -- 172.21.15.8:0/2049132790 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555d3c815b30 con 0x555d3c934d10 2023-10-06T23:20:17.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.495+0000 7fee77fff700 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555d3c934d10 0x555d3c937130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee77fff700 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555d3c934d10 0x555d3c937130 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c534f34199cc3035 server_cookie=d0a9ba03ab42f609 in_seq=0 out_seq=0 2023-10-06T23:20:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee65ffb700 10 client.26099 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee65ffb700 1 -- 172.21.15.8:0/2049132790 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x555d3c815b30 con 0x555d3c934d10 2023-10-06T23:20:17.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee65ffb700 10 client.26099 handle_command_reply: tid=0 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 client.26099 shutdown 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 -- 172.21.15.8:0/2049132790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 msgr2=0x555d3c8d9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8d9410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fee7001c800 tx=0x7fee700122e0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 -- 172.21.15.8:0/2049132790 shutdown_connections 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555d3c934d10 0x555d3c937130 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d3c8cba60 0x555d3c8da960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555d3c8ca260 0x555d3c8d9410 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 --2- 172.21.15.8:0/2049132790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555d3c8cabc0 0x555d3c8d9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee98706b80 1 -- 172.21.15.8:0/2049132790 >> 172.21.15.8:0/2049132790 conn(0x555d3c83e260 msgr2=0x555d3c8ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.496+0000 7fee65ffb700 0 client.26099 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.497+0000 7fee98706b80 1 -- 172.21.15.8:0/2049132790 shutdown_connections 2023-10-06T23:20:17.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.497+0000 7fee98706b80 1 -- 172.21.15.8:0/2049132790 wait complete. 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.497+0000 7fee98706b80 20 client.26099 trim_cache size 0 max 16384 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:20:17.501 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:20:17.502 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:20:17.502 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:20:17.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 -- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fee6c0a1500 msgr2=0x7fee6c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fee6c0a1500 0x7fee6c0a39c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fee78003fd0 tx=0x7fee780055f0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 -- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee801020a0 msgr2=0x7fee8019d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:17.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee801020a0 0x7fee8019d720 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fee6800e9a0 tx=0x7fee6800ecb0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 -- 172.21.15.8:0/703634168 shutdown_connections 2023-10-06T23:20:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fee6c0a1500 0x7fee6c0a39c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee80104a70 0x7fee801a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee800ff730 0x7fee8019d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 --2- 172.21.15.8:0/703634168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee801020a0 0x7fee8019d720 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 -- 172.21.15.8:0/703634168 >> 172.21.15.8:0/703634168 conn(0x7fee800fb330 msgr2=0x7fee801003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.498+0000 7fee84dff700 1 -- 172.21.15.8:0/703634168 shutdown_connections 2023-10-06T23:20:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:17.499+0000 7fee84dff700 1 -- 172.21.15.8:0/703634168 wait complete. 2023-10-06T23:20:17.520 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:17 smithi008 ceph-mon[98532]: pgmap v573: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.5 MiB/s wr, 487 op/s 2023-10-06T23:20:17.523 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:20:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:17 smithi156 ceph-mon[102862]: pgmap v573: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.5 MiB/s wr, 487 op/s 2023-10-06T23:20:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 325.0 s, 222.0 tps, lat 479.882 ms stddev 141.941 2023-10-06T23:20:19.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:19 smithi190 ceph-mon[102658]: pgmap v574: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.9 MiB/s wr, 438 op/s 2023-10-06T23:20:19.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:19 smithi156 ceph-mon[102862]: pgmap v574: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.9 MiB/s wr, 438 op/s 2023-10-06T23:20:19.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:19 smithi008 ceph-mon[98532]: pgmap v574: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 6.9 MiB/s wr, 438 op/s 2023-10-06T23:20:21.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:21 smithi190 ceph-mon[102658]: pgmap v575: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 6.6 MiB/s wr, 456 op/s 2023-10-06T23:20:21.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:21 smithi156 ceph-mon[102862]: pgmap v575: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 6.6 MiB/s wr, 456 op/s 2023-10-06T23:20:21.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:21 smithi008 ceph-mon[98532]: pgmap v575: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 6.6 MiB/s wr, 456 op/s 2023-10-06T23:20:23.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:23 smithi008 ceph-mon[98532]: pgmap v576: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 5.5 MiB/s wr, 398 op/s 2023-10-06T23:20:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:23 smithi190 ceph-mon[102658]: pgmap v576: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 5.5 MiB/s wr, 398 op/s 2023-10-06T23:20:23.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:23 smithi156 ceph-mon[102862]: pgmap v576: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 5.5 MiB/s wr, 398 op/s 2023-10-06T23:20:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 330.0 s, 225.0 tps, lat 445.505 ms stddev 236.139 2023-10-06T23:20:25.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:25 smithi190 ceph-mon[102658]: pgmap v577: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 6.7 MiB/s wr, 472 op/s 2023-10-06T23:20:25.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:25 smithi156 ceph-mon[102862]: pgmap v577: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 6.7 MiB/s wr, 472 op/s 2023-10-06T23:20:25.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:25 smithi008 ceph-mon[98532]: pgmap v577: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 6.7 MiB/s wr, 472 op/s 2023-10-06T23:20:27.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:27 smithi190 ceph-mon[102658]: pgmap v578: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.9 MiB/s wr, 469 op/s 2023-10-06T23:20:27.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 -- 172.21.15.8:0/333815954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 msgr2=0x7f8e10109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 --2- 172.21.15.8:0/333815954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 0x7f8e10109040 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800b0a0 tx=0x7f8e0800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 -- 172.21.15.8:0/333815954 shutdown_connections 2023-10-06T23:20:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 --2- 172.21.15.8:0/333815954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e10101970 0x7f8e10103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 --2- 172.21.15.8:0/333815954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 0x7f8e10109040 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 --2- 172.21.15.8:0/333815954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e101042a0 0x7f8e10106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 -- 172.21.15.8:0/333815954 >> 172.21.15.8:0/333815954 conn(0x7f8e100fb340 msgr2=0x7f8e100fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 -- 172.21.15.8:0/333815954 shutdown_connections 2023-10-06T23:20:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.482+0000 7f8e179ff700 1 -- 172.21.15.8:0/333815954 wait complete. 2023-10-06T23:20:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.484+0000 7f8e179ff700 1 Processor -- start 2023-10-06T23:20:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.484+0000 7f8e179ff700 1 -- start start 2023-10-06T23:20:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e179ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e10101970 0x7f8e1019ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e179ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e101042a0 0x7f8e1019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e179ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 0x7f8e10194840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e179ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10194e10 con 0x7f8e101042a0 2023-10-06T23:20:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e179ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10194f80 con 0x7f8e10106bd0 2023-10-06T23:20:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e179ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10195140 con 0x7f8e10101970 2023-10-06T23:20:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e10101970 0x7f8e1019ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e14f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e101042a0 0x7f8e1019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e15f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 0x7f8e10194840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e10101970 0x7f8e1019ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58368/0 (socket says 172.21.15.8:58368) 2023-10-06T23:20:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e14f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e101042a0 0x7f8e1019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55718/0 (socket says 172.21.15.8:55718) 2023-10-06T23:20:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.485+0000 7f8e1579b700 1 -- 172.21.15.8:0/1402614352 learned_addr learned my addr 172.21.15.8:0/1402614352 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.486+0000 7f8e15f9c700 1 -- 172.21.15.8:0/1402614352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e10101970 msgr2=0x7f8e1019ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.486+0000 7f8e15f9c700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e10101970 0x7f8e1019ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.486+0000 7f8e15f9c700 1 -- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e101042a0 msgr2=0x7f8e1019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.486+0000 7f8e15f9c700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e101042a0 0x7f8e1019efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.486+0000 7f8e15f9c700 1 -- 172.21.15.8:0/1402614352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c009520 con 0x7f8e10106bd0 2023-10-06T23:20:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.486+0000 7f8e15f9c700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 0x7f8e10194840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800b070 tx=0x7f8e0800bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.487+0000 7f8e067fc700 1 -- 172.21.15.8:0/1402614352 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800e040 con 0x7f8e10106bd0 2023-10-06T23:20:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.487+0000 7f8e179ff700 1 -- 172.21.15.8:0/1402614352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e08009d00 con 0x7f8e10106bd0 2023-10-06T23:20:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.487+0000 7f8e067fc700 1 -- 172.21.15.8:0/1402614352 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e08009480 con 0x7f8e10106bd0 2023-10-06T23:20:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.487+0000 7f8e067fc700 1 -- 172.21.15.8:0/1402614352 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e080052a0 con 0x7f8e10106bd0 2023-10-06T23:20:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.487+0000 7f8e179ff700 1 -- 172.21.15.8:0/1402614352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e10195670 con 0x7f8e10106bd0 2023-10-06T23:20:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.491+0000 7f8e067fc700 1 -- 172.21.15.8:0/1402614352 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8e08005400 con 0x7f8e10106bd0 2023-10-06T23:20:27.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.492+0000 7f8e2b2e9b80 1 Processor -- start 2023-10-06T23:20:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.493+0000 7f8e2b2e9b80 1 -- start start 2023-10-06T23:20:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.493+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e67122e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.493+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6713450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.493+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6713990 0x55f9e671a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.493+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e667a400 con 0x55f9e6711ec0 2023-10-06T23:20:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.493+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e666bbc0 con 0x55f9e6713990 2023-10-06T23:20:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.493+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e66694e0 con 0x55f9e6712fd0 2023-10-06T23:20:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e067fc700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dfc0a1500 0x7f8dfc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e14f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e67122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6713450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6713450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58382/0 (socket says 172.21.15.8:58382) 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e1579b700 1 -- 172.21.15.8:0/1995056535 learned_addr learned my addr 172.21.15.8:0/1995056535 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e067fc700 1 -- 172.21.15.8:0/1402614352 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8e080cdd10 con 0x7f8e10106bd0 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/1995056535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6713990 0x55f9e671a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e15f9c700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dfc0a1500 0x7f8dfc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e1579b700 1 -- 172.21.15.8:0/1995056535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6713990 msgr2=0x55f9e671a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e1579b700 1 --2- 172.21.15.8:0/1995056535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6713990 0x55f9e671a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e1579b700 1 -- 172.21.15.8:0/1995056535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 msgr2=0x55f9e67122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e1579b700 1 --2- 172.21.15.8:0/1995056535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e67122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.494+0000 7f8e1579b700 1 -- 172.21.15.8:0/1995056535 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e648fd80 con 0x55f9e6712fd0 2023-10-06T23:20:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.495+0000 7f8e15f9c700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dfc0a1500 0x7f8dfc0a39c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e080a2e40 tx=0x7f8e08009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.495+0000 7f8e1579b700 1 --2- 172.21.15.8:0/1995056535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6713450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0114c0 tx=0x7f8e0c0117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bb1bda1756bd9d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.495+0000 7f8dfb7fe700 1 -- 172.21.15.8:0/1995056535 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c019630 con 0x55f9e6712fd0 2023-10-06T23:20:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.495+0000 7f8dfb7fe700 1 -- 172.21.15.8:0/1995056535 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e0c019c20 con 0x55f9e6712fd0 2023-10-06T23:20:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.495+0000 7f8dfb7fe700 1 -- 172.21.15.8:0/1995056535 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00fbc0 con 0x55f9e6712fd0 2023-10-06T23:20:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.496+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/1995056535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 msgr2=0x55f9e6713450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.496+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/1995056535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6713450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0114c0 tx=0x7f8e0c0117d0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.497+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/1995056535 shutdown_connections 2023-10-06T23:20:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.497+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/1995056535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e67122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.497+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/1995056535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6713990 0x55f9e671a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.497+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/1995056535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6713450 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.497+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/1995056535 >> 172.21.15.8:0/1995056535 conn(0x55f9e6686200 msgr2=0x55f9e670cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.497+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/1995056535 shutdown_connections 2023-10-06T23:20:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.497+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/1995056535 wait complete. 2023-10-06T23:20:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.497+0000 7f8e2b2e9b80 1 -- start start 2023-10-06T23:20:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.498+0000 7f8e2b2e9b80 1 Processor -- start 2023-10-06T23:20:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.498+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e671bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.498+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e671c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.498+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 0x55f9e67230d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.498+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e6664dd0 con 0x55f9e6711ec0 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.498+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e66016b0 con 0x55f9e6712fd0 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.498+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e6601350 con 0x55f9e6713990 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.498+0000 7f8e2b2e9b80 10 client.0 _ll_register_callbacks cb 0x55f9e645e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e671c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e14f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e671bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e671c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58048/0 (socket says 172.21.15.8:58048) 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e1579b700 1 -- 172.21.15.8:0/842564466 learned_addr learned my addr 172.21.15.8:0/842564466 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 0x55f9e67230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e14f9a700 1 -- 172.21.15.8:0/842564466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 msgr2=0x55f9e67230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 0x55f9e67230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e14f9a700 1 -- 172.21.15.8:0/842564466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 msgr2=0x55f9e671c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.499+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e671c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.500+0000 7f8e14f9a700 1 -- 172.21.15.8:0/842564466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c009c90 con 0x55f9e6711ec0 2023-10-06T23:20:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.500+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e671bb50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8e0001aee0 tx=0x7f8e00009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa26bc01216aefaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.500+0000 7f8df8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:20:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.500+0000 7f8df8ff9700 1 -- 172.21.15.8:0/842564466 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00015d60 con 0x55f9e6711ec0 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.500+0000 7f8df8ff9700 1 -- 172.21.15.8:0/842564466 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8e000173f0 con 0x55f9e6711ec0 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.500+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/842564466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9e6704d50 con 0x55f9e6711ec0 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.501+0000 7f8df8ff9700 1 -- 172.21.15.8:0/842564466 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e00015ec0 con 0x55f9e6711ec0 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.501+0000 7f8e2b2e9b80 10 client.16263 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.501+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/842564466 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55f9e6478c00 con 0x55f9e6711ec0 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.501+0000 7f8df8ff9700 1 -- 172.21.15.8:0/842564466 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f9e6704d50 con 0x55f9e6711ec0 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.501+0000 7f8df8ff9700 1 -- 172.21.15.8:0/842564466 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8e00016370 con 0x55f9e6711ec0 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.502+0000 7f8e2b2e9b80 10 client.16263 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.502+0000 7f8e2b2e9b80 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.502+0000 7f8e2b2e9b80 20 client.16263 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.502+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f9e6727950 0x55f9e6729d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.502+0000 7f8e2b2e9b80 4 client.16263 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:20:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.502+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/842564466 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9e665ddb0 con 0x55f9e6727950 2023-10-06T23:20:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.502+0000 7f8e1579b700 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f9e6727950 0x55f9e6729d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.503+0000 7f8e1579b700 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f9e6727950 0x55f9e6729d70 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26422d456c4c5122 server_cookie=329a9f284024726a in_seq=0 out_seq=0 2023-10-06T23:20:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.503+0000 7f8df8ff9700 10 client.16263 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.504+0000 7f8df8ff9700 1 -- 172.21.15.8:0/842564466 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f9e665ddb0 con 0x55f9e6727950 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.504+0000 7f8df8ff9700 10 client.16263 handle_command_reply: tid=0 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.504+0000 7f8e2b2e9b80 1 client.16263 shutdown 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.504+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/842564466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 msgr2=0x55f9e671bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.504+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e671bb50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8e0001aee0 tx=0x7f8e00009190 comp rx=0 tx=0).stop 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/842564466 shutdown_connections 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f9e6727950 0x55f9e6729d70 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e671bb50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 0x55f9e67230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/842564466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e671c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/842564466 >> 172.21.15.8:0/842564466 conn(0x55f9e6686200 msgr2=0x55f9e670c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8df8ff9700 0 client.16263 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/842564466 shutdown_connections 2023-10-06T23:20:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/842564466 wait complete. 2023-10-06T23:20:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.505+0000 7f8e2b2e9b80 20 client.16263 trim_cache size 0 max 16384 2023-10-06T23:20:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.527+0000 7f8e2b2e9b80 1 Processor -- start 2023-10-06T23:20:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.527+0000 7f8e2b2e9b80 1 -- start start 2023-10-06T23:20:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.527+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e670c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.527+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e6723090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.527+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 0x55f9e6729960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.527+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e64e58c0 con 0x55f9e6711ec0 2023-10-06T23:20:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.527+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e6712740 con 0x55f9e6712fd0 2023-10-06T23:20:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.527+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e671b6c0 con 0x55f9e6713990 2023-10-06T23:20:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e670c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e6723090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e670c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:55736/0 (socket says 172.21.15.8:55736) 2023-10-06T23:20:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 -- 172.21.15.8:0/2928450420 learned_addr learned my addr 172.21.15.8:0/2928450420 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 0x55f9e6729960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 -- 172.21.15.8:0/2928450420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 msgr2=0x55f9e6729960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 0x55f9e6729960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 -- 172.21.15.8:0/2928450420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 msgr2=0x55f9e6723090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e6723090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e14f9a700 1 -- 172.21.15.8:0/2928450420 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e64b61f0 con 0x55f9e6711ec0 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.528+0000 7f8e1579b700 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e6723090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.529+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e670c250 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8e0001d010 tx=0x7f8e00009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d50b9f9288182e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.529+0000 7f8dfbfff700 1 -- 172.21.15.8:0/2928450420 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00006ac0 con 0x55f9e6711ec0 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.529+0000 7f8dfbfff700 1 -- 172.21.15.8:0/2928450420 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e00016d00 con 0x55f9e6711ec0 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.529+0000 7f8dfbfff700 1 -- 172.21.15.8:0/2928450420 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0002f660 con 0x55f9e6711ec0 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2928450420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 msgr2=0x55f9e670c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e670c250 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8e0001d010 tx=0x7f8e00009ad0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2928450420 shutdown_connections 2023-10-06T23:20:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6711ec0 0x55f9e670c250 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6713990 0x55f9e6729960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2928450420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6712fd0 0x55f9e6723090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2928450420 >> 172.21.15.8:0/2928450420 conn(0x55f9e6686200 msgr2=0x55f9e6723960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2928450420 shutdown_connections 2023-10-06T23:20:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2928450420 wait complete. 2023-10-06T23:20:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.530+0000 7f8e2b2e9b80 1 -- start start 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e2b2e9b80 1 Processor -- start 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6711ec0 0x55f9e6720790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6720cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e2b2e9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6713990 0x55f9e6721ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e6722220 con 0x55f9e6713990 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e6722390 con 0x55f9e6711ec0 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e2b2e9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e6722550 con 0x55f9e6712fd0 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e2b2e9b80 10 client.0 _ll_register_callbacks cb 0x7f8e0001a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.531+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6720cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e1579b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6720cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58392/0 (socket says 172.21.15.8:58392) 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e1579b700 1 -- 172.21.15.8:0/2247546136 learned_addr learned my addr 172.21.15.8:0/2247546136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6711ec0 0x55f9e6720790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6713990 0x55f9e6721ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e1579b700 1 -- 172.21.15.8:0/2247546136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6711ec0 msgr2=0x55f9e6720790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e1579b700 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6711ec0 0x55f9e6720790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e1579b700 1 -- 172.21.15.8:0/2247546136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6713990 msgr2=0x55f9e6721ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e1579b700 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6713990 0x55f9e6721ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e1579b700 1 -- 172.21.15.8:0/2247546136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9e648fd80 con 0x55f9e6712fd0 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8e1579b700 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6720cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c000c00 tx=0x7f8e0c005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96c6d6a7d5546ac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.532+0000 7f8df8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:20:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8df8ff9700 1 -- 172.21.15.8:0/2247546136 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c019770 con 0x55f9e6712fd0 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2247546136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e0c019c20 con 0x55f9e6712fd0 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8df8ff9700 1 -- 172.21.15.8:0/2247546136 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8e0c0198d0 con 0x55f9e6712fd0 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8df8ff9700 1 -- 172.21.15.8:0/2247546136 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e0c019ab0 con 0x55f9e6712fd0 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8e2b2e9b80 10 client.26140 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2247546136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55f9e6478c00 con 0x55f9e6712fd0 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8df8ff9700 1 -- 172.21.15.8:0/2247546136 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e0c019c20 con 0x55f9e6712fd0 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8df8ff9700 1 -- 172.21.15.8:0/2247546136 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8e0c004b60 con 0x55f9e6712fd0 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8e2b2e9b80 10 client.26140 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8e2b2e9b80 10 client.26140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8e2b2e9b80 20 client.26140 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.533+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f9e677bfe0 0x55f9e677e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.534+0000 7f8e2b2e9b80 4 client.26140 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:20:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.534+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2247546136 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f9e665dad0 con 0x55f9e677bfe0 2023-10-06T23:20:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.534+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f9e677bfe0 0x55f9e677e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.534+0000 7f8e14f9a700 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f9e677bfe0 0x55f9e677e3d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133ac710a2db51a5 server_cookie=44e7e0ef9322e102 in_seq=0 out_seq=0 2023-10-06T23:20:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.534+0000 7f8df8ff9700 10 client.26140 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.553+0000 7f8df8ff9700 1 -- 172.21.15.8:0/2247546136 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f9e665dad0 con 0x55f9e677bfe0 2023-10-06T23:20:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.553+0000 7f8df8ff9700 10 client.26140 handle_command_reply: tid=0 2023-10-06T23:20:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.553+0000 7f8e2b2e9b80 1 client.26140 shutdown 2023-10-06T23:20:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2247546136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 msgr2=0x55f9e6720cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6720cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c000c00 tx=0x7f8e0c005ce0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2247546136 shutdown_connections 2023-10-06T23:20:27.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55f9e677bfe0 0x55f9e677e3d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f9e6713990 0x55f9e6721ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9e6711ec0 0x55f9e6720790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 --2- 172.21.15.8:0/2247546136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9e6712fd0 0x55f9e6720cd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2247546136 >> 172.21.15.8:0/2247546136 conn(0x55f9e6686200 msgr2=0x55f9e670c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8df8ff9700 0 client.26140 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2247546136 shutdown_connections 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.554+0000 7f8e2b2e9b80 1 -- 172.21.15.8:0/2247546136 wait complete. 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.555+0000 7f8e2b2e9b80 20 client.26140 trim_cache size 0 max 16384 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:20:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:20:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:20:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:20:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 -- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dfc0a1500 msgr2=0x7f8dfc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dfc0a1500 0x7f8dfc0a39c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8e080a2e40 tx=0x7f8e08009040 comp rx=0 tx=0).stop 2023-10-06T23:20:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 -- 172.21.15.8:0/1402614352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 msgr2=0x7f8e10194840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 0x7f8e10194840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800b070 tx=0x7f8e0800bcc0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 -- 172.21.15.8:0/1402614352 shutdown_connections 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f8dfc0a1500 0x7f8dfc0a39c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e10106bd0 0x7f8e10194840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e10101970 0x7f8e1019ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 --2- 172.21.15.8:0/1402614352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e101042a0 0x7f8e1019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 -- 172.21.15.8:0/1402614352 >> 172.21.15.8:0/1402614352 conn(0x7f8e100fb340 msgr2=0x7f8e100ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 -- 172.21.15.8:0/1402614352 shutdown_connections 2023-10-06T23:20:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:27.556+0000 7f8e179ff700 1 -- 172.21.15.8:0/1402614352 wait complete. 2023-10-06T23:20:27.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:27 smithi156 ceph-mon[102862]: pgmap v578: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.9 MiB/s wr, 469 op/s 2023-10-06T23:20:27.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:27 smithi008 ceph-mon[98532]: pgmap v578: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.9 MiB/s wr, 469 op/s 2023-10-06T23:20:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 335.0 s, 244.4 tps, lat 408.052 ms stddev 85.409 2023-10-06T23:20:29.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:29 smithi190 ceph-mon[102658]: pgmap v579: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 6.0 MiB/s wr, 444 op/s 2023-10-06T23:20:29.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:29 smithi156 ceph-mon[102862]: pgmap v579: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 6.0 MiB/s wr, 444 op/s 2023-10-06T23:20:29.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:29 smithi008 ceph-mon[98532]: pgmap v579: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 6.0 MiB/s wr, 444 op/s 2023-10-06T23:20:31.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:31 smithi190 ceph-mon[102658]: pgmap v580: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 6.1 MiB/s wr, 488 op/s 2023-10-06T23:20:31.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:31 smithi156 ceph-mon[102862]: pgmap v580: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 6.1 MiB/s wr, 488 op/s 2023-10-06T23:20:31.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:31 smithi008 ceph-mon[98532]: pgmap v580: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 6.1 MiB/s wr, 488 op/s 2023-10-06T23:20:33.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:33 smithi008 ceph-mon[98532]: pgmap v581: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 5.9 MiB/s wr, 466 op/s 2023-10-06T23:20:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:33 smithi190 ceph-mon[102658]: pgmap v581: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 5.9 MiB/s wr, 466 op/s 2023-10-06T23:20:33.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:33 smithi156 ceph-mon[102862]: pgmap v581: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 5.9 MiB/s wr, 466 op/s 2023-10-06T23:20:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 340.0 s, 231.2 tps, lat 433.904 ms stddev 239.946 2023-10-06T23:20:35.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:35 smithi190 ceph-mon[102658]: pgmap v582: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 7.4 MiB/s wr, 559 op/s 2023-10-06T23:20:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:35 smithi156 ceph-mon[102862]: pgmap v582: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 7.4 MiB/s wr, 559 op/s 2023-10-06T23:20:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:35 smithi008 ceph-mon[98532]: pgmap v582: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 7.4 MiB/s wr, 559 op/s 2023-10-06T23:20:37.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:37 smithi190 ceph-mon[102658]: pgmap v583: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 7.7 MiB/s wr, 550 op/s 2023-10-06T23:20:37.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:37 smithi156 ceph-mon[102862]: pgmap v583: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 7.7 MiB/s wr, 550 op/s 2023-10-06T23:20:37.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:37 smithi008 ceph-mon[98532]: pgmap v583: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 7.7 MiB/s wr, 550 op/s 2023-10-06T23:20:39.006 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 345.0 s, 241.6 tps, lat 411.525 ms stddev 68.219 2023-10-06T23:20:39.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:39 smithi190 ceph-mon[102658]: pgmap v584: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 6.4 MiB/s wr, 475 op/s 2023-10-06T23:20:39.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:39 smithi156 ceph-mon[102862]: pgmap v584: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 6.4 MiB/s wr, 475 op/s 2023-10-06T23:20:39.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:39 smithi008 ceph-mon[98532]: pgmap v584: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 6.4 MiB/s wr, 475 op/s 2023-10-06T23:20:40.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 -- 172.21.15.8:0/927304820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 msgr2=0x7fc9d0101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/927304820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 0x7fc9d0101330 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009990 tx=0x7fc9cc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 -- 172.21.15.8:0/927304820 shutdown_connections 2023-10-06T23:20:40.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/927304820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 0x7fc9d0101330 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/927304820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d0102a20 0x7fc9d0109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/927304820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d0102060 0x7fc9d01024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 -- 172.21.15.8:0/927304820 >> 172.21.15.8:0/927304820 conn(0x7fc9d00fc460 msgr2=0x7fc9d00fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:40.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 -- 172.21.15.8:0/927304820 shutdown_connections 2023-10-06T23:20:40.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.781+0000 7fc9d7bff700 1 -- 172.21.15.8:0/927304820 wait complete. 2023-10-06T23:20:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.783+0000 7fc9d7bff700 1 Processor -- start 2023-10-06T23:20:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.783+0000 7fc9d7bff700 1 -- start start 2023-10-06T23:20:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d7bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 0x7fc9d00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d7bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d0102060 0x7fc9d00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d7bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d0102a20 0x7fc9d0073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d7bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01a0be0 con 0x7fc9d0100f10 2023-10-06T23:20:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d7bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01a0d20 con 0x7fc9d0102060 2023-10-06T23:20:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d7bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01a0e60 con 0x7fc9d0102a20 2023-10-06T23:20:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 0x7fc9d00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d0102060 0x7fc9d00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 0x7fc9d00732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44872/0 (socket says 172.21.15.8:44872) 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d599b700 1 -- 172.21.15.8:0/3769854640 learned_addr learned my addr 172.21.15.8:0/3769854640 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d619c700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d0102a20 0x7fc9d0073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d519a700 1 -- 172.21.15.8:0/3769854640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d0102a20 msgr2=0x7fc9d0073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d519a700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d0102a20 0x7fc9d0073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d519a700 1 -- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 msgr2=0x7fc9d00732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d519a700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 0x7fc9d00732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.784+0000 7fc9d519a700 1 -- 172.21.15.8:0/3769854640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc0095f0 con 0x7fc9d0102060 2023-10-06T23:20:40.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.785+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 0x7fc9d00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:40.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.785+0000 7fc9d519a700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d0102060 0x7fc9d00737e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000e9f0 tx=0x7fc9c000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:40.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.785+0000 7fc9c6ffd700 1 -- 172.21.15.8:0/3769854640 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000c9c0 con 0x7fc9d0102060 2023-10-06T23:20:40.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.785+0000 7fc9c6ffd700 1 -- 172.21.15.8:0/3769854640 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9c0010430 con 0x7fc9d0102060 2023-10-06T23:20:40.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.785+0000 7fc9d7bff700 1 -- 172.21.15.8:0/3769854640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d01a10f0 con 0x7fc9d0102060 2023-10-06T23:20:40.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.785+0000 7fc9c6ffd700 1 -- 172.21.15.8:0/3769854640 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0018680 con 0x7fc9d0102060 2023-10-06T23:20:40.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.785+0000 7fc9d7bff700 1 -- 172.21.15.8:0/3769854640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d01a1650 con 0x7fc9d0102060 2023-10-06T23:20:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.790+0000 7fc9c6ffd700 1 -- 172.21.15.8:0/3769854640 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc9c00105a0 con 0x7fc9d0102060 2023-10-06T23:20:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.792+0000 7fc9c6ffd700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc9bc0a1500 0x7fc9bc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.792+0000 7fc9eb581b80 1 Processor -- start 2023-10-06T23:20:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.792+0000 7fc9c6ffd700 1 -- 172.21.15.8:0/3769854640 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc9c0014070 con 0x7fc9d0102060 2023-10-06T23:20:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.793+0000 7fc9eb581b80 1 -- start start 2023-10-06T23:20:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.793+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc9bc0a1500 0x7fc9bc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.793+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfe3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.793+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfe4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.793+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.793+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcf43400 con 0x55cbbcfe51a0 2023-10-06T23:20:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.793+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcf34bc0 con 0x55cbbcfe36d0 2023-10-06T23:20:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.793+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcf324e0 con 0x55cbbcfe47e0 2023-10-06T23:20:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d619c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfe3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfe3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49544/0 (socket says 172.21.15.8:49544) 2023-10-06T23:20:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 -- 172.21.15.8:0/3835741908 learned_addr learned my addr 172.21.15.8:0/3835741908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d519a700 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfe4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc9bc0a1500 0x7fc9bc0a39c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0074bb0 tx=0x7fc9cc00b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 -- 172.21.15.8:0/3835741908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 msgr2=0x55cbbcfe4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfe4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 -- 172.21.15.8:0/3835741908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 msgr2=0x55cbbcfeba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d599b700 1 -- 172.21.15.8:0/3835741908 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbbcd58d80 con 0x55cbbcfe36d0 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d519a700 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfe4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.794+0000 7fc9d619c700 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.795+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfe3af0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc005cd0 tx=0x7fc9cc028000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc44252bcabb1106 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.795+0000 7fc9bbfff700 1 -- 172.21.15.8:0/3835741908 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00b930 con 0x55cbbcfe36d0 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.795+0000 7fc9bbfff700 1 -- 172.21.15.8:0/3835741908 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9cc01e040 con 0x55cbbcfe36d0 2023-10-06T23:20:40.798 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.795+0000 7fc9bbfff700 1 -- 172.21.15.8:0/3835741908 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00f460 con 0x55cbbcfe36d0 2023-10-06T23:20:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.796+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3835741908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 msgr2=0x55cbbcfe3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.796+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfe3af0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc005cd0 tx=0x7fc9cc028000 comp rx=0 tx=0).stop 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.796+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3835741908 shutdown_connections 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.796+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.796+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfe3af0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.796+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/3835741908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfe4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.796+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3835741908 >> 172.21.15.8:0/3835741908 conn(0x55cbbcf4f200 msgr2=0x55cbbcfd5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.797+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3835741908 shutdown_connections 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.797+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3835741908 wait complete. 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.797+0000 7fc9eb581b80 1 -- start start 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.798+0000 7fc9eb581b80 1 Processor -- start 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.798+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfed320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.798+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfed860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.798+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcff48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.798+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcf2ddd0 con 0x55cbbcfe51a0 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.798+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbceca6b0 con 0x55cbbcfe47e0 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.798+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbceca350 con 0x55cbbcfe36d0 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.798+0000 7fc9eb581b80 10 client.0 _ll_register_callbacks cb 0x55cbbcd277a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfed320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54938/0 (socket says 172.21.15.8:54938) 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d599b700 1 -- 172.21.15.8:0/1331813523 learned_addr learned my addr 172.21.15.8:0/1331813523 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d619c700 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcff48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d519a700 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d599b700 1 -- 172.21.15.8:0/1331813523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe47e0 msgr2=0x55cbbcfed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d599b700 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d599b700 1 -- 172.21.15.8:0/1331813523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 msgr2=0x55cbbcff48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d599b700 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcff48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.799+0000 7fc9d599b700 1 -- 172.21.15.8:0/1331813523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d01a1650 con 0x55cbbcfe36d0 2023-10-06T23:20:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.800+0000 7fc9d599b700 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfed320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc005850 tx=0x7fc9cc00b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6540ea9b7cd3138e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.800+0000 7fc9b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:20:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.800+0000 7fc9b97fa700 1 -- 172.21.15.8:0/1331813523 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00b930 con 0x55cbbcfe36d0 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.800+0000 7fc9eb581b80 1 -- 172.21.15.8:0/1331813523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbbcfcdd50 con 0x55cbbcfe36d0 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.800+0000 7fc9b97fa700 1 -- 172.21.15.8:0/1331813523 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc9cc00ba90 con 0x55cbbcfe36d0 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.800+0000 7fc9b97fa700 1 -- 172.21.15.8:0/1331813523 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9cc00bc50 con 0x55cbbcfe36d0 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.800+0000 7fc9eb581b80 10 client.26152 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.800+0000 7fc9eb581b80 1 -- 172.21.15.8:0/1331813523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7fc9c8003ac0 con 0x55cbbcfe36d0 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.801+0000 7fc9b97fa700 1 -- 172.21.15.8:0/1331813523 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cbbcfcdd50 con 0x55cbbcfe36d0 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.801+0000 7fc9b97fa700 1 -- 172.21.15.8:0/1331813523 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc9cc02e430 con 0x55cbbcfe36d0 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.801+0000 7fc9eb581b80 10 client.26152 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.801+0000 7fc9eb581b80 10 client.26152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.801+0000 7fc9eb581b80 20 client.26152 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.801+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cbbcff8ca0 0x55cbbcffb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.801+0000 7fc9eb581b80 4 client.26152 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:20:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.801+0000 7fc9eb581b80 1 -- 172.21.15.8:0/1331813523 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbbcf26db0 con 0x55cbbcff8ca0 2023-10-06T23:20:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.802+0000 7fc9d519a700 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cbbcff8ca0 0x55cbbcffb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.802+0000 7fc9d519a700 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cbbcff8ca0 0x55cbbcffb0c0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12a3cce3b531f908 server_cookie=446337f88a53a414 in_seq=0 out_seq=0 2023-10-06T23:20:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.802+0000 7fc9b97fa700 10 client.26152 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.803+0000 7fc9b97fa700 1 -- 172.21.15.8:0/1331813523 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cbbcf26db0 con 0x55cbbcff8ca0 2023-10-06T23:20:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.803+0000 7fc9b97fa700 10 client.26152 handle_command_reply: tid=0 2023-10-06T23:20:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.803+0000 7fc9eb581b80 1 client.26152 shutdown 2023-10-06T23:20:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 -- 172.21.15.8:0/1331813523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 msgr2=0x55cbbcfed320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfed320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc005850 tx=0x7fc9cc00b420 comp rx=0 tx=0).stop 2023-10-06T23:20:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 -- 172.21.15.8:0/1331813523 shutdown_connections 2023-10-06T23:20:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cbbcff8ca0 0x55cbbcffb0c0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcff48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcfed320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/1331813523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe47e0 0x55cbbcfed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 -- 172.21.15.8:0/1331813523 >> 172.21.15.8:0/1331813523 conn(0x55cbbcf4f200 msgr2=0x55cbbcfd5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9b97fa700 0 client.26152 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 -- 172.21.15.8:0/1331813523 shutdown_connections 2023-10-06T23:20:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.804+0000 7fc9eb581b80 1 -- 172.21.15.8:0/1331813523 wait complete. 2023-10-06T23:20:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.805+0000 7fc9eb581b80 20 client.26152 trim_cache size 0 max 16384 2023-10-06T23:20:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.826+0000 7fc9eb581b80 1 Processor -- start 2023-10-06T23:20:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.826+0000 7fc9eb581b80 1 -- start start 2023-10-06T23:20:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.826+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.826+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcff4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.826+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.826+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcdae8c0 con 0x55cbbcfe51a0 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.826+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcfee510 con 0x55cbbcfe36d0 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.826+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcfcd890 con 0x55cbbcfe47e0 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.827+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.827+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49550/0 (socket says 172.21.15.8:49550) 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.827+0000 7fc9d599b700 1 -- 172.21.15.8:0/3519525234 learned_addr learned my addr 172.21.15.8:0/3519525234 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.827+0000 7fc9d519a700 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcff4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.827+0000 7fc9d619c700 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.827+0000 7fc9d599b700 1 -- 172.21.15.8:0/3519525234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 msgr2=0x55cbbcff4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.827+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcff4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.828+0000 7fc9d599b700 1 -- 172.21.15.8:0/3519525234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 msgr2=0x55cbbcfeb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.828+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.828+0000 7fc9d599b700 1 -- 172.21.15.8:0/3519525234 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0109c70 con 0x55cbbcfe36d0 2023-10-06T23:20:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.828+0000 7fc9d619c700 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.828+0000 7fc9d599b700 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc004360 tx=0x7fc9cc004910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c06176d87c003842 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.828+0000 7fc9c4bff700 1 -- 172.21.15.8:0/3519525234 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc02e950 con 0x55cbbcfe36d0 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.828+0000 7fc9c4bff700 1 -- 172.21.15.8:0/3519525234 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9cc02eab0 con 0x55cbbcfe36d0 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.828+0000 7fc9c4bff700 1 -- 172.21.15.8:0/3519525234 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00f7f0 con 0x55cbbcfe36d0 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.829+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3519525234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 msgr2=0x55cbbcff50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.829+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc004360 tx=0x7fc9cc004910 comp rx=0 tx=0).stop 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.829+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3519525234 shutdown_connections 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.829+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe51a0 0x55cbbcfeb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.829+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.829+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/3519525234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe47e0 0x55cbbcff4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.829+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3519525234 >> 172.21.15.8:0/3519525234 conn(0x55cbbcf4f200 msgr2=0x55cbbcfd68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.830+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3519525234 shutdown_connections 2023-10-06T23:20:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.830+0000 7fc9eb581b80 1 -- 172.21.15.8:0/3519525234 wait complete. 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.830+0000 7fc9eb581b80 1 -- start start 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.831+0000 7fc9eb581b80 1 Processor -- start 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.831+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.831+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe47e0 0x55cbbcff24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.831+0000 7fc9eb581b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe51a0 0x55cbbcff34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.831+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcff3a30 con 0x55cbbcfe47e0 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.831+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcff3ba0 con 0x55cbbcfe51a0 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.831+0000 7fc9eb581b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbbcff3d60 con 0x55cbbcfe36d0 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.831+0000 7fc9eb581b80 10 client.0 _ll_register_callbacks cb 0x7fc9c8009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54954/0 (socket says 172.21.15.8:54954) 2023-10-06T23:20:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d599b700 1 -- 172.21.15.8:0/4077876186 learned_addr learned my addr 172.21.15.8:0/4077876186 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d619c700 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe51a0 0x55cbbcff34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d599b700 1 -- 172.21.15.8:0/4077876186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe51a0 msgr2=0x55cbbcff34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d599b700 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe51a0 0x55cbbcff34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d599b700 1 -- 172.21.15.8:0/4077876186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe47e0 msgr2=0x55cbbcff24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d599b700 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe47e0 0x55cbbcff24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.832+0000 7fc9d599b700 1 -- 172.21.15.8:0/4077876186 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c8003ac0 con 0x55cbbcfe36d0 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.833+0000 7fc9d599b700 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff1fa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc005850 tx=0x7fc9cc00bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e22c6d7f9ce39f7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.833+0000 7fc9b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.833+0000 7fc9b97fa700 1 -- 172.21.15.8:0/4077876186 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc02ec20 con 0x55cbbcfe36d0 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.833+0000 7fc9eb581b80 1 -- 172.21.15.8:0/4077876186 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9cc01e040 con 0x55cbbcfe36d0 2023-10-06T23:20:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.833+0000 7fc9b97fa700 1 -- 172.21.15.8:0/4077876186 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc9cc00f590 con 0x55cbbcfe36d0 2023-10-06T23:20:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.833+0000 7fc9b97fa700 1 -- 172.21.15.8:0/4077876186 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9cc00f750 con 0x55cbbcfe36d0 2023-10-06T23:20:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.833+0000 7fc9eb581b80 10 client.26158 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.833+0000 7fc9eb581b80 1 -- 172.21.15.8:0/4077876186 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55cbbcd41c00 con 0x55cbbcfe36d0 2023-10-06T23:20:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.834+0000 7fc9b97fa700 1 -- 172.21.15.8:0/4077876186 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9cc01e040 con 0x55cbbcfe36d0 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.834+0000 7fc9b97fa700 1 -- 172.21.15.8:0/4077876186 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc9cc04c870 con 0x55cbbcfe36d0 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.834+0000 7fc9eb581b80 10 client.26158 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.834+0000 7fc9eb581b80 10 client.26158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.834+0000 7fc9eb581b80 20 client.26158 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.834+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cbbd04cfc0 0x55cbbd04f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.834+0000 7fc9eb581b80 4 client.26158 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.834+0000 7fc9eb581b80 1 -- 172.21.15.8:0/4077876186 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cbbcf26ad0 con 0x55cbbd04cfc0 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.835+0000 7fc9d519a700 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cbbd04cfc0 0x55cbbd04f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.836+0000 7fc9d519a700 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cbbd04cfc0 0x55cbbd04f3e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ddf0e7726e37077 server_cookie=4974cd8380ef0475 in_seq=0 out_seq=0 2023-10-06T23:20:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.836+0000 7fc9b97fa700 10 client.26158 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:40.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9b97fa700 1 -- 172.21.15.8:0/4077876186 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cbbcf26ad0 con 0x55cbbd04cfc0 2023-10-06T23:20:40.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9b97fa700 10 client.26158 handle_command_reply: tid=0 2023-10-06T23:20:40.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 client.26158 shutdown 2023-10-06T23:20:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 -- 172.21.15.8:0/4077876186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 msgr2=0x55cbbcff1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff1fa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc005850 tx=0x7fc9cc00bce0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 -- 172.21.15.8:0/4077876186 shutdown_connections 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cbbd04cfc0 0x55cbbd04f3e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cbbcfe51a0 0x55cbbcff34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cbbcfe36d0 0x55cbbcff1fa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 --2- 172.21.15.8:0/4077876186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cbbcfe47e0 0x55cbbcff24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 -- 172.21.15.8:0/4077876186 >> 172.21.15.8:0/4077876186 conn(0x55cbbcf4f200 msgr2=0x55cbbcff50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9b97fa700 0 client.26158 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.855+0000 7fc9eb581b80 1 -- 172.21.15.8:0/4077876186 shutdown_connections 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.856+0000 7fc9eb581b80 1 -- 172.21.15.8:0/4077876186 wait complete. 2023-10-06T23:20:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.856+0000 7fc9eb581b80 20 client.26158 trim_cache size 0 max 16384 2023-10-06T23:20:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:20:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:20:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:20:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:20:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.856+0000 7fc9d7bff700 1 -- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc9bc0a1500 msgr2=0x7fc9bc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.856+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc9bc0a1500 0x7fc9bc0a39c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0074bb0 tx=0x7fc9cc00b260 comp rx=0 tx=0).stop 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.856+0000 7fc9d7bff700 1 -- 172.21.15.8:0/3769854640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d0102060 msgr2=0x7fc9d00737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.856+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d0102060 0x7fc9d00737e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000e9f0 tx=0x7fc9c000ed00 comp rx=0 tx=0).stop 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.857+0000 7fc9d7bff700 1 -- 172.21.15.8:0/3769854640 shutdown_connections 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.857+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc9bc0a1500 0x7fc9bc0a39c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.857+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9d0100f10 0x7fc9d00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.857+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d0102a20 0x7fc9d0073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.857+0000 7fc9d7bff700 1 --2- 172.21.15.8:0/3769854640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9d0102060 0x7fc9d00737e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.857+0000 7fc9d7bff700 1 -- 172.21.15.8:0/3769854640 >> 172.21.15.8:0/3769854640 conn(0x7fc9d00fc460 msgr2=0x7fc9d00fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.857+0000 7fc9d7bff700 1 -- 172.21.15.8:0/3769854640 shutdown_connections 2023-10-06T23:20:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:40.857+0000 7fc9d7bff700 1 -- 172.21.15.8:0/3769854640 wait complete. 2023-10-06T23:20:41.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:41 smithi190 ceph-mon[102658]: pgmap v585: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 7.3 MiB/s wr, 591 op/s 2023-10-06T23:20:41.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:41 smithi156 ceph-mon[102862]: pgmap v585: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 7.3 MiB/s wr, 591 op/s 2023-10-06T23:20:41.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:41 smithi008 ceph-mon[98532]: pgmap v585: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 7.3 MiB/s wr, 591 op/s 2023-10-06T23:20:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:42 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:20:42.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:42 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:20:42.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:42 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:20:43.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi156 to 220.9M 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: Unable to set osd_memory_target on smithi156 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi190 to 220.9M 2023-10-06T23:20:43.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: Unable to set osd_memory_target on smithi190 to 231680512: error parsing value: Value '231680512' is below minimum 939524096 2023-10-06T23:20:43.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:20:43.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:20:43.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:20:43.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:43 smithi008 ceph-mon[98532]: pgmap v586: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 6.7 MiB/s wr, 523 op/s 2023-10-06T23:20:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi156 to 220.9M 2023-10-06T23:20:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: Unable to set osd_memory_target on smithi156 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi190 to 220.9M 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: Unable to set osd_memory_target on smithi190 to 231680512: error parsing value: Value '231680512' is below minimum 939524096 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:20:43.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:43 smithi190 ceph-mon[102658]: pgmap v586: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 6.7 MiB/s wr, 523 op/s 2023-10-06T23:20:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi156 to 220.9M 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: Unable to set osd_memory_target on smithi156 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:20:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi190 to 220.9M 2023-10-06T23:20:43.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: Unable to set osd_memory_target on smithi190 to 231680512: error parsing value: Value '231680512' is below minimum 939524096 2023-10-06T23:20:43.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:20:43.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:20:43.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:20:43.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:43 smithi156 ceph-mon[102862]: pgmap v586: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 6.7 MiB/s wr, 523 op/s 2023-10-06T23:20:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 350.0 s, 194.6 tps, lat 516.816 ms stddev 306.428 2023-10-06T23:20:45.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:45 smithi190 ceph-mon[102658]: pgmap v587: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 8.1 MiB/s wr, 594 op/s 2023-10-06T23:20:45.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:45 smithi156 ceph-mon[102862]: pgmap v587: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 8.1 MiB/s wr, 594 op/s 2023-10-06T23:20:45.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:45 smithi008 ceph-mon[98532]: pgmap v587: 97 pgs: 97 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 8.1 MiB/s wr, 594 op/s 2023-10-06T23:20:47.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:47 smithi190 ceph-mon[102658]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 7.3 MiB/s wr, 544 op/s 2023-10-06T23:20:47.525 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:20:47.590 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:47 smithi008 ceph-mon[98532]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 7.3 MiB/s wr, 544 op/s 2023-10-06T23:20:47.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:47 smithi156 ceph-mon[102862]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 7.3 MiB/s wr, 544 op/s 2023-10-06T23:20:47.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.785+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/586219157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec4101940 msgr2=0x7f2ec4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.785+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/586219157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec4101940 0x7f2ec4103d30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009990 tx=0x7f2ec0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.786+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/586219157 shutdown_connections 2023-10-06T23:20:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.786+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/586219157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec4106ba0 0x7f2ec4109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.786+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/586219157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec4101940 0x7f2ec4103d30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.786+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/586219157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec4104270 0x7f2ec4106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.786+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/586219157 >> 172.21.15.8:0/586219157 conn(0x7f2ec40fb330 msgr2=0x7f2ec40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.786+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/586219157 shutdown_connections 2023-10-06T23:20:47.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.786+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/586219157 wait complete. 2023-10-06T23:20:47.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.788+0000 7f2ecc7ff700 1 Processor -- start 2023-10-06T23:20:47.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.788+0000 7f2ecc7ff700 1 -- start start 2023-10-06T23:20:47.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.788+0000 7f2ecc7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec4101940 0x7f2ec4195560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ecc7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec4104270 0x7f2ec4195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ecc7ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec4106ba0 0x7f2ec41920f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ecc7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4192890 con 0x7f2ec4104270 2023-10-06T23:20:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ecc7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4192a00 con 0x7f2ec4101940 2023-10-06T23:20:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ecc7ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4192bc0 con 0x7f2ec4106ba0 2023-10-06T23:20:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ecad9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec4106ba0 0x7f2ec41920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ecad9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec4106ba0 0x7f2ec41920f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54966/0 (socket says 172.21.15.8:54966) 2023-10-06T23:20:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ecad9c700 1 -- 172.21.15.8:0/909268753 learned_addr learned my addr 172.21.15.8:0/909268753 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.789+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec4104270 0x7f2ec4195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.790+0000 7f2eca59b700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec4101940 0x7f2ec4195560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.790+0000 7f2ecad9c700 1 -- 172.21.15.8:0/909268753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec4101940 msgr2=0x7f2ec4195560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.790+0000 7f2ecad9c700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec4101940 0x7f2ec4195560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.790+0000 7f2ecad9c700 1 -- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec4104270 msgr2=0x7f2ec4195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.790+0000 7f2ecad9c700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec4104270 0x7f2ec4195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.790+0000 7f2ecad9c700 1 -- 172.21.15.8:0/909268753 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00095f0 con 0x7f2ec4106ba0 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.791+0000 7f2ecad9c700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec4106ba0 0x7f2ec41920f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00ef30 tx=0x7f2ebc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.791+0000 7f2ebb7fe700 1 -- 172.21.15.8:0/909268753 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc018070 con 0x7f2ec4106ba0 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.791+0000 7f2ebb7fe700 1 -- 172.21.15.8:0/909268753 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ebc00f040 con 0x7f2ec4106ba0 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.791+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/909268753 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec41a51f0 con 0x7f2ec4106ba0 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.791+0000 7f2ebb7fe700 1 -- 172.21.15.8:0/909268753 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00cbc0 con 0x7f2ec4106ba0 2023-10-06T23:20:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.791+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/909268753 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec41a56d0 con 0x7f2ec4106ba0 2023-10-06T23:20:47.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.797+0000 7f2ebb7fe700 1 -- 172.21.15.8:0/909268753 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2ebc007500 con 0x7f2ec4106ba0 2023-10-06T23:20:47.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.798+0000 7f2ee0055b80 1 Processor -- start 2023-10-06T23:20:47.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.798+0000 7f2ee0055b80 1 -- start start 2023-10-06T23:20:47.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.798+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619260 0x5623da619680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.798+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619bc0 0x5623da61a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.798+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da61aa60 0x5623da61aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.798+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da581460 con 0x5623da619260 2023-10-06T23:20:47.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.798+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da572c20 con 0x5623da61aa60 2023-10-06T23:20:47.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.798+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da570540 con 0x5623da619bc0 2023-10-06T23:20:47.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.799+0000 7f2eca59b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619bc0 0x5623da61a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.799+0000 7f2eca59b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619bc0 0x5623da61a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54978/0 (socket says 172.21.15.8:54978) 2023-10-06T23:20:47.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.799+0000 7f2eca59b700 1 -- 172.21.15.8:0/117383108 learned_addr learned my addr 172.21.15.8:0/117383108 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:47.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.799+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da61aa60 0x5623da61aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.799+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619260 0x5623da619680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2eca59b700 1 -- 172.21.15.8:0/117383108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da61aa60 msgr2=0x5623da61aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2eca59b700 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da61aa60 0x5623da61aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2eca59b700 1 -- 172.21.15.8:0/117383108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619260 msgr2=0x5623da619680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2eca59b700 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619260 0x5623da619680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2ebb7fe700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2eb00a1500 0x7f2eb00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2eca59b700 1 -- 172.21.15.8:0/117383108 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623da396de0 con 0x5623da619bc0 2023-10-06T23:20:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2ebb7fe700 1 -- 172.21.15.8:0/909268753 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2ebc0cc740 con 0x7f2ec4106ba0 2023-10-06T23:20:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2ecad9c700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2eb00a1500 0x7f2eb00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.800+0000 7f2eca59b700 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619bc0 0x5623da61a480 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009990 tx=0x7f2ec0005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebb596840e86d212 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.801+0000 7f2ecad9c700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2eb00a1500 0x7f2eb00a39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc096570 tx=0x7f2ebc009ed0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.801+0000 7f2eb8ff9700 1 -- 172.21.15.8:0/117383108 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec001d070 con 0x5623da619bc0 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.801+0000 7f2eb8ff9700 1 -- 172.21.15.8:0/117383108 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ec001e040 con 0x5623da619bc0 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.801+0000 7f2eb8ff9700 1 -- 172.21.15.8:0/117383108 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000b710 con 0x5623da619bc0 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.802+0000 7f2ee0055b80 1 -- 172.21.15.8:0/117383108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619bc0 msgr2=0x5623da61a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.802+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619bc0 0x5623da61a480 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009990 tx=0x7f2ec0005f00 comp rx=0 tx=0).stop 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.802+0000 7f2ee0055b80 1 -- 172.21.15.8:0/117383108 shutdown_connections 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.802+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619260 0x5623da619680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.802+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da61aa60 0x5623da61aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.802+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/117383108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619bc0 0x5623da61a480 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.802+0000 7f2ee0055b80 1 -- 172.21.15.8:0/117383108 >> 172.21.15.8:0/117383108 conn(0x5623da58d260 msgr2=0x5623da614140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.802+0000 7f2ee0055b80 1 -- 172.21.15.8:0/117383108 shutdown_connections 2023-10-06T23:20:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.803+0000 7f2ee0055b80 1 -- 172.21.15.8:0/117383108 wait complete. 2023-10-06T23:20:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.803+0000 7f2ee0055b80 1 -- start start 2023-10-06T23:20:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.803+0000 7f2ee0055b80 1 Processor -- start 2023-10-06T23:20:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da622fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da6234f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 0x5623da62a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da56be30 con 0x5623da619bc0 2023-10-06T23:20:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da508710 con 0x5623da619260 2023-10-06T23:20:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da5083b0 con 0x5623da61aa60 2023-10-06T23:20:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ee0055b80 10 client.0 _ll_register_callbacks cb 0x5623da365800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ec9d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da622fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ec9d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da622fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49590/0 (socket says 172.21.15.8:49590) 2023-10-06T23:20:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2ec9d9a700 1 -- 172.21.15.8:0/2367557410 learned_addr learned my addr 172.21.15.8:0/2367557410 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.804+0000 7f2eca59b700 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da6234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.805+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 0x5623da62a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.805+0000 7f2ec9d9a700 1 -- 172.21.15.8:0/2367557410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 msgr2=0x5623da62a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.805+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 0x5623da62a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.805+0000 7f2ec9d9a700 1 -- 172.21.15.8:0/2367557410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 msgr2=0x5623da6234f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.805+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da6234f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.805+0000 7f2ec9d9a700 1 -- 172.21.15.8:0/2367557410 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec4109c00 con 0x5623da619260 2023-10-06T23:20:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.805+0000 7f2eca59b700 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da6234f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.806+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da622fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400f430 tx=0x7f2eb40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dda4284292116035 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.806+0000 7f2eadffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.806+0000 7f2eadffb700 1 -- 172.21.15.8:0/2367557410 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400fd20 con 0x5623da619260 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.806+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2367557410 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623da60bf10 con 0x5623da619260 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.806+0000 7f2eadffb700 1 -- 172.21.15.8:0/2367557410 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2eb400fe80 con 0x5623da619260 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.806+0000 7f2eadffb700 1 -- 172.21.15.8:0/2367557410 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eb4004030 con 0x5623da619260 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.806+0000 7f2ee0055b80 10 client.26147 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.806+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2367557410 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5623da37fc60 con 0x5623da619260 2023-10-06T23:20:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.807+0000 7f2eadffb700 1 -- 172.21.15.8:0/2367557410 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5623da60bf10 con 0x5623da619260 2023-10-06T23:20:47.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.807+0000 7f2eadffb700 1 -- 172.21.15.8:0/2367557410 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2eb4003c60 con 0x5623da619260 2023-10-06T23:20:47.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.808+0000 7f2ee0055b80 10 client.26147 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:47.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.808+0000 7f2ee0055b80 10 client.26147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:47.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.808+0000 7f2ee0055b80 20 client.26147 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.808+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5623da62ed00 0x5623da631120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.808+0000 7f2ee0055b80 4 client.26147 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:20:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.808+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2367557410 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623da564e10 con 0x5623da62ed00 2023-10-06T23:20:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.808+0000 7f2eca59b700 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5623da62ed00 0x5623da631120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.809+0000 7f2eca59b700 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5623da62ed00 0x5623da631120 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ce40abc6b6ae575 server_cookie=30076a7c2da2f068 in_seq=0 out_seq=0 2023-10-06T23:20:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.809+0000 7f2eadffb700 10 client.26147 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.809+0000 7f2eadffb700 1 -- 172.21.15.8:0/2367557410 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5623da564e10 con 0x5623da62ed00 2023-10-06T23:20:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.809+0000 7f2eadffb700 10 client.26147 handle_command_reply: tid=0 2023-10-06T23:20:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 client.26147 shutdown 2023-10-06T23:20:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2367557410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 msgr2=0x5623da622fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da622fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400f430 tx=0x7f2eb40047c0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2367557410 shutdown_connections 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5623da62ed00 0x5623da631120 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 0x5623da62a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da622fb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2eadffb700 0 client.26147 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2367557410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da6234f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2367557410 >> 172.21.15.8:0/2367557410 conn(0x5623da58d260 msgr2=0x5623da613f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2367557410 shutdown_connections 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.810+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2367557410 wait complete. 2023-10-06T23:20:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.811+0000 7f2ee0055b80 20 client.26147 trim_cache size 0 max 16384 2023-10-06T23:20:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.832+0000 7f2ee0055b80 1 Processor -- start 2023-10-06T23:20:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.832+0000 7f2ee0055b80 1 -- start start 2023-10-06T23:20:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da62ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da62a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 0x5623da622d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da3ec920 con 0x5623da619bc0 2023-10-06T23:20:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da622b20 con 0x5623da619260 2023-10-06T23:20:47.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da610a20 con 0x5623da61aa60 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2eca59b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da62a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ec9d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da62ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ec9d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da62ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49592/0 (socket says 172.21.15.8:49592) 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ec9d9a700 1 -- 172.21.15.8:0/42549979 learned_addr learned my addr 172.21.15.8:0/42549979 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.833+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 0x5623da622d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2ec9d9a700 1 -- 172.21.15.8:0/42549979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 msgr2=0x5623da622d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 0x5623da622d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2ec9d9a700 1 -- 172.21.15.8:0/42549979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 msgr2=0x5623da62a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da62a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2ec9d9a700 1 -- 172.21.15.8:0/42549979 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623da3bd250 con 0x5623da619260 2023-10-06T23:20:47.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2eca59b700 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da62a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:47.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da62ae20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4011870 tx=0x7f2eb4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6492a29a1b997dec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2eb97fa700 1 -- 172.21.15.8:0/42549979 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40237c0 con 0x5623da619260 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2eb97fa700 1 -- 172.21.15.8:0/42549979 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2eb4005b40 con 0x5623da619260 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.834+0000 7f2eb97fa700 1 -- 172.21.15.8:0/42549979 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4004430 con 0x5623da619260 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 -- 172.21.15.8:0/42549979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 msgr2=0x5623da62ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da62ae20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4011870 tx=0x7f2eb4004750 comp rx=0 tx=0).stop 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 -- 172.21.15.8:0/42549979 shutdown_connections 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da61aa60 0x5623da622d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619260 0x5623da62ae20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/42549979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da619bc0 0x5623da62a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 -- 172.21.15.8:0/42549979 >> 172.21.15.8:0/42549979 conn(0x5623da58d260 msgr2=0x5623da621ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 -- 172.21.15.8:0/42549979 shutdown_connections 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.835+0000 7f2ee0055b80 1 -- 172.21.15.8:0/42549979 wait complete. 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.836+0000 7f2ee0055b80 1 -- start start 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.836+0000 7f2ee0055b80 1 Processor -- start 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619260 0x5623da629df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619bc0 0x5623da62a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ee0055b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da61aa60 0x5623da628400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da628a20 con 0x5623da61aa60 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da628b90 con 0x5623da619bc0 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ee0055b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623da628d50 con 0x5623da619260 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ee0055b80 10 client.0 _ll_register_callbacks cb 0x7f2eb4011d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2eca59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619bc0 0x5623da62a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ec9d9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619260 0x5623da629df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2eca59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619bc0 0x5623da62a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49602/0 (socket says 172.21.15.8:49602) 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2eca59b700 1 -- 172.21.15.8:0/2175857035 learned_addr learned my addr 172.21.15.8:0/2175857035 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da61aa60 0x5623da628400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2eca59b700 1 -- 172.21.15.8:0/2175857035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619260 msgr2=0x5623da629df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2eca59b700 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619260 0x5623da629df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2eca59b700 1 -- 172.21.15.8:0/2175857035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da61aa60 msgr2=0x5623da628400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2eca59b700 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da61aa60 0x5623da628400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2eca59b700 1 -- 172.21.15.8:0/2175857035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623da396de0 con 0x5623da619bc0 2023-10-06T23:20:47.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.837+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da61aa60 0x5623da628400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.838+0000 7f2eca59b700 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619bc0 0x5623da62a330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00098e0 tx=0x7f2ec00094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce235c0eae576ba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.838+0000 7f2eadffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.838+0000 7f2eadffb700 1 -- 172.21.15.8:0/2175857035 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0031040 con 0x5623da619bc0 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.838+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2175857035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ec001e040 con 0x5623da619bc0 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.838+0000 7f2eadffb700 1 -- 172.21.15.8:0/2175857035 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2ec00334b0 con 0x5623da619bc0 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.839+0000 7f2eadffb700 1 -- 172.21.15.8:0/2175857035 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ec001d040 con 0x5623da619bc0 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.839+0000 7f2ee0055b80 10 client.26153 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.839+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2175857035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5623da37fc60 con 0x5623da619bc0 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.839+0000 7f2eadffb700 1 -- 172.21.15.8:0/2175857035 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ec001e040 con 0x5623da619bc0 2023-10-06T23:20:47.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.839+0000 7f2eadffb700 1 -- 172.21.15.8:0/2175857035 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2ec0033c00 con 0x5623da619bc0 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.839+0000 7f2ee0055b80 10 client.26153 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.839+0000 7f2ee0055b80 10 client.26153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.839+0000 7f2ee0055b80 20 client.26153 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.840+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5623da683a30 0x5623da685e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.840+0000 7f2ee0055b80 4 client.26153 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.840+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2175857035 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5623da564b30 con 0x5623da683a30 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.840+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5623da683a30 0x5623da685e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.841+0000 7f2ec9d9a700 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5623da683a30 0x5623da685e50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b8c59b4a886ad4 server_cookie=e06706b7963b8fdc in_seq=0 out_seq=0 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.841+0000 7f2eadffb700 10 client.26153 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.841+0000 7f2eadffb700 1 -- 172.21.15.8:0/2175857035 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5623da564b30 con 0x5623da683a30 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.841+0000 7f2eadffb700 10 client.26153 handle_command_reply: tid=0 2023-10-06T23:20:47.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.841+0000 7f2ee0055b80 1 client.26153 shutdown 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.841+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2175857035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619bc0 msgr2=0x5623da62a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.841+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619bc0 0x5623da62a330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00098e0 tx=0x7f2ec00094b0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2175857035 shutdown_connections 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5623da683a30 0x5623da685e50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5623da61aa60 0x5623da628400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623da619260 0x5623da629df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 1 --2- 172.21.15.8:0/2175857035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623da619bc0 0x5623da62a330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2175857035 >> 172.21.15.8:0/2175857035 conn(0x5623da58d260 msgr2=0x5623da61d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2eadffb700 0 client.26153 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2175857035 shutdown_connections 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 1 -- 172.21.15.8:0/2175857035 wait complete. 2023-10-06T23:20:47.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.842+0000 7f2ee0055b80 20 client.26153 trim_cache size 0 max 16384 2023-10-06T23:20:47.847 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:20:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:20:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:20:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:20:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:20:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:20:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:20:47.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:20:47.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:20:47.848 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:20:47.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2eb00a1500 msgr2=0x7f2eb00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2eb00a1500 0x7f2eb00a39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc096570 tx=0x7f2ebc009ed0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/909268753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec4106ba0 msgr2=0x7f2ec41920f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec4106ba0 0x7f2ec41920f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00ef30 tx=0x7f2ebc00c3a0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/909268753 shutdown_connections 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2eb00a1500 0x7f2eb00a39c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec4106ba0 0x7f2ec41920f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec4101940 0x7f2ec4195560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 --2- 172.21.15.8:0/909268753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec4104270 0x7f2ec4195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/909268753 >> 172.21.15.8:0/909268753 conn(0x7f2ec40fb330 msgr2=0x7f2ec40fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/909268753 shutdown_connections 2023-10-06T23:20:47.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:20:47.843+0000 7f2ecc7ff700 1 -- 172.21.15.8:0/909268753 wait complete. 2023-10-06T23:20:47.866 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:20:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 355.0 s, 235.0 tps, lat 423.870 ms stddev 143.121 2023-10-06T23:20:49.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:49 smithi190 ceph-mon[102658]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.9 MiB/s wr, 487 op/s 2023-10-06T23:20:49.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:49 smithi156 ceph-mon[102862]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.9 MiB/s wr, 487 op/s 2023-10-06T23:20:49.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:49 smithi008 ceph-mon[98532]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.9 MiB/s wr, 487 op/s 2023-10-06T23:20:51.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:51 smithi190 ceph-mon[102658]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2023-10-06T23:20:51.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:51 smithi156 ceph-mon[102862]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2023-10-06T23:20:51.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:51 smithi008 ceph-mon[98532]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2023-10-06T23:20:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:53 smithi190 ceph-mon[102658]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 5.2 MiB/s wr, 430 op/s 2023-10-06T23:20:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:53 smithi156 ceph-mon[102862]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 5.2 MiB/s wr, 430 op/s 2023-10-06T23:20:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:53 smithi008 ceph-mon[98532]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 5.2 MiB/s wr, 430 op/s 2023-10-06T23:20:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 360.0 s, 187.2 tps, lat 465.510 ms stddev 286.474 2023-10-06T23:20:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 -- 172.21.15.8:0/1912734122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 msgr2=0x7f65e8108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 --2- 172.21.15.8:0/1912734122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 0x7f65e8108b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009990 tx=0x7f65d8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 -- 172.21.15.8:0/1912734122 shutdown_connections 2023-10-06T23:20:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 --2- 172.21.15.8:0/1912734122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e81090c0 0x7f65e810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 --2- 172.21.15.8:0/1912734122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65e8107530 0x7f65e8107950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 --2- 172.21.15.8:0/1912734122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 0x7f65e8108b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 -- 172.21.15.8:0/1912734122 >> 172.21.15.8:0/1912734122 conn(0x7f65e80764b0 msgr2=0x7f65e8078910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 -- 172.21.15.8:0/1912734122 shutdown_connections 2023-10-06T23:20:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.056+0000 7f65f03ff700 1 -- 172.21.15.8:0/1912734122 wait complete. 2023-10-06T23:20:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.058+0000 7f65f03ff700 1 Processor -- start 2023-10-06T23:20:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.058+0000 7f65f03ff700 1 -- start start 2023-10-06T23:20:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.058+0000 7f65f03ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e8107530 0x7f65e819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65f03ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 0x7f65e819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65f03ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65e81090c0 0x7f65e819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65f03ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e819ec40 con 0x7f65e8107530 2023-10-06T23:20:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65f03ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e819edb0 con 0x7f65e81090c0 2023-10-06T23:20:54.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65f03ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e819ef70 con 0x7f65e8108720 2023-10-06T23:20:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65ee99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65e81090c0 0x7f65e819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65ee99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65e81090c0 0x7f65e819e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47360/0 (socket says 172.21.15.8:47360) 2023-10-06T23:20:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65ee99c700 1 -- 172.21.15.8:0/511115589 learned_addr learned my addr 172.21.15.8:0/511115589 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65ee19b700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e8107530 0x7f65e819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.059+0000 7f65ed99a700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 0x7f65e819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.060+0000 7f65ee99c700 1 -- 172.21.15.8:0/511115589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 msgr2=0x7f65e819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.060+0000 7f65ee99c700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 0x7f65e819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.060+0000 7f65ee99c700 1 -- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e8107530 msgr2=0x7f65e819d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.060+0000 7f65ee99c700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e8107530 0x7f65e819d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.060+0000 7f65ee99c700 1 -- 172.21.15.8:0/511115589 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80095f0 con 0x7f65e81090c0 2023-10-06T23:20:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.060+0000 7f65ed99a700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 0x7f65e819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:20:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.060+0000 7f65ee99c700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65e81090c0 0x7f65e819e5e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f65e0007ee0 tx=0x7f65e000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.061+0000 7f65df7fe700 1 -- 172.21.15.8:0/511115589 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0017070 con 0x7f65e81090c0 2023-10-06T23:20:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.061+0000 7f65df7fe700 1 -- 172.21.15.8:0/511115589 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65e000f040 con 0x7f65e81090c0 2023-10-06T23:20:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.061+0000 7f65df7fe700 1 -- 172.21.15.8:0/511115589 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0005710 con 0x7f65e81090c0 2023-10-06T23:20:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.061+0000 7f65f03ff700 1 -- 172.21.15.8:0/511115589 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e819f250 con 0x7f65e81090c0 2023-10-06T23:20:54.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.061+0000 7f65f03ff700 1 -- 172.21.15.8:0/511115589 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e81a5a10 con 0x7f65e81090c0 2023-10-06T23:20:54.068 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.067+0000 7f6603e08b80 1 Processor -- start 2023-10-06T23:20:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.068+0000 7f65df7fe700 1 -- 172.21.15.8:0/511115589 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f65e0005870 con 0x7f65e81090c0 2023-10-06T23:20:54.069 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.068+0000 7f6603e08b80 1 -- start start 2023-10-06T23:20:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.068+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743e22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.068+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743e3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.068+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743ea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.068+0000 7f6603e08b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c7434a400 con 0x555c743e1ec0 2023-10-06T23:20:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.068+0000 7f6603e08b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c7433bbc0 con 0x555c743e2fd0 2023-10-06T23:20:54.070 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.068+0000 7f6603e08b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c743394e0 con 0x555c743e3990 2023-10-06T23:20:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.069+0000 7f65ee19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.069+0000 7f65ee19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743e3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47366/0 (socket says 172.21.15.8:47366) 2023-10-06T23:20:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.069+0000 7f65ed99a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743e22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.069+0000 7f65ee19b700 1 -- 172.21.15.8:0/1698335511 learned_addr learned my addr 172.21.15.8:0/1698335511 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.069+0000 7f65ed99a700 1 --2- 172.21.15.8:0/1698335511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.070+0000 7f65ee19b700 1 -- 172.21.15.8:0/1698335511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 msgr2=0x555c743ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.070+0000 7f65ee19b700 1 --2- 172.21.15.8:0/1698335511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743ea220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.070+0000 7f65ee19b700 1 -- 172.21.15.8:0/1698335511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 msgr2=0x555c743e22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.070+0000 7f65ee19b700 1 --2- 172.21.15.8:0/1698335511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743e22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.070+0000 7f65ee19b700 1 -- 172.21.15.8:0/1698335511 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c7415fd80 con 0x555c743e2fd0 2023-10-06T23:20:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.070+0000 7f65df7fe700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65d40a14d0 0x7f65d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.070+0000 7f65ee19b700 1 --2- 172.21.15.8:0/1698335511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743e3450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009d30 tx=0x7f65e4011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b66ad4f565e14d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.071+0000 7f65df7fe700 1 -- 172.21.15.8:0/511115589 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f65e00cc500 con 0x7f65e81090c0 2023-10-06T23:20:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.071+0000 7f65dcbfe700 1 -- 172.21.15.8:0/1698335511 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4004220 con 0x555c743e2fd0 2023-10-06T23:20:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.071+0000 7f65dcbfe700 1 -- 172.21.15.8:0/1698335511 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65e4004380 con 0x555c743e2fd0 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.071+0000 7f65dcbfe700 1 -- 172.21.15.8:0/1698335511 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e40197a0 con 0x555c743e2fd0 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.071+0000 7f65ed99a700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65d40a14d0 0x7f65d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 -- 172.21.15.8:0/1698335511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 msgr2=0x555c743e3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 --2- 172.21.15.8:0/1698335511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743e3450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009d30 tx=0x7f65e4011720 comp rx=0 tx=0).stop 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f65ed99a700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65d40a14d0 0x7f65d40a3990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f65d800b2e0 tx=0x7f65d8009ca0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 -- 172.21.15.8:0/1698335511 shutdown_connections 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 --2- 172.21.15.8:0/1698335511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743e22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 --2- 172.21.15.8:0/1698335511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 --2- 172.21.15.8:0/1698335511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743e3450 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 -- 172.21.15.8:0/1698335511 >> 172.21.15.8:0/1698335511 conn(0x555c74356200 msgr2=0x555c743dcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 -- 172.21.15.8:0/1698335511 shutdown_connections 2023-10-06T23:20:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.072+0000 7f6603e08b80 1 -- 172.21.15.8:0/1698335511 wait complete. 2023-10-06T23:20:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.073+0000 7f6603e08b80 1 -- start start 2023-10-06T23:20:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.073+0000 7f6603e08b80 1 Processor -- start 2023-10-06T23:20:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.074+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.074+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e2fd0 0x555c743ec020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.074+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.074+0000 7f6603e08b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c74334dd0 con 0x555c743e1ec0 2023-10-06T23:20:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.074+0000 7f6603e08b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c742d16b0 con 0x555c743e3990 2023-10-06T23:20:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.074+0000 7f6603e08b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c742d1350 con 0x555c743e2fd0 2023-10-06T23:20:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.074+0000 7f6603e08b80 10 client.0 _ll_register_callbacks cb 0x555c7412e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ed99a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e2fd0 0x555c743ec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47368/0 (socket says 172.21.15.8:47368) 2023-10-06T23:20:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee99c700 1 -- 172.21.15.8:0/968063008 learned_addr learned my addr 172.21.15.8:0/968063008 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee99c700 1 -- 172.21.15.8:0/968063008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e2fd0 msgr2=0x555c743ec020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee99c700 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e2fd0 0x555c743ec020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee99c700 1 -- 172.21.15.8:0/968063008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 msgr2=0x555c743ebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee99c700 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743ebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.075+0000 7f65ee99c700 1 -- 172.21.15.8:0/968063008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e4009960 con 0x555c743e3990 2023-10-06T23:20:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.076+0000 7f65ee99c700 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f3060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65e00997c0 tx=0x7f65e0099210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=253a64c7a473e1a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.076+0000 7f65d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:20:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.076+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968063008 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00cc310 con 0x555c743e3990 2023-10-06T23:20:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.076+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968063008 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f65e0099830 con 0x555c743e3990 2023-10-06T23:20:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.076+0000 7f6603e08b80 1 -- 172.21.15.8:0/968063008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c743d4d50 con 0x555c743e3990 2023-10-06T23:20:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.076+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968063008 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65e009d980 con 0x555c743e3990 2023-10-06T23:20:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.076+0000 7f6603e08b80 10 client.26165 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.076+0000 7f6603e08b80 1 -- 172.21.15.8:0/968063008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x555c74148c00 con 0x555c743e3990 2023-10-06T23:20:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.077+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968063008 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555c743d4d50 con 0x555c743e3990 2023-10-06T23:20:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.077+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968063008 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f65e0099a90 con 0x555c743e3990 2023-10-06T23:20:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.077+0000 7f6603e08b80 10 client.26165 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.077+0000 7f6603e08b80 10 client.26165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.077+0000 7f6603e08b80 20 client.26165 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.077+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555c743f7840 0x555c743f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.077+0000 7f6603e08b80 4 client.26165 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:20:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.077+0000 7f6603e08b80 1 -- 172.21.15.8:0/968063008 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c7432ddb0 con 0x555c743f7840 2023-10-06T23:20:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.078+0000 7f65ee19b700 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555c743f7840 0x555c743f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.078+0000 7f65ee19b700 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555c743f7840 0x555c743f9c60 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=934806f86e658ff3 server_cookie=ca85f990197233da in_seq=0 out_seq=0 2023-10-06T23:20:54.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.079+0000 7f65d1ffb700 10 client.26165 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.079+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968063008 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555c7432ddb0 con 0x555c743f7840 2023-10-06T23:20:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.079+0000 7f65d1ffb700 10 client.26165 handle_command_reply: tid=0 2023-10-06T23:20:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 client.26165 shutdown 2023-10-06T23:20:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 -- 172.21.15.8:0/968063008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 msgr2=0x555c743f3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f3060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65e00997c0 tx=0x7f65e0099210 comp rx=0 tx=0).stop 2023-10-06T23:20:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 -- 172.21.15.8:0/968063008 shutdown_connections 2023-10-06T23:20:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555c743f7840 0x555c743f9c60 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f3060 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f65d1ffb700 0 client.26165 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:54.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968063008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e2fd0 0x555c743ec020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.080+0000 7f6603e08b80 1 -- 172.21.15.8:0/968063008 >> 172.21.15.8:0/968063008 conn(0x555c74356200 msgr2=0x555c743dc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.081+0000 7f6603e08b80 1 -- 172.21.15.8:0/968063008 shutdown_connections 2023-10-06T23:20:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.081+0000 7f6603e08b80 1 -- 172.21.15.8:0/968063008 wait complete. 2023-10-06T23:20:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.081+0000 7f6603e08b80 20 client.26165 trim_cache size 0 max 16384 2023-10-06T23:20:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.103+0000 7f6603e08b80 1 Processor -- start 2023-10-06T23:20:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.103+0000 7f6603e08b80 1 -- start start 2023-10-06T23:20:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743eb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743f3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743dcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f6603e08b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c741b58c0 con 0x555c743e1ec0 2023-10-06T23:20:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f6603e08b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c743f4d50 con 0x555c743e2fd0 2023-10-06T23:20:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f6603e08b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c743ddf50 con 0x555c743e3990 2023-10-06T23:20:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f65ee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f65ed99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f65ee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45152/0 (socket says 172.21.15.8:45152) 2023-10-06T23:20:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f65ed99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47372/0 (socket says 172.21.15.8:47372) 2023-10-06T23:20:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f65ee19b700 1 -- 172.21.15.8:0/616126847 learned_addr learned my addr 172.21.15.8:0/616126847 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.104+0000 7f65ee99c700 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743dcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65ee99c700 1 -- 172.21.15.8:0/616126847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 msgr2=0x555c743f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65ee99c700 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65ee99c700 1 -- 172.21.15.8:0/616126847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 msgr2=0x555c743eb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65ee99c700 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743eb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65ee99c700 1 -- 172.21.15.8:0/616126847 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c741861f0 con 0x555c743e3990 2023-10-06T23:20:54.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65ee19b700 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:20:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65ee99c700 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743dcb80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f65e0096250 tx=0x7f65e000df60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=224b3e0d6a813d3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65dd3ff700 1 -- 172.21.15.8:0/616126847 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e009d980 con 0x555c743e3990 2023-10-06T23:20:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65dd3ff700 1 -- 172.21.15.8:0/616126847 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65e0099830 con 0x555c743e3990 2023-10-06T23:20:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.105+0000 7f65dd3ff700 1 -- 172.21.15.8:0/616126847 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00cc370 con 0x555c743e3990 2023-10-06T23:20:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.106+0000 7f6603e08b80 1 -- 172.21.15.8:0/616126847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 msgr2=0x555c743dcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.106+0000 7f6603e08b80 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743dcb80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f65e0096250 tx=0x7f65e000df60 comp rx=0 tx=0).stop 2023-10-06T23:20:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.106+0000 7f6603e08b80 1 -- 172.21.15.8:0/616126847 shutdown_connections 2023-10-06T23:20:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.106+0000 7f6603e08b80 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e1ec0 0x555c743eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.106+0000 7f6603e08b80 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e3990 0x555c743dcb80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.106+0000 7f6603e08b80 1 --2- 172.21.15.8:0/616126847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e2fd0 0x555c743f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.106+0000 7f6603e08b80 1 -- 172.21.15.8:0/616126847 >> 172.21.15.8:0/616126847 conn(0x555c74356200 msgr2=0x555c743dc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.107+0000 7f6603e08b80 1 -- 172.21.15.8:0/616126847 shutdown_connections 2023-10-06T23:20:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.107+0000 7f6603e08b80 1 -- 172.21.15.8:0/616126847 wait complete. 2023-10-06T23:20:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.107+0000 7f6603e08b80 1 -- start start 2023-10-06T23:20:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.107+0000 7f6603e08b80 1 Processor -- start 2023-10-06T23:20:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.108+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e1ec0 0x555c743f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.108+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e2fd0 0x555c743f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.114 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.108+0000 7f6603e08b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.114 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.108+0000 7f6603e08b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c743f24e0 con 0x555c743e2fd0 2023-10-06T23:20:54.114 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.108+0000 7f6603e08b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c743f2650 con 0x555c743e3990 2023-10-06T23:20:54.114 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.108+0000 7f6603e08b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c743f2810 con 0x555c743e1ec0 2023-10-06T23:20:54.114 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.108+0000 7f6603e08b80 10 client.0 _ll_register_callbacks cb 0x7f65e0095c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:20:54.114 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ed99a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e2fd0 0x555c743f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ed99a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e2fd0 0x555c743f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45154/0 (socket says 172.21.15.8:45154) 2023-10-06T23:20:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ed99a700 1 -- 172.21.15.8:0/968961133 learned_addr learned my addr 172.21.15.8:0/968961133 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:20:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ee99c700 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ee19b700 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e1ec0 0x555c743f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ee99c700 1 -- 172.21.15.8:0/968961133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e1ec0 msgr2=0x555c743f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ee99c700 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e1ec0 0x555c743f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ee99c700 1 -- 172.21.15.8:0/968961133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e2fd0 msgr2=0x555c743f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:20:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ee99c700 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e2fd0 0x555c743f0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.109+0000 7f65ee99c700 1 -- 172.21.15.8:0/968961133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c7415fd80 con 0x555c743e3990 2023-10-06T23:20:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.110+0000 7f65ee99c700 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f1fa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ca380 tx=0x7f65e0099210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a176b2a2e9bb7d48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:20:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.110+0000 7f65d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:20:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.110+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968961133 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000dc60 con 0x555c743e3990 2023-10-06T23:20:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.110+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968961133 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f65e009d980 con 0x555c743e3990 2023-10-06T23:20:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.110+0000 7f6603e08b80 1 -- 172.21.15.8:0/968961133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65e4004380 con 0x555c743e3990 2023-10-06T23:20:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968961133 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65e0098d20 con 0x555c743e3990 2023-10-06T23:20:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f6603e08b80 10 client.26171 fetch_fsmap learned FSMap version 37 2023-10-06T23:20:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f6603e08b80 1 -- 172.21.15.8:0/968961133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x555c74148c00 con 0x555c743e3990 2023-10-06T23:20:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968961133 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65e4004380 con 0x555c743e3990 2023-10-06T23:20:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968961133 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f65e0004f00 con 0x555c743e3990 2023-10-06T23:20:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f6603e08b80 10 client.26171 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:20:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f6603e08b80 10 client.26171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:20:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f6603e08b80 20 client.26171 populate_metadata read hostname 'smithi008' 2023-10-06T23:20:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555c7444bcb0 0x555c7444e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:20:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f6603e08b80 4 client.26171 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:20:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.111+0000 7f6603e08b80 1 -- 172.21.15.8:0/968961133 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555c7432dad0 con 0x555c7444bcb0 2023-10-06T23:20:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.112+0000 7f65ee19b700 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555c7444bcb0 0x555c7444e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:20:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.113+0000 7f65ee19b700 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555c7444bcb0 0x555c7444e0a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450d58404a058fed server_cookie=51cac38166a9226e in_seq=0 out_seq=0 2023-10-06T23:20:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.113+0000 7f65d1ffb700 10 client.26171 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.126+0000 7f65d1ffb700 1 -- 172.21.15.8:0/968961133 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555c7432dad0 con 0x555c7444bcb0 2023-10-06T23:20:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.126+0000 7f65d1ffb700 10 client.26171 handle_command_reply: tid=0 2023-10-06T23:20:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.126+0000 7f6603e08b80 1 client.26171 shutdown 2023-10-06T23:20:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 -- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 msgr2=0x555c743f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f1fa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ca380 tx=0x7f65e0099210 comp rx=0 tx=0).stop 2023-10-06T23:20:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 -- 172.21.15.8:0/968961133 shutdown_connections 2023-10-06T23:20:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555c7444bcb0 0x555c7444e0a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c743e3990 0x555c743f1fa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555c743e1ec0 0x555c743f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 --2- 172.21.15.8:0/968961133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c743e2fd0 0x555c743f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f65d1ffb700 0 client.26171 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:20:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 -- 172.21.15.8:0/968961133 >> 172.21.15.8:0/968961133 conn(0x555c74356200 msgr2=0x555c743e9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 -- 172.21.15.8:0/968961133 shutdown_connections 2023-10-06T23:20:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.127+0000 7f6603e08b80 1 -- 172.21.15.8:0/968961133 wait complete. 2023-10-06T23:20:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.128+0000 7f6603e08b80 20 client.26171 trim_cache size 0 max 16384 2023-10-06T23:20:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:20:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:20:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:20:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:20:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.128+0000 7f65f03ff700 1 -- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65d40a14d0 msgr2=0x7f65d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.128+0000 7f65f03ff700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65d40a14d0 0x7f65d40a3990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f65d800b2e0 tx=0x7f65d8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.128+0000 7f65f03ff700 1 -- 172.21.15.8:0/511115589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65e81090c0 msgr2=0x7f65e819e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:20:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.128+0000 7f65f03ff700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65e81090c0 0x7f65e819e5e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f65e0007ee0 tx=0x7f65e000d3b0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.129+0000 7f65f03ff700 1 -- 172.21.15.8:0/511115589 shutdown_connections 2023-10-06T23:20:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.129+0000 7f65f03ff700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f65d40a14d0 0x7f65d40a3990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.129+0000 7f65f03ff700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e8107530 0x7f65e819d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.129+0000 7f65f03ff700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65e81090c0 0x7f65e819e5e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.129+0000 7f65f03ff700 1 --2- 172.21.15.8:0/511115589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e8108720 0x7f65e819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:20:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.129+0000 7f65f03ff700 1 -- 172.21.15.8:0/511115589 >> 172.21.15.8:0/511115589 conn(0x7f65e80764b0 msgr2=0x7f65e8078780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:20:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.129+0000 7f65f03ff700 1 -- 172.21.15.8:0/511115589 shutdown_connections 2023-10-06T23:20:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:20:54.129+0000 7f65f03ff700 1 -- 172.21.15.8:0/511115589 wait complete. 2023-10-06T23:20:55.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:55 smithi190 ceph-mon[102658]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 7.6 MiB/s wr, 570 op/s 2023-10-06T23:20:55.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:55 smithi156 ceph-mon[102862]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 7.6 MiB/s wr, 570 op/s 2023-10-06T23:20:55.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:55 smithi008 ceph-mon[98532]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 7.6 MiB/s wr, 570 op/s 2023-10-06T23:20:57.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:57 smithi190 ceph-mon[102658]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 6.4 MiB/s wr, 514 op/s 2023-10-06T23:20:57.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:57 smithi156 ceph-mon[102862]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 6.4 MiB/s wr, 514 op/s 2023-10-06T23:20:57.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:57 smithi008 ceph-mon[98532]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 6.4 MiB/s wr, 514 op/s 2023-10-06T23:20:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 365.0 s, 250.2 tps, lat 447.544 ms stddev 198.590 2023-10-06T23:20:59.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:20:59 smithi190 ceph-mon[102658]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 5.4 MiB/s wr, 459 op/s 2023-10-06T23:20:59.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:20:59 smithi156 ceph-mon[102862]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 5.4 MiB/s wr, 459 op/s 2023-10-06T23:20:59.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:20:59 smithi008 ceph-mon[98532]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 5.4 MiB/s wr, 459 op/s 2023-10-06T23:21:01.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:01 smithi190 ceph-mon[102658]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 7.2 MiB/s wr, 574 op/s 2023-10-06T23:21:01.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:01 smithi156 ceph-mon[102862]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 7.2 MiB/s wr, 574 op/s 2023-10-06T23:21:01.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:01 smithi008 ceph-mon[98532]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 7.2 MiB/s wr, 574 op/s 2023-10-06T23:21:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:03 smithi190 ceph-mon[102658]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 6.4 MiB/s wr, 500 op/s 2023-10-06T23:21:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:03 smithi156 ceph-mon[102862]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 6.4 MiB/s wr, 500 op/s 2023-10-06T23:21:03.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:03 smithi008 ceph-mon[98532]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 6.4 MiB/s wr, 500 op/s 2023-10-06T23:21:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 370.0 s, 226.2 tps, lat 453.813 ms stddev 255.221 2023-10-06T23:21:05.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:05 smithi190 ceph-mon[102658]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 7.2 MiB/s wr, 596 op/s 2023-10-06T23:21:05.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:05 smithi156 ceph-mon[102862]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 7.2 MiB/s wr, 596 op/s 2023-10-06T23:21:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:05 smithi008 ceph-mon[98532]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 7.2 MiB/s wr, 596 op/s 2023-10-06T23:21:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 -- 172.21.15.8:0/3361102505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faebc100ae0 msgr2=0x7faebc100f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 --2- 172.21.15.8:0/3361102505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faebc100ae0 0x7faebc100f60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009fc0 tx=0x7faeb400b330 comp rx=0 tx=0).stop 2023-10-06T23:21:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 -- 172.21.15.8:0/3361102505 shutdown_connections 2023-10-06T23:21:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 --2- 172.21.15.8:0/3361102505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faebc100ae0 0x7faebc100f60 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 --2- 172.21.15.8:0/3361102505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc0ff7c0 0x7faebc0ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 --2- 172.21.15.8:0/3361102505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faebc100120 0x7faebc1005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 -- 172.21.15.8:0/3361102505 >> 172.21.15.8:0/3361102505 conn(0x7faebc0fb340 msgr2=0x7faebc0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 -- 172.21.15.8:0/3361102505 shutdown_connections 2023-10-06T23:21:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.334+0000 7faec41ff700 1 -- 172.21.15.8:0/3361102505 wait complete. 2023-10-06T23:21:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.336+0000 7faec41ff700 1 Processor -- start 2023-10-06T23:21:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.336+0000 7faec41ff700 1 -- start start 2023-10-06T23:21:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec41ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faebc0ff7c0 0x7faebc198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec41ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc100120 0x7faebc199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec41ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faebc100ae0 0x7faebc19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec41ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc19a920 con 0x7faebc0ff7c0 2023-10-06T23:21:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec41ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc19aa90 con 0x7faebc100120 2023-10-06T23:21:07.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec41ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc19ac50 con 0x7faebc100ae0 2023-10-06T23:21:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec179a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc100120 0x7faebc199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec1f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faebc0ff7c0 0x7faebc198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec179a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc100120 0x7faebc199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49040/0 (socket says 172.21.15.8:49040) 2023-10-06T23:21:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec179a700 1 -- 172.21.15.8:0/1835593510 learned_addr learned my addr 172.21.15.8:0/1835593510 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.337+0000 7faec279c700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faebc100ae0 0x7faebc19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faec179a700 1 -- 172.21.15.8:0/1835593510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faebc100ae0 msgr2=0x7faebc19a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faec179a700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faebc100ae0 0x7faebc19a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faec179a700 1 -- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faebc0ff7c0 msgr2=0x7faebc198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faec179a700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faebc0ff7c0 0x7faebc198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faec179a700 1 -- 172.21.15.8:0/1835593510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80095f0 con 0x7faebc100120 2023-10-06T23:21:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faec179a700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc100120 0x7faebc199440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e9a0 tx=0x7faeac00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faeb2ffd700 1 -- 172.21.15.8:0/1835593510 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac009790 con 0x7faebc100120 2023-10-06T23:21:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faec41ff700 1 -- 172.21.15.8:0/1835593510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb4009c40 con 0x7faebc100120 2023-10-06T23:21:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faec41ff700 1 -- 172.21.15.8:0/1835593510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc19b120 con 0x7faebc100120 2023-10-06T23:21:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.338+0000 7faeb2ffd700 1 -- 172.21.15.8:0/1835593510 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeac010430 con 0x7faebc100120 2023-10-06T23:21:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.339+0000 7faeb2ffd700 1 -- 172.21.15.8:0/1835593510 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00cea0 con 0x7faebc100120 2023-10-06T23:21:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.343+0000 7faeb2ffd700 1 -- 172.21.15.8:0/1835593510 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7faeac00ca10 con 0x7faebc100120 2023-10-06T23:21:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.344+0000 7faed7b04b80 1 Processor -- start 2023-10-06T23:21:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.345+0000 7faed7b04b80 1 -- start start 2023-10-06T23:21:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.345+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff5daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.345+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff5ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.345+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff65a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.345+0000 7faed7b04b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4febd400 con 0x55ac4ff5f1a0 2023-10-06T23:21:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.345+0000 7faed7b04b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4feaebc0 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.345+0000 7faed7b04b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4feac4e0 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec279c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff5daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec1f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff5ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec279c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff5daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52116/0 (socket says 172.21.15.8:52116) 2023-10-06T23:21:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec1f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff5ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49044/0 (socket says 172.21.15.8:49044) 2023-10-06T23:21:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec279c700 1 -- 172.21.15.8:0/1887368096 learned_addr learned my addr 172.21.15.8:0/1887368096 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec179a700 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff65a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faeb2ffd700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faea80a1550 0x7faea80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec1f9b700 1 -- 172.21.15.8:0/1887368096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5d6d0 msgr2=0x55ac4ff5daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec1f9b700 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff5daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec1f9b700 1 -- 172.21.15.8:0/1887368096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 msgr2=0x55ac4ff65a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec1f9b700 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff65a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec1f9b700 1 -- 172.21.15.8:0/1887368096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac4fcd2d80 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faeb2ffd700 1 -- 172.21.15.8:0/1835593510 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faeac014070 con 0x7faebc100120 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec279c700 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff5daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.346+0000 7faec279c700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faea80a1550 0x7faea80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.347+0000 7faec1f9b700 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff5ec60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009f20 tx=0x7faeb8011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cac31ee9753bcc78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.347+0000 7faea7fff700 1 -- 172.21.15.8:0/1887368096 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb80042f0 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.347+0000 7faea7fff700 1 -- 172.21.15.8:0/1887368096 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeb8004450 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.347+0000 7faea7fff700 1 -- 172.21.15.8:0/1887368096 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb80198a0 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faec279c700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faea80a1550 0x7faea80a3a10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55ac4ff5d470 tx=0x7faeb4009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 -- 172.21.15.8:0/1887368096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5e7e0 msgr2=0x55ac4ff5ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff5ec60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009f20 tx=0x7faeb8011720 comp rx=0 tx=0).stop 2023-10-06T23:21:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 -- 172.21.15.8:0/1887368096 shutdown_connections 2023-10-06T23:21:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff65a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff5daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 --2- 172.21.15.8:0/1887368096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff5ec60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 -- 172.21.15.8:0/1887368096 >> 172.21.15.8:0/1887368096 conn(0x55ac4fec9200 msgr2=0x55ac4ff4fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 -- 172.21.15.8:0/1887368096 shutdown_connections 2023-10-06T23:21:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.348+0000 7faed7b04b80 1 -- 172.21.15.8:0/1887368096 wait complete. 2023-10-06T23:21:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.349+0000 7faed7b04b80 1 -- start start 2023-10-06T23:21:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.349+0000 7faed7b04b80 1 Processor -- start 2023-10-06T23:21:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff67820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff6e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faed7b04b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4fea7dd0 con 0x55ac4ff5f1a0 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faed7b04b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4fe446b0 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faed7b04b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4fe44350 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faed7b04b80 10 client.0 _ll_register_callbacks cb 0x55ac4fca17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faec179a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff67820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faec279c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff6e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faec179a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff67820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52128/0 (socket says 172.21.15.8:52128) 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faec179a700 1 -- 172.21.15.8:0/3651220188 learned_addr learned my addr 172.21.15.8:0/3651220188 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.350+0000 7faec1f9b700 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faec179a700 1 -- 172.21.15.8:0/3651220188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 msgr2=0x55ac4ff672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faec179a700 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faec179a700 1 -- 172.21.15.8:0/3651220188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 msgr2=0x55ac4ff6e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faec179a700 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff6e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faec179a700 1 -- 172.21.15.8:0/3651220188 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc10be60 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faec179a700 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff67820 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faeac096ac0 tx=0x7faeac09a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=242cdc8ee9d55518 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faea57fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faea57fa700 1 -- 172.21.15.8:0/3651220188 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a2150 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faea57fa700 1 -- 172.21.15.8:0/3651220188 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faeac00ccc0 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.351+0000 7faed7b04b80 1 -- 172.21.15.8:0/3651220188 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac4ff47d50 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.352+0000 7faea57fa700 1 -- 172.21.15.8:0/3651220188 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeac09a050 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.352+0000 7faed7b04b80 10 client.26206 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.352+0000 7faed7b04b80 1 -- 172.21.15.8:0/3651220188 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7faeb8009b80 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.352+0000 7faea57fa700 1 -- 172.21.15.8:0/3651220188 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeac0b1080 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.352+0000 7faea57fa700 1 -- 172.21.15.8:0/3651220188 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faeac098fb0 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.352+0000 7faed7b04b80 10 client.26206 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.352+0000 7faed7b04b80 10 client.26206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.353+0000 7faed7b04b80 20 client.26206 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.353+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ac4ff731b0 0x55ac4ff755d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.353+0000 7faed7b04b80 4 client.26206 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:21:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.353+0000 7faed7b04b80 1 -- 172.21.15.8:0/3651220188 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac4fea0db0 con 0x55ac4ff731b0 2023-10-06T23:21:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.353+0000 7faec1f9b700 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ac4ff731b0 0x55ac4ff755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.354+0000 7faec1f9b700 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ac4ff731b0 0x55ac4ff755d0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dad7cd4db0774aa server_cookie=a10a056c2dae8798 in_seq=0 out_seq=0 2023-10-06T23:21:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.354+0000 7faea57fa700 10 client.26206 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.354+0000 7faea57fa700 1 -- 172.21.15.8:0/3651220188 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ac4fea0db0 con 0x55ac4ff731b0 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.354+0000 7faea57fa700 10 client.26206 handle_command_reply: tid=0 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.354+0000 7faed7b04b80 1 client.26206 shutdown 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 -- 172.21.15.8:0/3651220188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 msgr2=0x55ac4ff67820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff67820 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faeac096ac0 tx=0x7faeac09a590 comp rx=0 tx=0).stop 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 -- 172.21.15.8:0/3651220188 shutdown_connections 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ac4ff731b0 0x55ac4ff755d0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff6e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faea57fa700 0 client.26206 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3651220188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff67820 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 -- 172.21.15.8:0/3651220188 >> 172.21.15.8:0/3651220188 conn(0x55ac4fec9200 msgr2=0x55ac4ff4f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 -- 172.21.15.8:0/3651220188 shutdown_connections 2023-10-06T23:21:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 1 -- 172.21.15.8:0/3651220188 wait complete. 2023-10-06T23:21:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.355+0000 7faed7b04b80 20 client.26206 trim_cache size 0 max 16384 2023-10-06T23:21:07.376 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.374+0000 7faed7b04b80 1 Processor -- start 2023-10-06T23:21:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.374+0000 7faed7b04b80 1 -- start start 2023-10-06T23:21:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff50950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faed7b04b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4fd288c0 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faed7b04b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4fea0db0 con 0x55ac4ff5f1a0 2023-10-06T23:21:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faed7b04b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4ff684d0 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faec179a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faec179a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52140/0 (socket says 172.21.15.8:52140) 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faec179a700 1 -- 172.21.15.8:0/1151756692 learned_addr learned my addr 172.21.15.8:0/1151756692 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faec279c700 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.375+0000 7faec1f9b700 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff50950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.376+0000 7faec179a700 1 -- 172.21.15.8:0/1151756692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5f1a0 msgr2=0x55ac4ff660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.376+0000 7faec179a700 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.376+0000 7faec179a700 1 -- 172.21.15.8:0/1151756692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5d6d0 msgr2=0x55ac4ff50950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.376+0000 7faec179a700 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff50950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.376+0000 7faec179a700 1 -- 172.21.15.8:0/1151756692 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac4fcbbc00 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.376+0000 7faec179a700 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6e820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faeac0d0360 tx=0x7faeac00e910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c274347bac8aff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:07.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.377+0000 7faeb0ff9700 1 -- 172.21.15.8:0/1151756692 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac09eee0 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.377+0000 7faeb0ff9700 1 -- 172.21.15.8:0/1151756692 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ac4ff47d50 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.377+0000 7faeb0ff9700 1 -- 172.21.15.8:0/1151756692 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a23e0 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 -- 172.21.15.8:0/1151756692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 msgr2=0x55ac4ff6e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6e820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faeac0d0360 tx=0x7faeac00e910 comp rx=0 tx=0).stop 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 -- 172.21.15.8:0/1151756692 shutdown_connections 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff50950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 --2- 172.21.15.8:0/1151756692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6e820 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 -- 172.21.15.8:0/1151756692 >> 172.21.15.8:0/1151756692 conn(0x55ac4fec9200 msgr2=0x55ac4ff4fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 -- 172.21.15.8:0/1151756692 shutdown_connections 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.378+0000 7faed7b04b80 1 -- 172.21.15.8:0/1151756692 wait complete. 2023-10-06T23:21:07.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.379+0000 7faed7b04b80 1 -- start start 2023-10-06T23:21:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.379+0000 7faed7b04b80 1 Processor -- start 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.379+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff6c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faed7b04b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff6d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faed7b04b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4ff6dcf0 con 0x55ac4ff5f1a0 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faed7b04b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4ff6de60 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faed7b04b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac4ff6e020 con 0x55ac4ff5e7e0 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faed7b04b80 10 client.0 _ll_register_callbacks cb 0x7faeac0d02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec279c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff6d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec1f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff6c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec1f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff6c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49074/0 (socket says 172.21.15.8:49074) 2023-10-06T23:21:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec1f9b700 1 -- 172.21.15.8:0/3421672302 learned_addr learned my addr 172.21.15.8:0/3421672302 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:07.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec179a700 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec1f9b700 1 -- 172.21.15.8:0/3421672302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 msgr2=0x55ac4ff6c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:07.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec1f9b700 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec1f9b700 1 -- 172.21.15.8:0/3421672302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 msgr2=0x55ac4ff6d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:07.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec1f9b700 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff6d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.380+0000 7faec1f9b700 1 -- 172.21.15.8:0/3421672302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8009b80 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.381+0000 7faec1f9b700 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff6c260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faeb8011a70 tx=0x7faeb8005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e0077a2096e690 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:07.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.381+0000 7faea57fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:21:07.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.381+0000 7faea57fa700 1 -- 172.21.15.8:0/3421672302 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb802c070 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.381+0000 7faed7b04b80 1 -- 172.21.15.8:0/3421672302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faeb8004450 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.381+0000 7faea57fa700 1 -- 172.21.15.8:0/3421672302 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faeb80040f0 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faea57fa700 1 -- 172.21.15.8:0/3421672302 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeb8005bc0 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faed7b04b80 10 client.26189 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faed7b04b80 1 -- 172.21.15.8:0/3421672302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ac4fcf91f0 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faea57fa700 1 -- 172.21.15.8:0/3421672302 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeb8004450 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faea57fa700 1 -- 172.21.15.8:0/3421672302 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faeb80045c0 con 0x55ac4ff5d6d0 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faed7b04b80 10 client.26189 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faed7b04b80 10 client.26189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faed7b04b80 20 client.26189 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ac4ffc7bb0 0x55ac4ffc9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:07.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faed7b04b80 4 client.26189 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:21:07.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.382+0000 7faed7b04b80 1 -- 172.21.15.8:0/3421672302 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ac4fea0ad0 con 0x55ac4ffc7bb0 2023-10-06T23:21:07.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.383+0000 7faec179a700 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ac4ffc7bb0 0x55ac4ffc9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:07.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.383+0000 7faec179a700 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ac4ffc7bb0 0x55ac4ffc9fd0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de31bdefaeae46c server_cookie=19e475ce64531567 in_seq=0 out_seq=0 2023-10-06T23:21:07.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.383+0000 7faea57fa700 10 client.26189 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.397+0000 7faea57fa700 1 -- 172.21.15.8:0/3421672302 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ac4fea0ad0 con 0x55ac4ffc7bb0 2023-10-06T23:21:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.397+0000 7faea57fa700 10 client.26189 handle_command_reply: tid=0 2023-10-06T23:21:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.397+0000 7faed7b04b80 1 client.26189 shutdown 2023-10-06T23:21:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 -- 172.21.15.8:0/3421672302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 msgr2=0x55ac4ff6c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff6c260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faeb8011a70 tx=0x7faeb8005e80 comp rx=0 tx=0).stop 2023-10-06T23:21:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 -- 172.21.15.8:0/3421672302 shutdown_connections 2023-10-06T23:21:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ac4ffc7bb0 0x55ac4ffc9fd0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ac4ff5f1a0 0x55ac4ff6d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac4ff5d6d0 0x55ac4ff6c260 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 --2- 172.21.15.8:0/3421672302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ac4ff5e7e0 0x55ac4ff6c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 -- 172.21.15.8:0/3421672302 >> 172.21.15.8:0/3421672302 conn(0x55ac4fec9200 msgr2=0x55ac4ff660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faea57fa700 0 client.26189 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 -- 172.21.15.8:0/3421672302 shutdown_connections 2023-10-06T23:21:07.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 1 -- 172.21.15.8:0/3421672302 wait complete. 2023-10-06T23:21:07.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.398+0000 7faed7b04b80 20 client.26189 trim_cache size 0 max 16384 2023-10-06T23:21:07.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:21:07.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:21:07.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:21:07.402 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:21:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 -- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faea80a1550 msgr2=0x7faea80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faea80a1550 0x7faea80a3a10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55ac4ff5d470 tx=0x7faeb4009920 comp rx=0 tx=0).stop 2023-10-06T23:21:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 -- 172.21.15.8:0/1835593510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc100120 msgr2=0x7faebc199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc100120 0x7faebc199440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e9a0 tx=0x7faeac00ecb0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 -- 172.21.15.8:0/1835593510 shutdown_connections 2023-10-06T23:21:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7faea80a1550 0x7faea80a3a10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faebc0ff7c0 0x7faebc198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faebc100ae0 0x7faebc19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.399+0000 7faec41ff700 1 --2- 172.21.15.8:0/1835593510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc100120 0x7faebc199440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.400+0000 7faec41ff700 1 -- 172.21.15.8:0/1835593510 >> 172.21.15.8:0/1835593510 conn(0x7faebc0fb340 msgr2=0x7faebc0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.400+0000 7faec41ff700 1 -- 172.21.15.8:0/1835593510 shutdown_connections 2023-10-06T23:21:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:07.400+0000 7faec41ff700 1 -- 172.21.15.8:0/1835593510 wait complete. 2023-10-06T23:21:07.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:07 smithi190 ceph-mon[102658]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 6.7 MiB/s wr, 539 op/s 2023-10-06T23:21:07.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:07 smithi156 ceph-mon[102862]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 6.7 MiB/s wr, 539 op/s 2023-10-06T23:21:07.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:07 smithi008 ceph-mon[98532]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 6.7 MiB/s wr, 539 op/s 2023-10-06T23:21:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 375.0 s, 282.6 tps, lat 351.129 ms stddev 46.051 2023-10-06T23:21:09.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:09 smithi190 ceph-mon[102658]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.5 MiB/s wr, 501 op/s 2023-10-06T23:21:09.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:09 smithi156 ceph-mon[102862]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.5 MiB/s wr, 501 op/s 2023-10-06T23:21:09.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:09 smithi008 ceph-mon[98532]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 6.5 MiB/s wr, 501 op/s 2023-10-06T23:21:11.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:11 smithi190 ceph-mon[102658]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 7.2 MiB/s wr, 555 op/s 2023-10-06T23:21:11.600 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:11 smithi156 ceph-mon[102862]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 7.2 MiB/s wr, 555 op/s 2023-10-06T23:21:11.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:11 smithi008 ceph-mon[98532]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 7.2 MiB/s wr, 555 op/s 2023-10-06T23:21:13.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:13 smithi190 ceph-mon[102658]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 5.3 MiB/s wr, 437 op/s 2023-10-06T23:21:13.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:13 smithi156 ceph-mon[102862]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 5.3 MiB/s wr, 437 op/s 2023-10-06T23:21:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:13 smithi008 ceph-mon[98532]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 5.3 MiB/s wr, 437 op/s 2023-10-06T23:21:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 380.0 s, 202.8 tps, lat 427.429 ms stddev 123.125 2023-10-06T23:21:15.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:15 smithi190 ceph-mon[102658]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 6.7 MiB/s wr, 550 op/s 2023-10-06T23:21:15.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:15 smithi156 ceph-mon[102862]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 6.7 MiB/s wr, 550 op/s 2023-10-06T23:21:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:15 smithi008 ceph-mon[98532]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 6.7 MiB/s wr, 550 op/s 2023-10-06T23:21:17.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:17 smithi190 ceph-mon[102658]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 7.8 MiB/s wr, 573 op/s 2023-10-06T23:21:17.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:17 smithi156 ceph-mon[102862]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 7.8 MiB/s wr, 573 op/s 2023-10-06T23:21:17.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:17 smithi008 ceph-mon[98532]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 7.8 MiB/s wr, 573 op/s 2023-10-06T23:21:17.867 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:21:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.161+0000 7fd0c27ff700 1 -- 172.21.15.8:0/2899042810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 msgr2=0x7fd0bc100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.161+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/2899042810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 0x7fd0bc100510 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009990 tx=0x7fd0a4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.162+0000 7fd0c27ff700 1 -- 172.21.15.8:0/2899042810 shutdown_connections 2023-10-06T23:21:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.162+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/2899042810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0bc0ff730 0x7fd0bc0ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.162+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/2899042810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0bc100a50 0x7fd0bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.162+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/2899042810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 0x7fd0bc100510 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.162+0000 7fd0c27ff700 1 -- 172.21.15.8:0/2899042810 >> 172.21.15.8:0/2899042810 conn(0x7fd0bc0fb330 msgr2=0x7fd0bc0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.162+0000 7fd0c27ff700 1 -- 172.21.15.8:0/2899042810 shutdown_connections 2023-10-06T23:21:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.162+0000 7fd0c27ff700 1 -- 172.21.15.8:0/2899042810 wait complete. 2023-10-06T23:21:18.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.163+0000 7fd0c27ff700 1 Processor -- start 2023-10-06T23:21:18.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.164+0000 7fd0c27ff700 1 -- start start 2023-10-06T23:21:18.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.164+0000 7fd0c27ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0bc0ff730 0x7fd0bc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.164+0000 7fd0c27ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 0x7fd0bc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.164+0000 7fd0c27ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0bc100a50 0x7fd0bc1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.164+0000 7fd0c27ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc1a08d0 con 0x7fd0bc100a50 2023-10-06T23:21:18.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.164+0000 7fd0c27ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc1a0a10 con 0x7fd0bc100090 2023-10-06T23:21:18.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.164+0000 7fd0c27ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc1a0ba0 con 0x7fd0bc0ff730 2023-10-06T23:21:18.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 0x7fd0bc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 0x7fd0bc199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36906/0 (socket says 172.21.15.8:36906) 2023-10-06T23:21:18.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bb7fe700 1 -- 172.21.15.8:0/516316347 learned_addr learned my addr 172.21.15.8:0/516316347 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:18.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0bc0ff730 0x7fd0bc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0c0d9c700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0bc100a50 0x7fd0bc1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bb7fe700 1 -- 172.21.15.8:0/516316347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0bc0ff730 msgr2=0x7fd0bc198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0bc0ff730 0x7fd0bc198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bb7fe700 1 -- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0bc100a50 msgr2=0x7fd0bc1a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0bc100a50 0x7fd0bc1a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.165+0000 7fd0bb7fe700 1 -- 172.21.15.8:0/516316347 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40095f0 con 0x7fd0bc100090 2023-10-06T23:21:18.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.166+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 0x7fd0bc199290 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4000c00 tx=0x7fd0a4003b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:18.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.166+0000 7fd0b97fa700 1 -- 172.21.15.8:0/516316347 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a401d070 con 0x7fd0bc100090 2023-10-06T23:21:18.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.166+0000 7fd0b97fa700 1 -- 172.21.15.8:0/516316347 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0a400bd70 con 0x7fd0bc100090 2023-10-06T23:21:18.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.166+0000 7fd0b97fa700 1 -- 172.21.15.8:0/516316347 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4022cf0 con 0x7fd0bc100090 2023-10-06T23:21:18.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.166+0000 7fd0c27ff700 1 -- 172.21.15.8:0/516316347 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc1a0e20 con 0x7fd0bc100090 2023-10-06T23:21:18.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.166+0000 7fd0c27ff700 1 -- 172.21.15.8:0/516316347 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc1a1190 con 0x7fd0bc100090 2023-10-06T23:21:18.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.170+0000 7fd0b97fa700 1 -- 172.21.15.8:0/516316347 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd0a4022470 con 0x7fd0bc100090 2023-10-06T23:21:18.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.172+0000 7fd0d61e2b80 1 Processor -- start 2023-10-06T23:21:18.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.172+0000 7fd0d61e2b80 1 -- start start 2023-10-06T23:21:18.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.172+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424e0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.172+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424e1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.172+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.172+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564542448460 con 0x5645424e1a60 2023-10-06T23:21:18.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.172+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564542439c20 con 0x5645424e0bc0 2023-10-06T23:21:18.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.172+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564542437540 con 0x5645424e0260 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0c0d9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424e1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0c0d9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424e0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59736/0 (socket says 172.21.15.8:59736) 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424e1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36908/0 (socket says 172.21.15.8:36908) 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0c0d9c700 1 -- 172.21.15.8:0/2960015985 learned_addr learned my addr 172.21.15.8:0/2960015985 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0b97fa700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0a80a1500 0x7fd0a80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0b97fa700 1 -- 172.21.15.8:0/516316347 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0a40ce330 con 0x7fd0bc100090 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0c0d9c700 1 -- 172.21.15.8:0/2960015985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 msgr2=0x5645424e1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0c0d9c700 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424e1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0c0d9c700 1 -- 172.21.15.8:0/2960015985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 msgr2=0x5645424e1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0c0d9c700 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424e1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0c0d9c700 1 -- 172.21.15.8:0/2960015985 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56454225dde0 con 0x5645424e0260 2023-10-06T23:21:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:21:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.173+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:21:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.174+0000 7fd0c0d9c700 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424e0680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00cd80 tx=0x7fd0ac00e630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155eccf23047ad2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:18.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.174+0000 7fd0c0d9c700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0a80a1500 0x7fd0a80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.174+0000 7fd0b27fc700 1 -- 172.21.15.8:0/2960015985 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac01c660 con 0x5645424e0260 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.174+0000 7fd0b27fc700 1 -- 172.21.15.8:0/2960015985 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0ac01cc50 con 0x5645424e0260 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.174+0000 7fd0b27fc700 1 -- 172.21.15.8:0/2960015985 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac012c80 con 0x5645424e0260 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/2960015985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 msgr2=0x5645424e0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0c0d9c700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0a80a1500 0x7fd0a80a39c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac012fd0 tx=0x7fd0ac012ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424e0680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00cd80 tx=0x7fd0ac00e630 comp rx=0 tx=0).stop 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/2960015985 shutdown_connections 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424e0680 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/2960015985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/2960015985 >> 172.21.15.8:0/2960015985 conn(0x564542454260 msgr2=0x5645424db140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/2960015985 shutdown_connections 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.175+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/2960015985 wait complete. 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.176+0000 7fd0d61e2b80 1 -- start start 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.176+0000 7fd0d61e2b80 1 Processor -- start 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424ea050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 0x5645424ea590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 0x5645424f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564542432e30 con 0x5645424e0bc0 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645423cf710 con 0x5645424e0260 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645423cf3b0 con 0x5645424e1a60 2023-10-06T23:21:18.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0d61e2b80 10 client.0 _ll_register_callbacks cb 0x56454222c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424ea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424ea050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36924/0 (socket says 172.21.15.8:36924) 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0bbfff700 1 -- 172.21.15.8:0/1105399408 learned_addr learned my addr 172.21.15.8:0/1105399408 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 0x5645424ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.177+0000 7fd0c0d9c700 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 0x5645424f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd0bbfff700 1 -- 172.21.15.8:0/1105399408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 msgr2=0x5645424f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 0x5645424f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd0bbfff700 1 -- 172.21.15.8:0/1105399408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 msgr2=0x5645424ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 0x5645424ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd0bbfff700 1 -- 172.21.15.8:0/1105399408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac00c880 con 0x5645424e0260 2023-10-06T23:21:18.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424ea050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009630 tx=0x7fd0b4007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1a391276c919d43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd09b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd09b7fe700 1 -- 172.21.15.8:0/1105399408 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4011990 con 0x5645424e0260 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd09b7fe700 1 -- 172.21.15.8:0/1105399408 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0b4011af0 con 0x5645424e0260 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.178+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/1105399408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645424d2f10 con 0x5645424e0260 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd09b7fe700 1 -- 172.21.15.8:0/1105399408 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0b4011cb0 con 0x5645424e0260 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd0d61e2b80 10 client.26201 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/1105399408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x564542246c60 con 0x5645424e0260 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd09b7fe700 1 -- 172.21.15.8:0/1105399408 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0b4025020 con 0x5645424e0260 2023-10-06T23:21:18.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd09b7fe700 1 -- 172.21.15.8:0/1105399408 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd0b4014070 con 0x5645424e0260 2023-10-06T23:21:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd0d61e2b80 10 client.26201 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd0d61e2b80 10 client.26201 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd0d61e2b80 20 client.26201 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5645424f5f00 0x5645424f8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd0d61e2b80 4 client.26201 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:21:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.179+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/1105399408 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56454242be10 con 0x5645424f5f00 2023-10-06T23:21:18.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.180+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5645424f5f00 0x5645424f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.180+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5645424f5f00 0x5645424f8320 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe8466ed530f488 server_cookie=5c587066f3169818 in_seq=0 out_seq=0 2023-10-06T23:21:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.180+0000 7fd09b7fe700 10 client.26201 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.181+0000 7fd09b7fe700 1 -- 172.21.15.8:0/1105399408 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56454242be10 con 0x5645424f5f00 2023-10-06T23:21:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.181+0000 7fd09b7fe700 10 client.26201 handle_command_reply: tid=0 2023-10-06T23:21:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.181+0000 7fd0d61e2b80 1 client.26201 shutdown 2023-10-06T23:21:18.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/1105399408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 msgr2=0x5645424ea050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424ea050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009630 tx=0x7fd0b4007ec0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/1105399408 shutdown_connections 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5645424f5f00 0x5645424f8320 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 0x5645424f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424ea050 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/1105399408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 0x5645424ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/1105399408 >> 172.21.15.8:0/1105399408 conn(0x564542454260 msgr2=0x5645424daf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd09b7fe700 0 client.26201 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/1105399408 shutdown_connections 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/1105399408 wait complete. 2023-10-06T23:21:18.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.182+0000 7fd0d61e2b80 20 client.26201 trim_cache size 0 max 16384 2023-10-06T23:21:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.209+0000 7fd0d61e2b80 1 Processor -- start 2023-10-06T23:21:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.209+0000 7fd0d61e2b80 1 -- start start 2023-10-06T23:21:18.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.209+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.209+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 0x5645424f1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.209+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 0x5645424ea340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.209+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645422b3920 con 0x5645424e0bc0 2023-10-06T23:21:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.209+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645424e8b20 con 0x5645424e0260 2023-10-06T23:21:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.209+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645424dc270 con 0x5645424e1a60 2023-10-06T23:21:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.210+0000 7fd0c0d9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 0x5645424ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.210+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.210+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424e9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36934/0 (socket says 172.21.15.8:36934) 2023-10-06T23:21:18.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.210+0000 7fd0bbfff700 1 -- 172.21.15.8:0/601264871 learned_addr learned my addr 172.21.15.8:0/601264871 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:18.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.210+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/601264871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 0x5645424f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.211+0000 7fd0bbfff700 1 -- 172.21.15.8:0/601264871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 msgr2=0x5645424ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.211+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/601264871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 0x5645424ea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.211+0000 7fd0bbfff700 1 -- 172.21.15.8:0/601264871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 msgr2=0x5645424f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.211+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/601264871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 0x5645424f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.211+0000 7fd0bbfff700 1 -- 172.21.15.8:0/601264871 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564542284250 con 0x5645424e0260 2023-10-06T23:21:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.211+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/601264871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424e9e00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4004600 tx=0x7fd0b4005b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fce774938ba2e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.212+0000 7fd0b2ffd700 1 -- 172.21.15.8:0/601264871 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4009940 con 0x5645424e0260 2023-10-06T23:21:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.212+0000 7fd0b2ffd700 1 -- 172.21.15.8:0/601264871 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0b4025030 con 0x5645424e0260 2023-10-06T23:21:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.212+0000 7fd0b2ffd700 1 -- 172.21.15.8:0/601264871 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4016d00 con 0x5645424e0260 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.212+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/601264871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 msgr2=0x5645424e9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.212+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/601264871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424e9e00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4004600 tx=0x7fd0b4005b20 comp rx=0 tx=0).stop 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.213+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/601264871 shutdown_connections 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.213+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/601264871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e1a60 0x5645424ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.213+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/601264871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0260 0x5645424e9e00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.213+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/601264871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e0bc0 0x5645424f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.213+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/601264871 >> 172.21.15.8:0/601264871 conn(0x564542454260 msgr2=0x5645424e4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.213+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/601264871 shutdown_connections 2023-10-06T23:21:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.213+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/601264871 wait complete. 2023-10-06T23:21:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.213+0000 7fd0d61e2b80 1 -- start start 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.214+0000 7fd0d61e2b80 1 Processor -- start 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.215+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424f1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.215+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424edca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.215+0000 7fd0d61e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424ee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.215+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645424ee720 con 0x5645424e1a60 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.215+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645424ee890 con 0x5645424e0bc0 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.215+0000 7fd0d61e2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564542549d40 con 0x5645424e0260 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.215+0000 7fd0d61e2b80 10 client.0 _ll_register_callbacks cb 0x7fd0b4009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.215+0000 7fd0bb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0c0d9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424ee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424edca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36948/0 (socket says 172.21.15.8:36948) 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bb7fe700 1 -- 172.21.15.8:0/3765915175 learned_addr learned my addr 172.21.15.8:0/3765915175 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bb7fe700 1 -- 172.21.15.8:0/3765915175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 msgr2=0x5645424f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bb7fe700 1 -- 172.21.15.8:0/3765915175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 msgr2=0x5645424ee1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424ee1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bb7fe700 1 -- 172.21.15.8:0/3765915175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564542246c60 con 0x5645424e0bc0 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.216+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.217+0000 7fd0bb7fe700 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424edca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4098100 tx=0x7fd0a400bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7458d7b618123c32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.217+0000 7fd09b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:21:18.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.217+0000 7fd09b7fe700 1 -- 172.21.15.8:0/3765915175 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4022720 con 0x5645424e0bc0 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.217+0000 7fd09b7fe700 1 -- 172.21.15.8:0/3765915175 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0a409bd90 con 0x5645424e0bc0 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.217+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/3765915175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0ac01cc50 con 0x5645424e0bc0 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.217+0000 7fd09b7fe700 1 -- 172.21.15.8:0/3765915175 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a409b690 con 0x5645424e0bc0 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.217+0000 7fd0d61e2b80 10 client.26207 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.217+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/3765915175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56454225c2b0 con 0x5645424e0bc0 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd09b7fe700 1 -- 172.21.15.8:0/3765915175 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0ac01cc50 con 0x5645424e0bc0 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd09b7fe700 1 -- 172.21.15.8:0/3765915175 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd0a409ab80 con 0x5645424e0bc0 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd0d61e2b80 10 client.26207 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd0d61e2b80 10 client.26207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd0d61e2b80 20 client.26207 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:18.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56454254b310 0x56454254d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd0d61e2b80 4 client.26207 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/3765915175 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56454242bb30 con 0x56454254b310 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.218+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56454254b310 0x56454254d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.219+0000 7fd0bbfff700 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56454254b310 0x56454254d730 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8113e0fa7be187db server_cookie=3353ac73276f6a30 in_seq=0 out_seq=0 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.219+0000 7fd09b7fe700 10 client.26207 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.219+0000 7fd09b7fe700 1 -- 172.21.15.8:0/3765915175 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56454242bb30 con 0x56454254b310 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.219+0000 7fd09b7fe700 10 client.26207 handle_command_reply: tid=0 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.219+0000 7fd0d61e2b80 1 client.26207 shutdown 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/3765915175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 msgr2=0x5645424edca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424edca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4098100 tx=0x7fd0a400bfd0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/3765915175 shutdown_connections 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56454254b310 0x56454254d730 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645424e1a60 0x5645424ee1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645424e0260 0x5645424f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 --2- 172.21.15.8:0/3765915175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645424e0bc0 0x5645424edca0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/3765915175 >> 172.21.15.8:0/3765915175 conn(0x564542454260 msgr2=0x5645424e9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd09b7fe700 0 client.26207 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/3765915175 shutdown_connections 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 1 -- 172.21.15.8:0/3765915175 wait complete. 2023-10-06T23:21:18.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.220+0000 7fd0d61e2b80 20 client.26207 trim_cache size 0 max 16384 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:21:18.226 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:21:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 -- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0a80a1500 msgr2=0x7fd0a80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0a80a1500 0x7fd0a80a39c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac012fd0 tx=0x7fd0ac012ec0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 -- 172.21.15.8:0/516316347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 msgr2=0x7fd0bc199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 0x7fd0bc199290 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4000c00 tx=0x7fd0a4003b00 comp rx=0 tx=0).stop 2023-10-06T23:21:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 -- 172.21.15.8:0/516316347 shutdown_connections 2023-10-06T23:21:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd0a80a1500 0x7fd0a80a39c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0bc100a50 0x7fd0bc1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0bc0ff730 0x7fd0bc198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 --2- 172.21.15.8:0/516316347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0bc100090 0x7fd0bc199290 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:18.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.221+0000 7fd0c27ff700 1 -- 172.21.15.8:0/516316347 >> 172.21.15.8:0/516316347 conn(0x7fd0bc0fb330 msgr2=0x7fd0bc0fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:18.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.222+0000 7fd0c27ff700 1 -- 172.21.15.8:0/516316347 shutdown_connections 2023-10-06T23:21:18.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:18.222+0000 7fd0c27ff700 1 -- 172.21.15.8:0/516316347 wait complete. 2023-10-06T23:21:18.250 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:21:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 385.0 s, 261.0 tps, lat 430.861 ms stddev 249.683 2023-10-06T23:21:19.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:19 smithi190 ceph-mon[102658]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 6.7 MiB/s wr, 510 op/s 2023-10-06T23:21:19.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:19 smithi156 ceph-mon[102862]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 6.7 MiB/s wr, 510 op/s 2023-10-06T23:21:19.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:19 smithi008 ceph-mon[98532]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 6.7 MiB/s wr, 510 op/s 2023-10-06T23:21:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 -- 172.21.15.8:0/1383307773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c90100fe0 msgr2=0x7f5c90101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1383307773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c90100fe0 0x7f5c90101440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009990 tx=0x7f5c80009ca0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 -- 172.21.15.8:0/1383307773 shutdown_connections 2023-10-06T23:21:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1383307773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c900ffdf0 0x7f5c90100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1383307773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c90101980 0x7f5c90108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1383307773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c90100fe0 0x7f5c90101440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 -- 172.21.15.8:0/1383307773 >> 172.21.15.8:0/1383307773 conn(0x7f5c900fb340 msgr2=0x7f5c900fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 -- 172.21.15.8:0/1383307773 shutdown_connections 2023-10-06T23:21:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.609+0000 7f5c975ff700 1 -- 172.21.15.8:0/1383307773 wait complete. 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.610+0000 7f5c975ff700 1 Processor -- start 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.611+0000 7f5c975ff700 1 -- start start 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.611+0000 7f5c975ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c900ffdf0 0x7f5c90198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.611+0000 7f5c975ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c90100fe0 0x7f5c901993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.611+0000 7f5c975ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c90101980 0x7f5c9019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.611+0000 7f5c975ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9019a8d0 con 0x7f5c900ffdf0 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.611+0000 7f5c975ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9019aa40 con 0x7f5c90101980 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.611+0000 7f5c975ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9019ac00 con 0x7f5c90100fe0 2023-10-06T23:21:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.611+0000 7f5c95b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c90101980 0x7f5c9019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c94b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c90100fe0 0x7f5c901993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c95b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c90101980 0x7f5c9019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33318/0 (socket says 172.21.15.8:33318) 2023-10-06T23:21:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c95b9c700 1 -- 172.21.15.8:0/1577396049 learned_addr learned my addr 172.21.15.8:0/1577396049 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c900ffdf0 0x7f5c90198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c95b9c700 1 -- 172.21.15.8:0/1577396049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c90100fe0 msgr2=0x7f5c901993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c95b9c700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c90100fe0 0x7f5c901993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c95b9c700 1 -- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c900ffdf0 msgr2=0x7f5c90198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c95b9c700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c900ffdf0 0x7f5c90198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c95b9c700 1 -- 172.21.15.8:0/1577396049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800095f0 con 0x7f5c90101980 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.612+0000 7f5c95b9c700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c90101980 0x7f5c9019a270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800ef30 tx=0x7f5c8800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.613+0000 7f5c867fc700 1 -- 172.21.15.8:0/1577396049 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88018070 con 0x7f5c90101980 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.613+0000 7f5c867fc700 1 -- 172.21.15.8:0/1577396049 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c8800f040 con 0x7f5c90101980 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.613+0000 7f5c975ff700 1 -- 172.21.15.8:0/1577396049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9019ae80 con 0x7f5c90101980 2023-10-06T23:21:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.613+0000 7f5c867fc700 1 -- 172.21.15.8:0/1577396049 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800cbc0 con 0x7f5c90101980 2023-10-06T23:21:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.613+0000 7f5c975ff700 1 -- 172.21.15.8:0/1577396049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c901a16a0 con 0x7f5c90101980 2023-10-06T23:21:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.618+0000 7f5c867fc700 1 -- 172.21.15.8:0/1577396049 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5c88007500 con 0x7f5c90101980 2023-10-06T23:21:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.619+0000 7f5caae8db80 1 Processor -- start 2023-10-06T23:21:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.619+0000 7f5caae8db80 1 -- start start 2023-10-06T23:21:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e112e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e11fd0 0x564740e12450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 0x564740e19220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5caae8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740d79400 con 0x564740e12990 2023-10-06T23:21:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5caae8db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740d6abc0 con 0x564740e11fd0 2023-10-06T23:21:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5caae8db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740d684e0 con 0x564740e10ec0 2023-10-06T23:21:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5c94b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5c9539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e11fd0 0x564740e12450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5c94b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e112e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59478/0 (socket says 172.21.15.8:59478) 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.620+0000 7f5c94b9a700 1 -- 172.21.15.8:0/1439399270 learned_addr learned my addr 172.21.15.8:0/1439399270 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 0x564740e19220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c867fc700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c7c0a1480 0x7f5c7c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c867fc700 1 -- 172.21.15.8:0/1577396049 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c880cc750 con 0x7f5c90101980 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c9539b700 1 -- 172.21.15.8:0/1439399270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 msgr2=0x564740e112e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e112e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c9539b700 1 -- 172.21.15.8:0/1439399270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 msgr2=0x564740e19220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 0x564740e19220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c9539b700 1 -- 172.21.15.8:0/1439399270 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564740b8ed80 con 0x564740e11fd0 2023-10-06T23:21:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:21:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e11fd0 0x564740e12450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009c80 tx=0x7f5c8c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43fef5fc9f949cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.621+0000 7f5c95b9c700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c7c0a1480 0x7f5c7c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.622+0000 7f5c7b7fe700 1 -- 172.21.15.8:0/1439399270 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c011cb0 con 0x564740e11fd0 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.622+0000 7f5c7b7fe700 1 -- 172.21.15.8:0/1439399270 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c8c011e10 con 0x564740e11fd0 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.622+0000 7f5c7b7fe700 1 -- 172.21.15.8:0/1439399270 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c005020 con 0x564740e11fd0 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 -- 172.21.15.8:0/1439399270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e11fd0 msgr2=0x564740e12450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e11fd0 0x564740e12450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009c80 tx=0x7f5c8c009f90 comp rx=0 tx=0).stop 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5c95b9c700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c7c0a1480 0x7f5c7c0a3940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5c880a18e0 tx=0x7f5c88009ed0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 -- 172.21.15.8:0/1439399270 shutdown_connections 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 0x564740e19220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1439399270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e11fd0 0x564740e12450 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 -- 172.21.15.8:0/1439399270 >> 172.21.15.8:0/1439399270 conn(0x564740d85200 msgr2=0x564740e0bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 -- 172.21.15.8:0/1439399270 shutdown_connections 2023-10-06T23:21:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.623+0000 7f5caae8db80 1 -- 172.21.15.8:0/1439399270 wait complete. 2023-10-06T23:21:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.624+0000 7f5caae8db80 1 -- start start 2023-10-06T23:21:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.625+0000 7f5caae8db80 1 Processor -- start 2023-10-06T23:21:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e1b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 0x564740e22110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5caae8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740d63dd0 con 0x564740e11fd0 2023-10-06T23:21:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5caae8db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740d006b0 con 0x564740e12990 2023-10-06T23:21:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5caae8db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740d00350 con 0x564740e10ec0 2023-10-06T23:21:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5caae8db80 10 client.0 _ll_register_callbacks cb 0x564740b5d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5c94b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5c9539b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e1b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5c94b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59482/0 (socket says 172.21.15.8:59482) 2023-10-06T23:21:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5c94b9a700 1 -- 172.21.15.8:0/1282415217 learned_addr learned my addr 172.21.15.8:0/1282415217 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.626+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 0x564740e22110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.627+0000 7f5c94b9a700 1 -- 172.21.15.8:0/1282415217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 msgr2=0x564740e22110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.627+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 0x564740e22110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.627+0000 7f5c94b9a700 1 -- 172.21.15.8:0/1282415217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 msgr2=0x564740e1b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.627+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e1b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.627+0000 7f5c94b9a700 1 -- 172.21.15.8:0/1282415217 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c80020040 con 0x564740e10ec0 2023-10-06T23:21:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.627+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1ab90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c800055d0 tx=0x7f5c80009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed7afe9115d58ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.627+0000 7f5c78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:21:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.628+0000 7f5c78ff9700 1 -- 172.21.15.8:0/1282415217 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000bcd0 con 0x564740e10ec0 2023-10-06T23:21:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.628+0000 7f5caae8db80 1 -- 172.21.15.8:0/1282415217 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564740e03d50 con 0x564740e10ec0 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.628+0000 7f5c78ff9700 1 -- 172.21.15.8:0/1282415217 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c8000be30 con 0x564740e10ec0 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.628+0000 7f5c78ff9700 1 -- 172.21.15.8:0/1282415217 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c80003680 con 0x564740e10ec0 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.628+0000 7f5caae8db80 10 client.26236 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.628+0000 7f5caae8db80 1 -- 172.21.15.8:0/1282415217 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f5c8c0098e0 con 0x564740e10ec0 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5c78ff9700 1 -- 172.21.15.8:0/1282415217 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564740e03d50 con 0x564740e10ec0 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5c78ff9700 1 -- 172.21.15.8:0/1282415217 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5c80034070 con 0x564740e10ec0 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5caae8db80 10 client.26236 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5caae8db80 10 client.26236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5caae8db80 20 client.26236 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564740e26990 0x564740e28db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5caae8db80 4 client.26236 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:21:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5caae8db80 1 -- 172.21.15.8:0/1282415217 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564740d5cdb0 con 0x564740e26990 2023-10-06T23:21:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.629+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564740e26990 0x564740e28db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.630+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564740e26990 0x564740e28db0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a58551ca9166fb02 server_cookie=8e50e21f0719977c in_seq=0 out_seq=0 2023-10-06T23:21:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.630+0000 7f5c78ff9700 10 client.26236 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5c78ff9700 1 -- 172.21.15.8:0/1282415217 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564740d5cdb0 con 0x564740e26990 2023-10-06T23:21:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5c78ff9700 10 client.26236 handle_command_reply: tid=0 2023-10-06T23:21:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 client.26236 shutdown 2023-10-06T23:21:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 -- 172.21.15.8:0/1282415217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 msgr2=0x564740e1ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1ab90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c800055d0 tx=0x7f5c80009ca0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 -- 172.21.15.8:0/1282415217 shutdown_connections 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564740e26990 0x564740e28db0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 0x564740e22110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1ab90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1282415217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e1b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5c78ff9700 0 client.26236 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.631+0000 7f5caae8db80 1 -- 172.21.15.8:0/1282415217 >> 172.21.15.8:0/1282415217 conn(0x564740d85200 msgr2=0x564740e0b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.632+0000 7f5caae8db80 1 -- 172.21.15.8:0/1282415217 shutdown_connections 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.632+0000 7f5caae8db80 1 -- 172.21.15.8:0/1282415217 wait complete. 2023-10-06T23:21:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.632+0000 7f5caae8db80 20 client.26236 trim_cache size 0 max 16384 2023-10-06T23:21:20.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.652+0000 7f5caae8db80 1 Processor -- start 2023-10-06T23:21:20.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.652+0000 7f5caae8db80 1 -- start start 2023-10-06T23:21:20.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.652+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e10ec0 0x564740e123b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.652+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e11fd0 0x564740e220d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.652+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 0x564740e0c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.652+0000 7f5caae8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740be48c0 con 0x564740e12990 2023-10-06T23:21:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.652+0000 7f5caae8db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740e0d2f0 con 0x564740e10ec0 2023-10-06T23:21:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.652+0000 7f5caae8db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740e18b10 con 0x564740e11fd0 2023-10-06T23:21:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e11fd0 0x564740e220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c94b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e10ec0 0x564740e123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e11fd0 0x564740e220d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59484/0 (socket says 172.21.15.8:59484) 2023-10-06T23:21:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 -- 172.21.15.8:0/1922037856 learned_addr learned my addr 172.21.15.8:0/1922037856 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c94b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e10ec0 0x564740e123b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33354/0 (socket says 172.21.15.8:33354) 2023-10-06T23:21:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/1922037856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 0x564740e0c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 -- 172.21.15.8:0/1922037856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e10ec0 msgr2=0x564740e123b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1922037856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e10ec0 0x564740e123b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 -- 172.21.15.8:0/1922037856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 msgr2=0x564740e0c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1922037856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 0x564740e0c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 -- 172.21.15.8:0/1922037856 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564740b77c00 con 0x564740e11fd0 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.653+0000 7f5c9539b700 1 --2- 172.21.15.8:0/1922037856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e11fd0 0x564740e220d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c000c00 tx=0x7f5c8c004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=673dadc767c30450 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.654+0000 7f5c7bfff700 1 -- 172.21.15.8:0/1922037856 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c011bf0 con 0x564740e11fd0 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.654+0000 7f5c7bfff700 1 -- 172.21.15.8:0/1922037856 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c8c003b10 con 0x564740e11fd0 2023-10-06T23:21:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.654+0000 7f5c7bfff700 1 -- 172.21.15.8:0/1922037856 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0046a0 con 0x564740e11fd0 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 -- 172.21.15.8:0/1922037856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e11fd0 msgr2=0x564740e220d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1922037856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e11fd0 0x564740e220d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c000c00 tx=0x7f5c8c004ac0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 -- 172.21.15.8:0/1922037856 shutdown_connections 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1922037856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e12990 0x564740e0c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1922037856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e10ec0 0x564740e123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 --2- 172.21.15.8:0/1922037856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e11fd0 0x564740e220d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 -- 172.21.15.8:0/1922037856 >> 172.21.15.8:0/1922037856 conn(0x564740d85200 msgr2=0x564740e198d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 -- 172.21.15.8:0/1922037856 shutdown_connections 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 -- 172.21.15.8:0/1922037856 wait complete. 2023-10-06T23:21:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.655+0000 7f5caae8db80 1 -- start start 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5caae8db80 1 Processor -- start 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e20000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5caae8db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 0x564740e21010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5caae8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740e21550 con 0x564740e11fd0 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5caae8db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740e216c0 con 0x564740e12990 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5caae8db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564740e21880 con 0x564740e10ec0 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5caae8db80 10 client.0 _ll_register_callbacks cb 0x7f5c80005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5c9539b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e20000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.656+0000 7f5c94b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c9539b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e20000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46854/0 (socket says 172.21.15.8:46854) 2023-10-06T23:21:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c9539b700 1 -- 172.21.15.8:0/2176169866 learned_addr learned my addr 172.21.15.8:0/2176169866 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 0x564740e21010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c94b9a700 1 -- 172.21.15.8:0/2176169866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 msgr2=0x564740e21010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 0x564740e21010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c94b9a700 1 -- 172.21.15.8:0/2176169866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 msgr2=0x564740e20000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e20000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c94b9a700 1 -- 172.21.15.8:0/2176169866 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c01d040 con 0x564740e10ec0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c94b9a700 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1fac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c80004840 tx=0x7f5c80009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=902e7ef1786a2fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.657+0000 7f5c78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.658+0000 7f5c78ff9700 1 -- 172.21.15.8:0/2176169866 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000bd90 con 0x564740e10ec0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.658+0000 7f5caae8db80 1 -- 172.21.15.8:0/2176169866 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c8c011e10 con 0x564740e10ec0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.658+0000 7f5c78ff9700 1 -- 172.21.15.8:0/2176169866 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5c80000e40 con 0x564740e10ec0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.658+0000 7f5c78ff9700 1 -- 172.21.15.8:0/2176169866 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c800049b0 con 0x564740e10ec0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.658+0000 7f5caae8db80 10 client.26242 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.658+0000 7f5caae8db80 1 -- 172.21.15.8:0/2176169866 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x564740bb51f0 con 0x564740e10ec0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.658+0000 7f5c78ff9700 1 -- 172.21.15.8:0/2176169866 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c8c011e10 con 0x564740e10ec0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.658+0000 7f5c78ff9700 1 -- 172.21.15.8:0/2176169866 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5c800099c0 con 0x564740e10ec0 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.659+0000 7f5caae8db80 10 client.26242 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.659+0000 7f5caae8db80 10 client.26242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.659+0000 7f5caae8db80 20 client.26242 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.659+0000 7f5caae8db80 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564740e7b010 0x564740e7d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.659+0000 7f5caae8db80 4 client.26242 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:21:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.659+0000 7f5caae8db80 1 -- 172.21.15.8:0/2176169866 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564740d5cad0 con 0x564740e7b010 2023-10-06T23:21:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.659+0000 7f5c9539b700 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564740e7b010 0x564740e7d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.660+0000 7f5c9539b700 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564740e7b010 0x564740e7d430 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef84cf27b268dfbd server_cookie=7cb13ea6be4d596c in_seq=0 out_seq=0 2023-10-06T23:21:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.660+0000 7f5c78ff9700 10 client.26242 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.677+0000 7f5c78ff9700 1 -- 172.21.15.8:0/2176169866 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564740d5cad0 con 0x564740e7b010 2023-10-06T23:21:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.677+0000 7f5c78ff9700 10 client.26242 handle_command_reply: tid=0 2023-10-06T23:21:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.677+0000 7f5caae8db80 1 client.26242 shutdown 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 -- 172.21.15.8:0/2176169866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 msgr2=0x564740e1fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1fac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c80004840 tx=0x7f5c80009310 comp rx=0 tx=0).stop 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 -- 172.21.15.8:0/2176169866 shutdown_connections 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564740e7b010 0x564740e7d430 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564740e12990 0x564740e21010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564740e10ec0 0x564740e1fac0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 --2- 172.21.15.8:0/2176169866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564740e11fd0 0x564740e20000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5c78ff9700 0 client.26242 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 -- 172.21.15.8:0/2176169866 >> 172.21.15.8:0/2176169866 conn(0x564740d85200 msgr2=0x564740e0c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 -- 172.21.15.8:0/2176169866 shutdown_connections 2023-10-06T23:21:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 1 -- 172.21.15.8:0/2176169866 wait complete. 2023-10-06T23:21:20.682 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.678+0000 7f5caae8db80 20 client.26242 trim_cache size 0 max 16384 2023-10-06T23:21:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:21:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:21:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:21:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 -- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c7c0a1480 msgr2=0x7f5c7c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c7c0a1480 0x7f5c7c0a3940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5c880a18e0 tx=0x7f5c88009ed0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 -- 172.21.15.8:0/1577396049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c90101980 msgr2=0x7f5c9019a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c90101980 0x7f5c9019a270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800ef30 tx=0x7f5c8800c3a0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 -- 172.21.15.8:0/1577396049 shutdown_connections 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f5c7c0a1480 0x7f5c7c0a3940 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c900ffdf0 0x7f5c90198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c90101980 0x7f5c9019a270 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 --2- 172.21.15.8:0/1577396049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c90100fe0 0x7f5c901993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 -- 172.21.15.8:0/1577396049 >> 172.21.15.8:0/1577396049 conn(0x7f5c900fb340 msgr2=0x7f5c90068310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.679+0000 7f5c975ff700 1 -- 172.21.15.8:0/1577396049 shutdown_connections 2023-10-06T23:21:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:20.680+0000 7f5c975ff700 1 -- 172.21.15.8:0/1577396049 wait complete. 2023-10-06T23:21:21.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:21 smithi190 ceph-mon[102658]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 6.4 MiB/s wr, 524 op/s 2023-10-06T23:21:21.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:21 smithi156 ceph-mon[102862]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 6.4 MiB/s wr, 524 op/s 2023-10-06T23:21:21.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:21 smithi008 ceph-mon[98532]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 6.4 MiB/s wr, 524 op/s 2023-10-06T23:21:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:23 smithi190 ceph-mon[102658]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 5.6 MiB/s wr, 454 op/s 2023-10-06T23:21:23.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:23 smithi156 ceph-mon[102862]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 5.6 MiB/s wr, 454 op/s 2023-10-06T23:21:23.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:23 smithi008 ceph-mon[98532]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 5.6 MiB/s wr, 454 op/s 2023-10-06T23:21:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 390.0 s, 269.6 tps, lat 363.910 ms stddev 61.976 2023-10-06T23:21:25.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:25 smithi156 ceph-mon[102862]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 7.6 MiB/s wr, 620 op/s 2023-10-06T23:21:25.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:25 smithi008 ceph-mon[98532]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 7.6 MiB/s wr, 620 op/s 2023-10-06T23:21:25.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:25 smithi190 ceph-mon[102658]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 7.6 MiB/s wr, 620 op/s 2023-10-06T23:21:27.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:27 smithi156 ceph-mon[102862]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 6.8 MiB/s wr, 545 op/s 2023-10-06T23:21:27.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:27 smithi008 ceph-mon[98532]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 6.8 MiB/s wr, 545 op/s 2023-10-06T23:21:27.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:27 smithi190 ceph-mon[102658]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 6.8 MiB/s wr, 545 op/s 2023-10-06T23:21:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 395.0 s, 225.6 tps, lat 454.308 ms stddev 267.349 2023-10-06T23:21:29.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:29 smithi156 ceph-mon[102862]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 6.4 MiB/s wr, 484 op/s 2023-10-06T23:21:29.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:29 smithi008 ceph-mon[98532]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 6.4 MiB/s wr, 484 op/s 2023-10-06T23:21:29.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:29 smithi190 ceph-mon[102658]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 6.4 MiB/s wr, 484 op/s 2023-10-06T23:21:31.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:31 smithi156 ceph-mon[102862]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2023-10-06T23:21:31.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:31 smithi008 ceph-mon[98532]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2023-10-06T23:21:31.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:31 smithi190 ceph-mon[102658]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2023-10-06T23:21:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:33 smithi190 ceph-mon[102658]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 5.9 MiB/s wr, 467 op/s 2023-10-06T23:21:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.835+0000 7f58665ff700 1 -- 172.21.15.8:0/1464147039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860102090 msgr2=0x7f5860102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.835+0000 7f58665ff700 1 --2- 172.21.15.8:0/1464147039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860102090 0x7f5860102510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5848009990 tx=0x7f5848009ca0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.835+0000 7f58665ff700 1 -- 172.21.15.8:0/1464147039 shutdown_connections 2023-10-06T23:21:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.835+0000 7f58665ff700 1 --2- 172.21.15.8:0/1464147039 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5860102a50 0x7f5860109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.835+0000 7f58665ff700 1 --2- 172.21.15.8:0/1464147039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5860100eb0 0x7f58601012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.835+0000 7f58665ff700 1 --2- 172.21.15.8:0/1464147039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860102090 0x7f5860102510 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.835+0000 7f58665ff700 1 -- 172.21.15.8:0/1464147039 >> 172.21.15.8:0/1464147039 conn(0x7f58600fc430 msgr2=0x7f58600fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.836+0000 7f58665ff700 1 -- 172.21.15.8:0/1464147039 shutdown_connections 2023-10-06T23:21:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.836+0000 7f58665ff700 1 -- 172.21.15.8:0/1464147039 wait complete. 2023-10-06T23:21:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f58665ff700 1 Processor -- start 2023-10-06T23:21:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f58665ff700 1 -- start start 2023-10-06T23:21:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f58665ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860100eb0 0x7f5860196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f58665ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5860102090 0x7f5860197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f58665ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5860102a50 0x7f5860197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f58665ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860198640 con 0x7f5860102090 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f58665ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58601987b0 con 0x7f5860102a50 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f58665ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860198970 con 0x7f5860100eb0 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f585ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5860102090 0x7f5860197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f5857fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860100eb0 0x7f5860196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f5857fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860100eb0 0x7f5860196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:41312/0 (socket says 172.21.15.8:41312) 2023-10-06T23:21:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.837+0000 7f5857fff700 1 -- 172.21.15.8:0/3411161082 learned_addr learned my addr 172.21.15.8:0/3411161082 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f5864b9c700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5860102a50 0x7f5860197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585ffff700 1 -- 172.21.15.8:0/3411161082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860100eb0 msgr2=0x7f5860196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585ffff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860100eb0 0x7f5860196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585ffff700 1 -- 172.21.15.8:0/3411161082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5860102a50 msgr2=0x7f5860197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585ffff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5860102a50 0x7f5860197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585ffff700 1 -- 172.21.15.8:0/3411161082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480095f0 con 0x7f5860102090 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f5864b9c700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5860102a50 0x7f5860197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585ffff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5860102090 0x7f5860197160 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f58480098e0 tx=0x7f5848005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585dffb700 1 -- 172.21.15.8:0/3411161082 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584801d070 con 0x7f5860102090 2023-10-06T23:21:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f58665ff700 1 -- 172.21.15.8:0/3411161082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5860198bf0 con 0x7f5860102090 2023-10-06T23:21:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585dffb700 1 -- 172.21.15.8:0/3411161082 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f584800be30 con 0x7f5860102090 2023-10-06T23:21:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.838+0000 7f585dffb700 1 -- 172.21.15.8:0/3411161082 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848022e40 con 0x7f5860102090 2023-10-06T23:21:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.839+0000 7f58665ff700 1 -- 172.21.15.8:0/3411161082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586019f410 con 0x7f5860102090 2023-10-06T23:21:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.842+0000 7f585dffb700 1 -- 172.21.15.8:0/3411161082 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5848022600 con 0x7f5860102090 2023-10-06T23:21:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.843+0000 7f5879f77b80 1 Processor -- start 2023-10-06T23:21:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.843+0000 7f5879f77b80 1 -- start start 2023-10-06T23:21:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.843+0000 7f585dffb700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f584c0a1480 0x7f584c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba9471f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba947203e0 0x55ba94720860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94727630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5879f77b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba94683400 con 0x55ba94720da0 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5879f77b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba94674bc0 con 0x55ba947203e0 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5879f77b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba946724e0 con 0x55ba9471f2d0 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f585dffb700 1 -- 172.21.15.8:0/3411161082 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f58480ce220 con 0x7f5860102090 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5857fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba9471f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5864b9c700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f584c0a1480 0x7f584c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f585ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba947203e0 0x55ba94720860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5857fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba9471f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:41316/0 (socket says 172.21.15.8:41316) 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5857fff700 1 -- 172.21.15.8:0/3968172974 learned_addr learned my addr 172.21.15.8:0/3968172974 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5864b9c700 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94727630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5857fff700 1 -- 172.21.15.8:0/3968172974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba947203e0 msgr2=0x55ba94720860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5857fff700 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba947203e0 0x55ba94720860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5857fff700 1 -- 172.21.15.8:0/3968172974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 msgr2=0x55ba94727630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5857fff700 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94727630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5857fff700 1 -- 172.21.15.8:0/3968172974 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba94498d80 con 0x55ba9471f2d0 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f5864b9c700 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94727630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:21:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.844+0000 7f585ffff700 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba947203e0 0x55ba94720860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:21:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.845+0000 7f5857fff700 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba9471f6f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5850009dd0 tx=0x7f5850011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5847eb6f52457de2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.845+0000 7f5864b9c700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f584c0a1480 0x7f584c0a3940 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5858015c00 tx=0x7f5858009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.845+0000 7f58567fc700 1 -- 172.21.15.8:0/3968172974 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850004230 con 0x55ba9471f2d0 2023-10-06T23:21:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.845+0000 7f58567fc700 1 -- 172.21.15.8:0/3968172974 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5850004390 con 0x55ba9471f2d0 2023-10-06T23:21:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.845+0000 7f58567fc700 1 -- 172.21.15.8:0/3968172974 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850019790 con 0x55ba9471f2d0 2023-10-06T23:21:33.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:33 smithi156 ceph-mon[102862]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 5.9 MiB/s wr, 467 op/s 2023-10-06T23:21:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 -- 172.21.15.8:0/3968172974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 msgr2=0x55ba9471f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba9471f6f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5850009dd0 tx=0x7f5850011720 comp rx=0 tx=0).stop 2023-10-06T23:21:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 -- 172.21.15.8:0/3968172974 shutdown_connections 2023-10-06T23:21:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94727630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba9471f6f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3968172974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba947203e0 0x55ba94720860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 -- 172.21.15.8:0/3968172974 >> 172.21.15.8:0/3968172974 conn(0x55ba9468f200 msgr2=0x55ba94715b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 -- 172.21.15.8:0/3968172974 shutdown_connections 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 -- 172.21.15.8:0/3968172974 wait complete. 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.846+0000 7f5879f77b80 1 -- start start 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.847+0000 7f5879f77b80 1 Processor -- start 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba94729000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba94729540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba94720da0 0x55ba94730580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5879f77b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9466ddd0 con 0x55ba947203e0 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5879f77b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9460a6b0 con 0x55ba94720da0 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5879f77b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9460a350 con 0x55ba9471f2d0 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5879f77b80 10 client.0 _ll_register_callbacks cb 0x55ba944677a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5857fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba94729000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f585ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba94729540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5857fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba94729000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:41330/0 (socket says 172.21.15.8:41330) 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5857fff700 1 -- 172.21.15.8:0/3585167479 learned_addr learned my addr 172.21.15.8:0/3585167479 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5864b9c700 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba94720da0 0x55ba94730580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5857fff700 1 -- 172.21.15.8:0/3585167479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba94720da0 msgr2=0x55ba94730580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5857fff700 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba94720da0 0x55ba94730580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5857fff700 1 -- 172.21.15.8:0/3585167479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 msgr2=0x55ba94729540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5857fff700 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba94729540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f5857fff700 1 -- 172.21.15.8:0/3585167479 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586019f410 con 0x55ba9471f2d0 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.848+0000 7f585ffff700 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba94729540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.849+0000 7f5857fff700 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba94729000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5850005950 tx=0x7f58500038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8ac0d6aec9c6c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.849+0000 7f583f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:21:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.849+0000 7f583f7fe700 1 -- 172.21.15.8:0/3585167479 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850005240 con 0x55ba9471f2d0 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.849+0000 7f5879f77b80 1 -- 172.21.15.8:0/3585167479 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba9470dd50 con 0x55ba9471f2d0 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.849+0000 7f583f7fe700 1 -- 172.21.15.8:0/3585167479 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5850005ce0 con 0x55ba9471f2d0 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.849+0000 7f583f7fe700 1 -- 172.21.15.8:0/3585167479 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58500053a0 con 0x55ba9471f2d0 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.849+0000 7f5879f77b80 10 client.26254 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.849+0000 7f5879f77b80 1 -- 172.21.15.8:0/3585167479 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f5850009a30 con 0x55ba9471f2d0 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f583f7fe700 1 -- 172.21.15.8:0/3585167479 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba9470dd50 con 0x55ba9471f2d0 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f583f7fe700 1 -- 172.21.15.8:0/3585167479 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5850021040 con 0x55ba9471f2d0 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f5879f77b80 10 client.26254 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f5879f77b80 10 client.26254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f5879f77b80 20 client.26254 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ba94734d60 0x55ba94737180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f5879f77b80 4 client.26254 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f5879f77b80 1 -- 172.21.15.8:0/3585167479 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba94666db0 con 0x55ba94734d60 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.850+0000 7f585ffff700 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ba94734d60 0x55ba94737180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.851+0000 7f585ffff700 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ba94734d60 0x55ba94737180 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=168b3247bef7b997 server_cookie=41ba5c745d2f5f8c in_seq=0 out_seq=0 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.851+0000 7f583f7fe700 10 client.26254 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f583f7fe700 1 -- 172.21.15.8:0/3585167479 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ba94666db0 con 0x55ba94734d60 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f583f7fe700 10 client.26254 handle_command_reply: tid=0 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 client.26254 shutdown 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 -- 172.21.15.8:0/3585167479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 msgr2=0x55ba94729000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba94729000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5850005950 tx=0x7f58500038b0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 -- 172.21.15.8:0/3585167479 shutdown_connections 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ba94734d60 0x55ba94737180 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba94720da0 0x55ba94730580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba9471f2d0 0x55ba94729000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 --2- 172.21.15.8:0/3585167479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba94729540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f583f7fe700 0 client.26254 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 -- 172.21.15.8:0/3585167479 >> 172.21.15.8:0/3585167479 conn(0x55ba9468f200 msgr2=0x55ba94715250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 -- 172.21.15.8:0/3585167479 shutdown_connections 2023-10-06T23:21:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 1 -- 172.21.15.8:0/3585167479 wait complete. 2023-10-06T23:21:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.852+0000 7f5879f77b80 20 client.26254 trim_cache size 0 max 16384 2023-10-06T23:21:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5879f77b80 1 Processor -- start 2023-10-06T23:21:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5879f77b80 1 -- start start 2023-10-06T23:21:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba947271c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba947203e0 0x55ba94727700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94730540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5879f77b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba944ee8c0 con 0x55ba94720da0 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5879f77b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9470dc90 con 0x55ba9471f2d0 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5879f77b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba947284b0 con 0x55ba947203e0 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5864b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94730540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f585ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba947203e0 0x55ba94727700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5857fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba947271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.871 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f585ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba947203e0 0x55ba94727700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:41338/0 (socket says 172.21.15.8:41338) 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f585ffff700 1 -- 172.21.15.8:0/2544002140 learned_addr learned my addr 172.21.15.8:0/2544002140 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.868+0000 7f5864b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94730540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53424/0 (socket says 172.21.15.8:53424) 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f585ffff700 1 -- 172.21.15.8:0/2544002140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 msgr2=0x55ba947271c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f585ffff700 1 --2- 172.21.15.8:0/2544002140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba947271c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f585ffff700 1 -- 172.21.15.8:0/2544002140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 msgr2=0x55ba94730540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f585ffff700 1 --2- 172.21.15.8:0/2544002140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94730540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f585ffff700 1 -- 172.21.15.8:0/2544002140 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba94481c00 con 0x55ba947203e0 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f585ffff700 1 --2- 172.21.15.8:0/2544002140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba947203e0 0x55ba94727700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5848009990 tx=0x7f5848005d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8633adae3cd2937f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f5856ffd700 1 -- 172.21.15.8:0/2544002140 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584809bc80 con 0x55ba947203e0 2023-10-06T23:21:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f5856ffd700 1 -- 172.21.15.8:0/2544002140 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f584809b580 con 0x55ba947203e0 2023-10-06T23:21:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.869+0000 7f5856ffd700 1 -- 172.21.15.8:0/2544002140 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480cbde0 con 0x55ba947203e0 2023-10-06T23:21:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 -- 172.21.15.8:0/2544002140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba947203e0 msgr2=0x55ba94727700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 --2- 172.21.15.8:0/2544002140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba947203e0 0x55ba94727700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5848009990 tx=0x7f5848005d40 comp rx=0 tx=0).stop 2023-10-06T23:21:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 -- 172.21.15.8:0/2544002140 shutdown_connections 2023-10-06T23:21:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 --2- 172.21.15.8:0/2544002140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba94720da0 0x55ba94730540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 --2- 172.21.15.8:0/2544002140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba947271c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 --2- 172.21.15.8:0/2544002140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba947203e0 0x55ba94727700 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 -- 172.21.15.8:0/2544002140 >> 172.21.15.8:0/2544002140 conn(0x55ba9468f200 msgr2=0x55ba94727ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 -- 172.21.15.8:0/2544002140 shutdown_connections 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 -- 172.21.15.8:0/2544002140 wait complete. 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 -- start start 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.870+0000 7f5879f77b80 1 Processor -- start 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba9472df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba9472e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5879f77b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba94720da0 0x55ba9472f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5879f77b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9472f9f0 con 0x55ba947203e0 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5879f77b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9472fb60 con 0x55ba9471f2d0 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5879f77b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9472fd20 con 0x55ba94720da0 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5879f77b80 10 client.0 _ll_register_callbacks cb 0x7f58480228b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f585ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba9472e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5857fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba9472df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5857fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba9472df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:51882/0 (socket says 172.21.15.8:51882) 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5857fff700 1 -- 172.21.15.8:0/4084177038 learned_addr learned my addr 172.21.15.8:0/4084177038 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.871+0000 7f5864b9c700 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba94720da0 0x55ba9472f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5857fff700 1 -- 172.21.15.8:0/4084177038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba94720da0 msgr2=0x55ba9472f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5857fff700 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba94720da0 0x55ba9472f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5857fff700 1 -- 172.21.15.8:0/4084177038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 msgr2=0x55ba9472e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5857fff700 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba9472e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5857fff700 1 -- 172.21.15.8:0/4084177038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5860198bf0 con 0x55ba9471f2d0 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5857fff700 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba9472df60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5850009e30 tx=0x7f5850011a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7e58c159f379f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f583f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f583f7fe700 1 -- 172.21.15.8:0/4084177038 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850019c80 con 0x55ba9471f2d0 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5879f77b80 1 -- 172.21.15.8:0/4084177038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5850004390 con 0x55ba9471f2d0 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f583f7fe700 1 -- 172.21.15.8:0/4084177038 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5850019de0 con 0x55ba9471f2d0 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f583f7fe700 1 -- 172.21.15.8:0/4084177038 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5850019860 con 0x55ba9471f2d0 2023-10-06T23:21:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5879f77b80 10 client.26243 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.872+0000 7f5879f77b80 1 -- 172.21.15.8:0/4084177038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ba944bf1f0 con 0x55ba9471f2d0 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f583f7fe700 1 -- 172.21.15.8:0/4084177038 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5850004390 con 0x55ba9471f2d0 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f583f7fe700 1 -- 172.21.15.8:0/4084177038 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5850011790 con 0x55ba9471f2d0 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f5879f77b80 10 client.26243 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f5879f77b80 10 client.26243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f5879f77b80 20 client.26243 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f5879f77b80 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ba94789280 0x55ba9478b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f5879f77b80 4 client.26243 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:21:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f5879f77b80 1 -- 172.21.15.8:0/4084177038 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ba94666ad0 con 0x55ba94789280 2023-10-06T23:21:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.873+0000 7f585ffff700 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ba94789280 0x55ba9478b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.874+0000 7f585ffff700 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ba94789280 0x55ba9478b6a0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33d45777a4242781 server_cookie=371bbe8fa0893fce in_seq=0 out_seq=0 2023-10-06T23:21:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.874+0000 7f583f7fe700 10 client.26243 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:33.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:33 smithi008 ceph-mon[98532]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 5.9 MiB/s wr, 467 op/s 2023-10-06T23:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.939+0000 7f583f7fe700 1 -- 172.21.15.8:0/4084177038 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ba94666ad0 con 0x55ba94789280 2023-10-06T23:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.939+0000 7f583f7fe700 10 client.26243 handle_command_reply: tid=0 2023-10-06T23:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.939+0000 7f5879f77b80 1 client.26243 shutdown 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 -- 172.21.15.8:0/4084177038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 msgr2=0x55ba9472df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba9472df60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5850009e30 tx=0x7f5850011a70 comp rx=0 tx=0).stop 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 -- 172.21.15.8:0/4084177038 shutdown_connections 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ba94789280 0x55ba9478b6a0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ba94720da0 0x55ba9472f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba9471f2d0 0x55ba9472df60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 --2- 172.21.15.8:0/4084177038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba947203e0 0x55ba9472e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f583f7fe700 0 client.26243 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 -- 172.21.15.8:0/4084177038 >> 172.21.15.8:0/4084177038 conn(0x55ba9468f200 msgr2=0x55ba947271c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 -- 172.21.15.8:0/4084177038 shutdown_connections 2023-10-06T23:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 1 -- 172.21.15.8:0/4084177038 wait complete. 2023-10-06T23:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.940+0000 7f5879f77b80 20 client.26243 trim_cache size 0 max 16384 2023-10-06T23:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:21:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:21:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.941+0000 7f58665ff700 1 -- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f584c0a1480 msgr2=0x7f584c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.941+0000 7f58665ff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f584c0a1480 0x7f584c0a3940 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5858015c00 tx=0x7f5858009920 comp rx=0 tx=0).stop 2023-10-06T23:21:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.941+0000 7f58665ff700 1 -- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5860102090 msgr2=0x7f5860197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.941+0000 7f58665ff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5860102090 0x7f5860197160 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f58480098e0 tx=0x7f5848005740 comp rx=0 tx=0).stop 2023-10-06T23:21:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.941+0000 7f58665ff700 1 -- 172.21.15.8:0/3411161082 shutdown_connections 2023-10-06T23:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.941+0000 7f58665ff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f584c0a1480 0x7f584c0a3940 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.942+0000 7f58665ff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5860102a50 0x7f5860197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.942+0000 7f58665ff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5860100eb0 0x7f5860196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.942+0000 7f58665ff700 1 --2- 172.21.15.8:0/3411161082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5860102090 0x7f5860197160 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.942+0000 7f58665ff700 1 -- 172.21.15.8:0/3411161082 >> 172.21.15.8:0/3411161082 conn(0x7f58600fc430 msgr2=0x7f58600fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.942+0000 7f58665ff700 1 -- 172.21.15.8:0/3411161082 shutdown_connections 2023-10-06T23:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:33.942+0000 7f58665ff700 1 -- 172.21.15.8:0/3411161082 wait complete. 2023-10-06T23:21:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 400.0 s, 274.8 tps, lat 351.292 ms stddev 58.911 2023-10-06T23:21:35.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:35 smithi156 ceph-mon[102862]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 6.5 MiB/s wr, 540 op/s 2023-10-06T23:21:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:35 smithi008 ceph-mon[98532]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 6.5 MiB/s wr, 540 op/s 2023-10-06T23:21:35.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:35 smithi190 ceph-mon[102658]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 6.5 MiB/s wr, 540 op/s 2023-10-06T23:21:37.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:37 smithi156 ceph-mon[102862]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.4 MiB/s wr, 455 op/s 2023-10-06T23:21:37.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:37 smithi008 ceph-mon[98532]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.4 MiB/s wr, 455 op/s 2023-10-06T23:21:37.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:37 smithi190 ceph-mon[102658]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 5.4 MiB/s wr, 455 op/s 2023-10-06T23:21:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 405.0 s, 212.8 tps, lat 477.454 ms stddev 287.654 2023-10-06T23:21:39.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:39 smithi156 ceph-mon[102862]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.4 MiB/s wr, 523 op/s 2023-10-06T23:21:39.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:39 smithi008 ceph-mon[98532]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.4 MiB/s wr, 523 op/s 2023-10-06T23:21:39.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:39 smithi190 ceph-mon[102658]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.4 MiB/s wr, 523 op/s 2023-10-06T23:21:41.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:41 smithi156 ceph-mon[102862]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 6.3 MiB/s wr, 528 op/s 2023-10-06T23:21:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:41 smithi008 ceph-mon[98532]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 6.3 MiB/s wr, 528 op/s 2023-10-06T23:21:41.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:41 smithi190 ceph-mon[102658]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 6.3 MiB/s wr, 528 op/s 2023-10-06T23:21:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:43 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:21:43.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:43 smithi190 ceph-mon[102658]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.4 MiB/s wr, 474 op/s 2023-10-06T23:21:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:43 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:21:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:43 smithi156 ceph-mon[102862]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.4 MiB/s wr, 474 op/s 2023-10-06T23:21:43.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:43 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:21:43.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:43 smithi008 ceph-mon[98532]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 5.4 MiB/s wr, 474 op/s 2023-10-06T23:21:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 410.0 s, 249.0 tps, lat 408.221 ms stddev 112.293 2023-10-06T23:21:44.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:44 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:21:44.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:44 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:21:44.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:44 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:21:44.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:21:44.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:21:44.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:21:44.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:44 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:21:44.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:44 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:21:44.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:44 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:21:45.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:45 smithi190 ceph-mon[102658]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 5.9 MiB/s wr, 542 op/s 2023-10-06T23:21:45.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:45 smithi156 ceph-mon[102862]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 5.9 MiB/s wr, 542 op/s 2023-10-06T23:21:45.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:45 smithi008 ceph-mon[98532]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 5.9 MiB/s wr, 542 op/s 2023-10-06T23:21:47.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.152+0000 7f634e1ff700 1 -- 172.21.15.8:0/1327574745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63481042a0 msgr2=0x7f6348106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.152+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1327574745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63481042a0 0x7f6348106690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f633c009990 tx=0x7f633c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.153+0000 7f634e1ff700 1 -- 172.21.15.8:0/1327574745 shutdown_connections 2023-10-06T23:21:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.153+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1327574745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6348106bd0 0x7f6348109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.153+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1327574745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6348101970 0x7f6348103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.153+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1327574745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63481042a0 0x7f6348106690 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.153+0000 7f634e1ff700 1 -- 172.21.15.8:0/1327574745 >> 172.21.15.8:0/1327574745 conn(0x7f63480fb340 msgr2=0x7f63480fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.153+0000 7f634e1ff700 1 -- 172.21.15.8:0/1327574745 shutdown_connections 2023-10-06T23:21:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.153+0000 7f634e1ff700 1 -- 172.21.15.8:0/1327574745 wait complete. 2023-10-06T23:21:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.154+0000 7f634e1ff700 1 Processor -- start 2023-10-06T23:21:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.154+0000 7f634e1ff700 1 -- start start 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f634e1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6348101970 0x7f6348196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f634e1ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63481042a0 0x7f63481970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f634e1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6348106bd0 0x7f6348197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f634e1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63481985c0 con 0x7f6348106bd0 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f634e1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6348198730 con 0x7f6348101970 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f634e1ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63481988f0 con 0x7f63481042a0 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f6347fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6348106bd0 0x7f6348197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f6346ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63481042a0 0x7f63481970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f6347fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6348106bd0 0x7f6348197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45330/0 (socket says 172.21.15.8:45330) 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f63477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6348101970 0x7f6348196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.155+0000 7f6347fff700 1 -- 172.21.15.8:0/1432152793 learned_addr learned my addr 172.21.15.8:0/1432152793 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.156+0000 7f6347fff700 1 -- 172.21.15.8:0/1432152793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63481042a0 msgr2=0x7f63481970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.156+0000 7f6347fff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63481042a0 0x7f63481970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.156+0000 7f6347fff700 1 -- 172.21.15.8:0/1432152793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6348101970 msgr2=0x7f6348196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.156+0000 7f6347fff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6348101970 0x7f6348196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.156+0000 7f6347fff700 1 -- 172.21.15.8:0/1432152793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0095f0 con 0x7f6348106bd0 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.156+0000 7f6346ffd700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63481042a0 0x7f63481970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.156+0000 7f6347fff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6348106bd0 0x7f6348197f60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f634000ef30 tx=0x7f634000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.156+0000 7f6344ff9700 1 -- 172.21.15.8:0/1432152793 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340018070 con 0x7f6348106bd0 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.157+0000 7f6344ff9700 1 -- 172.21.15.8:0/1432152793 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f634000f040 con 0x7f6348106bd0 2023-10-06T23:21:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.157+0000 7f6344ff9700 1 -- 172.21.15.8:0/1432152793 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634000cbc0 con 0x7f6348106bd0 2023-10-06T23:21:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.157+0000 7f634e1ff700 1 -- 172.21.15.8:0/1432152793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6348198b70 con 0x7f6348106bd0 2023-10-06T23:21:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.157+0000 7f634e1ff700 1 -- 172.21.15.8:0/1432152793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634819f390 con 0x7f6348106bd0 2023-10-06T23:21:47.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.163+0000 7f6344ff9700 1 -- 172.21.15.8:0/1432152793 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f634000cd80 con 0x7f6348106bd0 2023-10-06T23:21:47.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.164+0000 7f6361a51b80 1 Processor -- start 2023-10-06T23:21:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.164+0000 7f6361a51b80 1 -- start start 2023-10-06T23:21:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.164+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x55951993b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.164+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993b7d0 0x55951993bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.166 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993c5b0 0x55951993ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f6361a51b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595198a3400 con 0x55951993ae70 2023-10-06T23:21:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f6361a51b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559519894bc0 con 0x55951993c5b0 2023-10-06T23:21:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f6361a51b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595198924e0 con 0x55951993b7d0 2023-10-06T23:21:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f63477fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993b7d0 0x55951993bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f63477fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993b7d0 0x55951993bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54588/0 (socket says 172.21.15.8:54588) 2023-10-06T23:21:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f63477fe700 1 -- 172.21.15.8:0/1253999921 learned_addr learned my addr 172.21.15.8:0/1253999921 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f6346ffd700 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993c5b0 0x55951993ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.167 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f6346ffd700 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x55951993b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.165+0000 7f63477fe700 1 -- 172.21.15.8:0/1253999921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993c5b0 msgr2=0x55951993ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.166+0000 7f63477fe700 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993c5b0 0x55951993ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.166+0000 7f63477fe700 1 -- 172.21.15.8:0/1253999921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 msgr2=0x55951993b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.166+0000 7f63477fe700 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x55951993b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.166+0000 7f63477fe700 1 -- 172.21.15.8:0/1253999921 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595196b8d80 con 0x55951993b7d0 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.166+0000 7f6346ffd700 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x55951993b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.166+0000 7f63477fe700 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993b7d0 0x55951993bfd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f633800ad70 tx=0x7f633800f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10fb5e3709dfb3f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.166+0000 7f632dffb700 1 -- 172.21.15.8:0/1253999921 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633800a870 con 0x55951993b7d0 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.167+0000 7f632dffb700 1 -- 172.21.15.8:0/1253999921 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f633800fec0 con 0x55951993b7d0 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.167+0000 7f632dffb700 1 -- 172.21.15.8:0/1253999921 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63380186a0 con 0x55951993b7d0 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.167+0000 7f6344ff9700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f63300a1580 0x7f63300a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.167+0000 7f6344ff9700 1 -- 172.21.15.8:0/1432152793 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f63400cc550 con 0x7f6348106bd0 2023-10-06T23:21:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.167+0000 7f6346ffd700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f63300a1580 0x7f63300a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.168+0000 7f6361a51b80 1 -- 172.21.15.8:0/1253999921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993b7d0 msgr2=0x55951993bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.168+0000 7f6361a51b80 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993b7d0 0x55951993bfd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f633800ad70 tx=0x7f633800f6a0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.168+0000 7f6346ffd700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f63300a1580 0x7f63300a3a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f633c006010 tx=0x7f633c00b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.169+0000 7f6361a51b80 1 -- 172.21.15.8:0/1253999921 shutdown_connections 2023-10-06T23:21:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.169+0000 7f6361a51b80 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x55951993b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.169+0000 7f6361a51b80 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993c5b0 0x55951993ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.169+0000 7f6361a51b80 1 --2- 172.21.15.8:0/1253999921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993b7d0 0x55951993bfd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.169+0000 7f6361a51b80 1 -- 172.21.15.8:0/1253999921 >> 172.21.15.8:0/1253999921 conn(0x5595198af200 msgr2=0x559519935bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.169+0000 7f6361a51b80 1 -- 172.21.15.8:0/1253999921 shutdown_connections 2023-10-06T23:21:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.169+0000 7f6361a51b80 1 -- 172.21.15.8:0/1253999921 wait complete. 2023-10-06T23:21:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.170+0000 7f6361a51b80 1 -- start start 2023-10-06T23:21:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.170+0000 7f6361a51b80 1 Processor -- start 2023-10-06T23:21:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x559519944b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 0x5595199450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f6361a51b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951988ddd0 con 0x55951993b7d0 2023-10-06T23:21:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f6361a51b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951982a6b0 con 0x55951993ae70 2023-10-06T23:21:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f6361a51b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951982a350 con 0x55951993c5b0 2023-10-06T23:21:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f6361a51b80 10 client.0 _ll_register_callbacks cb 0x5595196877a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f63477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x559519944b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f6347fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f63477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x559519944b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37686/0 (socket says 172.21.15.8:37686) 2023-10-06T23:21:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.171+0000 7f63477fe700 1 -- 172.21.15.8:0/12179206 learned_addr learned my addr 172.21.15.8:0/12179206 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.172+0000 7f6346ffd700 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 0x5595199450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.172+0000 7f6347fff700 1 -- 172.21.15.8:0/12179206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 msgr2=0x559519944b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.172+0000 7f6347fff700 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x559519944b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.172+0000 7f6347fff700 1 -- 172.21.15.8:0/12179206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 msgr2=0x5595199450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.172+0000 7f6347fff700 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 0x5595199450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.172+0000 7f6347fff700 1 -- 172.21.15.8:0/12179206 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633800a9d0 con 0x55951993c5b0 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.172+0000 7f6347fff700 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994c110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f63400ca000 tx=0x7f6340099300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad285494b0f32f3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.172+0000 7f6326ffd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.173+0000 7f6326ffd700 1 -- 172.21.15.8:0/12179206 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634009da00 con 0x55951993c5b0 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.173+0000 7f6326ffd700 1 -- 172.21.15.8:0/12179206 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f63400a1bb0 con 0x55951993c5b0 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.173+0000 7f6361a51b80 1 -- 172.21.15.8:0/12179206 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559519886db0 con 0x55951993c5b0 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.173+0000 7f6326ffd700 1 -- 172.21.15.8:0/12179206 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63400b2020 con 0x55951993c5b0 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.173+0000 7f6361a51b80 10 client.26272 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:47.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.173+0000 7f6361a51b80 1 -- 172.21.15.8:0/12179206 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5595196a1c00 con 0x55951993c5b0 2023-10-06T23:21:47.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.173+0000 7f6326ffd700 1 -- 172.21.15.8:0/12179206 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559519886db0 con 0x55951993c5b0 2023-10-06T23:21:47.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.173+0000 7f6326ffd700 1 -- 172.21.15.8:0/12179206 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6340099c30 con 0x55951993c5b0 2023-10-06T23:21:47.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.174+0000 7f6361a51b80 10 client.26272 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:47.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.174+0000 7f6361a51b80 10 client.26272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.174+0000 7f6361a51b80 20 client.26272 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.174+0000 7f6361a51b80 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5595199619c0 0x559519963de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.174+0000 7f6361a51b80 4 client.26272 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:21:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.174+0000 7f6361a51b80 1 -- 172.21.15.8:0/12179206 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559519886ad0 con 0x5595199619c0 2023-10-06T23:21:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.176+0000 7f63477fe700 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5595199619c0 0x559519963de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.180+0000 7f63477fe700 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5595199619c0 0x559519963de0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9da1c3c257f18af5 server_cookie=2d7d017d1de61717 in_seq=0 out_seq=0 2023-10-06T23:21:47.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.180+0000 7f6326ffd700 10 client.26272 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.182+0000 7f6326ffd700 1 -- 172.21.15.8:0/12179206 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559519886ad0 con 0x5595199619c0 2023-10-06T23:21:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.182+0000 7f6326ffd700 10 client.26272 handle_command_reply: tid=0 2023-10-06T23:21:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.182+0000 7f6361a51b80 1 client.26272 shutdown 2023-10-06T23:21:47.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.182+0000 7f6361a51b80 1 -- 172.21.15.8:0/12179206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 msgr2=0x55951994c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.182+0000 7f6361a51b80 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994c110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f63400ca000 tx=0x7f6340099300 comp rx=0 tx=0).stop 2023-10-06T23:21:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.183+0000 7f6361a51b80 1 -- 172.21.15.8:0/12179206 shutdown_connections 2023-10-06T23:21:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.183+0000 7f6361a51b80 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5595199619c0 0x559519963de0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.183+0000 7f6361a51b80 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994c110 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.183+0000 7f6361a51b80 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x559519944b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.183+0000 7f6361a51b80 1 --2- 172.21.15.8:0/12179206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 0x5595199450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.183+0000 7f6361a51b80 1 -- 172.21.15.8:0/12179206 >> 172.21.15.8:0/12179206 conn(0x5595198af200 msgr2=0x559519935250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.183+0000 7f6326ffd700 0 client.26272 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.184+0000 7f6361a51b80 1 -- 172.21.15.8:0/12179206 shutdown_connections 2023-10-06T23:21:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.184+0000 7f6361a51b80 1 -- 172.21.15.8:0/12179206 wait complete. 2023-10-06T23:21:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.184+0000 7f6361a51b80 20 client.26272 trim_cache size 0 max 16384 2023-10-06T23:21:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.213+0000 7f6361a51b80 1 Processor -- start 2023-10-06T23:21:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.213+0000 7f6361a51b80 1 -- start start 2023-10-06T23:21:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.213+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x55951993c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.213+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 0x55951994c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.213+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951993fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.213+0000 7f6361a51b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951970e8c0 con 0x55951993b7d0 2023-10-06T23:21:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.213+0000 7f6361a51b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559519944040 con 0x55951993ae70 2023-10-06T23:21:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.213+0000 7f6361a51b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559519944730 con 0x55951993c5b0 2023-10-06T23:21:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6347fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951993fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6347fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951993fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54606/0 (socket says 172.21.15.8:54606) 2023-10-06T23:21:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6347fff700 1 -- 172.21.15.8:0/157328489 learned_addr learned my addr 172.21.15.8:0/157328489 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6346ffd700 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 0x55951994c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f63477fe700 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x55951993c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6347fff700 1 -- 172.21.15.8:0/157328489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 msgr2=0x55951993c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6347fff700 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x55951993c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6347fff700 1 -- 172.21.15.8:0/157328489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 msgr2=0x55951994c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6347fff700 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 0x55951994c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.214+0000 7f6347fff700 1 -- 172.21.15.8:0/157328489 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595196df1f0 con 0x55951993c5b0 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.215+0000 7f6347fff700 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951993fa80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63400a1680 tx=0x7f63400999f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b3736d45f32bac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.215+0000 7f632e7fc700 1 -- 172.21.15.8:0/157328489 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400a1bb0 con 0x55951993c5b0 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.215+0000 7f632e7fc700 1 -- 172.21.15.8:0/157328489 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f634009da00 con 0x55951993c5b0 2023-10-06T23:21:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.215+0000 7f632e7fc700 1 -- 172.21.15.8:0/157328489 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634009ae00 con 0x55951993c5b0 2023-10-06T23:21:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 -- 172.21.15.8:0/157328489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 msgr2=0x55951993fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951993fa80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63400a1680 tx=0x7f63400999f0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 -- 172.21.15.8:0/157328489 shutdown_connections 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951993fa80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993ae70 0x55951993c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 --2- 172.21.15.8:0/157328489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993b7d0 0x55951994c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 -- 172.21.15.8:0/157328489 >> 172.21.15.8:0/157328489 conn(0x5595198af200 msgr2=0x5595199639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 -- 172.21.15.8:0/157328489 shutdown_connections 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.216+0000 7f6361a51b80 1 -- 172.21.15.8:0/157328489 wait complete. 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.217+0000 7f6361a51b80 1 -- start start 2023-10-06T23:21:47.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.217+0000 7f6361a51b80 1 Processor -- start 2023-10-06T23:21:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.218+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x559519947310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.218+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993b7d0 0x559519947850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.218+0000 7f6361a51b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.218+0000 7f6361a51b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951994adb0 con 0x55951993ae70 2023-10-06T23:21:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.218+0000 7f6361a51b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951994af20 con 0x55951993b7d0 2023-10-06T23:21:47.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.218+0000 7f6361a51b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55951994b0e0 con 0x55951993c5b0 2023-10-06T23:21:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.218+0000 7f6361a51b80 10 client.0 _ll_register_callbacks cb 0x7f6340099710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6347fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6347fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54610/0 (socket says 172.21.15.8:54610) 2023-10-06T23:21:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6347fff700 1 -- 172.21.15.8:0/2287605929 learned_addr learned my addr 172.21.15.8:0/2287605929 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6346ffd700 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993b7d0 0x559519947850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f63477fe700 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x559519947310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6347fff700 1 -- 172.21.15.8:0/2287605929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993b7d0 msgr2=0x559519947850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6347fff700 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993b7d0 0x559519947850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6347fff700 1 -- 172.21.15.8:0/2287605929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 msgr2=0x559519947310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6347fff700 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x559519947310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.219+0000 7f6347fff700 1 -- 172.21.15.8:0/2287605929 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595196a1c00 con 0x55951993c5b0 2023-10-06T23:21:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.220+0000 7f6347fff700 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994a870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6340016040 tx=0x7f634009a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa82b8754e314590 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.220+0000 7f6326ffd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:21:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.220+0000 7f6326ffd700 1 -- 172.21.15.8:0/2287605929 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634009ade0 con 0x55951993c5b0 2023-10-06T23:21:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.220+0000 7f6326ffd700 1 -- 172.21.15.8:0/2287605929 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f63400a1bb0 con 0x55951993c5b0 2023-10-06T23:21:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.220+0000 7f6361a51b80 1 -- 172.21.15.8:0/2287605929 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55951992dd50 con 0x55951993c5b0 2023-10-06T23:21:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6326ffd700 1 -- 172.21.15.8:0/2287605929 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63400cc0d0 con 0x55951993c5b0 2023-10-06T23:21:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6361a51b80 10 client.26278 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6361a51b80 1 -- 172.21.15.8:0/2287605929 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5595196b7250 con 0x55951993c5b0 2023-10-06T23:21:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6326ffd700 1 -- 172.21.15.8:0/2287605929 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55951992dd50 con 0x55951993c5b0 2023-10-06T23:21:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6326ffd700 1 -- 172.21.15.8:0/2287605929 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f63400840e0 con 0x55951993c5b0 2023-10-06T23:21:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6361a51b80 10 client.26278 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6361a51b80 10 client.26278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6361a51b80 20 client.26278 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.221+0000 7f6361a51b80 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5595199b5800 0x5595199b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.222+0000 7f6361a51b80 4 client.26278 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:21:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.222+0000 7f6361a51b80 1 -- 172.21.15.8:0/2287605929 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5595196d9f10 con 0x5595199b5800 2023-10-06T23:21:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.222+0000 7f63477fe700 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5595199b5800 0x5595199b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.223+0000 7f63477fe700 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5595199b5800 0x5595199b7bf0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b84dc1a41093afa5 server_cookie=3f67f310056e789c in_seq=0 out_seq=0 2023-10-06T23:21:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.223+0000 7f6326ffd700 10 client.26278 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.239+0000 7f6326ffd700 1 -- 172.21.15.8:0/2287605929 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5595196d9f10 con 0x5595199b5800 2023-10-06T23:21:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.239+0000 7f6326ffd700 10 client.26278 handle_command_reply: tid=0 2023-10-06T23:21:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.239+0000 7f6361a51b80 1 client.26278 shutdown 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 -- 172.21.15.8:0/2287605929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 msgr2=0x55951994a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994a870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6340016040 tx=0x7f634009a060 comp rx=0 tx=0).stop 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 -- 172.21.15.8:0/2287605929 shutdown_connections 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5595199b5800 0x5595199b7bf0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55951993ae70 0x559519947310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6326ffd700 0 client.26278 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55951993c5b0 0x55951994a870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 --2- 172.21.15.8:0/2287605929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55951993b7d0 0x559519947850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 -- 172.21.15.8:0/2287605929 >> 172.21.15.8:0/2287605929 conn(0x5595198af200 msgr2=0x55951993fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 -- 172.21.15.8:0/2287605929 shutdown_connections 2023-10-06T23:21:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 1 -- 172.21.15.8:0/2287605929 wait complete. 2023-10-06T23:21:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.240+0000 7f6361a51b80 20 client.26278 trim_cache size 0 max 16384 2023-10-06T23:21:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:21:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:21:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:21:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:21:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 -- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f63300a1580 msgr2=0x7f63300a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f63300a1580 0x7f63300a3a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f633c006010 tx=0x7f633c00b260 comp rx=0 tx=0).stop 2023-10-06T23:21:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 -- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6348106bd0 msgr2=0x7f6348197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6348106bd0 0x7f6348197f60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f634000ef30 tx=0x7f634000c3a0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 -- 172.21.15.8:0/1432152793 shutdown_connections 2023-10-06T23:21:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f63300a1580 0x7f63300a3a40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6348106bd0 0x7f6348197f60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6348101970 0x7f6348196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 --2- 172.21.15.8:0/1432152793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f63481042a0 0x7f63481970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.241+0000 7f634e1ff700 1 -- 172.21.15.8:0/1432152793 >> 172.21.15.8:0/1432152793 conn(0x7f63480fb340 msgr2=0x7f63481025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.242+0000 7f634e1ff700 1 -- 172.21.15.8:0/1432152793 shutdown_connections 2023-10-06T23:21:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:21:47.242+0000 7f634e1ff700 1 -- 172.21.15.8:0/1432152793 wait complete. 2023-10-06T23:21:47.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:47 smithi156 ceph-mon[102862]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 6.9 MiB/s wr, 593 op/s 2023-10-06T23:21:47.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:47 smithi008 ceph-mon[98532]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 6.9 MiB/s wr, 593 op/s 2023-10-06T23:21:47.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:47 smithi190 ceph-mon[102658]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 6.9 MiB/s wr, 593 op/s 2023-10-06T23:21:48.251 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:21:48.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.543+0000 7fc523dff700 1 -- 172.21.15.8:0/939323117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c106c60 msgr2=0x7fc51c109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.543+0000 7fc523dff700 1 --2- 172.21.15.8:0/939323117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c106c60 0x7fc51c109050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc514009f90 tx=0x7fc51400b330 comp rx=0 tx=0).stop 2023-10-06T23:21:48.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.544+0000 7fc523dff700 1 -- 172.21.15.8:0/939323117 shutdown_connections 2023-10-06T23:21:48.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.544+0000 7fc523dff700 1 --2- 172.21.15.8:0/939323117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c106c60 0x7fc51c109050 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.544+0000 7fc523dff700 1 --2- 172.21.15.8:0/939323117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc51c101a00 0x7fc51c103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.544+0000 7fc523dff700 1 --2- 172.21.15.8:0/939323117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc51c104330 0x7fc51c106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.544+0000 7fc523dff700 1 -- 172.21.15.8:0/939323117 >> 172.21.15.8:0/939323117 conn(0x7fc51c0fb330 msgr2=0x7fc51c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:48.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.544+0000 7fc523dff700 1 -- 172.21.15.8:0/939323117 shutdown_connections 2023-10-06T23:21:48.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.544+0000 7fc523dff700 1 -- 172.21.15.8:0/939323117 wait complete. 2023-10-06T23:21:48.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.545+0000 7fc523dff700 1 Processor -- start 2023-10-06T23:21:48.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.546+0000 7fc523dff700 1 -- start start 2023-10-06T23:21:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.546+0000 7fc523dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc51c101a00 0x7fc51c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.546+0000 7fc523dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c104330 0x7fc51c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.546+0000 7fc523dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc51c106c60 0x7fc51c1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.546+0000 7fc523dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1a0950 con 0x7fc51c101a00 2023-10-06T23:21:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.546+0000 7fc523dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1a0a90 con 0x7fc51c104330 2023-10-06T23:21:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.546+0000 7fc523dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1a0c20 con 0x7fc51c106c60 2023-10-06T23:21:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52139a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c104330 0x7fc51c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52139a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c104330 0x7fc51c199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37732/0 (socket says 172.21.15.8:37732) 2023-10-06T23:21:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52239c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc51c106c60 0x7fc51c1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52139a700 1 -- 172.21.15.8:0/2002305086 learned_addr learned my addr 172.21.15.8:0/2002305086 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:48.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc521b9b700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc51c101a00 0x7fc51c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52239c700 1 -- 172.21.15.8:0/2002305086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c104330 msgr2=0x7fc51c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52239c700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c104330 0x7fc51c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52239c700 1 -- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc51c101a00 msgr2=0x7fc51c198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52239c700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc51c101a00 0x7fc51c198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.547+0000 7fc52239c700 1 -- 172.21.15.8:0/2002305086 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180095f0 con 0x7fc51c106c60 2023-10-06T23:21:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.548+0000 7fc52239c700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc51c106c60 0x7fc51c1a0380 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc51400b6c0 tx=0x7fc514004f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.548+0000 7fc512ffd700 1 -- 172.21.15.8:0/2002305086 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400e040 con 0x7fc51c106c60 2023-10-06T23:21:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.548+0000 7fc512ffd700 1 -- 172.21.15.8:0/2002305086 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc51400bc00 con 0x7fc51c106c60 2023-10-06T23:21:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.548+0000 7fc512ffd700 1 -- 172.21.15.8:0/2002305086 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514005040 con 0x7fc51c106c60 2023-10-06T23:21:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.548+0000 7fc523dff700 1 -- 172.21.15.8:0/2002305086 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c009520 con 0x7fc51c106c60 2023-10-06T23:21:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.548+0000 7fc523dff700 1 -- 172.21.15.8:0/2002305086 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc514009c40 con 0x7fc51c106c60 2023-10-06T23:21:48.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.553+0000 7fc512ffd700 1 -- 172.21.15.8:0/2002305086 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc51401d470 con 0x7fc51c106c60 2023-10-06T23:21:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.555+0000 7fc512ffd700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5080a1500 0x7fc5080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.555+0000 7fc53778fb80 1 Processor -- start 2023-10-06T23:21:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.555+0000 7fc512ffd700 1 -- 172.21.15.8:0/2002305086 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc5140ce080 con 0x7fc51c106c60 2023-10-06T23:21:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.556+0000 7fc521b9b700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5080a1500 0x7fc5080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.556+0000 7fc53778fb80 1 -- start start 2023-10-06T23:21:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc521b9b700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5080a1500 0x7fc5080a39c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc518005fd0 tx=0x7fc518009310 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a7ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7d3d0 0x55fe54a7dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7e270 0x55fe54a7e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc53778fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe549dc460 con 0x55fe54a7e270 2023-10-06T23:21:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc53778fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe549cdc20 con 0x55fe54a7d3d0 2023-10-06T23:21:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc53778fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe549cb540 con 0x55fe54a7ca70 2023-10-06T23:21:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc52239c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7e270 0x55fe54a7e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc52139a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7d3d0 0x55fe54a7dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc52239c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7e270 0x55fe54a7e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45386/0 (socket says 172.21.15.8:45386) 2023-10-06T23:21:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc52239c700 1 -- 172.21.15.8:0/1056350235 learned_addr learned my addr 172.21.15.8:0/1056350235 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.557+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a7ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.558+0000 7fc521b9b700 1 -- 172.21.15.8:0/1056350235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7d3d0 msgr2=0x55fe54a7dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:48.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.558+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7d3d0 0x55fe54a7dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.558+0000 7fc521b9b700 1 -- 172.21.15.8:0/1056350235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7e270 msgr2=0x55fe54a7e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:48.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.558+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7e270 0x55fe54a7e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.558+0000 7fc521b9b700 1 -- 172.21.15.8:0/1056350235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe547f1de0 con 0x55fe54a7ca70 2023-10-06T23:21:48.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.558+0000 7fc52239c700 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7e270 0x55fe54a7e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:21:48.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.558+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a7ce90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc51800e5a0 tx=0x7fc518014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9997882cf07e8b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:48.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.558+0000 7fc507fff700 1 -- 172.21.15.8:0/1056350235 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800ed20 con 0x55fe54a7ca70 2023-10-06T23:21:48.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.559+0000 7fc507fff700 1 -- 172.21.15.8:0/1056350235 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc518021070 con 0x55fe54a7ca70 2023-10-06T23:21:48.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.559+0000 7fc507fff700 1 -- 172.21.15.8:0/1056350235 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51801d670 con 0x55fe54a7ca70 2023-10-06T23:21:48.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.559+0000 7fc53778fb80 1 -- 172.21.15.8:0/1056350235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 msgr2=0x55fe54a7ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.559+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a7ce90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc51800e5a0 tx=0x7fc518014000 comp rx=0 tx=0).stop 2023-10-06T23:21:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.560+0000 7fc53778fb80 1 -- 172.21.15.8:0/1056350235 shutdown_connections 2023-10-06T23:21:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.560+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7e270 0x55fe54a7e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.560+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a7ce90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.560+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1056350235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7d3d0 0x55fe54a7dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.560+0000 7fc53778fb80 1 -- 172.21.15.8:0/1056350235 >> 172.21.15.8:0/1056350235 conn(0x55fe549e8260 msgr2=0x55fe54a6f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.560+0000 7fc53778fb80 1 -- 172.21.15.8:0/1056350235 shutdown_connections 2023-10-06T23:21:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.560+0000 7fc53778fb80 1 -- 172.21.15.8:0/1056350235 wait complete. 2023-10-06T23:21:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.560+0000 7fc53778fb80 1 -- start start 2023-10-06T23:21:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.561+0000 7fc53778fb80 1 Processor -- start 2023-10-06T23:21:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.561+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a86890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.561+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a86dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.561+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 0x55fe54a8de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.561+0000 7fc53778fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe549c6e30 con 0x55fe54a7d3d0 2023-10-06T23:21:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.561+0000 7fc53778fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe54963710 con 0x55fe54a7ca70 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.561+0000 7fc53778fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe549633b0 con 0x55fe54a7e270 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc53778fb80 10 client.0 _ll_register_callbacks cb 0x55fe547c0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc521b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a86890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc521b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a86890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37742/0 (socket says 172.21.15.8:37742) 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc521b9b700 1 -- 172.21.15.8:0/4058631256 learned_addr learned my addr 172.21.15.8:0/4058631256 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc52239c700 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 0x55fe54a8de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc52139a700 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a86dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc521b9b700 1 -- 172.21.15.8:0/4058631256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 msgr2=0x55fe54a8de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc521b9b700 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 0x55fe54a8de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc521b9b700 1 -- 172.21.15.8:0/4058631256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 msgr2=0x55fe54a86dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc521b9b700 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a86dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.562+0000 7fc521b9b700 1 -- 172.21.15.8:0/4058631256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc514009c40 con 0x55fe54a7ca70 2023-10-06T23:21:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.563+0000 7fc521b9b700 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a86890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc518009860 tx=0x7fc51800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c135773d357c054e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.563+0000 7fc5057fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:21:48.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.563+0000 7fc5057fa700 1 -- 172.21.15.8:0/4058631256 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800ee00 con 0x55fe54a7ca70 2023-10-06T23:21:48.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.563+0000 7fc5057fa700 1 -- 172.21.15.8:0/4058631256 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc518005250 con 0x55fe54a7ca70 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.563+0000 7fc53778fb80 1 -- 172.21.15.8:0/4058631256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe54a66f10 con 0x55fe54a7ca70 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.564+0000 7fc5057fa700 1 -- 172.21.15.8:0/4058631256 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc518005410 con 0x55fe54a7ca70 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.564+0000 7fc53778fb80 10 client.26270 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.564+0000 7fc53778fb80 1 -- 172.21.15.8:0/4058631256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7fc518017070 con 0x55fe54a7ca70 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.564+0000 7fc5057fa700 1 -- 172.21.15.8:0/4058631256 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fe54a66f10 con 0x55fe54a7ca70 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.565+0000 7fc5057fa700 1 -- 172.21.15.8:0/4058631256 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc5180048e0 con 0x55fe54a7ca70 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.565+0000 7fc53778fb80 10 client.26270 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.565+0000 7fc53778fb80 10 client.26270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.565+0000 7fc53778fb80 20 client.26270 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.565+0000 7fc53778fb80 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe54a92550 0x55fe54a94970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.565+0000 7fc53778fb80 4 client.26270 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:21:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.565+0000 7fc53778fb80 1 -- 172.21.15.8:0/4058631256 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe549bfe10 con 0x55fe54a92550 2023-10-06T23:21:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.565+0000 7fc52139a700 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe54a92550 0x55fe54a94970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.566+0000 7fc52139a700 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe54a92550 0x55fe54a94970 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff94d79b0b5e3a8 server_cookie=57d83e5d0c6cfe96 in_seq=0 out_seq=0 2023-10-06T23:21:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.566+0000 7fc5057fa700 10 client.26270 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.567+0000 7fc5057fa700 1 -- 172.21.15.8:0/4058631256 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fe549bfe10 con 0x55fe54a92550 2023-10-06T23:21:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.567+0000 7fc5057fa700 10 client.26270 handle_command_reply: tid=0 2023-10-06T23:21:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.567+0000 7fc53778fb80 1 client.26270 shutdown 2023-10-06T23:21:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 -- 172.21.15.8:0/4058631256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 msgr2=0x55fe54a86890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a86890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc518009860 tx=0x7fc51800eb20 comp rx=0 tx=0).stop 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 -- 172.21.15.8:0/4058631256 shutdown_connections 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe54a92550 0x55fe54a94970 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 0x55fe54a8de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a86890 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc5057fa700 0 client.26270 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 --2- 172.21.15.8:0/4058631256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a86dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 -- 172.21.15.8:0/4058631256 >> 172.21.15.8:0/4058631256 conn(0x55fe549e8260 msgr2=0x55fe54a6ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 -- 172.21.15.8:0/4058631256 shutdown_connections 2023-10-06T23:21:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 1 -- 172.21.15.8:0/4058631256 wait complete. 2023-10-06T23:21:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.568+0000 7fc53778fb80 20 client.26270 trim_cache size 0 max 16384 2023-10-06T23:21:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.592+0000 7fc53778fb80 1 Processor -- start 2023-10-06T23:21:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.592+0000 7fc53778fb80 1 -- start start 2023-10-06T23:21:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a6dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 0x55fe54a81180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc53778fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe54847920 con 0x55fe54a7d3d0 2023-10-06T23:21:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc53778fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe54a69570 con 0x55fe54a7ca70 2023-10-06T23:21:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc53778fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe54a84480 con 0x55fe54a7e270 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc52139a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc521b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a6dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc521b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a6dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:37746/0 (socket says 172.21.15.8:37746) 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc52139a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45412/0 (socket says 172.21.15.8:45412) 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc521b9b700 1 -- 172.21.15.8:0/1800216424 learned_addr learned my addr 172.21.15.8:0/1800216424 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.593+0000 7fc52239c700 1 --2- 172.21.15.8:0/1800216424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 0x55fe54a81180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc521b9b700 1 -- 172.21.15.8:0/1800216424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 msgr2=0x55fe54a81180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1800216424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 0x55fe54a81180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc521b9b700 1 -- 172.21.15.8:0/1800216424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 msgr2=0x55fe54a8ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1800216424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc521b9b700 1 -- 172.21.15.8:0/1800216424 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe547dac60 con 0x55fe54a7ca70 2023-10-06T23:21:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1800216424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a6dbc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc518016040 tx=0x7fc51801cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=672d6a6210929868 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc510bff700 1 -- 172.21.15.8:0/1800216424 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800ec40 con 0x55fe54a7ca70 2023-10-06T23:21:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc510bff700 1 -- 172.21.15.8:0/1800216424 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc51800eda0 con 0x55fe54a7ca70 2023-10-06T23:21:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.594+0000 7fc510bff700 1 -- 172.21.15.8:0/1800216424 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51801c410 con 0x55fe54a7ca70 2023-10-06T23:21:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.595+0000 7fc53778fb80 1 -- 172.21.15.8:0/1800216424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 msgr2=0x55fe54a6dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.595+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1800216424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a6dbc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc518016040 tx=0x7fc51801cdd0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.595+0000 7fc53778fb80 1 -- 172.21.15.8:0/1800216424 shutdown_connections 2023-10-06T23:21:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.595+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1800216424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7e270 0x55fe54a81180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.595+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1800216424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7ca70 0x55fe54a6dbc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.595+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1800216424 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.595+0000 7fc53778fb80 1 -- 172.21.15.8:0/1800216424 >> 172.21.15.8:0/1800216424 conn(0x55fe549e8260 msgr2=0x55fe54a85530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.596+0000 7fc53778fb80 1 -- 172.21.15.8:0/1800216424 shutdown_connections 2023-10-06T23:21:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.596+0000 7fc53778fb80 1 -- 172.21.15.8:0/1800216424 wait complete. 2023-10-06T23:21:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.596+0000 7fc53778fb80 1 -- start start 2023-10-06T23:21:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.596+0000 7fc53778fb80 1 Processor -- start 2023-10-06T23:21:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.597+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a8d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.597+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.597+0000 7fc53778fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7e270 0x55fe54a8a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.597+0000 7fc53778fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe54a8a6e0 con 0x55fe54a7d3d0 2023-10-06T23:21:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.597+0000 7fc53778fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe54a8a850 con 0x55fe54a7e270 2023-10-06T23:21:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.597+0000 7fc53778fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe54a8aa10 con 0x55fe54a7ca70 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.597+0000 7fc53778fb80 10 client.0 _ll_register_callbacks cb 0x7fc514097060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc52139a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc52139a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45424/0 (socket says 172.21.15.8:45424) 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc52139a700 1 -- 172.21.15.8:0/1167540935 learned_addr learned my addr 172.21.15.8:0/1167540935 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc52239c700 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7e270 0x55fe54a8a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a8d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc52239c700 1 -- 172.21.15.8:0/1167540935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 msgr2=0x55fe54a8d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc52239c700 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a8d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc52239c700 1 -- 172.21.15.8:0/1167540935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 msgr2=0x55fe54a8dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.598+0000 7fc52239c700 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.599+0000 7fc52239c700 1 -- 172.21.15.8:0/1167540935 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc518017070 con 0x55fe54a7e270 2023-10-06T23:21:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.599+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a8d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:21:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.599+0000 7fc52239c700 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7e270 0x55fe54a8a160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55fe54a7da50 tx=0x7fc51400bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9639694acdae37d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:21:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.599+0000 7fc5057fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:21:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.600+0000 7fc5057fa700 1 -- 172.21.15.8:0/1167540935 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5140b0060 con 0x55fe54a7e270 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.600+0000 7fc5057fa700 1 -- 172.21.15.8:0/1167540935 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc51409bae0 con 0x55fe54a7e270 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.600+0000 7fc53778fb80 1 -- 172.21.15.8:0/1167540935 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc518021070 con 0x55fe54a7e270 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.600+0000 7fc5057fa700 1 -- 172.21.15.8:0/1167540935 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5140673b0 con 0x55fe54a7e270 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.600+0000 7fc53778fb80 10 client.26276 fetch_fsmap learned FSMap version 37 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.600+0000 7fc53778fb80 1 -- 172.21.15.8:0/1167540935 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55fe54818250 con 0x55fe54a7e270 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.600+0000 7fc5057fa700 1 -- 172.21.15.8:0/1167540935 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc518021070 con 0x55fe54a7e270 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.601+0000 7fc5057fa700 1 -- 172.21.15.8:0/1167540935 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc51409f150 con 0x55fe54a7e270 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.601+0000 7fc53778fb80 10 client.26276 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.601+0000 7fc53778fb80 10 client.26276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.601+0000 7fc53778fb80 20 client.26276 populate_metadata read hostname 'smithi008' 2023-10-06T23:21:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.601+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe54ae76c0 0x55fe54ae9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.601+0000 7fc53778fb80 4 client.26276 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.601+0000 7fc53778fb80 1 -- 172.21.15.8:0/1167540935 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fe549bfb30 con 0x55fe54ae76c0 2023-10-06T23:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.601+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe54ae76c0 0x55fe54ae9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.602+0000 7fc521b9b700 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe54ae76c0 0x55fe54ae9ae0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b072940fa309a5a server_cookie=787def13c5c01b9f in_seq=0 out_seq=0 2023-10-06T23:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.602+0000 7fc5057fa700 10 client.26276 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.602+0000 7fc5057fa700 1 -- 172.21.15.8:0/1167540935 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55fe549bfb30 con 0x55fe54ae76c0 2023-10-06T23:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.602+0000 7fc5057fa700 10 client.26276 handle_command_reply: tid=0 2023-10-06T23:21:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.602+0000 7fc53778fb80 1 client.26276 shutdown 2023-10-06T23:21:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 -- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7e270 msgr2=0x55fe54a8a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7e270 0x55fe54a8a160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55fe54a7da50 tx=0x7fc51400bf50 comp rx=0 tx=0).stop 2023-10-06T23:21:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 -- 172.21.15.8:0/1167540935 shutdown_connections 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe54ae76c0 0x55fe54ae9ae0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe54a7e270 0x55fe54a8a160 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe54a7ca70 0x55fe54a8d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 --2- 172.21.15.8:0/1167540935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe54a7d3d0 0x55fe54a8dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 -- 172.21.15.8:0/1167540935 >> 172.21.15.8:0/1167540935 conn(0x55fe549e8260 msgr2=0x55fe54a6dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc5057fa700 0 client.26276 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 -- 172.21.15.8:0/1167540935 shutdown_connections 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.603+0000 7fc53778fb80 1 -- 172.21.15.8:0/1167540935 wait complete. 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.604+0000 7fc53778fb80 20 client.26276 trim_cache size 0 max 16384 2023-10-06T23:21:48.607 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:21:48.608 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:21:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.604+0000 7fc523dff700 1 -- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5080a1500 msgr2=0x7fc5080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.604+0000 7fc523dff700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5080a1500 0x7fc5080a39c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc518005fd0 tx=0x7fc518009310 comp rx=0 tx=0).stop 2023-10-06T23:21:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.604+0000 7fc523dff700 1 -- 172.21.15.8:0/2002305086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc51c106c60 msgr2=0x7fc51c1a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:21:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.604+0000 7fc523dff700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc51c106c60 0x7fc51c1a0380 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc51400b6c0 tx=0x7fc514004f90 comp rx=0 tx=0).stop 2023-10-06T23:21:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.605+0000 7fc523dff700 1 -- 172.21.15.8:0/2002305086 shutdown_connections 2023-10-06T23:21:48.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.605+0000 7fc523dff700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5080a1500 0x7fc5080a39c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.605+0000 7fc523dff700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc51c101a00 0x7fc51c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.605+0000 7fc523dff700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc51c106c60 0x7fc51c1a0380 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.605+0000 7fc523dff700 1 --2- 172.21.15.8:0/2002305086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc51c104330 0x7fc51c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:21:48.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.605+0000 7fc523dff700 1 -- 172.21.15.8:0/2002305086 >> 172.21.15.8:0/2002305086 conn(0x7fc51c0fb330 msgr2=0x7fc51c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:21:48.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.605+0000 7fc523dff700 1 -- 172.21.15.8:0/2002305086 shutdown_connections 2023-10-06T23:21:48.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:21:48.605+0000 7fc523dff700 1 -- 172.21.15.8:0/2002305086 wait complete. 2023-10-06T23:21:48.634 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:21:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 415.0 s, 260.2 tps, lat 373.170 ms stddev 57.358 2023-10-06T23:21:49.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:49 smithi156 ceph-mon[102862]: pgmap v619: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2023-10-06T23:21:49.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:49 smithi008 ceph-mon[98532]: pgmap v619: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2023-10-06T23:21:49.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:49 smithi190 ceph-mon[102658]: pgmap v619: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2023-10-06T23:21:51.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:51 smithi156 ceph-mon[102862]: pgmap v620: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 6.4 MiB/s wr, 587 op/s 2023-10-06T23:21:51.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:51 smithi008 ceph-mon[98532]: pgmap v620: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 6.4 MiB/s wr, 587 op/s 2023-10-06T23:21:51.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:51 smithi190 ceph-mon[102658]: pgmap v620: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 6.4 MiB/s wr, 587 op/s 2023-10-06T23:21:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:53 smithi190 ceph-mon[102658]: pgmap v621: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 6.5 MiB/s wr, 560 op/s 2023-10-06T23:21:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:53 smithi156 ceph-mon[102862]: pgmap v621: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 6.5 MiB/s wr, 560 op/s 2023-10-06T23:21:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:53 smithi008 ceph-mon[98532]: pgmap v621: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 6.5 MiB/s wr, 560 op/s 2023-10-06T23:21:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 420.0 s, 252.6 tps, lat 408.299 ms stddev 259.312 2023-10-06T23:21:55.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:55 smithi156 ceph-mon[102862]: pgmap v622: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 6.7 MiB/s wr, 591 op/s 2023-10-06T23:21:55.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:55 smithi008 ceph-mon[98532]: pgmap v622: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 6.7 MiB/s wr, 591 op/s 2023-10-06T23:21:55.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:55 smithi190 ceph-mon[102658]: pgmap v622: 97 pgs: 97 active+clean; 1.5 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 6.7 MiB/s wr, 591 op/s 2023-10-06T23:21:57.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:57 smithi156 ceph-mon[102862]: pgmap v623: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 7.3 MiB/s wr, 615 op/s 2023-10-06T23:21:57.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:57 smithi008 ceph-mon[98532]: pgmap v623: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 7.3 MiB/s wr, 615 op/s 2023-10-06T23:21:57.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:57 smithi190 ceph-mon[102658]: pgmap v623: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 7.3 MiB/s wr, 615 op/s 2023-10-06T23:21:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 425.0 s, 235.0 tps, lat 422.508 ms stddev 147.378 2023-10-06T23:21:59.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:21:59 smithi156 ceph-mon[102862]: pgmap v624: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 5.8 MiB/s wr, 502 op/s 2023-10-06T23:21:59.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:21:59 smithi008 ceph-mon[98532]: pgmap v624: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 5.8 MiB/s wr, 502 op/s 2023-10-06T23:21:59.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:21:59 smithi190 ceph-mon[102658]: pgmap v624: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 5.8 MiB/s wr, 502 op/s 2023-10-06T23:22:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 -- 172.21.15.8:0/1848458842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600102060 msgr2=0x7fc6001024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 --2- 172.21.15.8:0/1848458842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600102060 0x7fc6001024e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009990 tx=0x7fc5ec009ca0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 -- 172.21.15.8:0/1848458842 shutdown_connections 2023-10-06T23:22:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 --2- 172.21.15.8:0/1848458842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc600102a20 0x7fc600109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 --2- 172.21.15.8:0/1848458842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc600100f10 0x7fc600101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 --2- 172.21.15.8:0/1848458842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600102060 0x7fc6001024e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 -- 172.21.15.8:0/1848458842 >> 172.21.15.8:0/1848458842 conn(0x7fc6000fc460 msgr2=0x7fc6000fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 -- 172.21.15.8:0/1848458842 shutdown_connections 2023-10-06T23:22:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.470+0000 7fc6071ff700 1 -- 172.21.15.8:0/1848458842 wait complete. 2023-10-06T23:22:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.472+0000 7fc6071ff700 1 Processor -- start 2023-10-06T23:22:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.472+0000 7fc6071ff700 1 -- start start 2023-10-06T23:22:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.472+0000 7fc6071ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600100f10 0x7fc600198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.472+0000 7fc6071ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc600102060 0x7fc600199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.472+0000 7fc6071ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc600102a20 0x7fc60019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.472+0000 7fc6071ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60019a8e0 con 0x7fc600102a20 2023-10-06T23:22:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.472+0000 7fc6071ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60019aa50 con 0x7fc600100f10 2023-10-06T23:22:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.472+0000 7fc6071ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60019ac10 con 0x7fc600102060 2023-10-06T23:22:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600100f10 0x7fc600198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600100f10 0x7fc600198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43162/0 (socket says 172.21.15.8:43162) 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc604f9b700 1 -- 172.21.15.8:0/3450688510 learned_addr learned my addr 172.21.15.8:0/3450688510 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc60579c700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc600102a20 0x7fc60019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc5fffff700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc600102060 0x7fc600199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc604f9b700 1 -- 172.21.15.8:0/3450688510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc600102060 msgr2=0x7fc600199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc604f9b700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc600102060 0x7fc600199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc604f9b700 1 -- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc600102a20 msgr2=0x7fc60019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc604f9b700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc600102a20 0x7fc60019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc604f9b700 1 -- 172.21.15.8:0/3450688510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009c40 con 0x7fc600100f10 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.473+0000 7fc60579c700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc600102a20 0x7fc60019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.474+0000 7fc604f9b700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600100f10 0x7fc600198ef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400e9a0 tx=0x7fc5f400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.474+0000 7fc5fdffb700 1 -- 172.21.15.8:0/3450688510 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4009790 con 0x7fc600100f10 2023-10-06T23:22:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.474+0000 7fc6071ff700 1 -- 172.21.15.8:0/3450688510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ec0095f0 con 0x7fc600100f10 2023-10-06T23:22:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.474+0000 7fc5fdffb700 1 -- 172.21.15.8:0/3450688510 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5f400cbd0 con 0x7fc600100f10 2023-10-06T23:22:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.474+0000 7fc5fdffb700 1 -- 172.21.15.8:0/3450688510 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4018680 con 0x7fc600100f10 2023-10-06T23:22:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.474+0000 7fc6071ff700 1 -- 172.21.15.8:0/3450688510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6001a1600 con 0x7fc600100f10 2023-10-06T23:22:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.478+0000 7fc5fdffb700 1 -- 172.21.15.8:0/3450688510 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc5f400cd40 con 0x7fc600100f10 2023-10-06T23:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.480+0000 7fc61aaabb80 1 Processor -- start 2023-10-06T23:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.480+0000 7fc61aaabb80 1 -- start start 2023-10-06T23:22:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.480+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56deb6d0 0x55eb56debaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.480+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56dec7e0 0x55eb56decc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56df3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56d4b400 con 0x55eb56deb6d0 2023-10-06T23:22:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56d3cbc0 con 0x55eb56dec7e0 2023-10-06T23:22:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56d3a4e0 con 0x55eb56ded1a0 2023-10-06T23:22:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56dec7e0 0x55eb56decc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc60579c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56deb6d0 0x55eb56debaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc60579c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56deb6d0 0x55eb56debaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58470/0 (socket says 172.21.15.8:58470) 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc60579c700 1 -- 172.21.15.8:0/2394930378 learned_addr learned my addr 172.21.15.8:0/2394930378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc5fffff700 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56df3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.481+0000 7fc5fdffb700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5f00a1480 0x7fc5f00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc604f9b700 1 -- 172.21.15.8:0/2394930378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 msgr2=0x55eb56df3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc604f9b700 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56df3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc604f9b700 1 -- 172.21.15.8:0/2394930378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56deb6d0 msgr2=0x55eb56debaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc604f9b700 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56deb6d0 0x55eb56debaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc604f9b700 1 -- 172.21.15.8:0/2394930378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb56b60d80 con 0x55eb56dec7e0 2023-10-06T23:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc5fdffb700 1 -- 172.21.15.8:0/3450688510 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc5f4014070 con 0x7fc600100f10 2023-10-06T23:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc60579c700 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56deb6d0 0x55eb56debaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc60579c700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5f00a1480 0x7fc5f00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc604f9b700 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56dec7e0 0x55eb56decc60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40caad0 tx=0x7fc5f400efa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6b6714accb93b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc5eaffd700 1 -- 172.21.15.8:0/2394930378 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4099e60 con 0x55eb56dec7e0 2023-10-06T23:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc5eaffd700 1 -- 172.21.15.8:0/2394930378 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5f4099c80 con 0x55eb56dec7e0 2023-10-06T23:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.482+0000 7fc5eaffd700 1 -- 172.21.15.8:0/2394930378 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40a26b0 con 0x55eb56dec7e0 2023-10-06T23:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2394930378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56dec7e0 msgr2=0x55eb56decc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56dec7e0 0x55eb56decc60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40caad0 tx=0x7fc5f400efa0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc60579c700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5f00a1480 0x7fc5f00a3940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009fd0 tx=0x7fc5f8009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2394930378 shutdown_connections 2023-10-06T23:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56deb6d0 0x55eb56debaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56df3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2394930378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56dec7e0 0x55eb56decc60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2394930378 >> 172.21.15.8:0/2394930378 conn(0x55eb56d57200 msgr2=0x55eb56dddbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2394930378 shutdown_connections 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.483+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2394930378 wait complete. 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.484+0000 7fc61aaabb80 1 -- start start 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.484+0000 7fc61aaabb80 1 Processor -- start 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56df5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 0x55eb56dfc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56d35dd0 con 0x55eb56dec7e0 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56cd26b0 con 0x55eb56ded1a0 2023-10-06T23:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56cd2350 con 0x55eb56deb6d0 2023-10-06T23:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc61aaabb80 10 client.0 _ll_register_callbacks cb 0x55eb56b2f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc5fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56df5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc60579c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 0x55eb56dfc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58716/0 (socket says 172.21.15.8:58716) 2023-10-06T23:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc5fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56df5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58486/0 (socket says 172.21.15.8:58486) 2023-10-06T23:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.485+0000 7fc604f9b700 1 -- 172.21.15.8:0/745841467 learned_addr learned my addr 172.21.15.8:0/745841467 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.486+0000 7fc604f9b700 1 -- 172.21.15.8:0/745841467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 msgr2=0x55eb56dfc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.486+0000 7fc604f9b700 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 0x55eb56dfc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.486+0000 7fc604f9b700 1 -- 172.21.15.8:0/745841467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 msgr2=0x55eb56df5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.486+0000 7fc604f9b700 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56df5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.486+0000 7fc604f9b700 1 -- 172.21.15.8:0/745841467 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6001a1600 con 0x55eb56deb6d0 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.486+0000 7fc5fffff700 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56df5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.486+0000 7fc604f9b700 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df52e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400c5b0 tx=0x7fc5f4054eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2065c61771c9ac2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.486+0000 7fc5dffff700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.487+0000 7fc5dffff700 1 -- 172.21.15.8:0/745841467 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f409aa20 con 0x55eb56deb6d0 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.487+0000 7fc61aaabb80 1 -- 172.21.15.8:0/745841467 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb56dd5d50 con 0x55eb56deb6d0 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.487+0000 7fc5dffff700 1 -- 172.21.15.8:0/745841467 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc5f40a26b0 con 0x55eb56deb6d0 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.487+0000 7fc5dffff700 1 -- 172.21.15.8:0/745841467 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5f409e070 con 0x55eb56deb6d0 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.487+0000 7fc61aaabb80 10 client.26308 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.487+0000 7fc61aaabb80 1 -- 172.21.15.8:0/745841467 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55eb56b49c00 con 0x55eb56deb6d0 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.487+0000 7fc5dffff700 1 -- 172.21.15.8:0/745841467 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eb56dd5d50 con 0x55eb56deb6d0 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.487+0000 7fc5dffff700 1 -- 172.21.15.8:0/745841467 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc5f40a2220 con 0x55eb56deb6d0 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.488+0000 7fc61aaabb80 10 client.26308 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.488+0000 7fc61aaabb80 10 client.26308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.488+0000 7fc61aaabb80 20 client.26308 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.488+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55eb56e00d20 0x55eb56e03140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.488+0000 7fc61aaabb80 4 client.26308 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:22:00.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.488+0000 7fc61aaabb80 1 -- 172.21.15.8:0/745841467 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb56d2edb0 con 0x55eb56e00d20 2023-10-06T23:22:00.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.488+0000 7fc5fffff700 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55eb56e00d20 0x55eb56e03140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.489+0000 7fc5dffff700 10 client.26308 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:00.493 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.489+0000 7fc5fffff700 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55eb56e00d20 0x55eb56e03140 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd512f29c49cef86 server_cookie=3383a223c006028c in_seq=0 out_seq=0 2023-10-06T23:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.490+0000 7fc5dffff700 1 -- 172.21.15.8:0/745841467 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eb56d2edb0 con 0x55eb56e00d20 2023-10-06T23:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.490+0000 7fc5dffff700 10 client.26308 handle_command_reply: tid=0 2023-10-06T23:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.490+0000 7fc61aaabb80 1 client.26308 shutdown 2023-10-06T23:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 -- 172.21.15.8:0/745841467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 msgr2=0x55eb56df52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df52e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400c5b0 tx=0x7fc5f4054eb0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 -- 172.21.15.8:0/745841467 shutdown_connections 2023-10-06T23:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55eb56e00d20 0x55eb56e03140 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 0x55eb56dfc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df52e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/745841467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56df5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 -- 172.21.15.8:0/745841467 >> 172.21.15.8:0/745841467 conn(0x55eb56d57200 msgr2=0x55eb56ddd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc5dffff700 0 client.26308 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 -- 172.21.15.8:0/745841467 shutdown_connections 2023-10-06T23:22:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.491+0000 7fc61aaabb80 1 -- 172.21.15.8:0/745841467 wait complete. 2023-10-06T23:22:00.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.492+0000 7fc61aaabb80 20 client.26308 trim_cache size 0 max 16384 2023-10-06T23:22:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.518+0000 7fc61aaabb80 1 Processor -- start 2023-10-06T23:22:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc61aaabb80 1 -- start start 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 0x55eb56ddd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56bb68c0 con 0x55eb56dec7e0 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56dec640 con 0x55eb56ded1a0 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56dd58c0 con 0x55eb56deb6d0 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc5fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc60579c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 0x55eb56ddd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58718/0 (socket says 172.21.15.8:58718) 2023-10-06T23:22:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.519+0000 7fc604f9b700 1 -- 172.21.15.8:0/3628633167 learned_addr learned my addr 172.21.15.8:0/3628633167 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.520+0000 7fc5fffff700 1 -- 172.21.15.8:0/3628633167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 msgr2=0x55eb56df3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.520+0000 7fc5fffff700 1 --2- 172.21.15.8:0/3628633167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.520+0000 7fc5fffff700 1 -- 172.21.15.8:0/3628633167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 msgr2=0x55eb56ddd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.520+0000 7fc5fffff700 1 --2- 172.21.15.8:0/3628633167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 0x55eb56ddd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.520+0000 7fc5fffff700 1 -- 172.21.15.8:0/3628633167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb56b871f0 con 0x55eb56dec7e0 2023-10-06T23:22:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.520+0000 7fc5fffff700 1 --2- 172.21.15.8:0/3628633167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfc820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0098e0 tx=0x7fc5ec009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5621eda3c26afc5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.521+0000 7fc5eb7fe700 1 -- 172.21.15.8:0/3628633167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec005580 con 0x55eb56dec7e0 2023-10-06T23:22:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.521+0000 7fc5eb7fe700 1 -- 172.21.15.8:0/3628633167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5ec01e040 con 0x55eb56dec7e0 2023-10-06T23:22:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.521+0000 7fc5eb7fe700 1 -- 172.21.15.8:0/3628633167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec00bb10 con 0x55eb56dec7e0 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.522+0000 7fc61aaabb80 1 -- 172.21.15.8:0/3628633167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 msgr2=0x55eb56dfc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.522+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/3628633167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfc820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0098e0 tx=0x7fc5ec009310 comp rx=0 tx=0).stop 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.522+0000 7fc61aaabb80 1 -- 172.21.15.8:0/3628633167 shutdown_connections 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.522+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/3628633167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56ded1a0 0x55eb56ddd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.522+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/3628633167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56deb6d0 0x55eb56df3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.522+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/3628633167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfc820 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.522+0000 7fc61aaabb80 1 -- 172.21.15.8:0/3628633167 >> 172.21.15.8:0/3628633167 conn(0x55eb56d57200 msgr2=0x55eb56df4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.523+0000 7fc61aaabb80 1 -- 172.21.15.8:0/3628633167 shutdown_connections 2023-10-06T23:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.523+0000 7fc61aaabb80 1 -- 172.21.15.8:0/3628633167 wait complete. 2023-10-06T23:22:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.523+0000 7fc61aaabb80 1 -- start start 2023-10-06T23:22:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.524+0000 7fc61aaabb80 1 Processor -- start 2023-10-06T23:22:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.524+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56deb6d0 0x55eb56dfa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc61aaabb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56dfb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56dfbd40 con 0x55eb56dec7e0 2023-10-06T23:22:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56dfbeb0 con 0x55eb56deb6d0 2023-10-06T23:22:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc61aaabb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb56dfc070 con 0x55eb56ded1a0 2023-10-06T23:22:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc61aaabb80 10 client.0 _ll_register_callbacks cb 0x7fc5f4005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56deb6d0 0x55eb56dfa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc604f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56deb6d0 0x55eb56dfa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43202/0 (socket says 172.21.15.8:43202) 2023-10-06T23:22:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc604f9b700 1 -- 172.21.15.8:0/2601364949 learned_addr learned my addr 172.21.15.8:0/2601364949 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc5fffff700 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.525+0000 7fc60579c700 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56dfb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.526+0000 7fc60579c700 1 -- 172.21.15.8:0/2601364949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56deb6d0 msgr2=0x55eb56dfa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.526+0000 7fc60579c700 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56deb6d0 0x55eb56dfa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.526+0000 7fc60579c700 1 -- 172.21.15.8:0/2601364949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 msgr2=0x55eb56dfa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.526+0000 7fc60579c700 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.526+0000 7fc60579c700 1 -- 172.21.15.8:0/2601364949 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600109c70 con 0x55eb56ded1a0 2023-10-06T23:22:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.526+0000 7fc60579c700 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56dfb800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55eb56ded7c0 tx=0x7fc5f8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a47162ef8e69dd99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.526+0000 7fc5dffff700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:22:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.527+0000 7fc5dffff700 1 -- 172.21.15.8:0/2601364949 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800e040 con 0x55eb56ded1a0 2023-10-06T23:22:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.527+0000 7fc5dffff700 1 -- 172.21.15.8:0/2601364949 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc5f8003c00 con 0x55eb56ded1a0 2023-10-06T23:22:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.527+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2601364949 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5f4099c80 con 0x55eb56ded1a0 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.527+0000 7fc5dffff700 1 -- 172.21.15.8:0/2601364949 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5f8003dc0 con 0x55eb56ded1a0 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc61aaabb80 10 client.26314 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2601364949 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55eb56b5f250 con 0x55eb56ded1a0 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc5dffff700 1 -- 172.21.15.8:0/2601364949 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5f4099c80 con 0x55eb56ded1a0 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc5dffff700 1 -- 172.21.15.8:0/2601364949 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc5f80044a0 con 0x55eb56ded1a0 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc61aaabb80 10 client.26314 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc61aaabb80 10 client.26314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc61aaabb80 20 client.26314 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55eb56e557d0 0x55eb56e57bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc61aaabb80 4 client.26314 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:22:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.528+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2601364949 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eb56d2ead0 con 0x55eb56e557d0 2023-10-06T23:22:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.529+0000 7fc604f9b700 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55eb56e557d0 0x55eb56e57bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.529+0000 7fc604f9b700 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55eb56e557d0 0x55eb56e57bf0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58cb2e89a38d7392 server_cookie=60558a881e9f4e5f in_seq=0 out_seq=0 2023-10-06T23:22:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.529+0000 7fc5dffff700 10 client.26314 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.546+0000 7fc5dffff700 1 -- 172.21.15.8:0/2601364949 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eb56d2ead0 con 0x55eb56e557d0 2023-10-06T23:22:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.546+0000 7fc5dffff700 10 client.26314 handle_command_reply: tid=0 2023-10-06T23:22:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.546+0000 7fc61aaabb80 1 client.26314 shutdown 2023-10-06T23:22:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.546+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2601364949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 msgr2=0x55eb56dfb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.546+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56dfb800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55eb56ded7c0 tx=0x7fc5f8004ad0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2601364949 shutdown_connections 2023-10-06T23:22:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55eb56e557d0 0x55eb56e57bf0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eb56ded1a0 0x55eb56dfb800 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb56deb6d0 0x55eb56dfa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc5dffff700 0 client.26314 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 1 --2- 172.21.15.8:0/2601364949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eb56dec7e0 0x55eb56dfa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2601364949 >> 172.21.15.8:0/2601364949 conn(0x55eb56d57200 msgr2=0x55eb56df3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2601364949 shutdown_connections 2023-10-06T23:22:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 1 -- 172.21.15.8:0/2601364949 wait complete. 2023-10-06T23:22:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.547+0000 7fc61aaabb80 20 client.26314 trim_cache size 0 max 16384 2023-10-06T23:22:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:22:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:22:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:22:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 -- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5f00a1480 msgr2=0x7fc5f00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5f00a1480 0x7fc5f00a3940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009fd0 tx=0x7fc5f8009040 comp rx=0 tx=0).stop 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 -- 172.21.15.8:0/3450688510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600100f10 msgr2=0x7fc600198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600100f10 0x7fc600198ef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400e9a0 tx=0x7fc5f400ed60 comp rx=0 tx=0).stop 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 -- 172.21.15.8:0/3450688510 shutdown_connections 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc5f00a1480 0x7fc5f00a3940 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc600102a20 0x7fc60019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc600100f10 0x7fc600198ef0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 --2- 172.21.15.8:0/3450688510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc600102060 0x7fc600199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 -- 172.21.15.8:0/3450688510 >> 172.21.15.8:0/3450688510 conn(0x7fc6000fc460 msgr2=0x7fc600107ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 -- 172.21.15.8:0/3450688510 shutdown_connections 2023-10-06T23:22:00.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:00.548+0000 7fc6071ff700 1 -- 172.21.15.8:0/3450688510 wait complete. 2023-10-06T23:22:01.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:01 smithi156 ceph-mon[102862]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 6.6 MiB/s wr, 576 op/s 2023-10-06T23:22:01.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:01 smithi008 ceph-mon[98532]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 6.6 MiB/s wr, 576 op/s 2023-10-06T23:22:01.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:01 smithi190 ceph-mon[102658]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 6.6 MiB/s wr, 576 op/s 2023-10-06T23:22:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:03 smithi190 ceph-mon[102658]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 5.5 MiB/s wr, 479 op/s 2023-10-06T23:22:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:03 smithi156 ceph-mon[102862]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 5.5 MiB/s wr, 479 op/s 2023-10-06T23:22:03.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:03 smithi008 ceph-mon[98532]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 5.5 MiB/s wr, 479 op/s 2023-10-06T23:22:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 430.0 s, 195.8 tps, lat 493.885 ms stddev 347.945 2023-10-06T23:22:05.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:05 smithi156 ceph-mon[102862]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.8 MiB/s wr, 511 op/s 2023-10-06T23:22:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:05 smithi008 ceph-mon[98532]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.8 MiB/s wr, 511 op/s 2023-10-06T23:22:05.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:05 smithi190 ceph-mon[102658]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.8 MiB/s wr, 511 op/s 2023-10-06T23:22:07.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:07 smithi156 ceph-mon[102862]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 5.3 MiB/s wr, 518 op/s 2023-10-06T23:22:07.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:07 smithi008 ceph-mon[98532]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 5.3 MiB/s wr, 518 op/s 2023-10-06T23:22:07.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:07 smithi190 ceph-mon[102658]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 5.3 MiB/s wr, 518 op/s 2023-10-06T23:22:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 435.0 s, 103.2 tps, lat 1013.313 ms stddev 1507.486 2023-10-06T23:22:09.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:09 smithi156 ceph-mon[102862]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 4.9 MiB/s wr, 426 op/s 2023-10-06T23:22:09.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:09 smithi008 ceph-mon[98532]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 4.9 MiB/s wr, 426 op/s 2023-10-06T23:22:09.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:09 smithi190 ceph-mon[102658]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 4.9 MiB/s wr, 426 op/s 2023-10-06T23:22:11.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:11 smithi156 ceph-mon[102862]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 4.7 MiB/s wr, 405 op/s 2023-10-06T23:22:11.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:11 smithi008 ceph-mon[98532]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 4.7 MiB/s wr, 405 op/s 2023-10-06T23:22:11.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:11 smithi190 ceph-mon[102658]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 4.7 MiB/s wr, 405 op/s 2023-10-06T23:22:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:13 smithi190 ceph-mon[102658]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 4.3 MiB/s wr, 346 op/s 2023-10-06T23:22:13.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 -- 172.21.15.8:0/314522216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770101970 msgr2=0x7f6770103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 --2- 172.21.15.8:0/314522216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770101970 0x7f6770103d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f676c009990 tx=0x7f676c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 -- 172.21.15.8:0/314522216 shutdown_connections 2023-10-06T23:22:13.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 --2- 172.21.15.8:0/314522216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6770106bd0 0x7f6770109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 --2- 172.21.15.8:0/314522216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770101970 0x7f6770103d60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 --2- 172.21.15.8:0/314522216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f67701042a0 0x7f6770106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 -- 172.21.15.8:0/314522216 >> 172.21.15.8:0/314522216 conn(0x7f67700fb340 msgr2=0x7f67700fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:13.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 -- 172.21.15.8:0/314522216 shutdown_connections 2023-10-06T23:22:13.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.776+0000 7f67785ff700 1 -- 172.21.15.8:0/314522216 wait complete. 2023-10-06T23:22:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.777+0000 7f67785ff700 1 Processor -- start 2023-10-06T23:22:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.778+0000 7f67785ff700 1 -- start start 2023-10-06T23:22:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.778+0000 7f67785ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770101970 0x7f67700ff920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.778+0000 7f67785ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67701042a0 0x7f67700ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.778+0000 7f67785ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770106bd0 0x7f67701003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.778+0000 7f67785ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67701a0b90 con 0x7f6770101970 2023-10-06T23:22:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.778+0000 7f67785ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67701a0cd0 con 0x7f67701042a0 2023-10-06T23:22:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.778+0000 7f67785ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67701a0e10 con 0x7f6770106bd0 2023-10-06T23:22:13.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6775b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67701042a0 0x7f67700ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6775b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67701042a0 0x7f67700ffe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50116/0 (socket says 172.21.15.8:50116) 2023-10-06T23:22:13.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6775b9a700 1 -- 172.21.15.8:0/3918178204 learned_addr learned my addr 172.21.15.8:0/3918178204 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:13.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6776b9c700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770106bd0 0x7f67701003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f677639b700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770101970 0x7f67700ff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6775b9a700 1 -- 172.21.15.8:0/3918178204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770106bd0 msgr2=0x7f67701003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6775b9a700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770106bd0 0x7f67701003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6775b9a700 1 -- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770101970 msgr2=0x7f67700ff920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6775b9a700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770101970 0x7f67700ff920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f6775b9a700 1 -- 172.21.15.8:0/3918178204 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c0095f0 con 0x7f67701042a0 2023-10-06T23:22:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.779+0000 7f677639b700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770101970 0x7f67700ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:22:13.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.780+0000 7f6775b9a700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67701042a0 0x7f67700ffe60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f676000e9a0 tx=0x7f676000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:13.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.780+0000 7f67677fe700 1 -- 172.21.15.8:0/3918178204 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760009790 con 0x7f67701042a0 2023-10-06T23:22:13.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.780+0000 7f67785ff700 1 -- 172.21.15.8:0/3918178204 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67701a10a0 con 0x7f67701042a0 2023-10-06T23:22:13.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.780+0000 7f67677fe700 1 -- 172.21.15.8:0/3918178204 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f676000cbd0 con 0x7f67701042a0 2023-10-06T23:22:13.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.780+0000 7f67677fe700 1 -- 172.21.15.8:0/3918178204 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760018680 con 0x7f67701042a0 2023-10-06T23:22:13.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.780+0000 7f67785ff700 1 -- 172.21.15.8:0/3918178204 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67701a1600 con 0x7f67701042a0 2023-10-06T23:22:13.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.785+0000 7f67677fe700 1 -- 172.21.15.8:0/3918178204 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f676000cd40 con 0x7f67701042a0 2023-10-06T23:22:13.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.786+0000 7f678bf7eb80 1 Processor -- start 2023-10-06T23:22:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.787+0000 7f678bf7eb80 1 -- start start 2023-10-06T23:22:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.787+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db58852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.787+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5885fd0 0x556db5886450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.787+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5886990 0x556db588d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db57ed400 con 0x556db5886990 2023-10-06T23:22:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db57debc0 con 0x556db5884ec0 2023-10-06T23:22:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db57dc4e0 con 0x556db5885fd0 2023-10-06T23:22:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f6776b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db58852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f677639b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5885fd0 0x556db5886450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f677639b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5885fd0 0x556db5886450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38856/0 (socket says 172.21.15.8:38856) 2023-10-06T23:22:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f677639b700 1 -- 172.21.15.8:0/225097800 learned_addr learned my addr 172.21.15.8:0/225097800 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f6776b9c700 1 -- 172.21.15.8:0/225097800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5885fd0 msgr2=0x556db5886450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f6776b9c700 1 --2- 172.21.15.8:0/225097800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5885fd0 0x556db5886450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f6776b9c700 1 -- 172.21.15.8:0/225097800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5886990 msgr2=0x556db588d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f6776b9c700 1 --2- 172.21.15.8:0/225097800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5886990 0x556db588d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.788+0000 7f6776b9c700 1 -- 172.21.15.8:0/225097800 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556db5602d80 con 0x556db5884ec0 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.789+0000 7f6776b9c700 1 --2- 172.21.15.8:0/225097800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db58852e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6768009310 tx=0x7f6768009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac7a08144d6b4ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.789+0000 7f6764bfe700 1 -- 172.21.15.8:0/225097800 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800e070 con 0x556db5884ec0 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.789+0000 7f6764bfe700 1 -- 172.21.15.8:0/225097800 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f676800f040 con 0x556db5884ec0 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.789+0000 7f6764bfe700 1 -- 172.21.15.8:0/225097800 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680148e0 con 0x556db5884ec0 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.789+0000 7f67677fe700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f675c0a1500 0x7f675c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.790+0000 7f67677fe700 1 -- 172.21.15.8:0/3918178204 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6760014070 con 0x7f67701042a0 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.790+0000 7f677639b700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f675c0a1500 0x7f675c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.790+0000 7f678bf7eb80 1 -- 172.21.15.8:0/225097800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 msgr2=0x556db58852e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.790+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/225097800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db58852e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6768009310 tx=0x7f6768009920 comp rx=0 tx=0).stop 2023-10-06T23:22:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f678bf7eb80 1 -- 172.21.15.8:0/225097800 shutdown_connections 2023-10-06T23:22:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/225097800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5886990 0x556db588d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/225097800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db58852e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/225097800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5885fd0 0x556db5886450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f678bf7eb80 1 -- 172.21.15.8:0/225097800 >> 172.21.15.8:0/225097800 conn(0x556db57f9200 msgr2=0x556db587fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f678bf7eb80 1 -- 172.21.15.8:0/225097800 shutdown_connections 2023-10-06T23:22:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f678bf7eb80 1 -- 172.21.15.8:0/225097800 wait complete. 2023-10-06T23:22:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f677639b700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f675c0a1500 0x7f675c0a39c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f676c006010 tx=0x7f676c00b280 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.791+0000 7f678bf7eb80 1 -- start start 2023-10-06T23:22:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.792+0000 7f678bf7eb80 1 Processor -- start 2023-10-06T23:22:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5897430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db5897970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db57d7dd0 con 0x556db5885fd0 2023-10-06T23:22:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db57746b0 con 0x556db5884ec0 2023-10-06T23:22:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db5774350 con 0x556db5886990 2023-10-06T23:22:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f678bf7eb80 10 client.0 _ll_register_callbacks cb 0x556db55d17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f677639b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5897430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f677639b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5897430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50126/0 (socket says 172.21.15.8:50126) 2023-10-06T23:22:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f677639b700 1 -- 172.21.15.8:0/393381445 learned_addr learned my addr 172.21.15.8:0/393381445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f6776b9c700 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.793+0000 7f6775b9a700 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db5897970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.794+0000 7f677639b700 1 -- 172.21.15.8:0/393381445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 msgr2=0x556db589e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.794+0000 7f677639b700 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.794+0000 7f677639b700 1 -- 172.21.15.8:0/393381445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 msgr2=0x556db5897970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.794+0000 7f677639b700 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db5897970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.794+0000 7f677639b700 1 -- 172.21.15.8:0/393381445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6768009050 con 0x556db5884ec0 2023-10-06T23:22:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.794+0000 7f677639b700 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5897430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f676c003900 tx=0x7f676c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ca76bba74a05c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.794+0000 7f6759ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:22:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.795+0000 7f6759ffb700 1 -- 172.21.15.8:0/393381445 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c02c070 con 0x556db5884ec0 2023-10-06T23:22:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.795+0000 7f678bf7eb80 1 -- 172.21.15.8:0/393381445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556db5877d50 con 0x556db5884ec0 2023-10-06T23:22:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.795+0000 7f6759ffb700 1 -- 172.21.15.8:0/393381445 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f676c00b710 con 0x556db5884ec0 2023-10-06T23:22:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.795+0000 7f6759ffb700 1 -- 172.21.15.8:0/393381445 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f676c00b8d0 con 0x556db5884ec0 2023-10-06T23:22:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.795+0000 7f678bf7eb80 10 client.26306 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.795+0000 7f678bf7eb80 1 -- 172.21.15.8:0/393381445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x556db55ebc00 con 0x556db5884ec0 2023-10-06T23:22:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.796+0000 7f6759ffb700 1 -- 172.21.15.8:0/393381445 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556db5877d50 con 0x556db5884ec0 2023-10-06T23:22:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.796+0000 7f6759ffb700 1 -- 172.21.15.8:0/393381445 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f676c004b90 con 0x556db5884ec0 2023-10-06T23:22:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.796+0000 7f678bf7eb80 10 client.26306 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.796+0000 7f678bf7eb80 10 client.26306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.796+0000 7f678bf7eb80 20 client.26306 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.796+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556db58a31e0 0x556db58a5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.796+0000 7f678bf7eb80 4 client.26306 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.796+0000 7f678bf7eb80 1 -- 172.21.15.8:0/393381445 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556db57d0db0 con 0x556db58a31e0 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.797+0000 7f6775b9a700 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556db58a31e0 0x556db58a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.797+0000 7f6775b9a700 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556db58a31e0 0x556db58a5600 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e116ee69ccbaadd server_cookie=636361ae15b7f47d in_seq=0 out_seq=0 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.797+0000 7f6759ffb700 10 client.26306 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.798+0000 7f6759ffb700 1 -- 172.21.15.8:0/393381445 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556db57d0db0 con 0x556db58a31e0 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.798+0000 7f6759ffb700 10 client.26306 handle_command_reply: tid=0 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.798+0000 7f678bf7eb80 1 client.26306 shutdown 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 -- 172.21.15.8:0/393381445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 msgr2=0x556db5897430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5897430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f676c003900 tx=0x7f676c009310 comp rx=0 tx=0).stop 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 -- 172.21.15.8:0/393381445 shutdown_connections 2023-10-06T23:22:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556db58a31e0 0x556db58a5600 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5897430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/393381445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db5897970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 -- 172.21.15.8:0/393381445 >> 172.21.15.8:0/393381445 conn(0x556db57f9200 msgr2=0x556db587f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f6759ffb700 0 client.26306 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 -- 172.21.15.8:0/393381445 shutdown_connections 2023-10-06T23:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 1 -- 172.21.15.8:0/393381445 wait complete. 2023-10-06T23:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.799+0000 7f678bf7eb80 20 client.26306 trim_cache size 0 max 16384 2023-10-06T23:22:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.823+0000 7f678bf7eb80 1 Processor -- start 2023-10-06T23:22:13.825 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.823+0000 7f678bf7eb80 1 -- start start 2023-10-06T23:22:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5889940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db5889e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db56588c0 con 0x556db5885fd0 2023-10-06T23:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db5880a50 con 0x556db5884ec0 2023-10-06T23:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db5898480 con 0x556db5886990 2023-10-06T23:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f677639b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5889940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f677639b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5889940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50134/0 (socket says 172.21.15.8:50134) 2023-10-06T23:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f677639b700 1 -- 172.21.15.8:0/3638534908 learned_addr learned my addr 172.21.15.8:0/3638534908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f6776b9c700 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db5889e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.824+0000 7f6775b9a700 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.825+0000 7f6776b9c700 1 -- 172.21.15.8:0/3638534908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 msgr2=0x556db5889940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.825+0000 7f6776b9c700 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5889940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.825+0000 7f6776b9c700 1 -- 172.21.15.8:0/3638534908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 msgr2=0x556db589e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.825+0000 7f6776b9c700 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.825+0000 7f6776b9c700 1 -- 172.21.15.8:0/3638534908 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556db56291f0 con 0x556db5886990 2023-10-06T23:22:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.825+0000 7f677639b700 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5889940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.825+0000 7f6776b9c700 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db5889e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6768009310 tx=0x7f6768015e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf5e32e6855dbde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.826+0000 7f67653ff700 1 -- 172.21.15.8:0/3638534908 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800e040 con 0x556db5886990 2023-10-06T23:22:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.826+0000 7f67653ff700 1 -- 172.21.15.8:0/3638534908 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6768004c90 con 0x556db5886990 2023-10-06T23:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.826+0000 7f67653ff700 1 -- 172.21.15.8:0/3638534908 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768005500 con 0x556db5886990 2023-10-06T23:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.827+0000 7f678bf7eb80 1 -- 172.21.15.8:0/3638534908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 msgr2=0x556db5889e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.827+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db5889e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6768009310 tx=0x7f6768015e00 comp rx=0 tx=0).stop 2023-10-06T23:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.827+0000 7f678bf7eb80 1 -- 172.21.15.8:0/3638534908 shutdown_connections 2023-10-06T23:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.827+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db5889e80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.827+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db5889940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.827+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/3638534908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.827+0000 7f678bf7eb80 1 -- 172.21.15.8:0/3638534908 >> 172.21.15.8:0/3638534908 conn(0x556db57f9200 msgr2=0x556db588ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.827+0000 7f678bf7eb80 1 -- 172.21.15.8:0/3638534908 shutdown_connections 2023-10-06T23:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.828+0000 7f678bf7eb80 1 -- 172.21.15.8:0/3638534908 wait complete. 2023-10-06T23:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.828+0000 7f678bf7eb80 1 -- start start 2023-10-06T23:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.828+0000 7f678bf7eb80 1 Processor -- start 2023-10-06T23:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.829+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db589c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.829+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.829+0000 7f678bf7eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.829+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db589dfd0 con 0x556db5885fd0 2023-10-06T23:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.829+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db589e140 con 0x556db5884ec0 2023-10-06T23:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.829+0000 7f678bf7eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556db589e300 con 0x556db5886990 2023-10-06T23:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.829+0000 7f678bf7eb80 10 client.0 _ll_register_callbacks cb 0x7f676c005730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6775b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6776b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6776b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38882/0 (socket says 172.21.15.8:38882) 2023-10-06T23:22:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6776b9c700 1 -- 172.21.15.8:0/2454865337 learned_addr learned my addr 172.21.15.8:0/2454865337 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6775b9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44336/0 (socket says 172.21.15.8:44336) 2023-10-06T23:22:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f677639b700 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db589c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6776b9c700 1 -- 172.21.15.8:0/2454865337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 msgr2=0x556db589c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6776b9c700 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db589c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6776b9c700 1 -- 172.21.15.8:0/2454865337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 msgr2=0x556db589ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6776b9c700 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.830+0000 7f6776b9c700 1 -- 172.21.15.8:0/2454865337 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556db55ebc00 con 0x556db5886990 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.831+0000 7f6776b9c700 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589da90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6768015aa0 tx=0x7f6768015ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d6814a622b346e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.831+0000 7f6759ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.831+0000 7f6759ffb700 1 -- 172.21.15.8:0/2454865337 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800e040 con 0x556db5886990 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.831+0000 7f678bf7eb80 1 -- 172.21.15.8:0/2454865337 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f676800f040 con 0x556db5886990 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.831+0000 7f6759ffb700 1 -- 172.21.15.8:0/2454865337 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6768003a00 con 0x556db5886990 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.832+0000 7f6759ffb700 1 -- 172.21.15.8:0/2454865337 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f676803a020 con 0x556db5886990 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.832+0000 7f678bf7eb80 10 client.26332 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.832+0000 7f678bf7eb80 1 -- 172.21.15.8:0/2454865337 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x556db5602d80 con 0x556db5886990 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.832+0000 7f6759ffb700 1 -- 172.21.15.8:0/2454865337 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f676800f040 con 0x556db5886990 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.833+0000 7f6759ffb700 1 -- 172.21.15.8:0/2454865337 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6768033030 con 0x556db5886990 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.833+0000 7f678bf7eb80 10 client.26332 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.833+0000 7f678bf7eb80 10 client.26332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.833+0000 7f678bf7eb80 20 client.26332 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.833+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556db58f7a90 0x556db58f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.833+0000 7f678bf7eb80 4 client.26332 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.833+0000 7f678bf7eb80 1 -- 172.21.15.8:0/2454865337 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556db57d0ad0 con 0x556db58f7a90 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.833+0000 7f677639b700 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556db58f7a90 0x556db58f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.834+0000 7f677639b700 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556db58f7a90 0x556db58f9eb0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57f99c66a9314b9d server_cookie=55250c2a91f0a1b8 in_seq=0 out_seq=0 2023-10-06T23:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.834+0000 7f6759ffb700 10 client.26332 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.847+0000 7f6759ffb700 1 -- 172.21.15.8:0/2454865337 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556db57d0ad0 con 0x556db58f7a90 2023-10-06T23:22:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.847+0000 7f6759ffb700 10 client.26332 handle_command_reply: tid=0 2023-10-06T23:22:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.847+0000 7f678bf7eb80 1 client.26332 shutdown 2023-10-06T23:22:13.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:13 smithi156 ceph-mon[102862]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 4.3 MiB/s wr, 346 op/s 2023-10-06T23:22:13.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.847+0000 7f678bf7eb80 1 -- 172.21.15.8:0/2454865337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 msgr2=0x556db589da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.847+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589da90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6768015aa0 tx=0x7f6768015ad0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f678bf7eb80 1 -- 172.21.15.8:0/2454865337 shutdown_connections 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556db58f7a90 0x556db58f9eb0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db5886990 0x556db589da90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556db5884ec0 0x556db589c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f678bf7eb80 1 --2- 172.21.15.8:0/2454865337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556db5885fd0 0x556db589ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f678bf7eb80 1 -- 172.21.15.8:0/2454865337 >> 172.21.15.8:0/2454865337 conn(0x556db57f9200 msgr2=0x556db5889940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f6759ffb700 0 client.26332 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f678bf7eb80 1 -- 172.21.15.8:0/2454865337 shutdown_connections 2023-10-06T23:22:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.848+0000 7f678bf7eb80 1 -- 172.21.15.8:0/2454865337 wait complete. 2023-10-06T23:22:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.849+0000 7f678bf7eb80 20 client.26332 trim_cache size 0 max 16384 2023-10-06T23:22:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:22:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:22:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:22:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:22:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.849+0000 7f67785ff700 1 -- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f675c0a1500 msgr2=0x7f675c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.849+0000 7f67785ff700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f675c0a1500 0x7f675c0a39c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f676c006010 tx=0x7f676c00b280 comp rx=0 tx=0).stop 2023-10-06T23:22:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.849+0000 7f67785ff700 1 -- 172.21.15.8:0/3918178204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67701042a0 msgr2=0x7f67700ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.849+0000 7f67785ff700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67701042a0 0x7f67700ffe60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f676000e9a0 tx=0x7f676000ed60 comp rx=0 tx=0).stop 2023-10-06T23:22:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.850+0000 7f67785ff700 1 -- 172.21.15.8:0/3918178204 shutdown_connections 2023-10-06T23:22:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.850+0000 7f67785ff700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f675c0a1500 0x7f675c0a39c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.850+0000 7f67785ff700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770101970 0x7f67700ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.850+0000 7f67785ff700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770106bd0 0x7f67701003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.850+0000 7f67785ff700 1 --2- 172.21.15.8:0/3918178204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67701042a0 0x7f67700ffe60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.850+0000 7f67785ff700 1 -- 172.21.15.8:0/3918178204 >> 172.21.15.8:0/3918178204 conn(0x7f67700fb340 msgr2=0x7f67701025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.850+0000 7f67785ff700 1 -- 172.21.15.8:0/3918178204 shutdown_connections 2023-10-06T23:22:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:13.850+0000 7f67785ff700 1 -- 172.21.15.8:0/3918178204 wait complete. 2023-10-06T23:22:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:13 smithi008 ceph-mon[98532]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 4.3 MiB/s wr, 346 op/s 2023-10-06T23:22:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 440.0 s, 314.2 tps, lat 317.788 ms stddev 29.226 2023-10-06T23:22:15.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:15 smithi156 ceph-mon[102862]: pgmap v632: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.4 MiB/s wr, 366 op/s 2023-10-06T23:22:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:15 smithi008 ceph-mon[98532]: pgmap v632: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.4 MiB/s wr, 366 op/s 2023-10-06T23:22:15.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:15 smithi190 ceph-mon[102658]: pgmap v632: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.4 MiB/s wr, 366 op/s 2023-10-06T23:22:17.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:17 smithi156 ceph-mon[102862]: pgmap v633: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 3.7 MiB/s wr, 314 op/s 2023-10-06T23:22:17.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:17 smithi008 ceph-mon[98532]: pgmap v633: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 3.7 MiB/s wr, 314 op/s 2023-10-06T23:22:17.694 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:17 smithi190 ceph-mon[102658]: pgmap v633: 97 pgs: 97 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 3.7 MiB/s wr, 314 op/s 2023-10-06T23:22:18.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:22:18.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.947+0000 7f3092dff700 1 -- 172.21.15.8:0/532537583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 msgr2=0x7f308c101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:18.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.947+0000 7f3092dff700 1 --2- 172.21.15.8:0/532537583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 0x7f308c101330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3088009990 tx=0x7f3088009ca0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.948+0000 7f3092dff700 1 -- 172.21.15.8:0/532537583 shutdown_connections 2023-10-06T23:22:18.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.948+0000 7f3092dff700 1 --2- 172.21.15.8:0/532537583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f308c102a20 0x7f308c109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.948+0000 7f3092dff700 1 --2- 172.21.15.8:0/532537583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 0x7f308c101330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.948+0000 7f3092dff700 1 --2- 172.21.15.8:0/532537583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f308c102060 0x7f308c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.948+0000 7f3092dff700 1 -- 172.21.15.8:0/532537583 >> 172.21.15.8:0/532537583 conn(0x7f308c0fc460 msgr2=0x7f308c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:18.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.948+0000 7f3092dff700 1 -- 172.21.15.8:0/532537583 shutdown_connections 2023-10-06T23:22:18.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.948+0000 7f3092dff700 1 -- 172.21.15.8:0/532537583 wait complete. 2023-10-06T23:22:18.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.949+0000 7f3092dff700 1 Processor -- start 2023-10-06T23:22:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.950+0000 7f3092dff700 1 -- start start 2023-10-06T23:22:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.950+0000 7f3092dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 0x7f308c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.950+0000 7f3092dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f308c102060 0x7f308c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.950+0000 7f3092dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f308c102a20 0x7f308c1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.950+0000 7f3092dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c1a08d0 con 0x7f308c102060 2023-10-06T23:22:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.950+0000 7f3092dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c1a0a10 con 0x7f308c100f10 2023-10-06T23:22:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.950+0000 7f3092dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c1a0ba0 con 0x7f308c102a20 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3090b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 0x7f308c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3090b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 0x7f308c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50166/0 (socket says 172.21.15.8:50166) 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3090b9b700 1 -- 172.21.15.8:0/918319904 learned_addr learned my addr 172.21.15.8:0/918319904 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f309139c700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f308c102a20 0x7f308c1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3083fff700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f308c102060 0x7f308c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3090b9b700 1 -- 172.21.15.8:0/918319904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f308c102a20 msgr2=0x7f308c1a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3090b9b700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f308c102a20 0x7f308c1a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3090b9b700 1 -- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f308c102060 msgr2=0x7f308c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3090b9b700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f308c102060 0x7f308c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f3090b9b700 1 -- 172.21.15.8:0/918319904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880095f0 con 0x7f308c100f10 2023-10-06T23:22:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.951+0000 7f309139c700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f308c102a20 0x7f308c1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.952+0000 7f3090b9b700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 0x7f308c198d50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3088005910 tx=0x7f3088005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.952+0000 7f3081ffb700 1 -- 172.21.15.8:0/918319904 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308801d070 con 0x7f308c100f10 2023-10-06T23:22:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.952+0000 7f3081ffb700 1 -- 172.21.15.8:0/918319904 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f308800be10 con 0x7f308c100f10 2023-10-06T23:22:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.952+0000 7f3081ffb700 1 -- 172.21.15.8:0/918319904 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088022e00 con 0x7f308c100f10 2023-10-06T23:22:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.952+0000 7f3092dff700 1 -- 172.21.15.8:0/918319904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308c1a0e20 con 0x7f308c100f10 2023-10-06T23:22:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.953+0000 7f3092dff700 1 -- 172.21.15.8:0/918319904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308c1a1190 con 0x7f308c100f10 2023-10-06T23:22:18.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.959+0000 7f3081ffb700 1 -- 172.21.15.8:0/918319904 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f308800b980 con 0x7f308c100f10 2023-10-06T23:22:18.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.959+0000 7f30a671db80 1 Processor -- start 2023-10-06T23:22:18.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.960+0000 7f30a671db80 1 -- start start 2023-10-06T23:22:18.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.960+0000 7f30a671db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c1fb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.960+0000 7f30a671db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1fc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.960+0000 7f30a671db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c1fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.960+0000 7f30a671db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c163460 con 0x560b7c1fca60 2023-10-06T23:22:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.960+0000 7f30a671db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c154c20 con 0x560b7c1fb260 2023-10-06T23:22:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.960+0000 7f30a671db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c152540 con 0x560b7c1fbbc0 2023-10-06T23:22:18.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f309139c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c1fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3083fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c1fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3083fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c1fcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44358/0 (socket says 172.21.15.8:44358) 2023-10-06T23:22:18.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3083fff700 1 -- 172.21.15.8:0/314730497 learned_addr learned my addr 172.21.15.8:0/314730497 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:18.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3090b9b700 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3090b9b700 1 -- 172.21.15.8:0/314730497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 msgr2=0x560b7c1fb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3090b9b700 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c1fb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3090b9b700 1 -- 172.21.15.8:0/314730497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 msgr2=0x560b7c1fcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3090b9b700 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c1fcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3090b9b700 1 -- 172.21.15.8:0/314730497 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b7bf78de0 con 0x560b7c1fbbc0 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.961+0000 7f3083fff700 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c1fcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.962+0000 7f3081ffb700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30740a1500 0x7f30740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.962+0000 7f3081ffb700 1 -- 172.21.15.8:0/918319904 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f30880ce1f0 con 0x7f308c100f10 2023-10-06T23:22:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.962+0000 7f3090b9b700 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1fc480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f30880cbcd0 tx=0x7f30880d64f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23b4b78a4c2953d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:18.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.962+0000 7f309139c700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30740a1500 0x7f30740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.962+0000 7f3072ffd700 1 -- 172.21.15.8:0/314730497 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880860d0 con 0x560b7c1fbbc0 2023-10-06T23:22:18.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.963+0000 7f3072ffd700 1 -- 172.21.15.8:0/314730497 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30880978f0 con 0x560b7c1fbbc0 2023-10-06T23:22:18.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.963+0000 7f3072ffd700 1 -- 172.21.15.8:0/314730497 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308809b380 con 0x560b7c1fbbc0 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.963+0000 7f30a671db80 1 -- 172.21.15.8:0/314730497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 msgr2=0x560b7c1fc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f30a671db80 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1fc480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f30880cbcd0 tx=0x7f30880d64f0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f309139c700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30740a1500 0x7f30740a39c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3084004090 tx=0x7f308400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f30a671db80 1 -- 172.21.15.8:0/314730497 shutdown_connections 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f30a671db80 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c1fcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f30a671db80 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c1fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f30a671db80 1 --2- 172.21.15.8:0/314730497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1fc480 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f30a671db80 1 -- 172.21.15.8:0/314730497 >> 172.21.15.8:0/314730497 conn(0x560b7c16f260 msgr2=0x560b7c1f6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f30a671db80 1 -- 172.21.15.8:0/314730497 shutdown_connections 2023-10-06T23:22:18.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.964+0000 7f30a671db80 1 -- 172.21.15.8:0/314730497 wait complete. 2023-10-06T23:22:18.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.965+0000 7f30a671db80 1 -- start start 2023-10-06T23:22:18.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.965+0000 7f30a671db80 1 Processor -- start 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.966+0000 7f30a671db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fb260 0x560b7c204cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.966+0000 7f30a671db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fbbc0 0x560b7c205210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.966+0000 7f30a671db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c20c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.966+0000 7f30a671db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c14de30 con 0x560b7c1fca60 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.966+0000 7f30a671db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c0ea710 con 0x560b7c1fbbc0 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.966+0000 7f30a671db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c0ea3b0 con 0x560b7c1fb260 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.966+0000 7f30a671db80 10 client.0 _ll_register_callbacks cb 0x560b7bf47800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f3090b9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fb260 0x560b7c204cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f3083fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fbbc0 0x560b7c205210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f3090b9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fb260 0x560b7c204cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38926/0 (socket says 172.21.15.8:38926) 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f3090b9b700 1 -- 172.21.15.8:0/598352074 learned_addr learned my addr 172.21.15.8:0/598352074 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f309139c700 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c20c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f3090b9b700 1 -- 172.21.15.8:0/598352074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fbbc0 msgr2=0x560b7c205210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f3090b9b700 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fbbc0 0x560b7c205210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f3090b9b700 1 -- 172.21.15.8:0/598352074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 msgr2=0x560b7c20c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.967+0000 7f3090b9b700 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c20c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.968+0000 7f3090b9b700 1 -- 172.21.15.8:0/598352074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308c1a1190 con 0x560b7c1fb260 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.968+0000 7f309139c700 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c20c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:22:18.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.968+0000 7f3090b9b700 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fb260 0x560b7c204cd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30880d18b0 tx=0x7f30880ce4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d28f3438252128a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:18.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.968+0000 7f306bfff700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:22:18.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.968+0000 7f306bfff700 1 -- 172.21.15.8:0/598352074 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880860d0 con 0x560b7c1fb260 2023-10-06T23:22:18.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.968+0000 7f306bfff700 1 -- 172.21.15.8:0/598352074 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f308809bcb0 con 0x560b7c1fb260 2023-10-06T23:22:18.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.968+0000 7f30a671db80 1 -- 172.21.15.8:0/598352074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b7c1edf10 con 0x560b7c1fb260 2023-10-06T23:22:18.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.968+0000 7f306bfff700 1 -- 172.21.15.8:0/598352074 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f308809b0f0 con 0x560b7c1fb260 2023-10-06T23:22:18.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f30a671db80 10 client.26344 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:18.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f30a671db80 1 -- 172.21.15.8:0/598352074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560b7bf61c60 con 0x560b7c1fb260 2023-10-06T23:22:18.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f306bfff700 1 -- 172.21.15.8:0/598352074 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560b7c1edf10 con 0x560b7c1fb260 2023-10-06T23:22:18.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f306bfff700 1 -- 172.21.15.8:0/598352074 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3088084be0 con 0x560b7c1fb260 2023-10-06T23:22:18.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f30a671db80 10 client.26344 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:18.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f30a671db80 10 client.26344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:18.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f30a671db80 20 client.26344 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:18.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f30a671db80 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560b7c210510 0x560b7c212900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:18.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f30a671db80 4 client.26344 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:22:18.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.969+0000 7f30a671db80 1 -- 172.21.15.8:0/598352074 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b7c146e10 con 0x560b7c210510 2023-10-06T23:22:18.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.970+0000 7f3083fff700 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560b7c210510 0x560b7c212900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:18.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.970+0000 7f306bfff700 10 client.26344 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:18.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.970+0000 7f3083fff700 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560b7c210510 0x560b7c212900 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e789f34a8579c3c server_cookie=74baaec84568df70 in_seq=0 out_seq=0 2023-10-06T23:22:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.971+0000 7f306bfff700 1 -- 172.21.15.8:0/598352074 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560b7c146e10 con 0x560b7c210510 2023-10-06T23:22:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.971+0000 7f306bfff700 10 client.26344 handle_command_reply: tid=0 2023-10-06T23:22:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.971+0000 7f30a671db80 1 client.26344 shutdown 2023-10-06T23:22:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 -- 172.21.15.8:0/598352074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fb260 msgr2=0x560b7c204cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fb260 0x560b7c204cd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30880d18b0 tx=0x7f30880ce4b0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 -- 172.21.15.8:0/598352074 shutdown_connections 2023-10-06T23:22:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560b7c210510 0x560b7c212900 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fca60 0x560b7c20c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fb260 0x560b7c204cd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 --2- 172.21.15.8:0/598352074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fbbc0 0x560b7c205210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 -- 172.21.15.8:0/598352074 >> 172.21.15.8:0/598352074 conn(0x560b7c16f260 msgr2=0x560b7c1f5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f306bfff700 0 client.26344 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 -- 172.21.15.8:0/598352074 shutdown_connections 2023-10-06T23:22:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.972+0000 7f30a671db80 1 -- 172.21.15.8:0/598352074 wait complete. 2023-10-06T23:22:18.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:18.973+0000 7f30a671db80 20 client.26344 trim_cache size 0 max 16384 2023-10-06T23:22:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 445.0 s, 260.4 tps, lat 379.723 ms stddev 112.459 2023-10-06T23:22:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.004+0000 7f30a671db80 1 Processor -- start 2023-10-06T23:22:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.004+0000 7f30a671db80 1 -- start start 2023-10-06T23:22:19.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f30a671db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fb260 0x560b7c1ff930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:19.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f30a671db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:19.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f30a671db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fca60 0x560b7c20c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:19.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f30a671db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7bfce920 con 0x560b7c1fb260 2023-10-06T23:22:19.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f30a671db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c20d250 con 0x560b7c1fca60 2023-10-06T23:22:19.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f30a671db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c1f0300 con 0x560b7c1fbbc0 2023-10-06T23:22:19.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f3083fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:19.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f3083fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1ffe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38934/0 (socket says 172.21.15.8:38934) 2023-10-06T23:22:19.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f3083fff700 1 -- 172.21.15.8:0/273169445 learned_addr learned my addr 172.21.15.8:0/273169445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:19.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f309139c700 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fca60 0x560b7c20c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:19.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.005+0000 7f3090b9b700 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fb260 0x560b7c1ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:19.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.006+0000 7f309139c700 1 -- 172.21.15.8:0/273169445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 msgr2=0x560b7c1ffe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:19.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.006+0000 7f309139c700 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1ffe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.006+0000 7f309139c700 1 -- 172.21.15.8:0/273169445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fb260 msgr2=0x560b7c1ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:19.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.006+0000 7f309139c700 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fb260 0x560b7c1ff930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.006+0000 7f309139c700 1 -- 172.21.15.8:0/273169445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b7bf9f250 con 0x560b7c1fca60 2023-10-06T23:22:19.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.006+0000 7f309139c700 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fca60 0x560b7c20c210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f30840047e0 tx=0x7f3084017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=412fafbe3eb85062 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:19.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.007+0000 7f30737fe700 1 -- 172.21.15.8:0/273169445 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084008e80 con 0x560b7c1fca60 2023-10-06T23:22:19.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.007+0000 7f30737fe700 1 -- 172.21.15.8:0/273169445 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f308400f040 con 0x560b7c1fca60 2023-10-06T23:22:19.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.007+0000 7f30737fe700 1 -- 172.21.15.8:0/273169445 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084023740 con 0x560b7c1fca60 2023-10-06T23:22:19.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 -- 172.21.15.8:0/273169445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fca60 msgr2=0x560b7c20c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:19.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fca60 0x560b7c20c210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f30840047e0 tx=0x7f3084017000 comp rx=0 tx=0).stop 2023-10-06T23:22:19.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 -- 172.21.15.8:0/273169445 shutdown_connections 2023-10-06T23:22:19.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fb260 0x560b7c1ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fca60 0x560b7c20c210 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 --2- 172.21.15.8:0/273169445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fbbc0 0x560b7c1ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 -- 172.21.15.8:0/273169445 >> 172.21.15.8:0/273169445 conn(0x560b7c16f260 msgr2=0x560b7c20cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:19.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 -- 172.21.15.8:0/273169445 shutdown_connections 2023-10-06T23:22:19.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.008+0000 7f30a671db80 1 -- 172.21.15.8:0/273169445 wait complete. 2023-10-06T23:22:19.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.009+0000 7f30a671db80 1 -- start start 2023-10-06T23:22:19.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.009+0000 7f30a671db80 1 Processor -- start 2023-10-06T23:22:19.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f30a671db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c208010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:19.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f30a671db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fbbc0 0x560b7c208550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:19.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f30a671db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fca60 0x560b7c20b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:19.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f30a671db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c20bab0 con 0x560b7c1fbbc0 2023-10-06T23:22:19.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f30a671db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c20bc20 con 0x560b7c1fb260 2023-10-06T23:22:19.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f30a671db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7c20bde0 con 0x560b7c1fca60 2023-10-06T23:22:19.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f30a671db80 10 client.0 _ll_register_callbacks cb 0x7f3084009f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f3090b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c208010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f3090b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c208010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50198/0 (socket says 172.21.15.8:50198) 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f3090b9b700 1 -- 172.21.15.8:0/4181172551 learned_addr learned my addr 172.21.15.8:0/4181172551 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f3083fff700 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fbbc0 0x560b7c208550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.010+0000 7f309139c700 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fca60 0x560b7c20b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.011+0000 7f3090b9b700 1 -- 172.21.15.8:0/4181172551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fca60 msgr2=0x560b7c20b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.011+0000 7f3090b9b700 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fca60 0x560b7c20b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.011+0000 7f3090b9b700 1 -- 172.21.15.8:0/4181172551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fbbc0 msgr2=0x560b7c208550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.011+0000 7f3090b9b700 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fbbc0 0x560b7c208550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.011+0000 7f3090b9b700 1 -- 172.21.15.8:0/4181172551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3084009030 con 0x560b7c1fb260 2023-10-06T23:22:19.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.011+0000 7f3090b9b700 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c208010 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3088084f10 tx=0x7f30880228b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c70939d2c144caff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:19.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.011+0000 7f306bfff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:22:19.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.012+0000 7f306bfff700 1 -- 172.21.15.8:0/4181172551 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880860b0 con 0x560b7c1fb260 2023-10-06T23:22:19.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.012+0000 7f306bfff700 1 -- 172.21.15.8:0/4181172551 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f308809bcb0 con 0x560b7c1fb260 2023-10-06T23:22:19.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.012+0000 7f30a671db80 1 -- 172.21.15.8:0/4181172551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30880978f0 con 0x560b7c1fb260 2023-10-06T23:22:19.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.012+0000 7f306bfff700 1 -- 172.21.15.8:0/4181172551 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f308809b0f0 con 0x560b7c1fb260 2023-10-06T23:22:19.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.012+0000 7f30a671db80 10 client.26330 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:19.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.012+0000 7f30a671db80 1 -- 172.21.15.8:0/4181172551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560b7bf772b0 con 0x560b7c1fb260 2023-10-06T23:22:19.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.012+0000 7f306bfff700 1 -- 172.21.15.8:0/4181172551 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30880978f0 con 0x560b7c1fb260 2023-10-06T23:22:19.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.012+0000 7f306bfff700 1 -- 172.21.15.8:0/4181172551 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30880a3420 con 0x560b7c1fb260 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.013+0000 7f30a671db80 10 client.26330 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.013+0000 7f30a671db80 10 client.26330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.013+0000 7f30a671db80 20 client.26330 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.013+0000 7f30a671db80 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560b7c264ce0 0x560b7c2670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.013+0000 7f30a671db80 4 client.26330 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.013+0000 7f30a671db80 1 -- 172.21.15.8:0/4181172551 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560b7c146b30 con 0x560b7c264ce0 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.013+0000 7f3083fff700 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560b7c264ce0 0x560b7c2670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.014+0000 7f3083fff700 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560b7c264ce0 0x560b7c2670d0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=350cb12554521f0e server_cookie=aff11b233c98062 in_seq=0 out_seq=0 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.014+0000 7f306bfff700 10 client.26330 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.014+0000 7f306bfff700 1 -- 172.21.15.8:0/4181172551 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x560b7c146b30 con 0x560b7c264ce0 2023-10-06T23:22:19.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.014+0000 7f306bfff700 10 client.26330 handle_command_reply: tid=0 2023-10-06T23:22:19.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.014+0000 7f30a671db80 1 client.26330 shutdown 2023-10-06T23:22:19.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.014+0000 7f30a671db80 1 -- 172.21.15.8:0/4181172551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 msgr2=0x560b7c208010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:19.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.014+0000 7f30a671db80 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c208010 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3088084f10 tx=0x7f30880228b0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 1 -- 172.21.15.8:0/4181172551 shutdown_connections 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560b7c264ce0 0x560b7c2670d0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560b7c1fca60 0x560b7c20b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560b7c1fb260 0x560b7c208010 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 1 --2- 172.21.15.8:0/4181172551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560b7c1fbbc0 0x560b7c208550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 1 -- 172.21.15.8:0/4181172551 >> 172.21.15.8:0/4181172551 conn(0x560b7c16f260 msgr2=0x560b7c202e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f306bfff700 0 client.26330 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 1 -- 172.21.15.8:0/4181172551 shutdown_connections 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 1 -- 172.21.15.8:0/4181172551 wait complete. 2023-10-06T23:22:19.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.015+0000 7f30a671db80 20 client.26330 trim_cache size 0 max 16384 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:22:19.019 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:22:19.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 -- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30740a1500 msgr2=0x7f30740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:19.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30740a1500 0x7f30740a39c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3084004090 tx=0x7f308400b040 comp rx=0 tx=0).stop 2023-10-06T23:22:19.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 -- 172.21.15.8:0/918319904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 msgr2=0x7f308c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:19.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 0x7f308c198d50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3088005910 tx=0x7f3088005740 comp rx=0 tx=0).stop 2023-10-06T23:22:19.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 -- 172.21.15.8:0/918319904 shutdown_connections 2023-10-06T23:22:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f30740a1500 0x7f30740a39c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f308c102a20 0x7f308c1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f308c100f10 0x7f308c198d50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 --2- 172.21.15.8:0/918319904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f308c102060 0x7f308c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.016+0000 7f3092dff700 1 -- 172.21.15.8:0/918319904 >> 172.21.15.8:0/918319904 conn(0x7f308c0fc460 msgr2=0x7f308c0fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.017+0000 7f3092dff700 1 -- 172.21.15.8:0/918319904 shutdown_connections 2023-10-06T23:22:19.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:19.017+0000 7f3092dff700 1 -- 172.21.15.8:0/918319904 wait complete. 2023-10-06T23:22:19.044 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:22:19.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:19 smithi008 ceph-mon[98532]: pgmap v634: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 3.7 MiB/s wr, 341 op/s 2023-10-06T23:22:19.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:19 smithi156 ceph-mon[102862]: pgmap v634: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 3.7 MiB/s wr, 341 op/s 2023-10-06T23:22:19.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:19 smithi190 ceph-mon[102658]: pgmap v634: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 3.7 MiB/s wr, 341 op/s 2023-10-06T23:22:21.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:21 smithi156 ceph-mon[102862]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.8 MiB/s wr, 496 op/s 2023-10-06T23:22:21.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:21 smithi008 ceph-mon[98532]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.8 MiB/s wr, 496 op/s 2023-10-06T23:22:21.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:21 smithi190 ceph-mon[102658]: pgmap v635: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.8 MiB/s wr, 496 op/s 2023-10-06T23:22:23.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:23 smithi190 ceph-mon[102658]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2023-10-06T23:22:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:23 smithi156 ceph-mon[102862]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2023-10-06T23:22:23.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:23 smithi008 ceph-mon[98532]: pgmap v636: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2023-10-06T23:22:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 450.0 s, 264.4 tps, lat 379.651 ms stddev 60.999 2023-10-06T23:22:25.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:25 smithi156 ceph-mon[102862]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 5.5 MiB/s wr, 602 op/s 2023-10-06T23:22:25.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:25 smithi008 ceph-mon[98532]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 5.5 MiB/s wr, 602 op/s 2023-10-06T23:22:25.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:25 smithi190 ceph-mon[102658]: pgmap v637: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 5.5 MiB/s wr, 602 op/s 2023-10-06T23:22:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.080+0000 7ff1265ff700 1 -- 172.21.15.8:0/3191990990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff120074ef0 msgr2=0x7ff120073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.080+0000 7ff1265ff700 1 --2- 172.21.15.8:0/3191990990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff120074ef0 0x7ff120073340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1100098f0 tx=0x7ff110009c00 comp rx=0 tx=0).stop 2023-10-06T23:22:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.081+0000 7ff1265ff700 1 -- 172.21.15.8:0/3191990990 shutdown_connections 2023-10-06T23:22:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.081+0000 7ff1265ff700 1 --2- 172.21.15.8:0/3191990990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff12010d4d0 0x7ff12010f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.081+0000 7ff1265ff700 1 --2- 172.21.15.8:0/3191990990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff120074ef0 0x7ff120073340 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.081+0000 7ff1265ff700 1 --2- 172.21.15.8:0/3191990990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff120073910 0x7ff120073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.081+0000 7ff1265ff700 1 -- 172.21.15.8:0/3191990990 >> 172.21.15.8:0/3191990990 conn(0x7ff1200fc430 msgr2=0x7ff1200fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:27.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.081+0000 7ff1265ff700 1 -- 172.21.15.8:0/3191990990 shutdown_connections 2023-10-06T23:22:27.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.081+0000 7ff1265ff700 1 -- 172.21.15.8:0/3191990990 wait complete. 2023-10-06T23:22:27.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.082+0000 7ff1265ff700 1 Processor -- start 2023-10-06T23:22:27.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.083+0000 7ff1265ff700 1 -- start start 2023-10-06T23:22:27.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.083+0000 7ff1265ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff120073910 0x7ff12019d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.083+0000 7ff1265ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff120074ef0 0x7ff12019d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.083+0000 7ff1265ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff12010d4d0 0x7ff12019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.083+0000 7ff1265ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12019ecd0 con 0x7ff120073910 2023-10-06T23:22:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.083+0000 7ff1265ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12019ee40 con 0x7ff12010d4d0 2023-10-06T23:22:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.083+0000 7ff1265ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12019f000 con 0x7ff120074ef0 2023-10-06T23:22:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff124b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff12010d4d0 0x7ff12019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff11ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff120074ef0 0x7ff12019d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff124b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff12010d4d0 0x7ff12019e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57646/0 (socket says 172.21.15.8:57646) 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff11ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff120074ef0 0x7ff12019d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59922/0 (socket says 172.21.15.8:59922) 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff124b9c700 1 -- 172.21.15.8:0/2380514095 learned_addr learned my addr 172.21.15.8:0/2380514095 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff11ffff700 1 -- 172.21.15.8:0/2380514095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff12010d4d0 msgr2=0x7ff12019e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff11ffff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff12010d4d0 0x7ff12019e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff11ffff700 1 -- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff120073910 msgr2=0x7ff12019d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff11ffff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff120073910 0x7ff12019d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.084+0000 7ff11ffff700 1 -- 172.21.15.8:0/2380514095 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff110009520 con 0x7ff120074ef0 2023-10-06T23:22:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.085+0000 7ff11ffff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff120074ef0 0x7ff12019d7f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff10800e9c0 tx=0x7ff10800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.085+0000 7ff11dffb700 1 -- 172.21.15.8:0/2380514095 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800cbd0 con 0x7ff120074ef0 2023-10-06T23:22:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.085+0000 7ff1265ff700 1 -- 172.21.15.8:0/2380514095 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12019f2e0 con 0x7ff120074ef0 2023-10-06T23:22:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.085+0000 7ff11dffb700 1 -- 172.21.15.8:0/2380514095 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff10800eeb0 con 0x7ff120074ef0 2023-10-06T23:22:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.085+0000 7ff11dffb700 1 -- 172.21.15.8:0/2380514095 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108003c40 con 0x7ff120074ef0 2023-10-06T23:22:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.085+0000 7ff1265ff700 1 -- 172.21.15.8:0/2380514095 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1201a5aa0 con 0x7ff120074ef0 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.095+0000 7ff11dffb700 1 -- 172.21.15.8:0/2380514095 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff108003da0 con 0x7ff120074ef0 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.095+0000 7ff139fabb80 1 Processor -- start 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.098+0000 7ff11dffb700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff10c0a1500 0x7ff10c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.098+0000 7ff11dffb700 1 -- 172.21.15.8:0/2380514095 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff108014070 con 0x7ff120074ef0 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.099+0000 7ff139fabb80 1 -- start start 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.100+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.100+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fafe0 0x5645612fb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.100+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x564561302230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.100+0000 7ff139fabb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564561251400 con 0x5645612fb9a0 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.100+0000 7ff139fabb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564561242bc0 con 0x5645612fafe0 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.100+0000 7ff139fabb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645612404e0 con 0x5645612f9ed0 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.101+0000 7ff11ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fafe0 0x5645612fb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.102+0000 7ff124b9c700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff10c0a1500 0x7ff10c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.102+0000 7ff124b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x564561302230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.102+0000 7ff124b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x564561302230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56396/0 (socket says 172.21.15.8:56396) 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.102+0000 7ff124b9c700 1 -- 172.21.15.8:0/3612977229 learned_addr learned my addr 172.21.15.8:0/3612977229 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.103+0000 7ff124b9c700 1 -- 172.21.15.8:0/3612977229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 msgr2=0x5645612fa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.103+0000 7ff117fff700 1 --2- 172.21.15.8:0/3612977229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.103+0000 7ff124b9c700 1 --2- 172.21.15.8:0/3612977229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.103+0000 7ff124b9c700 1 -- 172.21.15.8:0/3612977229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fafe0 msgr2=0x5645612fb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.103+0000 7ff124b9c700 1 --2- 172.21.15.8:0/3612977229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fafe0 0x5645612fb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.103+0000 7ff124b9c700 1 -- 172.21.15.8:0/3612977229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564561066d80 con 0x5645612fb9a0 2023-10-06T23:22:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.105+0000 7ff124b9c700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff10c0a1500 0x7ff10c0a39c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff118009610 tx=0x7ff118008bf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.105+0000 7ff124b9c700 1 --2- 172.21.15.8:0/3612977229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x564561302230 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff118018360 tx=0x7ff11801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c55142199e751ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.106+0000 7ff1167fc700 1 -- 172.21.15.8:0/3612977229 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118027070 con 0x5645612fb9a0 2023-10-06T23:22:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.106+0000 7ff1167fc700 1 -- 172.21.15.8:0/3612977229 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff11800f040 con 0x5645612fb9a0 2023-10-06T23:22:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.106+0000 7ff1167fc700 1 -- 172.21.15.8:0/3612977229 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118007a50 con 0x5645612fb9a0 2023-10-06T23:22:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.107+0000 7ff139fabb80 1 -- 172.21.15.8:0/3612977229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 msgr2=0x564561302230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.107+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3612977229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x564561302230 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff118018360 tx=0x7ff11801f000 comp rx=0 tx=0).stop 2023-10-06T23:22:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.108+0000 7ff139fabb80 1 -- 172.21.15.8:0/3612977229 shutdown_connections 2023-10-06T23:22:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.108+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3612977229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x564561302230 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.108+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3612977229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.108+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3612977229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fafe0 0x5645612fb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.108+0000 7ff139fabb80 1 -- 172.21.15.8:0/3612977229 >> 172.21.15.8:0/3612977229 conn(0x56456125d200 msgr2=0x5645612e3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.108+0000 7ff139fabb80 1 -- 172.21.15.8:0/3612977229 shutdown_connections 2023-10-06T23:22:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.108+0000 7ff139fabb80 1 -- 172.21.15.8:0/3612977229 wait complete. 2023-10-06T23:22:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.108+0000 7ff139fabb80 1 -- start start 2023-10-06T23:22:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.109+0000 7ff139fabb80 1 Processor -- start 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.109+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612f9ed0 0x5645612e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.109+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.109+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x5645612f1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.109+0000 7ff139fabb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456123bdd0 con 0x5645612fb9a0 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.109+0000 7ff139fabb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645611d86b0 con 0x5645612f9ed0 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.109+0000 7ff139fabb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645611d8350 con 0x5645612fafe0 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.110+0000 7ff139fabb80 10 client.0 _ll_register_callbacks cb 0x5645610357a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.110+0000 7ff117fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612f9ed0 0x5645612e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.110+0000 7ff11ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.110+0000 7ff117fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612f9ed0 0x5645612e9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57664/0 (socket says 172.21.15.8:57664) 2023-10-06T23:22:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.110+0000 7ff117fff700 1 -- 172.21.15.8:0/3486200989 learned_addr learned my addr 172.21.15.8:0/3486200989 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.110+0000 7ff124b9c700 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x5645612f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff11ffff700 1 -- 172.21.15.8:0/3486200989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612f9ed0 msgr2=0x5645612e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff11ffff700 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612f9ed0 0x5645612e9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff11ffff700 1 -- 172.21.15.8:0/3486200989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 msgr2=0x5645612f1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff11ffff700 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x5645612f1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff11ffff700 1 -- 172.21.15.8:0/3486200989 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1180185d0 con 0x5645612fafe0 2023-10-06T23:22:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff117fff700 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612f9ed0 0x5645612e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff11ffff700 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612ea4c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff1080caaa0 tx=0x7ff108099ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3de6d6500465a5eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff0ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3486200989 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10809a2c0 con 0x5645612fafe0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff139fabb80 1 -- 172.21.15.8:0/3486200989 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645612dbd50 con 0x5645612fafe0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.111+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3486200989 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff10809e410 con 0x5645612fafe0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.112+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3486200989 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1080a2650 con 0x5645612fafe0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.112+0000 7ff139fabb80 10 client.26359 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.112+0000 7ff139fabb80 1 -- 172.21.15.8:0/3486200989 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56456104fc00 con 0x5645612fafe0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.112+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3486200989 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5645612dbd50 con 0x5645612fafe0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.112+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3486200989 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff1080a22e0 con 0x5645612fafe0 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.112+0000 7ff139fabb80 10 client.26359 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.112+0000 7ff139fabb80 10 client.26359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.112+0000 7ff139fabb80 20 client.26359 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.113+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5645612f5cd0 0x5645612f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.113+0000 7ff139fabb80 4 client.26359 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:22:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.113+0000 7ff139fabb80 1 -- 172.21.15.8:0/3486200989 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564561234db0 con 0x5645612f5cd0 2023-10-06T23:22:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.113+0000 7ff117fff700 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5645612f5cd0 0x5645612f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.114+0000 7ff117fff700 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5645612f5cd0 0x5645612f80f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0b4667b849a285b server_cookie=51028316b3cfc1b2 in_seq=0 out_seq=0 2023-10-06T23:22:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.114+0000 7ff0ff7fe700 10 client.26359 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.115+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3486200989 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564561234db0 con 0x5645612f5cd0 2023-10-06T23:22:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.115+0000 7ff0ff7fe700 10 client.26359 handle_command_reply: tid=0 2023-10-06T23:22:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.115+0000 7ff139fabb80 1 client.26359 shutdown 2023-10-06T23:22:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 -- 172.21.15.8:0/3486200989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 msgr2=0x5645612ea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612ea4c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff1080caaa0 tx=0x7ff108099ca0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 -- 172.21.15.8:0/3486200989 shutdown_connections 2023-10-06T23:22:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5645612f5cd0 0x5645612f80f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fb9a0 0x5645612f1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612f9ed0 0x5645612e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3486200989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612ea4c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff0ff7fe700 0 client.26359 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 -- 172.21.15.8:0/3486200989 >> 172.21.15.8:0/3486200989 conn(0x56456125d200 msgr2=0x5645612e3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 -- 172.21.15.8:0/3486200989 shutdown_connections 2023-10-06T23:22:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.116+0000 7ff139fabb80 1 -- 172.21.15.8:0/3486200989 wait complete. 2023-10-06T23:22:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.117+0000 7ff139fabb80 20 client.26359 trim_cache size 0 max 16384 2023-10-06T23:22:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.146+0000 7ff139fabb80 1 Processor -- start 2023-10-06T23:22:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.146+0000 7ff139fabb80 1 -- start start 2023-10-06T23:22:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.146+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.146+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fafe0 0x5645612f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.146+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 0x564561301e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.146+0000 7ff139fabb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645610bc8c0 con 0x5645612fafe0 2023-10-06T23:22:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.146+0000 7ff139fabb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645612e9b20 con 0x5645612fb9a0 2023-10-06T23:22:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.146+0000 7ff139fabb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645612f3210 con 0x5645612f9ed0 2023-10-06T23:22:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff117fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff117fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59958/0 (socket says 172.21.15.8:59958) 2023-10-06T23:22:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff117fff700 1 -- 172.21.15.8:0/2616343646 learned_addr learned my addr 172.21.15.8:0/2616343646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff124b9c700 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 0x564561301e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff11ffff700 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fafe0 0x5645612f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff117fff700 1 -- 172.21.15.8:0/2616343646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 msgr2=0x564561301e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff117fff700 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 0x564561301e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff117fff700 1 -- 172.21.15.8:0/2616343646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fafe0 msgr2=0x5645612f14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff117fff700 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fafe0 0x5645612f14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.147+0000 7ff117fff700 1 -- 172.21.15.8:0/2616343646 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56456108d1f0 con 0x5645612f9ed0 2023-10-06T23:22:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.148+0000 7ff117fff700 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fb3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff110009230 tx=0x7ff110009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21cd7b8f6ba08a4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.148+0000 7ff116ffd700 1 -- 172.21.15.8:0/2616343646 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11002d050 con 0x5645612f9ed0 2023-10-06T23:22:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.148+0000 7ff116ffd700 1 -- 172.21.15.8:0/2616343646 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff11002e040 con 0x5645612f9ed0 2023-10-06T23:22:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.148+0000 7ff116ffd700 1 -- 172.21.15.8:0/2616343646 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000b7c0 con 0x5645612f9ed0 2023-10-06T23:22:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.149+0000 7ff139fabb80 1 -- 172.21.15.8:0/2616343646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 msgr2=0x5645612fb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.149+0000 7ff139fabb80 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fb3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff110009230 tx=0x7ff110009260 comp rx=0 tx=0).stop 2023-10-06T23:22:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.150+0000 7ff139fabb80 1 -- 172.21.15.8:0/2616343646 shutdown_connections 2023-10-06T23:22:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.150+0000 7ff139fabb80 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 0x564561301e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.150+0000 7ff139fabb80 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612f9ed0 0x5645612fb3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.150+0000 7ff139fabb80 1 --2- 172.21.15.8:0/2616343646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612fafe0 0x5645612f14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.150+0000 7ff139fabb80 1 -- 172.21.15.8:0/2616343646 >> 172.21.15.8:0/2616343646 conn(0x56456125d200 msgr2=0x5645612e8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.150+0000 7ff139fabb80 1 -- 172.21.15.8:0/2616343646 shutdown_connections 2023-10-06T23:22:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.150+0000 7ff139fabb80 1 -- 172.21.15.8:0/2616343646 wait complete. 2023-10-06T23:22:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.151+0000 7ff139fabb80 1 -- start start 2023-10-06T23:22:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.151+0000 7ff139fabb80 1 Processor -- start 2023-10-06T23:22:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.152+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612f9ed0 0x5645612f1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.152+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612edd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.152+0000 7ff139fabb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 0x5645612ee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.152+0000 7ff139fabb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645612ee840 con 0x5645612f9ed0 2023-10-06T23:22:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.152+0000 7ff139fabb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564561373830 con 0x5645612fb9a0 2023-10-06T23:22:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.152+0000 7ff139fabb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564561373970 con 0x5645612fafe0 2023-10-06T23:22:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.152+0000 7ff139fabb80 10 client.0 _ll_register_callbacks cb 0x7ff10809a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff11ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff11ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612edd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59962/0 (socket says 172.21.15.8:59962) 2023-10-06T23:22:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff11ffff700 1 -- 172.21.15.8:0/3262184015 learned_addr learned my addr 172.21.15.8:0/3262184015 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff124b9c700 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 0x5645612ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff117fff700 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612f9ed0 0x5645612f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff11ffff700 1 -- 172.21.15.8:0/3262184015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 msgr2=0x5645612ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff11ffff700 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 0x5645612ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff11ffff700 1 -- 172.21.15.8:0/3262184015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612f9ed0 msgr2=0x5645612f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff11ffff700 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612f9ed0 0x5645612f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.153+0000 7ff11ffff700 1 -- 172.21.15.8:0/3262184015 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff120110270 con 0x5645612fafe0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.154+0000 7ff11ffff700 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612edd20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff10800c5b0 tx=0x7ff108099310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b2a942be44a9d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.154+0000 7ff0ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.154+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3262184015 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108096600 con 0x5645612fafe0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.154+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3262184015 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff10809e410 con 0x5645612fafe0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.154+0000 7ff139fabb80 1 -- 172.21.15.8:0/3262184015 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff11800f040 con 0x5645612fafe0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.154+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3262184015 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff10809a2c0 con 0x5645612fafe0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.154+0000 7ff139fabb80 10 client.26365 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.154+0000 7ff139fabb80 1 -- 172.21.15.8:0/3262184015 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x564561065250 con 0x5645612fafe0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.155+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3262184015 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff11800f040 con 0x5645612fafe0 2023-10-06T23:22:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.155+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3262184015 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff1080b8370 con 0x5645612fafe0 2023-10-06T23:22:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.155+0000 7ff139fabb80 10 client.26365 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.155+0000 7ff139fabb80 10 client.26365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.155+0000 7ff139fabb80 20 client.26365 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.155+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564561374f80 0x5645613773a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.155+0000 7ff139fabb80 4 client.26365 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:22:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.155+0000 7ff139fabb80 1 -- 172.21.15.8:0/3262184015 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564561234ad0 con 0x564561374f80 2023-10-06T23:22:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.156+0000 7ff117fff700 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564561374f80 0x5645613773a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.156+0000 7ff117fff700 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564561374f80 0x5645613773a0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1087eaef5482ca57 server_cookie=33d662af3078cc0e in_seq=0 out_seq=0 2023-10-06T23:22:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.156+0000 7ff0ff7fe700 10 client.26365 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff0ff7fe700 1 -- 172.21.15.8:0/3262184015 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564561234ad0 con 0x564561374f80 2023-10-06T23:22:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff0ff7fe700 10 client.26365 handle_command_reply: tid=0 2023-10-06T23:22:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 client.26365 shutdown 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 -- 172.21.15.8:0/3262184015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 msgr2=0x5645612edd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612edd20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff10800c5b0 tx=0x7ff108099310 comp rx=0 tx=0).stop 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 -- 172.21.15.8:0/3262184015 shutdown_connections 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x564561374f80 0x5645613773a0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645612f9ed0 0x5645612f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645612fb9a0 0x5645612ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 --2- 172.21.15.8:0/3262184015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5645612fafe0 0x5645612edd20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 -- 172.21.15.8:0/3262184015 >> 172.21.15.8:0/3262184015 conn(0x56456125d200 msgr2=0x564561301e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff0ff7fe700 0 client.26365 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.171+0000 7ff139fabb80 1 -- 172.21.15.8:0/3262184015 shutdown_connections 2023-10-06T23:22:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.172+0000 7ff139fabb80 1 -- 172.21.15.8:0/3262184015 wait complete. 2023-10-06T23:22:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.172+0000 7ff139fabb80 20 client.26365 trim_cache size 0 max 16384 2023-10-06T23:22:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:22:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:22:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:22:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:22:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.172+0000 7ff1265ff700 1 -- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff10c0a1500 msgr2=0x7ff10c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.172+0000 7ff1265ff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff10c0a1500 0x7ff10c0a39c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff118009610 tx=0x7ff118008bf0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 -- 172.21.15.8:0/2380514095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff120074ef0 msgr2=0x7ff12019d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff120074ef0 0x7ff12019d7f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff10800e9c0 tx=0x7ff10800ecd0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 -- 172.21.15.8:0/2380514095 shutdown_connections 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff10c0a1500 0x7ff10c0a39c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff120073910 0x7ff12019d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff12010d4d0 0x7ff12019e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 --2- 172.21.15.8:0/2380514095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff120074ef0 0x7ff12019d7f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 -- 172.21.15.8:0/2380514095 >> 172.21.15.8:0/2380514095 conn(0x7ff1200fc430 msgr2=0x7ff1200fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 -- 172.21.15.8:0/2380514095 shutdown_connections 2023-10-06T23:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:27.173+0000 7ff1265ff700 1 -- 172.21.15.8:0/2380514095 wait complete. 2023-10-06T23:22:27.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:27 smithi156 ceph-mon[102862]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 5.1 MiB/s wr, 571 op/s 2023-10-06T23:22:27.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:27 smithi008 ceph-mon[98532]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 5.1 MiB/s wr, 571 op/s 2023-10-06T23:22:27.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:27 smithi190 ceph-mon[102658]: pgmap v638: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 5.1 MiB/s wr, 571 op/s 2023-10-06T23:22:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 455.0 s, 260.0 tps, lat 384.798 ms stddev 48.027 2023-10-06T23:22:29.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:29 smithi156 ceph-mon[102862]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 5.0 MiB/s wr, 559 op/s 2023-10-06T23:22:29.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:29 smithi008 ceph-mon[98532]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 5.0 MiB/s wr, 559 op/s 2023-10-06T23:22:29.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:29 smithi190 ceph-mon[102658]: pgmap v639: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 5.0 MiB/s wr, 559 op/s 2023-10-06T23:22:31.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:31 smithi156 ceph-mon[102862]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 6.0 MiB/s wr, 642 op/s 2023-10-06T23:22:31.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:31 smithi008 ceph-mon[98532]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 6.0 MiB/s wr, 642 op/s 2023-10-06T23:22:31.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:31 smithi190 ceph-mon[102658]: pgmap v640: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 6.0 MiB/s wr, 642 op/s 2023-10-06T23:22:33.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:33 smithi190 ceph-mon[102658]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2023-10-06T23:22:33.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:33 smithi156 ceph-mon[102862]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2023-10-06T23:22:33.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:33 smithi008 ceph-mon[98532]: pgmap v641: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2023-10-06T23:22:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 460.0 s, 297.2 tps, lat 329.513 ms stddev 62.576 2023-10-06T23:22:35.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:35 smithi156 ceph-mon[102862]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.2 MiB/s wr, 590 op/s 2023-10-06T23:22:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:35 smithi008 ceph-mon[98532]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.2 MiB/s wr, 590 op/s 2023-10-06T23:22:35.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:35 smithi190 ceph-mon[102658]: pgmap v642: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.2 MiB/s wr, 590 op/s 2023-10-06T23:22:37.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:37 smithi156 ceph-mon[102862]: pgmap v643: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 4.6 MiB/s wr, 543 op/s 2023-10-06T23:22:37.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:37 smithi008 ceph-mon[98532]: pgmap v643: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 4.6 MiB/s wr, 543 op/s 2023-10-06T23:22:37.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:37 smithi190 ceph-mon[102658]: pgmap v643: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 4.6 MiB/s wr, 543 op/s 2023-10-06T23:22:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 465.0 s, 246.6 tps, lat 382.888 ms stddev 73.480 2023-10-06T23:22:39.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:39 smithi156 ceph-mon[102862]: pgmap v644: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.9 MiB/s wr, 561 op/s 2023-10-06T23:22:39.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:39 smithi008 ceph-mon[98532]: pgmap v644: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.9 MiB/s wr, 561 op/s 2023-10-06T23:22:39.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:39 smithi190 ceph-mon[102658]: pgmap v644: 97 pgs: 97 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.9 MiB/s wr, 561 op/s 2023-10-06T23:22:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.411+0000 7fc760dff700 1 -- 172.21.15.8:0/2555917155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c100ea0 msgr2=0x7fc75c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.411+0000 7fc760dff700 1 --2- 172.21.15.8:0/2555917155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c100ea0 0x7fc75c1012c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009990 tx=0x7fc74c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.411+0000 7fc760dff700 1 -- 172.21.15.8:0/2555917155 shutdown_connections 2023-10-06T23:22:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.411+0000 7fc760dff700 1 --2- 172.21.15.8:0/2555917155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75c102a40 0x7fc75c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.411+0000 7fc760dff700 1 --2- 172.21.15.8:0/2555917155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c100ea0 0x7fc75c1012c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.411+0000 7fc760dff700 1 --2- 172.21.15.8:0/2555917155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc75c102080 0x7fc75c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.411+0000 7fc760dff700 1 -- 172.21.15.8:0/2555917155 >> 172.21.15.8:0/2555917155 conn(0x7fc75c0fc480 msgr2=0x7fc75c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.412+0000 7fc760dff700 1 -- 172.21.15.8:0/2555917155 shutdown_connections 2023-10-06T23:22:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.412+0000 7fc760dff700 1 -- 172.21.15.8:0/2555917155 wait complete. 2023-10-06T23:22:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.414+0000 7fc760dff700 1 Processor -- start 2023-10-06T23:22:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.414+0000 7fc760dff700 1 -- start start 2023-10-06T23:22:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc760dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc75c100ea0 0x7fc75c198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc760dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75c102080 0x7fc75c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc760dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c102a40 0x7fc75c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc760dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c19a840 con 0x7fc75c100ea0 2023-10-06T23:22:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc760dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c19a9b0 con 0x7fc75c102080 2023-10-06T23:22:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc760dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c19ab70 con 0x7fc75c102a40 2023-10-06T23:22:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc75a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc75c100ea0 0x7fc75c198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc75a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc75c100ea0 0x7fc75c198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35840/0 (socket says 172.21.15.8:35840) 2023-10-06T23:22:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.415+0000 7fc75a59c700 1 -- 172.21.15.8:0/3976139976 learned_addr learned my addr 172.21.15.8:0/3976139976 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.416+0000 7fc759d9b700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75c102080 0x7fc75c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.416+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c102a40 0x7fc75c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.416+0000 7fc75ad9d700 1 -- 172.21.15.8:0/3976139976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75c102080 msgr2=0x7fc75c199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.416+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75c102080 0x7fc75c199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.416+0000 7fc75ad9d700 1 -- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc75c100ea0 msgr2=0x7fc75c198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.416+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc75c100ea0 0x7fc75c198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.416+0000 7fc75ad9d700 1 -- 172.21.15.8:0/3976139976 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0095f0 con 0x7fc75c102a40 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.416+0000 7fc75a59c700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc75c100ea0 0x7fc75c198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.417+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c102a40 0x7fc75c19a140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc75400efc0 tx=0x7fc75400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.417+0000 7fc74b7fe700 1 -- 172.21.15.8:0/3976139976 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754018070 con 0x7fc75c102a40 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.417+0000 7fc74b7fe700 1 -- 172.21.15.8:0/3976139976 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc75400f040 con 0x7fc75c102a40 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.417+0000 7fc74b7fe700 1 -- 172.21.15.8:0/3976139976 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75400cba0 con 0x7fc75c102a40 2023-10-06T23:22:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.418+0000 7fc760dff700 1 -- 172.21.15.8:0/3976139976 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c19adf0 con 0x7fc75c102a40 2023-10-06T23:22:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.418+0000 7fc760dff700 1 -- 172.21.15.8:0/3976139976 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c1a1570 con 0x7fc75c102a40 2023-10-06T23:22:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.423+0000 7fc77473db80 1 Processor -- start 2023-10-06T23:22:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.423+0000 7fc74b7fe700 1 -- 172.21.15.8:0/3976139976 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc754003a00 con 0x7fc75c102a40 2023-10-06T23:22:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.423+0000 7fc77473db80 1 -- start start 2023-10-06T23:22:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc77473db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b303faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc77473db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3040c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc77473db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30411a0 0x55d8b3047a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc77473db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b2f9f400 con 0x55d8b30407e0 2023-10-06T23:22:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc77473db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b2f90bc0 con 0x55d8b303f6d0 2023-10-06T23:22:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc77473db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b2f8e4e0 con 0x55d8b30411a0 2023-10-06T23:22:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc759d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b303faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc759d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b303faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41790/0 (socket says 172.21.15.8:41790) 2023-10-06T23:22:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc759d9b700 1 -- 172.21.15.8:0/881297176 learned_addr learned my addr 172.21.15.8:0/881297176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.424+0000 7fc75a59c700 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.425+0000 7fc759d9b700 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30411a0 0x55d8b3047a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.425+0000 7fc75a59c700 1 -- 172.21.15.8:0/881297176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30411a0 msgr2=0x55d8b3047a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.425+0000 7fc75a59c700 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30411a0 0x55d8b3047a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.425+0000 7fc75a59c700 1 -- 172.21.15.8:0/881297176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 msgr2=0x55d8b303faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.425+0000 7fc75a59c700 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b303faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.425+0000 7fc75a59c700 1 -- 172.21.15.8:0/881297176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8b2db4d80 con 0x55d8b30407e0 2023-10-06T23:22:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.426+0000 7fc74b7fe700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7440a1550 0x7fc7440a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.426+0000 7fc75a59c700 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3040c60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc74c005910 tx=0x7fc74c004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ca83acfbebe9e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.426+0000 7fc74b7fe700 1 -- 172.21.15.8:0/3976139976 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc7540cc750 con 0x7fc75c102a40 2023-10-06T23:22:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.426+0000 7fc759d9b700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7440a1550 0x7fc7440a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.426+0000 7fc748ff9700 1 -- 172.21.15.8:0/881297176 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c01d070 con 0x55d8b30407e0 2023-10-06T23:22:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.426+0000 7fc748ff9700 1 -- 172.21.15.8:0/881297176 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc74c01e040 con 0x55d8b30407e0 2023-10-06T23:22:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.427+0000 7fc748ff9700 1 -- 172.21.15.8:0/881297176 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00bab0 con 0x55d8b30407e0 2023-10-06T23:22:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.427+0000 7fc77473db80 1 -- 172.21.15.8:0/881297176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 msgr2=0x55d8b3040c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.427+0000 7fc77473db80 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3040c60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc74c005910 tx=0x7fc74c004000 comp rx=0 tx=0).stop 2023-10-06T23:22:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.427+0000 7fc77473db80 1 -- 172.21.15.8:0/881297176 shutdown_connections 2023-10-06T23:22:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.427+0000 7fc77473db80 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30411a0 0x55d8b3047a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.427+0000 7fc77473db80 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b303faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.427+0000 7fc77473db80 1 --2- 172.21.15.8:0/881297176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3040c60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.427+0000 7fc77473db80 1 -- 172.21.15.8:0/881297176 >> 172.21.15.8:0/881297176 conn(0x55d8b2fab200 msgr2=0x55d8b3031b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.428+0000 7fc759d9b700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7440a1550 0x7fc7440a3a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55d8b303f470 tx=0x7fc75000b860 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.428+0000 7fc77473db80 1 -- 172.21.15.8:0/881297176 shutdown_connections 2023-10-06T23:22:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.428+0000 7fc77473db80 1 -- 172.21.15.8:0/881297176 wait complete. 2023-10-06T23:22:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.428+0000 7fc77473db80 1 -- start start 2023-10-06T23:22:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.429+0000 7fc77473db80 1 Processor -- start 2023-10-06T23:22:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.429+0000 7fc77473db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b303f6d0 0x55d8b3049250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.429+0000 7fc77473db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3049790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.429+0000 7fc77473db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b30507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.429+0000 7fc77473db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b2f89dd0 con 0x55d8b30407e0 2023-10-06T23:22:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.429+0000 7fc77473db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b2f266b0 con 0x55d8b30411a0 2023-10-06T23:22:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.429+0000 7fc77473db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b2f26350 con 0x55d8b303f6d0 2023-10-06T23:22:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.429+0000 7fc77473db80 10 client.0 _ll_register_callbacks cb 0x55d8b2d837a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.430+0000 7fc75ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b30507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.430+0000 7fc75ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b30507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41796/0 (socket says 172.21.15.8:41796) 2023-10-06T23:22:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.430+0000 7fc75ad9d700 1 -- 172.21.15.8:0/2811902987 learned_addr learned my addr 172.21.15.8:0/2811902987 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.430+0000 7fc75a59c700 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b303f6d0 0x55d8b3049250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.430+0000 7fc759d9b700 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3049790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc75ad9d700 1 -- 172.21.15.8:0/2811902987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b303f6d0 msgr2=0x55d8b3049250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b303f6d0 0x55d8b3049250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc75ad9d700 1 -- 172.21.15.8:0/2811902987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 msgr2=0x55d8b3049790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3049790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc75ad9d700 1 -- 172.21.15.8:0/2811902987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c109c90 con 0x55d8b30411a0 2023-10-06T23:22:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b30507d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7540090a0 tx=0x7fc754095f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c0c1f594f8e47fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc741ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:22:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc741ffb700 1 -- 172.21.15.8:0/2811902987 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75409a210 con 0x55d8b30411a0 2023-10-06T23:22:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc741ffb700 1 -- 172.21.15.8:0/2811902987 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc75409ae40 con 0x55d8b30411a0 2023-10-06T23:22:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc77473db80 1 -- 172.21.15.8:0/2811902987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8b3029d50 con 0x55d8b30411a0 2023-10-06T23:22:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.431+0000 7fc741ffb700 1 -- 172.21.15.8:0/2811902987 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7540b2020 con 0x55d8b30411a0 2023-10-06T23:22:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.432+0000 7fc77473db80 10 client.26357 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.432+0000 7fc77473db80 1 -- 172.21.15.8:0/2811902987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d8b2d9dc00 con 0x55d8b30411a0 2023-10-06T23:22:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.432+0000 7fc741ffb700 1 -- 172.21.15.8:0/2811902987 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7540b6070 con 0x55d8b30411a0 2023-10-06T23:22:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.433+0000 7fc741ffb700 1 -- 172.21.15.8:0/2811902987 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc7540b2180 con 0x55d8b30411a0 2023-10-06T23:22:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.433+0000 7fc77473db80 10 client.26357 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.433+0000 7fc77473db80 10 client.26357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.433+0000 7fc77473db80 20 client.26357 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.433+0000 7fc77473db80 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d8b30550f0 0x55d8b3057510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.433+0000 7fc77473db80 4 client.26357 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:22:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.433+0000 7fc77473db80 1 -- 172.21.15.8:0/2811902987 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8b2f82db0 con 0x55d8b30550f0 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.434+0000 7fc75a59c700 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d8b30550f0 0x55d8b3057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.435+0000 7fc75a59c700 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d8b30550f0 0x55d8b3057510 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a616d1862fd2da4a server_cookie=ae0313afdff9808f in_seq=0 out_seq=0 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.435+0000 7fc741ffb700 10 client.26357 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.436+0000 7fc741ffb700 1 -- 172.21.15.8:0/2811902987 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d8b2f82db0 con 0x55d8b30550f0 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.436+0000 7fc741ffb700 10 client.26357 handle_command_reply: tid=0 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.436+0000 7fc77473db80 1 client.26357 shutdown 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 -- 172.21.15.8:0/2811902987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 msgr2=0x55d8b30507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b30507d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7540090a0 tx=0x7fc754095f60 comp rx=0 tx=0).stop 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 -- 172.21.15.8:0/2811902987 shutdown_connections 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d8b30550f0 0x55d8b3057510 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b30507d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b303f6d0 0x55d8b3049250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 --2- 172.21.15.8:0/2811902987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30407e0 0x55d8b3049790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc741ffb700 0 client.26357 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 -- 172.21.15.8:0/2811902987 >> 172.21.15.8:0/2811902987 conn(0x55d8b2fab200 msgr2=0x55d8b3031250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.437+0000 7fc77473db80 1 -- 172.21.15.8:0/2811902987 shutdown_connections 2023-10-06T23:22:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.438+0000 7fc77473db80 1 -- 172.21.15.8:0/2811902987 wait complete. 2023-10-06T23:22:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.438+0000 7fc77473db80 20 client.26357 trim_cache size 0 max 16384 2023-10-06T23:22:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.466+0000 7fc77473db80 1 Processor -- start 2023-10-06T23:22:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.466+0000 7fc77473db80 1 -- start start 2023-10-06T23:22:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.467+0000 7fc77473db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b303f6d0 0x55d8b3048900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.467+0000 7fc77473db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b3050790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.467+0000 7fc77473db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b3031250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.467+0000 7fc77473db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b2e0a8c0 con 0x55d8b303f6d0 2023-10-06T23:22:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.467+0000 7fc77473db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b3032b60 con 0x55d8b30411a0 2023-10-06T23:22:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.467+0000 7fc77473db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b3032f50 con 0x55d8b30407e0 2023-10-06T23:22:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc75a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b303f6d0 0x55d8b3048900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc75a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b303f6d0 0x55d8b3048900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35868/0 (socket says 172.21.15.8:35868) 2023-10-06T23:22:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc75a59c700 1 -- 172.21.15.8:0/347146716 learned_addr learned my addr 172.21.15.8:0/347146716 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc759d9b700 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b3050790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b3031250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc759d9b700 1 -- 172.21.15.8:0/347146716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 msgr2=0x55d8b3031250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc759d9b700 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b3031250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc759d9b700 1 -- 172.21.15.8:0/347146716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b303f6d0 msgr2=0x55d8b3048900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc759d9b700 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b303f6d0 0x55d8b3048900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.468+0000 7fc759d9b700 1 -- 172.21.15.8:0/347146716 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8b2ddb1f0 con 0x55d8b30407e0 2023-10-06T23:22:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.469+0000 7fc759d9b700 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b3050790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7500058e0 tx=0x7fc750004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aea4b5d244a9c508 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.469+0000 7fc7497fa700 1 -- 172.21.15.8:0/347146716 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750003a60 con 0x55d8b30407e0 2023-10-06T23:22:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.469+0000 7fc7497fa700 1 -- 172.21.15.8:0/347146716 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc750026040 con 0x55d8b30407e0 2023-10-06T23:22:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.469+0000 7fc7497fa700 1 -- 172.21.15.8:0/347146716 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75001fd70 con 0x55d8b30407e0 2023-10-06T23:22:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.470+0000 7fc77473db80 1 -- 172.21.15.8:0/347146716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 msgr2=0x55d8b3050790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.471+0000 7fc77473db80 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b3050790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7500058e0 tx=0x7fc750004750 comp rx=0 tx=0).stop 2023-10-06T23:22:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.471+0000 7fc77473db80 1 -- 172.21.15.8:0/347146716 shutdown_connections 2023-10-06T23:22:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.471+0000 7fc77473db80 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b303f6d0 0x55d8b3048900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.471+0000 7fc77473db80 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b30411a0 0x55d8b3031250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.471+0000 7fc77473db80 1 --2- 172.21.15.8:0/347146716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b3050790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.471+0000 7fc77473db80 1 -- 172.21.15.8:0/347146716 >> 172.21.15.8:0/347146716 conn(0x55d8b2fab200 msgr2=0x55d8b3031af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.471+0000 7fc77473db80 1 -- 172.21.15.8:0/347146716 shutdown_connections 2023-10-06T23:22:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.471+0000 7fc77473db80 1 -- 172.21.15.8:0/347146716 wait complete. 2023-10-06T23:22:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.472+0000 7fc77473db80 1 -- start start 2023-10-06T23:22:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.472+0000 7fc77473db80 1 Processor -- start 2023-10-06T23:22:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.473+0000 7fc77473db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b304e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.473+0000 7fc77473db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b304eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.473+0000 7fc77473db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30411a0 0x55d8b304fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.473+0000 7fc77473db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b3050040 con 0x55d8b30411a0 2023-10-06T23:22:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.473+0000 7fc77473db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b30501b0 con 0x55d8b303f6d0 2023-10-06T23:22:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.473+0000 7fc77473db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b3050370 con 0x55d8b30407e0 2023-10-06T23:22:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.473+0000 7fc77473db80 10 client.0 _ll_register_callbacks cb 0x7fc7540998e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b304e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc759d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b304eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b304e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41810/0 (socket says 172.21.15.8:41810) 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75a59c700 1 -- 172.21.15.8:0/1414108898 learned_addr learned my addr 172.21.15.8:0/1414108898 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75ad9d700 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30411a0 0x55d8b304fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75a59c700 1 -- 172.21.15.8:0/1414108898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 msgr2=0x55d8b304eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75a59c700 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b304eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75a59c700 1 -- 172.21.15.8:0/1414108898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30411a0 msgr2=0x55d8b304fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75a59c700 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30411a0 0x55d8b304fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc75a59c700 1 -- 172.21.15.8:0/1414108898 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75001a040 con 0x55d8b303f6d0 2023-10-06T23:22:40.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.474+0000 7fc759d9b700 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b304eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:40.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.475+0000 7fc75a59c700 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b304e5b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00b2e0 tx=0x7fc74c005cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b420e89ae8a3619 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.475+0000 7fc741ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:22:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.475+0000 7fc741ffb700 1 -- 172.21.15.8:0/1414108898 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c033070 con 0x55d8b303f6d0 2023-10-06T23:22:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.476+0000 7fc741ffb700 1 -- 172.21.15.8:0/1414108898 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc74c0333e0 con 0x55d8b303f6d0 2023-10-06T23:22:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.476+0000 7fc77473db80 1 -- 172.21.15.8:0/1414108898 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc74c01e040 con 0x55d8b303f6d0 2023-10-06T23:22:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.476+0000 7fc741ffb700 1 -- 172.21.15.8:0/1414108898 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc74c01d040 con 0x55d8b303f6d0 2023-10-06T23:22:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.476+0000 7fc77473db80 10 client.26363 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.476+0000 7fc77473db80 1 -- 172.21.15.8:0/1414108898 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d8b2db3250 con 0x55d8b303f6d0 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.477+0000 7fc741ffb700 1 -- 172.21.15.8:0/1414108898 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc74c01e040 con 0x55d8b303f6d0 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.477+0000 7fc741ffb700 1 -- 172.21.15.8:0/1414108898 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc74c033b60 con 0x55d8b303f6d0 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.477+0000 7fc77473db80 10 client.26363 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.477+0000 7fc77473db80 10 client.26363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.477+0000 7fc77473db80 20 client.26363 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.477+0000 7fc77473db80 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d8b30a9b30 0x55d8b30abf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.477+0000 7fc77473db80 4 client.26363 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.477+0000 7fc77473db80 1 -- 172.21.15.8:0/1414108898 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8b2f82ad0 con 0x55d8b30a9b30 2023-10-06T23:22:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.478+0000 7fc759d9b700 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d8b30a9b30 0x55d8b30abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.478+0000 7fc759d9b700 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d8b30a9b30 0x55d8b30abf50 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c7ad2a8f58281f server_cookie=6b00a5ba42ffcbc4 in_seq=0 out_seq=0 2023-10-06T23:22:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.479+0000 7fc741ffb700 10 client.26363 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.494+0000 7fc741ffb700 1 -- 172.21.15.8:0/1414108898 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8b2f82ad0 con 0x55d8b30a9b30 2023-10-06T23:22:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc741ffb700 10 client.26363 handle_command_reply: tid=0 2023-10-06T23:22:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 client.26363 shutdown 2023-10-06T23:22:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 -- 172.21.15.8:0/1414108898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 msgr2=0x55d8b304e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b304e5b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00b2e0 tx=0x7fc74c005cb0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 -- 172.21.15.8:0/1414108898 shutdown_connections 2023-10-06T23:22:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d8b30a9b30 0x55d8b30abf50 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d8b30411a0 0x55d8b304fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8b303f6d0 0x55d8b304e5b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 --2- 172.21.15.8:0/1414108898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8b30407e0 0x55d8b304eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc77473db80 1 -- 172.21.15.8:0/1414108898 >> 172.21.15.8:0/1414108898 conn(0x55d8b2fab200 msgr2=0x55d8b3044060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.495+0000 7fc741ffb700 0 client.26363 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.496+0000 7fc77473db80 1 -- 172.21.15.8:0/1414108898 shutdown_connections 2023-10-06T23:22:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.496+0000 7fc77473db80 1 -- 172.21.15.8:0/1414108898 wait complete. 2023-10-06T23:22:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.496+0000 7fc77473db80 20 client.26363 trim_cache size 0 max 16384 2023-10-06T23:22:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:22:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:22:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:22:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:22:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.497+0000 7fc760dff700 1 -- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7440a1550 msgr2=0x7fc7440a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.497+0000 7fc760dff700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7440a1550 0x7fc7440a3a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55d8b303f470 tx=0x7fc75000b860 comp rx=0 tx=0).stop 2023-10-06T23:22:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.497+0000 7fc760dff700 1 -- 172.21.15.8:0/3976139976 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c102a40 msgr2=0x7fc75c19a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.497+0000 7fc760dff700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c102a40 0x7fc75c19a140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc75400efc0 tx=0x7fc75400c3a0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.498+0000 7fc760dff700 1 -- 172.21.15.8:0/3976139976 shutdown_connections 2023-10-06T23:22:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.498+0000 7fc760dff700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fc7440a1550 0x7fc7440a3a10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.498+0000 7fc760dff700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc75c100ea0 0x7fc75c198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.498+0000 7fc760dff700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc75c102a40 0x7fc75c19a140 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.498+0000 7fc760dff700 1 --2- 172.21.15.8:0/3976139976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc75c102080 0x7fc75c199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.498+0000 7fc760dff700 1 -- 172.21.15.8:0/3976139976 >> 172.21.15.8:0/3976139976 conn(0x7fc75c0fc480 msgr2=0x7fc75c107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.501+0000 7fc760dff700 1 -- 172.21.15.8:0/3976139976 shutdown_connections 2023-10-06T23:22:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:40.501+0000 7fc760dff700 1 -- 172.21.15.8:0/3976139976 wait complete. 2023-10-06T23:22:41.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:41 smithi156 ceph-mon[102862]: pgmap v645: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 5.4 MiB/s wr, 608 op/s 2023-10-06T23:22:41.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:41 smithi008 ceph-mon[98532]: pgmap v645: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 5.4 MiB/s wr, 608 op/s 2023-10-06T23:22:41.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:41 smithi190 ceph-mon[102658]: pgmap v645: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 5.4 MiB/s wr, 608 op/s 2023-10-06T23:22:43.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:43 smithi190 ceph-mon[102658]: pgmap v646: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 3.7 MiB/s wr, 473 op/s 2023-10-06T23:22:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:43 smithi156 ceph-mon[102862]: pgmap v646: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 3.7 MiB/s wr, 473 op/s 2023-10-06T23:22:43.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:43 smithi008 ceph-mon[98532]: pgmap v646: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 3.7 MiB/s wr, 473 op/s 2023-10-06T23:22:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 470.0 s, 262.8 tps, lat 408.326 ms stddev 150.576 2023-10-06T23:22:44.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:44 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:22:44.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:44 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:22:45.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:44 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:22:45.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:45 smithi008 ceph-mon[98532]: pgmap v647: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.1 MiB/s wr, 594 op/s 2023-10-06T23:22:45.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:45 smithi190 ceph-mon[102658]: pgmap v647: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.1 MiB/s wr, 594 op/s 2023-10-06T23:22:46.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:45 smithi156 ceph-mon[102862]: pgmap v647: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.1 MiB/s wr, 594 op/s 2023-10-06T23:22:46.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:46 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:22:46.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:46 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:22:46.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:46 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:22:46.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:46 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:22:46.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:46 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:22:46.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:46 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:22:47.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:46 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:22:47.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:46 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:22:47.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:46 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:22:47.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:47 smithi008 ceph-mon[98532]: pgmap v648: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 4.4 MiB/s wr, 535 op/s 2023-10-06T23:22:47.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:47 smithi190 ceph-mon[102658]: pgmap v648: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 4.4 MiB/s wr, 535 op/s 2023-10-06T23:22:48.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:47 smithi156 ceph-mon[102862]: pgmap v648: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 4.4 MiB/s wr, 535 op/s 2023-10-06T23:22:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 475.0 s, 287.0 tps, lat 350.941 ms stddev 51.550 2023-10-06T23:22:49.045 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 -- 172.21.15.8:0/948645380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594108e10 msgr2=0x7ff59410b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/948645380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594108e10 0x7ff59410b280 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00b0a0 tx=0x7ff58c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 -- 172.21.15.8:0/948645380 shutdown_connections 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/948645380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594108e10 0x7ff59410b280 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/948645380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff594074e90 0x7ff5940732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/948645380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff5940738b0 0x7ff594073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 -- 172.21.15.8:0/948645380 >> 172.21.15.8:0/948645380 conn(0x7ff5940fc4d0 msgr2=0x7ff5940fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 -- 172.21.15.8:0/948645380 shutdown_connections 2023-10-06T23:22:49.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.385+0000 7ff59a5ff700 1 -- 172.21.15.8:0/948645380 wait complete. 2023-10-06T23:22:49.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.387+0000 7ff59a5ff700 1 Processor -- start 2023-10-06T23:22:49.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.387+0000 7ff59a5ff700 1 -- start start 2023-10-06T23:22:49.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.387+0000 7ff59a5ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5940738b0 0x7ff594198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.387+0000 7ff59a5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594074e90 0x7ff594199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.387+0000 7ff59a5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff594108e10 0x7ff5941a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.387+0000 7ff59a5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5941a0880 con 0x7ff594074e90 2023-10-06T23:22:49.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.387+0000 7ff59a5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5941a09f0 con 0x7ff594108e10 2023-10-06T23:22:49.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.387+0000 7ff59a5ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5941a0bb0 con 0x7ff5940738b0 2023-10-06T23:22:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff598b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff594108e10 0x7ff5941a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff598b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff594108e10 0x7ff5941a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41842/0 (socket says 172.21.15.8:41842) 2023-10-06T23:22:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff598b9c700 1 -- 172.21.15.8:0/3205160333 learned_addr learned my addr 172.21.15.8:0/3205160333 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff58bfff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594074e90 0x7ff594199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff593fff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5940738b0 0x7ff594198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff598b9c700 1 -- 172.21.15.8:0/3205160333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5940738b0 msgr2=0x7ff594198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff598b9c700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5940738b0 0x7ff594198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff598b9c700 1 -- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594074e90 msgr2=0x7ff594199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff598b9c700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594074e90 0x7ff594199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff598b9c700 1 -- 172.21.15.8:0/3205160333 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c009d00 con 0x7ff594108e10 2023-10-06T23:22:49.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.388+0000 7ff593fff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5940738b0 0x7ff594198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:22:49.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.389+0000 7ff58bfff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594074e90 0x7ff594199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:22:49.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.389+0000 7ff598b9c700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff594108e10 0x7ff5941a02b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0062a0 tx=0x7ff58c00bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.389+0000 7ff591ffb700 1 -- 172.21.15.8:0/3205160333 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00e040 con 0x7ff594108e10 2023-10-06T23:22:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.389+0000 7ff59a5ff700 1 -- 172.21.15.8:0/3205160333 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5941a0e30 con 0x7ff594108e10 2023-10-06T23:22:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.389+0000 7ff591ffb700 1 -- 172.21.15.8:0/3205160333 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff58c003e10 con 0x7ff594108e10 2023-10-06T23:22:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.389+0000 7ff591ffb700 1 -- 172.21.15.8:0/3205160333 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0052a0 con 0x7ff594108e10 2023-10-06T23:22:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.390+0000 7ff59a5ff700 1 -- 172.21.15.8:0/3205160333 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5941a11f0 con 0x7ff594108e10 2023-10-06T23:22:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.394+0000 7ff591ffb700 1 -- 172.21.15.8:0/3205160333 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff58c01d480 con 0x7ff594108e10 2023-10-06T23:22:49.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.396+0000 7ff5adfdcb80 1 Processor -- start 2023-10-06T23:22:49.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.397+0000 7ff5adfdcb80 1 -- start start 2023-10-06T23:22:49.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.397+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585f2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.397+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2bc0 0x5602585f3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.397+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f3a60 0x5602585f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.397+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025855a460 con 0x5602585f3a60 2023-10-06T23:22:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.397+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025854bc20 con 0x5602585f2260 2023-10-06T23:22:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.397+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560258549540 con 0x5602585f2bc0 2023-10-06T23:22:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.397+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41848/0 (socket says 172.21.15.8:41848) 2023-10-06T23:22:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 -- 172.21.15.8:0/1828080633 learned_addr learned my addr 172.21.15.8:0/1828080633 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f3a60 0x5602585f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff593fff700 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2bc0 0x5602585f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 -- 172.21.15.8:0/1828080633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2bc0 msgr2=0x5602585f3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2bc0 0x5602585f3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 -- 172.21.15.8:0/1828080633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f3a60 msgr2=0x5602585f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f3a60 0x5602585f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 -- 172.21.15.8:0/1828080633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56025836fde0 con 0x5602585f2260 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff591ffb700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff5800a15d0 0x7ff5800a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff591ffb700 1 -- 172.21.15.8:0/3205160333 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff58c0cdeb0 con 0x7ff594108e10 2023-10-06T23:22:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.398+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585f2680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5602585f3240 tx=0x7ff57c009820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82888b449abea0bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.399+0000 7ff593fff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff5800a15d0 0x7ff5800a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.399+0000 7ff58a7fc700 1 -- 172.21.15.8:0/1828080633 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c022be0 con 0x5602585f2260 2023-10-06T23:22:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.399+0000 7ff58a7fc700 1 -- 172.21.15.8:0/1828080633 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff57c022d40 con 0x5602585f2260 2023-10-06T23:22:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.399+0000 7ff58a7fc700 1 -- 172.21.15.8:0/1828080633 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00e610 con 0x5602585f2260 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.400+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1828080633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 msgr2=0x5602585f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.400+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585f2680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5602585f3240 tx=0x7ff57c009820 comp rx=0 tx=0).stop 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.400+0000 7ff593fff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff5800a15d0 0x7ff5800a3a90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff59419a210 tx=0x7ff584009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.400+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1828080633 shutdown_connections 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.400+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f3a60 0x5602585f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.400+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585f2680 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.400+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/1828080633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2bc0 0x5602585f3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.400+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1828080633 >> 172.21.15.8:0/1828080633 conn(0x560258566260 msgr2=0x5602585ed140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.401+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1828080633 shutdown_connections 2023-10-06T23:22:49.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.401+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1828080633 wait complete. 2023-10-06T23:22:49.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.401+0000 7ff5adfdcb80 1 -- start start 2023-10-06T23:22:49.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.402+0000 7ff5adfdcb80 1 Processor -- start 2023-10-06T23:22:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.402+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585fc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.402+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602585fc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.402+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258603600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.402+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560258544e30 con 0x5602585f2bc0 2023-10-06T23:22:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.402+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602584e1710 con 0x5602585f2260 2023-10-06T23:22:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.402+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602584e13b0 con 0x5602585f3a60 2023-10-06T23:22:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.402+0000 7ff5adfdcb80 10 client.0 _ll_register_callbacks cb 0x56025833e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.403+0000 7ff593fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585fc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.403+0000 7ff593fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585fc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41854/0 (socket says 172.21.15.8:41854) 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.403+0000 7ff593fff700 1 -- 172.21.15.8:0/2400866934 learned_addr learned my addr 172.21.15.8:0/2400866934 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.403+0000 7ff598b9c700 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258603600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.403+0000 7ff58bfff700 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602585fc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.403+0000 7ff598b9c700 1 -- 172.21.15.8:0/2400866934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 msgr2=0x5602585fc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff598b9c700 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585fc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff598b9c700 1 -- 172.21.15.8:0/2400866934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 msgr2=0x5602585fc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff598b9c700 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602585fc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff598b9c700 1 -- 172.21.15.8:0/2400866934 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c01a040 con 0x5602585f3a60 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff593fff700 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585fc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff598b9c700 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258603600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009fd0 tx=0x7ff58c09ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bad6b0235e33e19a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:49.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff5737fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:22:49.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff5737fe700 1 -- 172.21.15.8:0/2400866934 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c09a900 con 0x5602585f3a60 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff5737fe700 1 -- 172.21.15.8:0/2400866934 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff58c09b910 con 0x5602585f3a60 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.404+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/2400866934 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602585e4f10 con 0x5602585f3a60 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5737fe700 1 -- 172.21.15.8:0/2400866934 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff58c024310 con 0x5602585f3a60 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5adfdcb80 10 client.26392 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/2400866934 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560258358c60 con 0x5602585f3a60 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5737fe700 1 -- 172.21.15.8:0/2400866934 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5602585e4f10 con 0x5602585f3a60 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5737fe700 1 -- 172.21.15.8:0/2400866934 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff58c0b9240 con 0x5602585f3a60 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5adfdcb80 10 client.26392 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5adfdcb80 10 client.26392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:49.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5adfdcb80 20 client.26392 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:49.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560258607bd0 0x560258609fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5adfdcb80 4 client.26392 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:22:49.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.405+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/2400866934 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56025853de10 con 0x560258607bd0 2023-10-06T23:22:49.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.406+0000 7ff593fff700 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560258607bd0 0x560258609fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.407+0000 7ff593fff700 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560258607bd0 0x560258609fc0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a76dfc6aadf82f37 server_cookie=1d80aa80de71ac34 in_seq=0 out_seq=0 2023-10-06T23:22:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.407+0000 7ff5737fe700 10 client.26392 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.407+0000 7ff5737fe700 1 -- 172.21.15.8:0/2400866934 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56025853de10 con 0x560258607bd0 2023-10-06T23:22:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.407+0000 7ff5737fe700 10 client.26392 handle_command_reply: tid=0 2023-10-06T23:22:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.407+0000 7ff5adfdcb80 1 client.26392 shutdown 2023-10-06T23:22:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/2400866934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 msgr2=0x560258603600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258603600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009fd0 tx=0x7ff58c09ad50 comp rx=0 tx=0).stop 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/2400866934 shutdown_connections 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x560258607bd0 0x560258609fc0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258603600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2260 0x5602585fc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/2400866934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602585fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5737fe700 0 client.26392 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/2400866934 >> 172.21.15.8:0/2400866934 conn(0x560258566260 msgr2=0x5602585ecf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/2400866934 shutdown_connections 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/2400866934 wait complete. 2023-10-06T23:22:49.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.408+0000 7ff5adfdcb80 20 client.26392 trim_cache size 0 max 16384 2023-10-06T23:22:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.433+0000 7ff5adfdcb80 1 Processor -- start 2023-10-06T23:22:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.433+0000 7ff5adfdcb80 1 -- start start 2023-10-06T23:22:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.433+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2260 0x5602585f6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.433+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602586035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.433+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f3a60 0x5602585f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.433+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602583c5920 con 0x5602585f2bc0 2023-10-06T23:22:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.433+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602585e7590 con 0x5602585f3a60 2023-10-06T23:22:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.433+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025853de10 con 0x5602585f2260 2023-10-06T23:22:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff598b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f3a60 0x5602585f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff593fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2260 0x5602585f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff598b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f3a60 0x5602585f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41866/0 (socket says 172.21.15.8:41866) 2023-10-06T23:22:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff598b9c700 1 -- 172.21.15.8:0/1886331907 learned_addr learned my addr 172.21.15.8:0/1886331907 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602586035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff58bfff700 1 -- 172.21.15.8:0/1886331907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2260 msgr2=0x5602585f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2260 0x5602585f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff58bfff700 1 -- 172.21.15.8:0/1886331907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f3a60 msgr2=0x5602585f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f3a60 0x5602585f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff58bfff700 1 -- 172.21.15.8:0/1886331907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560258396250 con 0x5602585f2bc0 2023-10-06T23:22:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.434+0000 7ff598b9c700 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f3a60 0x5602585f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.435+0000 7ff58bfff700 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602586035c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff57c025040 tx=0x7ff57c005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4604c324ad3d6478 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.436+0000 7ff58affd700 1 -- 172.21.15.8:0/1886331907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c009640 con 0x5602585f2bc0 2023-10-06T23:22:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.436+0000 7ff58affd700 1 -- 172.21.15.8:0/1886331907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff57c005540 con 0x5602585f2bc0 2023-10-06T23:22:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.436+0000 7ff58affd700 1 -- 172.21.15.8:0/1886331907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00f9c0 con 0x5602585f2bc0 2023-10-06T23:22:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.436+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1886331907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 msgr2=0x5602586035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.437+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602586035c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff57c025040 tx=0x7ff57c005d00 comp rx=0 tx=0).stop 2023-10-06T23:22:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.437+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1886331907 shutdown_connections 2023-10-06T23:22:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.437+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f3a60 0x5602585f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.437+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f2260 0x5602585f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.437+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/1886331907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2bc0 0x5602586035c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.437+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1886331907 >> 172.21.15.8:0/1886331907 conn(0x560258566260 msgr2=0x560258603ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.437+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1886331907 shutdown_connections 2023-10-06T23:22:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.437+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/1886331907 wait complete. 2023-10-06T23:22:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.438+0000 7ff5adfdcb80 1 -- start start 2023-10-06T23:22:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.438+0000 7ff5adfdcb80 1 Processor -- start 2023-10-06T23:22:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2260 0x5602585ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2bc0 0x5602585ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff5adfdcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258602b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560258603060 con 0x5602585f2260 2023-10-06T23:22:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602586031d0 con 0x5602585f2bc0 2023-10-06T23:22:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff5adfdcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560258603390 con 0x5602585f3a60 2023-10-06T23:22:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff5adfdcb80 10 client.0 _ll_register_callbacks cb 0x7ff58c097550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2bc0 0x5602585ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2bc0 0x5602585ffb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:41870/0 (socket says 172.21.15.8:41870) 2023-10-06T23:22:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff58bfff700 1 -- 172.21.15.8:0/142312032 learned_addr learned my addr 172.21.15.8:0/142312032 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff593fff700 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2260 0x5602585ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff598b9c700 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258602b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.439+0000 7ff58bfff700 1 -- 172.21.15.8:0/142312032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 msgr2=0x560258602b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff58bfff700 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258602b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff58bfff700 1 -- 172.21.15.8:0/142312032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2260 msgr2=0x5602585ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff58bfff700 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2260 0x5602585ff5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff58bfff700 1 -- 172.21.15.8:0/142312032 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560258358c60 con 0x5602585f2bc0 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff598b9c700 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258602b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff58bfff700 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2bc0 0x5602585ffb00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff57c005d90 tx=0x7ff57c00f4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da2309a47c13674b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff5737fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff5737fe700 1 -- 172.21.15.8:0/142312032 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0056b0 con 0x5602585f2bc0 2023-10-06T23:22:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff5737fe700 1 -- 172.21.15.8:0/142312032 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff57c00f910 con 0x5602585f2bc0 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.440+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/142312032 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff57c022d40 con 0x5602585f2bc0 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5737fe700 1 -- 172.21.15.8:0/142312032 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff57c00fad0 con 0x5602585f2bc0 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5adfdcb80 10 client.26381 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/142312032 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56025836fde0 con 0x5602585f2bc0 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5737fe700 1 -- 172.21.15.8:0/142312032 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff57c043080 con 0x5602585f2bc0 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5737fe700 1 -- 172.21.15.8:0/142312032 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff57c034660 con 0x5602585f2bc0 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5adfdcb80 10 client.26381 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5adfdcb80 10 client.26381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5adfdcb80 20 client.26381 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56025865c880 0x56025865eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5adfdcb80 4 client.26381 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:22:49.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.441+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/142312032 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56025853db30 con 0x56025865c880 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.442+0000 7ff593fff700 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56025865c880 0x56025865eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.442+0000 7ff593fff700 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56025865c880 0x56025865eca0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c0d8a0469b8264 server_cookie=7d7cdf6dac6fa8c3 in_seq=0 out_seq=0 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.442+0000 7ff5737fe700 10 client.26381 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5737fe700 1 -- 172.21.15.8:0/142312032 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56025853db30 con 0x56025865c880 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5737fe700 10 client.26381 handle_command_reply: tid=0 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 client.26381 shutdown 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/142312032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2bc0 msgr2=0x5602585ffb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2bc0 0x5602585ffb00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff57c005d90 tx=0x7ff57c00f4c0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/142312032 shutdown_connections 2023-10-06T23:22:49.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56025865c880 0x56025865eca0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602585f2260 0x5602585ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5602585f3a60 0x560258602b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 --2- 172.21.15.8:0/142312032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602585f2bc0 0x5602585ffb00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/142312032 >> 172.21.15.8:0/142312032 conn(0x560258566260 msgr2=0x5602585f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.443+0000 7ff5737fe700 0 client.26381 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.444+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/142312032 shutdown_connections 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.444+0000 7ff5adfdcb80 1 -- 172.21.15.8:0/142312032 wait complete. 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.444+0000 7ff5adfdcb80 20 client.26381 trim_cache size 0 max 16384 2023-10-06T23:22:49.448 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:22:49.449 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:22:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 -- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff5800a15d0 msgr2=0x7ff5800a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff5800a15d0 0x7ff5800a3a90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff59419a210 tx=0x7ff584009260 comp rx=0 tx=0).stop 2023-10-06T23:22:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 -- 172.21.15.8:0/3205160333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff594108e10 msgr2=0x7ff5941a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff594108e10 0x7ff5941a02b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0062a0 tx=0x7ff58c00bd70 comp rx=0 tx=0).stop 2023-10-06T23:22:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 -- 172.21.15.8:0/3205160333 shutdown_connections 2023-10-06T23:22:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7ff5800a15d0 0x7ff5800a3a90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff594108e10 0x7ff5941a02b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5940738b0 0x7ff594198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 --2- 172.21.15.8:0/3205160333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff594074e90 0x7ff594199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:49.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 -- 172.21.15.8:0/3205160333 >> 172.21.15.8:0/3205160333 conn(0x7ff5940fc4d0 msgr2=0x7ff5940fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:49.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 -- 172.21.15.8:0/3205160333 shutdown_connections 2023-10-06T23:22:49.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:22:49.445+0000 7ff59a5ff700 1 -- 172.21.15.8:0/3205160333 wait complete. 2023-10-06T23:22:49.468 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:49 smithi008 ceph-mon[98532]: pgmap v649: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2023-10-06T23:22:49.471 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:22:49.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:49 smithi156 ceph-mon[102862]: pgmap v649: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2023-10-06T23:22:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:49 smithi190 ceph-mon[102658]: pgmap v649: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2023-10-06T23:22:51.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:51 smithi156 ceph-mon[102862]: pgmap v650: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 4.9 MiB/s wr, 575 op/s 2023-10-06T23:22:51.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:51 smithi008 ceph-mon[98532]: pgmap v650: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 4.9 MiB/s wr, 575 op/s 2023-10-06T23:22:51.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:51 smithi190 ceph-mon[102658]: pgmap v650: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 4.9 MiB/s wr, 575 op/s 2023-10-06T23:22:53.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:53 smithi190 ceph-mon[102658]: pgmap v651: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2023-10-06T23:22:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.714+0000 7f4210bff700 1 -- 172.21.15.8:0/3589782998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 msgr2=0x7f420c10b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.714+0000 7f4210bff700 1 --2- 172.21.15.8:0/3589782998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 0x7f420c10b570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4204009fc0 tx=0x7f420400b330 comp rx=0 tx=0).stop 2023-10-06T23:22:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.715+0000 7f4210bff700 1 -- 172.21.15.8:0/3589782998 shutdown_connections 2023-10-06T23:22:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.715+0000 7f4210bff700 1 --2- 172.21.15.8:0/3589782998 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f420c103130 0x7f420c103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.715+0000 7f4210bff700 1 --2- 172.21.15.8:0/3589782998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 0x7f420c10b570 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.715+0000 7f4210bff700 1 --2- 172.21.15.8:0/3589782998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f420c104320 0x7f420c104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.715+0000 7f4210bff700 1 -- 172.21.15.8:0/3589782998 >> 172.21.15.8:0/3589782998 conn(0x7f420c0fe6a0 msgr2=0x7f420c100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.715+0000 7f4210bff700 1 -- 172.21.15.8:0/3589782998 shutdown_connections 2023-10-06T23:22:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.715+0000 7f4210bff700 1 -- 172.21.15.8:0/3589782998 wait complete. 2023-10-06T23:22:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.716+0000 7f4210bff700 1 Processor -- start 2023-10-06T23:22:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.716+0000 7f4210bff700 1 -- start start 2023-10-06T23:22:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.716+0000 7f4210bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f420c103130 0x7f420c198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.716+0000 7f4210bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f420c104320 0x7f420c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f4210bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 0x7f420c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f4210bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c19a8f0 con 0x7f420c103130 2023-10-06T23:22:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f420a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f420c103130 0x7f420c198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f420a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f420c103130 0x7f420c198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35372/0 (socket says 172.21.15.8:35372) 2023-10-06T23:22:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f420a59c700 1 -- 172.21.15.8:0/3751178164 learned_addr learned my addr 172.21.15.8:0/3751178164 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f4209d9b700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f420c104320 0x7f420c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c19aa60 con 0x7f420c104cc0 2023-10-06T23:22:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c19ac20 con 0x7f420c104320 2023-10-06T23:22:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.717+0000 7f420ad9d700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 0x7f420c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f420a59c700 1 -- 172.21.15.8:0/3751178164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f420c104320 msgr2=0x7f420c199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f420a59c700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f420c104320 0x7f420c199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f420a59c700 1 -- 172.21.15.8:0/3751178164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 msgr2=0x7f420c19a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f420a59c700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 0x7f420c19a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f420a59c700 1 -- 172.21.15.8:0/3751178164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc0095f0 con 0x7f420c103130 2023-10-06T23:22:53.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f420ad9d700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 0x7f420c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:22:53.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f420a59c700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f420c103130 0x7f420c198ed0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00ebf0 tx=0x7f41fc00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:53.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f41fb7fe700 1 -- 172.21.15.8:0/3751178164 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc009a10 con 0x7f420c103130 2023-10-06T23:22:53.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.718+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4204009c40 con 0x7f420c103130 2023-10-06T23:22:53.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.719+0000 7f41fb7fe700 1 -- 172.21.15.8:0/3751178164 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41fc00cc90 con 0x7f420c103130 2023-10-06T23:22:53.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.719+0000 7f41fb7fe700 1 -- 172.21.15.8:0/3751178164 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc018680 con 0x7f420c103130 2023-10-06T23:22:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.719+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c19b0f0 con 0x7f420c103130 2023-10-06T23:22:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.723+0000 7f41fb7fe700 1 -- 172.21.15.8:0/3751178164 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f41fc010430 con 0x7f420c103130 2023-10-06T23:22:53.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.725+0000 7f4224613b80 1 Processor -- start 2023-10-06T23:22:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.725+0000 7f4224613b80 1 -- start start 2023-10-06T23:22:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f41fb7fe700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f41f40a1500 0x7f41f40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4224613b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4224613b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5a3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4224613b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5aa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f41fb7fe700 1 -- 172.21.15.8:0/3751178164 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f41fc014070 con 0x7f420c103130 2023-10-06T23:22:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4224613b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b50a400 con 0x55bc1b5a1ec0 2023-10-06T23:22:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4224613b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b4fbbc0 con 0x55bc1b5a3990 2023-10-06T23:22:53.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4224613b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b4f94e0 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4209d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4209d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5a3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:46242/0 (socket says 172.21.15.8:46242) 2023-10-06T23:22:53.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f4209d9b700 1 -- 172.21.15.8:0/4098995794 learned_addr learned my addr 172.21.15.8:0/4098995794 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:53.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f420ad9d700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f41f40a1500 0x7f41f40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.726+0000 7f420ad9d700 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.727+0000 7f420a59c700 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.727+0000 7f4209d9b700 1 -- 172.21.15.8:0/4098995794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 msgr2=0x55bc1b5aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:53.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.727+0000 7f4209d9b700 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.727+0000 7f4209d9b700 1 -- 172.21.15.8:0/4098995794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 msgr2=0x55bc1b5a22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:53.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.727+0000 7f4209d9b700 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5a22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.727+0000 7f4209d9b700 1 -- 172.21.15.8:0/4098995794 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc1b31fd80 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.727+0000 7f420ad9d700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f41f40a1500 0x7f41f40a39c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f42040060b0 tx=0x7f4204007600 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.728+0000 7f4209d9b700 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5a3450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4200009d80 tx=0x7f4200011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd9ed1af35388cfd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.728+0000 7f41f8ff9700 1 -- 172.21.15.8:0/4098995794 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200004230 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.728+0000 7f41f8ff9700 1 -- 172.21.15.8:0/4098995794 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4200004390 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.728+0000 7f41f8ff9700 1 -- 172.21.15.8:0/4098995794 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200019750 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 -- 172.21.15.8:0/4098995794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 msgr2=0x55bc1b5a3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5a3450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4200009d80 tx=0x7f4200011720 comp rx=0 tx=0).stop 2023-10-06T23:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 -- 172.21.15.8:0/4098995794 shutdown_connections 2023-10-06T23:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5a22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 --2- 172.21.15.8:0/4098995794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5a3450 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 -- 172.21.15.8:0/4098995794 >> 172.21.15.8:0/4098995794 conn(0x55bc1b516200 msgr2=0x55bc1b59cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 -- 172.21.15.8:0/4098995794 shutdown_connections 2023-10-06T23:22:53.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.729+0000 7f4224613b80 1 -- 172.21.15.8:0/4098995794 wait complete. 2023-10-06T23:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.730+0000 7f4224613b80 1 -- start start 2023-10-06T23:22:53.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.730+0000 7f4224613b80 1 Processor -- start 2023-10-06T23:22:53.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f4224613b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f4224613b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f4224613b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5bb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f4224613b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b4f4dd0 con 0x55bc1b5a1ec0 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f4224613b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b4916b0 con 0x55bc1b5a3990 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f4224613b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b491350 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f4224613b80 10 client.0 _ll_register_callbacks cb 0x55bc1b2ee7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f420ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f420ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5bb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:34356/0 (socket says 172.21.15.8:34356) 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f420ad9d700 1 -- 172.21.15.8:0/1737755110 learned_addr learned my addr 172.21.15.8:0/1737755110 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:53.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.731+0000 7f4209d9b700 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.732+0000 7f420a59c700 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.732+0000 7f420ad9d700 1 -- 172.21.15.8:0/1737755110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 msgr2=0x55bc1b5b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.732+0000 7f420ad9d700 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.732+0000 7f420ad9d700 1 -- 172.21.15.8:0/1737755110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 msgr2=0x55bc1b5b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.732+0000 7f420ad9d700 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.732+0000 7f420ad9d700 1 -- 172.21.15.8:0/1737755110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42000099e0 con 0x55bc1b5a3990 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.732+0000 7f420ad9d700 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5bb900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f420400b7c0 tx=0x7f4204009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=501ac7e85c0b1b79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.732+0000 7f41f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.733+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1737755110 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204026070 con 0x55bc1b5a3990 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.733+0000 7f4224613b80 1 -- 172.21.15.8:0/1737755110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc1b594d50 con 0x55bc1b5a3990 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.733+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1737755110 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f420400be40 con 0x55bc1b5a3990 2023-10-06T23:22:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.733+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1737755110 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f420400e040 con 0x55bc1b5a3990 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.733+0000 7f4224613b80 10 client.26393 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.733+0000 7f4224613b80 1 -- 172.21.15.8:0/1737755110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55bc1b308c00 con 0x55bc1b5a3990 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1737755110 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bc1b594d50 con 0x55bc1b5a3990 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1737755110 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f420402ea70 con 0x55bc1b5a3990 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f4224613b80 10 client.26393 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f4224613b80 10 client.26393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f4224613b80 20 client.26393 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f4224613b80 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc1b5c0150 0x55bc1b5c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f4224613b80 4 client.26393 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f4224613b80 1 -- 172.21.15.8:0/1737755110 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc1b4eddb0 con 0x55bc1b5c0150 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.734+0000 7f420a59c700 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc1b5c0150 0x55bc1b5c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.735+0000 7f41f1ffb700 10 client.26393 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.735+0000 7f420a59c700 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc1b5c0150 0x55bc1b5c2570 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=874540a10a1967d6 server_cookie=4d3635eb0f442cba in_seq=0 out_seq=0 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.736+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1737755110 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bc1b4eddb0 con 0x55bc1b5c0150 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.736+0000 7f41f1ffb700 10 client.26393 handle_command_reply: tid=0 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.736+0000 7f4224613b80 1 client.26393 shutdown 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 -- 172.21.15.8:0/1737755110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 msgr2=0x55bc1b5bb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5bb900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f420400b7c0 tx=0x7f4204009f10 comp rx=0 tx=0).stop 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 -- 172.21.15.8:0/1737755110 shutdown_connections 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc1b5c0150 0x55bc1b5c2570 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a3990 0x55bc1b5bb900 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 --2- 172.21.15.8:0/1737755110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f41f1ffb700 0 client.26393 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 -- 172.21.15.8:0/1737755110 >> 172.21.15.8:0/1737755110 conn(0x55bc1b516200 msgr2=0x55bc1b59c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 -- 172.21.15.8:0/1737755110 shutdown_connections 2023-10-06T23:22:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 1 -- 172.21.15.8:0/1737755110 wait complete. 2023-10-06T23:22:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.737+0000 7f4224613b80 20 client.26393 trim_cache size 0 max 16384 2023-10-06T23:22:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.760+0000 7f4224613b80 1 Processor -- start 2023-10-06T23:22:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f4224613b80 1 -- start start 2023-10-06T23:22:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f4224613b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b59cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f4224613b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5bb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f4224613b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a3990 0x55bc1b59c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f4224613b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b3758c0 con 0x55bc1b5a1ec0 2023-10-06T23:22:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f4224613b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b597200 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f4224613b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b5ab020 con 0x55bc1b5a3990 2023-10-06T23:22:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f420a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b59cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.761+0000 7f420a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b59cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35398/0 (socket says 172.21.15.8:35398) 2023-10-06T23:22:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f420a59c700 1 -- 172.21.15.8:0/2741058362 learned_addr learned my addr 172.21.15.8:0/2741058362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f4209d9b700 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f420ad9d700 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a3990 0x55bc1b59c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f420a59c700 1 -- 172.21.15.8:0/2741058362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a3990 msgr2=0x55bc1b59c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f420a59c700 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a3990 0x55bc1b59c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f420a59c700 1 -- 172.21.15.8:0/2741058362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a2fd0 msgr2=0x55bc1b5bb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f420a59c700 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5bb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f420a59c700 1 -- 172.21.15.8:0/2741058362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc1b3461f0 con 0x55bc1b5a1ec0 2023-10-06T23:22:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.762+0000 7f420a59c700 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b59cb80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0a23d0 tx=0x7f41fc0cac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ffa1c473ae88a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.763+0000 7f41f97fa700 1 -- 172.21.15.8:0/2741058362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00ce00 con 0x55bc1b5a1ec0 2023-10-06T23:22:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.763+0000 7f41f97fa700 1 -- 172.21.15.8:0/2741058362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41fc09a570 con 0x55bc1b5a1ec0 2023-10-06T23:22:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.763+0000 7f41f97fa700 1 -- 172.21.15.8:0/2741058362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc098910 con 0x55bc1b5a1ec0 2023-10-06T23:22:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 -- 172.21.15.8:0/2741058362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 msgr2=0x55bc1b59cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b59cb80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0a23d0 tx=0x7f41fc0cac20 comp rx=0 tx=0).stop 2023-10-06T23:22:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 -- 172.21.15.8:0/2741058362 shutdown_connections 2023-10-06T23:22:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b59cb80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a3990 0x55bc1b59c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 --2- 172.21.15.8:0/2741058362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5bb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 -- 172.21.15.8:0/2741058362 >> 172.21.15.8:0/2741058362 conn(0x55bc1b516200 msgr2=0x55bc1b5aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 -- 172.21.15.8:0/2741058362 shutdown_connections 2023-10-06T23:22:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.764+0000 7f4224613b80 1 -- 172.21.15.8:0/2741058362 wait complete. 2023-10-06T23:22:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.765+0000 7f4224613b80 1 -- start start 2023-10-06T23:22:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.765+0000 7f4224613b80 1 Processor -- start 2023-10-06T23:22:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4224613b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4224613b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4224613b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a3990 0x55bc1b5ba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4224613b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b5baf20 con 0x55bc1b5a3990 2023-10-06T23:22:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4224613b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b5bb090 con 0x55bc1b5a1ec0 2023-10-06T23:22:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4224613b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1b5bb250 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4224613b80 10 client.0 _ll_register_callbacks cb 0x7f4204004e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:22:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4209d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4209d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:46258/0 (socket says 172.21.15.8:46258) 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f4209d9b700 1 -- 172.21.15.8:0/1041879114 learned_addr learned my addr 172.21.15.8:0/1041879114 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.766+0000 7f420a59c700 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f420ad9d700 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a3990 0x55bc1b5ba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f4209d9b700 1 -- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a1ec0 msgr2=0x55bc1b5b9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f4209d9b700 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f4209d9b700 1 -- 172.21.15.8:0/1041879114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a3990 msgr2=0x55bc1b5ba9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f4209d9b700 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a3990 0x55bc1b5ba9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f4209d9b700 1 -- 172.21.15.8:0/1041879114 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c19b0f0 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f420a59c700 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f4209d9b700 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b99d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4200009d80 tx=0x7f4200009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc289fd26d8a5caa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.767+0000 7f41f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.768+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1041879114 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200004910 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.768+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1041879114 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4200004a70 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.768+0000 7f4224613b80 1 -- 172.21.15.8:0/1041879114 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4200004390 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.768+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1041879114 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4200004c30 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.768+0000 7f4224613b80 10 client.26416 fetch_fsmap learned FSMap version 37 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.768+0000 7f4224613b80 1 -- 172.21.15.8:0/1041879114 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55bc1b31e250 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.768+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1041879114 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4200004390 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.768+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1041879114 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4200011440 con 0x55bc1b5a2fd0 2023-10-06T23:22:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.769+0000 7f4224613b80 10 client.26416 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:22:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.769+0000 7f4224613b80 10 client.26416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:22:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.769+0000 7f4224613b80 20 client.26416 populate_metadata read hostname 'smithi008' 2023-10-06T23:22:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.769+0000 7f4224613b80 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc1b614dc0 0x55bc1b6171e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:22:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.769+0000 7f4224613b80 4 client.26416 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:22:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.769+0000 7f4224613b80 1 -- 172.21.15.8:0/1041879114 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bc1b4edad0 con 0x55bc1b614dc0 2023-10-06T23:22:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.769+0000 7f420a59c700 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc1b614dc0 0x55bc1b6171e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:22:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.770+0000 7f420a59c700 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc1b614dc0 0x55bc1b6171e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59072564e434e01d server_cookie=c5f16615bf07de3e in_seq=0 out_seq=0 2023-10-06T23:22:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.770+0000 7f41f1ffb700 10 client.26416 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f41f1ffb700 1 -- 172.21.15.8:0/1041879114 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bc1b4edad0 con 0x55bc1b614dc0 2023-10-06T23:22:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f41f1ffb700 10 client.26416 handle_command_reply: tid=0 2023-10-06T23:22:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 client.26416 shutdown 2023-10-06T23:22:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 -- 172.21.15.8:0/1041879114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 msgr2=0x55bc1b5b99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b99d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4200009d80 tx=0x7f4200009780 comp rx=0 tx=0).stop 2023-10-06T23:22:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 -- 172.21.15.8:0/1041879114 shutdown_connections 2023-10-06T23:22:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55bc1b614dc0 0x55bc1b6171e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc1b5a3990 0x55bc1b5ba9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc1b5a1ec0 0x55bc1b5b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 --2- 172.21.15.8:0/1041879114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bc1b5a2fd0 0x55bc1b5b99d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 -- 172.21.15.8:0/1041879114 >> 172.21.15.8:0/1041879114 conn(0x55bc1b516200 msgr2=0x55bc1b5a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f41f1ffb700 0 client.26416 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:22:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.785+0000 7f4224613b80 1 -- 172.21.15.8:0/1041879114 shutdown_connections 2023-10-06T23:22:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.786+0000 7f4224613b80 1 -- 172.21.15.8:0/1041879114 wait complete. 2023-10-06T23:22:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.786+0000 7f4224613b80 20 client.26416 trim_cache size 0 max 16384 2023-10-06T23:22:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:22:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:22:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:22:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:22:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.786+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f41f40a1500 msgr2=0x7f41f40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.786+0000 7f4210bff700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f41f40a1500 0x7f41f40a39c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f42040060b0 tx=0x7f4204007600 comp rx=0 tx=0).stop 2023-10-06T23:22:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f420c103130 msgr2=0x7f420c198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:22:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f420c103130 0x7f420c198ed0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00ebf0 tx=0x7f41fc00ef00 comp rx=0 tx=0).stop 2023-10-06T23:22:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 shutdown_connections 2023-10-06T23:22:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f41f40a1500 0x7f41f40a39c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f420c103130 0x7f420c198ed0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f420c104cc0 0x7f420c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 --2- 172.21.15.8:0/3751178164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f420c104320 0x7f420c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:22:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 >> 172.21.15.8:0/3751178164 conn(0x7f420c0fe6a0 msgr2=0x7f420c100850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:22:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 shutdown_connections 2023-10-06T23:22:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:22:53.787+0000 7f4210bff700 1 -- 172.21.15.8:0/3751178164 wait complete. 2023-10-06T23:22:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:53 smithi156 ceph-mon[102862]: pgmap v651: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2023-10-06T23:22:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:53 smithi008 ceph-mon[98532]: pgmap v651: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2023-10-06T23:22:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 480.0 s, 291.6 tps, lat 345.305 ms stddev 51.752 2023-10-06T23:22:55.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:55 smithi156 ceph-mon[102862]: pgmap v652: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 5.0 MiB/s wr, 586 op/s 2023-10-06T23:22:55.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:55 smithi008 ceph-mon[98532]: pgmap v652: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 5.0 MiB/s wr, 586 op/s 2023-10-06T23:22:55.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:55 smithi190 ceph-mon[102658]: pgmap v652: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 5.0 MiB/s wr, 586 op/s 2023-10-06T23:22:57.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:57 smithi156 ceph-mon[102862]: pgmap v653: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 4.7 MiB/s wr, 563 op/s 2023-10-06T23:22:57.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:57 smithi008 ceph-mon[98532]: pgmap v653: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 4.7 MiB/s wr, 563 op/s 2023-10-06T23:22:57.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:57 smithi190 ceph-mon[102658]: pgmap v653: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 4.7 MiB/s wr, 563 op/s 2023-10-06T23:22:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 485.0 s, 238.0 tps, lat 415.622 ms stddev 128.367 2023-10-06T23:22:59.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:22:59 smithi156 ceph-mon[102862]: pgmap v654: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2023-10-06T23:22:59.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:22:59 smithi008 ceph-mon[98532]: pgmap v654: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2023-10-06T23:22:59.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:22:59 smithi190 ceph-mon[102658]: pgmap v654: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2023-10-06T23:23:01.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:01 smithi156 ceph-mon[102862]: pgmap v655: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 5.1 MiB/s wr, 585 op/s 2023-10-06T23:23:01.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:01 smithi008 ceph-mon[98532]: pgmap v655: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 5.1 MiB/s wr, 585 op/s 2023-10-06T23:23:01.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:01 smithi190 ceph-mon[102658]: pgmap v655: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 5.1 MiB/s wr, 585 op/s 2023-10-06T23:23:03.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:03 smithi190 ceph-mon[102658]: pgmap v656: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 4.3 MiB/s wr, 518 op/s 2023-10-06T23:23:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:03 smithi156 ceph-mon[102862]: pgmap v656: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 4.3 MiB/s wr, 518 op/s 2023-10-06T23:23:03.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:03 smithi008 ceph-mon[98532]: pgmap v656: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 4.3 MiB/s wr, 518 op/s 2023-10-06T23:23:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 490.0 s, 263.2 tps, lat 379.429 ms stddev 50.549 2023-10-06T23:23:05.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:05 smithi156 ceph-mon[102862]: pgmap v657: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 4.4 MiB/s wr, 538 op/s 2023-10-06T23:23:05.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:05 smithi008 ceph-mon[98532]: pgmap v657: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 4.4 MiB/s wr, 538 op/s 2023-10-06T23:23:05.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:05 smithi190 ceph-mon[102658]: pgmap v657: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 4.4 MiB/s wr, 538 op/s 2023-10-06T23:23:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 -- 172.21.15.8:0/1724058563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76000ff7c0 msgr2=0x7f76000ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 --2- 172.21.15.8:0/1724058563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76000ff7c0 0x7f76000ffbe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0099c0 tx=0x7f75fc009cd0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 -- 172.21.15.8:0/1724058563 shutdown_connections 2023-10-06T23:23:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 --2- 172.21.15.8:0/1724058563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7600100ae0 0x7f7600100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 --2- 172.21.15.8:0/1724058563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76000ff7c0 0x7f76000ffbe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 --2- 172.21.15.8:0/1724058563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7600100120 0x7f76001005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 -- 172.21.15.8:0/1724058563 >> 172.21.15.8:0/1724058563 conn(0x7f76000fb340 msgr2=0x7f76000fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 -- 172.21.15.8:0/1724058563 shutdown_connections 2023-10-06T23:23:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.005+0000 7f76085ff700 1 -- 172.21.15.8:0/1724058563 wait complete. 2023-10-06T23:23:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.007+0000 7f76085ff700 1 Processor -- start 2023-10-06T23:23:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.007+0000 7f76085ff700 1 -- start start 2023-10-06T23:23:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.008+0000 7f76085ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76000ff7c0 0x7f760019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.008+0000 7f76085ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7600100120 0x7f760019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.008+0000 7f76085ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7600100ae0 0x7f760019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.008+0000 7f76085ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760019ec30 con 0x7f76000ff7c0 2023-10-06T23:23:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.008+0000 7f76085ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760019eda0 con 0x7f7600100120 2023-10-06T23:23:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.008+0000 7f76085ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760019ef60 con 0x7f7600100ae0 2023-10-06T23:23:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7606b9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7600100ae0 0x7f760019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7605b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7600100120 0x7f760019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f760639b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76000ff7c0 0x7f760019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7605b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7600100120 0x7f760019d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57552/0 (socket says 172.21.15.8:57552) 2023-10-06T23:23:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7605b9a700 1 -- 172.21.15.8:0/312170578 learned_addr learned my addr 172.21.15.8:0/312170578 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7605b9a700 1 -- 172.21.15.8:0/312170578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7600100ae0 msgr2=0x7f760019e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7605b9a700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7600100ae0 0x7f760019e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7605b9a700 1 -- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76000ff7c0 msgr2=0x7f760019d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7605b9a700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76000ff7c0 0x7f760019d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.009+0000 7f7605b9a700 1 -- 172.21.15.8:0/312170578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0095f0 con 0x7f7600100120 2023-10-06T23:23:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.010+0000 7f7605b9a700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7600100120 0x7f760019d750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f75f000e9a0 tx=0x7f75f000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.010+0000 7f75f77fe700 1 -- 172.21.15.8:0/312170578 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0009790 con 0x7f7600100120 2023-10-06T23:23:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.010+0000 7f75f77fe700 1 -- 172.21.15.8:0/312170578 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75f0010430 con 0x7f7600100120 2023-10-06T23:23:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.010+0000 7f76085ff700 1 -- 172.21.15.8:0/312170578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760019f240 con 0x7f7600100120 2023-10-06T23:23:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.010+0000 7f76085ff700 1 -- 172.21.15.8:0/312170578 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76001a5a00 con 0x7f7600100120 2023-10-06T23:23:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.010+0000 7f75f77fe700 1 -- 172.21.15.8:0/312170578 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000cea0 con 0x7f7600100120 2023-10-06T23:23:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.016+0000 7f75f77fe700 1 -- 172.21.15.8:0/312170578 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f75f000ca10 con 0x7f7600100120 2023-10-06T23:23:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.017+0000 7f761bfd1b80 1 Processor -- start 2023-10-06T23:23:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.018+0000 7f761bfd1b80 1 -- start start 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.018+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 0x55c89e8842e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.018+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e885450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.018+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 0x55c89e88c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.018+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e7ec400 con 0x55c89e883ec0 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.018+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e7ddbc0 con 0x55c89e885990 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.018+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e7db4e0 con 0x55c89e884fd0 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f760639b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e885450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f760639b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e885450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38678/0 (socket says 172.21.15.8:38678) 2023-10-06T23:23:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f760639b700 1 -- 172.21.15.8:0/2904282912 learned_addr learned my addr 172.21.15.8:0/2904282912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f7606b9c700 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 0x55c89e8842e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f7605b9a700 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 0x55c89e88c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f760639b700 1 -- 172.21.15.8:0/2904282912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 msgr2=0x55c89e88c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f760639b700 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 0x55c89e88c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f760639b700 1 -- 172.21.15.8:0/2904282912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 msgr2=0x55c89e8842e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f760639b700 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 0x55c89e8842e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f760639b700 1 -- 172.21.15.8:0/2904282912 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c89e601d80 con 0x55c89e884fd0 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.019+0000 7f75f77fe700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75ec0a1650 0x7f75ec0a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.020+0000 7f75f77fe700 1 -- 172.21.15.8:0/312170578 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f75f0014070 con 0x7f7600100120 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.020+0000 7f760639b700 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e885450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0099c0 tx=0x7f75fc005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb2e72c3c02afa62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.020+0000 7f75f4bfe700 1 -- 172.21.15.8:0/2904282912 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00b990 con 0x55c89e884fd0 2023-10-06T23:23:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.020+0000 7f7605b9a700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75ec0a1650 0x7f75ec0a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.020+0000 7f75f4bfe700 1 -- 172.21.15.8:0/2904282912 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75fc01e040 con 0x55c89e884fd0 2023-10-06T23:23:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.020+0000 7f75f4bfe700 1 -- 172.21.15.8:0/2904282912 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc003ad0 con 0x55c89e884fd0 2023-10-06T23:23:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.021+0000 7f7605b9a700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75ec0a1650 0x7f75ec0a3b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f75f000e970 tx=0x7f75f000c480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.021+0000 7f761bfd1b80 1 -- 172.21.15.8:0/2904282912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 msgr2=0x55c89e885450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.021+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e885450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0099c0 tx=0x7f75fc005e80 comp rx=0 tx=0).stop 2023-10-06T23:23:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.022+0000 7f761bfd1b80 1 -- 172.21.15.8:0/2904282912 shutdown_connections 2023-10-06T23:23:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.022+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 0x55c89e8842e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.022+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 0x55c89e88c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.022+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/2904282912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e885450 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.022+0000 7f761bfd1b80 1 -- 172.21.15.8:0/2904282912 >> 172.21.15.8:0/2904282912 conn(0x55c89e7f8200 msgr2=0x55c89e87ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.022+0000 7f761bfd1b80 1 -- 172.21.15.8:0/2904282912 shutdown_connections 2023-10-06T23:23:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.022+0000 7f761bfd1b80 1 -- 172.21.15.8:0/2904282912 wait complete. 2023-10-06T23:23:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.023+0000 7f761bfd1b80 1 -- start start 2023-10-06T23:23:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.023+0000 7f761bfd1b80 1 Processor -- start 2023-10-06T23:23:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.024+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.024+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e88e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.024+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 0x55c89e8950f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.024+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e7d6dd0 con 0x55c89e885990 2023-10-06T23:23:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.024+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e7736b0 con 0x55c89e883ec0 2023-10-06T23:23:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.024+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e773350 con 0x55c89e884fd0 2023-10-06T23:23:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.024+0000 7f761bfd1b80 10 client.0 _ll_register_callbacks cb 0x55c89e5d07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f7606b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f7606b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57564/0 (socket says 172.21.15.8:57564) 2023-10-06T23:23:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f7606b9c700 1 -- 172.21.15.8:0/390905032 learned_addr learned my addr 172.21.15.8:0/390905032 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f760639b700 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e88e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f7606b9c700 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 0x55c89e8950f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f760639b700 1 -- 172.21.15.8:0/390905032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 msgr2=0x55c89e88db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f760639b700 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f760639b700 1 -- 172.21.15.8:0/390905032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 msgr2=0x55c89e8950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f760639b700 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 0x55c89e8950f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f760639b700 1 -- 172.21.15.8:0/390905032 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760010be60 con 0x55c89e884fd0 2023-10-06T23:23:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.025+0000 7f7606b9c700 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:23:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.026+0000 7f760639b700 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e88e0b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00be70 tx=0x7f75fc005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd93fcfd273ffb7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.026+0000 7f75e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:23:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.027+0000 7f75e9ffb700 1 -- 172.21.15.8:0/390905032 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc031070 con 0x55c89e884fd0 2023-10-06T23:23:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.027+0000 7f75e9ffb700 1 -- 172.21.15.8:0/390905032 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f75fc005680 con 0x55c89e884fd0 2023-10-06T23:23:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.027+0000 7f761bfd1b80 1 -- 172.21.15.8:0/390905032 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c89e876d50 con 0x55c89e884fd0 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.027+0000 7f75e9ffb700 1 -- 172.21.15.8:0/390905032 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75fc0037d0 con 0x55c89e884fd0 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.027+0000 7f761bfd1b80 10 client.26428 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.027+0000 7f761bfd1b80 1 -- 172.21.15.8:0/390905032 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55c89e5eac00 con 0x55c89e884fd0 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.028+0000 7f75e9ffb700 1 -- 172.21.15.8:0/390905032 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75fc03c080 con 0x55c89e884fd0 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.028+0000 7f75e9ffb700 1 -- 172.21.15.8:0/390905032 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f75fc034030 con 0x55c89e884fd0 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.028+0000 7f761bfd1b80 10 client.26428 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.028+0000 7f761bfd1b80 10 client.26428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.028+0000 7f761bfd1b80 20 client.26428 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.028+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c89e8994e0 0x55c89e89b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.028+0000 7f761bfd1b80 4 client.26428 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.028+0000 7f761bfd1b80 1 -- 172.21.15.8:0/390905032 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c89e7cfdb0 con 0x55c89e8994e0 2023-10-06T23:23:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.029+0000 7f7606b9c700 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c89e8994e0 0x55c89e89b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.029+0000 7f75e9ffb700 10 client.26428 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.029+0000 7f7606b9c700 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c89e8994e0 0x55c89e89b900 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=564c6a0b8c5be8f1 server_cookie=bcbbf171bae3efbd in_seq=0 out_seq=0 2023-10-06T23:23:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.031+0000 7f75e9ffb700 1 -- 172.21.15.8:0/390905032 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7f75f8023730 con 0x55c89e8994e0 2023-10-06T23:23:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.031+0000 7f75e9ffb700 10 client.26428 handle_command_reply: tid=0 2023-10-06T23:23:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.031+0000 7f761bfd1b80 1 client.26428 shutdown 2023-10-06T23:23:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 -- 172.21.15.8:0/390905032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 msgr2=0x55c89e88e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e88e0b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00be70 tx=0x7f75fc005280 comp rx=0 tx=0).stop 2023-10-06T23:23:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 -- 172.21.15.8:0/390905032 shutdown_connections 2023-10-06T23:23:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c89e8994e0 0x55c89e89b900 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 0x55c89e8950f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f75e9ffb700 0 client.26428 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/390905032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e88e0b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 -- 172.21.15.8:0/390905032 >> 172.21.15.8:0/390905032 conn(0x55c89e7f8200 msgr2=0x55c89e87e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.032+0000 7f761bfd1b80 1 -- 172.21.15.8:0/390905032 shutdown_connections 2023-10-06T23:23:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.033+0000 7f761bfd1b80 1 -- 172.21.15.8:0/390905032 wait complete. 2023-10-06T23:23:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.033+0000 7f761bfd1b80 20 client.26428 trim_cache size 0 max 16384 2023-10-06T23:23:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.054+0000 7f761bfd1b80 1 Processor -- start 2023-10-06T23:23:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.054+0000 7f761bfd1b80 1 -- start start 2023-10-06T23:23:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.054+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e8950b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 0x55c89e895920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e6578c0 con 0x55c89e885990 2023-10-06T23:23:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e889460 con 0x55c89e883ec0 2023-10-06T23:23:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e879200 con 0x55c89e884fd0 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f7606b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f7606b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:57578/0 (socket says 172.21.15.8:57578) 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f7606b9c700 1 -- 172.21.15.8:0/1925035378 learned_addr learned my addr 172.21.15.8:0/1925035378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f760639b700 1 --2- 172.21.15.8:0/1925035378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e8950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f7606b9c700 1 -- 172.21.15.8:0/1925035378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 msgr2=0x55c89e8950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f7606b9c700 1 --2- 172.21.15.8:0/1925035378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e8950b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f7606b9c700 1 -- 172.21.15.8:0/1925035378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 msgr2=0x55c89e895920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.055+0000 7f7606b9c700 1 --2- 172.21.15.8:0/1925035378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 0x55c89e895920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.056+0000 7f7606b9c700 1 -- 172.21.15.8:0/1925035378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c89e6281f0 con 0x55c89e883ec0 2023-10-06T23:23:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.056+0000 7f7606b9c700 1 --2- 172.21.15.8:0/1925035378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88d220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f75f8003b20 tx=0x7f75f8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738afd4985cd9fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.056+0000 7f75f53ff700 1 -- 172.21.15.8:0/1925035378 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800e040 con 0x55c89e883ec0 2023-10-06T23:23:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.056+0000 7f75f53ff700 1 -- 172.21.15.8:0/1925035378 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75f801f070 con 0x55c89e883ec0 2023-10-06T23:23:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.056+0000 7f75f53ff700 1 -- 172.21.15.8:0/1925035378 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8005530 con 0x55c89e883ec0 2023-10-06T23:23:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.057+0000 7f761bfd1b80 1 -- 172.21.15.8:0/1925035378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 msgr2=0x55c89e88d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.057+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/1925035378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88d220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f75f8003b20 tx=0x7f75f8004ad0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.057+0000 7f761bfd1b80 1 -- 172.21.15.8:0/1925035378 shutdown_connections 2023-10-06T23:23:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.057+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/1925035378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e885990 0x55c89e895920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.057+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/1925035378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e883ec0 0x55c89e88d220 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.057+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/1925035378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e8950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.057+0000 7f761bfd1b80 1 -- 172.21.15.8:0/1925035378 >> 172.21.15.8:0/1925035378 conn(0x55c89e7f8200 msgr2=0x55c89e87e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.058+0000 7f761bfd1b80 1 -- 172.21.15.8:0/1925035378 shutdown_connections 2023-10-06T23:23:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.058+0000 7f761bfd1b80 1 -- 172.21.15.8:0/1925035378 wait complete. 2023-10-06T23:23:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.059+0000 7f761bfd1b80 1 -- start start 2023-10-06T23:23:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.059+0000 7f761bfd1b80 1 Processor -- start 2023-10-06T23:23:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.059+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 0x55c89e893020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e893560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f761bfd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 0x55c89e894570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e894ab0 con 0x55c89e883ec0 2023-10-06T23:23:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e894c20 con 0x55c89e885990 2023-10-06T23:23:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f761bfd1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89e894d90 con 0x55c89e884fd0 2023-10-06T23:23:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f761bfd1b80 10 client.0 _ll_register_callbacks cb 0x7f75f8009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f760639b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e893560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f760639b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e893560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38714/0 (socket says 172.21.15.8:38714) 2023-10-06T23:23:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.060+0000 7f760639b700 1 -- 172.21.15.8:0/3262708276 learned_addr learned my addr 172.21.15.8:0/3262708276 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f760639b700 1 -- 172.21.15.8:0/3262708276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 msgr2=0x55c89e894570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T23:23:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f760639b700 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 0x55c89e894570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f760639b700 1 -- 172.21.15.8:0/3262708276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 msgr2=0x55c89e893020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f760639b700 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 0x55c89e893020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f760639b700 1 -- 172.21.15.8:0/3262708276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f8009050 con 0x55c89e884fd0 2023-10-06T23:23:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f760639b700 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e893560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009d10 tx=0x7f75fc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd1a5a87e5f53699 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f75e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f75e9ffb700 1 -- 172.21.15.8:0/3262708276 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc03f070 con 0x55c89e884fd0 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f75e9ffb700 1 -- 172.21.15.8:0/3262708276 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f75fc032070 con 0x55c89e884fd0 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.061+0000 7f761bfd1b80 1 -- 172.21.15.8:0/3262708276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75fc01e040 con 0x55c89e884fd0 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.062+0000 7f75e9ffb700 1 -- 172.21.15.8:0/3262708276 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75fc031030 con 0x55c89e884fd0 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.062+0000 7f761bfd1b80 10 client.26434 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.062+0000 7f761bfd1b80 1 -- 172.21.15.8:0/3262708276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55c89e600250 con 0x55c89e884fd0 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.062+0000 7f75e9ffb700 1 -- 172.21.15.8:0/3262708276 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75fc01e040 con 0x55c89e884fd0 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.063+0000 7f75e9ffb700 1 -- 172.21.15.8:0/3262708276 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f75fc042020 con 0x55c89e884fd0 2023-10-06T23:23:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.063+0000 7f761bfd1b80 10 client.26434 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.063+0000 7f761bfd1b80 10 client.26434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.063+0000 7f761bfd1b80 20 client.26434 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.063+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c89e8ff040 0x55c89e901460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.063+0000 7f761bfd1b80 4 client.26434 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:23:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.063+0000 7f761bfd1b80 1 -- 172.21.15.8:0/3262708276 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c89e7cfad0 con 0x55c89e8ff040 2023-10-06T23:23:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.063+0000 7f7606b9c700 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c89e8ff040 0x55c89e901460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.064+0000 7f7606b9c700 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c89e8ff040 0x55c89e901460 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbe808322d475619 server_cookie=6b80bdabf4478e3c in_seq=0 out_seq=0 2023-10-06T23:23:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.064+0000 7f75e9ffb700 10 client.26434 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f75e9ffb700 1 -- 172.21.15.8:0/3262708276 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c89e7cfad0 con 0x55c89e8ff040 2023-10-06T23:23:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f75e9ffb700 10 client.26434 handle_command_reply: tid=0 2023-10-06T23:23:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 client.26434 shutdown 2023-10-06T23:23:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 -- 172.21.15.8:0/3262708276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 msgr2=0x55c89e893560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e893560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009d10 tx=0x7f75fc000bc0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 -- 172.21.15.8:0/3262708276 shutdown_connections 2023-10-06T23:23:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c89e8ff040 0x55c89e901460 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c89e883ec0 0x55c89e893020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c89e885990 0x55c89e894570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 --2- 172.21.15.8:0/3262708276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c89e884fd0 0x55c89e893560 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f75e9ffb700 0 client.26434 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 -- 172.21.15.8:0/3262708276 >> 172.21.15.8:0/3262708276 conn(0x55c89e7f8200 msgr2=0x55c89e88bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 -- 172.21.15.8:0/3262708276 shutdown_connections 2023-10-06T23:23:07.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 1 -- 172.21.15.8:0/3262708276 wait complete. 2023-10-06T23:23:07.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.079+0000 7f761bfd1b80 20 client.26434 trim_cache size 0 max 16384 2023-10-06T23:23:07.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:23:07.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:23:07.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:23:07.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:23:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 -- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75ec0a1650 msgr2=0x7f75ec0a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75ec0a1650 0x7f75ec0a3b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f75f000e970 tx=0x7f75f000c480 comp rx=0 tx=0).stop 2023-10-06T23:23:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 -- 172.21.15.8:0/312170578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7600100120 msgr2=0x7f760019d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7600100120 0x7f760019d750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f75f000e9a0 tx=0x7f75f000ecb0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 -- 172.21.15.8:0/312170578 shutdown_connections 2023-10-06T23:23:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75ec0a1650 0x7f75ec0a3b10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76000ff7c0 0x7f760019d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.084 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7600100ae0 0x7f760019e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 --2- 172.21.15.8:0/312170578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7600100120 0x7f760019d750 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.080+0000 7f76085ff700 1 -- 172.21.15.8:0/312170578 >> 172.21.15.8:0/312170578 conn(0x7f76000fb340 msgr2=0x7f76000fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.081+0000 7f76085ff700 1 -- 172.21.15.8:0/312170578 shutdown_connections 2023-10-06T23:23:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:07.081+0000 7f76085ff700 1 -- 172.21.15.8:0/312170578 wait complete. 2023-10-06T23:23:07.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:07 smithi156 ceph-mon[102862]: pgmap v658: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 5.0 MiB/s wr, 584 op/s 2023-10-06T23:23:07.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:07 smithi008 ceph-mon[98532]: pgmap v658: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 5.0 MiB/s wr, 584 op/s 2023-10-06T23:23:07.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:07 smithi190 ceph-mon[102658]: pgmap v658: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 5.0 MiB/s wr, 584 op/s 2023-10-06T23:23:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 495.0 s, 229.2 tps, lat 427.237 ms stddev 105.633 2023-10-06T23:23:09.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:09 smithi156 ceph-mon[102862]: pgmap v659: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 3.9 MiB/s wr, 476 op/s 2023-10-06T23:23:09.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:09 smithi008 ceph-mon[98532]: pgmap v659: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 3.9 MiB/s wr, 476 op/s 2023-10-06T23:23:09.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:09 smithi190 ceph-mon[102658]: pgmap v659: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 3.9 MiB/s wr, 476 op/s 2023-10-06T23:23:11.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:11 smithi156 ceph-mon[102862]: pgmap v660: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2023-10-06T23:23:11.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:11 smithi008 ceph-mon[98532]: pgmap v660: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2023-10-06T23:23:11.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:11 smithi190 ceph-mon[102658]: pgmap v660: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2023-10-06T23:23:13.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:13 smithi190 ceph-mon[102658]: pgmap v661: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 4.0 MiB/s wr, 480 op/s 2023-10-06T23:23:13.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:13 smithi156 ceph-mon[102862]: pgmap v661: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 4.0 MiB/s wr, 480 op/s 2023-10-06T23:23:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:13 smithi008 ceph-mon[98532]: pgmap v661: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 4.0 MiB/s wr, 480 op/s 2023-10-06T23:23:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 500.0 s, 288.8 tps, lat 351.022 ms stddev 67.405 2023-10-06T23:23:15.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:15 smithi008 ceph-mon[98532]: pgmap v662: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 4.5 MiB/s wr, 534 op/s 2023-10-06T23:23:15.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:15 smithi190 ceph-mon[102658]: pgmap v662: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 4.5 MiB/s wr, 534 op/s 2023-10-06T23:23:16.290 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:15 smithi156 ceph-mon[102862]: pgmap v662: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 4.5 MiB/s wr, 534 op/s 2023-10-06T23:23:17.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:17 smithi156 ceph-mon[102862]: pgmap v663: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.7 MiB/s wr, 548 op/s 2023-10-06T23:23:17.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:17 smithi008 ceph-mon[98532]: pgmap v663: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.7 MiB/s wr, 548 op/s 2023-10-06T23:23:17.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:17 smithi190 ceph-mon[102658]: pgmap v663: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.7 MiB/s wr, 548 op/s 2023-10-06T23:23:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 505.0 s, 234.4 tps, lat 417.147 ms stddev 141.021 2023-10-06T23:23:19.472 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:23:19.553 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:19 smithi008 ceph-mon[98532]: pgmap v664: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 3.8 MiB/s wr, 456 op/s 2023-10-06T23:23:19.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:19 smithi156 ceph-mon[102862]: pgmap v664: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 3.8 MiB/s wr, 456 op/s 2023-10-06T23:23:19.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:19 smithi190 ceph-mon[102658]: pgmap v664: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 3.8 MiB/s wr, 456 op/s 2023-10-06T23:23:19.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/125410127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 msgr2=0x7f0d78100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/125410127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 0x7f0d78100240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009990 tx=0x7f0d68009ca0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/125410127 shutdown_connections 2023-10-06T23:23:19.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/125410127 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d78101930 0x7f0d78108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/125410127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 0x7f0d78100240 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/125410127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d78100f70 0x7f0d781013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/125410127 >> 172.21.15.8:0/125410127 conn(0x7f0d780fb370 msgr2=0x7f0d780fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:19.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/125410127 shutdown_connections 2023-10-06T23:23:19.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.762+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/125410127 wait complete. 2023-10-06T23:23:19.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.764+0000 7f0d7d3ff700 1 Processor -- start 2023-10-06T23:23:19.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.764+0000 7f0d7d3ff700 1 -- start start 2023-10-06T23:23:19.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d7d3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 0x7f0d781041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d7d3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d78100f70 0x7f0d781027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d7d3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d78101930 0x7f0d78102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d7d3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781034d0 con 0x7f0d78100f70 2023-10-06T23:23:19.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d7d3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78103640 con 0x7f0d780ffe20 2023-10-06T23:23:19.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d7d3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781a0bd0 con 0x7f0d78101930 2023-10-06T23:23:19.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 0x7f0d781041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 0x7f0d781041b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:34582/0 (socket says 172.21.15.8:34582) 2023-10-06T23:23:19.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.765+0000 7f0d76ffd700 1 -- 172.21.15.8:0/1326945483 learned_addr learned my addr 172.21.15.8:0/1326945483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:19.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d767fc700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d78100f70 0x7f0d781027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d777fe700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d78101930 0x7f0d78102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d767fc700 1 -- 172.21.15.8:0/1326945483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d78101930 msgr2=0x7f0d78102d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d767fc700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d78101930 0x7f0d78102d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d767fc700 1 -- 172.21.15.8:0/1326945483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 msgr2=0x7f0d781041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d767fc700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 0x7f0d781041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d767fc700 1 -- 172.21.15.8:0/1326945483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d680095f0 con 0x7f0d78100f70 2023-10-06T23:23:19.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d76ffd700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 0x7f0d781041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:23:19.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.766+0000 7f0d767fc700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d78100f70 0x7f0d781027f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d950 tx=0x7f0d6c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:19.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.767+0000 7f0d5ffff700 1 -- 172.21.15.8:0/1326945483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00f890 con 0x7f0d78100f70 2023-10-06T23:23:19.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.767+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/1326945483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d781a0eb0 con 0x7f0d78100f70 2023-10-06T23:23:19.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.767+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/1326945483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d781a1380 con 0x7f0d78100f70 2023-10-06T23:23:19.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.767+0000 7f0d5ffff700 1 -- 172.21.15.8:0/1326945483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d6c00fe80 con 0x7f0d78100f70 2023-10-06T23:23:19.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.767+0000 7f0d5ffff700 1 -- 172.21.15.8:0/1326945483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00e3b0 con 0x7f0d78100f70 2023-10-06T23:23:19.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.772+0000 7f0d5ffff700 1 -- 172.21.15.8:0/1326945483 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0d6c00f9f0 con 0x7f0d78100f70 2023-10-06T23:23:19.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.774+0000 7f0d90db3b80 1 Processor -- start 2023-10-06T23:23:19.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.774+0000 7f0d90db3b80 1 -- start start 2023-10-06T23:23:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.774+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 0x556bf28e1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.774+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28e2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.774+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.774+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf2849460 con 0x556bf28e1260 2023-10-06T23:23:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.774+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf283ac20 con 0x556bf28e1bc0 2023-10-06T23:23:19.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.774+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf2838540 con 0x556bf28e2a60 2023-10-06T23:23:19.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.775+0000 7f0d767fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.775+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.775+0000 7f0d767fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:43574/0 (socket says 172.21.15.8:43574) 2023-10-06T23:23:19.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.775+0000 7f0d767fc700 1 -- 172.21.15.8:0/4024130740 learned_addr learned my addr 172.21.15.8:0/4024130740 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:19.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.775+0000 7f0d767fc700 1 -- 172.21.15.8:0/4024130740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 msgr2=0x556bf28e2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:19.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.775+0000 7f0d767fc700 1 --2- 172.21.15.8:0/4024130740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28e2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.775+0000 7f0d767fc700 1 -- 172.21.15.8:0/4024130740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 msgr2=0x556bf28e1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:19.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.775+0000 7f0d767fc700 1 --2- 172.21.15.8:0/4024130740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 0x556bf28e1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.776+0000 7f0d767fc700 1 -- 172.21.15.8:0/4024130740 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bf265ede0 con 0x556bf28e2a60 2023-10-06T23:23:19.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.776+0000 7f0d5ffff700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d600a1500 0x7f0d600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.776+0000 7f0d5ffff700 1 -- 172.21.15.8:0/1326945483 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0d6c0ccc10 con 0x7f0d78100f70 2023-10-06T23:23:19.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.776+0000 7f0d767fc700 1 --2- 172.21.15.8:0/4024130740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e2ee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0d0b70 tx=0x7f0d6c0d0ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1670a8f6232ed15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:19.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.776+0000 7f0d777fe700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d600a1500 0x7f0d600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.776+0000 7f0d5d7fa700 1 -- 172.21.15.8:0/4024130740 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c099cb0 con 0x556bf28e2a60 2023-10-06T23:23:19.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.776+0000 7f0d5d7fa700 1 -- 172.21.15.8:0/4024130740 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d6c0d1040 con 0x556bf28e2a60 2023-10-06T23:23:19.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.776+0000 7f0d5d7fa700 1 -- 172.21.15.8:0/4024130740 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c09a5e0 con 0x556bf28e2a60 2023-10-06T23:23:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.777+0000 7f0d90db3b80 1 -- 172.21.15.8:0/4024130740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 msgr2=0x556bf28e2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.777+0000 7f0d777fe700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d600a1500 0x7f0d600a39c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d78104810 tx=0x7f0d70003a70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.777+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/4024130740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e2ee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0d0b70 tx=0x7f0d6c0d0ba0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.778+0000 7f0d90db3b80 1 -- 172.21.15.8:0/4024130740 shutdown_connections 2023-10-06T23:23:19.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.778+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/4024130740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 0x556bf28e1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.778+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/4024130740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e2ee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.778+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/4024130740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.778+0000 7f0d90db3b80 1 -- 172.21.15.8:0/4024130740 >> 172.21.15.8:0/4024130740 conn(0x556bf2855260 msgr2=0x556bf28dc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.778+0000 7f0d90db3b80 1 -- 172.21.15.8:0/4024130740 shutdown_connections 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.778+0000 7f0d90db3b80 1 -- 172.21.15.8:0/4024130740 wait complete. 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.778+0000 7f0d90db3b80 1 -- start start 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.779+0000 7f0d90db3b80 1 Processor -- start 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.779+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1260 0x556bf28f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.779+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.779+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28fae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.779+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf2833e30 con 0x556bf28e2a60 2023-10-06T23:23:19.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.779+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf27d0710 con 0x556bf28e1bc0 2023-10-06T23:23:19.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.779+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf27d03b0 con 0x556bf28e1260 2023-10-06T23:23:19.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.779+0000 7f0d90db3b80 10 client.0 _ll_register_callbacks cb 0x556bf262d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:19.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1260 0x556bf28f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1260 0x556bf28f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:43590/0 (socket says 172.21.15.8:43590) 2023-10-06T23:23:19.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d76ffd700 1 -- 172.21.15.8:0/1710651685 learned_addr learned my addr 172.21.15.8:0/1710651685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:19.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d777fe700 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28fae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d767fc700 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d76ffd700 1 -- 172.21.15.8:0/1710651685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 msgr2=0x556bf28f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d76ffd700 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d76ffd700 1 -- 172.21.15.8:0/1710651685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 msgr2=0x556bf28fae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d76ffd700 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28fae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.780+0000 7f0d76ffd700 1 -- 172.21.15.8:0/1710651685 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d781a1380 con 0x556bf28e1260 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.781+0000 7f0d76ffd700 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1260 0x556bf28f3880 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0d680052a0 tx=0x7f0d680052d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e94fd53acb3453dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.781+0000 7f0d5aff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.781+0000 7f0d5aff5700 1 -- 172.21.15.8:0/1710651685 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6801d070 con 0x556bf28e1260 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.781+0000 7f0d90db3b80 1 -- 172.21.15.8:0/1710651685 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bf28d3f10 con 0x556bf28e1260 2023-10-06T23:23:19.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.781+0000 7f0d5aff5700 1 -- 172.21.15.8:0/1710651685 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0d68004500 con 0x556bf28e1260 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d5aff5700 1 -- 172.21.15.8:0/1710651685 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d680046e0 con 0x556bf28e1260 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d90db3b80 10 client.26446 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d90db3b80 1 -- 172.21.15.8:0/1710651685 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x556bf2647c60 con 0x556bf28e1260 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d5aff5700 1 -- 172.21.15.8:0/1710651685 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556bf28d3f10 con 0x556bf28e1260 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d5aff5700 1 -- 172.21.15.8:0/1710651685 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0d68003bf0 con 0x556bf28e1260 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d90db3b80 10 client.26446 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d90db3b80 10 client.26446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d90db3b80 20 client.26446 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556bf28ff690 0x556bf2901ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d90db3b80 4 client.26446 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.782+0000 7f0d90db3b80 1 -- 172.21.15.8:0/1710651685 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bf282ce10 con 0x556bf28ff690 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.783+0000 7f0d767fc700 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556bf28ff690 0x556bf2901ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.783+0000 7f0d767fc700 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556bf28ff690 0x556bf2901ab0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4a9fdbd16019e8 server_cookie=b88a5862a33b001a in_seq=0 out_seq=0 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.783+0000 7f0d5aff5700 10 client.26446 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.785+0000 7f0d5aff5700 1 -- 172.21.15.8:0/1710651685 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556bf282ce10 con 0x556bf28ff690 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.785+0000 7f0d5aff5700 10 client.26446 handle_command_reply: tid=0 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.785+0000 7f0d90db3b80 1 client.26446 shutdown 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.785+0000 7f0d90db3b80 1 -- 172.21.15.8:0/1710651685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1260 msgr2=0x556bf28f3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.785+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1260 0x556bf28f3880 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0d680052a0 tx=0x7f0d680052d0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 1 -- 172.21.15.8:0/1710651685 shutdown_connections 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556bf28ff690 0x556bf2901ab0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28fae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1260 0x556bf28f3880 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d5aff5700 0 client.26446 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/1710651685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 1 -- 172.21.15.8:0/1710651685 >> 172.21.15.8:0/1710651685 conn(0x556bf2855260 msgr2=0x556bf28dbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 1 -- 172.21.15.8:0/1710651685 shutdown_connections 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 1 -- 172.21.15.8:0/1710651685 wait complete. 2023-10-06T23:23:19.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.786+0000 7f0d90db3b80 20 client.26446 trim_cache size 0 max 16384 2023-10-06T23:23:19.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.813+0000 7f0d90db3b80 1 Processor -- start 2023-10-06T23:23:19.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.813+0000 7f0d90db3b80 1 -- start start 2023-10-06T23:23:19.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.813+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 0x556bf28e5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.813+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.813+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.813+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf26b4920 con 0x556bf28e1260 2023-10-06T23:23:19.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.813+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf28d65a0 con 0x556bf28e1bc0 2023-10-06T23:23:19.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.813+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf28f2330 con 0x556bf28e2a60 2023-10-06T23:23:19.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 0x556bf28e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d767fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d777fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d767fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28fadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:34606/0 (socket says 172.21.15.8:34606) 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d767fc700 1 -- 172.21.15.8:0/684326236 learned_addr learned my addr 172.21.15.8:0/684326236 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 0x556bf28e5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49594/0 (socket says 172.21.15.8:49594) 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d767fc700 1 -- 172.21.15.8:0/684326236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 msgr2=0x556bf28e5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d767fc700 1 --2- 172.21.15.8:0/684326236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d767fc700 1 -- 172.21.15.8:0/684326236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 msgr2=0x556bf28e5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d767fc700 1 --2- 172.21.15.8:0/684326236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 0x556bf28e5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.814+0000 7f0d767fc700 1 -- 172.21.15.8:0/684326236 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bf2685250 con 0x556bf28e1bc0 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.815+0000 7f0d767fc700 1 --2- 172.21.15.8:0/684326236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28fadc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0a1d40 tx=0x7f0d6c010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56bac026a2509e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.815+0000 7f0d5dffb700 1 -- 172.21.15.8:0/684326236 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0d0140 con 0x556bf28e1bc0 2023-10-06T23:23:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.815+0000 7f0d5dffb700 1 -- 172.21.15.8:0/684326236 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d6c099840 con 0x556bf28e1bc0 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.815+0000 7f0d5dffb700 1 -- 172.21.15.8:0/684326236 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c099f70 con 0x556bf28e1bc0 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 -- 172.21.15.8:0/684326236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 msgr2=0x556bf28fadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/684326236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28fadc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0a1d40 tx=0x7f0d6c010000 comp rx=0 tx=0).stop 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 -- 172.21.15.8:0/684326236 shutdown_connections 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/684326236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e1260 0x556bf28e5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/684326236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e2a60 0x556bf28e5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/684326236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1bc0 0x556bf28fadc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 -- 172.21.15.8:0/684326236 >> 172.21.15.8:0/684326236 conn(0x556bf2855260 msgr2=0x556bf28fb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 -- 172.21.15.8:0/684326236 shutdown_connections 2023-10-06T23:23:19.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.816+0000 7f0d90db3b80 1 -- 172.21.15.8:0/684326236 wait complete. 2023-10-06T23:23:19.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 1 -- start start 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 1 Processor -- start 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1260 0x556bf28fa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1bc0 0x556bf28f7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28f7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf28f7f60 con 0x556bf28e2a60 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf28faf20 con 0x556bf28e1260 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf28fb0b0 con 0x556bf28e1bc0 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.817+0000 7f0d90db3b80 10 client.0 _ll_register_callbacks cb 0x7f0d6800be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d767fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1bc0 0x556bf28f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1260 0x556bf28fa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28f7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49610/0 (socket says 172.21.15.8:49610) 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d767fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1bc0 0x556bf28f7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:43608/0 (socket says 172.21.15.8:43608) 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d777fe700 1 -- 172.21.15.8:0/3233385417 learned_addr learned my addr 172.21.15.8:0/3233385417 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d767fc700 1 -- 172.21.15.8:0/3233385417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1260 msgr2=0x556bf28fa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d767fc700 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1260 0x556bf28fa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d767fc700 1 -- 172.21.15.8:0/3233385417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 msgr2=0x556bf28f7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d767fc700 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28f7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d767fc700 1 -- 172.21.15.8:0/3233385417 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bf265ede0 con 0x556bf28e1bc0 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d777fe700 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d767fc700 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1bc0 0x556bf28f7340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0999b0 tx=0x7f0d6c0d0140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b791bab4a2acdd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.818+0000 7f0d5aff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:23:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d5aff5700 1 -- 172.21.15.8:0/3233385417 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0b8200 con 0x556bf28e1bc0 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d90db3b80 1 -- 172.21.15.8:0/3233385417 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d6c0d1040 con 0x556bf28e1bc0 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d5aff5700 1 -- 172.21.15.8:0/3233385417 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0d6c00fca0 con 0x556bf28e1bc0 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d5aff5700 1 -- 172.21.15.8:0/3233385417 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d6c099a20 con 0x556bf28e1bc0 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d90db3b80 10 client.26452 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d90db3b80 1 -- 172.21.15.8:0/3233385417 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x556bf265d2b0 con 0x556bf28e1bc0 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d5aff5700 1 -- 172.21.15.8:0/3233385417 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d6c0d1040 con 0x556bf28e1bc0 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d5aff5700 1 -- 172.21.15.8:0/3233385417 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0d6c09a140 con 0x556bf28e1bc0 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d90db3b80 10 client.26452 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.819+0000 7f0d90db3b80 10 client.26452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.820+0000 7f0d90db3b80 20 client.26452 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.820+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556bf2954700 0x556bf2956b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.820+0000 7f0d90db3b80 4 client.26452 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.820+0000 7f0d90db3b80 1 -- 172.21.15.8:0/3233385417 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556bf282cb30 con 0x556bf2954700 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.820+0000 7f0d76ffd700 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556bf2954700 0x556bf2956b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d76ffd700 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556bf2954700 0x556bf2956b20 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24876b63db4ca62 server_cookie=3dbbb498e5ad41d9 in_seq=0 out_seq=0 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d5aff5700 10 client.26452 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d5aff5700 1 -- 172.21.15.8:0/3233385417 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x556bf282cb30 con 0x556bf2954700 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d5aff5700 10 client.26452 handle_command_reply: tid=0 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 client.26452 shutdown 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 -- 172.21.15.8:0/3233385417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1bc0 msgr2=0x556bf28f7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1bc0 0x556bf28f7340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0999b0 tx=0x7f0d6c0d0140 comp rx=0 tx=0).stop 2023-10-06T23:23:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 -- 172.21.15.8:0/3233385417 shutdown_connections 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x556bf2954700 0x556bf2956b20 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556bf28e2a60 0x556bf28f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556bf28e1260 0x556bf28fa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 --2- 172.21.15.8:0/3233385417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bf28e1bc0 0x556bf28f7340 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d5aff5700 0 client.26452 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.821+0000 7f0d90db3b80 1 -- 172.21.15.8:0/3233385417 >> 172.21.15.8:0/3233385417 conn(0x556bf2855260 msgr2=0x556bf28e5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.822+0000 7f0d90db3b80 1 -- 172.21.15.8:0/3233385417 shutdown_connections 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.822+0000 7f0d90db3b80 1 -- 172.21.15.8:0/3233385417 wait complete. 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.822+0000 7f0d90db3b80 20 client.26452 trim_cache size 0 max 16384 2023-10-06T23:23:19.828 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:23:19.829 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:23:19.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d600a1500 msgr2=0x7f0d600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d600a1500 0x7f0d600a39c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d78104810 tx=0x7f0d70003a70 comp rx=0 tx=0).stop 2023-10-06T23:23:19.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d78100f70 msgr2=0x7f0d781027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:19.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d78100f70 0x7f0d781027f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d950 tx=0x7f0d6c00dc60 comp rx=0 tx=0).stop 2023-10-06T23:23:19.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/1326945483 shutdown_connections 2023-10-06T23:23:19.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d600a1500 0x7f0d600a39c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d78101930 0x7f0d78102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d780ffe20 0x7f0d781041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 --2- 172.21.15.8:0/1326945483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d78100f70 0x7f0d781027f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/1326945483 >> 172.21.15.8:0/1326945483 conn(0x7f0d780fb370 msgr2=0x7f0d780fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/1326945483 shutdown_connections 2023-10-06T23:23:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:19.823+0000 7f0d7d3ff700 1 -- 172.21.15.8:0/1326945483 wait complete. 2023-10-06T23:23:19.846 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:23:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 -- 172.21.15.8:0/4140052702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 msgr2=0x7fedc0103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 --2- 172.21.15.8:0/4140052702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 0x7fedc0103550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009990 tx=0x7fedb0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 -- 172.21.15.8:0/4140052702 shutdown_connections 2023-10-06T23:23:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 --2- 172.21.15.8:0/4140052702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0104cc0 0x7fedc010b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 --2- 172.21.15.8:0/4140052702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 0x7fedc0103550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 --2- 172.21.15.8:0/4140052702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc0104320 0x7fedc0104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 -- 172.21.15.8:0/4140052702 >> 172.21.15.8:0/4140052702 conn(0x7fedc00fe6a0 msgr2=0x7fedc0100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 -- 172.21.15.8:0/4140052702 shutdown_connections 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.282+0000 7fedc5bff700 1 -- 172.21.15.8:0/4140052702 wait complete. 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.284+0000 7fedc5bff700 1 Processor -- start 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.284+0000 7fedc5bff700 1 -- start start 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.284+0000 7fedc5bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 0x7fedc0198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.284+0000 7fedc5bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc0104320 0x7fedc0199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.284+0000 7fedc5bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0104cc0 0x7fedc019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.284+0000 7fedc5bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc019a860 con 0x7fedc0104320 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.284+0000 7fedc5bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc019a9d0 con 0x7fedc0104cc0 2023-10-06T23:23:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.284+0000 7fedc5bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc019ab90 con 0x7fedc0103130 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbf7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 0x7fedc0198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc0104320 0x7fedc0199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbf7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 0x7fedc0198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:43614/0 (socket says 172.21.15.8:43614) 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbf7fe700 1 -- 172.21.15.8:0/1094981799 learned_addr learned my addr 172.21.15.8:0/1094981799 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbffff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0104cc0 0x7fedc019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbf7fe700 1 -- 172.21.15.8:0/1094981799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0104cc0 msgr2=0x7fedc019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0104cc0 0x7fedc019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbf7fe700 1 -- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc0104320 msgr2=0x7fedc0199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc0104320 0x7fedc0199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbf7fe700 1 -- 172.21.15.8:0/1094981799 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4009520 con 0x7fedc0103130 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbffff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0104cc0 0x7fedc019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.285+0000 7fedbeffd700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc0104320 0x7fedc0199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:23:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.286+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 0x7fedc0198ee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedb0004800 tx=0x7fedb000b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.286+0000 7fedbcff9700 1 -- 172.21.15.8:0/1094981799 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb001d070 con 0x7fedc0103130 2023-10-06T23:23:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.286+0000 7fedc5bff700 1 -- 172.21.15.8:0/1094981799 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb00095f0 con 0x7fedc0103130 2023-10-06T23:23:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.286+0000 7fedbcff9700 1 -- 172.21.15.8:0/1094981799 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb0003d20 con 0x7fedc0103130 2023-10-06T23:23:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.286+0000 7fedbcff9700 1 -- 172.21.15.8:0/1094981799 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0005280 con 0x7fedc0103130 2023-10-06T23:23:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.286+0000 7fedc5bff700 1 -- 172.21.15.8:0/1094981799 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc01a13b0 con 0x7fedc0103130 2023-10-06T23:23:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.291+0000 7fedbcff9700 1 -- 172.21.15.8:0/1094981799 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fedb0003890 con 0x7fedc0103130 2023-10-06T23:23:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.292+0000 7fedd941fb80 1 Processor -- start 2023-10-06T23:23:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.292+0000 7fedd941fb80 1 -- start start 2023-10-06T23:23:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca44af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca45c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca4ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedd941fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fc9a4400 con 0x5640fca457e0 2023-10-06T23:23:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedd941fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fc995bc0 con 0x5640fca461a0 2023-10-06T23:23:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedd941fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fc9934e0 con 0x5640fca446d0 2023-10-06T23:23:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedbffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca44af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedbeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca4ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedbffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca44af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:43626/0 (socket says 172.21.15.8:43626) 2023-10-06T23:23:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.293+0000 7fedbffff700 1 -- 172.21.15.8:0/2912577512 learned_addr learned my addr 172.21.15.8:0/2912577512 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.294+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/2912577512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca45c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.294+0000 7fedbcff9700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feda80a1500 0x7feda80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.294+0000 7fedbffff700 1 -- 172.21.15.8:0/2912577512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 msgr2=0x5640fca4ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.294+0000 7fedbffff700 1 --2- 172.21.15.8:0/2912577512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca4ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.294+0000 7fedbffff700 1 -- 172.21.15.8:0/2912577512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 msgr2=0x5640fca45c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.294+0000 7fedbffff700 1 --2- 172.21.15.8:0/2912577512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca45c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.294+0000 7fedbffff700 1 -- 172.21.15.8:0/2912577512 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640fc7b9d80 con 0x5640fca446d0 2023-10-06T23:23:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.294+0000 7fedbcff9700 1 -- 172.21.15.8:0/1094981799 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fedb00cdf20 con 0x7fedc0103130 2023-10-06T23:23:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.295+0000 7fedbffff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feda80a1500 0x7feda80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.295+0000 7fedbffff700 1 --2- 172.21.15.8:0/2912577512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca44af0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009370 tx=0x7fedb8009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df54d3d6f6efb6b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.296+0000 7feda5ffb700 1 -- 172.21.15.8:0/2912577512 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800e030 con 0x5640fca446d0 2023-10-06T23:23:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.296+0000 7feda5ffb700 1 -- 172.21.15.8:0/2912577512 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb800f040 con 0x5640fca446d0 2023-10-06T23:23:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.296+0000 7feda5ffb700 1 -- 172.21.15.8:0/2912577512 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80216b0 con 0x5640fca446d0 2023-10-06T23:23:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 -- 172.21.15.8:0/2912577512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 msgr2=0x5640fca44af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedbffff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feda80a1500 0x7feda80a39c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fedb801c000 tx=0x7fedb801f000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 --2- 172.21.15.8:0/2912577512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca44af0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009370 tx=0x7fedb8009920 comp rx=0 tx=0).stop 2023-10-06T23:23:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 -- 172.21.15.8:0/2912577512 shutdown_connections 2023-10-06T23:23:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 --2- 172.21.15.8:0/2912577512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca4ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 --2- 172.21.15.8:0/2912577512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca44af0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 --2- 172.21.15.8:0/2912577512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca45c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 -- 172.21.15.8:0/2912577512 >> 172.21.15.8:0/2912577512 conn(0x5640fc9b0200 msgr2=0x5640fca36bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 -- 172.21.15.8:0/2912577512 shutdown_connections 2023-10-06T23:23:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.297+0000 7fedd941fb80 1 -- 172.21.15.8:0/2912577512 wait complete. 2023-10-06T23:23:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.298+0000 7fedd941fb80 1 -- start start 2023-10-06T23:23:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.298+0000 7fedd941fb80 1 Processor -- start 2023-10-06T23:23:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca4e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca4e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca55900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedd941fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fc98edd0 con 0x5640fca457e0 2023-10-06T23:23:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedd941fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fc92b6b0 con 0x5640fca461a0 2023-10-06T23:23:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedd941fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fc92b350 con 0x5640fca446d0 2023-10-06T23:23:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedd941fb80 10 client.0 _ll_register_callbacks cb 0x5640fc7887a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedbffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca55900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.299+0000 7fedbffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca55900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:34658/0 (socket says 172.21.15.8:34658) 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.300+0000 7fedbffff700 1 -- 172.21.15.8:0/321868509 learned_addr learned my addr 172.21.15.8:0/321868509 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.300+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca4e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.300+0000 7fedbeffd700 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca4e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.300+0000 7fedbffff700 1 -- 172.21.15.8:0/321868509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 msgr2=0x5640fca4e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.300+0000 7fedbffff700 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca4e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.300+0000 7fedbffff700 1 -- 172.21.15.8:0/321868509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 msgr2=0x5640fca4e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.300+0000 7fedbffff700 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca4e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.300+0000 7fedbffff700 1 -- 172.21.15.8:0/321868509 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb8009050 con 0x5640fca461a0 2023-10-06T23:23:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.301+0000 7fedbffff700 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca55900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009d40 tx=0x7fedb8015c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ebd5fea6ad36c87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.301+0000 7fed9effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:23:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.301+0000 7fed9effd700 1 -- 172.21.15.8:0/321868509 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800e040 con 0x5640fca461a0 2023-10-06T23:23:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.301+0000 7fed9effd700 1 -- 172.21.15.8:0/321868509 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fedb8004c90 con 0x5640fca461a0 2023-10-06T23:23:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.301+0000 7fedd941fb80 1 -- 172.21.15.8:0/321868509 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640fca2ed50 con 0x5640fca461a0 2023-10-06T23:23:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.302+0000 7fed9effd700 1 -- 172.21.15.8:0/321868509 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedb8004e70 con 0x5640fca461a0 2023-10-06T23:23:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.302+0000 7fedd941fb80 10 client.26444 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.302+0000 7fedd941fb80 1 -- 172.21.15.8:0/321868509 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5640fc7a2c00 con 0x5640fca461a0 2023-10-06T23:23:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.302+0000 7fed9effd700 1 -- 172.21.15.8:0/321868509 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb803c020 con 0x5640fca461a0 2023-10-06T23:23:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.303+0000 7fed9effd700 1 -- 172.21.15.8:0/321868509 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fedb8038480 con 0x5640fca461a0 2023-10-06T23:23:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.303+0000 7fedd941fb80 10 client.26444 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.303+0000 7fedd941fb80 10 client.26444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.303+0000 7fedd941fb80 20 client.26444 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.303+0000 7fedd941fb80 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5640fca5a190 0x5640fca5c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.303+0000 7fedd941fb80 4 client.26444 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:23:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.303+0000 7fedd941fb80 1 -- 172.21.15.8:0/321868509 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640fc987db0 con 0x5640fca5a190 2023-10-06T23:23:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.303+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5640fca5a190 0x5640fca5c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.304+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5640fca5a190 0x5640fca5c5b0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff61ce3fded43698 server_cookie=3a2eebb5542ec1f2 in_seq=0 out_seq=0 2023-10-06T23:23:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.304+0000 7fed9effd700 10 client.26444 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.305+0000 7fed9effd700 1 -- 172.21.15.8:0/321868509 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5640fc987db0 con 0x5640fca5a190 2023-10-06T23:23:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.305+0000 7fed9effd700 10 client.26444 handle_command_reply: tid=0 2023-10-06T23:23:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.305+0000 7fedd941fb80 1 client.26444 shutdown 2023-10-06T23:23:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.305+0000 7fedd941fb80 1 -- 172.21.15.8:0/321868509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 msgr2=0x5640fca55900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.305+0000 7fedd941fb80 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca55900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009d40 tx=0x7fedb8015c50 comp rx=0 tx=0).stop 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 1 -- 172.21.15.8:0/321868509 shutdown_connections 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5640fca5a190 0x5640fca5c5b0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca461a0 0x5640fca55900 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fed9effd700 0 client.26444 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca446d0 0x5640fca4e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 1 --2- 172.21.15.8:0/321868509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca4e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 1 -- 172.21.15.8:0/321868509 >> 172.21.15.8:0/321868509 conn(0x5640fc9b0200 msgr2=0x5640fca36250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 1 -- 172.21.15.8:0/321868509 shutdown_connections 2023-10-06T23:23:20.308 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 1 -- 172.21.15.8:0/321868509 wait complete. 2023-10-06T23:23:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.306+0000 7fedd941fb80 20 client.26444 trim_cache size 0 max 16384 2023-10-06T23:23:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.330+0000 7fedd941fb80 1 Processor -- start 2023-10-06T23:23:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.330+0000 7fedd941fb80 1 -- start start 2023-10-06T23:23:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca446d0 0x5640fca4da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca457e0 0x5640fca558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 0x5640fca4d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedd941fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fc80f8c0 con 0x5640fca446d0 2023-10-06T23:23:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedd941fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fca33860 con 0x5640fca457e0 2023-10-06T23:23:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedd941fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fca465b0 con 0x5640fca461a0 2023-10-06T23:23:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedbeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca457e0 0x5640fca558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedbeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca457e0 0x5640fca558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:34674/0 (socket says 172.21.15.8:34674) 2023-10-06T23:23:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedbeffd700 1 -- 172.21.15.8:0/4157891937 learned_addr learned my addr 172.21.15.8:0/4157891937 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.331+0000 7fedbffff700 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 0x5640fca4d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.332+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca446d0 0x5640fca4da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.332+0000 7fedbeffd700 1 -- 172.21.15.8:0/4157891937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 msgr2=0x5640fca4d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.332+0000 7fedbeffd700 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 0x5640fca4d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.332+0000 7fedbeffd700 1 -- 172.21.15.8:0/4157891937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca446d0 msgr2=0x5640fca4da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.332+0000 7fedbeffd700 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca446d0 0x5640fca4da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.332+0000 7fedbeffd700 1 -- 172.21.15.8:0/4157891937 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640fc7e01f0 con 0x5640fca457e0 2023-10-06T23:23:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.332+0000 7fedbeffd700 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca457e0 0x5640fca558c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedb400f8e0 tx=0x7fedb4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1073c2e07e2f88ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.333+0000 7feda67fc700 1 -- 172.21.15.8:0/4157891937 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4020070 con 0x5640fca457e0 2023-10-06T23:23:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.333+0000 7feda67fc700 1 -- 172.21.15.8:0/4157891937 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb4018040 con 0x5640fca457e0 2023-10-06T23:23:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.333+0000 7feda67fc700 1 -- 172.21.15.8:0/4157891937 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4017050 con 0x5640fca457e0 2023-10-06T23:23:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 -- 172.21.15.8:0/4157891937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca457e0 msgr2=0x5640fca558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca457e0 0x5640fca558c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedb400f8e0 tx=0x7fedb4009260 comp rx=0 tx=0).stop 2023-10-06T23:23:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 -- 172.21.15.8:0/4157891937 shutdown_connections 2023-10-06T23:23:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca446d0 0x5640fca4da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 0x5640fca4d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 --2- 172.21.15.8:0/4157891937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca457e0 0x5640fca558c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 -- 172.21.15.8:0/4157891937 >> 172.21.15.8:0/4157891937 conn(0x5640fc9b0200 msgr2=0x5640fca60f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 -- 172.21.15.8:0/4157891937 shutdown_connections 2023-10-06T23:23:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.334+0000 7fedd941fb80 1 -- 172.21.15.8:0/4157891937 wait complete. 2023-10-06T23:23:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.335+0000 7fedd941fb80 1 -- start start 2023-10-06T23:23:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.335+0000 7fedd941fb80 1 Processor -- start 2023-10-06T23:23:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca446d0 0x5640fca537c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca53d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedd941fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 0x5640fca54d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedd941fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fca55250 con 0x5640fca457e0 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedd941fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fca553c0 con 0x5640fca446d0 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedd941fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fca55580 con 0x5640fca461a0 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedd941fb80 10 client.0 _ll_register_callbacks cb 0x7fedb4009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedbeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca53d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedbeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca53d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49658/0 (socket says 172.21.15.8:49658) 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedbeffd700 1 -- 172.21.15.8:0/3000801865 learned_addr learned my addr 172.21.15.8:0/3000801865 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedbffff700 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 0x5640fca54d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.336+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca446d0 0x5640fca537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.337+0000 7fedbeffd700 1 -- 172.21.15.8:0/3000801865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 msgr2=0x5640fca54d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.337+0000 7fedbeffd700 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 0x5640fca54d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.337+0000 7fedbeffd700 1 -- 172.21.15.8:0/3000801865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca446d0 msgr2=0x5640fca537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.337+0000 7fedbeffd700 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca446d0 0x5640fca537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.337+0000 7fedbeffd700 1 -- 172.21.15.8:0/3000801865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb400f590 con 0x5640fca457e0 2023-10-06T23:23:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.337+0000 7fedbeffd700 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca53d00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fedb400fed0 tx=0x7fedb40123c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9257b89f310c31e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.338+0000 7fed9effd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:23:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.338+0000 7fed9effd700 1 -- 172.21.15.8:0/3000801865 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4020040 con 0x5640fca457e0 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.338+0000 7fed9effd700 1 -- 172.21.15.8:0/3000801865 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fedb4004be0 con 0x5640fca457e0 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.338+0000 7fedd941fb80 1 -- 172.21.15.8:0/3000801865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fedb800f040 con 0x5640fca457e0 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.338+0000 7fed9effd700 1 -- 172.21.15.8:0/3000801865 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedb4017020 con 0x5640fca457e0 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.338+0000 7fedd941fb80 10 client.16587 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.338+0000 7fedd941fb80 1 -- 172.21.15.8:0/3000801865 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5640fc7b8250 con 0x5640fca457e0 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.339+0000 7fed9effd700 1 -- 172.21.15.8:0/3000801865 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb800f040 con 0x5640fca457e0 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.339+0000 7fed9effd700 1 -- 172.21.15.8:0/3000801865 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fedb4003b90 con 0x5640fca457e0 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.339+0000 7fedd941fb80 10 client.16587 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.339+0000 7fedd941fb80 10 client.16587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.339+0000 7fedd941fb80 20 client.16587 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.339+0000 7fedd941fb80 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5640fcaaef80 0x5640fcab13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.339+0000 7fedd941fb80 4 client.16587 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:23:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.339+0000 7fedd941fb80 1 -- 172.21.15.8:0/3000801865 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5640fc987ad0 con 0x5640fcaaef80 2023-10-06T23:23:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.340+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5640fcaaef80 0x5640fcab13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.340+0000 7fed9effd700 10 client.16587 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.340+0000 7fedbf7fe700 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5640fcaaef80 0x5640fcab13a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddd549f0c48126b3 server_cookie=b3909a1ce6ac28c3 in_seq=0 out_seq=0 2023-10-06T23:23:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.357+0000 7fed9effd700 1 -- 172.21.15.8:0/3000801865 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5640fc987ad0 con 0x5640fcaaef80 2023-10-06T23:23:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.357+0000 7fed9effd700 10 client.16587 handle_command_reply: tid=0 2023-10-06T23:23:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 client.16587 shutdown 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 -- 172.21.15.8:0/3000801865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 msgr2=0x5640fca53d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca53d00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fedb400fed0 tx=0x7fedb40123c0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 -- 172.21.15.8:0/3000801865 shutdown_connections 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5640fcaaef80 0x5640fcab13a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640fca461a0 0x5640fca54d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640fca446d0 0x5640fca537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fed9effd700 0 client.16587 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 --2- 172.21.15.8:0/3000801865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640fca457e0 0x5640fca53d00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 -- 172.21.15.8:0/3000801865 >> 172.21.15.8:0/3000801865 conn(0x5640fc9b0200 msgr2=0x5640fca4d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 -- 172.21.15.8:0/3000801865 shutdown_connections 2023-10-06T23:23:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 1 -- 172.21.15.8:0/3000801865 wait complete. 2023-10-06T23:23:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.358+0000 7fedd941fb80 20 client.16587 trim_cache size 0 max 16384 2023-10-06T23:23:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:23:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:23:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:23:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:23:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 -- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feda80a1500 msgr2=0x7feda80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feda80a1500 0x7feda80a39c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fedb801c000 tx=0x7fedb801f000 comp rx=0 tx=0).stop 2023-10-06T23:23:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 -- 172.21.15.8:0/1094981799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 msgr2=0x7fedc0198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 0x7fedc0198ee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedb0004800 tx=0x7fedb000b9c0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 -- 172.21.15.8:0/1094981799 shutdown_connections 2023-10-06T23:23:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feda80a1500 0x7feda80a39c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0104cc0 0x7fedc019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0103130 0x7fedc0198ee0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 --2- 172.21.15.8:0/1094981799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc0104320 0x7fedc0199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 -- 172.21.15.8:0/1094981799 >> 172.21.15.8:0/1094981799 conn(0x7fedc00fe6a0 msgr2=0x7fedc0100950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.359+0000 7fedc5bff700 1 -- 172.21.15.8:0/1094981799 shutdown_connections 2023-10-06T23:23:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:20.360+0000 7fedc5bff700 1 -- 172.21.15.8:0/1094981799 wait complete. 2023-10-06T23:23:21.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:21 smithi156 ceph-mon[102862]: pgmap v665: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 4.9 MiB/s wr, 560 op/s 2023-10-06T23:23:21.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:21 smithi008 ceph-mon[98532]: pgmap v665: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 4.9 MiB/s wr, 560 op/s 2023-10-06T23:23:21.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:21 smithi190 ceph-mon[102658]: pgmap v665: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 4.9 MiB/s wr, 560 op/s 2023-10-06T23:23:23.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:23 smithi156 ceph-mon[102862]: pgmap v666: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 3.5 MiB/s wr, 449 op/s 2023-10-06T23:23:23.898 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:23 smithi008 ceph-mon[98532]: pgmap v666: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 3.5 MiB/s wr, 449 op/s 2023-10-06T23:23:23.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:23 smithi190 ceph-mon[102658]: pgmap v666: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 3.5 MiB/s wr, 449 op/s 2023-10-06T23:23:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 510.0 s, 272.6 tps, lat 378.365 ms stddev 75.572 2023-10-06T23:23:25.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:25 smithi156 ceph-mon[102862]: pgmap v667: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 4.9 MiB/s wr, 579 op/s 2023-10-06T23:23:25.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:25 smithi008 ceph-mon[98532]: pgmap v667: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 4.9 MiB/s wr, 579 op/s 2023-10-06T23:23:25.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:25 smithi190 ceph-mon[102658]: pgmap v667: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 4.9 MiB/s wr, 579 op/s 2023-10-06T23:23:27.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:27 smithi156 ceph-mon[102862]: pgmap v668: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 4.6 MiB/s wr, 546 op/s 2023-10-06T23:23:27.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:27 smithi008 ceph-mon[98532]: pgmap v668: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 4.6 MiB/s wr, 546 op/s 2023-10-06T23:23:27.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:27 smithi190 ceph-mon[102658]: pgmap v668: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 4.6 MiB/s wr, 546 op/s 2023-10-06T23:23:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 515.0 s, 261.2 tps, lat 382.799 ms stddev 54.497 2023-10-06T23:23:29.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:29 smithi156 ceph-mon[102862]: pgmap v669: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 4.0 MiB/s wr, 489 op/s 2023-10-06T23:23:29.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:29 smithi008 ceph-mon[98532]: pgmap v669: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 4.0 MiB/s wr, 489 op/s 2023-10-06T23:23:29.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:29 smithi190 ceph-mon[102658]: pgmap v669: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 4.0 MiB/s wr, 489 op/s 2023-10-06T23:23:31.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:31 smithi156 ceph-mon[102862]: pgmap v670: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 5.2 MiB/s wr, 598 op/s 2023-10-06T23:23:31.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:31 smithi008 ceph-mon[98532]: pgmap v670: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 5.2 MiB/s wr, 598 op/s 2023-10-06T23:23:31.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:31 smithi190 ceph-mon[102658]: pgmap v670: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 5.2 MiB/s wr, 598 op/s 2023-10-06T23:23:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 -- 172.21.15.8:0/2708057606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc100f10 msgr2=0x7f1adc101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/2708057606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc100f10 0x7f1adc101330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009990 tx=0x7f1acc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 -- 172.21.15.8:0/2708057606 shutdown_connections 2023-10-06T23:23:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/2708057606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1adc102a20 0x7f1adc109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/2708057606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc100f10 0x7f1adc101330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/2708057606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1adc102060 0x7f1adc1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 -- 172.21.15.8:0/2708057606 >> 172.21.15.8:0/2708057606 conn(0x7f1adc0fc480 msgr2=0x7f1adc0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 -- 172.21.15.8:0/2708057606 shutdown_connections 2023-10-06T23:23:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.591+0000 7f1ae1bff700 1 -- 172.21.15.8:0/2708057606 wait complete. 2023-10-06T23:23:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.593+0000 7f1ae1bff700 1 Processor -- start 2023-10-06T23:23:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.593+0000 7f1ae1bff700 1 -- start start 2023-10-06T23:23:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1ae1bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1adc100f10 0x7f1adc0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1ae1bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc102060 0x7f1adc0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1ae1bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1adc102a20 0x7f1adc073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1ae1bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1a0b90 con 0x7f1adc102a20 2023-10-06T23:23:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1ae1bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1a0cd0 con 0x7f1adc102060 2023-10-06T23:23:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1ae1bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1a0e10 con 0x7f1adc100f10 2023-10-06T23:23:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc102060 0x7f1adc0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1adb7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1adc100f10 0x7f1adc0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc102060 0x7f1adc0737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53920/0 (socket says 172.21.15.8:53920) 2023-10-06T23:23:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1adaffd700 1 -- 172.21.15.8:0/3468407491 learned_addr learned my addr 172.21.15.8:0/3468407491 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.594+0000 7f1adbfff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1adc102a20 0x7f1adc073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1adaffd700 1 -- 172.21.15.8:0/3468407491 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1adc100f10 msgr2=0x7f1adc0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1adaffd700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1adc100f10 0x7f1adc0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1adaffd700 1 -- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1adc102a20 msgr2=0x7f1adc073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1adaffd700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1adc102a20 0x7f1adc073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1adaffd700 1 -- 172.21.15.8:0/3468407491 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0095f0 con 0x7f1adc102060 2023-10-06T23:23:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1adbfff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1adc102a20 0x7f1adc073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:23:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1adaffd700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc102060 0x7f1adc0737e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000e9a0 tx=0x7f1ad000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1ad8ff9700 1 -- 172.21.15.8:0/3468407491 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000ca10 con 0x7f1adc102060 2023-10-06T23:23:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1ae1bff700 1 -- 172.21.15.8:0/3468407491 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1adc1a10a0 con 0x7f1adc102060 2023-10-06T23:23:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1ad8ff9700 1 -- 172.21.15.8:0/3468407491 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ad0010430 con 0x7f1adc102060 2023-10-06T23:23:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.595+0000 7f1ad8ff9700 1 -- 172.21.15.8:0/3468407491 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0018680 con 0x7f1adc102060 2023-10-06T23:23:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.596+0000 7f1ae1bff700 1 -- 172.21.15.8:0/3468407491 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc1a15d0 con 0x7f1adc102060 2023-10-06T23:23:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.602+0000 7f1ad8ff9700 1 -- 172.21.15.8:0/3468407491 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1ad000cb70 con 0x7f1adc102060 2023-10-06T23:23:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.603+0000 7f1af5470b80 1 Processor -- start 2023-10-06T23:23:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.603+0000 7f1af5470b80 1 -- start start 2023-10-06T23:23:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.604+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 0x562b84ef8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.604+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef97e0 0x562b84ef9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.604+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f00a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.604+0000 7f1af5470b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84e58400 con 0x562b84ef97e0 2023-10-06T23:23:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.604+0000 7f1af5470b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84e49bc0 con 0x562b84efa1a0 2023-10-06T23:23:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.604+0000 7f1af5470b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84e474e0 con 0x562b84ef86d0 2023-10-06T23:23:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.604+0000 7f1ad8ff9700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ac40a1500 0x7f1ac40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.604+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f00a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f00a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53934/0 (socket says 172.21.15.8:53934) 2023-10-06T23:23:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adbfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 0x562b84ef8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adaffd700 1 -- 172.21.15.8:0/3491353548 learned_addr learned my addr 172.21.15.8:0/3491353548 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adbfff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ac40a1500 0x7f1ac40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1ad8ff9700 1 -- 172.21.15.8:0/3468407491 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1ad0014070 con 0x7f1adc102060 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adb7fe700 1 --2- 172.21.15.8:0/3491353548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef97e0 0x562b84ef9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adaffd700 1 -- 172.21.15.8:0/3491353548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 msgr2=0x562b84ef8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adaffd700 1 --2- 172.21.15.8:0/3491353548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 0x562b84ef8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adaffd700 1 -- 172.21.15.8:0/3491353548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef97e0 msgr2=0x562b84ef9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adaffd700 1 --2- 172.21.15.8:0/3491353548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef97e0 0x562b84ef9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.605+0000 7f1adaffd700 1 -- 172.21.15.8:0/3491353548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b84c6dd80 con 0x562b84efa1a0 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.606+0000 7f1adaffd700 1 --2- 172.21.15.8:0/3491353548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f00a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0022000 tx=0x7f1ad0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e80bb41910b0326 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.606+0000 7f1adbfff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ac40a1500 0x7f1ac40a39c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x562b84ef8470 tx=0x7f1ad400b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.606+0000 7f1ac1ffb700 1 -- 172.21.15.8:0/3491353548 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad009a090 con 0x562b84efa1a0 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.606+0000 7f1ac1ffb700 1 -- 172.21.15.8:0/3491353548 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ad0099e00 con 0x562b84efa1a0 2023-10-06T23:23:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.606+0000 7f1ac1ffb700 1 -- 172.21.15.8:0/3491353548 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad009a330 con 0x562b84efa1a0 2023-10-06T23:23:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.607+0000 7f1af5470b80 1 -- 172.21.15.8:0/3491353548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 msgr2=0x562b84f00a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.607+0000 7f1af5470b80 1 --2- 172.21.15.8:0/3491353548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f00a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0022000 tx=0x7f1ad0000bc0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.607+0000 7f1af5470b80 1 -- 172.21.15.8:0/3491353548 shutdown_connections 2023-10-06T23:23:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.607+0000 7f1af5470b80 1 --2- 172.21.15.8:0/3491353548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f00a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.607+0000 7f1af5470b80 1 --2- 172.21.15.8:0/3491353548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 0x562b84ef8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.607+0000 7f1af5470b80 1 --2- 172.21.15.8:0/3491353548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef97e0 0x562b84ef9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.607+0000 7f1af5470b80 1 -- 172.21.15.8:0/3491353548 >> 172.21.15.8:0/3491353548 conn(0x562b84e64200 msgr2=0x562b84eeabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.607+0000 7f1af5470b80 1 -- 172.21.15.8:0/3491353548 shutdown_connections 2023-10-06T23:23:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.608+0000 7f1af5470b80 1 -- 172.21.15.8:0/3491353548 wait complete. 2023-10-06T23:23:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.608+0000 7f1af5470b80 1 -- start start 2023-10-06T23:23:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.609+0000 7f1af5470b80 1 Processor -- start 2023-10-06T23:23:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.609+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 0x562b84f02220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.609+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f02760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.609+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84efa1a0 0x562b84f097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.609+0000 7f1af5470b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84e42dd0 con 0x562b84efa1a0 2023-10-06T23:23:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.609+0000 7f1af5470b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84ddf6b0 con 0x562b84ef97e0 2023-10-06T23:23:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.610+0000 7f1af5470b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84ddf350 con 0x562b84ef86d0 2023-10-06T23:23:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.610+0000 7f1af5470b80 10 client.0 _ll_register_callbacks cb 0x562b84c3c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.610+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f02760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.610+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f02760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53936/0 (socket says 172.21.15.8:53936) 2023-10-06T23:23:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.610+0000 7f1adaffd700 1 -- 172.21.15.8:0/2146797478 learned_addr learned my addr 172.21.15.8:0/2146797478 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.611+0000 7f1adaffd700 1 -- 172.21.15.8:0/2146797478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 msgr2=0x562b84f02220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.611+0000 7f1adaffd700 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 0x562b84f02220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.611+0000 7f1adaffd700 1 -- 172.21.15.8:0/2146797478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84efa1a0 msgr2=0x562b84f097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.611+0000 7f1adaffd700 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84efa1a0 0x562b84f097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.611+0000 7f1adaffd700 1 -- 172.21.15.8:0/2146797478 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc1a15d0 con 0x562b84ef97e0 2023-10-06T23:23:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.611+0000 7f1adaffd700 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f02760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00cd140 tx=0x7f1ad009a3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82dcda75d7a3983d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.611+0000 7f1abaffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:23:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1abaffd700 1 -- 172.21.15.8:0/2146797478 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad009a9c0 con 0x562b84ef97e0 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1abaffd700 1 -- 172.21.15.8:0/2146797478 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1ad00b2030 con 0x562b84ef97e0 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1af5470b80 1 -- 172.21.15.8:0/2146797478 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b84ee2d50 con 0x562b84ef97e0 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1abaffd700 1 -- 172.21.15.8:0/2146797478 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ad009e410 con 0x562b84ef97e0 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1af5470b80 10 client.26462 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1af5470b80 1 -- 172.21.15.8:0/2146797478 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562b84c56c00 con 0x562b84ef97e0 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1abaffd700 1 -- 172.21.15.8:0/2146797478 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ad00a6020 con 0x562b84ef97e0 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1abaffd700 1 -- 172.21.15.8:0/2146797478 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1ad00a22e0 con 0x562b84ef97e0 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1af5470b80 10 client.26462 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.612+0000 7f1af5470b80 10 client.26462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.613+0000 7f1af5470b80 20 client.26462 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.613+0000 7f1af5470b80 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562b84f0dbc0 0x562b84f0ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.613+0000 7f1af5470b80 4 client.26462 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:23:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.613+0000 7f1af5470b80 1 -- 172.21.15.8:0/2146797478 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b84e3bdb0 con 0x562b84f0dbc0 2023-10-06T23:23:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.613+0000 7f1adb7fe700 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562b84f0dbc0 0x562b84f0ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.614+0000 7f1adb7fe700 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562b84f0dbc0 0x562b84f0ffe0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93e9dce1eda3e298 server_cookie=7265f0c63baeea78 in_seq=0 out_seq=0 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.614+0000 7f1abaffd700 10 client.26462 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1abaffd700 1 -- 172.21.15.8:0/2146797478 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562b84e3bdb0 con 0x562b84f0dbc0 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1abaffd700 10 client.26462 handle_command_reply: tid=0 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 client.26462 shutdown 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 -- 172.21.15.8:0/2146797478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 msgr2=0x562b84f02760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f02760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00cd140 tx=0x7f1ad009a3e0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 -- 172.21.15.8:0/2146797478 shutdown_connections 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562b84f0dbc0 0x562b84f0ffe0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84efa1a0 0x562b84f097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1abaffd700 0 client.26462 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef86d0 0x562b84f02220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 --2- 172.21.15.8:0/2146797478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f02760 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 -- 172.21.15.8:0/2146797478 >> 172.21.15.8:0/2146797478 conn(0x562b84e64200 msgr2=0x562b84eea250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 -- 172.21.15.8:0/2146797478 shutdown_connections 2023-10-06T23:23:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.615+0000 7f1af5470b80 1 -- 172.21.15.8:0/2146797478 wait complete. 2023-10-06T23:23:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.616+0000 7f1af5470b80 20 client.26462 trim_cache size 0 max 16384 2023-10-06T23:23:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.638+0000 7f1af5470b80 1 Processor -- start 2023-10-06T23:23:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.638+0000 7f1af5470b80 1 -- start start 2023-10-06T23:23:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.638+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84ef8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.638+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f09760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.638+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84efa1a0 0x562b84efd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.638+0000 7f1af5470b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84cc38c0 con 0x562b84ef86d0 2023-10-06T23:23:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.638+0000 7f1af5470b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84e3bdb0 con 0x562b84ef97e0 2023-10-06T23:23:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.638+0000 7f1af5470b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84f01720 con 0x562b84efa1a0 2023-10-06T23:23:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f09760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f09760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:53942/0 (socket says 172.21.15.8:53942) 2023-10-06T23:23:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adaffd700 1 -- 172.21.15.8:0/1589172724 learned_addr learned my addr 172.21.15.8:0/1589172724 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adbfff700 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84efa1a0 0x562b84efd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adb7fe700 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84ef8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adaffd700 1 -- 172.21.15.8:0/1589172724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84efa1a0 msgr2=0x562b84efd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adaffd700 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84efa1a0 0x562b84efd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adaffd700 1 -- 172.21.15.8:0/1589172724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 msgr2=0x562b84ef8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adaffd700 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84ef8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.639+0000 7f1adaffd700 1 -- 172.21.15.8:0/1589172724 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b84c941f0 con 0x562b84ef97e0 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.640+0000 7f1adaffd700 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f09760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0096d30 tx=0x7f1ad0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2912db7c88964 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.640+0000 7f1ac27fc700 1 -- 172.21.15.8:0/1589172724 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000ce90 con 0x562b84ef97e0 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.640+0000 7f1ac27fc700 1 -- 172.21.15.8:0/1589172724 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ad00a6070 con 0x562b84ef97e0 2023-10-06T23:23:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.640+0000 7f1ac27fc700 1 -- 172.21.15.8:0/1589172724 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00a2650 con 0x562b84ef97e0 2023-10-06T23:23:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 -- 172.21.15.8:0/1589172724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 msgr2=0x562b84f09760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f09760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0096d30 tx=0x7f1ad0000bc0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 -- 172.21.15.8:0/1589172724 shutdown_connections 2023-10-06T23:23:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84ef8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84efa1a0 0x562b84efd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1589172724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84ef97e0 0x562b84f09760 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 -- 172.21.15.8:0/1589172724 >> 172.21.15.8:0/1589172724 conn(0x562b84e64200 msgr2=0x562b84eeb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 -- 172.21.15.8:0/1589172724 shutdown_connections 2023-10-06T23:23:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.641+0000 7f1af5470b80 1 -- 172.21.15.8:0/1589172724 wait complete. 2023-10-06T23:23:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.642+0000 7f1af5470b80 1 -- start start 2023-10-06T23:23:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.642+0000 7f1af5470b80 1 Processor -- start 2023-10-06T23:23:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84f07110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef97e0 0x562b84f07650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1af5470b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f08660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1af5470b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84f08ba0 con 0x562b84ef86d0 2023-10-06T23:23:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1af5470b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84f08d10 con 0x562b84efa1a0 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1af5470b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b84f08ed0 con 0x562b84ef97e0 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1af5470b80 10 client.0 _ll_register_callbacks cb 0x7f1ad40093b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1adb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84f07110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1adb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84f07110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42600/0 (socket says 172.21.15.8:42600) 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1adb7fe700 1 -- 172.21.15.8:0/1257406215 learned_addr learned my addr 172.21.15.8:0/1257406215 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1adaffd700 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef97e0 0x562b84f07650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.643+0000 7f1adbfff700 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f08660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.644+0000 7f1adb7fe700 1 -- 172.21.15.8:0/1257406215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef97e0 msgr2=0x562b84f07650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.644+0000 7f1adb7fe700 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef97e0 0x562b84f07650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.644+0000 7f1adb7fe700 1 -- 172.21.15.8:0/1257406215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 msgr2=0x562b84f08660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.644+0000 7f1adb7fe700 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f08660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.644+0000 7f1adb7fe700 1 -- 172.21.15.8:0/1257406215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b84c56c00 con 0x562b84ef86d0 2023-10-06T23:23:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.644+0000 7f1adaffd700 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef97e0 0x562b84f07650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:23:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.644+0000 7f1adb7fe700 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84f07110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1acc003f60 tx=0x7f1acc004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5115978f7ccd97c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.644+0000 7f1abaffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.645+0000 7f1abaffd700 1 -- 172.21.15.8:0/1257406215 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc01d040 con 0x562b84ef86d0 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.645+0000 7f1abaffd700 1 -- 172.21.15.8:0/1257406215 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1acc005620 con 0x562b84ef86d0 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.645+0000 7f1af5470b80 1 -- 172.21.15.8:0/1257406215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ad0099e00 con 0x562b84ef86d0 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.645+0000 7f1abaffd700 1 -- 172.21.15.8:0/1257406215 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1acc026a00 con 0x562b84ef86d0 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.645+0000 7f1af5470b80 10 client.16602 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.645+0000 7f1af5470b80 1 -- 172.21.15.8:0/1257406215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562b84c6c250 con 0x562b84ef86d0 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.646+0000 7f1abaffd700 1 -- 172.21.15.8:0/1257406215 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ad0099e00 con 0x562b84ef86d0 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.646+0000 7f1abaffd700 1 -- 172.21.15.8:0/1257406215 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1acc038070 con 0x562b84ef86d0 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.646+0000 7f1af5470b80 10 client.16602 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.646+0000 7f1af5470b80 10 client.16602 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.646+0000 7f1af5470b80 20 client.16602 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.646+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562b84f62670 0x562b84f64a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.646+0000 7f1af5470b80 4 client.16602 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:23:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.646+0000 7f1af5470b80 1 -- 172.21.15.8:0/1257406215 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562b84e3bad0 con 0x562b84f62670 2023-10-06T23:23:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.647+0000 7f1adaffd700 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562b84f62670 0x562b84f64a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.647+0000 7f1adaffd700 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562b84f62670 0x562b84f64a90 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d44120562e62c511 server_cookie=cc4fc32adff0cd7e in_seq=0 out_seq=0 2023-10-06T23:23:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.647+0000 7f1abaffd700 10 client.16602 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1abaffd700 1 -- 172.21.15.8:0/1257406215 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562b84e3bad0 con 0x562b84f62670 2023-10-06T23:23:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1abaffd700 10 client.16602 handle_command_reply: tid=0 2023-10-06T23:23:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 client.16602 shutdown 2023-10-06T23:23:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 -- 172.21.15.8:0/1257406215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 msgr2=0x562b84f07110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84f07110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1acc003f60 tx=0x7f1acc004120 comp rx=0 tx=0).stop 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 -- 172.21.15.8:0/1257406215 shutdown_connections 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562b84f62670 0x562b84f64a90 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b84ef86d0 0x562b84f07110 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b84efa1a0 0x562b84f08660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 --2- 172.21.15.8:0/1257406215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562b84ef97e0 0x562b84f07650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 -- 172.21.15.8:0/1257406215 >> 172.21.15.8:0/1257406215 conn(0x562b84e64200 msgr2=0x562b84efd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1abaffd700 0 client.16602 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 -- 172.21.15.8:0/1257406215 shutdown_connections 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.663+0000 7f1af5470b80 1 -- 172.21.15.8:0/1257406215 wait complete. 2023-10-06T23:23:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1af5470b80 20 client.16602 trim_cache size 0 max 16384 2023-10-06T23:23:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:23:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:23:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:23:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 -- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ac40a1500 msgr2=0x7f1ac40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ac40a1500 0x7f1ac40a39c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x562b84ef8470 tx=0x7f1ad400b040 comp rx=0 tx=0).stop 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 -- 172.21.15.8:0/3468407491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc102060 msgr2=0x7f1adc0737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc102060 0x7f1adc0737e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000e9a0 tx=0x7f1ad000ecb0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 -- 172.21.15.8:0/3468407491 shutdown_connections 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ac40a1500 0x7f1ac40a39c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1adc102a20 0x7f1adc073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1adc100f10 0x7f1adc0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 --2- 172.21.15.8:0/3468407491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1adc102060 0x7f1adc0737e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 -- 172.21.15.8:0/3468407491 >> 172.21.15.8:0/3468407491 conn(0x7f1adc0fc480 msgr2=0x7f1adc0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 -- 172.21.15.8:0/3468407491 shutdown_connections 2023-10-06T23:23:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:33.664+0000 7f1ae1bff700 1 -- 172.21.15.8:0/3468407491 wait complete. 2023-10-06T23:23:33.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:33 smithi156 ceph-mon[102862]: pgmap v671: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 4.1 MiB/s wr, 497 op/s 2023-10-06T23:23:33.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:33 smithi008 ceph-mon[98532]: pgmap v671: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 4.1 MiB/s wr, 497 op/s 2023-10-06T23:23:33.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:33 smithi190 ceph-mon[102658]: pgmap v671: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 4.1 MiB/s wr, 497 op/s 2023-10-06T23:23:34.008 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 520.0 s, 255.5 tps, lat 391.638 ms stddev 58.622 2023-10-06T23:23:35.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:35 smithi156 ceph-mon[102862]: pgmap v672: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 4.6 MiB/s wr, 553 op/s 2023-10-06T23:23:35.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:35 smithi008 ceph-mon[98532]: pgmap v672: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 4.6 MiB/s wr, 553 op/s 2023-10-06T23:23:35.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:35 smithi190 ceph-mon[102658]: pgmap v672: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 4.6 MiB/s wr, 553 op/s 2023-10-06T23:23:37.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:37 smithi156 ceph-mon[102862]: pgmap v673: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 4.2 MiB/s wr, 519 op/s 2023-10-06T23:23:37.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:37 smithi008 ceph-mon[98532]: pgmap v673: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 4.2 MiB/s wr, 519 op/s 2023-10-06T23:23:37.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:37 smithi190 ceph-mon[102658]: pgmap v673: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 4.2 MiB/s wr, 519 op/s 2023-10-06T23:23:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 525.0 s, 271.7 tps, lat 370.300 ms stddev 48.876 2023-10-06T23:23:39.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:39 smithi156 ceph-mon[102862]: pgmap v674: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 4.1 MiB/s wr, 501 op/s 2023-10-06T23:23:39.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:39 smithi008 ceph-mon[98532]: pgmap v674: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 4.1 MiB/s wr, 501 op/s 2023-10-06T23:23:39.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:39 smithi190 ceph-mon[102658]: pgmap v674: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 4.1 MiB/s wr, 501 op/s 2023-10-06T23:23:41.599 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:41 smithi156 ceph-mon[102862]: pgmap v675: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 5.1 MiB/s wr, 614 op/s 2023-10-06T23:23:41.646 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:41 smithi008 ceph-mon[98532]: pgmap v675: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 5.1 MiB/s wr, 614 op/s 2023-10-06T23:23:41.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:41 smithi190 ceph-mon[102658]: pgmap v675: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 5.1 MiB/s wr, 614 op/s 2023-10-06T23:23:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:43 smithi156 ceph-mon[102862]: pgmap v676: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.0 MiB/s wr, 506 op/s 2023-10-06T23:23:43.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:43 smithi008 ceph-mon[98532]: pgmap v676: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.0 MiB/s wr, 506 op/s 2023-10-06T23:23:43.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:43 smithi190 ceph-mon[102658]: pgmap v676: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.0 MiB/s wr, 506 op/s 2023-10-06T23:23:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 530.0 s, 231.0 tps, lat 428.529 ms stddev 128.577 2023-10-06T23:23:45.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:45 smithi156 ceph-mon[102862]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 4.8 MiB/s wr, 597 op/s 2023-10-06T23:23:45.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:45 smithi008 ceph-mon[98532]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 4.8 MiB/s wr, 597 op/s 2023-10-06T23:23:45.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:45 smithi190 ceph-mon[102658]: pgmap v677: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 4.8 MiB/s wr, 597 op/s 2023-10-06T23:23:46.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:46 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:23:46.692 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:46 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:23:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.890+0000 7f1941dff700 1 -- 172.21.15.8:0/4118665619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c100fe0 msgr2=0x7f193c101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.890+0000 7f1941dff700 1 --2- 172.21.15.8:0/4118665619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c100fe0 0x7f193c101440 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f19340099c0 tx=0x7f1934009cd0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.891+0000 7f1941dff700 1 -- 172.21.15.8:0/4118665619 shutdown_connections 2023-10-06T23:23:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.891+0000 7f1941dff700 1 --2- 172.21.15.8:0/4118665619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c101980 0x7f193c108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.891+0000 7f1941dff700 1 --2- 172.21.15.8:0/4118665619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f193c0ffdf0 0x7f193c100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.891+0000 7f1941dff700 1 --2- 172.21.15.8:0/4118665619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c100fe0 0x7f193c101440 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.891+0000 7f1941dff700 1 -- 172.21.15.8:0/4118665619 >> 172.21.15.8:0/4118665619 conn(0x7f193c0fb340 msgr2=0x7f193c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.891+0000 7f1941dff700 1 -- 172.21.15.8:0/4118665619 shutdown_connections 2023-10-06T23:23:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.891+0000 7f1941dff700 1 -- 172.21.15.8:0/4118665619 wait complete. 2023-10-06T23:23:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.892+0000 7f1941dff700 1 Processor -- start 2023-10-06T23:23:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.893+0000 7f1941dff700 1 -- start start 2023-10-06T23:23:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.893+0000 7f1941dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c0ffdf0 0x7f193c10cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.893+0000 7f1941dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c100fe0 0x7f193c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.893+0000 7f1941dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f193c101980 0x7f193c10dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.893+0000 7f1941dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c10e610 con 0x7f193c100fe0 2023-10-06T23:23:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.893+0000 7f1941dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c10e780 con 0x7f193c0ffdf0 2023-10-06T23:23:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.893+0000 7f1941dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c10e940 con 0x7f193c101980 2023-10-06T23:23:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c0ffdf0 0x7f193c10cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f193c101980 0x7f193c10dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f193c101980 0x7f193c10dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44082/0 (socket says 172.21.15.8:44082) 2023-10-06T23:23:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193bfff700 1 -- 172.21.15.8:0/1812826580 learned_addr learned my addr 172.21.15.8:0/1812826580 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193affd700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c100fe0 0x7f193c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193bfff700 1 -- 172.21.15.8:0/1812826580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c0ffdf0 msgr2=0x7f193c10cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193bfff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c0ffdf0 0x7f193c10cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193bfff700 1 -- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c100fe0 msgr2=0x7f193c10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193bfff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c100fe0 0x7f193c10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.894+0000 7f193bfff700 1 -- 172.21.15.8:0/1812826580 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340095f0 con 0x7f193c101980 2023-10-06T23:23:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.895+0000 7f193bfff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f193c101980 0x7f193c10dfb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f192400c970 tx=0x7f192400cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.895+0000 7f1938ff9700 1 -- 172.21.15.8:0/1812826580 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924007b00 con 0x7f193c101980 2023-10-06T23:23:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.895+0000 7f1941dff700 1 -- 172.21.15.8:0/1812826580 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c10ec20 con 0x7f193c101980 2023-10-06T23:23:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.895+0000 7f1941dff700 1 -- 172.21.15.8:0/1812826580 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c10f3d0 con 0x7f193c101980 2023-10-06T23:23:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.896+0000 7f1938ff9700 1 -- 172.21.15.8:0/1812826580 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f192400ce60 con 0x7f193c101980 2023-10-06T23:23:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.896+0000 7f1938ff9700 1 -- 172.21.15.8:0/1812826580 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924005440 con 0x7f193c101980 2023-10-06T23:23:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.902+0000 7f1938ff9700 1 -- 172.21.15.8:0/1812826580 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f19240055a0 con 0x7f193c101980 2023-10-06T23:23:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.903+0000 7f1955691b80 1 Processor -- start 2023-10-06T23:23:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.904+0000 7f1955691b80 1 -- start start 2023-10-06T23:23:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.904+0000 7f1955691b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a252e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.904+0000 7f1955691b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 0x563655a26450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.904+0000 7f1955691b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a2d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.904+0000 7f1955691b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365598d400 con 0x563655a25fd0 2023-10-06T23:23:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.904+0000 7f1955691b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365597ebc0 con 0x563655a26990 2023-10-06T23:23:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.904+0000 7f1955691b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365597c4e0 con 0x563655a24ec0 2023-10-06T23:23:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.905+0000 7f193affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a252e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.905+0000 7f193affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a252e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44092/0 (socket says 172.21.15.8:44092) 2023-10-06T23:23:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.905+0000 7f193affd700 1 -- 172.21.15.8:0/3513908136 learned_addr learned my addr 172.21.15.8:0/3513908136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.905+0000 7f193affd700 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a2d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.905+0000 7f193b7fe700 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 0x563655a26450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.906+0000 7f193affd700 1 -- 172.21.15.8:0/3513908136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 msgr2=0x563655a2d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.906+0000 7f193affd700 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a2d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.906+0000 7f193affd700 1 -- 172.21.15.8:0/3513908136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 msgr2=0x563655a26450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.906+0000 7f193affd700 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 0x563655a26450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.906+0000 7f193affd700 1 -- 172.21.15.8:0/3513908136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636557a2d80 con 0x563655a24ec0 2023-10-06T23:23:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.906+0000 7f193affd700 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a252e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f19340099c0 tx=0x7f193401a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa517c80ee46bc2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.907+0000 7f1931ffb700 1 -- 172.21.15.8:0/3513908136 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340052d0 con 0x563655a24ec0 2023-10-06T23:23:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.907+0000 7f1931ffb700 1 -- 172.21.15.8:0/3513908136 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f193401e030 con 0x563655a24ec0 2023-10-06T23:23:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.907+0000 7f1931ffb700 1 -- 172.21.15.8:0/3513908136 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934003dc0 con 0x563655a24ec0 2023-10-06T23:23:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.907+0000 7f1938ff9700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f19280a1550 0x7f19280a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.907+0000 7f1938ff9700 1 -- 172.21.15.8:0/1812826580 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f19240cc740 con 0x7f193c101980 2023-10-06T23:23:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.908+0000 7f1955691b80 1 -- 172.21.15.8:0/3513908136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 msgr2=0x563655a252e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.908+0000 7f1955691b80 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a252e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f19340099c0 tx=0x7f193401a040 comp rx=0 tx=0).stop 2023-10-06T23:23:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.908+0000 7f193b7fe700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f19280a1550 0x7f19280a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.908+0000 7f1955691b80 1 -- 172.21.15.8:0/3513908136 shutdown_connections 2023-10-06T23:23:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.908+0000 7f1955691b80 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a2d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.908+0000 7f1955691b80 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a252e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.908+0000 7f1955691b80 1 --2- 172.21.15.8:0/3513908136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 0x563655a26450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.908+0000 7f1955691b80 1 -- 172.21.15.8:0/3513908136 >> 172.21.15.8:0/3513908136 conn(0x563655999200 msgr2=0x563655a1fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.909+0000 7f1955691b80 1 -- 172.21.15.8:0/3513908136 shutdown_connections 2023-10-06T23:23:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.909+0000 7f1955691b80 1 -- 172.21.15.8:0/3513908136 wait complete. 2023-10-06T23:23:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.910+0000 7f193b7fe700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f19280a1550 0x7f19280a3a10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f193c10c910 tx=0x7f192c00b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.910+0000 7f1955691b80 1 -- start start 2023-10-06T23:23:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.910+0000 7f1955691b80 1 Processor -- start 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.911+0000 7f1955691b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a3fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.911+0000 7f1955691b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 0x563655a400c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.911+0000 7f1955691b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a47100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.911+0000 7f1955691b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655977dd0 con 0x563655a25fd0 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.911+0000 7f1955691b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636559146b0 con 0x563655a26990 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.911+0000 7f1955691b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655914350 con 0x563655a24ec0 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.911+0000 7f1955691b80 10 client.0 _ll_register_callbacks cb 0x5636557717a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.911+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a3fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.912+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a3fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44108/0 (socket says 172.21.15.8:44108) 2023-10-06T23:23:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.912+0000 7f193b7fe700 1 -- 172.21.15.8:0/426844094 learned_addr learned my addr 172.21.15.8:0/426844094 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:46.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.912+0000 7f193bfff700 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a47100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.912+0000 7f193b7fe700 1 -- 172.21.15.8:0/426844094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 msgr2=0x563655a47100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.912+0000 7f193b7fe700 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a47100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.912+0000 7f193b7fe700 1 -- 172.21.15.8:0/426844094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 msgr2=0x563655a400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.912+0000 7f193b7fe700 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 0x563655a400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.912+0000 7f193b7fe700 1 -- 172.21.15.8:0/426844094 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c108b80 con 0x563655a24ec0 2023-10-06T23:23:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.913+0000 7f193b7fe700 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a3fb80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f192c016a70 tx=0x7f192c004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da78cfccf959ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.913+0000 7f191affd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:23:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.913+0000 7f191affd700 1 -- 172.21.15.8:0/426844094 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00e040 con 0x563655a24ec0 2023-10-06T23:23:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.913+0000 7f191affd700 1 -- 172.21.15.8:0/426844094 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f192c015a20 con 0x563655a24ec0 2023-10-06T23:23:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.914+0000 7f1955691b80 1 -- 172.21.15.8:0/426844094 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563655a17d50 con 0x563655a24ec0 2023-10-06T23:23:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.914+0000 7f191affd700 1 -- 172.21.15.8:0/426844094 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f192c015be0 con 0x563655a24ec0 2023-10-06T23:23:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.914+0000 7f1955691b80 10 client.26497 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.914+0000 7f1955691b80 1 -- 172.21.15.8:0/426844094 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56365578bc00 con 0x563655a24ec0 2023-10-06T23:23:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.915+0000 7f191affd700 1 -- 172.21.15.8:0/426844094 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563655a17d50 con 0x563655a24ec0 2023-10-06T23:23:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.915+0000 7f191affd700 1 -- 172.21.15.8:0/426844094 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f192c023c80 con 0x563655a24ec0 2023-10-06T23:23:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.915+0000 7f1955691b80 10 client.26497 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.915+0000 7f1955691b80 10 client.26497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.915+0000 7f1955691b80 20 client.26497 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.915+0000 7f1955691b80 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563655a4bb60 0x563655a4df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.915+0000 7f1955691b80 4 client.26497 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:23:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.915+0000 7f1955691b80 1 -- 172.21.15.8:0/426844094 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563655970db0 con 0x563655a4bb60 2023-10-06T23:23:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.916+0000 7f193affd700 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563655a4bb60 0x563655a4df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.917+0000 7f193affd700 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563655a4bb60 0x563655a4df80 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2806c9ff0b548d2 server_cookie=e871b3fc5ffbfd0e in_seq=0 out_seq=0 2023-10-06T23:23:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.917+0000 7f191affd700 10 client.26497 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.919+0000 7f191affd700 1 -- 172.21.15.8:0/426844094 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563655970db0 con 0x563655a4bb60 2023-10-06T23:23:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.919+0000 7f191affd700 10 client.26497 handle_command_reply: tid=0 2023-10-06T23:23:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.919+0000 7f1955691b80 1 client.26497 shutdown 2023-10-06T23:23:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.919+0000 7f1955691b80 1 -- 172.21.15.8:0/426844094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 msgr2=0x563655a3fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.919+0000 7f1955691b80 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a3fb80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f192c016a70 tx=0x7f192c004b40 comp rx=0 tx=0).stop 2023-10-06T23:23:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.920+0000 7f1955691b80 1 -- 172.21.15.8:0/426844094 shutdown_connections 2023-10-06T23:23:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.920+0000 7f1955691b80 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563655a4bb60 0x563655a4df80 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.920+0000 7f1955691b80 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a47100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.920+0000 7f1955691b80 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a3fb80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.920+0000 7f1955691b80 1 --2- 172.21.15.8:0/426844094 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a25fd0 0x563655a400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.920+0000 7f1955691b80 1 -- 172.21.15.8:0/426844094 >> 172.21.15.8:0/426844094 conn(0x563655999200 msgr2=0x563655a1f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.920+0000 7f191affd700 0 client.26497 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.920+0000 7f1955691b80 1 -- 172.21.15.8:0/426844094 shutdown_connections 2023-10-06T23:23:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.921+0000 7f1955691b80 1 -- 172.21.15.8:0/426844094 wait complete. 2023-10-06T23:23:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.921+0000 7f1955691b80 20 client.26497 trim_cache size 0 max 16384 2023-10-06T23:23:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.943+0000 7f1955691b80 1 Processor -- start 2023-10-06T23:23:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.943+0000 7f1955691b80 1 -- start start 2023-10-06T23:23:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f1955691b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a263b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f1955691b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a25fd0 0x563655a47090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f1955691b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a26990 0x563655a478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f1955691b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636557f88c0 con 0x563655a26990 2023-10-06T23:23:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f1955691b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655a29480 con 0x563655a25fd0 2023-10-06T23:23:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f1955691b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655a40d10 con 0x563655a24ec0 2023-10-06T23:23:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a263b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f193affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a25fd0 0x563655a47090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f193b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a263b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44124/0 (socket says 172.21.15.8:44124) 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f193b7fe700 1 -- 172.21.15.8:0/1504410665 learned_addr learned my addr 172.21.15.8:0/1504410665 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.944+0000 7f193bfff700 1 --2- 172.21.15.8:0/1504410665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a26990 0x563655a478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.945+0000 7f193b7fe700 1 -- 172.21.15.8:0/1504410665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a25fd0 msgr2=0x563655a47090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.945+0000 7f193b7fe700 1 --2- 172.21.15.8:0/1504410665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a25fd0 0x563655a47090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.945+0000 7f193b7fe700 1 -- 172.21.15.8:0/1504410665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a26990 msgr2=0x563655a478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.945+0000 7f193b7fe700 1 --2- 172.21.15.8:0/1504410665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a26990 0x563655a478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.945+0000 7f193b7fe700 1 -- 172.21.15.8:0/1504410665 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636557c91f0 con 0x563655a24ec0 2023-10-06T23:23:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.945+0000 7f193b7fe700 1 --2- 172.21.15.8:0/1504410665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a263b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f192c009220 tx=0x7f192c009350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d7f2b995a12e940 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.946+0000 7f19327fc700 1 -- 172.21.15.8:0/1504410665 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00e040 con 0x563655a24ec0 2023-10-06T23:23:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.946+0000 7f19327fc700 1 -- 172.21.15.8:0/1504410665 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f192c00f040 con 0x563655a24ec0 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.946+0000 7f19327fc700 1 -- 172.21.15.8:0/1504410665 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c02ea60 con 0x563655a24ec0 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.946+0000 7f1955691b80 1 -- 172.21.15.8:0/1504410665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 msgr2=0x563655a263b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.946+0000 7f1955691b80 1 --2- 172.21.15.8:0/1504410665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a263b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f192c009220 tx=0x7f192c009350 comp rx=0 tx=0).stop 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.946+0000 7f1955691b80 1 -- 172.21.15.8:0/1504410665 shutdown_connections 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.947+0000 7f1955691b80 1 --2- 172.21.15.8:0/1504410665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a26990 0x563655a478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.947+0000 7f1955691b80 1 --2- 172.21.15.8:0/1504410665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a24ec0 0x563655a263b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.947+0000 7f1955691b80 1 --2- 172.21.15.8:0/1504410665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a25fd0 0x563655a47090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.947+0000 7f1955691b80 1 -- 172.21.15.8:0/1504410665 >> 172.21.15.8:0/1504410665 conn(0x563655999200 msgr2=0x563655a52920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.947+0000 7f1955691b80 1 -- 172.21.15.8:0/1504410665 shutdown_connections 2023-10-06T23:23:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.947+0000 7f1955691b80 1 -- 172.21.15.8:0/1504410665 wait complete. 2023-10-06T23:23:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.947+0000 7f1955691b80 1 -- start start 2023-10-06T23:23:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.947+0000 7f1955691b80 1 Processor -- start 2023-10-06T23:23:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f1955691b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a24ec0 0x563655a44e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f1955691b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a25fd0 0x563655a45370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f1955691b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a46380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f1955691b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655a468c0 con 0x563655a24ec0 2023-10-06T23:23:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f1955691b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655a46a30 con 0x563655a26990 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f1955691b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563655a46bf0 con 0x563655a25fd0 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f1955691b80 10 client.0 _ll_register_callbacks cb 0x7f192c016430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f193affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a25fd0 0x563655a45370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f193affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a25fd0 0x563655a45370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44138/0 (socket says 172.21.15.8:44138) 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f193affd700 1 -- 172.21.15.8:0/1422696507 learned_addr learned my addr 172.21.15.8:0/1422696507 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f193b7fe700 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a24ec0 0x563655a44e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.948+0000 7f193bfff700 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a46380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f193affd700 1 -- 172.21.15.8:0/1422696507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 msgr2=0x563655a46380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f193affd700 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a46380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f193affd700 1 -- 172.21.15.8:0/1422696507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a24ec0 msgr2=0x563655a44e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f193affd700 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a24ec0 0x563655a44e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f193affd700 1 -- 172.21.15.8:0/1422696507 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56365578bc00 con 0x563655a25fd0 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f193affd700 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a25fd0 0x563655a45370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1934005950 tx=0x7f1934009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d920d78f91d02d30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f191affd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f191affd700 1 -- 172.21.15.8:0/1422696507 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934033070 con 0x563655a25fd0 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f1955691b80 1 -- 172.21.15.8:0/1422696507 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f193401e030 con 0x563655a25fd0 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.949+0000 7f191affd700 1 -- 172.21.15.8:0/1422696507 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f193402d070 con 0x563655a25fd0 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.950+0000 7f191affd700 1 -- 172.21.15.8:0/1422696507 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f193402f290 con 0x563655a25fd0 2023-10-06T23:23:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.950+0000 7f1955691b80 10 client.26503 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.950+0000 7f1955691b80 1 -- 172.21.15.8:0/1422696507 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5636557a1250 con 0x563655a25fd0 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.950+0000 7f191affd700 1 -- 172.21.15.8:0/1422696507 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f193403e080 con 0x563655a25fd0 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.951+0000 7f191affd700 1 -- 172.21.15.8:0/1422696507 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1934036030 con 0x563655a25fd0 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.951+0000 7f1955691b80 10 client.26503 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.951+0000 7f1955691b80 10 client.26503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.951+0000 7f1955691b80 20 client.26503 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.951+0000 7f1955691b80 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563655aa03e0 0x563655aa27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.951+0000 7f1955691b80 4 client.26503 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:23:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.951+0000 7f1955691b80 1 -- 172.21.15.8:0/1422696507 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563655970ad0 con 0x563655aa03e0 2023-10-06T23:23:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.951+0000 7f193b7fe700 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563655aa03e0 0x563655aa27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.952+0000 7f193b7fe700 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563655aa03e0 0x563655aa27d0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f91be4c148444c7 server_cookie=4a63c1248cacd4f4 in_seq=0 out_seq=0 2023-10-06T23:23:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.952+0000 7f191affd700 10 client.26503 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.967+0000 7f191affd700 1 -- 172.21.15.8:0/1422696507 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563655970ad0 con 0x563655aa03e0 2023-10-06T23:23:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.967+0000 7f191affd700 10 client.26503 handle_command_reply: tid=0 2023-10-06T23:23:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.967+0000 7f1955691b80 1 client.26503 shutdown 2023-10-06T23:23:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 -- 172.21.15.8:0/1422696507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a25fd0 msgr2=0x563655a45370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a25fd0 0x563655a45370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1934005950 tx=0x7f1934009310 comp rx=0 tx=0).stop 2023-10-06T23:23:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 -- 172.21.15.8:0/1422696507 shutdown_connections 2023-10-06T23:23:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563655aa03e0 0x563655aa27d0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563655a24ec0 0x563655a44e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563655a26990 0x563655a46380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 --2- 172.21.15.8:0/1422696507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563655a25fd0 0x563655a45370 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 -- 172.21.15.8:0/1422696507 >> 172.21.15.8:0/1422696507 conn(0x563655999200 msgr2=0x563655a2cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f191affd700 0 client.26503 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 -- 172.21.15.8:0/1422696507 shutdown_connections 2023-10-06T23:23:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.968+0000 7f1955691b80 1 -- 172.21.15.8:0/1422696507 wait complete. 2023-10-06T23:23:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.969+0000 7f1955691b80 20 client.26503 trim_cache size 0 max 16384 2023-10-06T23:23:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:23:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:23:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:23:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:23:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.969+0000 7f1941dff700 1 -- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f19280a1550 msgr2=0x7f19280a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.969+0000 7f1941dff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f19280a1550 0x7f19280a3a10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f193c10c910 tx=0x7f192c00b040 comp rx=0 tx=0).stop 2023-10-06T23:23:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.969+0000 7f1941dff700 1 -- 172.21.15.8:0/1812826580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f193c101980 msgr2=0x7f193c10dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.969+0000 7f1941dff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f193c101980 0x7f193c10dfb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f192400c970 tx=0x7f192400cc80 comp rx=0 tx=0).stop 2023-10-06T23:23:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.970+0000 7f1941dff700 1 -- 172.21.15.8:0/1812826580 shutdown_connections 2023-10-06T23:23:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.970+0000 7f1941dff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f19280a1550 0x7f19280a3a10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.970+0000 7f1941dff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f193c101980 0x7f193c10dfb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.970+0000 7f1941dff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f193c0ffdf0 0x7f193c10cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.970+0000 7f1941dff700 1 --2- 172.21.15.8:0/1812826580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f193c100fe0 0x7f193c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.970+0000 7f1941dff700 1 -- 172.21.15.8:0/1812826580 >> 172.21.15.8:0/1812826580 conn(0x7f193c0fb340 msgr2=0x7f193c0fbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.970+0000 7f1941dff700 1 -- 172.21.15.8:0/1812826580 shutdown_connections 2023-10-06T23:23:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:23:46.970+0000 7f1941dff700 1 -- 172.21.15.8:0/1812826580 wait complete. 2023-10-06T23:23:47.503 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:46 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:23:47.504 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:47 smithi156 ceph-mon[102862]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 4.4 MiB/s wr, 552 op/s 2023-10-06T23:23:47.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:47 smithi008 ceph-mon[98532]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 4.4 MiB/s wr, 552 op/s 2023-10-06T23:23:47.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:47 smithi190 ceph-mon[102658]: pgmap v678: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 4.4 MiB/s wr, 552 op/s 2023-10-06T23:23:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 535.0 s, 262.0 tps, lat 377.390 ms stddev 59.001 2023-10-06T23:23:49.598 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:49 smithi156 ceph-mon[102862]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 4.2 MiB/s wr, 527 op/s 2023-10-06T23:23:49.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:49 smithi008 ceph-mon[98532]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 4.2 MiB/s wr, 527 op/s 2023-10-06T23:23:49.693 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:49 smithi190 ceph-mon[102658]: pgmap v679: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 4.2 MiB/s wr, 527 op/s 2023-10-06T23:23:49.847 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:23:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 -- 172.21.15.8:0/462587361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9be8103110 msgr2=0x7f9be8103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/462587361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9be8103110 0x7f9be8103530 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9be40099c0 tx=0x7f9be4009cd0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 -- 172.21.15.8:0/462587361 shutdown_connections 2023-10-06T23:23:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/462587361 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9be8103110 0x7f9be8103530 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/462587361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9be8104ca0 0x7f9be810b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/462587361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9be8104300 0x7f9be8104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 -- 172.21.15.8:0/462587361 >> 172.21.15.8:0/462587361 conn(0x7f9be80fe660 msgr2=0x7f9be8100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 -- 172.21.15.8:0/462587361 shutdown_connections 2023-10-06T23:23:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.145+0000 7f9bf03ff700 1 -- 172.21.15.8:0/462587361 wait complete. 2023-10-06T23:23:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.147+0000 7f9bf03ff700 1 Processor -- start 2023-10-06T23:23:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.147+0000 7f9bf03ff700 1 -- start start 2023-10-06T23:23:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bf03ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9be8103110 0x7f9be8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bf03ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9be8104300 0x7f9be8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bf03ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9be8104ca0 0x7f9be81a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bf03ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81a08c0 con 0x7f9be8104ca0 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bf03ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81a0a00 con 0x7f9be8103110 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bf03ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81a0b90 con 0x7f9be8104300 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9be8103110 0x7f9be8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9be8103110 0x7f9be8198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33258/0 (socket says 172.21.15.8:33258) 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bee19b700 1 -- 172.21.15.8:0/1754219974 learned_addr learned my addr 172.21.15.8:0/1754219974 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bed99a700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9be8104300 0x7f9be8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.148+0000 7f9bee99c700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9be8104ca0 0x7f9be81a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.149+0000 7f9bee19b700 1 -- 172.21.15.8:0/1754219974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9be8104300 msgr2=0x7f9be8199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.149+0000 7f9bee19b700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9be8104300 0x7f9be8199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.149+0000 7f9bee19b700 1 -- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9be8104ca0 msgr2=0x7f9be81a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.149+0000 7f9bee19b700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9be8104ca0 0x7f9be81a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.149+0000 7f9bee19b700 1 -- 172.21.15.8:0/1754219974 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be40095f0 con 0x7f9be8103110 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.149+0000 7f9bed99a700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9be8104300 0x7f9be8199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.149+0000 7f9bee19b700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9be8103110 0x7f9be8198d40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9be4000c00 tx=0x7f9be400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.149+0000 7f9bdf7fe700 1 -- 172.21.15.8:0/1754219974 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be401d070 con 0x7f9be8103110 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.150+0000 7f9bdf7fe700 1 -- 172.21.15.8:0/1754219974 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9be400bcf0 con 0x7f9be8103110 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.150+0000 7f9bdf7fe700 1 -- 172.21.15.8:0/1754219974 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4004b30 con 0x7f9be8103110 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.150+0000 7f9bf03ff700 1 -- 172.21.15.8:0/1754219974 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be81a0e10 con 0x7f9be8103110 2023-10-06T23:23:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.150+0000 7f9bf03ff700 1 -- 172.21.15.8:0/1754219974 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be81a1180 con 0x7f9be8103110 2023-10-06T23:23:50.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.155+0000 7f9bdf7fe700 1 -- 172.21.15.8:0/1754219974 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9be4004c90 con 0x7f9be8103110 2023-10-06T23:23:50.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.157+0000 7f9c03d1bb80 1 Processor -- start 2023-10-06T23:23:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9c03d1bb80 1 -- start start 2023-10-06T23:23:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9bdf7fe700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9bd40a1580 0x7f9bd40a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9bdf7fe700 1 -- 172.21.15.8:0/1754219974 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9be40cda30 con 0x7f9be8103110 2023-10-06T23:23:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9bee99c700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9bd40a1580 0x7f9bd40a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba4833460 con 0x563ba48cb260 2023-10-06T23:23:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba4824c20 con 0x563ba48cbbc0 2023-10-06T23:23:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.158+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba4822540 con 0x563ba48cca60 2023-10-06T23:23:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43658/0 (socket says 172.21.15.8:43658) 2023-10-06T23:23:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 -- 172.21.15.8:0/1710097442 learned_addr learned my addr 172.21.15.8:0/1710097442 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee99c700 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bed99a700 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 -- 172.21.15.8:0/1710097442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 msgr2=0x563ba48ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 -- 172.21.15.8:0/1710097442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 msgr2=0x563ba48cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 -- 172.21.15.8:0/1710097442 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ba4648de0 con 0x563ba48cb260 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee99c700 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee99c700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9bd40a1580 0x7f9bd40a3a40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9be000f870 tx=0x7f9be000fc30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.159+0000 7f9bee19b700 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cb680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9be409ad20 tx=0x7f9be409ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48263ed9ed39099f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.160+0000 7f9bdcbfe700 1 -- 172.21.15.8:0/1710097442 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be409a6f0 con 0x563ba48cb260 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.160+0000 7f9bdcbfe700 1 -- 172.21.15.8:0/1710097442 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9be409b490 con 0x563ba48cb260 2023-10-06T23:23:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.160+0000 7f9bdcbfe700 1 -- 172.21.15.8:0/1710097442 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be409a280 con 0x563ba48cb260 2023-10-06T23:23:50.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.160+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/1710097442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 msgr2=0x563ba48cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.160+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cb680 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9be409ad20 tx=0x7f9be409ab60 comp rx=0 tx=0).stop 2023-10-06T23:23:50.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.161+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/1710097442 shutdown_connections 2023-10-06T23:23:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.161+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cb680 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.161+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.161+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/1710097442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.161+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/1710097442 >> 172.21.15.8:0/1710097442 conn(0x563ba483f260 msgr2=0x563ba48c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.161+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/1710097442 shutdown_connections 2023-10-06T23:23:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.161+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/1710097442 wait complete. 2023-10-06T23:23:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.161+0000 7f9c03d1bb80 1 -- start start 2023-10-06T23:23:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9c03d1bb80 1 Processor -- start 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48dc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba481de30 con 0x563ba48cb260 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba47ba710 con 0x563ba48cbbc0 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba47ba3b0 con 0x563ba48cca60 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9c03d1bb80 10 client.0 _ll_register_callbacks cb 0x563ba4617800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.162+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48d4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43672/0 (socket says 172.21.15.8:43672) 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee19b700 1 -- 172.21.15.8:0/2439759412 learned_addr learned my addr 172.21.15.8:0/2439759412 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bed99a700 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee99c700 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee19b700 1 -- 172.21.15.8:0/2439759412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 msgr2=0x563ba48dc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee19b700 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48dc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee19b700 1 -- 172.21.15.8:0/2439759412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 msgr2=0x563ba48d51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee19b700 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48d51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee19b700 1 -- 172.21.15.8:0/2439759412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be81a1180 con 0x563ba48cb260 2023-10-06T23:23:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bee19b700 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48d4ca0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9be40a2b60 tx=0x7f9be409eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485caebad835423b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:23:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.163+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2439759412 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be409ad90 con 0x563ba48cb260 2023-10-06T23:23:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.164+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2439759412 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9be40a2e10 con 0x563ba48cb260 2023-10-06T23:23:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.164+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2439759412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ba48bdf10 con 0x563ba48cb260 2023-10-06T23:23:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.164+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2439759412 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9be40aeae0 con 0x563ba48cb260 2023-10-06T23:23:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.164+0000 7f9c03d1bb80 10 client.16626 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.164+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2439759412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563ba4631c60 con 0x563ba48cb260 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.164+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2439759412 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563ba48bdf10 con 0x563ba48cb260 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.164+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2439759412 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9be40b3170 con 0x563ba48cb260 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.165+0000 7f9c03d1bb80 10 client.16626 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.165+0000 7f9c03d1bb80 10 client.16626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.165+0000 7f9c03d1bb80 20 client.16626 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.165+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563ba48e05a0 0x563ba48e29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.165+0000 7f9c03d1bb80 4 client.16626 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.165+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2439759412 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ba4816e10 con 0x563ba48e05a0 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.165+0000 7f9bed99a700 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563ba48e05a0 0x563ba48e29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.166+0000 7f9bed99a700 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563ba48e05a0 0x563ba48e29c0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef591abbc899eba server_cookie=f0fa7915d4635a9 in_seq=0 out_seq=0 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.166+0000 7f9bd1ffb700 10 client.16626 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.167+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2439759412 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563ba4816e10 con 0x563ba48e05a0 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.167+0000 7f9bd1ffb700 10 client.16626 handle_command_reply: tid=0 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.167+0000 7f9c03d1bb80 1 client.16626 shutdown 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.167+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2439759412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 msgr2=0x563ba48d4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.167+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48d4ca0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9be40a2b60 tx=0x7f9be409eee0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2439759412 shutdown_connections 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563ba48e05a0 0x563ba48e29c0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48d4ca0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48dc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2439759412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2439759412 >> 172.21.15.8:0/2439759412 conn(0x563ba483f260 msgr2=0x563ba48c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9bd1ffb700 0 client.16626 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2439759412 shutdown_connections 2023-10-06T23:23:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2439759412 wait complete. 2023-10-06T23:23:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.168+0000 7f9c03d1bb80 20 client.16626 trim_cache size 0 max 16384 2023-10-06T23:23:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.195+0000 7f9c03d1bb80 1 Processor -- start 2023-10-06T23:23:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.195+0000 7f9c03d1bb80 1 -- start start 2023-10-06T23:23:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba469e920 con 0x563ba48cb260 2023-10-06T23:23:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba48c5240 con 0x563ba48cbbc0 2023-10-06T23:23:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba48d2b90 con 0x563ba48cca60 2023-10-06T23:23:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43686/0 (socket says 172.21.15.8:43686) 2023-10-06T23:23:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9bee19b700 1 -- 172.21.15.8:0/3055519311 learned_addr learned my addr 172.21.15.8:0/3055519311 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9bed99a700 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.196+0000 7f9bee99c700 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.197+0000 7f9bed99a700 1 -- 172.21.15.8:0/3055519311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 msgr2=0x563ba48cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.197+0000 7f9bed99a700 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.197+0000 7f9bed99a700 1 -- 172.21.15.8:0/3055519311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 msgr2=0x563ba48cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.197+0000 7f9bed99a700 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.197+0000 7f9bed99a700 1 -- 172.21.15.8:0/3055519311 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ba466f250 con 0x563ba48cbbc0 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.197+0000 7f9bee19b700 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.197+0000 7f9bed99a700 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48dc1e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x563ba48e32a0 tx=0x7f9bd8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10555a886600575d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.198+0000 7f9bdd3ff700 1 -- 172.21.15.8:0/3055519311 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8017030 con 0x563ba48cbbc0 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.198+0000 7f9bdd3ff700 1 -- 172.21.15.8:0/3055519311 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bd8018040 con 0x563ba48cbbc0 2023-10-06T23:23:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.198+0000 7f9bdd3ff700 1 -- 172.21.15.8:0/3055519311 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8004a70 con 0x563ba48cbbc0 2023-10-06T23:23:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/3055519311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 msgr2=0x563ba48dc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48dc1e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x563ba48e32a0 tx=0x7f9bd8009260 comp rx=0 tx=0).stop 2023-10-06T23:23:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/3055519311 shutdown_connections 2023-10-06T23:23:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cb260 0x563ba48cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cca60 0x563ba48cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/3055519311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cbbc0 0x563ba48dc1e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/3055519311 >> 172.21.15.8:0/3055519311 conn(0x563ba483f260 msgr2=0x563ba48d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/3055519311 shutdown_connections 2023-10-06T23:23:50.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.199+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/3055519311 wait complete. 2023-10-06T23:23:50.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.200+0000 7f9c03d1bb80 1 -- start start 2023-10-06T23:23:50.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.200+0000 7f9c03d1bb80 1 Processor -- start 2023-10-06T23:23:50.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cb260 0x563ba48d8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cbbc0 0x563ba48d8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9c03d1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cca60 0x563ba48db790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba48dbcd0 con 0x563ba48cbbc0 2023-10-06T23:23:50.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba48dbe40 con 0x563ba48cca60 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9c03d1bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba48dbfb0 con 0x563ba48cb260 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9c03d1bb80 10 client.0 _ll_register_callbacks cb 0x7f9bd8009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cb260 0x563ba48d8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9bee19b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cb260 0x563ba48d8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34236/0 (socket says 172.21.15.8:34236) 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9bee19b700 1 -- 172.21.15.8:0/2040303371 learned_addr learned my addr 172.21.15.8:0/2040303371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9bed99a700 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cbbc0 0x563ba48d8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.201+0000 7f9bee99c700 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cca60 0x563ba48db790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.202+0000 7f9bed99a700 1 -- 172.21.15.8:0/2040303371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cb260 msgr2=0x563ba48d8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.202+0000 7f9bed99a700 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cb260 0x563ba48d8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.202+0000 7f9bed99a700 1 -- 172.21.15.8:0/2040303371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cca60 msgr2=0x563ba48db790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.202+0000 7f9bed99a700 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cca60 0x563ba48db790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.202+0000 7f9bed99a700 1 -- 172.21.15.8:0/2040303371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ba4631c60 con 0x563ba48cbbc0 2023-10-06T23:23:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.202+0000 7f9bed99a700 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cbbc0 0x563ba48d8950 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80205b0 tx=0x7f9bd80040a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828237b85c299499 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:23:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.202+0000 7f9bd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:23:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.203+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2040303371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8017040 con 0x563ba48cbbc0 2023-10-06T23:23:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.203+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2040303371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9be409b490 con 0x563ba48cbbc0 2023-10-06T23:23:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.203+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2040303371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9bd80129c0 con 0x563ba48cbbc0 2023-10-06T23:23:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.203+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2040303371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bd8012b80 con 0x563ba48cbbc0 2023-10-06T23:23:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.203+0000 7f9c03d1bb80 10 client.16632 fetch_fsmap learned FSMap version 37 2023-10-06T23:23:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.203+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2040303371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f9bd8005ce0 con 0x563ba48cbbc0 2023-10-06T23:23:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.204+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2040303371 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9be409b490 con 0x563ba48cbbc0 2023-10-06T23:23:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.204+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2040303371 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9bd803a070 con 0x563ba48cbbc0 2023-10-06T23:23:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.204+0000 7f9c03d1bb80 10 client.16632 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.204+0000 7f9c03d1bb80 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.204+0000 7f9c03d1bb80 20 client.16632 populate_metadata read hostname 'smithi008' 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.204+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563ba4935600 0x563ba4937a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.204+0000 7f9c03d1bb80 4 client.16632 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.204+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2040303371 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563ba4816b30 con 0x563ba4935600 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.205+0000 7f9bee19b700 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563ba4935600 0x563ba4937a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.205+0000 7f9bee19b700 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563ba4935600 0x563ba4937a20 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=956b96e33f526d13 server_cookie=dd9a7d209cb38257 in_seq=0 out_seq=0 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.205+0000 7f9bd1ffb700 10 client.16632 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9bd1ffb700 1 -- 172.21.15.8:0/2040303371 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563ba4816b30 con 0x563ba4935600 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9bd1ffb700 10 client.16632 handle_command_reply: tid=0 2023-10-06T23:23:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 client.16632 shutdown 2023-10-06T23:23:50.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2040303371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cbbc0 msgr2=0x563ba48d8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cbbc0 0x563ba48d8950 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80205b0 tx=0x7f9bd80040a0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2040303371 shutdown_connections 2023-10-06T23:23:50.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563ba4935600 0x563ba4937a20 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563ba48cca60 0x563ba48db790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ba48cb260 0x563ba48d8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 --2- 172.21.15.8:0/2040303371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563ba48cbbc0 0x563ba48d8950 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2040303371 >> 172.21.15.8:0/2040303371 conn(0x563ba483f260 msgr2=0x563ba48d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.206+0000 7f9bd1ffb700 0 client.16632 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:23:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.207+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2040303371 shutdown_connections 2023-10-06T23:23:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.207+0000 7f9c03d1bb80 1 -- 172.21.15.8:0/2040303371 wait complete. 2023-10-06T23:23:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.207+0000 7f9c03d1bb80 20 client.16632 trim_cache size 0 max 16384 2023-10-06T23:23:50.210 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:23:50.211 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:23:50.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.207+0000 7f9bf03ff700 1 -- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9bd40a1580 msgr2=0x7f9bd40a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.207+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9bd40a1580 0x7f9bd40a3a40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9be000f870 tx=0x7f9be000fc30 comp rx=0 tx=0).stop 2023-10-06T23:23:50.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 -- 172.21.15.8:0/1754219974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9be8103110 msgr2=0x7f9be8198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:23:50.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9be8103110 0x7f9be8198d40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9be4000c00 tx=0x7f9be400fa00 comp rx=0 tx=0).stop 2023-10-06T23:23:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 -- 172.21.15.8:0/1754219974 shutdown_connections 2023-10-06T23:23:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9bd40a1580 0x7f9bd40a3a40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9be8104ca0 0x7f9be81a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9be8103110 0x7f9be8198d40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 --2- 172.21.15.8:0/1754219974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9be8104300 0x7f9be8199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:23:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 -- 172.21.15.8:0/1754219974 >> 172.21.15.8:0/1754219974 conn(0x7f9be80fe660 msgr2=0x7f9be8100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:23:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 -- 172.21.15.8:0/1754219974 shutdown_connections 2023-10-06T23:23:50.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:23:50.208+0000 7f9bf03ff700 1 -- 172.21.15.8:0/1754219974 wait complete. 2023-10-06T23:23:50.232 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:23:52.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:51 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:51 smithi156 ceph-mon[102862]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.4 MiB/s wr, 560 op/s 2023-10-06T23:23:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:51 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:52.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:51 smithi008 ceph-mon[98532]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.4 MiB/s wr, 560 op/s 2023-10-06T23:23:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:51 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:52.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:51 smithi190 ceph-mon[102658]: pgmap v680: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.4 MiB/s wr, 560 op/s 2023-10-06T23:23:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:53 smithi156 ceph-mon[102862]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 4.1 MiB/s wr, 507 op/s 2023-10-06T23:23:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:53 smithi008 ceph-mon[98532]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 4.1 MiB/s wr, 507 op/s 2023-10-06T23:23:53.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:53 smithi190 ceph-mon[102658]: pgmap v681: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 4.1 MiB/s wr, 507 op/s 2023-10-06T23:23:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 540.0 s, 251.2 tps, lat 401.285 ms stddev 120.196 2023-10-06T23:23:55.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:55.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:55 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:55.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:55 smithi156 ceph-mon[102862]: pgmap v682: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 4.6 MiB/s wr, 566 op/s 2023-10-06T23:23:55.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:55.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:55 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:55.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:55 smithi008 ceph-mon[98532]: pgmap v682: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 4.6 MiB/s wr, 566 op/s 2023-10-06T23:23:55.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:55.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:55 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:55.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:55 smithi190 ceph-mon[102658]: pgmap v682: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 4.6 MiB/s wr, 566 op/s 2023-10-06T23:23:56.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:23:56.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:23:56.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:56 smithi156 ceph-mon[102862]: pgmap v683: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 4.1 MiB/s wr, 512 op/s 2023-10-06T23:23:56.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:56.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:23:56.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:23:56.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:56 smithi008 ceph-mon[98532]: pgmap v683: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 4.1 MiB/s wr, 512 op/s 2023-10-06T23:23:56.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:56.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:23:56.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:23:56.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:56 smithi190 ceph-mon[102658]: pgmap v683: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 4.1 MiB/s wr, 512 op/s 2023-10-06T23:23:56.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:23:57.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:57 smithi156 ceph-mon[102862]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-10-06T23:23:57.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:57 smithi008 ceph-mon[98532]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-10-06T23:23:57.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:57 smithi190 ceph-mon[102658]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-10-06T23:23:58.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:23:58 smithi156 ceph-mon[102862]: pgmap v684: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 4.2 MiB/s wr, 516 op/s 2023-10-06T23:23:58.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:23:58 smithi008 ceph-mon[98532]: pgmap v684: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 4.2 MiB/s wr, 516 op/s 2023-10-06T23:23:58.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:23:58 smithi190 ceph-mon[102658]: pgmap v684: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 4.2 MiB/s wr, 516 op/s 2023-10-06T23:23:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 545.0 s, 244.6 tps, lat 409.886 ms stddev 127.948 2023-10-06T23:24:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 -- 172.21.15.8:0/2175114699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 msgr2=0x7f9f80100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 --2- 172.21.15.8:0/2175114699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 0x7f9f80100210 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009990 tx=0x7f9f70009ca0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 -- 172.21.15.8:0/2175114699 shutdown_connections 2023-10-06T23:24:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 --2- 172.21.15.8:0/2175114699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f80101980 0x7f9f80108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 --2- 172.21.15.8:0/2175114699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 0x7f9f80100210 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 --2- 172.21.15.8:0/2175114699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f80100fe0 0x7f9f80101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 -- 172.21.15.8:0/2175114699 >> 172.21.15.8:0/2175114699 conn(0x7f9f800fb340 msgr2=0x7f9f800fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 -- 172.21.15.8:0/2175114699 shutdown_connections 2023-10-06T23:24:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.191+0000 7f9f855ff700 1 -- 172.21.15.8:0/2175114699 wait complete. 2023-10-06T23:24:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.193+0000 7f9f855ff700 1 Processor -- start 2023-10-06T23:24:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.193+0000 7f9f855ff700 1 -- start start 2023-10-06T23:24:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.193+0000 7f9f855ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 0x7f9f80198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.193+0000 7f9f855ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f80100fe0 0x7f9f80199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.193+0000 7f9f855ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f80101980 0x7f9f8019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.193+0000 7f9f855ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8019a8c0 con 0x7f9f80100fe0 2023-10-06T23:24:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.193+0000 7f9f855ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8019aa30 con 0x7f9f80101980 2023-10-06T23:24:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.193+0000 7f9f855ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8019abf0 con 0x7f9f800ffdf0 2023-10-06T23:24:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.194+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 0x7f9f80198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.194+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 0x7f9f80198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52642/0 (socket says 172.21.15.8:52642) 2023-10-06T23:24:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.194+0000 7f9f7effd700 1 -- 172.21.15.8:0/1465081534 learned_addr learned my addr 172.21.15.8:0/1465081534 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.194+0000 7f9f7f7fe700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f80101980 0x7f9f8019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.194+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f80100fe0 0x7f9f80199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.195+0000 7f9f7effd700 1 -- 172.21.15.8:0/1465081534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f80101980 msgr2=0x7f9f8019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.195+0000 7f9f7effd700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f80101980 0x7f9f8019a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.195+0000 7f9f7effd700 1 -- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f80100fe0 msgr2=0x7f9f80199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.195+0000 7f9f7effd700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f80100fe0 0x7f9f80199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.195+0000 7f9f7effd700 1 -- 172.21.15.8:0/1465081534 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700095f0 con 0x7f9f800ffdf0 2023-10-06T23:24:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.195+0000 7f9f7effd700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 0x7f9f80198ed0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000b2e0 tx=0x7f9f7000b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.195+0000 7f9f67fff700 1 -- 172.21.15.8:0/1465081534 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7001d070 con 0x7f9f800ffdf0 2023-10-06T23:24:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.196+0000 7f9f67fff700 1 -- 172.21.15.8:0/1465081534 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f7000bed0 con 0x7f9f800ffdf0 2023-10-06T23:24:00.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.196+0000 7f9f855ff700 1 -- 172.21.15.8:0/1465081534 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8019ae70 con 0x7f9f800ffdf0 2023-10-06T23:24:00.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.196+0000 7f9f67fff700 1 -- 172.21.15.8:0/1465081534 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000fd30 con 0x7f9f800ffdf0 2023-10-06T23:24:00.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.196+0000 7f9f855ff700 1 -- 172.21.15.8:0/1465081534 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f801023e0 con 0x7f9f800ffdf0 2023-10-06T23:24:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.200+0000 7f9f67fff700 1 -- 172.21.15.8:0/1465081534 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9f7000f460 con 0x7f9f800ffdf0 2023-10-06T23:24:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.201+0000 7f9f98fc4b80 1 Processor -- start 2023-10-06T23:24:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.201+0000 7f9f98fc4b80 1 -- start start 2023-10-06T23:24:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.201+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60ee992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.201+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60ee9a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.201+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.201+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60ee01400 con 0x55e60ee99fd0 2023-10-06T23:24:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.201+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60edf2bc0 con 0x55e60ee9a990 2023-10-06T23:24:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.201+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60edf04e0 con 0x55e60ee98ec0 2023-10-06T23:24:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7f7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60ee992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47162/0 (socket says 172.21.15.8:47162) 2023-10-06T23:24:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7e7fc700 1 -- 172.21.15.8:0/910136289 learned_addr learned my addr 172.21.15.8:0/910136289 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7effd700 1 --2- 172.21.15.8:0/910136289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60ee9a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7f7fe700 1 -- 172.21.15.8:0/910136289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 msgr2=0x55e60eea1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:00.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f67fff700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9f680a1500 0x7f9f680a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7f7fe700 1 --2- 172.21.15.8:0/910136289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7f7fe700 1 -- 172.21.15.8:0/910136289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 msgr2=0x55e60ee9a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7f7fe700 1 --2- 172.21.15.8:0/910136289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60ee9a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.202+0000 7f9f7f7fe700 1 -- 172.21.15.8:0/910136289 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e60ec16d80 con 0x55e60ee98ec0 2023-10-06T23:24:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.203+0000 7f9f67fff700 1 -- 172.21.15.8:0/1465081534 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9f700cdfb0 con 0x7f9f800ffdf0 2023-10-06T23:24:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.203+0000 7f9f7f7fe700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9f680a1500 0x7f9f680a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.203+0000 7f9f7f7fe700 1 --2- 172.21.15.8:0/910136289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60ee992e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9f78011580 tx=0x7f9f78009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a66ed296d1e7fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.204+0000 7f9f657fa700 1 -- 172.21.15.8:0/910136289 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7801a040 con 0x55e60ee98ec0 2023-10-06T23:24:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.204+0000 7f9f657fa700 1 -- 172.21.15.8:0/910136289 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f7800f040 con 0x55e60ee98ec0 2023-10-06T23:24:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.204+0000 7f9f657fa700 1 -- 172.21.15.8:0/910136289 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800e040 con 0x55e60ee98ec0 2023-10-06T23:24:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f7f7fe700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9f680a1500 0x7f9f680a39c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9f78020000 tx=0x7f9f78023000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/910136289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 msgr2=0x55e60ee992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/910136289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60ee992e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9f78011580 tx=0x7f9f78009920 comp rx=0 tx=0).stop 2023-10-06T23:24:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/910136289 shutdown_connections 2023-10-06T23:24:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/910136289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/910136289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60ee992e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/910136289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60ee9a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/910136289 >> 172.21.15.8:0/910136289 conn(0x55e60ee0d200 msgr2=0x55e60ee93bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/910136289 shutdown_connections 2023-10-06T23:24:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.205+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/910136289 wait complete. 2023-10-06T23:24:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.206+0000 7f9f98fc4b80 1 -- start start 2023-10-06T23:24:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.206+0000 7f9f98fc4b80 1 Processor -- start 2023-10-06T23:24:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.206+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60eea2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.206+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee99fd0 0x55e60eea30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eeaa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60edebdd0 con 0x55e60ee98ec0 2023-10-06T23:24:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60ed886b0 con 0x55e60ee9a990 2023-10-06T23:24:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60ed88350 con 0x55e60ee99fd0 2023-10-06T23:24:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f98fc4b80 10 client.0 _ll_register_callbacks cb 0x55e60ebe57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60eea2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60eea2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58752/0 (socket says 172.21.15.8:58752) 2023-10-06T23:24:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7effd700 1 -- 172.21.15.8:0/1244635003 learned_addr learned my addr 172.21.15.8:0/1244635003 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee99fd0 0x55e60eea30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7f7fe700 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eeaa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7effd700 1 -- 172.21.15.8:0/1244635003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee99fd0 msgr2=0x55e60eea30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7effd700 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee99fd0 0x55e60eea30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7effd700 1 -- 172.21.15.8:0/1244635003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 msgr2=0x55e60eeaa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7effd700 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eeaa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7effd700 1 -- 172.21.15.8:0/1244635003 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f78011230 con 0x55e60ee98ec0 2023-10-06T23:24:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.207+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee99fd0 0x55e60eea30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f7effd700 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60eea2b80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9f70023000 tx=0x7f9f700d1ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0e0d654aee9730 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f62ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:24:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f62ff5700 1 -- 172.21.15.8:0/1244635003 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700d02d0 con 0x55e60ee98ec0 2023-10-06T23:24:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/1244635003 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e60ee8bd50 con 0x55e60ee98ec0 2023-10-06T23:24:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f62ff5700 1 -- 172.21.15.8:0/1244635003 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9f7009ba70 con 0x55e60ee98ec0 2023-10-06T23:24:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f62ff5700 1 -- 172.21.15.8:0/1244635003 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f700976b0 con 0x55e60ee98ec0 2023-10-06T23:24:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f98fc4b80 10 client.16644 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/1244635003 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e60ebffc00 con 0x55e60ee98ec0 2023-10-06T23:24:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.208+0000 7f9f62ff5700 1 -- 172.21.15.8:0/1244635003 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e60ee8bd50 con 0x55e60ee98ec0 2023-10-06T23:24:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.209+0000 7f9f62ff5700 1 -- 172.21.15.8:0/1244635003 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9f7009f170 con 0x55e60ee98ec0 2023-10-06T23:24:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.209+0000 7f9f98fc4b80 10 client.16644 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.209+0000 7f9f98fc4b80 10 client.16644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.209+0000 7f9f98fc4b80 20 client.16644 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.209+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e60eeae5c0 0x55e60eeb09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.209+0000 7f9f98fc4b80 4 client.16644 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:24:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.209+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/1244635003 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e60ede4db0 con 0x55e60eeae5c0 2023-10-06T23:24:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.209+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e60eeae5c0 0x55e60eeb09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.210+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e60eeae5c0 0x55e60eeb09b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f1ddec1479fca01 server_cookie=7a3fdc9d845c23ab in_seq=0 out_seq=0 2023-10-06T23:24:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.210+0000 7f9f62ff5700 10 client.16644 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.211+0000 7f9f62ff5700 1 -- 172.21.15.8:0/1244635003 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e60ede4db0 con 0x55e60eeae5c0 2023-10-06T23:24:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.211+0000 7f9f62ff5700 10 client.16644 handle_command_reply: tid=0 2023-10-06T23:24:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.211+0000 7f9f98fc4b80 1 client.16644 shutdown 2023-10-06T23:24:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/1244635003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 msgr2=0x55e60eea2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60eea2b80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9f70023000 tx=0x7f9f700d1ee0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/1244635003 shutdown_connections 2023-10-06T23:24:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e60eeae5c0 0x55e60eeb09b0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60eea2b80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eeaa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/1244635003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee99fd0 0x55e60eea30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f62ff5700 0 client.16644 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/1244635003 >> 172.21.15.8:0/1244635003 conn(0x55e60ee0d200 msgr2=0x55e60ee93250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/1244635003 shutdown_connections 2023-10-06T23:24:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/1244635003 wait complete. 2023-10-06T23:24:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.212+0000 7f9f98fc4b80 20 client.16644 trim_cache size 0 max 16384 2023-10-06T23:24:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.233+0000 7f9f98fc4b80 1 Processor -- start 2023-10-06T23:24:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.233+0000 7f9f98fc4b80 1 -- start start 2023-10-06T23:24:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.233+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60ee94900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.233+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee99fd0 0x55e60eeaa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee9a990 0x55e60ee93250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60ec6c8c0 con 0x55e60ee98ec0 2023-10-06T23:24:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60ee99740 con 0x55e60ee99fd0 2023-10-06T23:24:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60eea2720 con 0x55e60ee9a990 2023-10-06T23:24:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60ee94900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee99fd0 0x55e60eeaa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee99fd0 0x55e60eeaa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:47182/0 (socket says 172.21.15.8:47182) 2023-10-06T23:24:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7f7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee9a990 0x55e60ee93250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7e7fc700 1 -- 172.21.15.8:0/4034169661 learned_addr learned my addr 172.21.15.8:0/4034169661 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7e7fc700 1 -- 172.21.15.8:0/4034169661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee9a990 msgr2=0x55e60ee93250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/4034169661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee9a990 0x55e60ee93250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7e7fc700 1 -- 172.21.15.8:0/4034169661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 msgr2=0x55e60ee94900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/4034169661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60ee94900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.234+0000 7f9f7e7fc700 1 -- 172.21.15.8:0/4034169661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e60ec3d1f0 con 0x55e60ee99fd0 2023-10-06T23:24:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.235+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/4034169661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee99fd0 0x55e60eeaa0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55e60eeb1290 tx=0x7f9f74009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6636edb1a7ae494 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.235+0000 7f9f65ffb700 1 -- 172.21.15.8:0/4034169661 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74016030 con 0x55e60ee99fd0 2023-10-06T23:24:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.235+0000 7f9f65ffb700 1 -- 172.21.15.8:0/4034169661 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f74017040 con 0x55e60ee99fd0 2023-10-06T23:24:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.235+0000 7f9f65ffb700 1 -- 172.21.15.8:0/4034169661 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7401e5a0 con 0x55e60ee99fd0 2023-10-06T23:24:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/4034169661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee99fd0 msgr2=0x55e60eeaa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/4034169661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee99fd0 0x55e60eeaa0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55e60eeb1290 tx=0x7f9f74009260 comp rx=0 tx=0).stop 2023-10-06T23:24:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/4034169661 shutdown_connections 2023-10-06T23:24:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/4034169661 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee98ec0 0x55e60ee94900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/4034169661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee9a990 0x55e60ee93250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/4034169661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee99fd0 0x55e60eeaa0c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/4034169661 >> 172.21.15.8:0/4034169661 conn(0x55e60ee0d200 msgr2=0x55e60ee93b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/4034169661 shutdown_connections 2023-10-06T23:24:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.236+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/4034169661 wait complete. 2023-10-06T23:24:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.237+0000 7f9f98fc4b80 1 -- start start 2023-10-06T23:24:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.237+0000 7f9f98fc4b80 1 Processor -- start 2023-10-06T23:24:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.238+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60eea7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.238+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60eea8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.238+0000 7f9f98fc4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.238+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60eea96e0 con 0x55e60ee99fd0 2023-10-06T23:24:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.238+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60eea9850 con 0x55e60ee9a990 2023-10-06T23:24:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.238+0000 7f9f98fc4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60eea9a10 con 0x55e60ee98ec0 2023-10-06T23:24:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.238+0000 7f9f98fc4b80 10 client.0 _ll_register_callbacks cb 0x7f9f700d1740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.238+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60eea7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60eea7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52684/0 (socket says 172.21.15.8:52684) 2023-10-06T23:24:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7effd700 1 -- 172.21.15.8:0/3150168854 learned_addr learned my addr 172.21.15.8:0/3150168854 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7f7fe700 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60eea8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7effd700 1 -- 172.21.15.8:0/3150168854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 msgr2=0x55e60eea91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7effd700 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7effd700 1 -- 172.21.15.8:0/3150168854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 msgr2=0x55e60eea8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7effd700 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60eea8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7effd700 1 -- 172.21.15.8:0/3150168854 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f74004040 con 0x55e60ee98ec0 2023-10-06T23:24:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60eea8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:24:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f7effd700 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60eea7c50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9f70097d90 tx=0x7f9f7000ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3618c5f65077178b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.239+0000 7f9f62ff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:24:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.240+0000 7f9f62ff5700 1 -- 172.21.15.8:0/3150168854 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700976b0 con 0x55e60ee98ec0 2023-10-06T23:24:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.240+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/3150168854 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f7800f040 con 0x55e60ee98ec0 2023-10-06T23:24:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.240+0000 7f9f62ff5700 1 -- 172.21.15.8:0/3150168854 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9f7009ba70 con 0x55e60ee98ec0 2023-10-06T23:24:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.240+0000 7f9f62ff5700 1 -- 172.21.15.8:0/3150168854 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f700a3670 con 0x55e60ee98ec0 2023-10-06T23:24:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.240+0000 7f9f98fc4b80 10 client.26539 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.240+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/3150168854 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e60ec15250 con 0x55e60ee98ec0 2023-10-06T23:24:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.240+0000 7f9f62ff5700 1 -- 172.21.15.8:0/3150168854 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f7800f040 con 0x55e60ee98ec0 2023-10-06T23:24:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.241+0000 7f9f62ff5700 1 -- 172.21.15.8:0/3150168854 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9f7009a2d0 con 0x55e60ee98ec0 2023-10-06T23:24:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.241+0000 7f9f98fc4b80 10 client.26539 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.241+0000 7f9f98fc4b80 10 client.26539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.241+0000 7f9f98fc4b80 20 client.26539 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.241+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e60ef02c00 0x55e60ef04ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.241+0000 7f9f98fc4b80 4 client.26539 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:24:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.241+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/3150168854 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e60ede4ad0 con 0x55e60ef02c00 2023-10-06T23:24:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.241+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e60ef02c00 0x55e60ef04ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.242+0000 7f9f62ff5700 10 client.26539 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.242+0000 7f9f7e7fc700 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e60ef02c00 0x55e60ef04ff0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4001a9bd5a8ef0b server_cookie=1b1cd57a1793c260 in_seq=0 out_seq=0 2023-10-06T23:24:00.260 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f62ff5700 1 -- 172.21.15.8:0/3150168854 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e60ede4ad0 con 0x55e60ef02c00 2023-10-06T23:24:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f62ff5700 10 client.26539 handle_command_reply: tid=0 2023-10-06T23:24:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 client.26539 shutdown 2023-10-06T23:24:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/3150168854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 msgr2=0x55e60eea7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60eea7c50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9f70097d90 tx=0x7f9f7000ff90 comp rx=0 tx=0).stop 2023-10-06T23:24:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/3150168854 shutdown_connections 2023-10-06T23:24:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e60ef02c00 0x55e60ef04ff0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e60ee9a990 0x55e60eea91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e60ee98ec0 0x55e60eea7c50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 --2- 172.21.15.8:0/3150168854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e60ee99fd0 0x55e60eea8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/3150168854 >> 172.21.15.8:0/3150168854 conn(0x55e60ee0d200 msgr2=0x55e60eea0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f62ff5700 0 client.26539 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/3150168854 shutdown_connections 2023-10-06T23:24:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.258+0000 7f9f98fc4b80 1 -- 172.21.15.8:0/3150168854 wait complete. 2023-10-06T23:24:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.259+0000 7f9f98fc4b80 20 client.26539 trim_cache size 0 max 16384 2023-10-06T23:24:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:24:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:24:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:24:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:24:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.259+0000 7f9f855ff700 1 -- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9f680a1500 msgr2=0x7f9f680a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.259+0000 7f9f855ff700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9f680a1500 0x7f9f680a39c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9f78020000 tx=0x7f9f78023000 comp rx=0 tx=0).stop 2023-10-06T23:24:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.259+0000 7f9f855ff700 1 -- 172.21.15.8:0/1465081534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 msgr2=0x7f9f80198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.259+0000 7f9f855ff700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 0x7f9f80198ed0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000b2e0 tx=0x7f9f7000b9c0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.260+0000 7f9f855ff700 1 -- 172.21.15.8:0/1465081534 shutdown_connections 2023-10-06T23:24:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.260+0000 7f9f855ff700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9f680a1500 0x7f9f680a39c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.260+0000 7f9f855ff700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f80101980 0x7f9f8019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.260+0000 7f9f855ff700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f800ffdf0 0x7f9f80198ed0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.260+0000 7f9f855ff700 1 --2- 172.21.15.8:0/1465081534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f80100fe0 0x7f9f80199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.260+0000 7f9f855ff700 1 -- 172.21.15.8:0/1465081534 >> 172.21.15.8:0/1465081534 conn(0x7f9f800fb340 msgr2=0x7f9f801069c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.260+0000 7f9f855ff700 1 -- 172.21.15.8:0/1465081534 shutdown_connections 2023-10-06T23:24:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:00.260+0000 7f9f855ff700 1 -- 172.21.15.8:0/1465081534 wait complete. 2023-10-06T23:24:01.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:00 smithi156 ceph-mon[102862]: pgmap v685: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.1 MiB/s wr, 519 op/s 2023-10-06T23:24:01.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:00 smithi008 ceph-mon[98532]: pgmap v685: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.1 MiB/s wr, 519 op/s 2023-10-06T23:24:01.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:00 smithi190 ceph-mon[102658]: pgmap v685: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.1 MiB/s wr, 519 op/s 2023-10-06T23:24:03.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:02 smithi156 ceph-mon[102862]: pgmap v686: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 4.6 MiB/s wr, 544 op/s 2023-10-06T23:24:03.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:02 smithi008 ceph-mon[98532]: pgmap v686: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 4.6 MiB/s wr, 544 op/s 2023-10-06T23:24:03.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:02 smithi190 ceph-mon[102658]: pgmap v686: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 4.6 MiB/s wr, 544 op/s 2023-10-06T23:24:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 550.0 s, 267.2 tps, lat 376.889 ms stddev 56.418 2023-10-06T23:24:05.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:04 smithi156 ceph-mon[102862]: pgmap v687: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 3.7 MiB/s wr, 482 op/s 2023-10-06T23:24:05.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:04 smithi008 ceph-mon[98532]: pgmap v687: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 3.7 MiB/s wr, 482 op/s 2023-10-06T23:24:05.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:04 smithi190 ceph-mon[102658]: pgmap v687: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 3.7 MiB/s wr, 482 op/s 2023-10-06T23:24:07.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:06 smithi156 ceph-mon[102862]: pgmap v688: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.1 MiB/s wr, 506 op/s 2023-10-06T23:24:07.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:06 smithi008 ceph-mon[98532]: pgmap v688: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.1 MiB/s wr, 506 op/s 2023-10-06T23:24:07.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:06 smithi190 ceph-mon[102658]: pgmap v688: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.1 MiB/s wr, 506 op/s 2023-10-06T23:24:08.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:08 smithi156 ceph-mon[102862]: pgmap v689: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-10-06T23:24:08.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:08 smithi008 ceph-mon[98532]: pgmap v689: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-10-06T23:24:08.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:08 smithi190 ceph-mon[102658]: pgmap v689: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-10-06T23:24:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 555.0 s, 275.2 tps, lat 363.641 ms stddev 52.115 2023-10-06T23:24:11.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:10 smithi156 ceph-mon[102862]: pgmap v690: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 4.4 MiB/s wr, 541 op/s 2023-10-06T23:24:11.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:10 smithi008 ceph-mon[98532]: pgmap v690: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 4.4 MiB/s wr, 541 op/s 2023-10-06T23:24:11.195 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:10 smithi190 ceph-mon[102658]: pgmap v690: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 4.4 MiB/s wr, 541 op/s 2023-10-06T23:24:13.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:12 smithi156 ceph-mon[102862]: pgmap v691: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 3.9 MiB/s wr, 493 op/s 2023-10-06T23:24:13.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:12 smithi008 ceph-mon[98532]: pgmap v691: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 3.9 MiB/s wr, 493 op/s 2023-10-06T23:24:13.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:12 smithi190 ceph-mon[102658]: pgmap v691: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 3.9 MiB/s wr, 493 op/s 2023-10-06T23:24:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 -- 172.21.15.8:0/1469458079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0760100fe0 msgr2=0x7f0760101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 --2- 172.21.15.8:0/1469458079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0760100fe0 0x7f0760101440 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f075c00b0a0 tx=0x7f075c00b3b0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 -- 172.21.15.8:0/1469458079 shutdown_connections 2023-10-06T23:24:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 --2- 172.21.15.8:0/1469458079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f07600ffdf0 0x7f0760100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 --2- 172.21.15.8:0/1469458079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0760101980 0x7f0760108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 --2- 172.21.15.8:0/1469458079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0760100fe0 0x7f0760101440 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 -- 172.21.15.8:0/1469458079 >> 172.21.15.8:0/1469458079 conn(0x7f07600fb340 msgr2=0x7f07600fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 -- 172.21.15.8:0/1469458079 shutdown_connections 2023-10-06T23:24:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.492+0000 7f07683ff700 1 -- 172.21.15.8:0/1469458079 wait complete. 2023-10-06T23:24:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.494+0000 7f07683ff700 1 Processor -- start 2023-10-06T23:24:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.494+0000 7f07683ff700 1 -- start start 2023-10-06T23:24:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.494+0000 7f07683ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07600ffdf0 0x7f0760198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.494+0000 7f07683ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0760100fe0 0x7f07601994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f07683ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0760101980 0x7f076019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f07683ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076019a9a0 con 0x7f0760100fe0 2023-10-06T23:24:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f07683ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076019ab10 con 0x7f07600ffdf0 2023-10-06T23:24:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f07683ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076019acd0 con 0x7f0760101980 2023-10-06T23:24:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07600ffdf0 0x7f0760198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076599a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0760100fe0 0x7f07601994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07600ffdf0 0x7f0760198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59240/0 (socket says 172.21.15.8:59240) 2023-10-06T23:24:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076619b700 1 -- 172.21.15.8:0/4081957880 learned_addr learned my addr 172.21.15.8:0/4081957880 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076699c700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0760101980 0x7f076019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076619b700 1 -- 172.21.15.8:0/4081957880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0760101980 msgr2=0x7f076019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076619b700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0760101980 0x7f076019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076619b700 1 -- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0760100fe0 msgr2=0x7f07601994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076619b700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0760100fe0 0x7f07601994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.495+0000 7f076619b700 1 -- 172.21.15.8:0/4081957880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c009d00 con 0x7f07600ffdf0 2023-10-06T23:24:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.496+0000 7f076619b700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07600ffdf0 0x7f0760198f80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f075000e970 tx=0x7f075000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.496+0000 7f07577fe700 1 -- 172.21.15.8:0/4081957880 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000c9e0 con 0x7f07600ffdf0 2023-10-06T23:24:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.497+0000 7f07683ff700 1 -- 172.21.15.8:0/4081957880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076019afb0 con 0x7f07600ffdf0 2023-10-06T23:24:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.497+0000 7f07577fe700 1 -- 172.21.15.8:0/4081957880 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0750010430 con 0x7f07600ffdf0 2023-10-06T23:24:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.497+0000 7f07683ff700 1 -- 172.21.15.8:0/4081957880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07601a1770 con 0x7f07600ffdf0 2023-10-06T23:24:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.497+0000 7f07577fe700 1 -- 172.21.15.8:0/4081957880 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750018680 con 0x7f07600ffdf0 2023-10-06T23:24:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.503+0000 7f07577fe700 1 -- 172.21.15.8:0/4081957880 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f075000cb40 con 0x7f07600ffdf0 2023-10-06T23:24:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.504+0000 7f077bc29b80 1 Processor -- start 2023-10-06T23:24:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.506+0000 7f077bc29b80 1 -- start start 2023-10-06T23:24:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.506+0000 7f07577fe700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f074c0a1580 0x7f074c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.506+0000 7f07577fe700 1 -- 172.21.15.8:0/4081957880 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0750014070 con 0x7f07600ffdf0 2023-10-06T23:24:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f076699c700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f074c0a1580 0x7f074c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f077bc29b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c5622400 con 0x5628c56bafd0 2023-10-06T23:24:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f077bc29b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c5613bc0 con 0x5628c56bb990 2023-10-06T23:24:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f077bc29b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c56114e0 con 0x5628c56b9ec0 2023-10-06T23:24:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f076619b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f076619b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56ba2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42972/0 (socket says 172.21.15.8:42972) 2023-10-06T23:24:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.507+0000 7f076619b700 1 -- 172.21.15.8:0/982229062 learned_addr learned my addr 172.21.15.8:0/982229062 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f076619b700 1 -- 172.21.15.8:0/982229062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 msgr2=0x5628c56c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f076619b700 1 --2- 172.21.15.8:0/982229062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f076619b700 1 -- 172.21.15.8:0/982229062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 msgr2=0x5628c56bb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f076619b700 1 --2- 172.21.15.8:0/982229062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f076619b700 1 -- 172.21.15.8:0/982229062 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628c5437d80 con 0x5628c56b9ec0 2023-10-06T23:24:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f076619b700 1 --2- 172.21.15.8:0/982229062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56ba2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07500a1e90 tx=0x7f0750099bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34fb67f676dfea66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f076699c700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f074c0a1580 0x7f074c0a3a40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0758009c70 tx=0x7f0758011720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f0754bfe700 1 -- 172.21.15.8:0/982229062 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075009a730 con 0x5628c56b9ec0 2023-10-06T23:24:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f0754bfe700 1 -- 172.21.15.8:0/982229062 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f075009a030 con 0x5628c56b9ec0 2023-10-06T23:24:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.508+0000 7f0754bfe700 1 -- 172.21.15.8:0/982229062 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750098460 con 0x5628c56b9ec0 2023-10-06T23:24:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.509+0000 7f077bc29b80 1 -- 172.21.15.8:0/982229062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 msgr2=0x5628c56ba2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.509+0000 7f077bc29b80 1 --2- 172.21.15.8:0/982229062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56ba2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07500a1e90 tx=0x7f0750099bf0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.510+0000 7f077bc29b80 1 -- 172.21.15.8:0/982229062 shutdown_connections 2023-10-06T23:24:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.510+0000 7f077bc29b80 1 --2- 172.21.15.8:0/982229062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.510+0000 7f077bc29b80 1 --2- 172.21.15.8:0/982229062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56ba2e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.510+0000 7f077bc29b80 1 --2- 172.21.15.8:0/982229062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56bb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.510+0000 7f077bc29b80 1 -- 172.21.15.8:0/982229062 >> 172.21.15.8:0/982229062 conn(0x5628c562e200 msgr2=0x5628c56b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.510+0000 7f077bc29b80 1 -- 172.21.15.8:0/982229062 shutdown_connections 2023-10-06T23:24:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.510+0000 7f077bc29b80 1 -- 172.21.15.8:0/982229062 wait complete. 2023-10-06T23:24:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.511+0000 7f077bc29b80 1 -- start start 2023-10-06T23:24:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.511+0000 7f077bc29b80 1 Processor -- start 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.512+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56b9ec0 0x5628c56c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.512+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bafd0 0x5628c56c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.512+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.512+0000 7f077bc29b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c560cdd0 con 0x5628c56b9ec0 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.512+0000 7f077bc29b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c55a96b0 con 0x5628c56bb990 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.512+0000 7f077bc29b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c55a9350 con 0x5628c56bafd0 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.512+0000 7f077bc29b80 10 client.0 _ll_register_callbacks cb 0x5628c54067a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.513+0000 7f076599a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bafd0 0x5628c56c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.513+0000 7f076699c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.513+0000 7f076619b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56b9ec0 0x5628c56c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.513+0000 7f076699c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59258/0 (socket says 172.21.15.8:59258) 2023-10-06T23:24:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.513+0000 7f076619b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56b9ec0 0x5628c56c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51554/0 (socket says 172.21.15.8:51554) 2023-10-06T23:24:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.513+0000 7f076699c700 1 -- 172.21.15.8:0/83679028 learned_addr learned my addr 172.21.15.8:0/83679028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.514+0000 7f076619b700 1 -- 172.21.15.8:0/83679028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bafd0 msgr2=0x5628c56c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.514+0000 7f076619b700 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bafd0 0x5628c56c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.514+0000 7f076619b700 1 -- 172.21.15.8:0/83679028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 msgr2=0x5628c56cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.514+0000 7f076619b700 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.514+0000 7f076619b700 1 -- 172.21.15.8:0/83679028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07601a1770 con 0x5628c56b9ec0 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.514+0000 7f076699c700 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.514+0000 7f076619b700 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56b9ec0 0x5628c56c3bd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0750098380 tx=0x7f0750004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3e954a7c7ea062 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.514+0000 7f0749ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.515+0000 7f0749ffb700 1 -- 172.21.15.8:0/83679028 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075009a730 con 0x5628c56b9ec0 2023-10-06T23:24:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.515+0000 7f0749ffb700 1 -- 172.21.15.8:0/83679028 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0750010e40 con 0x5628c56b9ec0 2023-10-06T23:24:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.515+0000 7f077bc29b80 1 -- 172.21.15.8:0/83679028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628c56acd50 con 0x5628c56b9ec0 2023-10-06T23:24:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.515+0000 7f0749ffb700 1 -- 172.21.15.8:0/83679028 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07500b80c0 con 0x5628c56b9ec0 2023-10-06T23:24:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.515+0000 7f077bc29b80 10 client.16656 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.515+0000 7f077bc29b80 1 -- 172.21.15.8:0/83679028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5628c5420c00 con 0x5628c56b9ec0 2023-10-06T23:24:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.516+0000 7f0749ffb700 1 -- 172.21.15.8:0/83679028 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5628c56acd50 con 0x5628c56b9ec0 2023-10-06T23:24:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.516+0000 7f0749ffb700 1 -- 172.21.15.8:0/83679028 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f07500b2af0 con 0x5628c56b9ec0 2023-10-06T23:24:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.516+0000 7f077bc29b80 10 client.16656 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.516+0000 7f077bc29b80 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.516+0000 7f077bc29b80 20 client.16656 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.516+0000 7f077bc29b80 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5628c56cf6c0 0x5628c56d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.516+0000 7f077bc29b80 4 client.16656 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:24:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.516+0000 7f077bc29b80 1 -- 172.21.15.8:0/83679028 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628c5605db0 con 0x5628c56cf6c0 2023-10-06T23:24:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.517+0000 7f076599a700 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5628c56cf6c0 0x5628c56d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.518+0000 7f076599a700 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5628c56cf6c0 0x5628c56d1ae0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb78aa9a7032343e server_cookie=f83c2ec08d55d5e8 in_seq=0 out_seq=0 2023-10-06T23:24:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.518+0000 7f0749ffb700 10 client.16656 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.519+0000 7f0749ffb700 1 -- 172.21.15.8:0/83679028 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5628c5605db0 con 0x5628c56cf6c0 2023-10-06T23:24:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.519+0000 7f0749ffb700 10 client.16656 handle_command_reply: tid=0 2023-10-06T23:24:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.519+0000 7f077bc29b80 1 client.16656 shutdown 2023-10-06T23:24:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f077bc29b80 1 -- 172.21.15.8:0/83679028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56b9ec0 msgr2=0x5628c56c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f077bc29b80 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56b9ec0 0x5628c56c3bd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0750098380 tx=0x7f0750004750 comp rx=0 tx=0).stop 2023-10-06T23:24:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f077bc29b80 1 -- 172.21.15.8:0/83679028 shutdown_connections 2023-10-06T23:24:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f077bc29b80 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5628c56cf6c0 0x5628c56d1ae0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f077bc29b80 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56b9ec0 0x5628c56c3bd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f077bc29b80 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f077bc29b80 1 --2- 172.21.15.8:0/83679028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bafd0 0x5628c56c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f077bc29b80 1 -- 172.21.15.8:0/83679028 >> 172.21.15.8:0/83679028 conn(0x5628c562e200 msgr2=0x5628c56b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.520+0000 7f0749ffb700 0 client.16656 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.521+0000 7f077bc29b80 1 -- 172.21.15.8:0/83679028 shutdown_connections 2023-10-06T23:24:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.531+0000 7f077bc29b80 1 -- 172.21.15.8:0/83679028 wait complete. 2023-10-06T23:24:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.531+0000 7f077bc29b80 20 client.16656 trim_cache size 0 max 16384 2023-10-06T23:24:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.558+0000 7f077bc29b80 1 Processor -- start 2023-10-06T23:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.558+0000 7f077bc29b80 1 -- start start 2023-10-06T23:24:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.559+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56b9ec0 0x5628c56cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.559+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.559+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bb990 0x5628c56d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.559+0000 7f077bc29b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c548d8c0 con 0x5628c56bafd0 2023-10-06T23:24:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.559+0000 7f077bc29b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c56b1860 con 0x5628c56b9ec0 2023-10-06T23:24:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.559+0000 7f077bc29b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c56c1b00 con 0x5628c56bb990 2023-10-06T23:24:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.559+0000 7f076619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56b9ec0 0x5628c56cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076699c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bb990 0x5628c56d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56b9ec0 0x5628c56cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59264/0 (socket says 172.21.15.8:59264) 2023-10-06T23:24:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076619b700 1 -- 172.21.15.8:0/2913821747 learned_addr learned my addr 172.21.15.8:0/2913821747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076699c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bb990 0x5628c56d16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42996/0 (socket says 172.21.15.8:42996) 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076599a700 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076619b700 1 -- 172.21.15.8:0/2913821747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bb990 msgr2=0x5628c56d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076619b700 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bb990 0x5628c56d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076619b700 1 -- 172.21.15.8:0/2913821747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 msgr2=0x5628c56cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076619b700 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076619b700 1 -- 172.21.15.8:0/2913821747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628c545e1f0 con 0x5628c56b9ec0 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076699c700 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bb990 0x5628c56d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076599a700 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:24:13.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.560+0000 7f076619b700 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56b9ec0 0x5628c56cb980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07500b2e50 tx=0x7f07500983d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322228d178c3b7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:13.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.561+0000 7f07553ff700 1 -- 172.21.15.8:0/2913821747 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075009a730 con 0x5628c56b9ec0 2023-10-06T23:24:13.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.561+0000 7f07553ff700 1 -- 172.21.15.8:0/2913821747 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07500a23c0 con 0x5628c56b9ec0 2023-10-06T23:24:13.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.561+0000 7f07553ff700 1 -- 172.21.15.8:0/2913821747 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500b2af0 con 0x5628c56b9ec0 2023-10-06T23:24:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 -- 172.21.15.8:0/2913821747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56b9ec0 msgr2=0x5628c56cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56b9ec0 0x5628c56cb980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07500b2e50 tx=0x7f07500983d0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 -- 172.21.15.8:0/2913821747 shutdown_connections 2023-10-06T23:24:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56bb990 0x5628c56d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56b9ec0 0x5628c56cb980 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 --2- 172.21.15.8:0/2913821747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 -- 172.21.15.8:0/2913821747 >> 172.21.15.8:0/2913821747 conn(0x5628c562e200 msgr2=0x5628c56b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 -- 172.21.15.8:0/2913821747 shutdown_connections 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.562+0000 7f077bc29b80 1 -- 172.21.15.8:0/2913821747 wait complete. 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.563+0000 7f077bc29b80 1 -- start start 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.563+0000 7f077bc29b80 1 Processor -- start 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f077bc29b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f077bc29b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c56ca4a0 con 0x5628c56bafd0 2023-10-06T23:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f077bc29b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c56ca610 con 0x5628c56bb990 2023-10-06T23:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f077bc29b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628c56ca7d0 con 0x5628c56b9ec0 2023-10-06T23:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f077bc29b80 10 client.0 _ll_register_callbacks cb 0x7f0750099e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f076699c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f076699c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59276/0 (socket says 172.21.15.8:59276) 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f076699c700 1 -- 172.21.15.8:0/1490382927 learned_addr learned my addr 172.21.15.8:0/1490382927 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f076599a700 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.564+0000 7f076619b700 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.565+0000 7f076699c700 1 -- 172.21.15.8:0/1490382927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 msgr2=0x5628c56c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.565+0000 7f076699c700 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.565+0000 7f076699c700 1 -- 172.21.15.8:0/1490382927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 msgr2=0x5628c56c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.565+0000 7f076699c700 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.565+0000 7f076699c700 1 -- 172.21.15.8:0/1490382927 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075800f6d0 con 0x5628c56bb990 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.565+0000 7f076699c700 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c9f60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f075800ffc0 tx=0x7f07580047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7b26dd6c7cc434d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.565+0000 7f0749ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.566+0000 7f0749ffb700 1 -- 172.21.15.8:0/1490382927 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758024070 con 0x5628c56bb990 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.566+0000 7f0749ffb700 1 -- 172.21.15.8:0/1490382927 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f07580283f0 con 0x5628c56bb990 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.566+0000 7f077bc29b80 1 -- 172.21.15.8:0/1490382927 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f075009a030 con 0x5628c56bb990 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.566+0000 7f0749ffb700 1 -- 172.21.15.8:0/1490382927 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f075801fe80 con 0x5628c56bb990 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.566+0000 7f077bc29b80 10 client.26537 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.566+0000 7f077bc29b80 1 -- 172.21.15.8:0/1490382927 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5628c5420c00 con 0x5628c56bb990 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.566+0000 7f0749ffb700 1 -- 172.21.15.8:0/1490382927 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f075009a030 con 0x5628c56bb990 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.567+0000 7f0749ffb700 1 -- 172.21.15.8:0/1490382927 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f075800e570 con 0x5628c56bb990 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.567+0000 7f077bc29b80 10 client.26537 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.567+0000 7f077bc29b80 10 client.26537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.567+0000 7f077bc29b80 20 client.26537 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.567+0000 7f077bc29b80 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5628c572c840 0x5628c572ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.567+0000 7f077bc29b80 4 client.26537 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.567+0000 7f077bc29b80 1 -- 172.21.15.8:0/1490382927 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5628c5605ad0 con 0x5628c572c840 2023-10-06T23:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.567+0000 7f076619b700 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5628c572c840 0x5628c572ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.568+0000 7f0749ffb700 10 client.26537 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.568+0000 7f076619b700 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5628c572c840 0x5628c572ec60 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cef7bcc2994306b server_cookie=c58c062641a2941b in_seq=0 out_seq=0 2023-10-06T23:24:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f0749ffb700 1 -- 172.21.15.8:0/1490382927 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5628c5605ad0 con 0x5628c572c840 2023-10-06T23:24:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f0749ffb700 10 client.26537 handle_command_reply: tid=0 2023-10-06T23:24:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f077bc29b80 1 client.26537 shutdown 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f077bc29b80 1 -- 172.21.15.8:0/1490382927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 msgr2=0x5628c56c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f077bc29b80 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c9f60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f075800ffc0 tx=0x7f07580047c0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f077bc29b80 1 -- 172.21.15.8:0/1490382927 shutdown_connections 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f077bc29b80 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5628c572c840 0x5628c572ec60 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f077bc29b80 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628c56bb990 0x5628c56c9f60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f077bc29b80 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628c56b9ec0 0x5628c56c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.583+0000 7f077bc29b80 1 --2- 172.21.15.8:0/1490382927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628c56bafd0 0x5628c56c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.584+0000 7f077bc29b80 1 -- 172.21.15.8:0/1490382927 >> 172.21.15.8:0/1490382927 conn(0x5628c562e200 msgr2=0x5628c56d16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.584+0000 7f0749ffb700 0 client.26537 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.584+0000 7f077bc29b80 1 -- 172.21.15.8:0/1490382927 shutdown_connections 2023-10-06T23:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.584+0000 7f077bc29b80 1 -- 172.21.15.8:0/1490382927 wait complete. 2023-10-06T23:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.584+0000 7f077bc29b80 20 client.26537 trim_cache size 0 max 16384 2023-10-06T23:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 -- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f074c0a1580 msgr2=0x7f074c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f074c0a1580 0x7f074c0a3a40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0758009c70 tx=0x7f0758011720 comp rx=0 tx=0).stop 2023-10-06T23:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 -- 172.21.15.8:0/4081957880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07600ffdf0 msgr2=0x7f0760198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07600ffdf0 0x7f0760198f80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f075000e970 tx=0x7f075000ec80 comp rx=0 tx=0).stop 2023-10-06T23:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 -- 172.21.15.8:0/4081957880 shutdown_connections 2023-10-06T23:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f074c0a1580 0x7f074c0a3a40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0760101980 0x7f076019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07600ffdf0 0x7f0760198f80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 --2- 172.21.15.8:0/4081957880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0760100fe0 0x7f07601994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 -- 172.21.15.8:0/4081957880 >> 172.21.15.8:0/4081957880 conn(0x7f07600fb340 msgr2=0x7f07600fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 -- 172.21.15.8:0/4081957880 shutdown_connections 2023-10-06T23:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:13.585+0000 7f07683ff700 1 -- 172.21.15.8:0/4081957880 wait complete. 2023-10-06T23:24:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 560.0 s, 265.0 tps, lat 375.391 ms stddev 50.704 2023-10-06T23:24:15.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:14 smithi156 ceph-mon[102862]: pgmap v692: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 4.6 MiB/s wr, 554 op/s 2023-10-06T23:24:15.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:14 smithi008 ceph-mon[98532]: pgmap v692: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 4.6 MiB/s wr, 554 op/s 2023-10-06T23:24:15.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:14 smithi190 ceph-mon[102658]: pgmap v692: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 4.6 MiB/s wr, 554 op/s 2023-10-06T23:24:17.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:16 smithi156 ceph-mon[102862]: pgmap v693: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 4.6 MiB/s wr, 568 op/s 2023-10-06T23:24:17.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:16 smithi008 ceph-mon[98532]: pgmap v693: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 4.6 MiB/s wr, 568 op/s 2023-10-06T23:24:17.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:16 smithi190 ceph-mon[102658]: pgmap v693: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 4.6 MiB/s wr, 568 op/s 2023-10-06T23:24:18.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:18 smithi156 ceph-mon[102862]: pgmap v694: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 3.9 MiB/s wr, 498 op/s 2023-10-06T23:24:18.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:18 smithi008 ceph-mon[98532]: pgmap v694: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 3.9 MiB/s wr, 498 op/s 2023-10-06T23:24:18.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:18 smithi190 ceph-mon[102658]: pgmap v694: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 3.9 MiB/s wr, 498 op/s 2023-10-06T23:24:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 565.0 s, 250.4 tps, lat 396.628 ms stddev 91.190 2023-10-06T23:24:20.233 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:24:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.530+0000 7f6b421ff700 1 -- 172.21.15.8:0/3019637937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b3c100ea0 msgr2=0x7f6b3c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.530+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3019637937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b3c100ea0 0x7f6b3c1012c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009990 tx=0x7f6b2c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.530+0000 7f6b421ff700 1 -- 172.21.15.8:0/3019637937 shutdown_connections 2023-10-06T23:24:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.530+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3019637937 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c102a40 0x7f6b3c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.530+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3019637937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b3c100ea0 0x7f6b3c1012c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.530+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3019637937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b3c102080 0x7f6b3c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.530+0000 7f6b421ff700 1 -- 172.21.15.8:0/3019637937 >> 172.21.15.8:0/3019637937 conn(0x7f6b3c0fc460 msgr2=0x7f6b3c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.531+0000 7f6b421ff700 1 -- 172.21.15.8:0/3019637937 shutdown_connections 2023-10-06T23:24:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.531+0000 7f6b421ff700 1 -- 172.21.15.8:0/3019637937 wait complete. 2023-10-06T23:24:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.532+0000 7f6b421ff700 1 Processor -- start 2023-10-06T23:24:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.532+0000 7f6b421ff700 1 -- start start 2023-10-06T23:24:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b421ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c100ea0 0x7f6b3c194940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b421ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b3c102080 0x7f6b3c199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b421ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b3c102a40 0x7f6b3c194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b421ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c1ad4d0 con 0x7f6b3c100ea0 2023-10-06T23:24:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b421ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c1ad610 con 0x7f6b3c102a40 2023-10-06T23:24:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b421ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c1ad7a0 con 0x7f6b3c102080 2023-10-06T23:24:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b3b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c100ea0 0x7f6b3c194940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b3b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c100ea0 0x7f6b3c194940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54132/0 (socket says 172.21.15.8:54132) 2023-10-06T23:24:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.533+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/3695295242 learned_addr learned my addr 172.21.15.8:0/3695295242 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.534+0000 7f6b3affd700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b3c102080 0x7f6b3c199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.534+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b3c102a40 0x7f6b3c194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.534+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/3695295242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b3c102080 msgr2=0x7f6b3c199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.534+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b3c102080 0x7f6b3c199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.534+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/3695295242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b3c102a40 msgr2=0x7f6b3c194fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.534+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b3c102a40 0x7f6b3c194fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.534+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/3695295242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009c40 con 0x7f6b3c100ea0 2023-10-06T23:24:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.534+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c100ea0 0x7f6b3c194940 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0059d0 tx=0x7f6b2c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.535+0000 7f6b38ff9700 1 -- 172.21.15.8:0/3695295242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c01d070 con 0x7f6b3c100ea0 2023-10-06T23:24:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.535+0000 7f6b38ff9700 1 -- 172.21.15.8:0/3695295242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b2c00f460 con 0x7f6b3c100ea0 2023-10-06T23:24:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.535+0000 7f6b38ff9700 1 -- 172.21.15.8:0/3695295242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c021670 con 0x7f6b3c100ea0 2023-10-06T23:24:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.535+0000 7f6b421ff700 1 -- 172.21.15.8:0/3695295242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c0095f0 con 0x7f6b3c100ea0 2023-10-06T23:24:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.535+0000 7f6b421ff700 1 -- 172.21.15.8:0/3695295242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c1adcf0 con 0x7f6b3c100ea0 2023-10-06T23:24:20.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.540+0000 7f6b38ff9700 1 -- 172.21.15.8:0/3695295242 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6b2c00f860 con 0x7f6b3c100ea0 2023-10-06T23:24:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.542+0000 7f6b55a5ab80 1 Processor -- start 2023-10-06T23:24:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.542+0000 7f6b55a5ab80 1 -- start start 2023-10-06T23:24:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.542+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3280680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.542+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280bc0 0x5612d3281480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3281a60 0x5612d3281ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d31e8460 con 0x5612d3280260 2023-10-06T23:24:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d31d9c20 con 0x5612d3280bc0 2023-10-06T23:24:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d31d7540 con 0x5612d3281a60 2023-10-06T23:24:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b3affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3281a60 0x5612d3281ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b3b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280bc0 0x5612d3281480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b3bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3280680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b3affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3281a60 0x5612d3281ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37230/0 (socket says 172.21.15.8:37230) 2023-10-06T23:24:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.543+0000 7f6b3affd700 1 -- 172.21.15.8:0/113182876 learned_addr learned my addr 172.21.15.8:0/113182876 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b38ff9700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b240a1480 0x7f6b240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/113182876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3281a60 msgr2=0x5612d3281ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/113182876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3281a60 0x5612d3281ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/113182876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 msgr2=0x5612d3280680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/113182876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3280680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/113182876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612d2ffdde0 con 0x5612d3280bc0 2023-10-06T23:24:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b3affd700 1 --2- 172.21.15.8:0/113182876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3281a60 0x5612d3281ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b38ff9700 1 -- 172.21.15.8:0/3695295242 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6b2c0cdfe0 con 0x7f6b3c100ea0 2023-10-06T23:24:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.544+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b240a1480 0x7f6b240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.545+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/113182876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280bc0 0x5612d3281480 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0cba70 tx=0x7f6b2c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b138465309c6a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.545+0000 7f6b21ffb700 1 -- 172.21.15.8:0/113182876 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c01df10 con 0x5612d3280bc0 2023-10-06T23:24:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.545+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b240a1480 0x7f6b240a3940 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6b34007a40 tx=0x7f6b34004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.546+0000 7f6b21ffb700 1 -- 172.21.15.8:0/113182876 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b2c09b150 con 0x5612d3280bc0 2023-10-06T23:24:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.546+0000 7f6b21ffb700 1 -- 172.21.15.8:0/113182876 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c09b380 con 0x5612d3280bc0 2023-10-06T23:24:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.546+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/113182876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280bc0 msgr2=0x5612d3281480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.546+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/113182876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280bc0 0x5612d3281480 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0cba70 tx=0x7f6b2c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.547+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/113182876 shutdown_connections 2023-10-06T23:24:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.547+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/113182876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3280680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.547+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/113182876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3281a60 0x5612d3281ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.547+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/113182876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280bc0 0x5612d3281480 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.547+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/113182876 >> 172.21.15.8:0/113182876 conn(0x5612d31f4260 msgr2=0x5612d327b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:20.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.547+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/113182876 shutdown_connections 2023-10-06T23:24:20.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.547+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/113182876 wait complete. 2023-10-06T23:24:20.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.548+0000 7f6b55a5ab80 1 -- start start 2023-10-06T23:24:20.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.548+0000 7f6b55a5ab80 1 Processor -- start 2023-10-06T23:24:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.549+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.549+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d328a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.549+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d3291210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.549+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d31d2e30 con 0x5612d3280260 2023-10-06T23:24:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.549+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d316f710 con 0x5612d3281a60 2023-10-06T23:24:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.549+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d316f3b0 con 0x5612d3280bc0 2023-10-06T23:24:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b55a5ab80 10 client.0 _ll_register_callbacks cb 0x5612d2fcc800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d3291210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d3291210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50568/0 (socket says 172.21.15.8:50568) 2023-10-06T23:24:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3bfff700 1 -- 172.21.15.8:0/1426082283 learned_addr learned my addr 172.21.15.8:0/1426082283 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3affd700 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d328a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3bfff700 1 -- 172.21.15.8:0/1426082283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 msgr2=0x5612d328a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d328a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3bfff700 1 -- 172.21.15.8:0/1426082283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 msgr2=0x5612d3289c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.550+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.551+0000 7f6b3bfff700 1 -- 172.21.15.8:0/1426082283 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b30009960 con 0x5612d3281a60 2023-10-06T23:24:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.551+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:24:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.551+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d3291210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6b34017fc0 tx=0x7f6b3400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3faaee2e5f4b698c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.551+0000 7f6b1affd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:24:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.551+0000 7f6b1affd700 1 -- 172.21.15.8:0/1426082283 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3401e040 con 0x5612d3281a60 2023-10-06T23:24:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.551+0000 7f6b1affd700 1 -- 172.21.15.8:0/1426082283 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6b34024470 con 0x5612d3281a60 2023-10-06T23:24:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.551+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/1426082283 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612d3272f10 con 0x5612d3281a60 2023-10-06T23:24:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.552+0000 7f6b1affd700 1 -- 172.21.15.8:0/1426082283 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b3400e040 con 0x5612d3281a60 2023-10-06T23:24:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.552+0000 7f6b55a5ab80 10 client.26549 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.552+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/1426082283 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f6b3c1adcf0 con 0x5612d3281a60 2023-10-06T23:24:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.552+0000 7f6b1affd700 1 -- 172.21.15.8:0/1426082283 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5612d3272f10 con 0x5612d3281a60 2023-10-06T23:24:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.553+0000 7f6b1affd700 1 -- 172.21.15.8:0/1426082283 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6b3402f6d0 con 0x5612d3281a60 2023-10-06T23:24:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.553+0000 7f6b55a5ab80 10 client.26549 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.553+0000 7f6b55a5ab80 10 client.26549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.553+0000 7f6b55a5ab80 20 client.26549 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.553+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5612d3295b70 0x5612d3297f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.553+0000 7f6b55a5ab80 4 client.26549 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:24:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.553+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/1426082283 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612d31cbe10 con 0x5612d3295b70 2023-10-06T23:24:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.553+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5612d3295b70 0x5612d3297f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.554+0000 7f6b1affd700 10 client.26549 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.554+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5612d3295b70 0x5612d3297f90 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31bfce3407f6ed5c server_cookie=a5d79c03452b592b in_seq=0 out_seq=0 2023-10-06T23:24:20.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.555+0000 7f6b1affd700 1 -- 172.21.15.8:0/1426082283 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5612d31cbe10 con 0x5612d3295b70 2023-10-06T23:24:20.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.555+0000 7f6b1affd700 10 client.26549 handle_command_reply: tid=0 2023-10-06T23:24:20.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.555+0000 7f6b55a5ab80 1 client.26549 shutdown 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/1426082283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 msgr2=0x5612d3291210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d3291210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6b34017fc0 tx=0x7f6b3400b040 comp rx=0 tx=0).stop 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/1426082283 shutdown_connections 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5612d3295b70 0x5612d3297f90 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d3291210 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b1affd700 0 client.26549 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/1426082283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d328a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/1426082283 >> 172.21.15.8:0/1426082283 conn(0x5612d31f4260 msgr2=0x5612d327af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/1426082283 shutdown_connections 2023-10-06T23:24:20.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/1426082283 wait complete. 2023-10-06T23:24:20.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.556+0000 7f6b55a5ab80 20 client.26549 trim_cache size 0 max 16384 2023-10-06T23:24:20.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.582+0000 7f6b55a5ab80 1 Processor -- start 2023-10-06T23:24:20.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.582+0000 7f6b55a5ab80 1 -- start start 2023-10-06T23:24:20.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d32911d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d328a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d3053920 con 0x5612d3280260 2023-10-06T23:24:20.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d3280fa0 con 0x5612d3281a60 2023-10-06T23:24:20.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d3281270 con 0x5612d3280bc0 2023-10-06T23:24:20.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b3bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d328a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b3b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b3bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d328a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50574/0 (socket says 172.21.15.8:50574) 2023-10-06T23:24:20.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b3bfff700 1 -- 172.21.15.8:0/3411844117 learned_addr learned my addr 172.21.15.8:0/3411844117 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:20.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.583+0000 7f6b3affd700 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d32911d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.584+0000 7f6b3bfff700 1 -- 172.21.15.8:0/3411844117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 msgr2=0x5612d32911d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:20.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.584+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d32911d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.584+0000 7f6b3bfff700 1 -- 172.21.15.8:0/3411844117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 msgr2=0x5612d3289c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:20.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.584+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.584+0000 7f6b3bfff700 1 -- 172.21.15.8:0/3411844117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612d2fe6c60 con 0x5612d3281a60 2023-10-06T23:24:20.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.584+0000 7f6b3affd700 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d32911d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:24:20.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.584+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d328a1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b340092e0 tx=0x7f6b34019af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a16c550718d5dbcb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:20.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.584+0000 7f6b227fc700 1 -- 172.21.15.8:0/3411844117 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400e040 con 0x5612d3281a60 2023-10-06T23:24:20.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.585+0000 7f6b227fc700 1 -- 172.21.15.8:0/3411844117 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b3400f040 con 0x5612d3281a60 2023-10-06T23:24:20.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.585+0000 7f6b227fc700 1 -- 172.21.15.8:0/3411844117 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34024b40 con 0x5612d3281a60 2023-10-06T23:24:20.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.585+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/3411844117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 msgr2=0x5612d328a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.585+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d328a1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b340092e0 tx=0x7f6b34019af0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.586+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/3411844117 shutdown_connections 2023-10-06T23:24:20.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.586+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3280260 0x5612d3289c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.586+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3281a60 0x5612d328a1d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.586+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/3411844117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d32911d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.586+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/3411844117 >> 172.21.15.8:0/3411844117 conn(0x5612d31f4260 msgr2=0x5612d3287e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:20.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.586+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/3411844117 shutdown_connections 2023-10-06T23:24:20.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.586+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/3411844117 wait complete. 2023-10-06T23:24:20.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.586+0000 7f6b55a5ab80 1 -- start start 2023-10-06T23:24:20.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.587+0000 7f6b55a5ab80 1 Processor -- start 2023-10-06T23:24:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.587+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280260 0x5612d3290c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.587+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d3291170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.587+0000 7f6b55a5ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3281a60 0x5612d328d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.587+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d328ddb0 con 0x5612d3281a60 2023-10-06T23:24:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.587+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d328def0 con 0x5612d3280260 2023-10-06T23:24:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.587+0000 7f6b55a5ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612d328e0b0 con 0x5612d3280bc0 2023-10-06T23:24:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.587+0000 7f6b55a5ab80 10 client.0 _ll_register_callbacks cb 0x7f6b34017990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:20.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.588+0000 7f6b3affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d3291170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.588+0000 7f6b3b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280260 0x5612d3290c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.588+0000 7f6b3b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280260 0x5612d3290c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50580/0 (socket says 172.21.15.8:50580) 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.588+0000 7f6b3affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d3291170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37260/0 (socket says 172.21.15.8:37260) 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.588+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/82028894 learned_addr learned my addr 172.21.15.8:0/82028894 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.588+0000 7f6b3bfff700 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3281a60 0x5612d328d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/82028894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 msgr2=0x5612d3291170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d3291170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/82028894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3281a60 msgr2=0x5612d328d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3281a60 0x5612d328d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b3b7fe700 1 -- 172.21.15.8:0/82028894 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c1adcf0 con 0x5612d3280260 2023-10-06T23:24:20.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b3affd700 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d3291170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b3b7fe700 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280260 0x5612d3290c30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c09b310 tx=0x7f6b2c095f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cf41ca9c93db3ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b1affd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:24:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b1affd700 1 -- 172.21.15.8:0/82028894 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c09ba80 con 0x5612d3280260 2023-10-06T23:24:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b1affd700 1 -- 172.21.15.8:0/82028894 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6b2c09f4d0 con 0x5612d3280260 2023-10-06T23:24:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.589+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/82028894 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b2c09b150 con 0x5612d3280260 2023-10-06T23:24:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b1affd700 1 -- 172.21.15.8:0/82028894 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b2c0a3680 con 0x5612d3280260 2023-10-06T23:24:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b55a5ab80 10 client.26555 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:20.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/82028894 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5612d3024250 con 0x5612d3280260 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b1affd700 1 -- 172.21.15.8:0/82028894 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b2c09b150 con 0x5612d3280260 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b1affd700 1 -- 172.21.15.8:0/82028894 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6b2c09f150 con 0x5612d3280260 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b55a5ab80 10 client.26555 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b55a5ab80 10 client.26555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b55a5ab80 20 client.26555 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5612d32eab50 0x5612d32ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b55a5ab80 4 client.26555 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.590+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/82028894 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5612d31cbb30 con 0x5612d32eab50 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.591+0000 7f6b3affd700 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5612d32eab50 0x5612d32ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.591+0000 7f6b3affd700 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5612d32eab50 0x5612d32ecf40 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6484534c44e1a751 server_cookie=d6e8a5222bc3d068 in_seq=0 out_seq=0 2023-10-06T23:24:20.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.591+0000 7f6b1affd700 10 client.26555 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b1affd700 1 -- 172.21.15.8:0/82028894 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5612d31cbb30 con 0x5612d32eab50 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b1affd700 10 client.26555 handle_command_reply: tid=0 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 client.26555 shutdown 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/82028894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280260 msgr2=0x5612d3290c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280260 0x5612d3290c30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c09b310 tx=0x7f6b2c095f90 comp rx=0 tx=0).stop 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/82028894 shutdown_connections 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5612d32eab50 0x5612d32ecf40 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5612d3281a60 0x5612d328d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b1affd700 0 client.26555 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612d3280260 0x5612d3290c30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 --2- 172.21.15.8:0/82028894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5612d3280bc0 0x5612d3291170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/82028894 >> 172.21.15.8:0/82028894 conn(0x5612d31f4260 msgr2=0x5612d3289c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/82028894 shutdown_connections 2023-10-06T23:24:20.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.592+0000 7f6b55a5ab80 1 -- 172.21.15.8:0/82028894 wait complete. 2023-10-06T23:24:20.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.593+0000 7f6b55a5ab80 20 client.26555 trim_cache size 0 max 16384 2023-10-06T23:24:20.598 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:24:20.599 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.593+0000 7f6b421ff700 1 -- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b240a1480 msgr2=0x7f6b240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.593+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b240a1480 0x7f6b240a3940 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6b34007a40 tx=0x7f6b34004b40 comp rx=0 tx=0).stop 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.593+0000 7f6b421ff700 1 -- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c100ea0 msgr2=0x7f6b3c194940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.593+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c100ea0 0x7f6b3c194940 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0059d0 tx=0x7f6b2c0057c0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.594+0000 7f6b421ff700 1 -- 172.21.15.8:0/3695295242 shutdown_connections 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.594+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6b240a1480 0x7f6b240a3940 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.594+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b3c100ea0 0x7f6b3c194940 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.594+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b3c102a40 0x7f6b3c194fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.594+0000 7f6b421ff700 1 --2- 172.21.15.8:0/3695295242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b3c102080 0x7f6b3c199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.594+0000 7f6b421ff700 1 -- 172.21.15.8:0/3695295242 >> 172.21.15.8:0/3695295242 conn(0x7f6b3c0fc460 msgr2=0x7f6b3c107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.594+0000 7f6b421ff700 1 -- 172.21.15.8:0/3695295242 shutdown_connections 2023-10-06T23:24:20.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:20.594+0000 7f6b421ff700 1 -- 172.21.15.8:0/3695295242 wait complete. 2023-10-06T23:24:20.619 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:24:20.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:20 smithi008 ceph-mon[98532]: pgmap v695: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 4.3 MiB/s wr, 544 op/s 2023-10-06T23:24:21.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:20 smithi156 ceph-mon[102862]: pgmap v695: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 4.3 MiB/s wr, 544 op/s 2023-10-06T23:24:21.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:20 smithi190 ceph-mon[102658]: pgmap v695: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 4.3 MiB/s wr, 544 op/s 2023-10-06T23:24:23.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:22 smithi156 ceph-mon[102862]: pgmap v696: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.4 MiB/s wr, 538 op/s 2023-10-06T23:24:23.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:22 smithi008 ceph-mon[98532]: pgmap v696: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.4 MiB/s wr, 538 op/s 2023-10-06T23:24:23.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:22 smithi190 ceph-mon[102658]: pgmap v696: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.4 MiB/s wr, 538 op/s 2023-10-06T23:24:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 570.0 s, 273.0 tps, lat 369.434 ms stddev 51.303 2023-10-06T23:24:25.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:24 smithi156 ceph-mon[102862]: pgmap v697: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.8 MiB/s wr, 576 op/s 2023-10-06T23:24:25.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:24 smithi008 ceph-mon[98532]: pgmap v697: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.8 MiB/s wr, 576 op/s 2023-10-06T23:24:25.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:24 smithi190 ceph-mon[102658]: pgmap v697: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.8 MiB/s wr, 576 op/s 2023-10-06T23:24:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.826+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2134729847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0075870 msgr2=0x7fe1f0075c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.826+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2134729847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0075870 0x7fe1f0075c90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009990 tx=0x7fe1e0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.827+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2134729847 shutdown_connections 2023-10-06T23:24:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.827+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2134729847 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0075870 0x7fe1f0075c90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.827+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2134729847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0077470 0x7fe1f0077cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.827+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2134729847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f0076ab0 0x7fe1f0076f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.827+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2134729847 >> 172.21.15.8:0/2134729847 conn(0x7fe1f00fe6a0 msgr2=0x7fe1f0100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.827+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2134729847 shutdown_connections 2023-10-06T23:24:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.827+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2134729847 wait complete. 2023-10-06T23:24:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.828+0000 7fe1f63ff700 1 Processor -- start 2023-10-06T23:24:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.829+0000 7fe1f63ff700 1 -- start start 2023-10-06T23:24:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.829+0000 7fe1f63ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f0075870 0x7fe1f019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.829+0000 7fe1f63ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0076ab0 0x7fe1f019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.829+0000 7fe1f63ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0077470 0x7fe1f019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.829+0000 7fe1f63ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f019ec30 con 0x7fe1f0076ab0 2023-10-06T23:24:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.829+0000 7fe1f63ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f019eda0 con 0x7fe1f0077470 2023-10-06T23:24:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.829+0000 7fe1f63ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f019ef60 con 0x7fe1f0075870 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.829+0000 7fe1effff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f0075870 0x7fe1f019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1effff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f0075870 0x7fe1f019d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37274/0 (socket says 172.21.15.8:37274) 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1effff700 1 -- 172.21.15.8:0/2646966527 learned_addr learned my addr 172.21.15.8:0/2646966527 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1f499c700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0077470 0x7fe1f019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0076ab0 0x7fe1f019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1effff700 1 -- 172.21.15.8:0/2646966527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0077470 msgr2=0x7fe1f019e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1effff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0077470 0x7fe1f019e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1effff700 1 -- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0076ab0 msgr2=0x7fe1f019d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1effff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0076ab0 0x7fe1f019d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1effff700 1 -- 172.21.15.8:0/2646966527 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00095f0 con 0x7fe1f0075870 2023-10-06T23:24:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.830+0000 7fe1effff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f0075870 0x7fe1f019d210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00098e0 tx=0x7fe1e0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.831+0000 7fe1ed7fa700 1 -- 172.21.15.8:0/2646966527 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e001d070 con 0x7fe1f0075870 2023-10-06T23:24:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.831+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2646966527 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f019f1e0 con 0x7fe1f0075870 2023-10-06T23:24:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.831+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2646966527 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f01a5a00 con 0x7fe1f0075870 2023-10-06T23:24:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.831+0000 7fe1ed7fa700 1 -- 172.21.15.8:0/2646966527 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1e000be30 con 0x7fe1f0075870 2023-10-06T23:24:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.831+0000 7fe1ed7fa700 1 -- 172.21.15.8:0/2646966527 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0022e20 con 0x7fe1f0075870 2023-10-06T23:24:26.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.836+0000 7fe1ed7fa700 1 -- 172.21.15.8:0/2646966527 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe1e000b9a0 con 0x7fe1f0075870 2023-10-06T23:24:26.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.839+0000 7fe209d15b80 1 Processor -- start 2023-10-06T23:24:26.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.839+0000 7fe209d15b80 1 -- start start 2023-10-06T23:24:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.839+0000 7fe1ed7fa700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1d80a1500 0x7fe1d80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.839+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 0x562fe2cac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe209d15b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2c13400 con 0x562fe2caaec0 2023-10-06T23:24:26.841 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe209d15b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2c04bc0 con 0x562fe2cac990 2023-10-06T23:24:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe209d15b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2c024e0 con 0x562fe2cabfd0 2023-10-06T23:24:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe1ed7fa700 1 -- 172.21.15.8:0/2646966527 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe1e00ce090 con 0x7fe1f0075870 2023-10-06T23:24:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe1f499c700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1d80a1500 0x7fe1d80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe1effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe1f499c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe1effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54200/0 (socket says 172.21.15.8:54200) 2023-10-06T23:24:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.840+0000 7fe1effff700 1 -- 172.21.15.8:0/243561192 learned_addr learned my addr 172.21.15.8:0/243561192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.841+0000 7fe1effff700 1 -- 172.21.15.8:0/243561192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 msgr2=0x562fe2cac450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T23:24:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.841+0000 7fe1effff700 1 --2- 172.21.15.8:0/243561192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 0x562fe2cac450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.841+0000 7fe1effff700 1 -- 172.21.15.8:0/243561192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 msgr2=0x562fe2cb3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.841+0000 7fe1effff700 1 --2- 172.21.15.8:0/243561192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.841+0000 7fe1effff700 1 -- 172.21.15.8:0/243561192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fe2a28d80 con 0x562fe2caaec0 2023-10-06T23:24:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.841+0000 7fe1f499c700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1d80a1500 0x7fe1d80a39c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009ec0 tx=0x7fe1e80092f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.842+0000 7fe1effff700 1 --2- 172.21.15.8:0/243561192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00a31c0 tx=0x7fe1e0097860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b1c1b8918411c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.842+0000 7fe1d67fc700 1 -- 172.21.15.8:0/243561192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e008aa20 con 0x562fe2caaec0 2023-10-06T23:24:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.842+0000 7fe1d67fc700 1 -- 172.21.15.8:0/243561192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1e000bc50 con 0x562fe2caaec0 2023-10-06T23:24:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.842+0000 7fe1d67fc700 1 -- 172.21.15.8:0/243561192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00cbc50 con 0x562fe2caaec0 2023-10-06T23:24:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.843+0000 7fe209d15b80 1 -- 172.21.15.8:0/243561192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 msgr2=0x562fe2cab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.843+0000 7fe209d15b80 1 --2- 172.21.15.8:0/243561192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00a31c0 tx=0x7fe1e0097860 comp rx=0 tx=0).stop 2023-10-06T23:24:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.844+0000 7fe209d15b80 1 -- 172.21.15.8:0/243561192 shutdown_connections 2023-10-06T23:24:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.844+0000 7fe209d15b80 1 --2- 172.21.15.8:0/243561192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.844+0000 7fe209d15b80 1 --2- 172.21.15.8:0/243561192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.844+0000 7fe209d15b80 1 --2- 172.21.15.8:0/243561192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 0x562fe2cac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.844+0000 7fe209d15b80 1 -- 172.21.15.8:0/243561192 >> 172.21.15.8:0/243561192 conn(0x562fe2c1f200 msgr2=0x562fe2ca5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.844+0000 7fe209d15b80 1 -- 172.21.15.8:0/243561192 shutdown_connections 2023-10-06T23:24:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.844+0000 7fe209d15b80 1 -- 172.21.15.8:0/243561192 wait complete. 2023-10-06T23:24:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.845+0000 7fe209d15b80 1 -- start start 2023-10-06T23:24:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.845+0000 7fe209d15b80 1 Processor -- start 2023-10-06T23:24:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.846+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.846+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cb4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.846+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 0x562fe2cbbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.846+0000 7fe209d15b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2bfddd0 con 0x562fe2cac990 2023-10-06T23:24:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.846+0000 7fe209d15b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2b9a6b0 con 0x562fe2cabfd0 2023-10-06T23:24:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.846+0000 7fe209d15b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2b9a350 con 0x562fe2caaec0 2023-10-06T23:24:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.846+0000 7fe209d15b80 10 client.0 _ll_register_callbacks cb 0x562fe29f77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.847+0000 7fe1effff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.847+0000 7fe1ef7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cb4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.847+0000 7fe1f499c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 0x562fe2cbbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.847+0000 7fe1effff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37278/0 (socket says 172.21.15.8:37278) 2023-10-06T23:24:26.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.847+0000 7fe1ef7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cb4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50604/0 (socket says 172.21.15.8:50604) 2023-10-06T23:24:26.849 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.847+0000 7fe1effff700 1 -- 172.21.15.8:0/332684839 learned_addr learned my addr 172.21.15.8:0/332684839 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1effff700 1 -- 172.21.15.8:0/332684839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 msgr2=0x562fe2cb4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1effff700 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cb4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1effff700 1 -- 172.21.15.8:0/332684839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 msgr2=0x562fe2cbbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1effff700 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 0x562fe2cbbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1effff700 1 -- 172.21.15.8:0/332684839 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f01a5a00 con 0x562fe2caaec0 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cb4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1effff700 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb48e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0003ec0 tx=0x7fe1e000bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6392954ccaee79e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/332684839 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e009f350 con 0x562fe2caaec0 2023-10-06T23:24:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.848+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/332684839 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe1e009baf0 con 0x562fe2caaec0 2023-10-06T23:24:26.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.849+0000 7fe209d15b80 1 -- 172.21.15.8:0/332684839 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fe2c9dd50 con 0x562fe2caaec0 2023-10-06T23:24:26.851 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.849+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/332684839 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e009a8e0 con 0x562fe2caaec0 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.849+0000 7fe209d15b80 10 client.26584 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.849+0000 7fe209d15b80 1 -- 172.21.15.8:0/332684839 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562fe2a11c00 con 0x562fe2caaec0 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.849+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/332684839 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1e00b0030 con 0x562fe2caaec0 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.850+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/332684839 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe1e00a12f0 con 0x562fe2caaec0 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.850+0000 7fe209d15b80 10 client.26584 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.850+0000 7fe209d15b80 10 client.26584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.850+0000 7fe209d15b80 20 client.26584 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.850+0000 7fe209d15b80 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562fe2cc0380 0x562fe2cc27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.850+0000 7fe209d15b80 4 client.26584 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.850+0000 7fe209d15b80 1 -- 172.21.15.8:0/332684839 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fe2bf6db0 con 0x562fe2cc0380 2023-10-06T23:24:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.850+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562fe2cc0380 0x562fe2cc27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.851+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562fe2cc0380 0x562fe2cc27a0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c14071175682cc5d server_cookie=fbc9e72399a810d1 in_seq=0 out_seq=0 2023-10-06T23:24:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.851+0000 7fe1cf7fe700 10 client.26584 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.852+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/332684839 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562fe2bf6db0 con 0x562fe2cc0380 2023-10-06T23:24:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.852+0000 7fe1cf7fe700 10 client.26584 handle_command_reply: tid=0 2023-10-06T23:24:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.852+0000 7fe209d15b80 1 client.26584 shutdown 2023-10-06T23:24:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 -- 172.21.15.8:0/332684839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 msgr2=0x562fe2cb48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb48e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0003ec0 tx=0x7fe1e000bdc0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 -- 172.21.15.8:0/332684839 shutdown_connections 2023-10-06T23:24:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562fe2cc0380 0x562fe2cc27a0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 0x562fe2cbbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb48e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 --2- 172.21.15.8:0/332684839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cb4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 -- 172.21.15.8:0/332684839 >> 172.21.15.8:0/332684839 conn(0x562fe2c1f200 msgr2=0x562fe2ca5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe1cf7fe700 0 client.26584 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 -- 172.21.15.8:0/332684839 shutdown_connections 2023-10-06T23:24:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.853+0000 7fe209d15b80 1 -- 172.21.15.8:0/332684839 wait complete. 2023-10-06T23:24:26.856 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.854+0000 7fe209d15b80 20 client.26584 trim_cache size 0 max 16384 2023-10-06T23:24:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.877+0000 7fe209d15b80 1 Processor -- start 2023-10-06T23:24:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.878+0000 7fe209d15b80 1 -- start start 2023-10-06T23:24:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.878+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.878+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 0x562fe2cbbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.878+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.878+0000 7fe209d15b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2a7e8c0 con 0x562fe2caaec0 2023-10-06T23:24:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.878+0000 7fe209d15b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2ca68b0 con 0x562fe2cac990 2023-10-06T23:24:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.878+0000 7fe209d15b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2cb4450 con 0x562fe2cabfd0 2023-10-06T23:24:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1f499c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1effff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1f499c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50608/0 (socket says 172.21.15.8:50608) 2023-10-06T23:24:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1f499c700 1 -- 172.21.15.8:0/968057952 learned_addr learned my addr 172.21.15.8:0/968057952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 0x562fe2cbbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1ef7fe700 1 -- 172.21.15.8:0/968057952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 msgr2=0x562fe2cb4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1ef7fe700 1 -- 172.21.15.8:0/968057952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 msgr2=0x562fe2cab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1ef7fe700 1 -- 172.21.15.8:0/968057952 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fe2a4f1f0 con 0x562fe2cabfd0 2023-10-06T23:24:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.879+0000 7fe1effff700 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.880+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 0x562fe2cbbe20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x562fe2cc0760 tx=0x7fe1e401acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fba2a7ebf8f62278 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.880+0000 7fe1d6ffd700 1 -- 172.21.15.8:0/968057952 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e401e030 con 0x562fe2cabfd0 2023-10-06T23:24:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.880+0000 7fe1d6ffd700 1 -- 172.21.15.8:0/968057952 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1e4017040 con 0x562fe2cabfd0 2023-10-06T23:24:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.880+0000 7fe1d6ffd700 1 -- 172.21.15.8:0/968057952 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4016070 con 0x562fe2cabfd0 2023-10-06T23:24:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.881+0000 7fe209d15b80 1 -- 172.21.15.8:0/968057952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 msgr2=0x562fe2cbbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.881+0000 7fe209d15b80 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 0x562fe2cbbe20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x562fe2cc0760 tx=0x7fe1e401acb0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.881+0000 7fe209d15b80 1 -- 172.21.15.8:0/968057952 shutdown_connections 2023-10-06T23:24:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.881+0000 7fe209d15b80 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2caaec0 0x562fe2cab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.881+0000 7fe209d15b80 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cac990 0x562fe2cb4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.881+0000 7fe209d15b80 1 --2- 172.21.15.8:0/968057952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2cabfd0 0x562fe2cbbe20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.881+0000 7fe209d15b80 1 -- 172.21.15.8:0/968057952 >> 172.21.15.8:0/968057952 conn(0x562fe2c1f200 msgr2=0x562fe2caf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.881+0000 7fe209d15b80 1 -- 172.21.15.8:0/968057952 shutdown_connections 2023-10-06T23:24:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.882+0000 7fe209d15b80 1 -- 172.21.15.8:0/968057952 wait complete. 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.882+0000 7fe209d15b80 1 -- start start 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.883+0000 7fe209d15b80 1 Processor -- start 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.883+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.883+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.883+0000 7fe209d15b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 0x562fe2cbb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.883+0000 7fe209d15b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2cbb7f0 con 0x562fe2cac990 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.883+0000 7fe209d15b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2cbb960 con 0x562fe2cabfd0 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.883+0000 7fe209d15b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fe2cbbb20 con 0x562fe2caaec0 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.883+0000 7fe209d15b80 10 client.0 _ll_register_callbacks cb 0x562fe29f77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1effff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1effff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37298/0 (socket says 172.21.15.8:37298) 2023-10-06T23:24:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1effff700 1 -- 172.21.15.8:0/2605355867 learned_addr learned my addr 172.21.15.8:0/2605355867 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1f499c700 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 0x562fe2cbb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1effff700 1 -- 172.21.15.8:0/2605355867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 msgr2=0x562fe2cba2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1effff700 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cba2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1effff700 1 -- 172.21.15.8:0/2605355867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 msgr2=0x562fe2cbb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1effff700 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 0x562fe2cbb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.884+0000 7fe1effff700 1 -- 172.21.15.8:0/2605355867 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562fe2a11c00 con 0x562fe2caaec0 2023-10-06T23:24:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.885+0000 7fe1effff700 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb9d60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0099740 tx=0x7fe1e00999a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a78c75314eacc73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.885+0000 7fe1cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:24:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.885+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/2605355867 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e009af30 con 0x562fe2caaec0 2023-10-06T23:24:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.885+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/2605355867 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe1e009baf0 con 0x562fe2caaec0 2023-10-06T23:24:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.885+0000 7fe209d15b80 1 -- 172.21.15.8:0/2605355867 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1e000bc50 con 0x562fe2caaec0 2023-10-06T23:24:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.885+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/2605355867 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e009a8e0 con 0x562fe2caaec0 2023-10-06T23:24:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.885+0000 7fe209d15b80 10 client.26590 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.885+0000 7fe209d15b80 1 -- 172.21.15.8:0/2605355867 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7fe1e4009cb0 con 0x562fe2caaec0 2023-10-06T23:24:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/2605355867 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1e000bc50 con 0x562fe2caaec0 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/2605355867 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe1e00b92c0 con 0x562fe2caaec0 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe209d15b80 10 client.26590 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe209d15b80 10 client.26590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe209d15b80 20 client.26590 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe209d15b80 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562fe2d14e80 0x562fe2d172a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe209d15b80 4 client.26590 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe209d15b80 1 -- 172.21.15.8:0/2605355867 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562fe2bf6ad0 con 0x562fe2d14e80 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.886+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562fe2d14e80 0x562fe2d172a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.887+0000 7fe1ef7fe700 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562fe2d14e80 0x562fe2d172a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aad8ea1de283c31c server_cookie=7bdc9ca331eeb90f in_seq=0 out_seq=0 2023-10-06T23:24:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.887+0000 7fe1cf7fe700 10 client.26590 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:26.905 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe1cf7fe700 1 -- 172.21.15.8:0/2605355867 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562fe2bf6ad0 con 0x562fe2d14e80 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe1cf7fe700 10 client.26590 handle_command_reply: tid=0 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 client.26590 shutdown 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 -- 172.21.15.8:0/2605355867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 msgr2=0x562fe2cb9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb9d60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0099740 tx=0x7fe1e00999a0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 -- 172.21.15.8:0/2605355867 shutdown_connections 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562fe2d14e80 0x562fe2d172a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562fe2cac990 0x562fe2cbb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe1cf7fe700 0 client.26590 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562fe2caaec0 0x562fe2cb9d60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 --2- 172.21.15.8:0/2605355867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562fe2cabfd0 0x562fe2cba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 -- 172.21.15.8:0/2605355867 >> 172.21.15.8:0/2605355867 conn(0x562fe2c1f200 msgr2=0x562fe2cb4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 -- 172.21.15.8:0/2605355867 shutdown_connections 2023-10-06T23:24:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.904+0000 7fe209d15b80 1 -- 172.21.15.8:0/2605355867 wait complete. 2023-10-06T23:24:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.905+0000 7fe209d15b80 20 client.26590 trim_cache size 0 max 16384 2023-10-06T23:24:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:24:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:24:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:24:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:24:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1d80a1500 msgr2=0x7fe1d80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1d80a1500 0x7fe1d80a39c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009ec0 tx=0x7fe1e80092f0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2646966527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f0075870 msgr2=0x7fe1f019d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f0075870 0x7fe1f019d210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00098e0 tx=0x7fe1e0004730 comp rx=0 tx=0).stop 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2646966527 shutdown_connections 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1d80a1500 0x7fe1d80a39c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1f0077470 0x7fe1f019e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1f0075870 0x7fe1f019d210 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 --2- 172.21.15.8:0/2646966527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1f0076ab0 0x7fe1f019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2646966527 >> 172.21.15.8:0/2646966527 conn(0x7fe1f00fe6a0 msgr2=0x7fe1f0100430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2646966527 shutdown_connections 2023-10-06T23:24:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:26.906+0000 7fe1f63ff700 1 -- 172.21.15.8:0/2646966527 wait complete. 2023-10-06T23:24:27.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:26 smithi156 ceph-mon[102862]: pgmap v698: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-10-06T23:24:27.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:26 smithi008 ceph-mon[98532]: pgmap v698: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-10-06T23:24:27.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:26 smithi190 ceph-mon[102658]: pgmap v698: 97 pgs: 97 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-10-06T23:24:28.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:28 smithi156 ceph-mon[102862]: pgmap v699: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 3.7 MiB/s wr, 476 op/s 2023-10-06T23:24:28.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:28 smithi008 ceph-mon[98532]: pgmap v699: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 3.7 MiB/s wr, 476 op/s 2023-10-06T23:24:28.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:28 smithi190 ceph-mon[102658]: pgmap v699: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 3.7 MiB/s wr, 476 op/s 2023-10-06T23:24:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 575.0 s, 247.0 tps, lat 407.467 ms stddev 107.156 2023-10-06T23:24:31.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:30 smithi156 ceph-mon[102862]: pgmap v700: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.4 MiB/s wr, 550 op/s 2023-10-06T23:24:31.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:30 smithi008 ceph-mon[98532]: pgmap v700: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.4 MiB/s wr, 550 op/s 2023-10-06T23:24:31.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:30 smithi190 ceph-mon[102658]: pgmap v700: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 4.4 MiB/s wr, 550 op/s 2023-10-06T23:24:33.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:32 smithi156 ceph-mon[102862]: pgmap v701: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.1 MiB/s wr, 552 op/s 2023-10-06T23:24:33.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:32 smithi008 ceph-mon[98532]: pgmap v701: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.1 MiB/s wr, 552 op/s 2023-10-06T23:24:33.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:32 smithi190 ceph-mon[102658]: pgmap v701: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.1 MiB/s wr, 552 op/s 2023-10-06T23:24:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 580.0 s, 251.6 tps, lat 398.815 ms stddev 118.001 2023-10-06T23:24:35.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:34 smithi156 ceph-mon[102862]: pgmap v702: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 5.2 MiB/s wr, 559 op/s 2023-10-06T23:24:35.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:34 smithi008 ceph-mon[98532]: pgmap v702: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 5.2 MiB/s wr, 559 op/s 2023-10-06T23:24:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:34 smithi190 ceph-mon[102658]: pgmap v702: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 5.2 MiB/s wr, 559 op/s 2023-10-06T23:24:37.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:36 smithi156 ceph-mon[102862]: pgmap v703: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2023-10-06T23:24:37.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:36 smithi008 ceph-mon[98532]: pgmap v703: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2023-10-06T23:24:37.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:36 smithi190 ceph-mon[102658]: pgmap v703: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2023-10-06T23:24:38.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:38 smithi156 ceph-mon[102862]: pgmap v704: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 5.9 MiB/s wr, 570 op/s 2023-10-06T23:24:38.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:38 smithi008 ceph-mon[98532]: pgmap v704: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 5.9 MiB/s wr, 570 op/s 2023-10-06T23:24:38.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:38 smithi190 ceph-mon[102658]: pgmap v704: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 5.9 MiB/s wr, 570 op/s 2023-10-06T23:24:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 585.0 s, 245.2 tps, lat 406.003 ms stddev 111.547 2023-10-06T23:24:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 -- 172.21.15.8:0/1205613436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24f4108de0 msgr2=0x7f24f410b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/1205613436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24f4108de0 0x7f24f410b270 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009f90 tx=0x7f24ec00b330 comp rx=0 tx=0).stop 2023-10-06T23:24:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 -- 172.21.15.8:0/1205613436 shutdown_connections 2023-10-06T23:24:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/1205613436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24f4108de0 0x7f24f410b270 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/1205613436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f4074e70 0x7f24f40732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/1205613436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4073890 0x7f24f4073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 -- 172.21.15.8:0/1205613436 >> 172.21.15.8:0/1205613436 conn(0x7f24f40fc420 msgr2=0x7f24f40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 -- 172.21.15.8:0/1205613436 shutdown_connections 2023-10-06T23:24:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.126+0000 7f24fc3ff700 1 -- 172.21.15.8:0/1205613436 wait complete. 2023-10-06T23:24:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.127+0000 7f24fc3ff700 1 Processor -- start 2023-10-06T23:24:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fc3ff700 1 -- start start 2023-10-06T23:24:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fc3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4073890 0x7f24f4198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fc3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24f4074e70 0x7f24f4199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fc3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f4108de0 0x7f24f419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fc3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f419a8f0 con 0x7f24f4074e70 2023-10-06T23:24:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fc3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f419aa60 con 0x7f24f4073890 2023-10-06T23:24:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fc3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f419ac20 con 0x7f24f4108de0 2023-10-06T23:24:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fa19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4073890 0x7f24f4198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fa99c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f4108de0 0x7f24f419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fa19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4073890 0x7f24f4198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:56086/0 (socket says 172.21.15.8:56086) 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24fa19b700 1 -- 172.21.15.8:0/3091909440 learned_addr learned my addr 172.21.15.8:0/3091909440 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.128+0000 7f24f999a700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24f4074e70 0x7f24f4199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.129+0000 7f24fa99c700 1 -- 172.21.15.8:0/3091909440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4073890 msgr2=0x7f24f4198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.129+0000 7f24fa99c700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4073890 0x7f24f4198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.129+0000 7f24fa99c700 1 -- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24f4074e70 msgr2=0x7f24f4199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.129+0000 7f24fa99c700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24f4074e70 0x7f24f4199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.129+0000 7f24fa99c700 1 -- 172.21.15.8:0/3091909440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec009c40 con 0x7f24f4108de0 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.129+0000 7f24fa99c700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f4108de0 0x7f24f419a290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b6c0 tx=0x7f24ec008c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.129+0000 7f24eb7fe700 1 -- 172.21.15.8:0/3091909440 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00e040 con 0x7f24f4108de0 2023-10-06T23:24:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.129+0000 7f24fc3ff700 1 -- 172.21.15.8:0/3091909440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f419aea0 con 0x7f24f4108de0 2023-10-06T23:24:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.130+0000 7f24eb7fe700 1 -- 172.21.15.8:0/3091909440 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24ec008f00 con 0x7f24f4108de0 2023-10-06T23:24:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.130+0000 7f24eb7fe700 1 -- 172.21.15.8:0/3091909440 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec01b460 con 0x7f24f4108de0 2023-10-06T23:24:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.130+0000 7f24fc3ff700 1 -- 172.21.15.8:0/3091909440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f41a16c0 con 0x7f24f4108de0 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.133+0000 7f24eb7fe700 1 -- 172.21.15.8:0/3091909440 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f24ec01d470 con 0x7f24f4108de0 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.135+0000 7f250fd1bb80 1 Processor -- start 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.135+0000 7f250fd1bb80 1 -- start start 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.135+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.135+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab08fd0 0x55666ab09450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.135+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab10220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.135+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666aa70400 con 0x55666ab08fd0 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.135+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666aa61bc0 con 0x55666ab09990 2023-10-06T23:24:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.135+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666aa5f4e0 con 0x55666ab07ec0 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59176/0 (socket says 172.21.15.8:59176) 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 -- 172.21.15.8:0/1689772442 learned_addr learned my addr 172.21.15.8:0/1689772442 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab10220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24fa19b700 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab08fd0 0x55666ab09450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24eb7fe700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f24e00a14d0 0x7f24e00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 -- 172.21.15.8:0/1689772442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 msgr2=0x55666ab10220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab10220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 -- 172.21.15.8:0/1689772442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab08fd0 msgr2=0x55666ab09450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab08fd0 0x55666ab09450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 -- 172.21.15.8:0/1689772442 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a885d80 con 0x55666ab07ec0 2023-10-06T23:24:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24eb7fe700 1 -- 172.21.15.8:0/3091909440 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f24ec0cdc30 con 0x7f24f4108de0 2023-10-06T23:24:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24fa99c700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f24e00a14d0 0x7f24e00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.136+0000 7f24f999a700 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab082e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f24e40118e0 tx=0x7f24e4009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b441520587e6c93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.137+0000 7f24e8bfe700 1 -- 172.21.15.8:0/1689772442 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4004030 con 0x55666ab07ec0 2023-10-06T23:24:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.137+0000 7f24e8bfe700 1 -- 172.21.15.8:0/1689772442 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24e4004830 con 0x55666ab07ec0 2023-10-06T23:24:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.137+0000 7f24e8bfe700 1 -- 172.21.15.8:0/1689772442 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4005280 con 0x55666ab07ec0 2023-10-06T23:24:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1689772442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 msgr2=0x55666ab082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f24fa99c700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f24e00a14d0 0x7f24e00a3990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0a2d60 tx=0x7f24ec009920 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab082e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f24e40118e0 tx=0x7f24e4009880 comp rx=0 tx=0).stop 2023-10-06T23:24:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1689772442 shutdown_connections 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab10220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab082e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1689772442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab08fd0 0x55666ab09450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1689772442 >> 172.21.15.8:0/1689772442 conn(0x55666aa7c200 msgr2=0x55666ab02bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1689772442 shutdown_connections 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.138+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1689772442 wait complete. 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.139+0000 7f250fd1bb80 1 -- start start 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.139+0000 7f250fd1bb80 1 Processor -- start 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab1a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab08fd0 0x55666ab1a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab09990 0x55666ab218f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666aa5add0 con 0x55666ab09990 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a9f76b0 con 0x55666ab08fd0 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a9f7350 con 0x55666ab07ec0 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f250fd1bb80 10 client.0 _ll_register_callbacks cb 0x55666a8547a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f24f999a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab1a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f24fa19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab08fd0 0x55666ab1a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f24fa19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab08fd0 0x55666ab1a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:56116/0 (socket says 172.21.15.8:56116) 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f24fa19b700 1 -- 172.21.15.8:0/4118111020 learned_addr learned my addr 172.21.15.8:0/4118111020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.140+0000 7f24f999a700 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab09990 0x55666ab218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.141+0000 7f24fa19b700 1 -- 172.21.15.8:0/4118111020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 msgr2=0x55666ab1a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.141+0000 7f24fa19b700 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab1a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.141+0000 7f24fa19b700 1 -- 172.21.15.8:0/4118111020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab09990 msgr2=0x55666ab218f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.141+0000 7f24fa19b700 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab09990 0x55666ab218f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.141+0000 7f24fa19b700 1 -- 172.21.15.8:0/4118111020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e4019040 con 0x55666ab08fd0 2023-10-06T23:24:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.141+0000 7f24fa19b700 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab08fd0 0x55666ab1a8b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24f0012810 tx=0x7f24f0012b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd39ef75d84b6966 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.141+0000 7f24ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.142+0000 7f24ddffb700 1 -- 172.21.15.8:0/4118111020 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0017070 con 0x55666ab08fd0 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.142+0000 7f24ddffb700 1 -- 172.21.15.8:0/4118111020 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f24f000f4e0 con 0x55666ab08fd0 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.142+0000 7f250fd1bb80 1 -- 172.21.15.8:0/4118111020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55666aafad50 con 0x55666ab08fd0 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.142+0000 7f24ddffb700 1 -- 172.21.15.8:0/4118111020 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f00122e0 con 0x55666ab08fd0 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.142+0000 7f250fd1bb80 10 client.26585 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.142+0000 7f250fd1bb80 1 -- 172.21.15.8:0/4118111020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55666a86ec00 con 0x55666ab08fd0 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.143+0000 7f24ddffb700 1 -- 172.21.15.8:0/4118111020 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55666aafad50 con 0x55666ab08fd0 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.143+0000 7f24ddffb700 1 -- 172.21.15.8:0/4118111020 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f24f0010800 con 0x55666ab08fd0 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.143+0000 7f250fd1bb80 10 client.26585 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.143+0000 7f250fd1bb80 10 client.26585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.143+0000 7f250fd1bb80 20 client.26585 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.143+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55666ab26250 0x55666ab28670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.143+0000 7f250fd1bb80 4 client.26585 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:24:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.143+0000 7f250fd1bb80 1 -- 172.21.15.8:0/4118111020 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55666aa53db0 con 0x55666ab26250 2023-10-06T23:24:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.144+0000 7f24f999a700 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55666ab26250 0x55666ab28670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.144+0000 7f24f999a700 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55666ab26250 0x55666ab28670 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe31fad30debc14 server_cookie=5a19f83cd58a5ba7 in_seq=0 out_seq=0 2023-10-06T23:24:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.144+0000 7f24ddffb700 10 client.26585 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.145+0000 7f24ddffb700 1 -- 172.21.15.8:0/4118111020 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55666aa53db0 con 0x55666ab26250 2023-10-06T23:24:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.145+0000 7f24ddffb700 10 client.26585 handle_command_reply: tid=0 2023-10-06T23:24:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.145+0000 7f250fd1bb80 1 client.26585 shutdown 2023-10-06T23:24:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 -- 172.21.15.8:0/4118111020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab08fd0 msgr2=0x55666ab1a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab08fd0 0x55666ab1a8b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24f0012810 tx=0x7f24f0012b20 comp rx=0 tx=0).stop 2023-10-06T23:24:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 -- 172.21.15.8:0/4118111020 shutdown_connections 2023-10-06T23:24:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55666ab26250 0x55666ab28670 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab09990 0x55666ab218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab07ec0 0x55666ab1a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/4118111020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab08fd0 0x55666ab1a8b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 -- 172.21.15.8:0/4118111020 >> 172.21.15.8:0/4118111020 conn(0x55666aa7c200 msgr2=0x55666ab02250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f24ddffb700 0 client.26585 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 -- 172.21.15.8:0/4118111020 shutdown_connections 2023-10-06T23:24:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 1 -- 172.21.15.8:0/4118111020 wait complete. 2023-10-06T23:24:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.146+0000 7f250fd1bb80 20 client.26585 trim_cache size 0 max 16384 2023-10-06T23:24:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.170+0000 7f250fd1bb80 1 Processor -- start 2023-10-06T23:24:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.170+0000 7f250fd1bb80 1 -- start start 2023-10-06T23:24:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab28260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab21810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab0fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a8db8c0 con 0x55666ab07ec0 2023-10-06T23:24:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666ab21d50 con 0x55666ab09990 2023-10-06T23:24:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666ab038b0 con 0x55666ab08fd0 2023-10-06T23:24:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f24f999a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab28260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f24f999a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab28260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53072/0 (socket says 172.21.15.8:53072) 2023-10-06T23:24:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f24f999a700 1 -- 172.21.15.8:0/1697281697 learned_addr learned my addr 172.21.15.8:0/1697281697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f24fa19b700 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab21810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.171+0000 7f24f999a700 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab0fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.172+0000 7f24f999a700 1 -- 172.21.15.8:0/1697281697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 msgr2=0x55666ab21810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.172+0000 7f24f999a700 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab21810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.172+0000 7f24f999a700 1 -- 172.21.15.8:0/1697281697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 msgr2=0x55666ab0fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.172+0000 7f24f999a700 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab0fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.172+0000 7f24f999a700 1 -- 172.21.15.8:0/1697281697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a8ac1f0 con 0x55666ab07ec0 2023-10-06T23:24:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.172+0000 7f24f999a700 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab28260 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f24e4005950 tx=0x7f24e40058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6322cb9d767ea70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.173+0000 7f24e93ff700 1 -- 172.21.15.8:0/1697281697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4032580 con 0x55666ab07ec0 2023-10-06T23:24:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.173+0000 7f24e93ff700 1 -- 172.21.15.8:0/1697281697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24e4005500 con 0x55666ab07ec0 2023-10-06T23:24:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.173+0000 7f24e93ff700 1 -- 172.21.15.8:0/1697281697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e401f440 con 0x55666ab07ec0 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.173+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1697281697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 msgr2=0x55666ab28260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.173+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab28260 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f24e4005950 tx=0x7f24e40058e0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.174+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1697281697 shutdown_connections 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.174+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab28260 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.174+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab0fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.174+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1697281697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab21810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.174+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1697281697 >> 172.21.15.8:0/1697281697 conn(0x55666aa7c200 msgr2=0x55666ab10860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.174+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1697281697 shutdown_connections 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.174+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1697281697 wait complete. 2023-10-06T23:24:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.175+0000 7f250fd1bb80 1 -- start start 2023-10-06T23:24:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.175+0000 7f250fd1bb80 1 Processor -- start 2023-10-06T23:24:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab1ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab1f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f250fd1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab203d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666ab20910 con 0x55666ab07ec0 2023-10-06T23:24:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666ab20a80 con 0x55666ab09990 2023-10-06T23:24:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f250fd1bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666ab20c40 con 0x55666ab08fd0 2023-10-06T23:24:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f250fd1bb80 10 client.0 _ll_register_callbacks cb 0x7f24f0009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f24fa19b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab1f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f24fa19b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab1f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:59198/0 (socket says 172.21.15.8:59198) 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f24fa19b700 1 -- 172.21.15.8:0/1587830409 learned_addr learned my addr 172.21.15.8:0/1587830409 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.176+0000 7f24f999a700 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24f999a700 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab1ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24fa19b700 1 -- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 msgr2=0x55666ab203d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24fa19b700 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab203d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24fa19b700 1 -- 172.21.15.8:0/1587830409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 msgr2=0x55666ab1ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24fa19b700 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab1ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24fa19b700 1 -- 172.21.15.8:0/1587830409 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55666a885d80 con 0x55666ab08fd0 2023-10-06T23:24:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24f999a700 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab203d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24fa19b700 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab1f3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009f80 tx=0x7f24f0010aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7a435a29cec7208 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.177+0000 7f24ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.178+0000 7f24ddffb700 1 -- 172.21.15.8:0/1587830409 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0017040 con 0x55666ab08fd0 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.178+0000 7f24ddffb700 1 -- 172.21.15.8:0/1587830409 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f24f00052e0 con 0x55666ab08fd0 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.178+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1587830409 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24e4004830 con 0x55666ab08fd0 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.178+0000 7f24ddffb700 1 -- 172.21.15.8:0/1587830409 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f00054a0 con 0x55666ab08fd0 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.178+0000 7f250fd1bb80 10 client.26608 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.178+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1587830409 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55666a884250 con 0x55666ab08fd0 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f24ddffb700 1 -- 172.21.15.8:0/1587830409 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24e4004830 con 0x55666ab08fd0 2023-10-06T23:24:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f24ddffb700 1 -- 172.21.15.8:0/1587830409 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f24f000f4e0 con 0x55666ab08fd0 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f250fd1bb80 10 client.26608 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f250fd1bb80 10 client.26608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f250fd1bb80 20 client.26608 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55666ab7a870 0x55666ab7cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f250fd1bb80 4 client.26608 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1587830409 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55666aa53ad0 con 0x55666ab7a870 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.179+0000 7f24f999a700 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55666ab7a870 0x55666ab7cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.180+0000 7f24f999a700 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55666ab7a870 0x55666ab7cc90 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad840210353987cc server_cookie=514885af9b6422b in_seq=0 out_seq=0 2023-10-06T23:24:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.180+0000 7f24ddffb700 10 client.26608 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.197+0000 7f24ddffb700 1 -- 172.21.15.8:0/1587830409 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55666aa53ad0 con 0x55666ab7a870 2023-10-06T23:24:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.197+0000 7f24ddffb700 10 client.26608 handle_command_reply: tid=0 2023-10-06T23:24:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.197+0000 7f250fd1bb80 1 client.26608 shutdown 2023-10-06T23:24:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.197+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1587830409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 msgr2=0x55666ab1f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.197+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab1f3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009f80 tx=0x7f24f0010aa0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1587830409 shutdown_connections 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55666ab7a870 0x55666ab7cc90 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55666ab07ec0 0x55666ab1ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f24ddffb700 0 client.26608 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55666ab09990 0x55666ab203d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 1 --2- 172.21.15.8:0/1587830409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55666ab08fd0 0x55666ab1f3c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1587830409 >> 172.21.15.8:0/1587830409 conn(0x55666aa7c200 msgr2=0x55666ab28260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1587830409 shutdown_connections 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 1 -- 172.21.15.8:0/1587830409 wait complete. 2023-10-06T23:24:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.198+0000 7f250fd1bb80 20 client.26608 trim_cache size 0 max 16384 2023-10-06T23:24:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:24:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:24:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:24:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 -- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f24e00a14d0 msgr2=0x7f24e00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f24e00a14d0 0x7f24e00a3990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0a2d60 tx=0x7f24ec009920 comp rx=0 tx=0).stop 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 -- 172.21.15.8:0/3091909440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f4108de0 msgr2=0x7f24f419a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f4108de0 0x7f24f419a290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b6c0 tx=0x7f24ec008c80 comp rx=0 tx=0).stop 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 -- 172.21.15.8:0/3091909440 shutdown_connections 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f24e00a14d0 0x7f24e00a3990 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24f4108de0 0x7f24f419a290 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24f4073890 0x7f24f4198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 --2- 172.21.15.8:0/3091909440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24f4074e70 0x7f24f4199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.199+0000 7f24fc3ff700 1 -- 172.21.15.8:0/3091909440 >> 172.21.15.8:0/3091909440 conn(0x7f24f40fc420 msgr2=0x7f24f40fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.200+0000 7f24fc3ff700 1 -- 172.21.15.8:0/3091909440 shutdown_connections 2023-10-06T23:24:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:40.200+0000 7f24fc3ff700 1 -- 172.21.15.8:0/3091909440 wait complete. 2023-10-06T23:24:41.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:40 smithi156 ceph-mon[102862]: pgmap v705: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 6.0 MiB/s wr, 602 op/s 2023-10-06T23:24:41.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:40 smithi008 ceph-mon[98532]: pgmap v705: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 6.0 MiB/s wr, 602 op/s 2023-10-06T23:24:41.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:40 smithi190 ceph-mon[102658]: pgmap v705: 97 pgs: 97 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 6.0 MiB/s wr, 602 op/s 2023-10-06T23:24:43.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:42 smithi156 ceph-mon[102862]: pgmap v706: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 6.6 MiB/s wr, 604 op/s 2023-10-06T23:24:43.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:42 smithi008 ceph-mon[98532]: pgmap v706: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 6.6 MiB/s wr, 604 op/s 2023-10-06T23:24:43.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:42 smithi190 ceph-mon[102658]: pgmap v706: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 6.6 MiB/s wr, 604 op/s 2023-10-06T23:24:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 590.0 s, 295.2 tps, lat 339.216 ms stddev 50.572 2023-10-06T23:24:45.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:44 smithi156 ceph-mon[102862]: pgmap v707: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 5.5 MiB/s wr, 550 op/s 2023-10-06T23:24:45.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:44 smithi008 ceph-mon[98532]: pgmap v707: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 5.5 MiB/s wr, 550 op/s 2023-10-06T23:24:45.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:44 smithi190 ceph-mon[102658]: pgmap v707: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 5.5 MiB/s wr, 550 op/s 2023-10-06T23:24:47.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:46 smithi156 ceph-mon[102862]: pgmap v708: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.5 MiB/s wr, 558 op/s 2023-10-06T23:24:47.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:46 smithi008 ceph-mon[98532]: pgmap v708: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.5 MiB/s wr, 558 op/s 2023-10-06T23:24:47.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:46 smithi190 ceph-mon[102658]: pgmap v708: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.5 MiB/s wr, 558 op/s 2023-10-06T23:24:48.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:48 smithi156 ceph-mon[102862]: pgmap v709: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 7.5 MiB/s wr, 656 op/s 2023-10-06T23:24:48.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:48 smithi008 ceph-mon[98532]: pgmap v709: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 7.5 MiB/s wr, 656 op/s 2023-10-06T23:24:48.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:48 smithi190 ceph-mon[102658]: pgmap v709: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 7.5 MiB/s wr, 656 op/s 2023-10-06T23:24:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 595.0 s, 288.4 tps, lat 345.171 ms stddev 52.802 2023-10-06T23:24:50.620 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:24:50.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 -- 172.21.15.8:0/1274538530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c1090a0 msgr2=0x7f092c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:50.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 --2- 172.21.15.8:0/1274538530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c1090a0 0x7f092c10f950 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0924009920 tx=0x7f0924009c30 comp rx=0 tx=0).stop 2023-10-06T23:24:50.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 -- 172.21.15.8:0/1274538530 shutdown_connections 2023-10-06T23:24:50.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 --2- 172.21.15.8:0/1274538530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c1090a0 0x7f092c10f950 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 --2- 172.21.15.8:0/1274538530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f092c107510 0x7f092c107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 --2- 172.21.15.8:0/1274538530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f092c108700 0x7f092c108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 -- 172.21.15.8:0/1274538530 >> 172.21.15.8:0/1274538530 conn(0x7f092c076490 msgr2=0x7f092c0788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:50.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 -- 172.21.15.8:0/1274538530 shutdown_connections 2023-10-06T23:24:50.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.927+0000 7f0931fff700 1 -- 172.21.15.8:0/1274538530 wait complete. 2023-10-06T23:24:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.929+0000 7f0931fff700 1 Processor -- start 2023-10-06T23:24:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.929+0000 7f0931fff700 1 -- start start 2023-10-06T23:24:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.929+0000 7f0931fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f092c107510 0x7f092c19d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.929+0000 7f0931fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c108700 0x7f092c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.929+0000 7f0931fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f092c1090a0 0x7f092c1a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.929+0000 7f0931fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1a4d30 con 0x7f092c108700 2023-10-06T23:24:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.929+0000 7f0931fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1a4e70 con 0x7f092c107510 2023-10-06T23:24:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f0931fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1a5000 con 0x7f092c1090a0 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f092c107510 0x7f092c19d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f092c107510 0x7f092c19d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49680/0 (socket says 172.21.15.8:49680) 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092b7fe700 1 -- 172.21.15.8:0/2216545683 learned_addr learned my addr 172.21.15.8:0/2216545683 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092bfff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f092c1090a0 0x7f092c1a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092affd700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c108700 0x7f092c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092b7fe700 1 -- 172.21.15.8:0/2216545683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f092c1090a0 msgr2=0x7f092c1a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092b7fe700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f092c1090a0 0x7f092c1a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092b7fe700 1 -- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c108700 msgr2=0x7f092c19d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092b7fe700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c108700 0x7f092c19d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092b7fe700 1 -- 172.21.15.8:0/2216545683 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c009c40 con 0x7f092c107510 2023-10-06T23:24:50.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.930+0000 7f092affd700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c108700 0x7f092c19d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:24:50.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.931+0000 7f092b7fe700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f092c107510 0x7f092c19d1b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c140 tx=0x7f091c00c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:50.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.931+0000 7f0928ff9700 1 -- 172.21.15.8:0/2216545683 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00e050 con 0x7f092c107510 2023-10-06T23:24:50.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.931+0000 7f0928ff9700 1 -- 172.21.15.8:0/2216545683 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f091c00f040 con 0x7f092c107510 2023-10-06T23:24:50.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.931+0000 7f0928ff9700 1 -- 172.21.15.8:0/2216545683 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c013400 con 0x7f092c107510 2023-10-06T23:24:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.931+0000 7f0931fff700 1 -- 172.21.15.8:0/2216545683 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09200095f0 con 0x7f092c107510 2023-10-06T23:24:50.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.931+0000 7f0931fff700 1 -- 172.21.15.8:0/2216545683 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0924009520 con 0x7f092c107510 2023-10-06T23:24:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.936+0000 7f0928ff9700 1 -- 172.21.15.8:0/2216545683 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f091c007500 con 0x7f092c107510 2023-10-06T23:24:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.939+0000 7f09459d6b80 1 Processor -- start 2023-10-06T23:24:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.939+0000 7f0928ff9700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f09140a1500 0x7f09140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.939+0000 7f09459d6b80 1 -- start start 2023-10-06T23:24:50.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.939+0000 7f0928ff9700 1 -- 172.21.15.8:0/2216545683 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f091c0ccbd0 con 0x7f092c107510 2023-10-06T23:24:50.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.939+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90f260 0x558c2a90f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90fbc0 0x558c2a910480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 0x558c2a910ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f09459d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a877460 con 0x558c2a910a60 2023-10-06T23:24:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f09459d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a868c20 con 0x558c2a90f260 2023-10-06T23:24:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f09459d6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a866540 con 0x558c2a90fbc0 2023-10-06T23:24:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f092bfff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f09140a1500 0x7f09140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f092b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90f260 0x558c2a90f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f092affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90fbc0 0x558c2a910480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f092b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90f260 0x558c2a90f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49686/0 (socket says 172.21.15.8:49686) 2023-10-06T23:24:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.940+0000 7f092b7fe700 1 -- 172.21.15.8:0/3755025350 learned_addr learned my addr 172.21.15.8:0/3755025350 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f092b7fe700 1 -- 172.21.15.8:0/3755025350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90fbc0 msgr2=0x558c2a910480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f092b7fe700 1 --2- 172.21.15.8:0/3755025350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90fbc0 0x558c2a910480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f092b7fe700 1 -- 172.21.15.8:0/3755025350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 msgr2=0x558c2a910ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f092b7fe700 1 --2- 172.21.15.8:0/3755025350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 0x558c2a910ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f092b7fe700 1 -- 172.21.15.8:0/3755025350 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c2a68cde0 con 0x558c2a90f260 2023-10-06T23:24:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f092b7fe700 1 --2- 172.21.15.8:0/3755025350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90f260 0x558c2a90f680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f091c099e30 tx=0x7f091c099ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0cc5b680ddb5631 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f092bfff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f09140a1500 0x7f09140a39c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f09240098f0 tx=0x7f0924019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f0911ffb700 1 -- 172.21.15.8:0/3755025350 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c09a5a0 con 0x558c2a90f260 2023-10-06T23:24:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f0911ffb700 1 -- 172.21.15.8:0/3755025350 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f091c099ea0 con 0x558c2a90f260 2023-10-06T23:24:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.941+0000 7f0911ffb700 1 -- 172.21.15.8:0/3755025350 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c09a360 con 0x558c2a90f260 2023-10-06T23:24:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.942+0000 7f09459d6b80 1 -- 172.21.15.8:0/3755025350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90f260 msgr2=0x558c2a90f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.942+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3755025350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90f260 0x558c2a90f680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f091c099e30 tx=0x7f091c099ab0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.943+0000 7f09459d6b80 1 -- 172.21.15.8:0/3755025350 shutdown_connections 2023-10-06T23:24:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.943+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3755025350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 0x558c2a910ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.943+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3755025350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90f260 0x558c2a90f680 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.943+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3755025350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90fbc0 0x558c2a910480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.943+0000 7f09459d6b80 1 -- 172.21.15.8:0/3755025350 >> 172.21.15.8:0/3755025350 conn(0x558c2a883260 msgr2=0x558c2a90a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.943+0000 7f09459d6b80 1 -- 172.21.15.8:0/3755025350 shutdown_connections 2023-10-06T23:24:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.943+0000 7f09459d6b80 1 -- 172.21.15.8:0/3755025350 wait complete. 2023-10-06T23:24:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.943+0000 7f09459d6b80 1 -- start start 2023-10-06T23:24:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.944+0000 7f09459d6b80 1 Processor -- start 2023-10-06T23:24:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.944+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a919020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.944+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a919560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.944+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 0x558c2a9205a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.944+0000 7f09459d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a861e30 con 0x558c2a910a60 2023-10-06T23:24:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.944+0000 7f09459d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a7fe710 con 0x558c2a90fbc0 2023-10-06T23:24:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.944+0000 7f09459d6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a7fe3b0 con 0x558c2a90f260 2023-10-06T23:24:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.945+0000 7f09459d6b80 10 client.0 _ll_register_callbacks cb 0x558c2a65b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.945+0000 7f092affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a919560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.945+0000 7f092affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a919560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49702/0 (socket says 172.21.15.8:49702) 2023-10-06T23:24:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.945+0000 7f092affd700 1 -- 172.21.15.8:0/2893910874 learned_addr learned my addr 172.21.15.8:0/2893910874 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.945+0000 7f092b7fe700 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a919020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.945+0000 7f092bfff700 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 0x558c2a9205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f092affd700 1 -- 172.21.15.8:0/2893910874 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 msgr2=0x558c2a919020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f092affd700 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a919020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f092affd700 1 -- 172.21.15.8:0/2893910874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 msgr2=0x558c2a9205a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f092affd700 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 0x558c2a9205a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f092affd700 1 -- 172.21.15.8:0/2893910874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0924009520 con 0x558c2a90fbc0 2023-10-06T23:24:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f092affd700 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a919560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0920013990 tx=0x7f0920013ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2aed2817c44d897 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f090affd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:24:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f090affd700 1 -- 172.21.15.8:0/2893910874 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920011ce0 con 0x558c2a90fbc0 2023-10-06T23:24:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.946+0000 7f090affd700 1 -- 172.21.15.8:0/2893910874 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0920011e40 con 0x558c2a90fbc0 2023-10-06T23:24:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.947+0000 7f09459d6b80 1 -- 172.21.15.8:0/2893910874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c2a901f10 con 0x558c2a90fbc0 2023-10-06T23:24:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.947+0000 7f090affd700 1 -- 172.21.15.8:0/2893910874 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f092001c440 con 0x558c2a90fbc0 2023-10-06T23:24:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.947+0000 7f09459d6b80 10 client.26603 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.947+0000 7f09459d6b80 1 -- 172.21.15.8:0/2893910874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558c2a675c60 con 0x558c2a90fbc0 2023-10-06T23:24:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.947+0000 7f090affd700 1 -- 172.21.15.8:0/2893910874 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c2a901f10 con 0x558c2a90fbc0 2023-10-06T23:24:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.947+0000 7f090affd700 1 -- 172.21.15.8:0/2893910874 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09200266b0 con 0x558c2a90fbc0 2023-10-06T23:24:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.948+0000 7f09459d6b80 10 client.26603 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.948+0000 7f09459d6b80 10 client.26603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.948+0000 7f09459d6b80 20 client.26603 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.948+0000 7f09459d6b80 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c2a924ea0 0x558c2a9272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.948+0000 7f09459d6b80 4 client.26603 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:24:50.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.948+0000 7f09459d6b80 1 -- 172.21.15.8:0/2893910874 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c2a85ae10 con 0x558c2a924ea0 2023-10-06T23:24:50.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.948+0000 7f092b7fe700 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c2a924ea0 0x558c2a9272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.949+0000 7f092b7fe700 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c2a924ea0 0x558c2a9272c0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d3eb4c9caa46283 server_cookie=a744400646804c7f in_seq=0 out_seq=0 2023-10-06T23:24:50.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.949+0000 7f090affd700 10 client.26603 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:50.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.950+0000 7f090affd700 1 -- 172.21.15.8:0/2893910874 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c2a85ae10 con 0x558c2a924ea0 2023-10-06T23:24:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.950+0000 7f090affd700 10 client.26603 handle_command_reply: tid=0 2023-10-06T23:24:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.950+0000 7f09459d6b80 1 client.26603 shutdown 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 -- 172.21.15.8:0/2893910874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 msgr2=0x558c2a919560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a919560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0920013990 tx=0x7f0920013ca0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 -- 172.21.15.8:0/2893910874 shutdown_connections 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c2a924ea0 0x558c2a9272c0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a910a60 0x558c2a9205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f090affd700 0 client.26603 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a919020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 --2- 172.21.15.8:0/2893910874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a919560 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 -- 172.21.15.8:0/2893910874 >> 172.21.15.8:0/2893910874 conn(0x558c2a883260 msgr2=0x558c2a909f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.951+0000 7f09459d6b80 1 -- 172.21.15.8:0/2893910874 shutdown_connections 2023-10-06T23:24:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.952+0000 7f09459d6b80 1 -- 172.21.15.8:0/2893910874 wait complete. 2023-10-06T23:24:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.952+0000 7f09459d6b80 20 client.26603 trim_cache size 0 max 16384 2023-10-06T23:24:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.981+0000 7f09459d6b80 1 Processor -- start 2023-10-06T23:24:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.981+0000 7f09459d6b80 1 -- start start 2023-10-06T23:24:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.981+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90f260 0x558c2a917c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.981+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a9204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.981+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a910a60 0x558c2a919020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.981+0000 7f09459d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a6e2920 con 0x558c2a90f260 2023-10-06T23:24:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.981+0000 7f09459d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a918500 con 0x558c2a90fbc0 2023-10-06T23:24:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.981+0000 7f09459d6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a922260 con 0x558c2a910a60 2023-10-06T23:24:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a9204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a9204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49706/0 (socket says 172.21.15.8:49706) 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092affd700 1 -- 172.21.15.8:0/1662164581 learned_addr learned my addr 172.21.15.8:0/1662164581 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092b7fe700 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90f260 0x558c2a917c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092bfff700 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a910a60 0x558c2a919020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092affd700 1 -- 172.21.15.8:0/1662164581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a910a60 msgr2=0x558c2a919020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092affd700 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a910a60 0x558c2a919020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092affd700 1 -- 172.21.15.8:0/1662164581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90f260 msgr2=0x558c2a917c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092affd700 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90f260 0x558c2a917c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.982+0000 7f092affd700 1 -- 172.21.15.8:0/1662164581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c2a6b3250 con 0x558c2a90fbc0 2023-10-06T23:24:50.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.983+0000 7f092affd700 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a9204c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0920026fd0 tx=0x7f0920011740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5581b4da170b3352 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.983+0000 7f09127fc700 1 -- 172.21.15.8:0/1662164581 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920011ae0 con 0x558c2a90fbc0 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.983+0000 7f09127fc700 1 -- 172.21.15.8:0/1662164581 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0920011c40 con 0x558c2a90fbc0 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.983+0000 7f09127fc700 1 -- 172.21.15.8:0/1662164581 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920005690 con 0x558c2a90fbc0 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 -- 172.21.15.8:0/1662164581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 msgr2=0x558c2a9204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a9204c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0920026fd0 tx=0x7f0920011740 comp rx=0 tx=0).stop 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 -- 172.21.15.8:0/1662164581 shutdown_connections 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90f260 0x558c2a917c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a910a60 0x558c2a919020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 --2- 172.21.15.8:0/1662164581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a90fbc0 0x558c2a9204c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 -- 172.21.15.8:0/1662164581 >> 172.21.15.8:0/1662164581 conn(0x558c2a883260 msgr2=0x558c2a92bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:50.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 -- 172.21.15.8:0/1662164581 shutdown_connections 2023-10-06T23:24:50.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.984+0000 7f09459d6b80 1 -- 172.21.15.8:0/1662164581 wait complete. 2023-10-06T23:24:50.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.985+0000 7f09459d6b80 1 -- start start 2023-10-06T23:24:50.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.985+0000 7f09459d6b80 1 Processor -- start 2023-10-06T23:24:50.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.986+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a91e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.986+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90fbc0 0x558c2a91e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.986+0000 7f09459d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a910a60 0x558c2a91f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.986+0000 7f09459d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a91fde0 con 0x558c2a90fbc0 2023-10-06T23:24:50.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.986+0000 7f09459d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a91ff50 con 0x558c2a910a60 2023-10-06T23:24:50.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.986+0000 7f09459d6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2a920110 con 0x558c2a90f260 2023-10-06T23:24:50.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.986+0000 7f09459d6b80 10 client.0 _ll_register_callbacks cb 0x558c2a65b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:50.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a910a60 0x558c2a91f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a91e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a910a60 0x558c2a91f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49718/0 (socket says 172.21.15.8:49718) 2023-10-06T23:24:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092bfff700 1 -- 172.21.15.8:0/3470448267 learned_addr learned my addr 172.21.15.8:0/3470448267 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092affd700 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90fbc0 0x558c2a91e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092b7fe700 1 -- 172.21.15.8:0/3470448267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a910a60 msgr2=0x558c2a91f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092b7fe700 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a910a60 0x558c2a91f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092b7fe700 1 -- 172.21.15.8:0/3470448267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90fbc0 msgr2=0x558c2a91e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092b7fe700 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90fbc0 0x558c2a91e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.987+0000 7f092b7fe700 1 -- 172.21.15.8:0/3470448267 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c2a675c60 con 0x558c2a90f260 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.988+0000 7f092b7fe700 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a91e350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f091c0090a0 tx=0x7f091c09a010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5482b1854e9ffe60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.988+0000 7f090affd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.988+0000 7f090affd700 1 -- 172.21.15.8:0/3470448267 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c097fe0 con 0x558c2a90f260 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.988+0000 7f09459d6b80 1 -- 172.21.15.8:0/3470448267 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f091c099ea0 con 0x558c2a90f260 2023-10-06T23:24:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.988+0000 7f090affd700 1 -- 172.21.15.8:0/3470448267 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f091c098240 con 0x558c2a90f260 2023-10-06T23:24:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.988+0000 7f090affd700 1 -- 172.21.15.8:0/3470448267 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f091c099390 con 0x558c2a90f260 2023-10-06T23:24:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.988+0000 7f09459d6b80 10 client.26626 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.988+0000 7f09459d6b80 1 -- 172.21.15.8:0/3470448267 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558c2a68b2b0 con 0x558c2a90f260 2023-10-06T23:24:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f090affd700 1 -- 172.21.15.8:0/3470448267 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f091c099ea0 con 0x558c2a90f260 2023-10-06T23:24:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f090affd700 1 -- 172.21.15.8:0/3470448267 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f091c07f050 con 0x558c2a90f260 2023-10-06T23:24:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f09459d6b80 10 client.26626 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f09459d6b80 10 client.26626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f09459d6b80 20 client.26626 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c2a924ea0 0x558c2a97b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f09459d6b80 4 client.26626 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:24:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f09459d6b80 1 -- 172.21.15.8:0/3470448267 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558c2a85ab30 con 0x558c2a924ea0 2023-10-06T23:24:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.989+0000 7f092affd700 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c2a924ea0 0x558c2a97b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.990+0000 7f092affd700 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c2a924ea0 0x558c2a97b9e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5619044bb30311 server_cookie=e96a35ee5250225b in_seq=0 out_seq=0 2023-10-06T23:24:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.990+0000 7f090affd700 10 client.26626 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f090affd700 1 -- 172.21.15.8:0/3470448267 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558c2a85ab30 con 0x558c2a924ea0 2023-10-06T23:24:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f090affd700 10 client.26626 handle_command_reply: tid=0 2023-10-06T23:24:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 client.26626 shutdown 2023-10-06T23:24:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 -- 172.21.15.8:0/3470448267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 msgr2=0x558c2a91e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a91e350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f091c0090a0 tx=0x7f091c09a010 comp rx=0 tx=0).stop 2023-10-06T23:24:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 -- 172.21.15.8:0/3470448267 shutdown_connections 2023-10-06T23:24:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x558c2a924ea0 0x558c2a97b9e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c2a910a60 0x558c2a91f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558c2a90f260 0x558c2a91e350 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 --2- 172.21.15.8:0/3470448267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c2a90fbc0 0x558c2a91e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f090affd700 0 client.26626 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.991+0000 7f09459d6b80 1 -- 172.21.15.8:0/3470448267 >> 172.21.15.8:0/3470448267 conn(0x558c2a883260 msgr2=0x558c2a916e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.992+0000 7f09459d6b80 1 -- 172.21.15.8:0/3470448267 shutdown_connections 2023-10-06T23:24:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.992+0000 7f09459d6b80 1 -- 172.21.15.8:0/3470448267 wait complete. 2023-10-06T23:24:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.992+0000 7f09459d6b80 20 client.26626 trim_cache size 0 max 16384 2023-10-06T23:24:51.000 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:24:51.000 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:24:51.001 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:24:51.001 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:24:51.001 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:24:51.001 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:24:51.001 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:24:51.001 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:24:51.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:24:51.002 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:24:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.992+0000 7f0931fff700 1 -- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f09140a1500 msgr2=0x7f09140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.992+0000 7f0931fff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f09140a1500 0x7f09140a39c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f09240098f0 tx=0x7f0924019040 comp rx=0 tx=0).stop 2023-10-06T23:24:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.992+0000 7f0931fff700 1 -- 172.21.15.8:0/2216545683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f092c107510 msgr2=0x7f092c19d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.992+0000 7f0931fff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f092c107510 0x7f092c19d1b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c140 tx=0x7f091c00c450 comp rx=0 tx=0).stop 2023-10-06T23:24:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.993+0000 7f0931fff700 1 -- 172.21.15.8:0/2216545683 shutdown_connections 2023-10-06T23:24:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.993+0000 7f0931fff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f09140a1500 0x7f09140a39c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.993+0000 7f0931fff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f092c1090a0 0x7f092c1a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.993+0000 7f0931fff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f092c107510 0x7f092c19d1b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.993+0000 7f0931fff700 1 --2- 172.21.15.8:0/2216545683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f092c108700 0x7f092c19d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.993+0000 7f0931fff700 1 -- 172.21.15.8:0/2216545683 >> 172.21.15.8:0/2216545683 conn(0x7f092c076490 msgr2=0x7f092c10bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.993+0000 7f0931fff700 1 -- 172.21.15.8:0/2216545683 shutdown_connections 2023-10-06T23:24:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:24:50.993+0000 7f0931fff700 1 -- 172.21.15.8:0/2216545683 wait complete. 2023-10-06T23:24:51.017 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:50 smithi008 ceph-mon[98532]: pgmap v710: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 6.1 MiB/s wr, 586 op/s 2023-10-06T23:24:51.021 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:24:51.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:50 smithi156 ceph-mon[102862]: pgmap v710: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 6.1 MiB/s wr, 586 op/s 2023-10-06T23:24:51.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:50 smithi190 ceph-mon[102658]: pgmap v710: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 6.1 MiB/s wr, 586 op/s 2023-10-06T23:24:53.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:52 smithi156 ceph-mon[102862]: pgmap v711: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2023-10-06T23:24:53.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:52 smithi008 ceph-mon[98532]: pgmap v711: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2023-10-06T23:24:53.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:52 smithi190 ceph-mon[102658]: pgmap v711: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 6.8 MiB/s wr, 615 op/s 2023-10-06T23:24:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.402+0000 7fa964fff700 1 -- 172.21.15.8:0/1006392149 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9600ff1b0 msgr2=0x7fa9600ff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.402+0000 7fa964fff700 1 --2- 172.21.15.8:0/1006392149 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9600ff1b0 0x7fa9600ff5d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa950009990 tx=0x7fa950009ca0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.403+0000 7fa964fff700 1 -- 172.21.15.8:0/1006392149 shutdown_connections 2023-10-06T23:24:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.403+0000 7fa964fff700 1 --2- 172.21.15.8:0/1006392149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9601008d0 0x7fa960105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.403+0000 7fa964fff700 1 --2- 172.21.15.8:0/1006392149 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9600ff1b0 0x7fa9600ff5d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.403+0000 7fa964fff700 1 --2- 172.21.15.8:0/1006392149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9600fff10 0x7fa960100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.403+0000 7fa964fff700 1 -- 172.21.15.8:0/1006392149 >> 172.21.15.8:0/1006392149 conn(0x7fa9600faac0 msgr2=0x7fa9600fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.403+0000 7fa964fff700 1 -- 172.21.15.8:0/1006392149 shutdown_connections 2023-10-06T23:24:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.403+0000 7fa964fff700 1 -- 172.21.15.8:0/1006392149 wait complete. 2023-10-06T23:24:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.405+0000 7fa964fff700 1 Processor -- start 2023-10-06T23:24:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.405+0000 7fa964fff700 1 -- start start 2023-10-06T23:24:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.405+0000 7fa964fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9600ff1b0 0x7fa96019d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa964fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9600fff10 0x7fa96019d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa964fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9601008d0 0x7fa96019e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa964fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96019ecc0 con 0x7fa9600ff1b0 2023-10-06T23:24:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa964fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96019ee30 con 0x7fa9600fff10 2023-10-06T23:24:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa964fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96019eff0 con 0x7fa9601008d0 2023-10-06T23:24:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa95ed9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9601008d0 0x7fa96019e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa95e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9600ff1b0 0x7fa96019d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa95ed9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9601008d0 0x7fa96019e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34394/0 (socket says 172.21.15.8:34394) 2023-10-06T23:24:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa95ed9d700 1 -- 172.21.15.8:0/427883947 learned_addr learned my addr 172.21.15.8:0/427883947 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.406+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9600fff10 0x7fa96019d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa95ed9d700 1 -- 172.21.15.8:0/427883947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9600fff10 msgr2=0x7fa96019d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa95ed9d700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9600fff10 0x7fa96019d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa95ed9d700 1 -- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9600ff1b0 msgr2=0x7fa96019d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa95ed9d700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9600ff1b0 0x7fa96019d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa95ed9d700 1 -- 172.21.15.8:0/427883947 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500095f0 con 0x7fa9601008d0 2023-10-06T23:24:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa95e59c700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9600ff1b0 0x7fa96019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa95ed9d700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9601008d0 0x7fa96019e660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa95800ef30 tx=0x7fa95800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa94f7fe700 1 -- 172.21.15.8:0/427883947 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958018070 con 0x7fa9601008d0 2023-10-06T23:24:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.407+0000 7fa94f7fe700 1 -- 172.21.15.8:0/427883947 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa95800f040 con 0x7fa9601008d0 2023-10-06T23:24:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.408+0000 7fa94f7fe700 1 -- 172.21.15.8:0/427883947 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95800cbc0 con 0x7fa9601008d0 2023-10-06T23:24:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.408+0000 7fa964fff700 1 -- 172.21.15.8:0/427883947 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96019f270 con 0x7fa9601008d0 2023-10-06T23:24:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.408+0000 7fa964fff700 1 -- 172.21.15.8:0/427883947 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9601a5a90 con 0x7fa9601008d0 2023-10-06T23:24:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.413+0000 7fa94f7fe700 1 -- 172.21.15.8:0/427883947 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa95800cd20 con 0x7fa9601008d0 2023-10-06T23:24:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.413+0000 7fa978845b80 1 Processor -- start 2023-10-06T23:24:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.414+0000 7fa978845b80 1 -- start start 2023-10-06T23:24:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.414+0000 7fa978845b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e0158672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.414+0000 7fa978845b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e015868450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.414+0000 7fa978845b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e01586f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.414+0000 7fa978845b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0157cf400 con 0x55e015867fd0 2023-10-06T23:24:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.414+0000 7fa978845b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0157c0bc0 con 0x55e015868990 2023-10-06T23:24:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.414+0000 7fa978845b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0157be4e0 con 0x55e015866ec0 2023-10-06T23:24:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e0158672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa94f7fe700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa9480a1500 0x7fa9480a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e0158672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34410/0 (socket says 172.21.15.8:34410) 2023-10-06T23:24:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 -- 172.21.15.8:0/1595658438 learned_addr learned my addr 172.21.15.8:0/1595658438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e01586f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa94f7fe700 1 -- 172.21.15.8:0/427883947 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa9580cc6f0 con 0x7fa9601008d0 2023-10-06T23:24:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95e59c700 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e015868450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95ed9d700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa9480a1500 0x7fa9480a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 -- 172.21.15.8:0/1595658438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 msgr2=0x55e01586f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e01586f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 -- 172.21.15.8:0/1595658438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 msgr2=0x55e015868450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e015868450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 -- 172.21.15.8:0/1595658438 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0155e4d80 con 0x55e015866ec0 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.415+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e0158672e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9540118e0 tx=0x7fa954009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d8607c6deb9d6ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.416+0000 7fa94cff9700 1 -- 172.21.15.8:0/1595658438 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954004030 con 0x55e015866ec0 2023-10-06T23:24:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.416+0000 7fa95ed9d700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa9480a1500 0x7fa9480a39c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa958095f90 tx=0x7fa958009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.416+0000 7fa94cff9700 1 -- 172.21.15.8:0/1595658438 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa954004830 con 0x55e015866ec0 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.416+0000 7fa94cff9700 1 -- 172.21.15.8:0/1595658438 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954005280 con 0x55e015866ec0 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.416+0000 7fa978845b80 1 -- 172.21.15.8:0/1595658438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 msgr2=0x55e0158672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.416+0000 7fa978845b80 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e0158672e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9540118e0 tx=0x7fa954009880 comp rx=0 tx=0).stop 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.417+0000 7fa978845b80 1 -- 172.21.15.8:0/1595658438 shutdown_connections 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.417+0000 7fa978845b80 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e01586f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.417+0000 7fa978845b80 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e0158672e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.417+0000 7fa978845b80 1 --2- 172.21.15.8:0/1595658438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e015868450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.417+0000 7fa978845b80 1 -- 172.21.15.8:0/1595658438 >> 172.21.15.8:0/1595658438 conn(0x55e0157db200 msgr2=0x55e015861bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.417+0000 7fa978845b80 1 -- 172.21.15.8:0/1595658438 shutdown_connections 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.417+0000 7fa978845b80 1 -- 172.21.15.8:0/1595658438 wait complete. 2023-10-06T23:24:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.417+0000 7fa978845b80 1 -- start start 2023-10-06T23:24:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.418+0000 7fa978845b80 1 Processor -- start 2023-10-06T23:24:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.418+0000 7fa978845b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e015870c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.418+0000 7fa978845b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015867fd0 0x55e015871170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.418+0000 7fa978845b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015868990 0x55e0158781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.418+0000 7fa978845b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0157b9dd0 con 0x55e015868990 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.418+0000 7fa978845b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0157566b0 con 0x55e015866ec0 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.418+0000 7fa978845b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e015756350 con 0x55e015867fd0 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.418+0000 7fa978845b80 10 client.0 _ll_register_callbacks cb 0x55e0155b37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e015870c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015867fd0 0x55e015871170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015867fd0 0x55e015871170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34422/0 (socket says 172.21.15.8:34422) 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95e59c700 1 -- 172.21.15.8:0/3440612906 learned_addr learned my addr 172.21.15.8:0/3440612906 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015868990 0x55e0158781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95e59c700 1 -- 172.21.15.8:0/3440612906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 msgr2=0x55e015870c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95e59c700 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e015870c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95e59c700 1 -- 172.21.15.8:0/3440612906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015868990 msgr2=0x55e0158781b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95e59c700 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015868990 0x55e0158781b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.419+0000 7fa95e59c700 1 -- 172.21.15.8:0/3440612906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa954019040 con 0x55e015867fd0 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.420+0000 7fa95e59c700 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015867fd0 0x55e015871170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa950009990 tx=0x7fa950003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=471737daee4c85d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.420+0000 7fa945ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.420+0000 7fa945ffb700 1 -- 172.21.15.8:0/3440612906 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95001d070 con 0x55e015867fd0 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.420+0000 7fa978845b80 1 -- 172.21.15.8:0/3440612906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e015859d50 con 0x55e015867fd0 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.420+0000 7fa945ffb700 1 -- 172.21.15.8:0/3440612906 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa95000b710 con 0x55e015867fd0 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa945ffb700 1 -- 172.21.15.8:0/3440612906 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa950003d90 con 0x55e015867fd0 2023-10-06T23:24:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa978845b80 10 client.26638 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa978845b80 1 -- 172.21.15.8:0/3440612906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e0155cdc00 con 0x55e015867fd0 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa945ffb700 1 -- 172.21.15.8:0/3440612906 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e015859d50 con 0x55e015867fd0 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa945ffb700 1 -- 172.21.15.8:0/3440612906 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa950004830 con 0x55e015867fd0 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa978845b80 10 client.26638 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa978845b80 10 client.26638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa978845b80 20 client.26638 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa978845b80 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e01587cb00 0x55e01587ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa978845b80 4 client.26638 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:24:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.421+0000 7fa978845b80 1 -- 172.21.15.8:0/3440612906 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0157b2db0 con 0x55e01587cb00 2023-10-06T23:24:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.422+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e01587cb00 0x55e01587ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.422+0000 7fa945ffb700 10 client.26638 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.422+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e01587cb00 0x55e01587ef20 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7224b1b9458f0973 server_cookie=32770c1b819c4983 in_seq=0 out_seq=0 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.423+0000 7fa945ffb700 1 -- 172.21.15.8:0/3440612906 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e0157b2db0 con 0x55e01587cb00 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.423+0000 7fa945ffb700 10 client.26638 handle_command_reply: tid=0 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 client.26638 shutdown 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 -- 172.21.15.8:0/3440612906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015867fd0 msgr2=0x55e015871170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015867fd0 0x55e015871170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa950009990 tx=0x7fa950003c60 comp rx=0 tx=0).stop 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 -- 172.21.15.8:0/3440612906 shutdown_connections 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e01587cb00 0x55e01587ef20 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015868990 0x55e0158781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e015870c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 --2- 172.21.15.8:0/3440612906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015867fd0 0x55e015871170 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 -- 172.21.15.8:0/3440612906 >> 172.21.15.8:0/3440612906 conn(0x55e0157db200 msgr2=0x55e015861250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa945ffb700 0 client.26638 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 -- 172.21.15.8:0/3440612906 shutdown_connections 2023-10-06T23:24:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.424+0000 7fa978845b80 1 -- 172.21.15.8:0/3440612906 wait complete. 2023-10-06T23:24:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.425+0000 7fa978845b80 20 client.26638 trim_cache size 0 max 16384 2023-10-06T23:24:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.446+0000 7fa978845b80 1 Processor -- start 2023-10-06T23:24:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.446+0000 7fa978845b80 1 -- start start 2023-10-06T23:24:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa978845b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e01586f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa978845b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158780d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa978845b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015868990 0x55e01586ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa978845b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e01563a8c0 con 0x55e015867fd0 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa978845b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e01586c510 con 0x55e015866ec0 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa978845b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e015871890 con 0x55e015868990 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa95dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e01586f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa95e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158780d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa95dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e01586f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49762/0 (socket says 172.21.15.8:49762) 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa95dd9b700 1 -- 172.21.15.8:0/2260097137 learned_addr learned my addr 172.21.15.8:0/2260097137 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.447+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015868990 0x55e01586ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.448+0000 7fa95e59c700 1 -- 172.21.15.8:0/2260097137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015868990 msgr2=0x55e01586ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.448+0000 7fa95e59c700 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015868990 0x55e01586ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.448+0000 7fa95e59c700 1 -- 172.21.15.8:0/2260097137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 msgr2=0x55e01586f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.448+0000 7fa95e59c700 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e01586f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.448+0000 7fa95e59c700 1 -- 172.21.15.8:0/2260097137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e01560b1f0 con 0x55e015867fd0 2023-10-06T23:24:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.448+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e01586f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:24:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.448+0000 7fa95e59c700 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158780d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa950006010 tx=0x7fa9500098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f400e122fdb3db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.448+0000 7fa94d7fa700 1 -- 172.21.15.8:0/2260097137 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95001d030 con 0x55e015867fd0 2023-10-06T23:24:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.449+0000 7fa94d7fa700 1 -- 172.21.15.8:0/2260097137 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa95001e040 con 0x55e015867fd0 2023-10-06T23:24:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.449+0000 7fa94d7fa700 1 -- 172.21.15.8:0/2260097137 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000b970 con 0x55e015867fd0 2023-10-06T23:24:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.449+0000 7fa978845b80 1 -- 172.21.15.8:0/2260097137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 msgr2=0x55e0158780d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.449+0000 7fa978845b80 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158780d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa950006010 tx=0x7fa9500098c0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.450+0000 7fa978845b80 1 -- 172.21.15.8:0/2260097137 shutdown_connections 2023-10-06T23:24:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.450+0000 7fa978845b80 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015868990 0x55e01586ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.450+0000 7fa978845b80 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015866ec0 0x55e01586f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.450+0000 7fa978845b80 1 --2- 172.21.15.8:0/2260097137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158780d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.450+0000 7fa978845b80 1 -- 172.21.15.8:0/2260097137 >> 172.21.15.8:0/2260097137 conn(0x55e0157db200 msgr2=0x55e015883880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.450+0000 7fa978845b80 1 -- 172.21.15.8:0/2260097137 shutdown_connections 2023-10-06T23:24:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.450+0000 7fa978845b80 1 -- 172.21.15.8:0/2260097137 wait complete. 2023-10-06T23:24:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.450+0000 7fa978845b80 1 -- start start 2023-10-06T23:24:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.451+0000 7fa978845b80 1 Processor -- start 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa978845b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e015875eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa978845b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158763f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa978845b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e015877400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa978845b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e015877940 con 0x55e015867fd0 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa978845b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e015877ab0 con 0x55e015868990 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa978845b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e015877c70 con 0x55e015866ec0 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa978845b80 10 client.0 _ll_register_callbacks cb 0x55e0155b37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa95e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa95e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158763f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35162/0 (socket says 172.21.15.8:35162) 2023-10-06T23:24:53.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa95e59c700 1 -- 172.21.15.8:0/2326366057 learned_addr learned my addr 172.21.15.8:0/2326366057 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e015875eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.452+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e015877400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa95dd9b700 1 -- 172.21.15.8:0/2326366057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 msgr2=0x55e015875eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e015875eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa95dd9b700 1 -- 172.21.15.8:0/2326366057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 msgr2=0x55e0158763f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158763f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa95dd9b700 1 -- 172.21.15.8:0/2326366057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0155e4d80 con 0x55e015868990 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa95dd9b700 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e015877400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa954011880 tx=0x7fa954009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77da4752d799da2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa945ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa945ffb700 1 -- 172.21.15.8:0/2326366057 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954033b40 con 0x55e015868990 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa978845b80 1 -- 172.21.15.8:0/2326366057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa954004830 con 0x55e015868990 2023-10-06T23:24:53.457 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.453+0000 7fa945ffb700 1 -- 172.21.15.8:0/2326366057 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa954033ca0 con 0x55e015868990 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.454+0000 7fa945ffb700 1 -- 172.21.15.8:0/2326366057 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa954033e60 con 0x55e015868990 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.454+0000 7fa978845b80 10 client.26627 fetch_fsmap learned FSMap version 37 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.454+0000 7fa978845b80 1 -- 172.21.15.8:0/2326366057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e0155cdc00 con 0x55e015868990 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.454+0000 7fa945ffb700 1 -- 172.21.15.8:0/2326366057 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa954004830 con 0x55e015868990 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.454+0000 7fa945ffb700 1 -- 172.21.15.8:0/2326366057 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa95401d070 con 0x55e015868990 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.454+0000 7fa978845b80 10 client.26627 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.454+0000 7fa978845b80 10 client.26627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.454+0000 7fa978845b80 20 client.26627 populate_metadata read hostname 'smithi008' 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.455+0000 7fa978845b80 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e0158d1670 0x55e0158d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.455+0000 7fa978845b80 4 client.26627 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:24:53.458 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.455+0000 7fa978845b80 1 -- 172.21.15.8:0/2326366057 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e0157b2ad0 con 0x55e0158d1670 2023-10-06T23:24:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.455+0000 7fa95e59c700 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e0158d1670 0x55e0158d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:24:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.456+0000 7fa95e59c700 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e0158d1670 0x55e0158d3af0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26fa8f8dfbe3d454 server_cookie=c18d9d90ea93d44b in_seq=0 out_seq=0 2023-10-06T23:24:53.459 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.456+0000 7fa945ffb700 10 client.26627 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:53.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.473+0000 7fa945ffb700 1 -- 172.21.15.8:0/2326366057 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e0157b2ad0 con 0x55e0158d1670 2023-10-06T23:24:53.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.473+0000 7fa945ffb700 10 client.26627 handle_command_reply: tid=0 2023-10-06T23:24:53.475 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.473+0000 7fa978845b80 1 client.26627 shutdown 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 -- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 msgr2=0x55e015877400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e015877400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa954011880 tx=0x7fa954009c40 comp rx=0 tx=0).stop 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 -- 172.21.15.8:0/2326366057 shutdown_connections 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55e0158d1670 0x55e0158d3af0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e015868990 0x55e015877400 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e015866ec0 0x55e015875eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 --2- 172.21.15.8:0/2326366057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e015867fd0 0x55e0158763f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 -- 172.21.15.8:0/2326366057 >> 172.21.15.8:0/2326366057 conn(0x55e0157db200 msgr2=0x55e01586f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa945ffb700 0 client.26627 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 -- 172.21.15.8:0/2326366057 shutdown_connections 2023-10-06T23:24:53.476 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.474+0000 7fa978845b80 1 -- 172.21.15.8:0/2326366057 wait complete. 2023-10-06T23:24:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.475+0000 7fa978845b80 20 client.26627 trim_cache size 0 max 16384 2023-10-06T23:24:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:24:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:24:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:24:53.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:24:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 -- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa9480a1500 msgr2=0x7fa9480a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa9480a1500 0x7fa9480a39c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa958095f90 tx=0x7fa958009040 comp rx=0 tx=0).stop 2023-10-06T23:24:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 -- 172.21.15.8:0/427883947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9601008d0 msgr2=0x7fa96019e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:24:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9601008d0 0x7fa96019e660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa95800ef30 tx=0x7fa95800c3a0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 -- 172.21.15.8:0/427883947 shutdown_connections 2023-10-06T23:24:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa9480a1500 0x7fa9480a39c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9600ff1b0 0x7fa96019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9601008d0 0x7fa96019e660 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 --2- 172.21.15.8:0/427883947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9600fff10 0x7fa96019d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:24:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.476+0000 7fa964fff700 1 -- 172.21.15.8:0/427883947 >> 172.21.15.8:0/427883947 conn(0x7fa9600faac0 msgr2=0x7fa9600fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:24:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.477+0000 7fa964fff700 1 -- 172.21.15.8:0/427883947 shutdown_connections 2023-10-06T23:24:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:24:53.477+0000 7fa964fff700 1 -- 172.21.15.8:0/427883947 wait complete. 2023-10-06T23:24:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 600.0 s, 266.2 tps, lat 374.817 ms stddev 66.031 2023-10-06T23:24:55.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:54 smithi156 ceph-mon[102862]: pgmap v712: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 5.9 MiB/s wr, 557 op/s 2023-10-06T23:24:55.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:54 smithi008 ceph-mon[98532]: pgmap v712: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 5.9 MiB/s wr, 557 op/s 2023-10-06T23:24:55.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:54 smithi190 ceph-mon[102658]: pgmap v712: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 5.9 MiB/s wr, 557 op/s 2023-10-06T23:24:57.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:56 smithi156 ceph-mon[102862]: pgmap v713: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2023-10-06T23:24:57.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:24:57.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:57.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:56 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:57.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:56 smithi008 ceph-mon[98532]: pgmap v713: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2023-10-06T23:24:57.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:24:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:57.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:56 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:57.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:56 smithi190 ceph-mon[102658]: pgmap v713: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2023-10-06T23:24:57.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:24:57.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:57.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:56 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:58.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:57 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:58.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:58.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:57 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:58.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:58.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:57 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:24:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 605.0 s, 260.0 tps, lat 384.138 ms stddev 94.090 2023-10-06T23:24:59.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:24:58 smithi156 ceph-mon[102862]: pgmap v714: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 6.2 MiB/s wr, 546 op/s 2023-10-06T23:24:59.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:24:58 smithi008 ceph-mon[98532]: pgmap v714: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 6.2 MiB/s wr, 546 op/s 2023-10-06T23:24:59.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:24:58 smithi190 ceph-mon[102658]: pgmap v714: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 6.2 MiB/s wr, 546 op/s 2023-10-06T23:25:01.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:00 smithi156 ceph-mon[102862]: pgmap v715: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.5 MiB/s wr, 457 op/s 2023-10-06T23:25:01.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:00 smithi008 ceph-mon[98532]: pgmap v715: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.5 MiB/s wr, 457 op/s 2023-10-06T23:25:01.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:00 smithi190 ceph-mon[102658]: pgmap v715: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.5 MiB/s wr, 457 op/s 2023-10-06T23:25:03.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:02 smithi156 ceph-mon[102862]: pgmap v716: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 5.0 MiB/s wr, 470 op/s 2023-10-06T23:25:03.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:02 smithi008 ceph-mon[98532]: pgmap v716: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 5.0 MiB/s wr, 470 op/s 2023-10-06T23:25:03.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:02 smithi190 ceph-mon[102658]: pgmap v716: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 5.0 MiB/s wr, 470 op/s 2023-10-06T23:25:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 610.0 s, 229.4 tps, lat 435.596 ms stddev 141.151 2023-10-06T23:25:05.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:04 smithi156 ceph-mon[102862]: pgmap v717: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 5.7 MiB/s wr, 498 op/s 2023-10-06T23:25:05.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:04 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:05.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:04 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:05.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:04 smithi008 ceph-mon[98532]: pgmap v717: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 5.7 MiB/s wr, 498 op/s 2023-10-06T23:25:05.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:04 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:05.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:04 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:05.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:04 smithi190 ceph-mon[102658]: pgmap v717: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 5.7 MiB/s wr, 498 op/s 2023-10-06T23:25:05.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:04 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:05.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:04 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.705+0000 7fb5239ff700 1 -- 172.21.15.8:0/3293779814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0fee50 msgr2=0x7fb51c0ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.705+0000 7fb5239ff700 1 --2- 172.21.15.8:0/3293779814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0fee50 0x7fb51c0ff270 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb518009990 tx=0x7fb518009ca0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.706+0000 7fb5239ff700 1 -- 172.21.15.8:0/3293779814 shutdown_connections 2023-10-06T23:25:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.706+0000 7fb5239ff700 1 --2- 172.21.15.8:0/3293779814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb51c100880 0x7fb51c101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.706+0000 7fb5239ff700 1 --2- 172.21.15.8:0/3293779814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0fee50 0x7fb51c0ff270 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.706+0000 7fb5239ff700 1 --2- 172.21.15.8:0/3293779814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c0ffec0 0x7fb51c100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.706+0000 7fb5239ff700 1 -- 172.21.15.8:0/3293779814 >> 172.21.15.8:0/3293779814 conn(0x7fb51c0fa690 msgr2=0x7fb51c0fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.706+0000 7fb5239ff700 1 -- 172.21.15.8:0/3293779814 shutdown_connections 2023-10-06T23:25:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.706+0000 7fb5239ff700 1 -- 172.21.15.8:0/3293779814 wait complete. 2023-10-06T23:25:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.708+0000 7fb5239ff700 1 Processor -- start 2023-10-06T23:25:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.708+0000 7fb5239ff700 1 -- start start 2023-10-06T23:25:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb5239ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c0fee50 0x7fb51c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb5239ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0ffec0 0x7fb51c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb5239ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb51c100880 0x7fb51c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb5239ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c19a7a0 con 0x7fb51c0fee50 2023-10-06T23:25:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb5239ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c19a910 con 0x7fb51c100880 2023-10-06T23:25:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb5239ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c19aad0 con 0x7fb51c0ffec0 2023-10-06T23:25:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb520f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0ffec0 0x7fb51c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb520f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0ffec0 0x7fb51c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47590/0 (socket says 172.21.15.8:47590) 2023-10-06T23:25:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb520f9a700 1 -- 172.21.15.8:0/564545070 learned_addr learned my addr 172.21.15.8:0/564545070 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.709+0000 7fb521f9c700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb51c100880 0x7fb51c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.710+0000 7fb520f9a700 1 -- 172.21.15.8:0/564545070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb51c100880 msgr2=0x7fb51c19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.710+0000 7fb520f9a700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb51c100880 0x7fb51c19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.710+0000 7fb520f9a700 1 -- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c0fee50 msgr2=0x7fb51c198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.710+0000 7fb520f9a700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c0fee50 0x7fb51c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.710+0000 7fb520f9a700 1 -- 172.21.15.8:0/564545070 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180095f0 con 0x7fb51c0ffec0 2023-10-06T23:25:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.710+0000 7fb520f9a700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0ffec0 0x7fb51c1992f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00c9b0 tx=0x7fb50c00ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.710+0000 7fb5127fc700 1 -- 172.21.15.8:0/564545070 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c007b00 con 0x7fb51c0ffec0 2023-10-06T23:25:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.711+0000 7fb5239ff700 1 -- 172.21.15.8:0/564545070 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c19adb0 con 0x7fb51c0ffec0 2023-10-06T23:25:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.711+0000 7fb5239ff700 1 -- 172.21.15.8:0/564545070 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c1a1570 con 0x7fb51c0ffec0 2023-10-06T23:25:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.711+0000 7fb5127fc700 1 -- 172.21.15.8:0/564545070 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb50c007c60 con 0x7fb51c0ffec0 2023-10-06T23:25:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.711+0000 7fb5127fc700 1 -- 172.21.15.8:0/564545070 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c018660 con 0x7fb51c0ffec0 2023-10-06T23:25:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.716+0000 7fb5127fc700 1 -- 172.21.15.8:0/564545070 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb50c00f450 con 0x7fb51c0ffec0 2023-10-06T23:25:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.718+0000 7fb5127fc700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5080a1500 0x7fb5080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.718+0000 7fb5127fc700 1 -- 172.21.15.8:0/564545070 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb50c0ccbe0 con 0x7fb51c0ffec0 2023-10-06T23:25:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.719+0000 7fb52179b700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5080a1500 0x7fb5080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.719+0000 7fb5373e0b80 1 Processor -- start 2023-10-06T23:25:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.719+0000 7fb52179b700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5080a1500 0x7fb5080a39c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb5180098e0 tx=0x7fb518000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.720+0000 7fb5373e0b80 1 -- start start 2023-10-06T23:25:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.720+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4db22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.720+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4db3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.720+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4dba220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.720+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4d1a400 con 0x555af4db3990 2023-10-06T23:25:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.720+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4d0bbc0 con 0x555af4db1ec0 2023-10-06T23:25:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.720+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4d094e0 con 0x555af4db2fd0 2023-10-06T23:25:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.721+0000 7fb52179b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4db22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.721+0000 7fb52179b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4db22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33572/0 (socket says 172.21.15.8:33572) 2023-10-06T23:25:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.721+0000 7fb52179b700 1 -- 172.21.15.8:0/1343427192 learned_addr learned my addr 172.21.15.8:0/1343427192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.721+0000 7fb521f9c700 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4dba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb520f9a700 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4db3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb521f9c700 1 -- 172.21.15.8:0/1343427192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 msgr2=0x555af4db3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb521f9c700 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4db3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb521f9c700 1 -- 172.21.15.8:0/1343427192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 msgr2=0x555af4db22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb521f9c700 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4db22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb521f9c700 1 -- 172.21.15.8:0/1343427192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555af4b2fd80 con 0x555af4db3990 2023-10-06T23:25:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb52179b700 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4db22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:25:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb520f9a700 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4db3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:25:06.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb521f9c700 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4dba220 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb51400f300 tx=0x7fb51400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc737d0432632f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb5077fe700 1 -- 172.21.15.8:0/1343427192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400fe40 con 0x555af4db3990 2023-10-06T23:25:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb5077fe700 1 -- 172.21.15.8:0/1343427192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb514004bb0 con 0x555af4db3990 2023-10-06T23:25:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.722+0000 7fb5077fe700 1 -- 172.21.15.8:0/1343427192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514014e50 con 0x555af4db3990 2023-10-06T23:25:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.723+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1343427192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 msgr2=0x555af4dba220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.723+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4dba220 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb51400f300 tx=0x7fb51400f610 comp rx=0 tx=0).stop 2023-10-06T23:25:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.724+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1343427192 shutdown_connections 2023-10-06T23:25:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.724+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4dba220 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.724+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4db22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.724+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1343427192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4db3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.724+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1343427192 >> 172.21.15.8:0/1343427192 conn(0x555af4d26200 msgr2=0x555af4dacbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.724+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1343427192 shutdown_connections 2023-10-06T23:25:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.724+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1343427192 wait complete. 2023-10-06T23:25:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.724+0000 7fb5373e0b80 1 -- start start 2023-10-06T23:25:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.725+0000 7fb5373e0b80 1 Processor -- start 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.726+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db1ec0 0x555af4dbbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.726+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4dbc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.726+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db3990 0x555af4dc30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.726+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4d04dd0 con 0x555af4db1ec0 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.726+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4ca16b0 con 0x555af4db3990 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.726+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4ca1350 con 0x555af4db2fd0 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.726+0000 7fb5373e0b80 10 client.0 _ll_register_callbacks cb 0x555af4afe7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb520f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4dbc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb520f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4dbc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47608/0 (socket says 172.21.15.8:47608) 2023-10-06T23:25:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb520f9a700 1 -- 172.21.15.8:0/1076154400 learned_addr learned my addr 172.21.15.8:0/1076154400 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb52179b700 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db1ec0 0x555af4dbbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb521f9c700 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db3990 0x555af4dc30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb521f9c700 1 -- 172.21.15.8:0/1076154400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 msgr2=0x555af4dbc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb521f9c700 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4dbc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb521f9c700 1 -- 172.21.15.8:0/1076154400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db1ec0 msgr2=0x555af4dbbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb521f9c700 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db1ec0 0x555af4dbbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.727+0000 7fb521f9c700 1 -- 172.21.15.8:0/1076154400 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c101b30 con 0x555af4db3990 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.728+0000 7fb521f9c700 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db3990 0x555af4dc30f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb51400a040 tx=0x7fb51401c600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e1287282cb7f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.728+0000 7fb504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.728+0000 7fb504ff9700 1 -- 172.21.15.8:0/1076154400 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514007690 con 0x555af4db3990 2023-10-06T23:25:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.728+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1076154400 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555af4da4d50 con 0x555af4db3990 2023-10-06T23:25:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.728+0000 7fb504ff9700 1 -- 172.21.15.8:0/1076154400 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb51400fe40 con 0x555af4db3990 2023-10-06T23:25:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.728+0000 7fb504ff9700 1 -- 172.21.15.8:0/1076154400 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb514014950 con 0x555af4db3990 2023-10-06T23:25:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.728+0000 7fb5373e0b80 10 client.26636 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.728+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1076154400 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7fb514007d60 con 0x555af4db3990 2023-10-06T23:25:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb504ff9700 1 -- 172.21.15.8:0/1076154400 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555af4da4d50 con 0x555af4db3990 2023-10-06T23:25:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb504ff9700 1 -- 172.21.15.8:0/1076154400 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb51402f070 con 0x555af4db3990 2023-10-06T23:25:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb5373e0b80 10 client.26636 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb5373e0b80 10 client.26636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb5373e0b80 20 client.26636 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555af4dc78b0 0x555af4dc9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb5373e0b80 4 client.26636 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:25:06.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1076154400 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555af4cfddb0 con 0x555af4dc78b0 2023-10-06T23:25:06.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.729+0000 7fb52179b700 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555af4dc78b0 0x555af4dc9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.730+0000 7fb52179b700 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555af4dc78b0 0x555af4dc9cd0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4e0bceac9a5a3a8 server_cookie=c4bcdd5d83e5020 in_seq=0 out_seq=0 2023-10-06T23:25:06.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.730+0000 7fb504ff9700 10 client.26636 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:06.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.731+0000 7fb504ff9700 1 -- 172.21.15.8:0/1076154400 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555af4cfddb0 con 0x555af4dc78b0 2023-10-06T23:25:06.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.731+0000 7fb504ff9700 10 client.26636 handle_command_reply: tid=0 2023-10-06T23:25:06.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.731+0000 7fb5373e0b80 1 client.26636 shutdown 2023-10-06T23:25:06.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db3990 msgr2=0x555af4dc30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db3990 0x555af4dc30f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb51400a040 tx=0x7fb51401c600 comp rx=0 tx=0).stop 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1076154400 shutdown_connections 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555af4dc78b0 0x555af4dc9cd0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db1ec0 0x555af4dbbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db3990 0x555af4dc30f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/1076154400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db2fd0 0x555af4dbc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1076154400 >> 172.21.15.8:0/1076154400 conn(0x555af4d26200 msgr2=0x555af4dac250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb504ff9700 0 client.26636 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.732+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1076154400 shutdown_connections 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.733+0000 7fb5373e0b80 1 -- 172.21.15.8:0/1076154400 wait complete. 2023-10-06T23:25:06.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.733+0000 7fb5373e0b80 20 client.26636 trim_cache size 0 max 16384 2023-10-06T23:25:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.758+0000 7fb5373e0b80 1 Processor -- start 2023-10-06T23:25:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.758+0000 7fb5373e0b80 1 -- start start 2023-10-06T23:25:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.758+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db1ec0 0x555af4dad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db2fd0 0x555af4dc3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4db6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4b858c0 con 0x555af4db3990 2023-10-06T23:25:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4dbb710 con 0x555af4db2fd0 2023-10-06T23:25:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4db2b40 con 0x555af4db1ec0 2023-10-06T23:25:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb52179b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db1ec0 0x555af4dad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb521f9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4db6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb520f9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db2fd0 0x555af4dc3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb52179b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db1ec0 0x555af4dad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47622/0 (socket says 172.21.15.8:47622) 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.759+0000 7fb52179b700 1 -- 172.21.15.8:0/3505535174 learned_addr learned my addr 172.21.15.8:0/3505535174 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.760+0000 7fb52179b700 1 -- 172.21.15.8:0/3505535174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db2fd0 msgr2=0x555af4dc3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.760+0000 7fb52179b700 1 --2- 172.21.15.8:0/3505535174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db2fd0 0x555af4dc3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.760+0000 7fb52179b700 1 -- 172.21.15.8:0/3505535174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 msgr2=0x555af4db6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.760+0000 7fb52179b700 1 --2- 172.21.15.8:0/3505535174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4db6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.760+0000 7fb52179b700 1 -- 172.21.15.8:0/3505535174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555af4b18c00 con 0x555af4db1ec0 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.760+0000 7fb521f9c700 1 --2- 172.21.15.8:0/3505535174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4db6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:25:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.760+0000 7fb52179b700 1 --2- 172.21.15.8:0/3505535174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db1ec0 0x555af4dad8b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x555af4db1c60 tx=0x7fb518020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29abf9bd8c82d752 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.761+0000 7fb507fff700 1 -- 172.21.15.8:0/3505535174 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51802b070 con 0x555af4db1ec0 2023-10-06T23:25:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.761+0000 7fb507fff700 1 -- 172.21.15.8:0/3505535174 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb51802c040 con 0x555af4db1ec0 2023-10-06T23:25:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.761+0000 7fb507fff700 1 -- 172.21.15.8:0/3505535174 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51801d070 con 0x555af4db1ec0 2023-10-06T23:25:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3505535174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db1ec0 msgr2=0x555af4dad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3505535174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db1ec0 0x555af4dad8b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x555af4db1c60 tx=0x7fb518020000 comp rx=0 tx=0).stop 2023-10-06T23:25:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3505535174 shutdown_connections 2023-10-06T23:25:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3505535174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db3990 0x555af4db6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3505535174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db1ec0 0x555af4dad8b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3505535174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db2fd0 0x555af4dc3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3505535174 >> 172.21.15.8:0/3505535174 conn(0x555af4d26200 msgr2=0x555af4dce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3505535174 shutdown_connections 2023-10-06T23:25:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.762+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3505535174 wait complete. 2023-10-06T23:25:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.763+0000 7fb5373e0b80 1 -- start start 2023-10-06T23:25:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.763+0000 7fb5373e0b80 1 Processor -- start 2023-10-06T23:25:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4dc1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db2fd0 0x555af4dc15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb5373e0b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db3990 0x555af4dc25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4dc2af0 con 0x555af4db2fd0 2023-10-06T23:25:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4dc2c60 con 0x555af4db1ec0 2023-10-06T23:25:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb5373e0b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af4dc2e20 con 0x555af4db3990 2023-10-06T23:25:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb5373e0b80 10 client.0 _ll_register_callbacks cb 0x7fb518005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb52179b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4dc1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb521f9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db3990 0x555af4dc25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb52179b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4dc1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33602/0 (socket says 172.21.15.8:33602) 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb52179b700 1 -- 172.21.15.8:0/3661172345 learned_addr learned my addr 172.21.15.8:0/3661172345 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.764+0000 7fb520f9a700 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db2fd0 0x555af4dc15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb52179b700 1 -- 172.21.15.8:0/3661172345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db3990 msgr2=0x555af4dc25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb52179b700 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db3990 0x555af4dc25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb52179b700 1 -- 172.21.15.8:0/3661172345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db2fd0 msgr2=0x555af4dc15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb52179b700 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db2fd0 0x555af4dc15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb52179b700 1 -- 172.21.15.8:0/3661172345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb514007d60 con 0x555af4db1ec0 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb520f9a700 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db2fd0 0x555af4dc15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb521f9c700 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db3990 0x555af4dc25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb52179b700 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4dc1060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb518005b40 tx=0x7fb518003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a9e2fbbe428c65d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.765+0000 7fb504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:25:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.766+0000 7fb504ff9700 1 -- 172.21.15.8:0/3661172345 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51801d050 con 0x555af4db1ec0 2023-10-06T23:25:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.766+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3661172345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb514004bb0 con 0x555af4db1ec0 2023-10-06T23:25:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.766+0000 7fb504ff9700 1 -- 172.21.15.8:0/3661172345 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb518034e40 con 0x555af4db1ec0 2023-10-06T23:25:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.766+0000 7fb504ff9700 1 -- 172.21.15.8:0/3661172345 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb51802b040 con 0x555af4db1ec0 2023-10-06T23:25:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.766+0000 7fb5373e0b80 10 client.26642 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.766+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3661172345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7fb51800b7d0 con 0x555af4db1ec0 2023-10-06T23:25:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.766+0000 7fb504ff9700 1 -- 172.21.15.8:0/3661172345 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb514004bb0 con 0x555af4db1ec0 2023-10-06T23:25:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.767+0000 7fb504ff9700 1 -- 172.21.15.8:0/3661172345 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb5180256e0 con 0x555af4db1ec0 2023-10-06T23:25:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.767+0000 7fb5373e0b80 10 client.26642 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.767+0000 7fb5373e0b80 10 client.26642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.767+0000 7fb5373e0b80 20 client.26642 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.767+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555af4e24c40 0x555af4e27060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.767+0000 7fb5373e0b80 4 client.26642 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:25:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.767+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3661172345 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555af4cfdad0 con 0x555af4e24c40 2023-10-06T23:25:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.767+0000 7fb520f9a700 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555af4e24c40 0x555af4e27060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.768+0000 7fb520f9a700 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555af4e24c40 0x555af4e27060 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b3d370e331bbba server_cookie=5c970b5f8e7ccf53 in_seq=0 out_seq=0 2023-10-06T23:25:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.768+0000 7fb504ff9700 10 client.26642 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb504ff9700 1 -- 172.21.15.8:0/3661172345 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555af4cfdad0 con 0x555af4e24c40 2023-10-06T23:25:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb504ff9700 10 client.26642 handle_command_reply: tid=0 2023-10-06T23:25:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 client.26642 shutdown 2023-10-06T23:25:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3661172345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 msgr2=0x555af4dc1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4dc1060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb518005b40 tx=0x7fb518003820 comp rx=0 tx=0).stop 2023-10-06T23:25:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3661172345 shutdown_connections 2023-10-06T23:25:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x555af4e24c40 0x555af4e27060 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555af4db3990 0x555af4dc25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555af4db1ec0 0x555af4dc1060 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 --2- 172.21.15.8:0/3661172345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555af4db2fd0 0x555af4dc15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb504ff9700 0 client.26642 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3661172345 >> 172.21.15.8:0/3661172345 conn(0x555af4d26200 msgr2=0x555af4dad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3661172345 shutdown_connections 2023-10-06T23:25:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.790+0000 7fb5373e0b80 1 -- 172.21.15.8:0/3661172345 wait complete. 2023-10-06T23:25:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.791+0000 7fb5373e0b80 20 client.26642 trim_cache size 0 max 16384 2023-10-06T23:25:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:25:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:25:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:25:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:25:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.791+0000 7fb5239ff700 1 -- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5080a1500 msgr2=0x7fb5080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.791+0000 7fb5239ff700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5080a1500 0x7fb5080a39c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb5180098e0 tx=0x7fb518000bc0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.791+0000 7fb5239ff700 1 -- 172.21.15.8:0/564545070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0ffec0 msgr2=0x7fb51c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.791+0000 7fb5239ff700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0ffec0 0x7fb51c1992f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00c9b0 tx=0x7fb50c00ccc0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.792+0000 7fb5239ff700 1 -- 172.21.15.8:0/564545070 shutdown_connections 2023-10-06T23:25:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.792+0000 7fb5239ff700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb5080a1500 0x7fb5080a39c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.792+0000 7fb5239ff700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb51c0fee50 0x7fb51c198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.792+0000 7fb5239ff700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb51c100880 0x7fb51c19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.792+0000 7fb5239ff700 1 --2- 172.21.15.8:0/564545070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb51c0ffec0 0x7fb51c1992f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.792+0000 7fb5239ff700 1 -- 172.21.15.8:0/564545070 >> 172.21.15.8:0/564545070 conn(0x7fb51c0fa690 msgr2=0x7fb51c0fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.792+0000 7fb5239ff700 1 -- 172.21.15.8:0/564545070 shutdown_connections 2023-10-06T23:25:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:06.792+0000 7fb5239ff700 1 -- 172.21.15.8:0/564545070 wait complete. 2023-10-06T23:25:07.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:06 smithi156 ceph-mon[102862]: pgmap v718: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 5.7 MiB/s wr, 509 op/s 2023-10-06T23:25:07.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:06 smithi008 ceph-mon[98532]: pgmap v718: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 5.7 MiB/s wr, 509 op/s 2023-10-06T23:25:07.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:06 smithi190 ceph-mon[102658]: pgmap v718: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 5.7 MiB/s wr, 509 op/s 2023-10-06T23:25:08.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:08 smithi156 ceph-mon[102862]: pgmap v719: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 5.1 MiB/s wr, 457 op/s 2023-10-06T23:25:08.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:08 smithi008 ceph-mon[98532]: pgmap v719: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 5.1 MiB/s wr, 457 op/s 2023-10-06T23:25:08.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:08 smithi190 ceph-mon[102658]: pgmap v719: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 5.1 MiB/s wr, 457 op/s 2023-10-06T23:25:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 615.0 s, 251.0 tps, lat 398.200 ms stddev 51.020 2023-10-06T23:25:10.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:10 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:10.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:10 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:10.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:10 smithi156 ceph-mon[102862]: pgmap v720: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.3 MiB/s wr, 488 op/s 2023-10-06T23:25:10.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:10 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:10.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:10 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:10.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:10 smithi008 ceph-mon[98532]: pgmap v720: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.3 MiB/s wr, 488 op/s 2023-10-06T23:25:10.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:10 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:10.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:10 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:10.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:10 smithi190 ceph-mon[102658]: pgmap v720: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.3 MiB/s wr, 488 op/s 2023-10-06T23:25:11.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:25:11.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:25:11.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:11 smithi156 ceph-mon[102862]: pgmap v721: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 5.6 MiB/s wr, 514 op/s 2023-10-06T23:25:11.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:11.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:25:11.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:25:11.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:11 smithi008 ceph-mon[98532]: pgmap v721: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 5.6 MiB/s wr, 514 op/s 2023-10-06T23:25:11.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:11.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:25:11.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:25:11.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:11 smithi190 ceph-mon[102658]: pgmap v721: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 5.6 MiB/s wr, 514 op/s 2023-10-06T23:25:11.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:25:12.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:12 smithi156 ceph-mon[102862]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-10-06T23:25:12.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:12 smithi156 ceph-mon[102862]: Cluster is now healthy 2023-10-06T23:25:12.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:12 smithi008 ceph-mon[98532]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-10-06T23:25:12.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:12 smithi008 ceph-mon[98532]: Cluster is now healthy 2023-10-06T23:25:12.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:12 smithi190 ceph-mon[102658]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-10-06T23:25:12.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:12 smithi190 ceph-mon[102658]: Cluster is now healthy 2023-10-06T23:25:13.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:13 smithi156 ceph-mon[102862]: pgmap v722: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 5.1 MiB/s wr, 489 op/s 2023-10-06T23:25:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:13 smithi008 ceph-mon[98532]: pgmap v722: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 5.1 MiB/s wr, 489 op/s 2023-10-06T23:25:13.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:13 smithi190 ceph-mon[102658]: pgmap v722: 97 pgs: 97 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 5.1 MiB/s wr, 489 op/s 2023-10-06T23:25:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 620.0 s, 272.8 tps, lat 369.488 ms stddev 52.900 2023-10-06T23:25:15.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:15 smithi008 ceph-mon[98532]: pgmap v723: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.7 MiB/s wr, 485 op/s 2023-10-06T23:25:15.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:15 smithi190 ceph-mon[102658]: pgmap v723: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.7 MiB/s wr, 485 op/s 2023-10-06T23:25:16.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:15 smithi156 ceph-mon[102862]: pgmap v723: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.7 MiB/s wr, 485 op/s 2023-10-06T23:25:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:17 smithi008 ceph-mon[98532]: pgmap v724: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2023-10-06T23:25:17.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:17 smithi190 ceph-mon[102658]: pgmap v724: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2023-10-06T23:25:18.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:17 smithi156 ceph-mon[102862]: pgmap v724: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2023-10-06T23:25:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 625.0 s, 283.4 tps, lat 350.899 ms stddev 53.949 2023-10-06T23:25:19.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:19 smithi008 ceph-mon[98532]: pgmap v725: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2023-10-06T23:25:19.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:19 smithi190 ceph-mon[102658]: pgmap v725: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2023-10-06T23:25:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.021+0000 7f71bd7ff700 1 -- 172.21.15.8:0/923746349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71b8106bd0 msgr2=0x7f71b8109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.021+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/923746349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71b8106bd0 0x7f71b8109040 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f71b000b0a0 tx=0x7f71b000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.022+0000 7f71bd7ff700 1 -- 172.21.15.8:0/923746349 shutdown_connections 2023-10-06T23:25:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.022+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/923746349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71b8106bd0 0x7f71b8109040 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.022+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/923746349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b8101970 0x7f71b8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.022+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/923746349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b81042a0 0x7f71b8106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.022+0000 7f71bd7ff700 1 -- 172.21.15.8:0/923746349 >> 172.21.15.8:0/923746349 conn(0x7f71b80fb340 msgr2=0x7f71b80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.022+0000 7f71bd7ff700 1 -- 172.21.15.8:0/923746349 shutdown_connections 2023-10-06T23:25:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.022+0000 7f71bd7ff700 1 -- 172.21.15.8:0/923746349 wait complete. 2023-10-06T23:25:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.023+0000 7f71bd7ff700 1 Processor -- start 2023-10-06T23:25:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.023+0000 7f71bd7ff700 1 -- start start 2023-10-06T23:25:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71bd7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8101970 0x7f71b8196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71bd7ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b81042a0 0x7f71b8197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71bd7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71b8106bd0 0x7f71b8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71bd7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81986b0 con 0x7f71b8106bd0 2023-10-06T23:25:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71bd7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8198820 con 0x7f71b8101970 2023-10-06T23:25:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71bd7ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81989e0 con 0x7f71b81042a0 2023-10-06T23:25:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8101970 0x7f71b8196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b67fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b81042a0 0x7f71b8197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b67fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b81042a0 0x7f71b8197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40038/0 (socket says 172.21.15.8:40038) 2023-10-06T23:25:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8101970 0x7f71b8196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43840/0 (socket says 172.21.15.8:43840) 2023-10-06T23:25:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b67fc700 1 -- 172.21.15.8:0/1947821982 learned_addr learned my addr 172.21.15.8:0/1947821982 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b77fe700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71b8106bd0 0x7f71b8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1947821982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b81042a0 msgr2=0x7f71b8197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b81042a0 0x7f71b8197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71b8106bd0 msgr2=0x7f71b8197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71b8106bd0 0x7f71b8197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.024+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1947821982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009d00 con 0x7f71b8101970 2023-10-06T23:25:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.025+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8101970 0x7f71b8196d30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f71a800e9f0 tx=0x7f71a800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.025+0000 7f719ffff700 1 -- 172.21.15.8:0/1947821982 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800c9c0 con 0x7f71b8101970 2023-10-06T23:25:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.025+0000 7f719ffff700 1 -- 172.21.15.8:0/1947821982 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71a8010430 con 0x7f71b8101970 2023-10-06T23:25:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.025+0000 7f719ffff700 1 -- 172.21.15.8:0/1947821982 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8018680 con 0x7f71b8101970 2023-10-06T23:25:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.025+0000 7f71bd7ff700 1 -- 172.21.15.8:0/1947821982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b8198cc0 con 0x7f71b8101970 2023-10-06T23:25:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.026+0000 7f71bd7ff700 1 -- 172.21.15.8:0/1947821982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b819f3e0 con 0x7f71b8101970 2023-10-06T23:25:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.031+0000 7f719ffff700 1 -- 172.21.15.8:0/1947821982 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f71a80105a0 con 0x7f71b8101970 2023-10-06T23:25:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.032+0000 7f71d10c9b80 1 Processor -- start 2023-10-06T23:25:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.032+0000 7f71d10c9b80 1 -- start start 2023-10-06T23:25:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.033+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb7fb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.033+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb804800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.033+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 0x55ffbb805210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.033+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb763400 con 0x55ffbb804d90 2023-10-06T23:25:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.033+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb754bc0 con 0x55ffbb7fb780 2023-10-06T23:25:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.033+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb7524e0 con 0x55ffbb7fae20 2023-10-06T23:25:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.033+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb804800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.033+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb804800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43846/0 (socket says 172.21.15.8:43846) 2023-10-06T23:25:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1547234699 learned_addr learned my addr 172.21.15.8:0/1547234699 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f71b67fc700 1 --2- 172.21.15.8:0/1547234699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 0x55ffbb805210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1547234699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 msgr2=0x55ffbb7fb240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T23:25:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1547234699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb7fb240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1547234699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 msgr2=0x55ffbb805210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1547234699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 0x55ffbb805210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1547234699 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffbb578d80 con 0x55ffbb7fb780 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1547234699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb804800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f71a80d0c20 tx=0x7f71a80d0f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9510190d537b8ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.034+0000 7f719ffff700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71a00a1480 0x7f71a00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.035+0000 7f719ffff700 1 -- 172.21.15.8:0/1947821982 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f71a8014070 con 0x7f71b8101970 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.035+0000 7f719d7fa700 1 -- 172.21.15.8:0/1547234699 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8096480 con 0x55ffbb7fb780 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.035+0000 7f71b77fe700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71a00a1480 0x7f71a00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.035+0000 7f719d7fa700 1 -- 172.21.15.8:0/1547234699 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71a8099f10 con 0x55ffbb7fb780 2023-10-06T23:25:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.035+0000 7f719d7fa700 1 -- 172.21.15.8:0/1547234699 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8099aa0 con 0x55ffbb7fb780 2023-10-06T23:25:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1547234699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 msgr2=0x55ffbb804800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1547234699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb804800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f71a80d0c20 tx=0x7f71a80d0f30 comp rx=0 tx=0).stop 2023-10-06T23:25:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71b77fe700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71a00a1480 0x7f71a00a3940 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71b000b780 tx=0x7f71b0006210 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1547234699 shutdown_connections 2023-10-06T23:25:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1547234699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 0x55ffbb805210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1547234699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb7fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1547234699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb804800 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1547234699 >> 172.21.15.8:0/1547234699 conn(0x55ffbb76f200 msgr2=0x55ffbb7f5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.036+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1547234699 shutdown_connections 2023-10-06T23:25:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.037+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1547234699 wait complete. 2023-10-06T23:25:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.037+0000 7f71d10c9b80 1 -- start start 2023-10-06T23:25:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.038+0000 7f71d10c9b80 1 Processor -- start 2023-10-06T23:25:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.038+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fae20 0x55ffbb81e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.038+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fb780 0x55ffbb81e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.038+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb825960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.038+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb74ddd0 con 0x55ffbb7fb780 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.038+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb6ea6b0 con 0x55ffbb7fae20 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.038+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb6ea350 con 0x55ffbb804d90 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.038+0000 7f71d10c9b80 10 client.0 _ll_register_callbacks cb 0x55ffbb5477a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fae20 0x55ffbb81e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fae20 0x55ffbb81e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43858/0 (socket says 172.21.15.8:43858) 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1182496844 learned_addr learned my addr 172.21.15.8:0/1182496844 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b67fc700 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fb780 0x55ffbb81e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b77fe700 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb825960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1182496844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 msgr2=0x55ffbb825960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb825960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1182496844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fb780 msgr2=0x55ffbb81e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fb780 0x55ffbb81e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.039+0000 7f71b6ffd700 1 -- 172.21.15.8:0/1182496844 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b819f3e0 con 0x55ffbb7fae20 2023-10-06T23:25:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.040+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fae20 0x55ffbb81e3e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71a80ca970 tx=0x7f71a80ccf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cf59049c7d35bd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.040+0000 7f719aff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.040+0000 7f719aff5700 1 -- 172.21.15.8:0/1182496844 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80d0040 con 0x55ffbb7fae20 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.040+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1182496844 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ffbb7edd50 con 0x55ffbb7fae20 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.040+0000 7f719aff5700 1 -- 172.21.15.8:0/1182496844 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f71a8010880 con 0x55ffbb7fae20 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f719aff5700 1 -- 172.21.15.8:0/1182496844 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a8096480 con 0x55ffbb7fae20 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f71d10c9b80 10 client.26654 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1182496844 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ffbb561c00 con 0x55ffbb7fae20 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f719aff5700 1 -- 172.21.15.8:0/1182496844 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71a80b6080 con 0x55ffbb7fae20 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f719aff5700 1 -- 172.21.15.8:0/1182496844 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f71a80dd020 con 0x55ffbb7fae20 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f71d10c9b80 10 client.26654 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f71d10c9b80 10 client.26654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f71d10c9b80 20 client.26654 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ffbb829c90 0x55ffbb82c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f71d10c9b80 4 client.26654 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:25:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.041+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1182496844 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ffbb746db0 con 0x55ffbb829c90 2023-10-06T23:25:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.042+0000 7f71b67fc700 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ffbb829c90 0x55ffbb82c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.043+0000 7f71b67fc700 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ffbb829c90 0x55ffbb82c080 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bd6d7bb3c8115f9 server_cookie=60b2a3935d592cec in_seq=0 out_seq=0 2023-10-06T23:25:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.043+0000 7f719aff5700 10 client.26654 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.043+0000 7f719aff5700 1 -- 172.21.15.8:0/1182496844 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ffbb746db0 con 0x55ffbb829c90 2023-10-06T23:25:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.043+0000 7f719aff5700 10 client.26654 handle_command_reply: tid=0 2023-10-06T23:25:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.043+0000 7f71d10c9b80 1 client.26654 shutdown 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1182496844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fae20 msgr2=0x55ffbb81e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fae20 0x55ffbb81e3e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71a80ca970 tx=0x7f71a80ccf10 comp rx=0 tx=0).stop 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1182496844 shutdown_connections 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ffbb829c90 0x55ffbb82c080 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb825960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fae20 0x55ffbb81e3e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1182496844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fb780 0x55ffbb81e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1182496844 >> 172.21.15.8:0/1182496844 conn(0x55ffbb76f200 msgr2=0x55ffbb7f47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f719aff5700 0 client.26654 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1182496844 shutdown_connections 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.044+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1182496844 wait complete. 2023-10-06T23:25:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.045+0000 7f71d10c9b80 20 client.26654 trim_cache size 0 max 16384 2023-10-06T23:25:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.070+0000 7f71d10c9b80 1 Processor -- start 2023-10-06T23:25:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.070+0000 7f71d10c9b80 1 -- start start 2023-10-06T23:25:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.070+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fae20 0x55ffbb7f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.070+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb825920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.070+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb81d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.070+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb5ce8c0 con 0x55ffbb7fae20 2023-10-06T23:25:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.070+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb81dfb0 con 0x55ffbb7fb780 2023-10-06T23:25:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.070+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb7f6040 con 0x55ffbb804d90 2023-10-06T23:25:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb825920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b77fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb81d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b77fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb81d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40060/0 (socket says 172.21.15.8:40060) 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb825920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43872/0 (socket says 172.21.15.8:43872) 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b77fe700 1 -- 172.21.15.8:0/1793106489 learned_addr learned my addr 172.21.15.8:0/1793106489 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/1793106489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fae20 0x55ffbb7f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b67fc700 1 -- 172.21.15.8:0/1793106489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 msgr2=0x55ffbb81d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b67fc700 1 --2- 172.21.15.8:0/1793106489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb81d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b67fc700 1 -- 172.21.15.8:0/1793106489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fae20 msgr2=0x55ffbb7f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b67fc700 1 --2- 172.21.15.8:0/1793106489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fae20 0x55ffbb7f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.071+0000 7f71b67fc700 1 -- 172.21.15.8:0/1793106489 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffbb59f1f0 con 0x55ffbb7fb780 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.072+0000 7f71b67fc700 1 --2- 172.21.15.8:0/1793106489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb825920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55ffbb82c920 tx=0x7f71ac009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c7ad7e51813c8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.072+0000 7f719dffb700 1 -- 172.21.15.8:0/1793106489 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac017030 con 0x55ffbb7fb780 2023-10-06T23:25:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.072+0000 7f719dffb700 1 -- 172.21.15.8:0/1793106489 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71ac018040 con 0x55ffbb7fb780 2023-10-06T23:25:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.072+0000 7f719dffb700 1 -- 172.21.15.8:0/1793106489 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac003e60 con 0x55ffbb7fb780 2023-10-06T23:25:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.073+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1793106489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 msgr2=0x55ffbb825920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.075 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.073+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1793106489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb825920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55ffbb82c920 tx=0x7f71ac009260 comp rx=0 tx=0).stop 2023-10-06T23:25:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.074+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1793106489 shutdown_connections 2023-10-06T23:25:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.074+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1793106489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb7fae20 0x55ffbb7f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.074+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1793106489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb804d90 0x55ffbb81d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.074+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/1793106489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb825920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.074+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1793106489 >> 172.21.15.8:0/1793106489 conn(0x55ffbb76f200 msgr2=0x55ffbb8309d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.074+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1793106489 shutdown_connections 2023-10-06T23:25:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.074+0000 7f71d10c9b80 1 -- 172.21.15.8:0/1793106489 wait complete. 2023-10-06T23:25:20.076 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.074+0000 7f71d10c9b80 1 -- start start 2023-10-06T23:25:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.075+0000 7f71d10c9b80 1 Processor -- start 2023-10-06T23:25:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.075+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb8212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.075+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb821800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.075+0000 7f71d10c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 0x55ffbb824820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.075+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb824d60 con 0x55ffbb804d90 2023-10-06T23:25:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.075+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb824ed0 con 0x55ffbb7fb780 2023-10-06T23:25:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.075+0000 7f71d10c9b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffbb825090 con 0x55ffbb7fae20 2023-10-06T23:25:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.075+0000 7f71d10c9b80 10 client.0 _ll_register_callbacks cb 0x7f71a80d0aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.076+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb8212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.076+0000 7f71b6ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb8212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40064/0 (socket says 172.21.15.8:40064) 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.076+0000 7f71b6ffd700 1 -- 172.21.15.8:0/151527906 learned_addr learned my addr 172.21.15.8:0/151527906 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.076+0000 7f71b77fe700 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 0x55ffbb824820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.076+0000 7f71b67fc700 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb821800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f71b6ffd700 1 -- 172.21.15.8:0/151527906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 msgr2=0x55ffbb821800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb821800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f71b6ffd700 1 -- 172.21.15.8:0/151527906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 msgr2=0x55ffbb824820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 0x55ffbb824820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f71b6ffd700 1 -- 172.21.15.8:0/151527906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac009e30 con 0x55ffbb7fae20 2023-10-06T23:25:20.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f71b6ffd700 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb8212c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f71a80cac90 tx=0x7f71a80996d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39faf26eac999fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f719aff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:25:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f719aff5700 1 -- 172.21.15.8:0/151527906 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8096480 con 0x55ffbb7fae20 2023-10-06T23:25:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f71d10c9b80 1 -- 172.21.15.8:0/151527906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71a8099f10 con 0x55ffbb7fae20 2023-10-06T23:25:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.077+0000 7f719aff5700 1 -- 172.21.15.8:0/151527906 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f71a8010880 con 0x55ffbb7fae20 2023-10-06T23:25:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f719aff5700 1 -- 172.21.15.8:0/151527906 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a8099aa0 con 0x55ffbb7fae20 2023-10-06T23:25:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f71d10c9b80 10 client.26674 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:20.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f71d10c9b80 1 -- 172.21.15.8:0/151527906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ffbb577250 con 0x55ffbb7fae20 2023-10-06T23:25:20.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f719aff5700 1 -- 172.21.15.8:0/151527906 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71a8064020 con 0x55ffbb7fae20 2023-10-06T23:25:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f719aff5700 1 -- 172.21.15.8:0/151527906 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f71a80dd070 con 0x55ffbb7fae20 2023-10-06T23:25:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f71d10c9b80 10 client.26674 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f71d10c9b80 10 client.26674 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f71d10c9b80 20 client.26674 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ffbb87e260 0x55ffbb880680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f71d10c9b80 4 client.26674 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:25:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.078+0000 7f71d10c9b80 1 -- 172.21.15.8:0/151527906 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ffbb746ad0 con 0x55ffbb87e260 2023-10-06T23:25:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.079+0000 7f71b67fc700 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ffbb87e260 0x55ffbb880680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.079+0000 7f71b67fc700 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ffbb87e260 0x55ffbb880680 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eaa087b5f7e074e server_cookie=8644585fc8fcbf5f in_seq=0 out_seq=0 2023-10-06T23:25:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.079+0000 7f719aff5700 10 client.26674 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f719aff5700 1 -- 172.21.15.8:0/151527906 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ffbb746ad0 con 0x55ffbb87e260 2023-10-06T23:25:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f719aff5700 10 client.26674 handle_command_reply: tid=0 2023-10-06T23:25:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 client.26674 shutdown 2023-10-06T23:25:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 -- 172.21.15.8:0/151527906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 msgr2=0x55ffbb8212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb8212c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f71a80cac90 tx=0x7f71a80996d0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 -- 172.21.15.8:0/151527906 shutdown_connections 2023-10-06T23:25:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ffbb87e260 0x55ffbb880680 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ffbb804d90 0x55ffbb824820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffbb7fae20 0x55ffbb8212c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 --2- 172.21.15.8:0/151527906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffbb7fb780 0x55ffbb821800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 -- 172.21.15.8:0/151527906 >> 172.21.15.8:0/151527906 conn(0x55ffbb76f200 msgr2=0x55ffbb81d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f719aff5700 0 client.26674 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 -- 172.21.15.8:0/151527906 shutdown_connections 2023-10-06T23:25:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.095+0000 7f71d10c9b80 1 -- 172.21.15.8:0/151527906 wait complete. 2023-10-06T23:25:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.096+0000 7f71d10c9b80 20 client.26674 trim_cache size 0 max 16384 2023-10-06T23:25:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:25:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:25:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:25:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:25:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.096+0000 7f71bd7ff700 1 -- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71a00a1480 msgr2=0x7f71a00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.096+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71a00a1480 0x7f71a00a3940 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71b000b780 tx=0x7f71b0006210 comp rx=0 tx=0).stop 2023-10-06T23:25:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.096+0000 7f71bd7ff700 1 -- 172.21.15.8:0/1947821982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8101970 msgr2=0x7f71b8196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.096+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8101970 0x7f71b8196d30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f71a800e9f0 tx=0x7f71a800ed00 comp rx=0 tx=0).stop 2023-10-06T23:25:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.097+0000 7f71bd7ff700 1 -- 172.21.15.8:0/1947821982 shutdown_connections 2023-10-06T23:25:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.097+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f71a00a1480 0x7f71a00a3940 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.097+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71b8106bd0 0x7f71b8197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.097+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71b8101970 0x7f71b8196d30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.097+0000 7f71bd7ff700 1 --2- 172.21.15.8:0/1947821982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71b81042a0 0x7f71b8197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.097+0000 7f71bd7ff700 1 -- 172.21.15.8:0/1947821982 >> 172.21.15.8:0/1947821982 conn(0x7f71b80fb340 msgr2=0x7f71b8102640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.097+0000 7f71bd7ff700 1 -- 172.21.15.8:0/1947821982 shutdown_connections 2023-10-06T23:25:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:20.097+0000 7f71bd7ff700 1 -- 172.21.15.8:0/1947821982 wait complete. 2023-10-06T23:25:20.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:19 smithi156 ceph-mon[102862]: pgmap v725: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2023-10-06T23:25:21.021 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:25:21.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.329+0000 7f2a62dff700 1 -- 172.21.15.8:0/3803492521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c1019e0 msgr2=0x7f2a5c103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.329+0000 7f2a62dff700 1 --2- 172.21.15.8:0/3803492521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c1019e0 0x7f2a5c103dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009990 tx=0x7f2a50009ca0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.330+0000 7f2a62dff700 1 -- 172.21.15.8:0/3803492521 shutdown_connections 2023-10-06T23:25:21.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.330+0000 7f2a62dff700 1 --2- 172.21.15.8:0/3803492521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a5c106c40 0x7f2a5c109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.330+0000 7f2a62dff700 1 --2- 172.21.15.8:0/3803492521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c1019e0 0x7f2a5c103dd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.330+0000 7f2a62dff700 1 --2- 172.21.15.8:0/3803492521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a5c104310 0x7f2a5c106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.330+0000 7f2a62dff700 1 -- 172.21.15.8:0/3803492521 >> 172.21.15.8:0/3803492521 conn(0x7f2a5c0fb330 msgr2=0x7f2a5c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:21.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.330+0000 7f2a62dff700 1 -- 172.21.15.8:0/3803492521 shutdown_connections 2023-10-06T23:25:21.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.330+0000 7f2a62dff700 1 -- 172.21.15.8:0/3803492521 wait complete. 2023-10-06T23:25:21.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.331+0000 7f2a62dff700 1 Processor -- start 2023-10-06T23:25:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.332+0000 7f2a62dff700 1 -- start start 2023-10-06T23:25:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.332+0000 7f2a62dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a5c1019e0 0x7f2a5c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.332+0000 7f2a62dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c104310 0x7f2a5c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.332+0000 7f2a62dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a5c106c40 0x7f2a5c1a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.332+0000 7f2a62dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1a08d0 con 0x7f2a5c1019e0 2023-10-06T23:25:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.332+0000 7f2a62dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c06a8d0 con 0x7f2a5c106c40 2023-10-06T23:25:21.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.332+0000 7f2a62dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c06aa60 con 0x7f2a5c104310 2023-10-06T23:25:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c104310 0x7f2a5c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c104310 0x7f2a5c199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:40070/0 (socket says 172.21.15.8:40070) 2023-10-06T23:25:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a5bfff700 1 -- 172.21.15.8:0/993263488 learned_addr learned my addr 172.21.15.8:0/993263488 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:21.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a5c1019e0 0x7f2a5c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a6139c700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a5c106c40 0x7f2a5c1a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a5bfff700 1 -- 172.21.15.8:0/993263488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a5c106c40 msgr2=0x7f2a5c1a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a5c106c40 0x7f2a5c1a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a5bfff700 1 -- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a5c1019e0 msgr2=0x7f2a5c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a5c1019e0 0x7f2a5c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.333+0000 7f2a5bfff700 1 -- 172.21.15.8:0/993263488 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009c40 con 0x7f2a5c104310 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.334+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c104310 0x7f2a5c199290 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e9a0 tx=0x7f2a4800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.334+0000 7f2a59ffb700 1 -- 172.21.15.8:0/993263488 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800c9c0 con 0x7f2a5c104310 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.334+0000 7f2a59ffb700 1 -- 172.21.15.8:0/993263488 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a48010430 con 0x7f2a5c104310 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.334+0000 7f2a59ffb700 1 -- 172.21.15.8:0/993263488 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48018680 con 0x7f2a5c104310 2023-10-06T23:25:21.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.334+0000 7f2a62dff700 1 -- 172.21.15.8:0/993263488 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a500095f0 con 0x7f2a5c104310 2023-10-06T23:25:21.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.335+0000 7f2a62dff700 1 -- 172.21.15.8:0/993263488 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c06b0c0 con 0x7f2a5c104310 2023-10-06T23:25:21.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.340+0000 7f2a59ffb700 1 -- 172.21.15.8:0/993263488 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2a480105a0 con 0x7f2a5c104310 2023-10-06T23:25:21.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.341+0000 7f2a76666b80 1 Processor -- start 2023-10-06T23:25:21.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.342+0000 7f2a76666b80 1 -- start start 2023-10-06T23:25:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.342+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af5d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.342+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5dbc0 0x55b97af5e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.342+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af5eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.342+0000 7f2a76666b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97aec5460 con 0x55b97af5dbc0 2023-10-06T23:25:21.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.342+0000 7f2a76666b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97aeb6c20 con 0x55b97af5d260 2023-10-06T23:25:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.342+0000 7f2a76666b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97aeb4540 con 0x55b97af5ea60 2023-10-06T23:25:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a6139c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af5d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a6139c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af5d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43908/0 (socket says 172.21.15.8:43908) 2023-10-06T23:25:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a6139c700 1 -- 172.21.15.8:0/550341085 learned_addr learned my addr 172.21.15.8:0/550341085 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a59ffb700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2a4c0a9d10 0x7f2a4c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af5eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a59ffb700 1 -- 172.21.15.8:0/993263488 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2a48014070 con 0x7f2a5c104310 2023-10-06T23:25:21.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5dbc0 0x55b97af5e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a5bfff700 1 -- 172.21.15.8:0/550341085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 msgr2=0x55b97af5d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:21.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af5d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a5bfff700 1 -- 172.21.15.8:0/550341085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5dbc0 msgr2=0x55b97af5e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5dbc0 0x55b97af5e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a5bfff700 1 -- 172.21.15.8:0/550341085 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b97acdade0 con 0x55b97af5ea60 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a6139c700 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af5d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.343+0000 7f2a6139c700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2a4c0a9d10 0x7f2a4c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.344+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af5eee0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2a480ca990 tx=0x7f2a48099f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6ec56b950b4c6f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.344+0000 7f2a46ffd700 1 -- 172.21.15.8:0/550341085 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48099b10 con 0x55b97af5ea60 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.344+0000 7f2a46ffd700 1 -- 172.21.15.8:0/550341085 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a480108a0 con 0x55b97af5ea60 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.344+0000 7f2a46ffd700 1 -- 172.21.15.8:0/550341085 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480caaa0 con 0x55b97af5ea60 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.344+0000 7f2a6139c700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2a4c0a9d10 0x7f2a4c0ac1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009f80 tx=0x7f2a54004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.345+0000 7f2a76666b80 1 -- 172.21.15.8:0/550341085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 msgr2=0x55b97af5eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.345+0000 7f2a76666b80 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af5eee0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2a480ca990 tx=0x7f2a48099f80 comp rx=0 tx=0).stop 2023-10-06T23:25:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.345+0000 7f2a76666b80 1 -- 172.21.15.8:0/550341085 shutdown_connections 2023-10-06T23:25:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.345+0000 7f2a76666b80 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af5eee0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.345+0000 7f2a76666b80 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af5d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.345+0000 7f2a76666b80 1 --2- 172.21.15.8:0/550341085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5dbc0 0x55b97af5e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.345+0000 7f2a76666b80 1 -- 172.21.15.8:0/550341085 >> 172.21.15.8:0/550341085 conn(0x55b97aed1260 msgr2=0x55b97af58140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:21.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.346+0000 7f2a76666b80 1 -- 172.21.15.8:0/550341085 shutdown_connections 2023-10-06T23:25:21.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.346+0000 7f2a76666b80 1 -- 172.21.15.8:0/550341085 wait complete. 2023-10-06T23:25:21.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.346+0000 7f2a76666b80 1 -- start start 2023-10-06T23:25:21.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.347+0000 7f2a76666b80 1 Processor -- start 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.347+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 0x55b97af66f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.347+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.347+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af6e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.347+0000 7f2a76666b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97aeafe30 con 0x55b97af5d260 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.347+0000 7f2a76666b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97ae4c710 con 0x55b97af5dbc0 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.347+0000 7f2a76666b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97ae4c3b0 con 0x55b97af5ea60 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.347+0000 7f2a76666b80 10 client.0 _ll_register_callbacks cb 0x55b97aca9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af674c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43910/0 (socket says 172.21.15.8:43910) 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a5bfff700 1 -- 172.21.15.8:0/2823849165 learned_addr learned my addr 172.21.15.8:0/2823849165 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:21.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 0x55b97af66f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a6139c700 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af6e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a5bfff700 1 -- 172.21.15.8:0/2823849165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 msgr2=0x55b97af6e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:21.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af6e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a5bfff700 1 -- 172.21.15.8:0/2823849165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 msgr2=0x55b97af66f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:21.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 0x55b97af66f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.348+0000 7f2a5bfff700 1 -- 172.21.15.8:0/2823849165 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5400e4d0 con 0x55b97af5dbc0 2023-10-06T23:25:21.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.349+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af674c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2a48010c50 tx=0x7f2a4809e300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ffa1bb61ab1dac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:21.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.349+0000 7f2a3bfff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:25:21.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.349+0000 7f2a3bfff700 1 -- 172.21.15.8:0/2823849165 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480998a0 con 0x55b97af5dbc0 2023-10-06T23:25:21.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.349+0000 7f2a3bfff700 1 -- 172.21.15.8:0/2823849165 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2a4809a8b0 con 0x55b97af5dbc0 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.349+0000 7f2a76666b80 1 -- 172.21.15.8:0/2823849165 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b97af4ff10 con 0x55b97af5dbc0 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.349+0000 7f2a3bfff700 1 -- 172.21.15.8:0/2823849165 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a480a20b0 con 0x55b97af5dbc0 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.349+0000 7f2a76666b80 10 client.26672 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.349+0000 7f2a76666b80 1 -- 172.21.15.8:0/2823849165 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f2a5c06b0c0 con 0x55b97af5dbc0 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.350+0000 7f2a3bfff700 1 -- 172.21.15.8:0/2823849165 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a480b6020 con 0x55b97af5dbc0 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.350+0000 7f2a3bfff700 1 -- 172.21.15.8:0/2823849165 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2a480961a0 con 0x55b97af5dbc0 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.350+0000 7f2a76666b80 10 client.26672 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.350+0000 7f2a76666b80 10 client.26672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.350+0000 7f2a76666b80 20 client.26672 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.350+0000 7f2a76666b80 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b97af72940 0x55b97af74d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.350+0000 7f2a76666b80 4 client.26672 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:25:21.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.350+0000 7f2a76666b80 1 -- 172.21.15.8:0/2823849165 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b97aea8e10 con 0x55b97af72940 2023-10-06T23:25:21.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.351+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b97af72940 0x55b97af74d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.351+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b97af72940 0x55b97af74d60 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1926edd232d463 server_cookie=2f8a5d3a8bb49679 in_seq=0 out_seq=0 2023-10-06T23:25:21.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.351+0000 7f2a3bfff700 10 client.26672 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:21.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.353+0000 7f2a3bfff700 1 -- 172.21.15.8:0/2823849165 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b97aea8e10 con 0x55b97af72940 2023-10-06T23:25:21.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.353+0000 7f2a3bfff700 10 client.26672 handle_command_reply: tid=0 2023-10-06T23:25:21.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.353+0000 7f2a76666b80 1 client.26672 shutdown 2023-10-06T23:25:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a76666b80 1 -- 172.21.15.8:0/2823849165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 msgr2=0x55b97af674c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a76666b80 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af674c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2a48010c50 tx=0x7f2a4809e300 comp rx=0 tx=0).stop 2023-10-06T23:25:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a76666b80 1 -- 172.21.15.8:0/2823849165 shutdown_connections 2023-10-06T23:25:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a76666b80 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b97af72940 0x55b97af74d60 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a76666b80 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 0x55b97af66f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a76666b80 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af6e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a76666b80 1 --2- 172.21.15.8:0/2823849165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af674c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a76666b80 1 -- 172.21.15.8:0/2823849165 >> 172.21.15.8:0/2823849165 conn(0x55b97aed1260 msgr2=0x55b97af57f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:21.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.354+0000 7f2a3bfff700 0 client.26672 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:21.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.355+0000 7f2a76666b80 1 -- 172.21.15.8:0/2823849165 shutdown_connections 2023-10-06T23:25:21.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.355+0000 7f2a76666b80 1 -- 172.21.15.8:0/2823849165 wait complete. 2023-10-06T23:25:21.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.355+0000 7f2a76666b80 20 client.26672 trim_cache size 0 max 16384 2023-10-06T23:25:21.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.381+0000 7f2a76666b80 1 Processor -- start 2023-10-06T23:25:21.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.381+0000 7f2a76666b80 1 -- start start 2023-10-06T23:25:21.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 0x55b97af64e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af6e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a76666b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97ad30920 con 0x55b97af5d260 2023-10-06T23:25:21.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a76666b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97af5cee0 con 0x55b97af5dbc0 2023-10-06T23:25:21.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a76666b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97af66430 con 0x55b97af5ea60 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af6e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af6e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43920/0 (socket says 172.21.15.8:43920) 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a5bfff700 1 -- 172.21.15.8:0/3814661436 learned_addr learned my addr 172.21.15.8:0/3814661436 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.382+0000 7f2a6139c700 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.383+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 0x55b97af64e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.383+0000 7f2a5bfff700 1 -- 172.21.15.8:0/3814661436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 msgr2=0x55b97af619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.383+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.383+0000 7f2a5bfff700 1 -- 172.21.15.8:0/3814661436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 msgr2=0x55b97af64e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.383+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 0x55b97af64e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.383+0000 7f2a5bfff700 1 -- 172.21.15.8:0/3814661436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b97acc3c60 con 0x55b97af5dbc0 2023-10-06T23:25:21.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.383+0000 7f2a6139c700 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:25:21.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.383+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af6e4c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e970 tx=0x7f2a48099f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de9a9ecb77f77e26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:21.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.384+0000 7f2a477fe700 1 -- 172.21.15.8:0/3814661436 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480b84b0 con 0x55b97af5dbc0 2023-10-06T23:25:21.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.384+0000 7f2a477fe700 1 -- 172.21.15.8:0/3814661436 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a480b6070 con 0x55b97af5dbc0 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.384+0000 7f2a477fe700 1 -- 172.21.15.8:0/3814661436 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480a2310 con 0x55b97af5dbc0 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 -- 172.21.15.8:0/3814661436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 msgr2=0x55b97af6e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af6e4c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e970 tx=0x7f2a48099f80 comp rx=0 tx=0).stop 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 -- 172.21.15.8:0/3814661436 shutdown_connections 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5d260 0x55b97af64e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5ea60 0x55b97af619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 --2- 172.21.15.8:0/3814661436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5dbc0 0x55b97af6e4c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 -- 172.21.15.8:0/3814661436 >> 172.21.15.8:0/3814661436 conn(0x55b97aed1260 msgr2=0x55b97af6edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:21.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 -- 172.21.15.8:0/3814661436 shutdown_connections 2023-10-06T23:25:21.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.385+0000 7f2a76666b80 1 -- 172.21.15.8:0/3814661436 wait complete. 2023-10-06T23:25:21.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.386+0000 7f2a76666b80 1 -- start start 2023-10-06T23:25:21.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.386+0000 7f2a76666b80 1 Processor -- start 2023-10-06T23:25:21.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.387+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af6bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.387+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5dbc0 0x55b97af6c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.387+0000 7f2a76666b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5ea60 0x55b97af6d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.387+0000 7f2a76666b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97af6d7b0 con 0x55b97af5ea60 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.387+0000 7f2a76666b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97af6d920 con 0x55b97af5d260 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.387+0000 7f2a76666b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b97af6dae0 con 0x55b97af5dbc0 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.387+0000 7f2a76666b80 10 client.0 _ll_register_callbacks cb 0x7f2a5400e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.387+0000 7f2a60b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af6bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.388+0000 7f2a5bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5dbc0 0x55b97af6c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.389+0000 7f2a60b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af6bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:43934/0 (socket says 172.21.15.8:43934) 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.389+0000 7f2a60b9b700 1 -- 172.21.15.8:0/267385064 learned_addr learned my addr 172.21.15.8:0/267385064 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.390+0000 7f2a6139c700 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5ea60 0x55b97af6d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.391+0000 7f2a60b9b700 1 -- 172.21.15.8:0/267385064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5dbc0 msgr2=0x55b97af6c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:21.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.391+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5dbc0 0x55b97af6c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.391+0000 7f2a60b9b700 1 -- 172.21.15.8:0/267385064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5ea60 msgr2=0x55b97af6d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:21.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.391+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5ea60 0x55b97af6d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.391+0000 7f2a60b9b700 1 -- 172.21.15.8:0/267385064 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5400eaa0 con 0x55b97af5d260 2023-10-06T23:25:21.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.392+0000 7f2a60b9b700 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af6bd20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009990 tx=0x7f2a50005120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f94ce59c69c1610 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:21.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.392+0000 7f2a3bfff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:25:21.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.393+0000 7f2a3bfff700 1 -- 172.21.15.8:0/267385064 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5001d040 con 0x55b97af5d260 2023-10-06T23:25:21.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.393+0000 7f2a3bfff700 1 -- 172.21.15.8:0/267385064 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2a50027c70 con 0x55b97af5d260 2023-10-06T23:25:21.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.393+0000 7f2a76666b80 1 -- 172.21.15.8:0/267385064 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a480108a0 con 0x55b97af5d260 2023-10-06T23:25:21.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.393+0000 7f2a3bfff700 1 -- 172.21.15.8:0/267385064 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a50027e30 con 0x55b97af5d260 2023-10-06T23:25:21.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.393+0000 7f2a76666b80 10 client.26678 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:21.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.393+0000 7f2a76666b80 1 -- 172.21.15.8:0/267385064 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f2a5c06b0c0 con 0x55b97af5d260 2023-10-06T23:25:21.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.394+0000 7f2a3bfff700 1 -- 172.21.15.8:0/267385064 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a480108a0 con 0x55b97af5d260 2023-10-06T23:25:21.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.394+0000 7f2a3bfff700 1 -- 172.21.15.8:0/267385064 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2a5000b710 con 0x55b97af5d260 2023-10-06T23:25:21.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.395+0000 7f2a76666b80 10 client.26678 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:21.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.395+0000 7f2a76666b80 10 client.26678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:21.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.395+0000 7f2a76666b80 20 client.26678 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:21.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.395+0000 7f2a76666b80 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b97afc70f0 0x55b97afc94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:21.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.395+0000 7f2a76666b80 4 client.26678 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:25:21.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.395+0000 7f2a76666b80 1 -- 172.21.15.8:0/267385064 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b97aea8b30 con 0x55b97afc70f0 2023-10-06T23:25:21.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.396+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b97afc70f0 0x55b97afc94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:21.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.397+0000 7f2a5bfff700 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b97afc70f0 0x55b97afc94e0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08ccc0dd5218c75 server_cookie=1c617f5f185d0edf in_seq=0 out_seq=0 2023-10-06T23:25:21.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.397+0000 7f2a3bfff700 10 client.26678 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:21.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.397+0000 7f2a3bfff700 1 -- 172.21.15.8:0/267385064 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b97aea8b30 con 0x55b97afc70f0 2023-10-06T23:25:21.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.397+0000 7f2a3bfff700 10 client.26678 handle_command_reply: tid=0 2023-10-06T23:25:21.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.397+0000 7f2a76666b80 1 client.26678 shutdown 2023-10-06T23:25:21.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.397+0000 7f2a76666b80 1 -- 172.21.15.8:0/267385064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 msgr2=0x55b97af6bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.397+0000 7f2a76666b80 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af6bd20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009990 tx=0x7f2a50005120 comp rx=0 tx=0).stop 2023-10-06T23:25:21.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 1 -- 172.21.15.8:0/267385064 shutdown_connections 2023-10-06T23:25:21.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b97afc70f0 0x55b97afc94e0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b97af5ea60 0x55b97af6d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b97af5d260 0x55b97af6bd20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 1 --2- 172.21.15.8:0/267385064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b97af5dbc0 0x55b97af6c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 1 -- 172.21.15.8:0/267385064 >> 172.21.15.8:0/267385064 conn(0x55b97aed1260 msgr2=0x55b97af64e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:21.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a3bfff700 0 client.26678 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:21.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 1 -- 172.21.15.8:0/267385064 shutdown_connections 2023-10-06T23:25:21.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 1 -- 172.21.15.8:0/267385064 wait complete. 2023-10-06T23:25:21.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.398+0000 7f2a76666b80 20 client.26678 trim_cache size 0 max 16384 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:25:21.401 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:25:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.399+0000 7f2a62dff700 1 -- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2a4c0a9d10 msgr2=0x7f2a4c0ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.399+0000 7f2a62dff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2a4c0a9d10 0x7f2a4c0ac1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009f80 tx=0x7f2a54004ad0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.399+0000 7f2a62dff700 1 -- 172.21.15.8:0/993263488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c104310 msgr2=0x7f2a5c199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.399+0000 7f2a62dff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c104310 0x7f2a5c199290 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e9a0 tx=0x7f2a4800ecb0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.400+0000 7f2a62dff700 1 -- 172.21.15.8:0/993263488 shutdown_connections 2023-10-06T23:25:21.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.400+0000 7f2a62dff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f2a4c0a9d10 0x7f2a4c0ac1d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.400+0000 7f2a62dff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a5c1019e0 0x7f2a5c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.400+0000 7f2a62dff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a5c106c40 0x7f2a5c1a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.400+0000 7f2a62dff700 1 --2- 172.21.15.8:0/993263488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a5c104310 0x7f2a5c199290 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:21.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.400+0000 7f2a62dff700 1 -- 172.21.15.8:0/993263488 >> 172.21.15.8:0/993263488 conn(0x7f2a5c0fb330 msgr2=0x7f2a5c102650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:21.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.400+0000 7f2a62dff700 1 -- 172.21.15.8:0/993263488 shutdown_connections 2023-10-06T23:25:21.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:21.400+0000 7f2a62dff700 1 -- 172.21.15.8:0/993263488 wait complete. 2023-10-06T23:25:21.421 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:25:21.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:21 smithi008 ceph-mon[98532]: pgmap v726: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 5.7 MiB/s wr, 560 op/s 2023-10-06T23:25:21.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:21 smithi190 ceph-mon[102658]: pgmap v726: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 5.7 MiB/s wr, 560 op/s 2023-10-06T23:25:22.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:21 smithi156 ceph-mon[102862]: pgmap v726: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 5.7 MiB/s wr, 560 op/s 2023-10-06T23:25:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:23 smithi156 ceph-mon[102862]: pgmap v727: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 5.9 MiB/s wr, 558 op/s 2023-10-06T23:25:23.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:23 smithi008 ceph-mon[98532]: pgmap v727: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 5.9 MiB/s wr, 558 op/s 2023-10-06T23:25:23.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:23 smithi190 ceph-mon[102658]: pgmap v727: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 5.9 MiB/s wr, 558 op/s 2023-10-06T23:25:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 630.0 s, 258.8 tps, lat 382.935 ms stddev 64.317 2023-10-06T23:25:25.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:25 smithi008 ceph-mon[98532]: pgmap v728: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 6.0 MiB/s wr, 575 op/s 2023-10-06T23:25:25.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:25 smithi190 ceph-mon[102658]: pgmap v728: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 6.0 MiB/s wr, 575 op/s 2023-10-06T23:25:26.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:25 smithi156 ceph-mon[102862]: pgmap v728: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 6.0 MiB/s wr, 575 op/s 2023-10-06T23:25:27.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:27 smithi008 ceph-mon[98532]: pgmap v729: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 4.9 MiB/s wr, 500 op/s 2023-10-06T23:25:27.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:27 smithi190 ceph-mon[102658]: pgmap v729: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 4.9 MiB/s wr, 500 op/s 2023-10-06T23:25:28.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:27 smithi156 ceph-mon[102862]: pgmap v729: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 4.9 MiB/s wr, 500 op/s 2023-10-06T23:25:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 635.0 s, 257.0 tps, lat 394.237 ms stddev 68.303 2023-10-06T23:25:29.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:29 smithi008 ceph-mon[98532]: pgmap v730: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.2 MiB/s wr, 445 op/s 2023-10-06T23:25:29.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:29 smithi190 ceph-mon[102658]: pgmap v730: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.2 MiB/s wr, 445 op/s 2023-10-06T23:25:30.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:29 smithi156 ceph-mon[102862]: pgmap v730: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.2 MiB/s wr, 445 op/s 2023-10-06T23:25:31.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:31 smithi008 ceph-mon[98532]: pgmap v731: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 5.6 MiB/s wr, 555 op/s 2023-10-06T23:25:31.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:31 smithi190 ceph-mon[102658]: pgmap v731: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 5.6 MiB/s wr, 555 op/s 2023-10-06T23:25:32.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:31 smithi156 ceph-mon[102862]: pgmap v731: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 5.6 MiB/s wr, 555 op/s 2023-10-06T23:25:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.321+0000 7f3b15dff700 1 -- 172.21.15.8:0/837440255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b10076ab0 msgr2=0x7f3b10076f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.321+0000 7f3b15dff700 1 --2- 172.21.15.8:0/837440255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b10076ab0 0x7f3b10076f30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3b040098f0 tx=0x7f3b04009c00 comp rx=0 tx=0).stop 2023-10-06T23:25:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.321+0000 7f3b15dff700 1 -- 172.21.15.8:0/837440255 shutdown_connections 2023-10-06T23:25:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.321+0000 7f3b15dff700 1 --2- 172.21.15.8:0/837440255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b10077470 0x7f3b10077cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.321+0000 7f3b15dff700 1 --2- 172.21.15.8:0/837440255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10075870 0x7f3b10075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.321+0000 7f3b15dff700 1 --2- 172.21.15.8:0/837440255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b10076ab0 0x7f3b10076f30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.321+0000 7f3b15dff700 1 -- 172.21.15.8:0/837440255 >> 172.21.15.8:0/837440255 conn(0x7f3b100fe660 msgr2=0x7f3b10100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.322+0000 7f3b15dff700 1 -- 172.21.15.8:0/837440255 shutdown_connections 2023-10-06T23:25:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.322+0000 7f3b15dff700 1 -- 172.21.15.8:0/837440255 wait complete. 2023-10-06T23:25:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.323+0000 7f3b15dff700 1 Processor -- start 2023-10-06T23:25:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.324+0000 7f3b15dff700 1 -- start start 2023-10-06T23:25:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.324+0000 7f3b15dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10075870 0x7f3b1019d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.324+0000 7f3b15dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b10076ab0 0x7f3b1019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.324+0000 7f3b15dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b10077470 0x7f3b1019e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.324+0000 7f3b15dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1019ec60 con 0x7f3b10076ab0 2023-10-06T23:25:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.324+0000 7f3b15dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1019edd0 con 0x7f3b10075870 2023-10-06T23:25:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.324+0000 7f3b15dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1019ef90 con 0x7f3b10077470 2023-10-06T23:25:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10075870 0x7f3b1019d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10075870 0x7f3b1019d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50312/0 (socket says 172.21.15.8:50312) 2023-10-06T23:25:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/305613908 learned_addr learned my addr 172.21.15.8:0/305613908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0effd700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b10076ab0 0x7f3b1019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0ffff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b10077470 0x7f3b1019e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/305613908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b10077470 msgr2=0x7f3b1019e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b10077470 0x7f3b1019e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b10076ab0 msgr2=0x7f3b1019d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b10076ab0 0x7f3b1019d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/305613908 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04009520 con 0x7f3b10075870 2023-10-06T23:25:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.325+0000 7f3b0effd700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b10076ab0 0x7f3b1019d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:25:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.326+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10075870 0x7f3b1019d240 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000e9c0 tx=0x7f3b0000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.326+0000 7f3b0cff9700 1 -- 172.21.15.8:0/305613908 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000cbd0 con 0x7f3b10075870 2023-10-06T23:25:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.326+0000 7f3b0cff9700 1 -- 172.21.15.8:0/305613908 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b0000eeb0 con 0x7f3b10075870 2023-10-06T23:25:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.326+0000 7f3b0cff9700 1 -- 172.21.15.8:0/305613908 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00005410 con 0x7f3b10075870 2023-10-06T23:25:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.326+0000 7f3b15dff700 1 -- 172.21.15.8:0/305613908 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1019f270 con 0x7f3b10075870 2023-10-06T23:25:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.327+0000 7f3b15dff700 1 -- 172.21.15.8:0/305613908 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b101a5a30 con 0x7f3b10075870 2023-10-06T23:25:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.332+0000 7f3b0cff9700 1 -- 172.21.15.8:0/305613908 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3b00005590 con 0x7f3b10075870 2023-10-06T23:25:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.334+0000 7f3b297c2b80 1 Processor -- start 2023-10-06T23:25:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.334+0000 7f3b297c2b80 1 -- start start 2023-10-06T23:25:33.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.334+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410da2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 0x55be410db450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be41042400 con 0x55be410dafd0 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be41033bc0 con 0x55be410db990 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be410314e0 con 0x55be410d9ec0 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b0cff9700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3af80a1500 0x7f3af80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b0effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410da2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b0effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50326/0 (socket says 172.21.15.8:50326) 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b0effd700 1 -- 172.21.15.8:0/4029005634 learned_addr learned my addr 172.21.15.8:0/4029005634 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.335+0000 7f3b0cff9700 1 -- 172.21.15.8:0/305613908 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b00014070 con 0x7f3b10075870 2023-10-06T23:25:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.336+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/4029005634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 0x55be410db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.336+0000 7f3b0effd700 1 -- 172.21.15.8:0/4029005634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 msgr2=0x55be410da2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.336+0000 7f3b0effd700 1 --2- 172.21.15.8:0/4029005634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410da2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.336+0000 7f3b0effd700 1 -- 172.21.15.8:0/4029005634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 msgr2=0x55be410db450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.336+0000 7f3b0effd700 1 --2- 172.21.15.8:0/4029005634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 0x55be410db450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.336+0000 7f3b0effd700 1 -- 172.21.15.8:0/4029005634 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be40e57d80 con 0x55be410db990 2023-10-06T23:25:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.336+0000 7f3b0ffff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3af80a1500 0x7f3af80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.336+0000 7f3b0effd700 1 --2- 172.21.15.8:0/4029005634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e2220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009810 tx=0x7f3b0400bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a501f47bb2c5676 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.337+0000 7f3af5ffb700 1 -- 172.21.15.8:0/4029005634 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0401c040 con 0x55be410db990 2023-10-06T23:25:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.337+0000 7f3af5ffb700 1 -- 172.21.15.8:0/4029005634 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b0400b560 con 0x55be410db990 2023-10-06T23:25:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.337+0000 7f3af5ffb700 1 -- 172.21.15.8:0/4029005634 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b040052a0 con 0x55be410db990 2023-10-06T23:25:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 -- 172.21.15.8:0/4029005634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 msgr2=0x55be410e2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b0ffff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3af80a1500 0x7f3af80a39c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009ec0 tx=0x7f3b08004b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/4029005634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e2220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009810 tx=0x7f3b0400bec0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 -- 172.21.15.8:0/4029005634 shutdown_connections 2023-10-06T23:25:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/4029005634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e2220 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/4029005634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410da2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/4029005634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 0x55be410db450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 -- 172.21.15.8:0/4029005634 >> 172.21.15.8:0/4029005634 conn(0x55be4104e200 msgr2=0x55be410d4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 -- 172.21.15.8:0/4029005634 shutdown_connections 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.338+0000 7f3b297c2b80 1 -- 172.21.15.8:0/4029005634 wait complete. 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.339+0000 7f3b297c2b80 1 -- start start 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.339+0000 7f3b297c2b80 1 Processor -- start 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410d9ec0 0x55be410e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 0x55be410e4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410db990 0x55be410eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4102cdd0 con 0x55be410dafd0 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be40fc96b0 con 0x55be410d9ec0 2023-10-06T23:25:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be40fc9350 con 0x55be410db990 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b297c2b80 10 client.0 _ll_register_callbacks cb 0x55be40e267a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410d9ec0 0x55be410e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410db990 0x55be410eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410d9ec0 0x55be410e3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:50328/0 (socket says 172.21.15.8:50328) 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.340+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/2393346828 learned_addr learned my addr 172.21.15.8:0/2393346828 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.341+0000 7f3b0effd700 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 0x55be410e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.341+0000 7f3b0ffff700 1 -- 172.21.15.8:0/2393346828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410d9ec0 msgr2=0x55be410e3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.341+0000 7f3b0ffff700 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410d9ec0 0x55be410e3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.341+0000 7f3b0ffff700 1 -- 172.21.15.8:0/2393346828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 msgr2=0x55be410e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.341+0000 7f3b0ffff700 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 0x55be410e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.341+0000 7f3b0ffff700 1 -- 172.21.15.8:0/2393346828 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b10078720 con 0x55be410db990 2023-10-06T23:25:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.341+0000 7f3b0ffff700 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410db990 0x55be410eb060 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3b08004240 tx=0x7f3b08004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2deda7536352cb0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.341+0000 7f3aeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.342+0000 7f3aeeffd700 1 -- 172.21.15.8:0/2393346828 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800e040 con 0x55be410db990 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.342+0000 7f3aeeffd700 1 -- 172.21.15.8:0/2393346828 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b08007710 con 0x55be410db990 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.342+0000 7f3b297c2b80 1 -- 172.21.15.8:0/2393346828 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be410ccd50 con 0x55be410db990 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.342+0000 7f3aeeffd700 1 -- 172.21.15.8:0/2393346828 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b080078d0 con 0x55be410db990 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.342+0000 7f3b297c2b80 10 client.26704 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.342+0000 7f3b297c2b80 1 -- 172.21.15.8:0/2393346828 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55be40e40c00 con 0x55be410db990 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.343+0000 7f3aeeffd700 1 -- 172.21.15.8:0/2393346828 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55be410ccd50 con 0x55be410db990 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.343+0000 7f3aeeffd700 1 -- 172.21.15.8:0/2393346828 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b0801ac00 con 0x55be410db990 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.343+0000 7f3b297c2b80 10 client.26704 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.343+0000 7f3b297c2b80 10 client.26704 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.343+0000 7f3b297c2b80 20 client.26704 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.343+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be410ef960 0x55be410f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.343+0000 7f3b297c2b80 4 client.26704 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:25:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.343+0000 7f3b297c2b80 1 -- 172.21.15.8:0/2393346828 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be41025db0 con 0x55be410ef960 2023-10-06T23:25:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.344+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be410ef960 0x55be410f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.344+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be410ef960 0x55be410f1d80 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46afd52968e9299a server_cookie=334b519dde8a2996 in_seq=0 out_seq=0 2023-10-06T23:25:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.345+0000 7f3aeeffd700 10 client.26704 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.345+0000 7f3aeeffd700 1 -- 172.21.15.8:0/2393346828 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55be41025db0 con 0x55be410ef960 2023-10-06T23:25:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.345+0000 7f3aeeffd700 10 client.26704 handle_command_reply: tid=0 2023-10-06T23:25:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 client.26704 shutdown 2023-10-06T23:25:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 -- 172.21.15.8:0/2393346828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410db990 msgr2=0x55be410eb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410db990 0x55be410eb060 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3b08004240 tx=0x7f3b08004ad0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 -- 172.21.15.8:0/2393346828 shutdown_connections 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be410ef960 0x55be410f1d80 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410db990 0x55be410eb060 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410d9ec0 0x55be410e3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/2393346828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410dafd0 0x55be410e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3aeeffd700 0 client.26704 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 -- 172.21.15.8:0/2393346828 >> 172.21.15.8:0/2393346828 conn(0x55be4104e200 msgr2=0x55be410d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.346+0000 7f3b297c2b80 1 -- 172.21.15.8:0/2393346828 shutdown_connections 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.347+0000 7f3b297c2b80 1 -- 172.21.15.8:0/2393346828 wait complete. 2023-10-06T23:25:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.347+0000 7f3b297c2b80 20 client.26704 trim_cache size 0 max 16384 2023-10-06T23:25:33.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.370+0000 7f3b297c2b80 1 Processor -- start 2023-10-06T23:25:33.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.370+0000 7f3b297c2b80 1 -- start start 2023-10-06T23:25:33.371 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.370+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410d9ec0 0x55be410e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.370+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410dafd0 0x55be410eb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.370+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.370+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be40ead8c0 con 0x55be410d9ec0 2023-10-06T23:25:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.370+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be410de450 con 0x55be410db990 2023-10-06T23:25:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.370+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be410d6680 con 0x55be410dafd0 2023-10-06T23:25:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410dafd0 0x55be410eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410d9ec0 0x55be410e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410d9ec0 0x55be410e3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40878/0 (socket says 172.21.15.8:40878) 2023-10-06T23:25:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/3926855977 learned_addr learned my addr 172.21.15.8:0/3926855977 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0ffff700 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/3926855977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410dafd0 msgr2=0x55be410eb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410dafd0 0x55be410eb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/3926855977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 msgr2=0x55be410e1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:33.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/3926855977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be40e7e1f0 con 0x55be410d9ec0 2023-10-06T23:25:33.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.371+0000 7f3b0effd700 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410dafd0 0x55be410eb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:25:33.374 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.372+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410d9ec0 0x55be410e3190 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3b0009a1a0 tx=0x7f3b000ca8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4564d4ab27fa4835 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.372+0000 7f3af67fc700 1 -- 172.21.15.8:0/3926855977 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0009e160 con 0x55be410d9ec0 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.372+0000 7f3af67fc700 1 -- 172.21.15.8:0/3926855977 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b0009a910 con 0x55be410d9ec0 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.372+0000 7f3af67fc700 1 -- 172.21.15.8:0/3926855977 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000cab00 con 0x55be410d9ec0 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3926855977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410d9ec0 msgr2=0x55be410e3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410d9ec0 0x55be410e3190 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3b0009a1a0 tx=0x7f3b000ca8c0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3926855977 shutdown_connections 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410d9ec0 0x55be410e3190 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410db990 0x55be410e1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3926855977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410dafd0 0x55be410eb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3926855977 >> 172.21.15.8:0/3926855977 conn(0x55be4104e200 msgr2=0x55be410e27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3926855977 shutdown_connections 2023-10-06T23:25:33.375 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.373+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3926855977 wait complete. 2023-10-06T23:25:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.374+0000 7f3b297c2b80 1 -- start start 2023-10-06T23:25:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.374+0000 7f3b297c2b80 1 Processor -- start 2023-10-06T23:25:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.375+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.375+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410dafd0 0x55be410e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.375+0000 7f3b297c2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410db990 0x55be410ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.375+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be410eaa10 con 0x55be410db990 2023-10-06T23:25:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.375+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be410eab80 con 0x55be410dafd0 2023-10-06T23:25:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.375+0000 7f3b297c2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be410ead40 con 0x55be410d9ec0 2023-10-06T23:25:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.375+0000 7f3b297c2b80 10 client.0 _ll_register_callbacks cb 0x55be40e267a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.375+0000 7f3b0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410db990 0x55be410ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410e8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:37922/0 (socket says 172.21.15.8:37922) 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/3012744428 learned_addr learned my addr 172.21.15.8:0/3012744428 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0effd700 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410dafd0 0x55be410e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/3012744428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410dafd0 msgr2=0x55be410e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410dafd0 0x55be410e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/3012744428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410db990 msgr2=0x55be410ea4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410db990 0x55be410ea4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.376+0000 7f3b0f7fe700 1 -- 172.21.15.8:0/3012744428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be40e57d80 con 0x55be410d9ec0 2023-10-06T23:25:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.377+0000 7f3b0f7fe700 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410e8f80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b00096710 tx=0x7f3b00009550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b213effbadb4e9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.377+0000 7f3aeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.377+0000 7f3aeeffd700 1 -- 172.21.15.8:0/3012744428 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0009a210 con 0x55be410d9ec0 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.377+0000 7f3aeeffd700 1 -- 172.21.15.8:0/3012744428 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b0009e360 con 0x55be410d9ec0 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.377+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3012744428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b0400b560 con 0x55be410d9ec0 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.377+0000 7f3aeeffd700 1 -- 172.21.15.8:0/3012744428 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b0009a470 con 0x55be410d9ec0 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.377+0000 7f3b297c2b80 10 client.26710 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.377+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3012744428 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f3b101a5a30 con 0x55be410d9ec0 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3aeeffd700 1 -- 172.21.15.8:0/3012744428 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b0400b560 con 0x55be410d9ec0 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3aeeffd700 1 -- 172.21.15.8:0/3012744428 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b000a2110 con 0x55be410d9ec0 2023-10-06T23:25:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3b297c2b80 10 client.26710 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3b297c2b80 10 client.26710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3b297c2b80 20 client.26710 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be41144410 0x55be41146830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3b297c2b80 4 client.26710 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:25:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3012744428 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55be41025ad0 con 0x55be41144410 2023-10-06T23:25:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.378+0000 7f3b0effd700 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be41144410 0x55be41146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.379+0000 7f3b0effd700 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be41144410 0x55be41146830 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e02c96b99e083634 server_cookie=351a1befb5d89d25 in_seq=0 out_seq=0 2023-10-06T23:25:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.379+0000 7f3aeeffd700 10 client.26710 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3aeeffd700 1 -- 172.21.15.8:0/3012744428 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55be41025ad0 con 0x55be41144410 2023-10-06T23:25:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3aeeffd700 10 client.26710 handle_command_reply: tid=0 2023-10-06T23:25:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 client.26710 shutdown 2023-10-06T23:25:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3012744428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 msgr2=0x55be410e8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410e8f80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b00096710 tx=0x7f3b00009550 comp rx=0 tx=0).stop 2023-10-06T23:25:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3012744428 shutdown_connections 2023-10-06T23:25:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55be41144410 0x55be41146830 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55be410db990 0x55be410ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be410d9ec0 0x55be410e8f80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3aeeffd700 0 client.26710 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 --2- 172.21.15.8:0/3012744428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55be410dafd0 0x55be410e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3012744428 >> 172.21.15.8:0/3012744428 conn(0x55be4104e200 msgr2=0x55be410e1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.395+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3012744428 shutdown_connections 2023-10-06T23:25:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.396+0000 7f3b297c2b80 1 -- 172.21.15.8:0/3012744428 wait complete. 2023-10-06T23:25:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.396+0000 7f3b297c2b80 20 client.26710 trim_cache size 0 max 16384 2023-10-06T23:25:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:25:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:25:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:25:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:25:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.396+0000 7f3b15dff700 1 -- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3af80a1500 msgr2=0x7f3af80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.396+0000 7f3b15dff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3af80a1500 0x7f3af80a39c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009ec0 tx=0x7f3b08004b40 comp rx=0 tx=0).stop 2023-10-06T23:25:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.396+0000 7f3b15dff700 1 -- 172.21.15.8:0/305613908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10075870 msgr2=0x7f3b1019d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.396+0000 7f3b15dff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10075870 0x7f3b1019d240 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000e9c0 tx=0x7f3b0000ecd0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.397+0000 7f3b15dff700 1 -- 172.21.15.8:0/305613908 shutdown_connections 2023-10-06T23:25:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.397+0000 7f3b15dff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f3af80a1500 0x7f3af80a39c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.397+0000 7f3b15dff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b10077470 0x7f3b1019e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.397+0000 7f3b15dff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10075870 0x7f3b1019d240 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.397+0000 7f3b15dff700 1 --2- 172.21.15.8:0/305613908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b10076ab0 0x7f3b1019d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.397+0000 7f3b15dff700 1 -- 172.21.15.8:0/305613908 >> 172.21.15.8:0/305613908 conn(0x7f3b100fe660 msgr2=0x7f3b10100440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.397+0000 7f3b15dff700 1 -- 172.21.15.8:0/305613908 shutdown_connections 2023-10-06T23:25:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:33.397+0000 7f3b15dff700 1 -- 172.21.15.8:0/305613908 wait complete. 2023-10-06T23:25:33.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:33 smithi156 ceph-mon[102862]: pgmap v732: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 4.4 MiB/s wr, 456 op/s 2023-10-06T23:25:33.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:33 smithi008 ceph-mon[98532]: pgmap v732: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 4.4 MiB/s wr, 456 op/s 2023-10-06T23:25:33.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:33 smithi190 ceph-mon[102658]: pgmap v732: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 4.4 MiB/s wr, 456 op/s 2023-10-06T23:25:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 640.0 s, 277.8 tps, lat 358.443 ms stddev 52.698 2023-10-06T23:25:35.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:35 smithi008 ceph-mon[98532]: pgmap v733: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.2 MiB/s wr, 458 op/s 2023-10-06T23:25:35.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:35 smithi190 ceph-mon[102658]: pgmap v733: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.2 MiB/s wr, 458 op/s 2023-10-06T23:25:36.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:35 smithi156 ceph-mon[102862]: pgmap v733: 97 pgs: 97 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.2 MiB/s wr, 458 op/s 2023-10-06T23:25:37.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:37 smithi008 ceph-mon[98532]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2023-10-06T23:25:37.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:37 smithi190 ceph-mon[102658]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2023-10-06T23:25:38.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:37 smithi156 ceph-mon[102862]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2023-10-06T23:25:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 645.0 s, 241.4 tps, lat 412.325 ms stddev 60.930 2023-10-06T23:25:39.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:39 smithi008 ceph-mon[98532]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2023-10-06T23:25:39.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:39 smithi190 ceph-mon[102658]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2023-10-06T23:25:40.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:39 smithi156 ceph-mon[102862]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.2 MiB/s wr, 510 op/s 2023-10-06T23:25:41.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:41 smithi008 ceph-mon[98532]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 6.0 MiB/s wr, 594 op/s 2023-10-06T23:25:41.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:41 smithi190 ceph-mon[102658]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 6.0 MiB/s wr, 594 op/s 2023-10-06T23:25:42.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:41 smithi156 ceph-mon[102862]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 6.0 MiB/s wr, 594 op/s 2023-10-06T23:25:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:43 smithi156 ceph-mon[102862]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.6 MiB/s wr, 493 op/s 2023-10-06T23:25:43.900 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:43 smithi008 ceph-mon[98532]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.6 MiB/s wr, 493 op/s 2023-10-06T23:25:43.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:43 smithi190 ceph-mon[102658]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.6 MiB/s wr, 493 op/s 2023-10-06T23:25:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 650.0 s, 259.6 tps, lat 386.053 ms stddev 64.976 2023-10-06T23:25:45.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:45 smithi008 ceph-mon[98532]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2023-10-06T23:25:45.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:45 smithi190 ceph-mon[102658]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2023-10-06T23:25:46.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:45 smithi156 ceph-mon[102862]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2023-10-06T23:25:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.554+0000 7fe141fff700 1 -- 172.21.15.8:0/3858989643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c108dc0 msgr2=0x7fe13c10b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.554+0000 7fe141fff700 1 --2- 172.21.15.8:0/3858989643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c108dc0 0x7fe13c10b250 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b0a0 tx=0x7fe13400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.554+0000 7fe141fff700 1 -- 172.21.15.8:0/3858989643 shutdown_connections 2023-10-06T23:25:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.554+0000 7fe141fff700 1 --2- 172.21.15.8:0/3858989643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c108dc0 0x7fe13c10b250 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.554+0000 7fe141fff700 1 --2- 172.21.15.8:0/3858989643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13c074ef0 0x7fe13c073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.554+0000 7fe141fff700 1 --2- 172.21.15.8:0/3858989643 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe13c073910 0x7fe13c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.554+0000 7fe141fff700 1 -- 172.21.15.8:0/3858989643 >> 172.21.15.8:0/3858989643 conn(0x7fe13c0fc430 msgr2=0x7fe13c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.555+0000 7fe141fff700 1 -- 172.21.15.8:0/3858989643 shutdown_connections 2023-10-06T23:25:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.555+0000 7fe141fff700 1 -- 172.21.15.8:0/3858989643 wait complete. 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe141fff700 1 Processor -- start 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe141fff700 1 -- start start 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe141fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c073910 0x7fe13c198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe141fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe13c074ef0 0x7fe13c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe141fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13c108dc0 0x7fe13c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe141fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c19a8f0 con 0x7fe13c073910 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe141fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c19aa60 con 0x7fe13c074ef0 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe141fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c19ac20 con 0x7fe13c108dc0 2023-10-06T23:25:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe13b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c073910 0x7fe13c198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe13b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c073910 0x7fe13c198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35264/0 (socket says 172.21.15.8:35264) 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.556+0000 7fe13b7fe700 1 -- 172.21.15.8:0/3098482907 learned_addr learned my addr 172.21.15.8:0/3098482907 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe13affd700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe13c074ef0 0x7fe13c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe13bfff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13c108dc0 0x7fe13c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe13b7fe700 1 -- 172.21.15.8:0/3098482907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13c108dc0 msgr2=0x7fe13c19a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13c108dc0 0x7fe13c19a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe13b7fe700 1 -- 172.21.15.8:0/3098482907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe13c074ef0 msgr2=0x7fe13c199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe13c074ef0 0x7fe13c199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe13b7fe700 1 -- 172.21.15.8:0/3098482907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134009d00 con 0x7fe13c073910 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c073910 0x7fe13c198ed0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00e9a0 tx=0x7fe12c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe138ff9700 1 -- 172.21.15.8:0/3098482907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c009790 con 0x7fe13c073910 2023-10-06T23:25:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe141fff700 1 -- 172.21.15.8:0/3098482907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13c19af00 con 0x7fe13c073910 2023-10-06T23:25:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe138ff9700 1 -- 172.21.15.8:0/3098482907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe12c010430 con 0x7fe13c073910 2023-10-06T23:25:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe138ff9700 1 -- 172.21.15.8:0/3098482907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00cea0 con 0x7fe13c073910 2023-10-06T23:25:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.557+0000 7fe141fff700 1 -- 172.21.15.8:0/3098482907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c1a16c0 con 0x7fe13c073910 2023-10-06T23:25:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.561+0000 7fe138ff9700 1 -- 172.21.15.8:0/3098482907 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe12c0105a0 con 0x7fe13c073910 2023-10-06T23:25:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.562+0000 7fe15585ab80 1 Processor -- start 2023-10-06T23:25:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.562+0000 7fe15585ab80 1 -- start start 2023-10-06T23:25:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.562+0000 7fe138ff9700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1240a1480 0x7fe1240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.562+0000 7fe138ff9700 1 -- 172.21.15.8:0/3098482907 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe12c014070 con 0x7fe13c073910 2023-10-06T23:25:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.562+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x56391168a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.562+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x56391168b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168b990 0x563911692220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13bfff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1240a1480 0x7fe1240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe15585ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639115f2400 con 0x56391168b990 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe15585ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639115e3bc0 con 0x56391168afd0 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe15585ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639115e14e0 con 0x563911689ec0 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x56391168a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168b990 0x563911692220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x56391168a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49388/0 (socket says 172.21.15.8:49388) 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 -- 172.21.15.8:0/1104130122 learned_addr learned my addr 172.21.15.8:0/1104130122 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13affd700 1 --2- 172.21.15.8:0/1104130122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x56391168b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 -- 172.21.15.8:0/1104130122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 msgr2=0x56391168b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/1104130122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x56391168b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 -- 172.21.15.8:0/1104130122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168b990 msgr2=0x563911692220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/1104130122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168b990 0x563911692220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 -- 172.21.15.8:0/1104130122 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563911407d80 con 0x563911689ec0 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.563+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/1104130122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x56391168a2e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe12c09a170 tx=0x7fe12c099c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3124fb71215c375f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.564+0000 7fe13bfff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1240a1480 0x7fe1240a3940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b780 tx=0x7fe1340093c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.564+0000 7fe121ffb700 1 -- 172.21.15.8:0/1104130122 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c09e120 con 0x563911689ec0 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.564+0000 7fe121ffb700 1 -- 172.21.15.8:0/1104130122 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe12c09a1e0 con 0x563911689ec0 2023-10-06T23:25:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.564+0000 7fe121ffb700 1 -- 172.21.15.8:0/1104130122 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0996d0 con 0x563911689ec0 2023-10-06T23:25:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.564+0000 7fe15585ab80 1 -- 172.21.15.8:0/1104130122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 msgr2=0x56391168a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.564+0000 7fe15585ab80 1 --2- 172.21.15.8:0/1104130122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x56391168a2e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe12c09a170 tx=0x7fe12c099c10 comp rx=0 tx=0).stop 2023-10-06T23:25:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 -- 172.21.15.8:0/1104130122 shutdown_connections 2023-10-06T23:25:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 --2- 172.21.15.8:0/1104130122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168b990 0x563911692220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 --2- 172.21.15.8:0/1104130122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x56391168a2e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 --2- 172.21.15.8:0/1104130122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x56391168b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 -- 172.21.15.8:0/1104130122 >> 172.21.15.8:0/1104130122 conn(0x5639115fe200 msgr2=0x563911684bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 -- 172.21.15.8:0/1104130122 shutdown_connections 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 -- 172.21.15.8:0/1104130122 wait complete. 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 -- start start 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.565+0000 7fe15585ab80 1 Processor -- start 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x563911693b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168afd0 0x5639116940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168b990 0x56391169b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe15585ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639115dcdd0 con 0x56391168afd0 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe15585ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639115796b0 con 0x56391168b990 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe15585ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563911579350 con 0x563911689ec0 2023-10-06T23:25:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe15585ab80 10 client.0 _ll_register_callbacks cb 0x5639113d67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe13affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168afd0 0x5639116940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe13affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168afd0 0x5639116940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35276/0 (socket says 172.21.15.8:35276) 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe13affd700 1 -- 172.21.15.8:0/4113563516 learned_addr learned my addr 172.21.15.8:0/4113563516 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.566+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x563911693b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe13bfff700 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168b990 0x56391169b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe13affd700 1 -- 172.21.15.8:0/4113563516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 msgr2=0x563911693b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe13affd700 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x563911693b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe13affd700 1 -- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168b990 msgr2=0x56391169b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe13affd700 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168b990 0x56391169b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe13affd700 1 -- 172.21.15.8:0/4113563516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c1a16c0 con 0x56391168afd0 2023-10-06T23:25:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe13bfff700 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168b990 0x56391169b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe13affd700 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168afd0 0x5639116940a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe130009610 tx=0x7fe1300119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb8e48ea8685510 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe11affd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe11affd700 1 -- 172.21.15.8:0/4113563516 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130016070 con 0x56391168afd0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe15585ab80 1 -- 172.21.15.8:0/4113563516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56391167cd50 con 0x56391168afd0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.567+0000 7fe11affd700 1 -- 172.21.15.8:0/4113563516 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe130004320 con 0x56391168afd0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe11affd700 1 -- 172.21.15.8:0/4113563516 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1300044e0 con 0x56391168afd0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe15585ab80 10 client.16818 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe15585ab80 1 -- 172.21.15.8:0/4113563516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5639113f0c00 con 0x56391168afd0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe11affd700 1 -- 172.21.15.8:0/4113563516 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56391167cd50 con 0x56391168afd0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe11affd700 1 -- 172.21.15.8:0/4113563516 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe130025630 con 0x56391168afd0 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe15585ab80 10 client.16818 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe15585ab80 10 client.16818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe15585ab80 20 client.16818 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe15585ab80 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56391169f9e0 0x5639116a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.568+0000 7fe15585ab80 4 client.16818 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:25:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.569+0000 7fe15585ab80 1 -- 172.21.15.8:0/4113563516 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639115d5db0 con 0x56391169f9e0 2023-10-06T23:25:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.777+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56391169f9e0 0x5639116a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.777+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56391169f9e0 0x5639116a1e00 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d04c41653b8916c server_cookie=8f4e634289761743 in_seq=0 out_seq=0 2023-10-06T23:25:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.777+0000 7fe11affd700 10 client.16818 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe11affd700 1 -- 172.21.15.8:0/4113563516 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5639115d5db0 con 0x56391169f9e0 2023-10-06T23:25:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe11affd700 10 client.16818 handle_command_reply: tid=0 2023-10-06T23:25:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 client.16818 shutdown 2023-10-06T23:25:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 -- 172.21.15.8:0/4113563516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168afd0 msgr2=0x5639116940a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168afd0 0x5639116940a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe130009610 tx=0x7fe1300119a0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 -- 172.21.15.8:0/4113563516 shutdown_connections 2023-10-06T23:25:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56391169f9e0 0x5639116a1e00 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168b990 0x56391169b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563911689ec0 0x563911693b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 --2- 172.21.15.8:0/4113563516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56391168afd0 0x5639116940a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe15585ab80 1 -- 172.21.15.8:0/4113563516 >> 172.21.15.8:0/4113563516 conn(0x5639115fe200 msgr2=0x563911684250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.779+0000 7fe11affd700 0 client.16818 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.780+0000 7fe15585ab80 1 -- 172.21.15.8:0/4113563516 shutdown_connections 2023-10-06T23:25:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.780+0000 7fe15585ab80 1 -- 172.21.15.8:0/4113563516 wait complete. 2023-10-06T23:25:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.780+0000 7fe15585ab80 20 client.16818 trim_cache size 0 max 16384 2023-10-06T23:25:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.798+0000 7fe15585ab80 1 Processor -- start 2023-10-06T23:25:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.798+0000 7fe15585ab80 1 -- start start 2023-10-06T23:25:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x5639116927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x56391169b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x563911691e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe15585ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56391145d8c0 con 0x563911689ec0 2023-10-06T23:25:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe15585ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563911691c10 con 0x56391168afd0 2023-10-06T23:25:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe15585ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56391168aa90 con 0x56391168b990 2023-10-06T23:25:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe13b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x5639116927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe13bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x563911691e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe13b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x5639116927f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35282/0 (socket says 172.21.15.8:35282) 2023-10-06T23:25:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe13b7fe700 1 -- 172.21.15.8:0/1786859178 learned_addr learned my addr 172.21.15.8:0/1786859178 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.799+0000 7fe13affd700 1 --2- 172.21.15.8:0/1786859178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x56391169b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.800+0000 7fe13bfff700 1 -- 172.21.15.8:0/1786859178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 msgr2=0x56391169b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.800+0000 7fe13bfff700 1 --2- 172.21.15.8:0/1786859178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x56391169b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.800+0000 7fe13bfff700 1 -- 172.21.15.8:0/1786859178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 msgr2=0x5639116927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.800+0000 7fe13bfff700 1 --2- 172.21.15.8:0/1786859178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x5639116927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.800+0000 7fe13bfff700 1 -- 172.21.15.8:0/1786859178 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56391142e1f0 con 0x56391168b990 2023-10-06T23:25:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.800+0000 7fe13bfff700 1 --2- 172.21.15.8:0/1786859178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x563911691e60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b070 tx=0x7fe134023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=989c377a0d8ddf59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.800+0000 7fe1227fc700 1 -- 172.21.15.8:0/1786859178 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13400bdb0 con 0x56391168b990 2023-10-06T23:25:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.801+0000 7fe1227fc700 1 -- 172.21.15.8:0/1786859178 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe134003e90 con 0x56391168b990 2023-10-06T23:25:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.801+0000 7fe1227fc700 1 -- 172.21.15.8:0/1786859178 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13402a6a0 con 0x56391168b990 2023-10-06T23:25:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.801+0000 7fe15585ab80 1 -- 172.21.15.8:0/1786859178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 msgr2=0x563911691e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.801+0000 7fe15585ab80 1 --2- 172.21.15.8:0/1786859178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x563911691e60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b070 tx=0x7fe134023000 comp rx=0 tx=0).stop 2023-10-06T23:25:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.801+0000 7fe15585ab80 1 -- 172.21.15.8:0/1786859178 shutdown_connections 2023-10-06T23:25:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.801+0000 7fe15585ab80 1 --2- 172.21.15.8:0/1786859178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x5639116927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.801+0000 7fe15585ab80 1 --2- 172.21.15.8:0/1786859178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x563911691e60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.801+0000 7fe15585ab80 1 --2- 172.21.15.8:0/1786859178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x56391169b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.802+0000 7fe15585ab80 1 -- 172.21.15.8:0/1786859178 >> 172.21.15.8:0/1786859178 conn(0x5639115fe200 msgr2=0x5639116858b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.802+0000 7fe15585ab80 1 -- 172.21.15.8:0/1786859178 shutdown_connections 2023-10-06T23:25:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.802+0000 7fe15585ab80 1 -- 172.21.15.8:0/1786859178 wait complete. 2023-10-06T23:25:46.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.802+0000 7fe15585ab80 1 -- start start 2023-10-06T23:25:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.803+0000 7fe15585ab80 1 Processor -- start 2023-10-06T23:25:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.803+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x563911698e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.803+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x563911699340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.803+0000 7fe15585ab80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x56391169a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.803+0000 7fe15585ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56391169a890 con 0x563911689ec0 2023-10-06T23:25:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.803+0000 7fe15585ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56391169aa00 con 0x56391168afd0 2023-10-06T23:25:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.803+0000 7fe15585ab80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56391169abc0 con 0x56391168b990 2023-10-06T23:25:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.803+0000 7fe15585ab80 10 client.0 _ll_register_callbacks cb 0x7fe130009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x563911698e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x563911698e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35298/0 (socket says 172.21.15.8:35298) 2023-10-06T23:25:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13b7fe700 1 -- 172.21.15.8:0/3480222692 learned_addr learned my addr 172.21.15.8:0/3480222692 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13bfff700 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x56391169a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13affd700 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x563911699340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13bfff700 1 -- 172.21.15.8:0/3480222692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 msgr2=0x563911699340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13bfff700 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x563911699340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13bfff700 1 -- 172.21.15.8:0/3480222692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 msgr2=0x563911698e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13bfff700 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x563911698e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.804+0000 7fe13bfff700 1 -- 172.21.15.8:0/3480222692 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe134026070 con 0x56391168b990 2023-10-06T23:25:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.805+0000 7fe13bfff700 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x56391169a350 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b070 tx=0x7fe13400b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a79153c9d17e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.805+0000 7fe11affd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:25:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.805+0000 7fe11affd700 1 -- 172.21.15.8:0/3480222692 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13402e860 con 0x56391168b990 2023-10-06T23:25:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.805+0000 7fe15585ab80 1 -- 172.21.15.8:0/3480222692 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe12c09a1e0 con 0x56391168b990 2023-10-06T23:25:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.805+0000 7fe11affd700 1 -- 172.21.15.8:0/3480222692 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe13403fa20 con 0x56391168b990 2023-10-06T23:25:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.805+0000 7fe11affd700 1 -- 172.21.15.8:0/3480222692 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe13403fbe0 con 0x56391168b990 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe15585ab80 10 client.26728 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe15585ab80 1 -- 172.21.15.8:0/3480222692 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563911406250 con 0x56391168b990 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe11affd700 1 -- 172.21.15.8:0/3480222692 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe12c09a1e0 con 0x56391168b990 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe11affd700 1 -- 172.21.15.8:0/3480222692 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe134051070 con 0x56391168b990 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe15585ab80 10 client.26728 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe15585ab80 10 client.26728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe15585ab80 20 client.26728 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe15585ab80 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5639116f4430 0x5639116f6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe15585ab80 4 client.26728 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.806+0000 7fe15585ab80 1 -- 172.21.15.8:0/3480222692 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5639115d5ad0 con 0x5639116f4430 2023-10-06T23:25:46.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.807+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5639116f4430 0x5639116f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:46.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.808+0000 7fe11affd700 10 client.26728 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:46.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.808+0000 7fe13b7fe700 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5639116f4430 0x5639116f6850 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7cae080d18a668a server_cookie=87779c5d5d992061 in_seq=0 out_seq=0 2023-10-06T23:25:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe11affd700 1 -- 172.21.15.8:0/3480222692 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5639115d5ad0 con 0x5639116f4430 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe11affd700 10 client.26728 handle_command_reply: tid=0 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 client.26728 shutdown 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 -- 172.21.15.8:0/3480222692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 msgr2=0x56391169a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x56391169a350 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b070 tx=0x7fe13400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 -- 172.21.15.8:0/3480222692 shutdown_connections 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5639116f4430 0x5639116f6850 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563911689ec0 0x563911698e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe11affd700 0 client.26728 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56391168b990 0x56391169a350 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 --2- 172.21.15.8:0/3480222692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56391168afd0 0x563911699340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 -- 172.21.15.8:0/3480222692 >> 172.21.15.8:0/3480222692 conn(0x5639115fe200 msgr2=0x563911691e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 -- 172.21.15.8:0/3480222692 shutdown_connections 2023-10-06T23:25:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.828+0000 7fe15585ab80 1 -- 172.21.15.8:0/3480222692 wait complete. 2023-10-06T23:25:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.829+0000 7fe15585ab80 20 client.26728 trim_cache size 0 max 16384 2023-10-06T23:25:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:25:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:25:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:25:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 -- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1240a1480 msgr2=0x7fe1240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1240a1480 0x7fe1240a3940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b780 tx=0x7fe1340093c0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 -- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c073910 msgr2=0x7fe13c198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c073910 0x7fe13c198ed0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00e9a0 tx=0x7fe12c00ecb0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 -- 172.21.15.8:0/3098482907 shutdown_connections 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe1240a1480 0x7fe1240a3940 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe13c073910 0x7fe13c198ed0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe13c108dc0 0x7fe13c19a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 --2- 172.21.15.8:0/3098482907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe13c074ef0 0x7fe13c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 -- 172.21.15.8:0/3098482907 >> 172.21.15.8:0/3098482907 conn(0x7fe13c0fc430 msgr2=0x7fe13c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 -- 172.21.15.8:0/3098482907 shutdown_connections 2023-10-06T23:25:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:25:46.830+0000 7fe141fff700 1 -- 172.21.15.8:0/3098482907 wait complete. 2023-10-06T23:25:47.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:47 smithi008 ceph-mon[98532]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 5.5 MiB/s wr, 569 op/s 2023-10-06T23:25:47.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:47 smithi190 ceph-mon[102658]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 5.5 MiB/s wr, 569 op/s 2023-10-06T23:25:48.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:47 smithi156 ceph-mon[102862]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 5.5 MiB/s wr, 569 op/s 2023-10-06T23:25:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 655.0 s, 231.2 tps, lat 417.995 ms stddev 124.048 2023-10-06T23:25:49.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:49 smithi008 ceph-mon[98532]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2023-10-06T23:25:49.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:49 smithi190 ceph-mon[102658]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2023-10-06T23:25:50.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:49 smithi156 ceph-mon[102862]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2023-10-06T23:25:51.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:25:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 -- 172.21.15.8:0/2321070037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6884104270 msgr2=0x7f6884106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 --2- 172.21.15.8:0/2321070037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6884104270 0x7f6884106660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6874009990 tx=0x7f6874009ca0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 -- 172.21.15.8:0/2321070037 shutdown_connections 2023-10-06T23:25:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 --2- 172.21.15.8:0/2321070037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6884106ba0 0x7f6884109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 --2- 172.21.15.8:0/2321070037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6884101940 0x7f6884103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 --2- 172.21.15.8:0/2321070037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6884104270 0x7f6884106660 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 -- 172.21.15.8:0/2321070037 >> 172.21.15.8:0/2321070037 conn(0x7f68840fb330 msgr2=0x7f68840fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:51.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 -- 172.21.15.8:0/2321070037 shutdown_connections 2023-10-06T23:25:51.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.730+0000 7f688c1ff700 1 -- 172.21.15.8:0/2321070037 wait complete. 2023-10-06T23:25:51.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.732+0000 7f688c1ff700 1 Processor -- start 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.732+0000 7f688c1ff700 1 -- start start 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.732+0000 7f688c1ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6884101940 0x7f6884198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f688c1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6884104270 0x7f6884199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f688c1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6884106ba0 0x7f68841a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f688c1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68841a0850 con 0x7f6884106ba0 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f688c1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68841a09c0 con 0x7f6884104270 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f688c1ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68841a0b80 con 0x7f6884101940 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6884101940 0x7f6884198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f688a79c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6884106ba0 0x7f68841a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6884101940 0x7f6884198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:53112/0 (socket says 172.21.15.8:53112) 2023-10-06T23:25:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f6889f9b700 1 -- 172.21.15.8:0/1553233554 learned_addr learned my addr 172.21.15.8:0/1553233554 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f688979a700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6884104270 0x7f6884199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f6889f9b700 1 -- 172.21.15.8:0/1553233554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6884104270 msgr2=0x7f6884199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f6889f9b700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6884104270 0x7f6884199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f6889f9b700 1 -- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6884106ba0 msgr2=0x7f68841a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f6889f9b700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6884106ba0 0x7f68841a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f6889f9b700 1 -- 172.21.15.8:0/1553233554 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740095f0 con 0x7f6884101940 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.733+0000 7f688a79c700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6884106ba0 0x7f68841a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.734+0000 7f6889f9b700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6884101940 0x7f6884198d10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f688000ef10 tx=0x7f688000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.734+0000 7f687affd700 1 -- 172.21.15.8:0/1553233554 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000c9c0 con 0x7f6884101940 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.734+0000 7f688c1ff700 1 -- 172.21.15.8:0/1553233554 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68841a0e00 con 0x7f6884101940 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.734+0000 7f687affd700 1 -- 172.21.15.8:0/1553233554 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f688000f040 con 0x7f6884101940 2023-10-06T23:25:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.734+0000 7f687affd700 1 -- 172.21.15.8:0/1553233554 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880014480 con 0x7f6884101940 2023-10-06T23:25:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.734+0000 7f688c1ff700 1 -- 172.21.15.8:0/1553233554 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68841a1230 con 0x7f6884101940 2023-10-06T23:25:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.738+0000 7f687affd700 1 -- 172.21.15.8:0/1553233554 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6880007690 con 0x7f6884101940 2023-10-06T23:25:51.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.739+0000 7f687affd700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68700a1480 0x7f68700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.739+0000 7f689fb14b80 1 Processor -- start 2023-10-06T23:25:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.739+0000 7f687affd700 1 -- 172.21.15.8:0/1553233554 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f68800ccff0 con 0x7f6884101940 2023-10-06T23:25:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.739+0000 7f689fb14b80 1 -- start start 2023-10-06T23:25:51.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.739+0000 7f688979a700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68700a1480 0x7f68700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6013b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f689fb14b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b600a2460 con 0x563b6013abc0 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f689fb14b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b60093c20 con 0x563b6013a260 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f689fb14b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b60091540 con 0x563b6013ba60 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f688a79c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49110/0 (socket says 172.21.15.8:49110) 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f6889f9b700 1 -- 172.21.15.8:0/2608917044 learned_addr learned my addr 172.21.15.8:0/2608917044 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f688a79c700 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:53122/0 (socket says 172.21.15.8:53122) 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.740+0000 7f688979a700 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6013b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f688a79c700 1 -- 172.21.15.8:0/2608917044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 msgr2=0x563b6013a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f688a79c700 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f688979a700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68700a1480 0x7f68700a3940 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6874006010 tx=0x7f6874004160 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f688a79c700 1 -- 172.21.15.8:0/2608917044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 msgr2=0x563b6013b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f688a79c700 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6013b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f688a79c700 1 -- 172.21.15.8:0/2608917044 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b5feb7de0 con 0x563b6013ba60 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f688a79c700 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013bee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f687c011440 tx=0x7f687c011750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f7a35bdc30b996 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f686ffff700 1 -- 172.21.15.8:0/2608917044 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c004310 con 0x563b6013ba60 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f686ffff700 1 -- 172.21.15.8:0/2608917044 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f687c004470 con 0x563b6013ba60 2023-10-06T23:25:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.741+0000 7f686ffff700 1 -- 172.21.15.8:0/2608917044 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c005650 con 0x563b6013ba60 2023-10-06T23:25:51.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 -- 172.21.15.8:0/2608917044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 msgr2=0x563b6013bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:51.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013bee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f687c011440 tx=0x7f687c011750 comp rx=0 tx=0).stop 2023-10-06T23:25:51.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 -- 172.21.15.8:0/2608917044 shutdown_connections 2023-10-06T23:25:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013bee0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2608917044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6013b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 -- 172.21.15.8:0/2608917044 >> 172.21.15.8:0/2608917044 conn(0x563b600ae260 msgr2=0x563b60135140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 -- 172.21.15.8:0/2608917044 shutdown_connections 2023-10-06T23:25:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.742+0000 7f689fb14b80 1 -- 172.21.15.8:0/2608917044 wait complete. 2023-10-06T23:25:51.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.743+0000 7f689fb14b80 1 -- start start 2023-10-06T23:25:51.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.744+0000 7f689fb14b80 1 Processor -- start 2023-10-06T23:25:51.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.744+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b60144050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.744+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b60144590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.744+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6014b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.744+0000 7f689fb14b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6008ce30 con 0x563b6013abc0 2023-10-06T23:25:51.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.744+0000 7f689fb14b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b60029710 con 0x563b6013a260 2023-10-06T23:25:51.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.744+0000 7f689fb14b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b600293b0 con 0x563b6013ba60 2023-10-06T23:25:51.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f689fb14b80 10 client.0 _ll_register_callbacks cb 0x563b5fe86800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:51.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b60144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b60144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49114/0 (socket says 172.21.15.8:49114) 2023-10-06T23:25:51.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f6889f9b700 1 -- 172.21.15.8:0/2315205879 learned_addr learned my addr 172.21.15.8:0/2315205879 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:51.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f688a79c700 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6014b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f688979a700 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b60144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f6889f9b700 1 -- 172.21.15.8:0/2315205879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 msgr2=0x563b6014b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:51.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f6889f9b700 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6014b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f6889f9b700 1 -- 172.21.15.8:0/2315205879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 msgr2=0x563b60144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:51.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f6889f9b700 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b60144590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.745+0000 7f6889f9b700 1 -- 172.21.15.8:0/2315205879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c009c90 con 0x563b6013a260 2023-10-06T23:25:51.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.746+0000 7f6889f9b700 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b60144050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f688000cfd0 tx=0x7f688009a820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b48ea2aa2e7b0b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:51.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.746+0000 7f686d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:25:51.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.746+0000 7f686d7fa700 1 -- 172.21.15.8:0/2315205879 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880099c40 con 0x563b6013a260 2023-10-06T23:25:51.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.746+0000 7f686d7fa700 1 -- 172.21.15.8:0/2315205879 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f688009a9e0 con 0x563b6013a260 2023-10-06T23:25:51.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.746+0000 7f689fb14b80 1 -- 172.21.15.8:0/2315205879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b6012cf10 con 0x563b6013a260 2023-10-06T23:25:51.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.746+0000 7f686d7fa700 1 -- 172.21.15.8:0/2315205879 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f688009a2e0 con 0x563b6013a260 2023-10-06T23:25:51.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.746+0000 7f689fb14b80 10 client.26726 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:51.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.746+0000 7f689fb14b80 1 -- 172.21.15.8:0/2315205879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563b5fea0c60 con 0x563b6013a260 2023-10-06T23:25:51.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f686d7fa700 1 -- 172.21.15.8:0/2315205879 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563b6012cf10 con 0x563b6013a260 2023-10-06T23:25:51.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f686d7fa700 1 -- 172.21.15.8:0/2315205879 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f68800a21e0 con 0x563b6013a260 2023-10-06T23:25:51.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f689fb14b80 10 client.26726 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:51.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f689fb14b80 10 client.26726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:51.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f689fb14b80 20 client.26726 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:51.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b601587b0 0x563b6015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f689fb14b80 4 client.26726 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:25:51.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f689fb14b80 1 -- 172.21.15.8:0/2315205879 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b60085e10 con 0x563b601587b0 2023-10-06T23:25:51.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.747+0000 7f688979a700 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b601587b0 0x563b6015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.748+0000 7f688979a700 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b601587b0 0x563b6015abd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=153e2c45f4a0f5ad server_cookie=242b0d93fc65512e in_seq=0 out_seq=0 2023-10-06T23:25:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.748+0000 7f686d7fa700 10 client.26726 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.749+0000 7f686d7fa700 1 -- 172.21.15.8:0/2315205879 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563b60085e10 con 0x563b601587b0 2023-10-06T23:25:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.749+0000 7f686d7fa700 10 client.26726 handle_command_reply: tid=0 2023-10-06T23:25:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.749+0000 7f689fb14b80 1 client.26726 shutdown 2023-10-06T23:25:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 -- 172.21.15.8:0/2315205879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 msgr2=0x563b60144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b60144050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f688000cfd0 tx=0x7f688009a820 comp rx=0 tx=0).stop 2023-10-06T23:25:51.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 -- 172.21.15.8:0/2315205879 shutdown_connections 2023-10-06T23:25:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b601587b0 0x563b6015abd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6014b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b60144050 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f686d7fa700 0 client.26726 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2315205879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b60144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 -- 172.21.15.8:0/2315205879 >> 172.21.15.8:0/2315205879 conn(0x563b600ae260 msgr2=0x563b60134f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:51.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 -- 172.21.15.8:0/2315205879 shutdown_connections 2023-10-06T23:25:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 1 -- 172.21.15.8:0/2315205879 wait complete. 2023-10-06T23:25:51.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.750+0000 7f689fb14b80 20 client.26726 trim_cache size 0 max 16384 2023-10-06T23:25:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.775+0000 7f689fb14b80 1 Processor -- start 2023-10-06T23:25:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.775+0000 7f689fb14b80 1 -- start start 2023-10-06T23:25:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6014b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f689fb14b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5ff0d920 con 0x563b6013abc0 2023-10-06T23:25:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f689fb14b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6012f300 con 0x563b6013a260 2023-10-06T23:25:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f689fb14b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6013b690 con 0x563b6013ba60 2023-10-06T23:25:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f688a79c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f688979a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f688a79c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:53136/0 (socket says 172.21.15.8:53136) 2023-10-06T23:25:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:49126/0 (socket says 172.21.15.8:49126) 2023-10-06T23:25:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.776+0000 7f688a79c700 1 -- 172.21.15.8:0/718984653 learned_addr learned my addr 172.21.15.8:0/718984653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.777+0000 7f688a79c700 1 -- 172.21.15.8:0/718984653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 msgr2=0x563b6013e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.777+0000 7f688a79c700 1 --2- 172.21.15.8:0/718984653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.777+0000 7f688a79c700 1 -- 172.21.15.8:0/718984653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 msgr2=0x563b6014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.777+0000 7f688a79c700 1 --2- 172.21.15.8:0/718984653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6014b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.777+0000 7f688a79c700 1 -- 172.21.15.8:0/718984653 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b5fede250 con 0x563b6013ba60 2023-10-06T23:25:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.777+0000 7f688979a700 1 --2- 172.21.15.8:0/718984653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:25:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.777+0000 7f688a79c700 1 --2- 172.21.15.8:0/718984653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013ee70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f687c011aa0 tx=0x7f687c009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a68a5a3cf044127 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.778+0000 7f6878ff9700 1 -- 172.21.15.8:0/718984653 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c004110 con 0x563b6013ba60 2023-10-06T23:25:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.778+0000 7f6878ff9700 1 -- 172.21.15.8:0/718984653 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f687c004270 con 0x563b6013ba60 2023-10-06T23:25:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.778+0000 7f6878ff9700 1 -- 172.21.15.8:0/718984653 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c004bb0 con 0x563b6013ba60 2023-10-06T23:25:51.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.778+0000 7f689fb14b80 1 -- 172.21.15.8:0/718984653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 msgr2=0x563b6013ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:51.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.778+0000 7f689fb14b80 1 --2- 172.21.15.8:0/718984653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013ee70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f687c011aa0 tx=0x7f687c009fb0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.779+0000 7f689fb14b80 1 -- 172.21.15.8:0/718984653 shutdown_connections 2023-10-06T23:25:51.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.779+0000 7f689fb14b80 1 --2- 172.21.15.8:0/718984653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013ba60 0x563b6013ee70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.779+0000 7f689fb14b80 1 --2- 172.21.15.8:0/718984653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013a260 0x563b6013e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.779+0000 7f689fb14b80 1 --2- 172.21.15.8:0/718984653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013abc0 0x563b6014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.779+0000 7f689fb14b80 1 -- 172.21.15.8:0/718984653 >> 172.21.15.8:0/718984653 conn(0x563b600ae260 msgr2=0x563b60142d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.779+0000 7f689fb14b80 1 -- 172.21.15.8:0/718984653 shutdown_connections 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.779+0000 7f689fb14b80 1 -- 172.21.15.8:0/718984653 wait complete. 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.779+0000 7f689fb14b80 1 -- start start 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.780+0000 7f689fb14b80 1 Processor -- start 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.780+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013a260 0x563b60147760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.780+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013abc0 0x563b60147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.780+0000 7f689fb14b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013ba60 0x563b6014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.780+0000 7f689fb14b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6014b200 con 0x563b6013ba60 2023-10-06T23:25:51.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.780+0000 7f689fb14b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6014b370 con 0x563b6013abc0 2023-10-06T23:25:51.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.780+0000 7f689fb14b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b6014b530 con 0x563b6013a260 2023-10-06T23:25:51.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.780+0000 7f689fb14b80 10 client.0 _ll_register_callbacks cb 0x7f688009a0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:25:51.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013a260 0x563b60147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f688979a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013abc0 0x563b60147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f6889f9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013a260 0x563b60147760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:53142/0 (socket says 172.21.15.8:53142) 2023-10-06T23:25:51.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f6889f9b700 1 -- 172.21.15.8:0/2301438082 learned_addr learned my addr 172.21.15.8:0/2301438082 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:25:51.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f688a79c700 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013ba60 0x563b6014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:51.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f6889f9b700 1 -- 172.21.15.8:0/2301438082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013abc0 msgr2=0x563b60147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:51.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f6889f9b700 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013abc0 0x563b60147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f6889f9b700 1 -- 172.21.15.8:0/2301438082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013ba60 msgr2=0x563b6014acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:25:51.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f6889f9b700 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013ba60 0x563b6014acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:51.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.781+0000 7f6889f9b700 1 -- 172.21.15.8:0/2301438082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6884109c00 con 0x563b6013a260 2023-10-06T23:25:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.782+0000 7f6889f9b700 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013a260 0x563b60147760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6880098630 tx=0x7f6880099ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=367cfbebb50b5169 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:25:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.782+0000 7f686d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:25:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.782+0000 7f686d7fa700 1 -- 172.21.15.8:0/2301438082 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880099c40 con 0x563b6013a260 2023-10-06T23:25:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.782+0000 7f686d7fa700 1 -- 172.21.15.8:0/2301438082 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f688009a9e0 con 0x563b6013a260 2023-10-06T23:25:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.782+0000 7f689fb14b80 1 -- 172.21.15.8:0/2301438082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f687c004470 con 0x563b6013a260 2023-10-06T23:25:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.782+0000 7f686d7fa700 1 -- 172.21.15.8:0/2301438082 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f688009a2e0 con 0x563b6013a260 2023-10-06T23:25:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.782+0000 7f689fb14b80 10 client.26746 fetch_fsmap learned FSMap version 37 2023-10-06T23:25:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.782+0000 7f689fb14b80 1 -- 172.21.15.8:0/2301438082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f687c01d040 con 0x563b6013a260 2023-10-06T23:25:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.783+0000 7f686d7fa700 1 -- 172.21.15.8:0/2301438082 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f687c004470 con 0x563b6013a260 2023-10-06T23:25:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.783+0000 7f686d7fa700 1 -- 172.21.15.8:0/2301438082 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f68800993d0 con 0x563b6013a260 2023-10-06T23:25:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.783+0000 7f689fb14b80 10 client.26746 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:25:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.783+0000 7f689fb14b80 10 client.26746 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:25:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.783+0000 7f689fb14b80 20 client.26746 populate_metadata read hostname 'smithi008' 2023-10-06T23:25:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.783+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b601ad670 0x563b601afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:25:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.783+0000 7f689fb14b80 4 client.26746 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:25:51.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:51.783+0000 7f689fb14b80 1 -- 172.21.15.8:0/2301438082 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563b60085b30 con 0x563b601ad670 2023-10-06T23:25:51.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:51 smithi008 ceph-mon[98532]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 5.4 MiB/s wr, 564 op/s 2023-10-06T23:25:51.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:51 smithi190 ceph-mon[102658]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 5.4 MiB/s wr, 564 op/s 2023-10-06T23:25:52.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:51 smithi156 ceph-mon[102862]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 5.4 MiB/s wr, 564 op/s 2023-10-06T23:25:52.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.146+0000 7f688979a700 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b601ad670 0x563b601afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:25:52.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.147+0000 7f688979a700 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b601ad670 0x563b601afa90 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5be8b2cea4c501b6 server_cookie=a55c54318bc8619e in_seq=0 out_seq=0 2023-10-06T23:25:52.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.147+0000 7f686d7fa700 10 client.26746 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:52.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f686d7fa700 1 -- 172.21.15.8:0/2301438082 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563b60085b30 con 0x563b601ad670 2023-10-06T23:25:52.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f686d7fa700 10 client.26746 handle_command_reply: tid=0 2023-10-06T23:25:52.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 client.26746 shutdown 2023-10-06T23:25:52.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 -- 172.21.15.8:0/2301438082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013a260 msgr2=0x563b60147760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:52.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013a260 0x563b60147760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6880098630 tx=0x7f6880099ab0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 -- 172.21.15.8:0/2301438082 shutdown_connections 2023-10-06T23:25:52.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563b601ad670 0x563b601afa90 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563b6013ba60 0x563b6014acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563b6013a260 0x563b60147760 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 --2- 172.21.15.8:0/2301438082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563b6013abc0 0x563b60147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f689fb14b80 1 -- 172.21.15.8:0/2301438082 >> 172.21.15.8:0/2301438082 conn(0x563b600ae260 msgr2=0x563b6013e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:52.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.148+0000 7f686d7fa700 0 client.26746 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:25:52.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.149+0000 7f689fb14b80 1 -- 172.21.15.8:0/2301438082 shutdown_connections 2023-10-06T23:25:52.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.149+0000 7f689fb14b80 1 -- 172.21.15.8:0/2301438082 wait complete. 2023-10-06T23:25:52.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.149+0000 7f689fb14b80 20 client.26746 trim_cache size 0 max 16384 2023-10-06T23:25:52.153 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:25:52.154 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:25:52.154 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:25:52.154 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:25:52.154 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:25:52.154 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:25:52.155 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:25:52.155 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:25:52.155 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:25:52.155 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:25:52.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 -- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68700a1480 msgr2=0x7f68700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:52.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68700a1480 0x7f68700a3940 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6874006010 tx=0x7f6874004160 comp rx=0 tx=0).stop 2023-10-06T23:25:52.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 -- 172.21.15.8:0/1553233554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6884101940 msgr2=0x7f6884198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:25:52.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6884101940 0x7f6884198d10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f688000ef10 tx=0x7f688000c3a0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 -- 172.21.15.8:0/1553233554 shutdown_connections 2023-10-06T23:25:52.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68700a1480 0x7f68700a3940 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6884106ba0 0x7f68841a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6884101940 0x7f6884198d10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 --2- 172.21.15.8:0/1553233554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6884104270 0x7f6884199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:25:52.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 -- 172.21.15.8:0/1553233554 >> 172.21.15.8:0/1553233554 conn(0x7f68840fb330 msgr2=0x7f68840fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:25:52.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 -- 172.21.15.8:0/1553233554 shutdown_connections 2023-10-06T23:25:52.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:25:52.150+0000 7f688c1ff700 1 -- 172.21.15.8:0/1553233554 wait complete. 2023-10-06T23:25:52.176 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:25:53.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:53 smithi156 ceph-mon[102862]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2023-10-06T23:25:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:53 smithi008 ceph-mon[98532]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2023-10-06T23:25:53.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:53 smithi190 ceph-mon[102658]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2023-10-06T23:25:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 660.0 s, 218.6 tps, lat 471.215 ms stddev 159.119 2023-10-06T23:25:55.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:55 smithi008 ceph-mon[98532]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 5.6 MiB/s wr, 549 op/s 2023-10-06T23:25:55.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:55 smithi190 ceph-mon[102658]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 5.6 MiB/s wr, 549 op/s 2023-10-06T23:25:56.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:55 smithi156 ceph-mon[102862]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 5.6 MiB/s wr, 549 op/s 2023-10-06T23:25:57.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:57 smithi008 ceph-mon[98532]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 4.4 MiB/s wr, 455 op/s 2023-10-06T23:25:57.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:57 smithi190 ceph-mon[102658]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 4.4 MiB/s wr, 455 op/s 2023-10-06T23:25:58.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:57 smithi156 ceph-mon[102862]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 4.4 MiB/s wr, 455 op/s 2023-10-06T23:25:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 665.0 s, 240.6 tps, lat 418.400 ms stddev 111.396 2023-10-06T23:25:59.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:25:59 smithi008 ceph-mon[98532]: pgmap v745: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 4.1 MiB/s wr, 420 op/s 2023-10-06T23:25:59.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:25:59 smithi190 ceph-mon[102658]: pgmap v745: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 4.1 MiB/s wr, 420 op/s 2023-10-06T23:26:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 -- 172.21.15.8:0/4217505770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0102060 msgr2=0x7f6ac01024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/4217505770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0102060 0x7f6ac01024e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009990 tx=0x7f6ab4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 -- 172.21.15.8:0/4217505770 shutdown_connections 2023-10-06T23:26:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/4217505770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ac0100f10 0x7f6ac0101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/4217505770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0102a20 0x7f6ac0109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/4217505770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0102060 0x7f6ac01024e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 -- 172.21.15.8:0/4217505770 >> 172.21.15.8:0/4217505770 conn(0x7f6ac00fc460 msgr2=0x7f6ac00fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 -- 172.21.15.8:0/4217505770 shutdown_connections 2023-10-06T23:26:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.029+0000 7f6ac4fff700 1 -- 172.21.15.8:0/4217505770 wait complete. 2023-10-06T23:26:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.030+0000 7f6ac4fff700 1 Processor -- start 2023-10-06T23:26:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.031+0000 7f6ac4fff700 1 -- start start 2023-10-06T23:26:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.031+0000 7f6ac4fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0100f10 0x7f6ac0198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.031+0000 7f6ac4fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0102060 0x7f6ac0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.031+0000 7f6ac4fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ac0102a20 0x7f6ac019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.031+0000 7f6ac4fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac019a830 con 0x7f6ac0102a20 2023-10-06T23:26:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.031+0000 7f6ac4fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac019a9a0 con 0x7f6ac0102060 2023-10-06T23:26:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.031+0000 7f6ac4fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac019ab60 con 0x7f6ac0100f10 2023-10-06T23:26:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0100f10 0x7f6ac0198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0100f10 0x7f6ac0198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60894/0 (socket says 172.21.15.8:60894) 2023-10-06T23:26:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ac0102a20 0x7f6ac019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abe59c700 1 -- 172.21.15.8:0/2384944986 learned_addr learned my addr 172.21.15.8:0/2384944986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abdd9b700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0102060 0x7f6ac0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abe59c700 1 -- 172.21.15.8:0/2384944986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0102060 msgr2=0x7f6ac0199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abe59c700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0102060 0x7f6ac0199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abe59c700 1 -- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ac0102a20 msgr2=0x7f6ac019a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abe59c700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ac0102a20 0x7f6ac019a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abe59c700 1 -- 172.21.15.8:0/2384944986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40095f0 con 0x7f6ac0100f10 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.032+0000 7f6abdd9b700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0102060 0x7f6ac0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.033+0000 7f6abe59c700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0100f10 0x7f6ac0198e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e9a0 tx=0x7f6ab000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.033+0000 7f6aaf7fe700 1 -- 172.21.15.8:0/2384944986 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000cbd0 con 0x7f6ac0100f10 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.033+0000 7f6aaf7fe700 1 -- 172.21.15.8:0/2384944986 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ab000cd30 con 0x7f6ac0100f10 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.033+0000 7f6ac4fff700 1 -- 172.21.15.8:0/2384944986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac019ae40 con 0x7f6ac0100f10 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.033+0000 7f6aaf7fe700 1 -- 172.21.15.8:0/2384944986 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0018680 con 0x7f6ac0100f10 2023-10-06T23:26:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.033+0000 7f6ac4fff700 1 -- 172.21.15.8:0/2384944986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac01a15a0 con 0x7f6ac0100f10 2023-10-06T23:26:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.038+0000 7f6aaf7fe700 1 -- 172.21.15.8:0/2384944986 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6ab0010430 con 0x7f6ac0100f10 2023-10-06T23:26:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.039+0000 7f6ad89eeb80 1 Processor -- start 2023-10-06T23:26:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.039+0000 7f6ad89eeb80 1 -- start start 2023-10-06T23:26:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.039+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58cec0 0x55c24a58d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.039+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a58e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.039+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a595220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.039+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a4f5400 con 0x55c24a58dfd0 2023-10-06T23:26:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.040+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a4e6bc0 con 0x55c24a58cec0 2023-10-06T23:26:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.040+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a4e44e0 con 0x55c24a58e990 2023-10-06T23:26:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.040+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a58e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.040+0000 7f6abdd9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a595220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.040+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a58e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42346/0 (socket says 172.21.15.8:42346) 2023-10-06T23:26:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.040+0000 7f6abe59c700 1 -- 172.21.15.8:0/1737410672 learned_addr learned my addr 172.21.15.8:0/1737410672 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.040+0000 7f6abed9d700 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58cec0 0x55c24a58d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.040+0000 7f6aaf7fe700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6aa80a1480 0x7f6aa80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6aaf7fe700 1 -- 172.21.15.8:0/2384944986 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6ab0014070 con 0x7f6ac0100f10 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abe59c700 1 -- 172.21.15.8:0/1737410672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 msgr2=0x55c24a595220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abe59c700 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a595220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abe59c700 1 -- 172.21.15.8:0/1737410672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58cec0 msgr2=0x55c24a58d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abe59c700 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58cec0 0x55c24a58d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abe59c700 1 -- 172.21.15.8:0/1737410672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c24a30ad80 con 0x55c24a58dfd0 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abdd9b700 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a595220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abed9d700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6aa80a1480 0x7f6aa80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abe59c700 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a58e450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0096d70 tx=0x7f6ab00109d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bdf0a33b0e0160 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6aacff9700 1 -- 172.21.15.8:0/1737410672 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0096640 con 0x55c24a58dfd0 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6aacff9700 1 -- 172.21.15.8:0/1737410672 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ab009a0d0 con 0x55c24a58dfd0 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6aacff9700 1 -- 172.21.15.8:0/1737410672 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab009e450 con 0x55c24a58dfd0 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.041+0000 7f6abed9d700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6aa80a1480 0x7f6aa80a3940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55c24a58cc60 tx=0x7f6ab8009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/1737410672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 msgr2=0x55c24a58e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a58e450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0096d70 tx=0x7f6ab00109d0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/1737410672 shutdown_connections 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a595220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58cec0 0x55c24a58d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/1737410672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a58e450 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/1737410672 >> 172.21.15.8:0/1737410672 conn(0x55c24a501200 msgr2=0x55c24a587bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/1737410672 shutdown_connections 2023-10-06T23:26:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.042+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/1737410672 wait complete. 2023-10-06T23:26:00.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.043+0000 7f6ad89eeb80 1 -- start start 2023-10-06T23:26:00.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.043+0000 7f6ad89eeb80 1 Processor -- start 2023-10-06T23:26:00.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a596b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.047 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 0x55c24a5970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58e990 0x55c24a59e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a4dfdd0 con 0x55c24a58e990 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a47c6b0 con 0x55c24a58dfd0 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a47c350 con 0x55c24a58cec0 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6ad89eeb80 10 client.0 _ll_register_callbacks cb 0x55c24a2d97a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a596b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a596b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60906/0 (socket says 172.21.15.8:60906) 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6abe59c700 1 -- 172.21.15.8:0/2722084477 learned_addr learned my addr 172.21.15.8:0/2722084477 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6abdd9b700 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 0x55c24a5970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.044+0000 7f6abed9d700 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58e990 0x55c24a59e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6abe59c700 1 -- 172.21.15.8:0/2722084477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 msgr2=0x55c24a5970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:00.048 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6abe59c700 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 0x55c24a5970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6abe59c700 1 -- 172.21.15.8:0/2722084477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58e990 msgr2=0x55c24a59e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6abe59c700 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58e990 0x55c24a59e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6abe59c700 1 -- 172.21.15.8:0/2722084477 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac0109c70 con 0x55c24a58cec0 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6abed9d700 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58e990 0x55c24a59e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6abe59c700 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a596b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0096800 tx=0x7f6ab00d0390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=190aee0ad4f8cb85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6aa5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/2722084477 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0096640 con 0x55c24a58cec0 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/2722084477 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6ab0010e40 con 0x55c24a58cec0 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.045+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/2722084477 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c24a57fd50 con 0x55c24a58cec0 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.046+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/2722084477 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ab0099c60 con 0x55c24a58cec0 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.046+0000 7f6ad89eeb80 10 client.26758 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:00.049 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.046+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/2722084477 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f6ac01a15a0 con 0x55c24a58cec0 2023-10-06T23:26:00.050 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.046+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/2722084477 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c24a57fd50 con 0x55c24a58cec0 2023-10-06T23:26:00.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.047+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/2722084477 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6ab00a2200 con 0x55c24a58cec0 2023-10-06T23:26:00.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.047+0000 7f6ad89eeb80 10 client.26758 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:00.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.047+0000 7f6ad89eeb80 10 client.26758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:00.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.047+0000 7f6ad89eeb80 20 client.26758 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:00.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.047+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c24a5a2680 0x55c24a5a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.047+0000 7f6ad89eeb80 4 client.26758 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:26:00.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.047+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/2722084477 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c24a4d8db0 con 0x55c24a5a2680 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.047+0000 7f6abdd9b700 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c24a5a2680 0x55c24a5a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.048+0000 7f6abdd9b700 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c24a5a2680 0x55c24a5a4aa0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5470f72637527cc server_cookie=f3085bc80765ab3d in_seq=0 out_seq=0 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.048+0000 7f6aa5ffb700 10 client.26758 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/2722084477 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c24a4d8db0 con 0x55c24a5a2680 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6aa5ffb700 10 client.26758 handle_command_reply: tid=0 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 client.26758 shutdown 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/2722084477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 msgr2=0x55c24a596b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a596b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0096800 tx=0x7f6ab00d0390 comp rx=0 tx=0).stop 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/2722084477 shutdown_connections 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c24a5a2680 0x55c24a5a4aa0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58e990 0x55c24a59e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a596b90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/2722084477 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 0x55c24a5970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/2722084477 >> 172.21.15.8:0/2722084477 conn(0x55c24a501200 msgr2=0x55c24a587250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.049+0000 7f6aa5ffb700 0 client.26758 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.050+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/2722084477 shutdown_connections 2023-10-06T23:26:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.050+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/2722084477 wait complete. 2023-10-06T23:26:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.050+0000 7f6ad89eeb80 20 client.26758 trim_cache size 0 max 16384 2023-10-06T23:26:00.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.076+0000 7f6ad89eeb80 1 Processor -- start 2023-10-06T23:26:00.077 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.076+0000 7f6ad89eeb80 1 -- start start 2023-10-06T23:26:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.076+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a5957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a59e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58e990 0x55c24a594c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a3608c0 con 0x55c24a58dfd0 2023-10-06T23:26:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a592540 con 0x55c24a58e990 2023-10-06T23:26:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a58e770 con 0x55c24a58cec0 2023-10-06T23:26:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6abdd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a59e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6abed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58e990 0x55c24a594c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6abe59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a5957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6abdd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a59e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42362/0 (socket says 172.21.15.8:42362) 2023-10-06T23:26:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.077+0000 7f6abdd9b700 1 -- 172.21.15.8:0/3810651478 learned_addr learned my addr 172.21.15.8:0/3810651478 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6abe59c700 1 -- 172.21.15.8:0/3810651478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58e990 msgr2=0x55c24a594c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6abe59c700 1 --2- 172.21.15.8:0/3810651478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58e990 0x55c24a594c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6abe59c700 1 -- 172.21.15.8:0/3810651478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 msgr2=0x55c24a59e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6abe59c700 1 --2- 172.21.15.8:0/3810651478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a59e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6abe59c700 1 -- 172.21.15.8:0/3810651478 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c24a2f3c00 con 0x55c24a58cec0 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6abdd9b700 1 --2- 172.21.15.8:0/3810651478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a59e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6abe59c700 1 --2- 172.21.15.8:0/3810651478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a5957f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e970 tx=0x7f6ab00988b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99803e567efab180 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6aad7fa700 1 -- 172.21.15.8:0/3810651478 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0062070 con 0x55c24a58cec0 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6aad7fa700 1 -- 172.21.15.8:0/3810651478 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ab00b0070 con 0x55c24a58cec0 2023-10-06T23:26:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.078+0000 7f6aad7fa700 1 -- 172.21.15.8:0/3810651478 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab009e450 con 0x55c24a58cec0 2023-10-06T23:26:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.079+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/3810651478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 msgr2=0x55c24a5957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.079+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/3810651478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a5957f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e970 tx=0x7f6ab00988b0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.080+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/3810651478 shutdown_connections 2023-10-06T23:26:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.080+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/3810651478 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58e990 0x55c24a594c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.080+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/3810651478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58cec0 0x55c24a5957f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.080+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/3810651478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58dfd0 0x55c24a59e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.080+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/3810651478 >> 172.21.15.8:0/3810651478 conn(0x55c24a501200 msgr2=0x55c24a5a93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.080+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/3810651478 shutdown_connections 2023-10-06T23:26:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.080+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/3810651478 wait complete. 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.080+0000 7f6ad89eeb80 1 -- start start 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.081+0000 7f6ad89eeb80 1 Processor -- start 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.081+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58cec0 0x55c24a59be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.081+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 0x55c24a59c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.081+0000 7f6ad89eeb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a59d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.081+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a59d890 con 0x55c24a58cec0 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.081+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a59da00 con 0x55c24a58dfd0 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.081+0000 7f6ad89eeb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c24a59dbc0 con 0x55c24a58e990 2023-10-06T23:26:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.081+0000 7f6ad89eeb80 10 client.0 _ll_register_callbacks cb 0x7f6ac0199a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abed9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a59d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abed9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a59d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:60930/0 (socket says 172.21.15.8:60930) 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abed9d700 1 -- 172.21.15.8:0/885883482 learned_addr learned my addr 172.21.15.8:0/885883482 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abdd9b700 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 0x55c24a59c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abe59c700 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58cec0 0x55c24a59be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abed9d700 1 -- 172.21.15.8:0/885883482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 msgr2=0x55c24a59c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abed9d700 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 0x55c24a59c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abed9d700 1 -- 172.21.15.8:0/885883482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58cec0 msgr2=0x55c24a59be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.082+0000 7f6abed9d700 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58cec0 0x55c24a59be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.083+0000 7f6abed9d700 1 -- 172.21.15.8:0/885883482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab4005140 con 0x55c24a58e990 2023-10-06T23:26:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.083+0000 7f6abe59c700 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58cec0 0x55c24a59be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.083+0000 7f6abed9d700 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a59d350 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8017d50 tx=0x7f6ab8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939c0027ff2ee684 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.083+0000 7f6aa5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:26:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.083+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/885883482 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800e040 con 0x55c24a58e990 2023-10-06T23:26:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.083+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/885883482 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6ab801c040 con 0x55c24a58e990 2023-10-06T23:26:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.083+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/885883482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ab009a0d0 con 0x55c24a58e990 2023-10-06T23:26:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.084+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/885883482 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ab8017e30 con 0x55c24a58e990 2023-10-06T23:26:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.084+0000 7f6ad89eeb80 10 client.26764 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.084+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/885883482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f6ac01a15a0 con 0x55c24a58e990 2023-10-06T23:26:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.084+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/885883482 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ab009a0d0 con 0x55c24a58e990 2023-10-06T23:26:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.085+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/885883482 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6ab80042c0 con 0x55c24a58e990 2023-10-06T23:26:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.085+0000 7f6ad89eeb80 10 client.26764 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.085+0000 7f6ad89eeb80 10 client.26764 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.085+0000 7f6ad89eeb80 20 client.26764 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.085+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c24a5f7420 0x55c24a5f9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.085+0000 7f6ad89eeb80 4 client.26764 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:26:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.085+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/885883482 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c24a4d8ad0 con 0x55c24a5f7420 2023-10-06T23:26:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.085+0000 7f6abe59c700 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c24a5f7420 0x55c24a5f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.086+0000 7f6abe59c700 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c24a5f7420 0x55c24a5f9840 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1101a0543f83e906 server_cookie=874d662b37a9dfc2 in_seq=0 out_seq=0 2023-10-06T23:26:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.086+0000 7f6aa5ffb700 10 client.26764 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:00.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:25:59 smithi156 ceph-mon[102862]: pgmap v745: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 4.1 MiB/s wr, 420 op/s 2023-10-06T23:26:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6aa5ffb700 1 -- 172.21.15.8:0/885883482 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c24a4d8ad0 con 0x55c24a5f7420 2023-10-06T23:26:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6aa5ffb700 10 client.26764 handle_command_reply: tid=0 2023-10-06T23:26:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 client.26764 shutdown 2023-10-06T23:26:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/885883482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 msgr2=0x55c24a59d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a59d350 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8017d50 tx=0x7f6ab8004ad0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/885883482 shutdown_connections 2023-10-06T23:26:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55c24a5f7420 0x55c24a5f9840 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c24a58cec0 0x55c24a59be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c24a58e990 0x55c24a59d350 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 --2- 172.21.15.8:0/885883482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c24a58dfd0 0x55c24a59c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/885883482 >> 172.21.15.8:0/885883482 conn(0x55c24a501200 msgr2=0x55c24a5957f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.105+0000 7f6aa5ffb700 0 client.26764 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.106+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/885883482 shutdown_connections 2023-10-06T23:26:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.106+0000 7f6ad89eeb80 1 -- 172.21.15.8:0/885883482 wait complete. 2023-10-06T23:26:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.106+0000 7f6ad89eeb80 20 client.26764 trim_cache size 0 max 16384 2023-10-06T23:26:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:26:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:26:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:26:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:26:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 -- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6aa80a1480 msgr2=0x7f6aa80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6aa80a1480 0x7f6aa80a3940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55c24a58cc60 tx=0x7f6ab8009040 comp rx=0 tx=0).stop 2023-10-06T23:26:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 -- 172.21.15.8:0/2384944986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0100f10 msgr2=0x7f6ac0198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0100f10 0x7f6ac0198e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e9a0 tx=0x7f6ab000ecb0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 -- 172.21.15.8:0/2384944986 shutdown_connections 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6aa80a1480 0x7f6aa80a3940 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ac0102a20 0x7f6ac019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ac0100f10 0x7f6ac0198e40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 --2- 172.21.15.8:0/2384944986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0102060 0x7f6ac0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 -- 172.21.15.8:0/2384944986 >> 172.21.15.8:0/2384944986 conn(0x7f6ac00fc460 msgr2=0x7f6ac00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 -- 172.21.15.8:0/2384944986 shutdown_connections 2023-10-06T23:26:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:00.107+0000 7f6ac4fff700 1 -- 172.21.15.8:0/2384944986 wait complete. 2023-10-06T23:26:01.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:01 smithi008 ceph-mon[98532]: pgmap v746: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 5.6 MiB/s wr, 546 op/s 2023-10-06T23:26:01.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:01 smithi190 ceph-mon[102658]: pgmap v746: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 5.6 MiB/s wr, 546 op/s 2023-10-06T23:26:02.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:01 smithi156 ceph-mon[102862]: pgmap v746: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 5.6 MiB/s wr, 546 op/s 2023-10-06T23:26:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:03 smithi156 ceph-mon[102862]: pgmap v747: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2023-10-06T23:26:03.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:03 smithi008 ceph-mon[98532]: pgmap v747: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2023-10-06T23:26:03.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:03 smithi190 ceph-mon[102658]: pgmap v747: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2023-10-06T23:26:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 670.0 s, 259.2 tps, lat 385.792 ms stddev 47.636 2023-10-06T23:26:05.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:05 smithi008 ceph-mon[98532]: pgmap v748: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.6 MiB/s wr, 487 op/s 2023-10-06T23:26:05.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:05 smithi190 ceph-mon[102658]: pgmap v748: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.6 MiB/s wr, 487 op/s 2023-10-06T23:26:06.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:05 smithi156 ceph-mon[102862]: pgmap v748: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.6 MiB/s wr, 487 op/s 2023-10-06T23:26:07.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:07 smithi008 ceph-mon[98532]: pgmap v749: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 4.5 MiB/s wr, 488 op/s 2023-10-06T23:26:07.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:07 smithi190 ceph-mon[102658]: pgmap v749: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 4.5 MiB/s wr, 488 op/s 2023-10-06T23:26:08.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:07 smithi156 ceph-mon[102862]: pgmap v749: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 4.5 MiB/s wr, 488 op/s 2023-10-06T23:26:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 675.0 s, 272.6 tps, lat 368.249 ms stddev 53.082 2023-10-06T23:26:09.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:09 smithi008 ceph-mon[98532]: pgmap v750: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 4.4 MiB/s wr, 476 op/s 2023-10-06T23:26:09.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:09 smithi190 ceph-mon[102658]: pgmap v750: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 4.4 MiB/s wr, 476 op/s 2023-10-06T23:26:10.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:09 smithi156 ceph-mon[102862]: pgmap v750: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 4.4 MiB/s wr, 476 op/s 2023-10-06T23:26:11.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:11 smithi008 ceph-mon[98532]: pgmap v751: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 5.1 MiB/s wr, 558 op/s 2023-10-06T23:26:11.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:11 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:26:11.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:11 smithi190 ceph-mon[102658]: pgmap v751: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 5.1 MiB/s wr, 558 op/s 2023-10-06T23:26:11.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:11 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:26:12.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:11 smithi156 ceph-mon[102862]: pgmap v751: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 5.1 MiB/s wr, 558 op/s 2023-10-06T23:26:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:11 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:26:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.332+0000 7fb3f75ff700 1 -- 172.21.15.8:0/2987117040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0102a40 msgr2=0x7fb3f0109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.332+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/2987117040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0102a40 0x7fb3f0109360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009990 tx=0x7fb3e8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.332+0000 7fb3f75ff700 1 -- 172.21.15.8:0/2987117040 shutdown_connections 2023-10-06T23:26:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.332+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/2987117040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f0100ea0 0x7fb3f01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.332+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/2987117040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0102a40 0x7fb3f0109360 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.332+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/2987117040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3f0102080 0x7fb3f0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.332+0000 7fb3f75ff700 1 -- 172.21.15.8:0/2987117040 >> 172.21.15.8:0/2987117040 conn(0x7fb3f00fc480 msgr2=0x7fb3f00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.332+0000 7fb3f75ff700 1 -- 172.21.15.8:0/2987117040 shutdown_connections 2023-10-06T23:26:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.333+0000 7fb3f75ff700 1 -- 172.21.15.8:0/2987117040 wait complete. 2023-10-06T23:26:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.334+0000 7fb3f75ff700 1 Processor -- start 2023-10-06T23:26:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.334+0000 7fb3f75ff700 1 -- start start 2023-10-06T23:26:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f75ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100ea0 0x7fb3f00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f75ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3f0102080 0x7fb3f00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f75ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f0102a40 0x7fb3f0073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f75ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0074e40 con 0x7fb3f0102a40 2023-10-06T23:26:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f75ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0074fb0 con 0x7fb3f0100ea0 2023-10-06T23:26:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f75ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0075170 con 0x7fb3f0102080 2023-10-06T23:26:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f4b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3f0102080 0x7fb3f00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f4b9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3f0102080 0x7fb3f00737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45030/0 (socket says 172.21.15.8:45030) 2023-10-06T23:26:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.335+0000 7fb3f4b9a700 1 -- 172.21.15.8:0/331220795 learned_addr learned my addr 172.21.15.8:0/331220795 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.336+0000 7fb3f539b700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100ea0 0x7fb3f00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.336+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f0102a40 0x7fb3f0073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.336+0000 7fb3f539b700 1 -- 172.21.15.8:0/331220795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3f0102080 msgr2=0x7fb3f00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.336+0000 7fb3f539b700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3f0102080 0x7fb3f00737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.336+0000 7fb3f539b700 1 -- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f0102a40 msgr2=0x7fb3f0073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.336+0000 7fb3f539b700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f0102a40 0x7fb3f0073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.336+0000 7fb3f539b700 1 -- 172.21.15.8:0/331220795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80095f0 con 0x7fb3f0100ea0 2023-10-06T23:26:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.337+0000 7fb3f539b700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100ea0 0x7fb3f00732a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400bd70 tx=0x7fb3e400bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.337+0000 7fb3ee7fc700 1 -- 172.21.15.8:0/331220795 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400cb90 con 0x7fb3f0100ea0 2023-10-06T23:26:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.337+0000 7fb3ee7fc700 1 -- 172.21.15.8:0/331220795 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3e400ccf0 con 0x7fb3f0100ea0 2023-10-06T23:26:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.337+0000 7fb3ee7fc700 1 -- 172.21.15.8:0/331220795 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4012580 con 0x7fb3f0100ea0 2023-10-06T23:26:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.337+0000 7fb3f75ff700 1 -- 172.21.15.8:0/331220795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f01a5480 con 0x7fb3f0100ea0 2023-10-06T23:26:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.337+0000 7fb3f75ff700 1 -- 172.21.15.8:0/331220795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f01a5990 con 0x7fb3f0100ea0 2023-10-06T23:26:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.343+0000 7fb3ee7fc700 1 -- 172.21.15.8:0/331220795 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb3e40149d0 con 0x7fb3f0100ea0 2023-10-06T23:26:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.344+0000 7fb40b007b80 1 Processor -- start 2023-10-06T23:26:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.344+0000 7fb40b007b80 1 -- start start 2023-10-06T23:26:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 0x56526f3662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f367450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f36e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb40b007b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f2ce400 con 0x56526f365ec0 2023-10-06T23:26:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb40b007b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f2bfbc0 con 0x56526f367990 2023-10-06T23:26:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb40b007b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f2bd4e0 con 0x56526f366fd0 2023-10-06T23:26:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb3f539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f367450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb3f4b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f36e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb3f539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f367450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:45044/0 (socket says 172.21.15.8:45044) 2023-10-06T23:26:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.345+0000 7fb3f539b700 1 -- 172.21.15.8:0/1598037346 learned_addr learned my addr 172.21.15.8:0/1598037346 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.346+0000 7fb3f4b9a700 1 -- 172.21.15.8:0/1598037346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 msgr2=0x56526f367450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.346+0000 7fb3f4b9a700 1 --2- 172.21.15.8:0/1598037346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f367450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.346+0000 7fb3f4b9a700 1 -- 172.21.15.8:0/1598037346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 msgr2=0x56526f3662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.346+0000 7fb3f4b9a700 1 --2- 172.21.15.8:0/1598037346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 0x56526f3662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.346+0000 7fb3f4b9a700 1 -- 172.21.15.8:0/1598037346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56526f0e3d80 con 0x56526f367990 2023-10-06T23:26:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.346+0000 7fb3f4b9a700 1 --2- 172.21.15.8:0/1598037346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f36e220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00acc0 tx=0x7fb3dc00f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5460e025f6b59a22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.346+0000 7fb3ee7fc700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb3e00a1500 0x7fb3e00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.346+0000 7fb3db7fe700 1 -- 172.21.15.8:0/1598037346 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00fe20 con 0x56526f367990 2023-10-06T23:26:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.347+0000 7fb3db7fe700 1 -- 172.21.15.8:0/1598037346 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3dc004cc0 con 0x56526f367990 2023-10-06T23:26:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.347+0000 7fb3db7fe700 1 -- 172.21.15.8:0/1598037346 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc018440 con 0x56526f367990 2023-10-06T23:26:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.347+0000 7fb3ee7fc700 1 -- 172.21.15.8:0/331220795 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb3e4006e40 con 0x7fb3f0100ea0 2023-10-06T23:26:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.347+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb3e00a1500 0x7fb3e00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 -- 172.21.15.8:0/1598037346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 msgr2=0x56526f36e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1598037346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f36e220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00acc0 tx=0x7fb3dc00f3c0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb3e00a1500 0x7fb3e00a39c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x56526f365c60 tx=0x7fb3e8005be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 -- 172.21.15.8:0/1598037346 shutdown_connections 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1598037346 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 0x56526f3662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1598037346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f36e220 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1598037346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f367450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 -- 172.21.15.8:0/1598037346 >> 172.21.15.8:0/1598037346 conn(0x56526f2da200 msgr2=0x56526f360bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 -- 172.21.15.8:0/1598037346 shutdown_connections 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.348+0000 7fb40b007b80 1 -- 172.21.15.8:0/1598037346 wait complete. 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.349+0000 7fb40b007b80 1 -- start start 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.349+0000 7fb40b007b80 1 Processor -- start 2023-10-06T23:26:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 0x56526f36fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f36ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f376fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb40b007b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f2b8dd0 con 0x56526f365ec0 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb40b007b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f2556b0 con 0x56526f367990 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb40b007b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f255350 con 0x56526f366fd0 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb40b007b80 10 client.0 _ll_register_callbacks cb 0x56526f0b27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb3f5b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f376fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb3f5b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f376fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:40508/0 (socket says 172.21.15.8:40508) 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb3f5b9c700 1 -- 172.21.15.8:0/2990085900 learned_addr learned my addr 172.21.15.8:0/2990085900 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.350+0000 7fb3f539b700 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 0x56526f36fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.351+0000 7fb3f4b9a700 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f36ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.351+0000 7fb3f5b9c700 1 -- 172.21.15.8:0/2990085900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 msgr2=0x56526f36ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.351+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f36ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.351+0000 7fb3f5b9c700 1 -- 172.21.15.8:0/2990085900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 msgr2=0x56526f36fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.351+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 0x56526f36fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.351+0000 7fb3f5b9c700 1 -- 172.21.15.8:0/2990085900 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc00a920 con 0x56526f367990 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.351+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f376fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009fd0 tx=0x7fb3e8005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63a5423fdead534f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.351+0000 7fb3d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.352+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/2990085900 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e802b070 con 0x56526f367990 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.352+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/2990085900 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb3e8004af0 con 0x56526f367990 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.352+0000 7fb40b007b80 1 -- 172.21.15.8:0/2990085900 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56526f358d50 con 0x56526f367990 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.352+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/2990085900 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3e8005720 con 0x56526f367990 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.352+0000 7fb40b007b80 10 client.26762 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.352+0000 7fb40b007b80 1 -- 172.21.15.8:0/2990085900 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56526f0ccc00 con 0x56526f367990 2023-10-06T23:26:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.353+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/2990085900 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56526f358d50 con 0x56526f367990 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.353+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/2990085900 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb3e8004060 con 0x56526f367990 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.353+0000 7fb40b007b80 10 client.26762 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.353+0000 7fb40b007b80 10 client.26762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.353+0000 7fb40b007b80 20 client.26762 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.353+0000 7fb40b007b80 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56526f37b810 0x56526f37dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.353+0000 7fb40b007b80 4 client.26762 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.353+0000 7fb40b007b80 1 -- 172.21.15.8:0/2990085900 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56526f2b1db0 con 0x56526f37b810 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.354+0000 7fb3f539b700 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56526f37b810 0x56526f37dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.354+0000 7fb3f539b700 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56526f37b810 0x56526f37dc30 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d17a20310bc9c886 server_cookie=52bc8f68e7e58ad1 in_seq=0 out_seq=0 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.354+0000 7fb3d8ff9700 10 client.26762 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.355+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/2990085900 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56526f2b1db0 con 0x56526f37b810 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.355+0000 7fb3d8ff9700 10 client.26762 handle_command_reply: tid=0 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.355+0000 7fb40b007b80 1 client.26762 shutdown 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 -- 172.21.15.8:0/2990085900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 msgr2=0x56526f376fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f376fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009fd0 tx=0x7fb3e8005fb0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 -- 172.21.15.8:0/2990085900 shutdown_connections 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56526f37b810 0x56526f37dc30 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f365ec0 0x56526f36fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f367990 0x56526f376fe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 --2- 172.21.15.8:0/2990085900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f36ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 -- 172.21.15.8:0/2990085900 >> 172.21.15.8:0/2990085900 conn(0x56526f2da200 msgr2=0x56526f360250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb3d8ff9700 0 client.26762 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 -- 172.21.15.8:0/2990085900 shutdown_connections 2023-10-06T23:26:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 1 -- 172.21.15.8:0/2990085900 wait complete. 2023-10-06T23:26:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.356+0000 7fb40b007b80 20 client.26762 trim_cache size 0 max 16384 2023-10-06T23:26:13.379 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.377+0000 7fb40b007b80 1 Processor -- start 2023-10-06T23:26:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.377+0000 7fb40b007b80 1 -- start start 2023-10-06T23:26:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f365ec0 0x56526f3673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f366fd0 0x56526f376fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f36e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb40b007b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f1398c0 con 0x56526f367990 2023-10-06T23:26:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb40b007b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f36ed90 con 0x56526f366fd0 2023-10-06T23:26:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb40b007b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f3626e0 con 0x56526f365ec0 2023-10-06T23:26:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb3f5b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f36e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb3f539b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f365ec0 0x56526f3673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb3f5b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f36e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58462/0 (socket says 172.21.15.8:58462) 2023-10-06T23:26:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb3f5b9c700 1 -- 172.21.15.8:0/3422036540 learned_addr learned my addr 172.21.15.8:0/3422036540 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.378+0000 7fb3f4b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f366fd0 0x56526f376fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3f539b700 1 -- 172.21.15.8:0/3422036540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f366fd0 msgr2=0x56526f376fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3f539b700 1 --2- 172.21.15.8:0/3422036540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f366fd0 0x56526f376fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3f539b700 1 -- 172.21.15.8:0/3422036540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 msgr2=0x56526f36e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3f539b700 1 --2- 172.21.15.8:0/3422036540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f36e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3f539b700 1 -- 172.21.15.8:0/3422036540 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56526f10a1f0 con 0x56526f365ec0 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3f539b700 1 --2- 172.21.15.8:0/3422036540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f365ec0 0x56526f3673b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40c9fd0 tx=0x7fb3e40ce780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdf914fb5fbf9341 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3dbfff700 1 -- 172.21.15.8:0/3422036540 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4099570 con 0x56526f365ec0 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3dbfff700 1 -- 172.21.15.8:0/3422036540 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3e40992e0 con 0x56526f365ec0 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.379+0000 7fb3dbfff700 1 -- 172.21.15.8:0/3422036540 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40a1b30 con 0x56526f365ec0 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 -- 172.21.15.8:0/3422036540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f365ec0 msgr2=0x56526f3673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 --2- 172.21.15.8:0/3422036540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f365ec0 0x56526f3673b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40c9fd0 tx=0x7fb3e40ce780 comp rx=0 tx=0).stop 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 -- 172.21.15.8:0/3422036540 shutdown_connections 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 --2- 172.21.15.8:0/3422036540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f36e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 --2- 172.21.15.8:0/3422036540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f365ec0 0x56526f3673b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 --2- 172.21.15.8:0/3422036540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f366fd0 0x56526f376fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 -- 172.21.15.8:0/3422036540 >> 172.21.15.8:0/3422036540 conn(0x56526f2da200 msgr2=0x56526f3825d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 -- 172.21.15.8:0/3422036540 shutdown_connections 2023-10-06T23:26:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.380+0000 7fb40b007b80 1 -- 172.21.15.8:0/3422036540 wait complete. 2023-10-06T23:26:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.381+0000 7fb40b007b80 1 -- start start 2023-10-06T23:26:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.381+0000 7fb40b007b80 1 Processor -- start 2023-10-06T23:26:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f365ec0 0x56526f374d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f375280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb40b007b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f376290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb40b007b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f3767d0 con 0x56526f367990 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb40b007b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f376940 con 0x56526f365ec0 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb40b007b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526f376b00 con 0x56526f366fd0 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb40b007b80 10 client.0 _ll_register_callbacks cb 0x7fb3e800bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb3f539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f365ec0 0x56526f374d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb3f5b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f376290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb3f539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f365ec0 0x56526f374d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:40534/0 (socket says 172.21.15.8:40534) 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb3f539b700 1 -- 172.21.15.8:0/1887334267 learned_addr learned my addr 172.21.15.8:0/1887334267 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb3f4b9a700 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f375280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb3f5b9c700 1 -- 172.21.15.8:0/1887334267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 msgr2=0x56526f375280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f375280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.382+0000 7fb3f5b9c700 1 -- 172.21.15.8:0/1887334267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f365ec0 msgr2=0x56526f374d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.383+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f365ec0 0x56526f374d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.383+0000 7fb3f5b9c700 1 -- 172.21.15.8:0/1887334267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f01a5990 con 0x56526f367990 2023-10-06T23:26:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.383+0000 7fb3f5b9c700 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f376290 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800f530 tx=0x7fb3e8004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc0ce4b974f57da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.383+0000 7fb3d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:26:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.383+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/1887334267 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e802b070 con 0x56526f367990 2023-10-06T23:26:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.383+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/1887334267 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb3e800f920 con 0x56526f367990 2023-10-06T23:26:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.383+0000 7fb40b007b80 1 -- 172.21.15.8:0/1887334267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3dc004cc0 con 0x56526f367990 2023-10-06T23:26:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/1887334267 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3e8005720 con 0x56526f367990 2023-10-06T23:26:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb40b007b80 10 client.16872 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb40b007b80 1 -- 172.21.15.8:0/1887334267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56526f0e2250 con 0x56526f367990 2023-10-06T23:26:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/1887334267 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3dc004cc0 con 0x56526f367990 2023-10-06T23:26:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/1887334267 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb3e804d070 con 0x56526f367990 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb40b007b80 10 client.16872 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb40b007b80 10 client.16872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb40b007b80 20 client.16872 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.384+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56526f3d00b0 0x56526f3d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.385+0000 7fb40b007b80 4 client.16872 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.385+0000 7fb40b007b80 1 -- 172.21.15.8:0/1887334267 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56526f2b1ad0 con 0x56526f3d00b0 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.385+0000 7fb3f539b700 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56526f3d00b0 0x56526f3d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.386+0000 7fb3f539b700 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56526f3d00b0 0x56526f3d24a0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=600fa393453b2c45 server_cookie=79a1caaff37e6be2 in_seq=0 out_seq=0 2023-10-06T23:26:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.386+0000 7fb3d8ff9700 10 client.16872 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.405+0000 7fb3d8ff9700 1 -- 172.21.15.8:0/1887334267 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56526f2b1ad0 con 0x56526f3d00b0 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.405+0000 7fb3d8ff9700 10 client.16872 handle_command_reply: tid=0 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.405+0000 7fb40b007b80 1 client.16872 shutdown 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.405+0000 7fb40b007b80 1 -- 172.21.15.8:0/1887334267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 msgr2=0x56526f376290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.405+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f376290 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800f530 tx=0x7fb3e8004d20 comp rx=0 tx=0).stop 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.405+0000 7fb40b007b80 1 -- 172.21.15.8:0/1887334267 shutdown_connections 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.405+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56526f3d00b0 0x56526f3d24a0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.406+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56526f367990 0x56526f376290 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.406+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56526f365ec0 0x56526f374d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.406+0000 7fb40b007b80 1 --2- 172.21.15.8:0/1887334267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56526f366fd0 0x56526f375280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.406+0000 7fb40b007b80 1 -- 172.21.15.8:0/1887334267 >> 172.21.15.8:0/1887334267 conn(0x56526f2da200 msgr2=0x56526f36dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.406+0000 7fb3d8ff9700 0 client.16872 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.406+0000 7fb40b007b80 1 -- 172.21.15.8:0/1887334267 shutdown_connections 2023-10-06T23:26:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.406+0000 7fb40b007b80 1 -- 172.21.15.8:0/1887334267 wait complete. 2023-10-06T23:26:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.406+0000 7fb40b007b80 20 client.16872 trim_cache size 0 max 16384 2023-10-06T23:26:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:26:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:26:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:26:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 -- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb3e00a1500 msgr2=0x7fb3e00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb3e00a1500 0x7fb3e00a39c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x56526f365c60 tx=0x7fb3e8005be0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 -- 172.21.15.8:0/331220795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100ea0 msgr2=0x7fb3f00732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100ea0 0x7fb3f00732a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400bd70 tx=0x7fb3e400bda0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 -- 172.21.15.8:0/331220795 shutdown_connections 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb3e00a1500 0x7fb3e00a39c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3f0102a40 0x7fb3f0073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3f0100ea0 0x7fb3f00732a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 --2- 172.21.15.8:0/331220795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3f0102080 0x7fb3f00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 -- 172.21.15.8:0/331220795 >> 172.21.15.8:0/331220795 conn(0x7fb3f00fc480 msgr2=0x7fb3f00fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 -- 172.21.15.8:0/331220795 shutdown_connections 2023-10-06T23:26:13.412 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:13.407+0000 7fb3f75ff700 1 -- 172.21.15.8:0/331220795 wait complete. 2023-10-06T23:26:13.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:13 smithi156 ceph-mon[102862]: pgmap v752: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2023-10-06T23:26:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:13 smithi008 ceph-mon[98532]: pgmap v752: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2023-10-06T23:26:13.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:13 smithi190 ceph-mon[102658]: pgmap v752: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2023-10-06T23:26:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 680.0 s, 206.2 tps, lat 481.203 ms stddev 197.924 2023-10-06T23:26:15.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:15 smithi008 ceph-mon[98532]: pgmap v753: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 5.1 MiB/s wr, 534 op/s 2023-10-06T23:26:15.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:15 smithi190 ceph-mon[102658]: pgmap v753: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 5.1 MiB/s wr, 534 op/s 2023-10-06T23:26:16.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:15 smithi156 ceph-mon[102862]: pgmap v753: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 5.1 MiB/s wr, 534 op/s 2023-10-06T23:26:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:17 smithi008 ceph-mon[98532]: pgmap v754: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 5.1 MiB/s wr, 523 op/s 2023-10-06T23:26:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:26:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:26:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:26:17.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:17 smithi190 ceph-mon[102658]: pgmap v754: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 5.1 MiB/s wr, 523 op/s 2023-10-06T23:26:17.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:26:17.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:26:17.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:26:18.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:17 smithi156 ceph-mon[102862]: pgmap v754: 97 pgs: 97 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 5.1 MiB/s wr, 523 op/s 2023-10-06T23:26:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:26:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:26:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:26:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 685.0 s, 279.0 tps, lat 361.208 ms stddev 49.886 2023-10-06T23:26:19.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:19 smithi008 ceph-mon[98532]: pgmap v755: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 3.9 MiB/s wr, 425 op/s 2023-10-06T23:26:19.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:19 smithi190 ceph-mon[102658]: pgmap v755: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 3.9 MiB/s wr, 425 op/s 2023-10-06T23:26:20.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:19 smithi156 ceph-mon[102862]: pgmap v755: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 3.9 MiB/s wr, 425 op/s 2023-10-06T23:26:21.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:21 smithi008 ceph-mon[98532]: pgmap v756: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 5.0 MiB/s wr, 524 op/s 2023-10-06T23:26:21.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:21 smithi190 ceph-mon[102658]: pgmap v756: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 5.0 MiB/s wr, 524 op/s 2023-10-06T23:26:22.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:21 smithi156 ceph-mon[102862]: pgmap v756: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 5.0 MiB/s wr, 524 op/s 2023-10-06T23:26:22.176 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:26:22.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.488+0000 7f61bafff700 1 -- 172.21.15.8:0/1449153240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61b4074e90 msgr2=0x7f61b40732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.488+0000 7f61bafff700 1 --2- 172.21.15.8:0/1449153240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61b4074e90 0x7f61b40732e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009990 tx=0x7f61ac009ca0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.488+0000 7f61bafff700 1 -- 172.21.15.8:0/1449153240 shutdown_connections 2023-10-06T23:26:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.488+0000 7f61bafff700 1 --2- 172.21.15.8:0/1449153240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61b4108e10 0x7f61b410b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.488+0000 7f61bafff700 1 --2- 172.21.15.8:0/1449153240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61b4074e90 0x7f61b40732e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.488+0000 7f61bafff700 1 --2- 172.21.15.8:0/1449153240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61b40738b0 0x7f61b4073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.488+0000 7f61bafff700 1 -- 172.21.15.8:0/1449153240 >> 172.21.15.8:0/1449153240 conn(0x7f61b40fc4d0 msgr2=0x7f61b40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.488+0000 7f61bafff700 1 -- 172.21.15.8:0/1449153240 shutdown_connections 2023-10-06T23:26:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.489+0000 7f61bafff700 1 -- 172.21.15.8:0/1449153240 wait complete. 2023-10-06T23:26:22.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.490+0000 7f61bafff700 1 Processor -- start 2023-10-06T23:26:22.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.491+0000 7f61bafff700 1 -- start start 2023-10-06T23:26:22.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.491+0000 7f61bafff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61b40738b0 0x7f61b4198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.491+0000 7f61bafff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61b4074e90 0x7f61b4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.491+0000 7f61bafff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61b4108e10 0x7f61b41a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.491+0000 7f61bafff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41a0870 con 0x7f61b40738b0 2023-10-06T23:26:22.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.491+0000 7f61bafff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41a09e0 con 0x7f61b4074e90 2023-10-06T23:26:22.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.491+0000 7f61bafff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41a0ba0 con 0x7f61b4108e10 2023-10-06T23:26:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.492+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61b4074e90 0x7f61b4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.492+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61b4074e90 0x7f61b4199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58978/0 (socket says 172.21.15.8:58978) 2023-10-06T23:26:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.492+0000 7f61b3fff700 1 -- 172.21.15.8:0/2804849575 learned_addr learned my addr 172.21.15.8:0/2804849575 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.492+0000 7f61b8d9b700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61b40738b0 0x7f61b4198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.493+0000 7f61b959c700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61b4108e10 0x7f61b41a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.493+0000 7f61b3fff700 1 -- 172.21.15.8:0/2804849575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61b4108e10 msgr2=0x7f61b41a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.493+0000 7f61b3fff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61b4108e10 0x7f61b41a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.493+0000 7f61b3fff700 1 -- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61b40738b0 msgr2=0x7f61b4198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.493+0000 7f61b3fff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61b40738b0 0x7f61b4198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.493+0000 7f61b3fff700 1 -- 172.21.15.8:0/2804849575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0095f0 con 0x7f61b4074e90 2023-10-06T23:26:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.493+0000 7f61b8d9b700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61b40738b0 0x7f61b4198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.493+0000 7f61b3fff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61b4074e90 0x7f61b4199270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f619c00e9a0 tx=0x7f619c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.494+0000 7f61b1ffb700 1 -- 172.21.15.8:0/2804849575 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c009790 con 0x7f61b4074e90 2023-10-06T23:26:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.494+0000 7f61b1ffb700 1 -- 172.21.15.8:0/2804849575 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f619c00cbd0 con 0x7f61b4074e90 2023-10-06T23:26:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.494+0000 7f61b1ffb700 1 -- 172.21.15.8:0/2804849575 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c018680 con 0x7f61b4074e90 2023-10-06T23:26:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.494+0000 7f61bafff700 1 -- 172.21.15.8:0/2804849575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b41a0e80 con 0x7f61b4074e90 2023-10-06T23:26:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.494+0000 7f61bafff700 1 -- 172.21.15.8:0/2804849575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b41a1250 con 0x7f61b4074e90 2023-10-06T23:26:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.500+0000 7f61b1ffb700 1 -- 172.21.15.8:0/2804849575 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f619c00cd40 con 0x7f61b4074e90 2023-10-06T23:26:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.501+0000 7f61ce98eb80 1 Processor -- start 2023-10-06T23:26:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.502+0000 7f61ce98eb80 1 -- start start 2023-10-06T23:26:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.502+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 0x55ca9bd19e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.502+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd1ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.502+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1b270 0x55ca9bd1b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.502+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bc79460 con 0x55ca9bd1b270 2023-10-06T23:26:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.502+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bc6ac20 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.502+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bc68540 con 0x55ca9bd19a70 2023-10-06T23:26:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.503+0000 7f61b1ffb700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f61a00a1550 0x7f61a00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.503+0000 7f61b959c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 0x55ca9bd19e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.503+0000 7f61b1ffb700 1 -- 172.21.15.8:0/2804849575 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f619c014070 con 0x7f61b4074e90 2023-10-06T23:26:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.503+0000 7f61b8d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd1ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.503+0000 7f61b8d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd1ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58986/0 (socket says 172.21.15.8:58986) 2023-10-06T23:26:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.503+0000 7f61b8d9b700 1 -- 172.21.15.8:0/3255067986 learned_addr learned my addr 172.21.15.8:0/3255067986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.503+0000 7f61b3fff700 1 --2- 172.21.15.8:0/3255067986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1b270 0x55ca9bd1b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.503+0000 7f61b959c700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f61a00a1550 0x7f61a00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.504+0000 7f61b959c700 1 -- 172.21.15.8:0/3255067986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 msgr2=0x55ca9bd1ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.504+0000 7f61b959c700 1 --2- 172.21.15.8:0/3255067986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd1ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.504+0000 7f61b959c700 1 -- 172.21.15.8:0/3255067986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1b270 msgr2=0x55ca9bd1b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.504+0000 7f61b959c700 1 --2- 172.21.15.8:0/3255067986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1b270 0x55ca9bd1b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.504+0000 7f61b959c700 1 -- 172.21.15.8:0/3255067986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9ba8ede0 con 0x55ca9bd19a70 2023-10-06T23:26:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.504+0000 7f61b959c700 1 --2- 172.21.15.8:0/3255067986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 0x55ca9bd19e90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f61a40079c0 tx=0x7f61a4007cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf949d026d507bed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.505+0000 7f61aaffd700 1 -- 172.21.15.8:0/3255067986 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4021460 con 0x55ca9bd19a70 2023-10-06T23:26:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.505+0000 7f61b959c700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f61a00a1550 0x7f61a00a3a10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f61a400f000 tx=0x7f61a401c000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.505+0000 7f61aaffd700 1 -- 172.21.15.8:0/3255067986 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61a400f030 con 0x55ca9bd19a70 2023-10-06T23:26:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.505+0000 7f61aaffd700 1 -- 172.21.15.8:0/3255067986 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4019660 con 0x55ca9bd19a70 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 -- 172.21.15.8:0/3255067986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 msgr2=0x55ca9bd19e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/3255067986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 0x55ca9bd19e90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f61a40079c0 tx=0x7f61a4007cd0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 -- 172.21.15.8:0/3255067986 shutdown_connections 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/3255067986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1b270 0x55ca9bd1b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/3255067986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 0x55ca9bd19e90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/3255067986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd1ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 -- 172.21.15.8:0/3255067986 >> 172.21.15.8:0/3255067986 conn(0x55ca9bc85260 msgr2=0x55ca9bd0c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 -- 172.21.15.8:0/3255067986 shutdown_connections 2023-10-06T23:26:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.506+0000 7f61ce98eb80 1 -- 172.21.15.8:0/3255067986 wait complete. 2023-10-06T23:26:22.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.507+0000 7f61ce98eb80 1 -- start start 2023-10-06T23:26:22.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.507+0000 7f61ce98eb80 1 Processor -- start 2023-10-06T23:26:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.508+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd19a70 0x55ca9bd23860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.508+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd23da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.508+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd2ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.508+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bc63e30 con 0x55ca9bd19a70 2023-10-06T23:26:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.508+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bc00710 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.508+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bc003b0 con 0x55ca9bd1b270 2023-10-06T23:26:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.508+0000 7f61ce98eb80 10 client.0 _ll_register_callbacks cb 0x55ca9ba5d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.508+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd23da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b959c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd2ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b959c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd2ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:51940/0 (socket says 172.21.15.8:51940) 2023-10-06T23:26:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd23da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58994/0 (socket says 172.21.15.8:58994) 2023-10-06T23:26:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b959c700 1 -- 172.21.15.8:0/512352570 learned_addr learned my addr 172.21.15.8:0/512352570 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b8d9b700 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd19a70 0x55ca9bd23860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b3fff700 1 -- 172.21.15.8:0/512352570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 msgr2=0x55ca9bd2ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:22.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b3fff700 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd2ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b3fff700 1 -- 172.21.15.8:0/512352570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd19a70 msgr2=0x55ca9bd23860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:22.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b3fff700 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd19a70 0x55ca9bd23860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b3fff700 1 -- 172.21.15.8:0/512352570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a40075a0 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f61b3fff700 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd23da0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f619c099f30 tx=0x7f619c076ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf7db40cadac3da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:22.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.509+0000 7f6193fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:26:22.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.510+0000 7f6193fff700 1 -- 172.21.15.8:0/512352570 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c099920 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.510+0000 7f6193fff700 1 -- 172.21.15.8:0/512352570 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f619c094e40 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.510+0000 7f61ce98eb80 1 -- 172.21.15.8:0/512352570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca9bd03f10 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.510+0000 7f6193fff700 1 -- 172.21.15.8:0/512352570 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f619c09a230 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.510+0000 7f61ce98eb80 10 client.26780 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:22.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.510+0000 7f61ce98eb80 1 -- 172.21.15.8:0/512352570 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ca9ba77c60 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.511+0000 7f6193fff700 1 -- 172.21.15.8:0/512352570 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ca9bd03f10 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.512+0000 7f6193fff700 1 -- 172.21.15.8:0/512352570 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f619c0a2130 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.512+0000 7f61ce98eb80 10 client.26780 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.512+0000 7f61ce98eb80 10 client.26780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.512+0000 7f61ce98eb80 20 client.26780 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.512+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ca9bd2f5d0 0x55ca9bd319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.512+0000 7f61ce98eb80 4 client.26780 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:26:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.512+0000 7f61ce98eb80 1 -- 172.21.15.8:0/512352570 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca9bc5ce10 con 0x55ca9bd2f5d0 2023-10-06T23:26:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.513+0000 7f61b8d9b700 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ca9bd2f5d0 0x55ca9bd319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.513+0000 7f61b8d9b700 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ca9bd2f5d0 0x55ca9bd319f0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9ad2a60e8c14266 server_cookie=7fd620e086ba6f6a in_seq=0 out_seq=0 2023-10-06T23:26:22.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.513+0000 7f6193fff700 10 client.26780 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:22.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.514+0000 7f6193fff700 1 -- 172.21.15.8:0/512352570 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ca9bc5ce10 con 0x55ca9bd2f5d0 2023-10-06T23:26:22.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.514+0000 7f6193fff700 10 client.26780 handle_command_reply: tid=0 2023-10-06T23:26:22.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.514+0000 7f61ce98eb80 1 client.26780 shutdown 2023-10-06T23:26:22.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f61ce98eb80 1 -- 172.21.15.8:0/512352570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 msgr2=0x55ca9bd23da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd23da0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f619c099f30 tx=0x7f619c076ad0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f61ce98eb80 1 -- 172.21.15.8:0/512352570 shutdown_connections 2023-10-06T23:26:22.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ca9bd2f5d0 0x55ca9bd319f0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd19a70 0x55ca9bd23860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd2ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/512352570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd23da0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f61ce98eb80 1 -- 172.21.15.8:0/512352570 >> 172.21.15.8:0/512352570 conn(0x55ca9bc85260 msgr2=0x55ca9bd0bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:22.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.515+0000 7f6193fff700 0 client.26780 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:22.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.516+0000 7f61ce98eb80 1 -- 172.21.15.8:0/512352570 shutdown_connections 2023-10-06T23:26:22.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.516+0000 7f61ce98eb80 1 -- 172.21.15.8:0/512352570 wait complete. 2023-10-06T23:26:22.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.516+0000 7f61ce98eb80 20 client.26780 trim_cache size 0 max 16384 2023-10-06T23:26:22.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.539+0000 7f61ce98eb80 1 Processor -- start 2023-10-06T23:26:22.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.539+0000 7f61ce98eb80 1 -- start start 2023-10-06T23:26:22.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.539+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 0x55ca9bd216c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd2ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1b270 0x55ca9bd23610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bae4920 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bd1a7e0 con 0x55ca9bd1b270 2023-10-06T23:26:22.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bd22d10 con 0x55ca9bd19a70 2023-10-06T23:26:22.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd2ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61b3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd2ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35924/0 (socket says 172.21.15.8:35924) 2023-10-06T23:26:22.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61b3fff700 1 -- 172.21.15.8:0/2477828504 learned_addr learned my addr 172.21.15.8:0/2477828504 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:22.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.540+0000 7f61b959c700 1 --2- 172.21.15.8:0/2477828504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1b270 0x55ca9bd23610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61b3fff700 1 -- 172.21.15.8:0/2477828504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 msgr2=0x55ca9bd216c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T23:26:22.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61b3fff700 1 --2- 172.21.15.8:0/2477828504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 0x55ca9bd216c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61b3fff700 1 -- 172.21.15.8:0/2477828504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1b270 msgr2=0x55ca9bd23610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61b3fff700 1 --2- 172.21.15.8:0/2477828504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1b270 0x55ca9bd23610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61b3fff700 1 -- 172.21.15.8:0/2477828504 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9bab5250 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61b3fff700 1 --2- 172.21.15.8:0/2477828504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd2ada0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f619c0caa60 tx=0x7f619c0987e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a6a17dbcd08c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61ab7fe700 1 -- 172.21.15.8:0/2477828504 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c09a230 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61ab7fe700 1 -- 172.21.15.8:0/2477828504 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f619c09e380 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.541+0000 7f61ab7fe700 1 -- 172.21.15.8:0/2477828504 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c096020 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.542+0000 7f61ce98eb80 1 -- 172.21.15.8:0/2477828504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 msgr2=0x55ca9bd2ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.542+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/2477828504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd2ada0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f619c0caa60 tx=0x7f619c0987e0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.542+0000 7f61ce98eb80 1 -- 172.21.15.8:0/2477828504 shutdown_connections 2023-10-06T23:26:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.542+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/2477828504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd1b270 0x55ca9bd23610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.542+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/2477828504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd19a70 0x55ca9bd216c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.542+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/2477828504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd2ada0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.542+0000 7f61ce98eb80 1 -- 172.21.15.8:0/2477828504 >> 172.21.15.8:0/2477828504 conn(0x55ca9bc85260 msgr2=0x55ca9bd22480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.543+0000 7f61ce98eb80 1 -- 172.21.15.8:0/2477828504 shutdown_connections 2023-10-06T23:26:22.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.543+0000 7f61ce98eb80 1 -- 172.21.15.8:0/2477828504 wait complete. 2023-10-06T23:26:22.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.543+0000 7f61ce98eb80 1 -- start start 2023-10-06T23:26:22.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.543+0000 7f61ce98eb80 1 Processor -- start 2023-10-06T23:26:22.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.544+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd19a70 0x55ca9bd2a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.544+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd29000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.544+0000 7f61ce98eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd29540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.544+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bd29a80 con 0x55ca9bd1a3d0 2023-10-06T23:26:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.544+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bd29bf0 con 0x55ca9bd19a70 2023-10-06T23:26:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.544+0000 7f61ce98eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9bd29db0 con 0x55ca9bd1b270 2023-10-06T23:26:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.544+0000 7f61ce98eb80 10 client.0 _ll_register_callbacks cb 0x7f619c096570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b8d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd19a70 0x55ca9bd2a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b8d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd19a70 0x55ca9bd2a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59004/0 (socket says 172.21.15.8:59004) 2023-10-06T23:26:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b8d9b700 1 -- 172.21.15.8:0/1859075587 learned_addr learned my addr 172.21.15.8:0/1859075587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b8d9b700 1 -- 172.21.15.8:0/1859075587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 msgr2=0x55ca9bd29540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b959c700 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd29540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b8d9b700 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd29540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b8d9b700 1 -- 172.21.15.8:0/1859075587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 msgr2=0x55ca9bd29000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b8d9b700 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd29000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.545+0000 7f61b8d9b700 1 -- 172.21.15.8:0/1859075587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca9ba77c60 con 0x55ca9bd19a70 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.546+0000 7f61b959c700 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd29540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.546+0000 7f61b8d9b700 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd19a70 0x55ca9bd2a9f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0098e0 tx=0x7f61ac0056f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57f0a9c81273cc9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.546+0000 7f6193fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.546+0000 7f6193fff700 1 -- 172.21.15.8:0/1859075587 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac01d070 con 0x55ca9bd19a70 2023-10-06T23:26:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.546+0000 7f61ce98eb80 1 -- 172.21.15.8:0/1859075587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61a400f030 con 0x55ca9bd19a70 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.546+0000 7f6193fff700 1 -- 172.21.15.8:0/1859075587 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f61ac003680 con 0x55ca9bd19a70 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.547+0000 7f6193fff700 1 -- 172.21.15.8:0/1859075587 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61ac003840 con 0x55ca9bd19a70 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.547+0000 7f61ce98eb80 10 client.26786 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.547+0000 7f61ce98eb80 1 -- 172.21.15.8:0/1859075587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ca9ba8d2b0 con 0x55ca9bd19a70 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.547+0000 7f6193fff700 1 -- 172.21.15.8:0/1859075587 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61a400f030 con 0x55ca9bd19a70 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.547+0000 7f6193fff700 1 -- 172.21.15.8:0/1859075587 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61ac037070 con 0x55ca9bd19a70 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f61ce98eb80 10 client.26786 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f61ce98eb80 10 client.26786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f61ce98eb80 20 client.26786 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ca9bd84b80 0x55ca9bd86fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f61ce98eb80 4 client.26786 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:26:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f61ce98eb80 1 -- 172.21.15.8:0/1859075587 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ca9bc5cb30 con 0x55ca9bd84b80 2023-10-06T23:26:22.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f61b3fff700 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ca9bd84b80 0x55ca9bd86fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f61b3fff700 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ca9bd84b80 0x55ca9bd86fa0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9a6b0d956b0e4ef server_cookie=add34440db01bd48 in_seq=0 out_seq=0 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.548+0000 7f6193fff700 10 client.26786 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f6193fff700 1 -- 172.21.15.8:0/1859075587 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ca9bc5cb30 con 0x55ca9bd84b80 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f6193fff700 10 client.26786 handle_command_reply: tid=0 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 client.26786 shutdown 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 -- 172.21.15.8:0/1859075587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd19a70 msgr2=0x55ca9bd2a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd19a70 0x55ca9bd2a9f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0098e0 tx=0x7f61ac0056f0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 -- 172.21.15.8:0/1859075587 shutdown_connections 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55ca9bd84b80 0x55ca9bd86fa0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca9bd1b270 0x55ca9bd29540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca9bd19a70 0x55ca9bd2a9f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f6193fff700 0 client.26786 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 --2- 172.21.15.8:0/1859075587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ca9bd1a3d0 0x55ca9bd29000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 -- 172.21.15.8:0/1859075587 >> 172.21.15.8:0/1859075587 conn(0x55ca9bc85260 msgr2=0x55ca9bd216c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 -- 172.21.15.8:0/1859075587 shutdown_connections 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.549+0000 7f61ce98eb80 1 -- 172.21.15.8:0/1859075587 wait complete. 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.550+0000 7f61ce98eb80 20 client.26786 trim_cache size 0 max 16384 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:26:22.556 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:26:22.557 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:26:22.557 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:26:22.557 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:26:22.557 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:26:22.557 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:26:22.557 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:26:22.557 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:26:22.557 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 -- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f61a00a1550 msgr2=0x7f61a00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f61a00a1550 0x7f61a00a3a10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f61a400f000 tx=0x7f61a401c000 comp rx=0 tx=0).stop 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 -- 172.21.15.8:0/2804849575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61b4074e90 msgr2=0x7f61b4199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61b4074e90 0x7f61b4199270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f619c00e9a0 tx=0x7f619c00ecb0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 -- 172.21.15.8:0/2804849575 shutdown_connections 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f61a00a1550 0x7f61a00a3a10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f61b40738b0 0x7f61b4198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61b4108e10 0x7f61b41a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 --2- 172.21.15.8:0/2804849575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61b4074e90 0x7f61b4199270 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 -- 172.21.15.8:0/2804849575 >> 172.21.15.8:0/2804849575 conn(0x7f61b40fc4d0 msgr2=0x7f61b40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 -- 172.21.15.8:0/2804849575 shutdown_connections 2023-10-06T23:26:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:22.551+0000 7f61bafff700 1 -- 172.21.15.8:0/2804849575 wait complete. 2023-10-06T23:26:22.578 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:26:23.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:23 smithi156 ceph-mon[102862]: pgmap v757: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2023-10-06T23:26:23.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:23 smithi008 ceph-mon[98532]: pgmap v757: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2023-10-06T23:26:23.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:23 smithi190 ceph-mon[102658]: pgmap v757: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2023-10-06T23:26:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 690.0 s, 245.8 tps, lat 406.859 ms stddev 202.125 2023-10-06T23:26:25.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:25 smithi008 ceph-mon[98532]: pgmap v758: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 5.0 MiB/s wr, 513 op/s 2023-10-06T23:26:25.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:25 smithi190 ceph-mon[102658]: pgmap v758: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 5.0 MiB/s wr, 513 op/s 2023-10-06T23:26:26.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:25 smithi156 ceph-mon[102862]: pgmap v758: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 5.0 MiB/s wr, 513 op/s 2023-10-06T23:26:26.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 -- 172.21.15.8:0/1073907653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c701042a0 msgr2=0x7f6c70106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 --2- 172.21.15.8:0/1073907653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c701042a0 0x7f6c70106690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009990 tx=0x7f6c60009ca0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 -- 172.21.15.8:0/1073907653 shutdown_connections 2023-10-06T23:26:26.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 --2- 172.21.15.8:0/1073907653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c70101970 0x7f6c70103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 --2- 172.21.15.8:0/1073907653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c70106bd0 0x7f6c70109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 --2- 172.21.15.8:0/1073907653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c701042a0 0x7f6c70106690 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 -- 172.21.15.8:0/1073907653 >> 172.21.15.8:0/1073907653 conn(0x7f6c700fb340 msgr2=0x7f6c700fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:26.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 -- 172.21.15.8:0/1073907653 shutdown_connections 2023-10-06T23:26:26.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.636+0000 7f6c783ff700 1 -- 172.21.15.8:0/1073907653 wait complete. 2023-10-06T23:26:26.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.637+0000 7f6c783ff700 1 Processor -- start 2023-10-06T23:26:26.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.637+0000 7f6c783ff700 1 -- start start 2023-10-06T23:26:26.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.637+0000 7f6c783ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c70101970 0x7f6c700ff920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.637+0000 7f6c783ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c701042a0 0x7f6c700ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.637+0000 7f6c783ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70106bd0 0x7f6c701003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.637+0000 7f6c783ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c701a0b90 con 0x7f6c70101970 2023-10-06T23:26:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.637+0000 7f6c783ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c701a0cd0 con 0x7f6c70106bd0 2023-10-06T23:26:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.637+0000 7f6c783ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c701a0e10 con 0x7f6c701042a0 2023-10-06T23:26:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7619b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c70101970 0x7f6c700ff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7619b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c70101970 0x7f6c700ff920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35948/0 (socket says 172.21.15.8:35948) 2023-10-06T23:26:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7619b700 1 -- 172.21.15.8:0/3133311715 learned_addr learned my addr 172.21.15.8:0/3133311715 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7599a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c701042a0 0x7f6c700ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7699c700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70106bd0 0x7f6c701003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7619b700 1 -- 172.21.15.8:0/3133311715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c701042a0 msgr2=0x7f6c700ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7619b700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c701042a0 0x7f6c700ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7619b700 1 -- 172.21.15.8:0/3133311715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70106bd0 msgr2=0x7f6c701003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7619b700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70106bd0 0x7f6c701003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.638+0000 7f6c7619b700 1 -- 172.21.15.8:0/3133311715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600095f0 con 0x7f6c70101970 2023-10-06T23:26:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.639+0000 7f6c7599a700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c701042a0 0x7f6c700ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:26:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.639+0000 7f6c7619b700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c70101970 0x7f6c700ff920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00ef10 tx=0x7f6c6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.639+0000 7f6c677fe700 1 -- 172.21.15.8:0/3133311715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00ca70 con 0x7f6c70101970 2023-10-06T23:26:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.639+0000 7f6c677fe700 1 -- 172.21.15.8:0/3133311715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c00f040 con 0x7f6c70101970 2023-10-06T23:26:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.639+0000 7f6c677fe700 1 -- 172.21.15.8:0/3133311715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c014480 con 0x7f6c70101970 2023-10-06T23:26:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.639+0000 7f6c783ff700 1 -- 172.21.15.8:0/3133311715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c701a1040 con 0x7f6c70101970 2023-10-06T23:26:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.639+0000 7f6c783ff700 1 -- 172.21.15.8:0/3133311715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c701a1550 con 0x7f6c70101970 2023-10-06T23:26:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.643+0000 7f6c677fe700 1 -- 172.21.15.8:0/3133311715 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6c6c007500 con 0x7f6c70101970 2023-10-06T23:26:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.644+0000 7f6c8be06b80 1 Processor -- start 2023-10-06T23:26:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.645+0000 7f6c8be06b80 1 -- start start 2023-10-06T23:26:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.645+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.645+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac54450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.645+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac5b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.645+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85abbb400 con 0x55a85ac52ec0 2023-10-06T23:26:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.645+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85abacbc0 con 0x55a85ac53fd0 2023-10-06T23:26:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.645+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85abaa4e0 con 0x55a85ac54990 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac54450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7699c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7599a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac5b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac54450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59036/0 (socket says 172.21.15.8:59036) 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7619b700 1 -- 172.21.15.8:0/3714476116 learned_addr learned my addr 172.21.15.8:0/3714476116 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c677fe700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c5c0a1500 0x7f6c5c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c677fe700 1 -- 172.21.15.8:0/3133311715 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c6c0ccff0 con 0x7f6c70101970 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7619b700 1 -- 172.21.15.8:0/3714476116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 msgr2=0x55a85ac5b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7619b700 1 --2- 172.21.15.8:0/3714476116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac5b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7619b700 1 -- 172.21.15.8:0/3714476116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 msgr2=0x55a85ac532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.646+0000 7f6c7619b700 1 --2- 172.21.15.8:0/3714476116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.647+0000 7f6c7619b700 1 -- 172.21.15.8:0/3714476116 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a85a9d0d80 con 0x55a85ac53fd0 2023-10-06T23:26:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.647+0000 7f6c7699c700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c5c0a1500 0x7f6c5c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.647+0000 7f6c7619b700 1 --2- 172.21.15.8:0/3714476116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac54450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c09a000 tx=0x7f6c6c0965a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e30f2d38692368 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.647+0000 7f6c7699c700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c5c0a1500 0x7f6c5c0a39c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55a85ac52c60 tx=0x7f6c680047c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.647+0000 7f6c64bfe700 1 -- 172.21.15.8:0/3714476116 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c09a0d0 con 0x55a85ac53fd0 2023-10-06T23:26:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.648+0000 7f6c64bfe700 1 -- 172.21.15.8:0/3714476116 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c099e40 con 0x55a85ac53fd0 2023-10-06T23:26:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.648+0000 7f6c64bfe700 1 -- 172.21.15.8:0/3714476116 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0a2690 con 0x55a85ac53fd0 2023-10-06T23:26:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.648+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3714476116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 msgr2=0x55a85ac54450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.648+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/3714476116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac54450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c09a000 tx=0x7f6c6c0965a0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.649+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3714476116 shutdown_connections 2023-10-06T23:26:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.649+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/3714476116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.649+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/3714476116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac5b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.649+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/3714476116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac54450 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.649+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3714476116 >> 172.21.15.8:0/3714476116 conn(0x55a85abc7200 msgr2=0x55a85ac4dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.649+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3714476116 shutdown_connections 2023-10-06T23:26:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.649+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3714476116 wait complete. 2023-10-06T23:26:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.649+0000 7f6c8be06b80 1 -- start start 2023-10-06T23:26:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.650+0000 7f6c8be06b80 1 Processor -- start 2023-10-06T23:26:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.650+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac5cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.650+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac5d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.650+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac64140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.650+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85aba5dd0 con 0x55a85ac52ec0 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.650+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85ab426b0 con 0x55a85ac53fd0 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.650+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85ab42350 con 0x55a85ac54990 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.650+0000 7f6c8be06b80 10 client.0 _ll_register_callbacks cb 0x55a85a99f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7619b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac5cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7599a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac5d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7619b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac5cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35970/0 (socket says 172.21.15.8:35970) 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7599a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac5d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59050/0 (socket says 172.21.15.8:59050) 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7619b700 1 -- 172.21.15.8:0/223933320 learned_addr learned my addr 172.21.15.8:0/223933320 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7699c700 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac64140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7599a700 1 -- 172.21.15.8:0/223933320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 msgr2=0x55a85ac64140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7599a700 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac64140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7599a700 1 -- 172.21.15.8:0/223933320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 msgr2=0x55a85ac5cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7599a700 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac5cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7599a700 1 -- 172.21.15.8:0/223933320 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c701a1550 con 0x55a85ac53fd0 2023-10-06T23:26:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.651+0000 7f6c7619b700 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac5cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.652+0000 7f6c7599a700 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac5d100 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c600098e0 tx=0x7f6c600053b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa053a60f287eda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.652+0000 7f6c59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.652+0000 7f6c59ffb700 1 -- 172.21.15.8:0/223933320 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60003a90 con 0x55a85ac53fd0 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.652+0000 7f6c59ffb700 1 -- 172.21.15.8:0/223933320 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c60003bf0 con 0x55a85ac53fd0 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.652+0000 7f6c8be06b80 1 -- 172.21.15.8:0/223933320 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a85ac45d50 con 0x55a85ac53fd0 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.652+0000 7f6c59ffb700 1 -- 172.21.15.8:0/223933320 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c6000b710 con 0x55a85ac53fd0 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.652+0000 7f6c8be06b80 10 client.26798 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.652+0000 7f6c8be06b80 1 -- 172.21.15.8:0/223933320 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a85a9b9c00 con 0x55a85ac53fd0 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c59ffb700 1 -- 172.21.15.8:0/223933320 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a85ac45d50 con 0x55a85ac53fd0 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c59ffb700 1 -- 172.21.15.8:0/223933320 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c60004880 con 0x55a85ac53fd0 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c8be06b80 10 client.26798 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c8be06b80 10 client.26798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c8be06b80 20 client.26798 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a85ac68970 0x55a85ac6ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c8be06b80 4 client.26798 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:26:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c8be06b80 1 -- 172.21.15.8:0/223933320 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a85ab9edb0 con 0x55a85ac68970 2023-10-06T23:26:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.653+0000 7f6c7619b700 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a85ac68970 0x55a85ac6ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.654+0000 7f6c7619b700 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a85ac68970 0x55a85ac6ad90 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=603c4131a6c8d7c4 server_cookie=8ce6be5f4e20422e in_seq=0 out_seq=0 2023-10-06T23:26:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.654+0000 7f6c59ffb700 10 client.26798 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.655+0000 7f6c59ffb700 1 -- 172.21.15.8:0/223933320 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a85ab9edb0 con 0x55a85ac68970 2023-10-06T23:26:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.655+0000 7f6c59ffb700 10 client.26798 handle_command_reply: tid=0 2023-10-06T23:26:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.655+0000 7f6c8be06b80 1 client.26798 shutdown 2023-10-06T23:26:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.655+0000 7f6c8be06b80 1 -- 172.21.15.8:0/223933320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 msgr2=0x55a85ac5d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.655+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac5d100 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c600098e0 tx=0x7f6c600053b0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.655+0000 7f6c8be06b80 1 -- 172.21.15.8:0/223933320 shutdown_connections 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.655+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a85ac68970 0x55a85ac6ad90 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.656+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac52ec0 0x55a85ac5cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.656+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac64140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.656+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/223933320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac53fd0 0x55a85ac5d100 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.656+0000 7f6c8be06b80 1 -- 172.21.15.8:0/223933320 >> 172.21.15.8:0/223933320 conn(0x55a85abc7200 msgr2=0x55a85ac4d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.656+0000 7f6c59ffb700 0 client.26798 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.656+0000 7f6c8be06b80 1 -- 172.21.15.8:0/223933320 shutdown_connections 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.656+0000 7f6c8be06b80 1 -- 172.21.15.8:0/223933320 wait complete. 2023-10-06T23:26:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.656+0000 7f6c8be06b80 20 client.26798 trim_cache size 0 max 16384 2023-10-06T23:26:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.682+0000 7f6c8be06b80 1 Processor -- start 2023-10-06T23:26:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.682+0000 7f6c8be06b80 1 -- start start 2023-10-06T23:26:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.682+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac64100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac5ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85aa268c0 con 0x55a85ac53fd0 2023-10-06T23:26:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85ac5c730 con 0x55a85ac52ec0 2023-10-06T23:26:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85ac4ea00 con 0x55a85ac54990 2023-10-06T23:26:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c7619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c7599a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac64100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c7699c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac5ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c7619b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:59066/0 (socket says 172.21.15.8:59066) 2023-10-06T23:26:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c7619b700 1 -- 172.21.15.8:0/3405767959 learned_addr learned my addr 172.21.15.8:0/3405767959 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.683+0000 7f6c7599a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac64100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35986/0 (socket says 172.21.15.8:35986) 2023-10-06T23:26:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.684+0000 7f6c7599a700 1 -- 172.21.15.8:0/3405767959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 msgr2=0x55a85ac5ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.684+0000 7f6c7599a700 1 --2- 172.21.15.8:0/3405767959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac5ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.684+0000 7f6c7599a700 1 -- 172.21.15.8:0/3405767959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 msgr2=0x55a85ac543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.684+0000 7f6c7599a700 1 --2- 172.21.15.8:0/3405767959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.684+0000 7f6c7599a700 1 -- 172.21.15.8:0/3405767959 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a85a9f71f0 con 0x55a85ac53fd0 2023-10-06T23:26:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.684+0000 7f6c7619b700 1 --2- 172.21.15.8:0/3405767959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.684+0000 7f6c7599a700 1 --2- 172.21.15.8:0/3405767959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac64100 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6c60003f60 tx=0x7f6c60005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beb76b60fd1de16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.685+0000 7f6c653ff700 1 -- 172.21.15.8:0/3405767959 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60003a90 con 0x55a85ac53fd0 2023-10-06T23:26:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.685+0000 7f6c653ff700 1 -- 172.21.15.8:0/3405767959 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6001e040 con 0x55a85ac53fd0 2023-10-06T23:26:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.685+0000 7f6c653ff700 1 -- 172.21.15.8:0/3405767959 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000b970 con 0x55a85ac53fd0 2023-10-06T23:26:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.686+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3405767959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 msgr2=0x55a85ac64100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.686+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/3405767959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac64100 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6c60003f60 tx=0x7f6c60005910 comp rx=0 tx=0).stop 2023-10-06T23:26:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.686+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3405767959 shutdown_connections 2023-10-06T23:26:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.686+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/3405767959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac5ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.686+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/3405767959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.686+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/3405767959 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac64100 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.686+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3405767959 >> 172.21.15.8:0/3405767959 conn(0x55a85abc7200 msgr2=0x55a85ac5b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.687+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3405767959 shutdown_connections 2023-10-06T23:26:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.687+0000 7f6c8be06b80 1 -- 172.21.15.8:0/3405767959 wait complete. 2023-10-06T23:26:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.687+0000 7f6c8be06b80 1 -- start start 2023-10-06T23:26:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.688+0000 7f6c8be06b80 1 Processor -- start 2023-10-06T23:26:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.688+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac61980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.688+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac61ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.688+0000 7f6c8be06b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac62e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.688+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85ac633a0 con 0x55a85ac53fd0 2023-10-06T23:26:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.688+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85ac63510 con 0x55a85ac52ec0 2023-10-06T23:26:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.688+0000 7f6c8be06b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85ac636d0 con 0x55a85ac54990 2023-10-06T23:26:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.688+0000 7f6c8be06b80 10 client.0 _ll_register_callbacks cb 0x7f6c60005c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.689+0000 7f6c7699c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac62e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.689+0000 7f6c7699c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac62e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:51988/0 (socket says 172.21.15.8:51988) 2023-10-06T23:26:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.689+0000 7f6c7699c700 1 -- 172.21.15.8:0/1487086176 learned_addr learned my addr 172.21.15.8:0/1487086176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.689+0000 7f6c7599a700 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac61ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.689+0000 7f6c7619b700 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac61980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.690+0000 7f6c7699c700 1 -- 172.21.15.8:0/1487086176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 msgr2=0x55a85ac61980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.690+0000 7f6c7699c700 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac61980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.690+0000 7f6c7699c700 1 -- 172.21.15.8:0/1487086176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 msgr2=0x55a85ac61ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.690+0000 7f6c7699c700 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac61ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.690+0000 7f6c7699c700 1 -- 172.21.15.8:0/1487086176 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a85a9d0d80 con 0x55a85ac54990 2023-10-06T23:26:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.690+0000 7f6c7699c700 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac62e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800b5d0 tx=0x7f6c68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd1cedf3782438a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.690+0000 7f6c59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:26:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.690+0000 7f6c59ffb700 1 -- 172.21.15.8:0/1487086176 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68026070 con 0x55a85ac54990 2023-10-06T23:26:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.691+0000 7f6c59ffb700 1 -- 172.21.15.8:0/1487086176 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c68012e10 con 0x55a85ac54990 2023-10-06T23:26:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.691+0000 7f6c8be06b80 1 -- 172.21.15.8:0/1487086176 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c6c099e40 con 0x55a85ac54990 2023-10-06T23:26:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.691+0000 7f6c59ffb700 1 -- 172.21.15.8:0/1487086176 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c68021480 con 0x55a85ac54990 2023-10-06T23:26:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.691+0000 7f6c8be06b80 10 client.26809 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.691+0000 7f6c8be06b80 1 -- 172.21.15.8:0/1487086176 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a85a9b9c00 con 0x55a85ac54990 2023-10-06T23:26:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c59ffb700 1 -- 172.21.15.8:0/1487086176 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c099e40 con 0x55a85ac54990 2023-10-06T23:26:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c59ffb700 1 -- 172.21.15.8:0/1487086176 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c6802b620 con 0x55a85ac54990 2023-10-06T23:26:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c8be06b80 10 client.26809 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c8be06b80 10 client.26809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c8be06b80 20 client.26809 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a85acc5ae0 0x55a85acc7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c8be06b80 4 client.26809 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:26:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c8be06b80 1 -- 172.21.15.8:0/1487086176 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a85ab9ead0 con 0x55a85acc5ae0 2023-10-06T23:26:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.692+0000 7f6c7619b700 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a85acc5ae0 0x55a85acc7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:26.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.693+0000 7f6c7619b700 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a85acc5ae0 0x55a85acc7f00 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd78ee50e6ebca14 server_cookie=5abe24dc87d4e0ea in_seq=0 out_seq=0 2023-10-06T23:26:26.696 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.693+0000 7f6c59ffb700 10 client.26809 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.713+0000 7f6c59ffb700 1 -- 172.21.15.8:0/1487086176 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a85ab9ead0 con 0x55a85acc5ae0 2023-10-06T23:26:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.713+0000 7f6c59ffb700 10 client.26809 handle_command_reply: tid=0 2023-10-06T23:26:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.713+0000 7f6c8be06b80 1 client.26809 shutdown 2023-10-06T23:26:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.713+0000 7f6c8be06b80 1 -- 172.21.15.8:0/1487086176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 msgr2=0x55a85ac62e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.713+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac62e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800b5d0 tx=0x7f6c68004750 comp rx=0 tx=0).stop 2023-10-06T23:26:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 1 -- 172.21.15.8:0/1487086176 shutdown_connections 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a85acc5ae0 0x55a85acc7f00 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a85ac54990 0x55a85ac62e60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a85ac52ec0 0x55a85ac61980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c59ffb700 0 client.26809 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 1 --2- 172.21.15.8:0/1487086176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a85ac53fd0 0x55a85ac61ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 1 -- 172.21.15.8:0/1487086176 >> 172.21.15.8:0/1487086176 conn(0x55a85abc7200 msgr2=0x55a85ac5ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 1 -- 172.21.15.8:0/1487086176 shutdown_connections 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 1 -- 172.21.15.8:0/1487086176 wait complete. 2023-10-06T23:26:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.714+0000 7f6c8be06b80 20 client.26809 trim_cache size 0 max 16384 2023-10-06T23:26:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:26:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:26:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:26:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:26:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 -- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c5c0a1500 msgr2=0x7f6c5c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c5c0a1500 0x7f6c5c0a39c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55a85ac52c60 tx=0x7f6c680047c0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 -- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c70101970 msgr2=0x7f6c700ff920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c70101970 0x7f6c700ff920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00ef10 tx=0x7f6c6c00c3a0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 -- 172.21.15.8:0/3133311715 shutdown_connections 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6c5c0a1500 0x7f6c5c0a39c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c70101970 0x7f6c700ff920 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70106bd0 0x7f6c701003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 --2- 172.21.15.8:0/3133311715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c701042a0 0x7f6c700ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.715+0000 7f6c783ff700 1 -- 172.21.15.8:0/3133311715 >> 172.21.15.8:0/3133311715 conn(0x7f6c700fb340 msgr2=0x7f6c701025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.716+0000 7f6c783ff700 1 -- 172.21.15.8:0/3133311715 shutdown_connections 2023-10-06T23:26:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:26.716+0000 7f6c783ff700 1 -- 172.21.15.8:0/3133311715 wait complete. 2023-10-06T23:26:27.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:27 smithi008 ceph-mon[98532]: pgmap v759: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 4.1 MiB/s wr, 451 op/s 2023-10-06T23:26:27.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:27 smithi190 ceph-mon[102658]: pgmap v759: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 4.1 MiB/s wr, 451 op/s 2023-10-06T23:26:28.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:27 smithi156 ceph-mon[102862]: pgmap v759: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 4.1 MiB/s wr, 451 op/s 2023-10-06T23:26:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 695.0 s, 250.6 tps, lat 396.310 ms stddev 78.227 2023-10-06T23:26:29.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:29 smithi008 ceph-mon[98532]: pgmap v760: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.7 MiB/s wr, 477 op/s 2023-10-06T23:26:29.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:29 smithi190 ceph-mon[102658]: pgmap v760: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.7 MiB/s wr, 477 op/s 2023-10-06T23:26:30.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:29 smithi156 ceph-mon[102862]: pgmap v760: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 4.7 MiB/s wr, 477 op/s 2023-10-06T23:26:31.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:31 smithi008 ceph-mon[98532]: pgmap v761: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 5.5 MiB/s wr, 553 op/s 2023-10-06T23:26:31.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:31 smithi190 ceph-mon[102658]: pgmap v761: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 5.5 MiB/s wr, 553 op/s 2023-10-06T23:26:32.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:31 smithi156 ceph-mon[102862]: pgmap v761: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 5.5 MiB/s wr, 553 op/s 2023-10-06T23:26:33.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:33 smithi156 ceph-mon[102862]: pgmap v762: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 4.3 MiB/s wr, 446 op/s 2023-10-06T23:26:33.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:33 smithi008 ceph-mon[98532]: pgmap v762: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 4.3 MiB/s wr, 446 op/s 2023-10-06T23:26:33.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:33 smithi190 ceph-mon[102658]: pgmap v762: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 4.3 MiB/s wr, 446 op/s 2023-10-06T23:26:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 700.0 s, 286.2 tps, lat 352.869 ms stddev 50.648 2023-10-06T23:26:35.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:35 smithi008 ceph-mon[98532]: pgmap v763: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 4.5 MiB/s wr, 475 op/s 2023-10-06T23:26:35.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:35 smithi190 ceph-mon[102658]: pgmap v763: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 4.5 MiB/s wr, 475 op/s 2023-10-06T23:26:36.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:35 smithi156 ceph-mon[102862]: pgmap v763: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 4.5 MiB/s wr, 475 op/s 2023-10-06T23:26:37.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:37 smithi008 ceph-mon[98532]: pgmap v764: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.3 MiB/s wr, 549 op/s 2023-10-06T23:26:37.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:37 smithi190 ceph-mon[102658]: pgmap v764: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.3 MiB/s wr, 549 op/s 2023-10-06T23:26:38.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:37 smithi156 ceph-mon[102862]: pgmap v764: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.3 MiB/s wr, 549 op/s 2023-10-06T23:26:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 705.0 s, 272.8 tps, lat 363.256 ms stddev 40.886 2023-10-06T23:26:39.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:39 smithi008 ceph-mon[98532]: pgmap v765: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.1 MiB/s wr, 535 op/s 2023-10-06T23:26:39.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:39 smithi190 ceph-mon[102658]: pgmap v765: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.1 MiB/s wr, 535 op/s 2023-10-06T23:26:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.096+0000 7fecefbff700 1 -- 172.21.15.8:0/2562105652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074ef0 msgr2=0x7fece8073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.096+0000 7fecefbff700 1 --2- 172.21.15.8:0/2562105652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074ef0 0x7fece8073340 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fece4009990 tx=0x7fece4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.097+0000 7fecefbff700 1 -- 172.21.15.8:0/2562105652 shutdown_connections 2023-10-06T23:26:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.097+0000 7fecefbff700 1 --2- 172.21.15.8:0/2562105652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8074ef0 0x7fece8073340 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.097+0000 7fecefbff700 1 --2- 172.21.15.8:0/2562105652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fece810d4c0 0x7fece810f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.097+0000 7fecefbff700 1 --2- 172.21.15.8:0/2562105652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece8073910 0x7fece8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.097+0000 7fecefbff700 1 -- 172.21.15.8:0/2562105652 >> 172.21.15.8:0/2562105652 conn(0x7fece80fc460 msgr2=0x7fece80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.097+0000 7fecefbff700 1 -- 172.21.15.8:0/2562105652 shutdown_connections 2023-10-06T23:26:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.097+0000 7fecefbff700 1 -- 172.21.15.8:0/2562105652 wait complete. 2023-10-06T23:26:40.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:39 smithi156 ceph-mon[102862]: pgmap v765: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.1 MiB/s wr, 535 op/s 2023-10-06T23:26:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.098+0000 7fecefbff700 1 Processor -- start 2023-10-06T23:26:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.098+0000 7fecefbff700 1 -- start start 2023-10-06T23:26:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.098+0000 7fecefbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8073910 0x7fece819d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7fecefbff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece8074ef0 0x7fece819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7fecefbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fece810d4c0 0x7fece819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7fecefbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece819ec60 con 0x7fece8073910 2023-10-06T23:26:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7fecefbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece819edd0 con 0x7fece810d4c0 2023-10-06T23:26:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7fecefbff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece819ef90 con 0x7fece8074ef0 2023-10-06T23:26:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7feced99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8073910 0x7fece819d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7feced19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece8074ef0 0x7fece819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7feced99b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8073910 0x7fece819d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33730/0 (socket says 172.21.15.8:33730) 2023-10-06T23:26:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7feced19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece8074ef0 0x7fece819d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:57200/0 (socket says 172.21.15.8:57200) 2023-10-06T23:26:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7fecee19c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fece810d4c0 0x7fece819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.099+0000 7feced99b700 1 -- 172.21.15.8:0/2884276369 learned_addr learned my addr 172.21.15.8:0/2884276369 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7feced19a700 1 -- 172.21.15.8:0/2884276369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fece810d4c0 msgr2=0x7fece819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7feced19a700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fece810d4c0 0x7fece819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7feced19a700 1 -- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8073910 msgr2=0x7fece819d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7feced19a700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8073910 0x7fece819d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7feced19a700 1 -- 172.21.15.8:0/2884276369 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece40095f0 con 0x7fece8074ef0 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7fecee19c700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fece810d4c0 0x7fece819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7feced19a700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece8074ef0 0x7fece819d780 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fecd800e9c0 tx=0x7fecd800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7fecdeffd700 1 -- 172.21.15.8:0/2884276369 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8004220 con 0x7fece8074ef0 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7fecdeffd700 1 -- 172.21.15.8:0/2884276369 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecd8004380 con 0x7fece8074ef0 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.100+0000 7fecefbff700 1 -- 172.21.15.8:0/2884276369 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece819f270 con 0x7fece8074ef0 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.101+0000 7fecdeffd700 1 -- 172.21.15.8:0/2884276369 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8003b40 con 0x7fece8074ef0 2023-10-06T23:26:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.101+0000 7fecefbff700 1 -- 172.21.15.8:0/2884276369 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece81a5a30 con 0x7fece8074ef0 2023-10-06T23:26:40.105 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.104+0000 7fecdeffd700 1 -- 172.21.15.8:0/2884276369 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fecd8003ca0 con 0x7fece8074ef0 2023-10-06T23:26:40.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.106+0000 7fecdeffd700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecd40a1500 0x7fecd40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.107 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.106+0000 7fecdeffd700 1 -- 172.21.15.8:0/2884276369 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecd8014070 con 0x7fece8074ef0 2023-10-06T23:26:40.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.106+0000 7feced99b700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecd40a1500 0x7fecd40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.108 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.107+0000 7feced99b700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecd40a1500 0x7fecd40a39c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fece4006010 tx=0x7fece400b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:40.122 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.121+0000 7fed03526b80 1 Processor -- start 2023-10-06T23:26:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.122+0000 7fed03526b80 1 -- start start 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.122+0000 7fed03526b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723862e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.122+0000 7fed03526b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72387450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.122+0000 7fed03526b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc7238e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.122+0000 7fed03526b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc722ee400 con 0x55dc72387990 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.122+0000 7fed03526b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc722dfbc0 con 0x55dc72386fd0 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.122+0000 7fed03526b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc722dd4e0 con 0x55dc72385ec0 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.122+0000 7feced19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72387450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7feced99b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7feced19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72387450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38852/0 (socket says 172.21.15.8:38852) 2023-10-06T23:26:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7feced19a700 1 -- 172.21.15.8:0/112364102 learned_addr learned my addr 172.21.15.8:0/112364102 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7fecee19c700 1 --2- 172.21.15.8:0/112364102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc7238e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7feced19a700 1 -- 172.21.15.8:0/112364102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 msgr2=0x55dc723862e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7feced19a700 1 --2- 172.21.15.8:0/112364102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723862e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7feced19a700 1 -- 172.21.15.8:0/112364102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 msgr2=0x55dc7238e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7feced19a700 1 --2- 172.21.15.8:0/112364102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc7238e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.123+0000 7feced19a700 1 -- 172.21.15.8:0/112364102 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc72103d80 con 0x55dc72386fd0 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.124+0000 7feced19a700 1 --2- 172.21.15.8:0/112364102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72387450 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fecd80966d0 tx=0x7fecd8099d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=285ea5f59a49462c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.124+0000 7fecd3fff700 1 -- 172.21.15.8:0/112364102 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd809a8d0 con 0x55dc72386fd0 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.124+0000 7fecd3fff700 1 -- 172.21.15.8:0/112364102 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecd809a1d0 con 0x55dc72386fd0 2023-10-06T23:26:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.124+0000 7fecd3fff700 1 -- 172.21.15.8:0/112364102 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8098690 con 0x55dc72386fd0 2023-10-06T23:26:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 -- 172.21.15.8:0/112364102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 msgr2=0x55dc72387450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 --2- 172.21.15.8:0/112364102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72387450 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fecd80966d0 tx=0x7fecd8099d90 comp rx=0 tx=0).stop 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 -- 172.21.15.8:0/112364102 shutdown_connections 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 --2- 172.21.15.8:0/112364102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc7238e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 --2- 172.21.15.8:0/112364102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723862e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 --2- 172.21.15.8:0/112364102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72387450 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 -- 172.21.15.8:0/112364102 >> 172.21.15.8:0/112364102 conn(0x55dc722fa200 msgr2=0x55dc72380bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 -- 172.21.15.8:0/112364102 shutdown_connections 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.125+0000 7fed03526b80 1 -- 172.21.15.8:0/112364102 wait complete. 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.126+0000 7fed03526b80 1 -- start start 2023-10-06T23:26:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.126+0000 7fed03526b80 1 Processor -- start 2023-10-06T23:26:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.127+0000 7fed03526b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.127+0000 7fed03526b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72386fd0 0x55dc72390050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.127+0000 7fed03526b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72387990 0x55dc72397090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.127+0000 7fed03526b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc722d8dd0 con 0x55dc72386fd0 2023-10-06T23:26:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.127+0000 7fed03526b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc722756b0 con 0x55dc72385ec0 2023-10-06T23:26:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.127+0000 7fed03526b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc72275350 con 0x55dc72387990 2023-10-06T23:26:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.127+0000 7fed03526b80 10 client.0 _ll_register_callbacks cb 0x55dc720d27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7fecee19c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72387990 0x55dc72397090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38864/0 (socket says 172.21.15.8:38864) 2023-10-06T23:26:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced99b700 1 -- 172.21.15.8:0/1539399964 learned_addr learned my addr 172.21.15.8:0/1539399964 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced19a700 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72386fd0 0x55dc72390050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced99b700 1 -- 172.21.15.8:0/1539399964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72387990 msgr2=0x55dc72397090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:40.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced99b700 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72387990 0x55dc72397090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced99b700 1 -- 172.21.15.8:0/1539399964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72386fd0 msgr2=0x55dc72390050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced99b700 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72386fd0 0x55dc72390050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7feced99b700 1 -- 172.21.15.8:0/1539399964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece81a5a30 con 0x55dc72385ec0 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.128+0000 7fecee19c700 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72387990 0x55dc72397090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.129+0000 7feced99b700 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238fb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fece4003ad0 tx=0x7fece4009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=755210f26866be2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.129+0000 7fecd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.129+0000 7fecd17fa700 1 -- 172.21.15.8:0/1539399964 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4005a00 con 0x55dc72385ec0 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.129+0000 7fecd17fa700 1 -- 172.21.15.8:0/1539399964 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fece400bdb0 con 0x55dc72385ec0 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.129+0000 7fed03526b80 1 -- 172.21.15.8:0/1539399964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc72378d50 con 0x55dc72385ec0 2023-10-06T23:26:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.130+0000 7fecd17fa700 1 -- 172.21.15.8:0/1539399964 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fece4004500 con 0x55dc72385ec0 2023-10-06T23:26:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.130+0000 7fed03526b80 10 client.26816 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.130+0000 7fed03526b80 1 -- 172.21.15.8:0/1539399964 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55dc720ecc00 con 0x55dc72385ec0 2023-10-06T23:26:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.130+0000 7fecd17fa700 1 -- 172.21.15.8:0/1539399964 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fece4040020 con 0x55dc72385ec0 2023-10-06T23:26:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.130+0000 7fecd17fa700 1 -- 172.21.15.8:0/1539399964 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fece402f070 con 0x55dc72385ec0 2023-10-06T23:26:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.130+0000 7fed03526b80 10 client.26816 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.130+0000 7fed03526b80 10 client.26816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.130+0000 7fed03526b80 20 client.26816 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.131+0000 7fed03526b80 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55dc7239b960 0x55dc7239dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.131+0000 7fed03526b80 4 client.26816 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.131+0000 7fed03526b80 1 -- 172.21.15.8:0/1539399964 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc722d1db0 con 0x55dc7239b960 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.131+0000 7feced19a700 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55dc7239b960 0x55dc7239dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.132+0000 7feced19a700 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55dc7239b960 0x55dc7239dd80 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a6a90e42b051fc server_cookie=3b9110a27372b6df in_seq=0 out_seq=0 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.132+0000 7fecd17fa700 10 client.26816 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.132+0000 7fecd17fa700 1 -- 172.21.15.8:0/1539399964 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc722d1db0 con 0x55dc7239b960 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.132+0000 7fecd17fa700 10 client.26816 handle_command_reply: tid=0 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 client.26816 shutdown 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 -- 172.21.15.8:0/1539399964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 msgr2=0x55dc7238fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238fb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fece4003ad0 tx=0x7fece4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 -- 172.21.15.8:0/1539399964 shutdown_connections 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55dc7239b960 0x55dc7239dd80 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72387990 0x55dc72397090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238fb10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 --2- 172.21.15.8:0/1539399964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72386fd0 0x55dc72390050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fed03526b80 1 -- 172.21.15.8:0/1539399964 >> 172.21.15.8:0/1539399964 conn(0x55dc722fa200 msgr2=0x55dc72380250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.133+0000 7fecd17fa700 0 client.26816 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.134+0000 7fed03526b80 1 -- 172.21.15.8:0/1539399964 shutdown_connections 2023-10-06T23:26:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.134+0000 7fed03526b80 1 -- 172.21.15.8:0/1539399964 wait complete. 2023-10-06T23:26:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.134+0000 7fed03526b80 20 client.26816 trim_cache size 0 max 16384 2023-10-06T23:26:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7fed03526b80 1 Processor -- start 2023-10-06T23:26:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7fed03526b80 1 -- start start 2023-10-06T23:26:40.154 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7fed03526b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7fed03526b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72386fd0 0x55dc7238ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7fed03526b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72397050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7fed03526b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc721598c0 con 0x55dc72387990 2023-10-06T23:26:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7fed03526b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc7238efc0 con 0x55dc72385ec0 2023-10-06T23:26:40.155 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7fed03526b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc72386c80 con 0x55dc72386fd0 2023-10-06T23:26:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7feced19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72386fd0 0x55dc7238ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7feced99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7feced99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:38874/0 (socket says 172.21.15.8:38874) 2023-10-06T23:26:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7feced99b700 1 -- 172.21.15.8:0/540329690 learned_addr learned my addr 172.21.15.8:0/540329690 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.153+0000 7feced19a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72386fd0 0x55dc7238ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:57234/0 (socket says 172.21.15.8:57234) 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.154+0000 7fecee19c700 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72397050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.154+0000 7feced99b700 1 -- 172.21.15.8:0/540329690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72386fd0 msgr2=0x55dc7238ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.154+0000 7feced99b700 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72386fd0 0x55dc7238ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.154+0000 7feced99b700 1 -- 172.21.15.8:0/540329690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 msgr2=0x55dc72397050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.154+0000 7feced99b700 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72397050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.154+0000 7feced99b700 1 -- 172.21.15.8:0/540329690 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc7212a1f0 con 0x55dc72385ec0 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.154+0000 7fecee19c700 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72397050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.154+0000 7feced99b700 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238a930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fece403c660 tx=0x7fece4005a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55fc1d7addf7d55a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.155+0000 7fecdcbff700 1 -- 172.21.15.8:0/540329690 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400b9f0 con 0x55dc72385ec0 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.155+0000 7fecdcbff700 1 -- 172.21.15.8:0/540329690 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fece4028050 con 0x55dc72385ec0 2023-10-06T23:26:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.155+0000 7fecdcbff700 1 -- 172.21.15.8:0/540329690 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4004b00 con 0x55dc72385ec0 2023-10-06T23:26:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 -- 172.21.15.8:0/540329690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 msgr2=0x55dc7238a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238a930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fece403c660 tx=0x7fece4005a80 comp rx=0 tx=0).stop 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 -- 172.21.15.8:0/540329690 shutdown_connections 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72397050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72385ec0 0x55dc7238a930 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 --2- 172.21.15.8:0/540329690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72386fd0 0x55dc7238ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 -- 172.21.15.8:0/540329690 >> 172.21.15.8:0/540329690 conn(0x55dc722fa200 msgr2=0x55dc7238de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 -- 172.21.15.8:0/540329690 shutdown_connections 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 -- 172.21.15.8:0/540329690 wait complete. 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.156+0000 7fed03526b80 1 -- start start 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.157+0000 7fed03526b80 1 Processor -- start 2023-10-06T23:26:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.157+0000 7fed03526b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723949d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.157+0000 7fed03526b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72394f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.157+0000 7fed03526b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72395f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.157+0000 7fed03526b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc72396460 con 0x55dc72387990 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.157+0000 7fed03526b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc723965d0 con 0x55dc72386fd0 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.157+0000 7fed03526b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc72396790 con 0x55dc72385ec0 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.157+0000 7fed03526b80 10 client.0 _ll_register_callbacks cb 0x7fece4003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced99b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced99b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723949d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:57244/0 (socket says 172.21.15.8:57244) 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced99b700 1 -- 172.21.15.8:0/3510646334 learned_addr learned my addr 172.21.15.8:0/3510646334 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced19a700 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72394f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7fecee19c700 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72395f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced99b700 1 -- 172.21.15.8:0/3510646334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 msgr2=0x55dc72394f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced99b700 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72394f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced99b700 1 -- 172.21.15.8:0/3510646334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 msgr2=0x55dc72395f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced99b700 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72395f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.158+0000 7feced99b700 1 -- 172.21.15.8:0/3510646334 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc720ecc00 con 0x55dc72385ec0 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.159+0000 7feced99b700 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723949d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fece4009ce0 tx=0x7fece400bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd53cde1dcc95cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.159+0000 7fecd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.159+0000 7fecd17fa700 1 -- 172.21.15.8:0/3510646334 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece403dd20 con 0x55dc72385ec0 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.159+0000 7fed03526b80 1 -- 172.21.15.8:0/3510646334 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fecd809a1d0 con 0x55dc72385ec0 2023-10-06T23:26:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.159+0000 7fecd17fa700 1 -- 172.21.15.8:0/3510646334 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fece4041080 con 0x55dc72385ec0 2023-10-06T23:26:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.160+0000 7fecd17fa700 1 -- 172.21.15.8:0/3510646334 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fece4053030 con 0x55dc72385ec0 2023-10-06T23:26:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.160+0000 7fed03526b80 10 client.26827 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.160+0000 7fed03526b80 1 -- 172.21.15.8:0/3510646334 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55dc72102250 con 0x55dc72385ec0 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.160+0000 7fecd17fa700 1 -- 172.21.15.8:0/3510646334 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecd809a1d0 con 0x55dc72385ec0 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.160+0000 7fecd17fa700 1 -- 172.21.15.8:0/3510646334 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fece4003b00 con 0x55dc72385ec0 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.160+0000 7fed03526b80 10 client.26827 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.160+0000 7fed03526b80 10 client.26827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.160+0000 7fed03526b80 20 client.26827 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.161+0000 7fed03526b80 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55dc723efea0 0x55dc723f2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.161+0000 7fed03526b80 4 client.26827 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.161+0000 7fed03526b80 1 -- 172.21.15.8:0/3510646334 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dc722d1ad0 con 0x55dc723efea0 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.161+0000 7feced19a700 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55dc723efea0 0x55dc723f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.162+0000 7feced19a700 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55dc723efea0 0x55dc723f2290 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fe3451e0411ff46 server_cookie=9707bae39ce0d6b9 in_seq=0 out_seq=0 2023-10-06T23:26:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.162+0000 7fecd17fa700 10 client.26827 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.179+0000 7fecd17fa700 1 -- 172.21.15.8:0/3510646334 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dc722d1ad0 con 0x55dc723efea0 2023-10-06T23:26:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.179+0000 7fecd17fa700 10 client.26827 handle_command_reply: tid=0 2023-10-06T23:26:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.179+0000 7fed03526b80 1 client.26827 shutdown 2023-10-06T23:26:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 -- 172.21.15.8:0/3510646334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 msgr2=0x55dc723949d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723949d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fece4009ce0 tx=0x7fece400bdb0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 -- 172.21.15.8:0/3510646334 shutdown_connections 2023-10-06T23:26:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55dc723efea0 0x55dc723f2290 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc72387990 0x55dc72395f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dc72385ec0 0x55dc723949d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 --2- 172.21.15.8:0/3510646334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc72386fd0 0x55dc72394f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 -- 172.21.15.8:0/3510646334 >> 172.21.15.8:0/3510646334 conn(0x55dc722fa200 msgr2=0x55dc7238a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fecd17fa700 0 client.26827 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 -- 172.21.15.8:0/3510646334 shutdown_connections 2023-10-06T23:26:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.180+0000 7fed03526b80 1 -- 172.21.15.8:0/3510646334 wait complete. 2023-10-06T23:26:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.181+0000 7fed03526b80 20 client.26827 trim_cache size 0 max 16384 2023-10-06T23:26:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:26:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:26:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:26:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:26:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.181+0000 7fecefbff700 1 -- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecd40a1500 msgr2=0x7fecd40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.181+0000 7fecefbff700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecd40a1500 0x7fecd40a39c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fece4006010 tx=0x7fece400b260 comp rx=0 tx=0).stop 2023-10-06T23:26:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.181+0000 7fecefbff700 1 -- 172.21.15.8:0/2884276369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece8074ef0 msgr2=0x7fece819d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.181+0000 7fecefbff700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece8074ef0 0x7fece819d780 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fecd800e9c0 tx=0x7fecd800ecd0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.182+0000 7fecefbff700 1 -- 172.21.15.8:0/2884276369 shutdown_connections 2023-10-06T23:26:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.182+0000 7fecefbff700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fecd40a1500 0x7fecd40a39c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.182+0000 7fecefbff700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fece8073910 0x7fece819d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.182+0000 7fecefbff700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fece810d4c0 0x7fece819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.182+0000 7fecefbff700 1 --2- 172.21.15.8:0/2884276369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fece8074ef0 0x7fece819d780 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.182+0000 7fecefbff700 1 -- 172.21.15.8:0/2884276369 >> 172.21.15.8:0/2884276369 conn(0x7fece80fc460 msgr2=0x7fece80fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.182+0000 7fecefbff700 1 -- 172.21.15.8:0/2884276369 shutdown_connections 2023-10-06T23:26:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:40.182+0000 7fecefbff700 1 -- 172.21.15.8:0/2884276369 wait complete. 2023-10-06T23:26:41.903 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:41 smithi008 ceph-mon[98532]: pgmap v766: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2023-10-06T23:26:41.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:41 smithi190 ceph-mon[102658]: pgmap v766: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2023-10-06T23:26:42.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:41 smithi156 ceph-mon[102862]: pgmap v766: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2023-10-06T23:26:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:43 smithi156 ceph-mon[102862]: pgmap v767: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2023-10-06T23:26:43.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:43 smithi008 ceph-mon[98532]: pgmap v767: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2023-10-06T23:26:43.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:43 smithi190 ceph-mon[102658]: pgmap v767: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2023-10-06T23:26:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 710.0 s, 253.4 tps, lat 396.260 ms stddev 58.026 2023-10-06T23:26:45.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:45 smithi008 ceph-mon[98532]: pgmap v768: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 5.3 MiB/s wr, 593 op/s 2023-10-06T23:26:45.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:45 smithi190 ceph-mon[102658]: pgmap v768: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 5.3 MiB/s wr, 593 op/s 2023-10-06T23:26:46.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:45 smithi156 ceph-mon[102862]: pgmap v768: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 5.3 MiB/s wr, 593 op/s 2023-10-06T23:26:47.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:47 smithi008 ceph-mon[98532]: pgmap v769: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 5.2 MiB/s wr, 566 op/s 2023-10-06T23:26:47.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:47 smithi190 ceph-mon[102658]: pgmap v769: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 5.2 MiB/s wr, 566 op/s 2023-10-06T23:26:48.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:47 smithi156 ceph-mon[102862]: pgmap v769: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 5.2 MiB/s wr, 566 op/s 2023-10-06T23:26:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 715.0 s, 266.2 tps, lat 374.059 ms stddev 34.824 2023-10-06T23:26:49.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:49 smithi190 ceph-mon[102658]: pgmap v770: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 3.8 MiB/s wr, 450 op/s 2023-10-06T23:26:50.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:49 smithi156 ceph-mon[102862]: pgmap v770: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 3.8 MiB/s wr, 450 op/s 2023-10-06T23:26:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:49 smithi008 ceph-mon[98532]: pgmap v770: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 3.8 MiB/s wr, 450 op/s 2023-10-06T23:26:51.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:51 smithi190 ceph-mon[102658]: pgmap v771: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2023-10-06T23:26:52.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:51 smithi156 ceph-mon[102862]: pgmap v771: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2023-10-06T23:26:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:51 smithi008 ceph-mon[98532]: pgmap v771: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2023-10-06T23:26:52.579 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:26:53.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 -- 172.21.15.8:0/240281449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77e8100e90 msgr2=0x7f77e81012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 --2- 172.21.15.8:0/240281449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77e8100e90 0x7f77e81012b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009990 tx=0x7f77e4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 -- 172.21.15.8:0/240281449 shutdown_connections 2023-10-06T23:26:53.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 --2- 172.21.15.8:0/240281449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77e8100e90 0x7f77e81012b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 --2- 172.21.15.8:0/240281449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77e8102a30 0x7f77e8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 --2- 172.21.15.8:0/240281449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e8102070 0x7f77e81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 -- 172.21.15.8:0/240281449 >> 172.21.15.8:0/240281449 conn(0x7f77e80fc430 msgr2=0x7f77e80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 -- 172.21.15.8:0/240281449 shutdown_connections 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.030+0000 7f77f05ff700 1 -- 172.21.15.8:0/240281449 wait complete. 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.031+0000 7f77f05ff700 1 Processor -- start 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77f05ff700 1 -- start start 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77f05ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77e8100e90 0x7f77e8194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77f05ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77e8102070 0x7f77e8199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77f05ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e8102a30 0x7f77e8194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77f05ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e81ad510 con 0x7f77e8102070 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77f05ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e81ad650 con 0x7f77e8100e90 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77f05ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e81ad7c0 con 0x7f77e8102a30 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77eeb9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e8102a30 0x7f77e8194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77ee39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77e8100e90 0x7f77e8194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77eeb9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e8102a30 0x7f77e8194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:50994/0 (socket says 172.21.15.8:50994) 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.032+0000 7f77eeb9c700 1 -- 172.21.15.8:0/4055923479 learned_addr learned my addr 172.21.15.8:0/4055923479 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.033+0000 7f77edb9a700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77e8102070 0x7f77e8199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.033+0000 7f77ee39b700 1 -- 172.21.15.8:0/4055923479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e8102a30 msgr2=0x7f77e8194fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.033+0000 7f77ee39b700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e8102a30 0x7f77e8194fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.033+0000 7f77ee39b700 1 -- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77e8102070 msgr2=0x7f77e8199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.033+0000 7f77ee39b700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77e8102070 0x7f77e8199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.033+0000 7f77ee39b700 1 -- 172.21.15.8:0/4055923479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e40095f0 con 0x7f77e8100e90 2023-10-06T23:26:53.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.033+0000 7f77ee39b700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77e8100e90 0x7f77e8194960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f77e4000c00 tx=0x7f77e4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:53.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.034+0000 7f77db7fe700 1 -- 172.21.15.8:0/4055923479 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e401d070 con 0x7f77e8100e90 2023-10-06T23:26:53.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.034+0000 7f77f05ff700 1 -- 172.21.15.8:0/4055923479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e81ada40 con 0x7f77e8100e90 2023-10-06T23:26:53.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.034+0000 7f77db7fe700 1 -- 172.21.15.8:0/4055923479 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77e400bdb0 con 0x7f77e8100e90 2023-10-06T23:26:53.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.034+0000 7f77db7fe700 1 -- 172.21.15.8:0/4055923479 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4022d40 con 0x7f77e8100e90 2023-10-06T23:26:53.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.034+0000 7f77f05ff700 1 -- 172.21.15.8:0/4055923479 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e81adec0 con 0x7f77e8100e90 2023-10-06T23:26:53.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.038+0000 7f77db7fe700 1 -- 172.21.15.8:0/4055923479 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f77e4022470 con 0x7f77e8100e90 2023-10-06T23:26:53.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.040+0000 7f77db7fe700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77d40a1480 0x7f77d40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.041+0000 7f77db7fe700 1 -- 172.21.15.8:0/4055923479 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77e40ce210 con 0x7f77e8100e90 2023-10-06T23:26:53.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.041+0000 7f77edb9a700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77d40a1480 0x7f77d40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.042+0000 7f77edb9a700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77d40a1480 0x7f77d40a3940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77e8100bb0 tx=0x7f77dc009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:53.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.205+0000 7f7803fb5b80 1 Processor -- start 2023-10-06T23:26:53.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.205+0000 7f7803fb5b80 1 -- start start 2023-10-06T23:26:53.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0bc0 0x55b65ace1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65ac48460 con 0x55b65ace1a60 2023-10-06T23:26:53.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65ac39c20 con 0x55b65ace0bc0 2023-10-06T23:26:53.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65ac37540 con 0x55b65ace0260 2023-10-06T23:26:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f77eeb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f77ee39b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f77edb9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0bc0 0x55b65ace1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f77ee39b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:51000/0 (socket says 172.21.15.8:51000) 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.206+0000 7f77ee39b700 1 -- 172.21.15.8:0/2178473481 learned_addr learned my addr 172.21.15.8:0/2178473481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77ee39b700 1 -- 172.21.15.8:0/2178473481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0bc0 msgr2=0x55b65ace1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77ee39b700 1 --2- 172.21.15.8:0/2178473481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0bc0 0x55b65ace1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77ee39b700 1 -- 172.21.15.8:0/2178473481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 msgr2=0x55b65ace1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77ee39b700 1 --2- 172.21.15.8:0/2178473481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77ee39b700 1 -- 172.21.15.8:0/2178473481 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b65aa5dde0 con 0x55b65ace0260 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77ee39b700 1 --2- 172.21.15.8:0/2178473481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace0680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f77e409b270 tx=0x7f77e4005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3383d7dd5b9376ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77d8bfe700 1 -- 172.21.15.8:0/2178473481 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4022ea0 con 0x55b65ace0260 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77d8bfe700 1 -- 172.21.15.8:0/2178473481 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77e409aed0 con 0x55b65ace0260 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.207+0000 7f77d8bfe700 1 -- 172.21.15.8:0/2178473481 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e409aa60 con 0x55b65ace0260 2023-10-06T23:26:53.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2178473481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 msgr2=0x55b65ace0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2178473481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace0680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f77e409b270 tx=0x7f77e4005fb0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2178473481 shutdown_connections 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2178473481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2178473481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace0680 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2178473481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0bc0 0x55b65ace1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2178473481 >> 172.21.15.8:0/2178473481 conn(0x55b65ac54260 msgr2=0x55b65acdb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2178473481 shutdown_connections 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.208+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2178473481 wait complete. 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.209+0000 7f7803fb5b80 1 -- start start 2023-10-06T23:26:53.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.209+0000 7f7803fb5b80 1 Processor -- start 2023-10-06T23:26:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0bc0 0x55b65acea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65acf1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65ac32e30 con 0x55b65ace0bc0 2023-10-06T23:26:53.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65abcf710 con 0x55b65ace1a60 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65abcf3b0 con 0x55b65ace0260 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f7803fb5b80 10 client.0 _ll_register_callbacks cb 0x55b65aa2c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77ee39b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77ee39b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:51016/0 (socket says 172.21.15.8:51016) 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77ee39b700 1 -- 172.21.15.8:0/2657563917 learned_addr learned my addr 172.21.15.8:0/2657563917 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77eeb9c700 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65acf1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77edb9a700 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0bc0 0x55b65acea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77ee39b700 1 -- 172.21.15.8:0/2657563917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 msgr2=0x55b65acf1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77ee39b700 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65acf1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77ee39b700 1 -- 172.21.15.8:0/2657563917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0bc0 msgr2=0x55b65acea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77ee39b700 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0bc0 0x55b65acea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.210+0000 7f77ee39b700 1 -- 172.21.15.8:0/2657563917 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e81adec0 con 0x55b65ace0260 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f77ee39b700 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace9cd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f77e4005cd0 tx=0x7f77e40971f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f552b8403e3611ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f77d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f77d1ffb700 1 -- 172.21.15.8:0/2657563917 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4022ea0 con 0x55b65ace0260 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2657563917 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b65acd2f10 con 0x55b65ace0260 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f77d1ffb700 1 -- 172.21.15.8:0/2657563917 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77e409b570 con 0x55b65ace0260 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f77d1ffb700 1 -- 172.21.15.8:0/2657563917 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77e409bc70 con 0x55b65ace0260 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f7803fb5b80 10 client.26839 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2657563917 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55b65aa46c60 con 0x55b65ace0260 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.211+0000 7f77d1ffb700 1 -- 172.21.15.8:0/2657563917 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b65acd2f10 con 0x55b65ace0260 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.212+0000 7f77d1ffb700 1 -- 172.21.15.8:0/2657563917 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77e4097360 con 0x55b65ace0260 2023-10-06T23:26:53.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.212+0000 7f7803fb5b80 10 client.26839 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.212+0000 7f7803fb5b80 10 client.26839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.212+0000 7f7803fb5b80 20 client.26839 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.212+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b65acf5530 0x55b65acf7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.212+0000 7f7803fb5b80 4 client.26839 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:26:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.212+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2657563917 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b65ac2be10 con 0x55b65acf5530 2023-10-06T23:26:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.212+0000 7f77edb9a700 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b65acf5530 0x55b65acf7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.213+0000 7f77edb9a700 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b65acf5530 0x55b65acf7950 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8d8d9a86612ef01 server_cookie=e46026f5b7be9fdb in_seq=0 out_seq=0 2023-10-06T23:26:53.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.213+0000 7f77d1ffb700 10 client.26839 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f77d1ffb700 1 -- 172.21.15.8:0/2657563917 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b65ac2be10 con 0x55b65acf5530 2023-10-06T23:26:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f77d1ffb700 10 client.26839 handle_command_reply: tid=0 2023-10-06T23:26:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 client.26839 shutdown 2023-10-06T23:26:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2657563917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 msgr2=0x55b65ace9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace9cd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f77e4005cd0 tx=0x7f77e40971f0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2657563917 shutdown_connections 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b65acf5530 0x55b65acf7950 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65acf1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0260 0x55b65ace9cd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/2657563917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0bc0 0x55b65acea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2657563917 >> 172.21.15.8:0/2657563917 conn(0x55b65ac54260 msgr2=0x55b65acdaf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f77d1ffb700 0 client.26839 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2657563917 shutdown_connections 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.214+0000 7f7803fb5b80 1 -- 172.21.15.8:0/2657563917 wait complete. 2023-10-06T23:26:53.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.215+0000 7f7803fb5b80 20 client.26839 trim_cache size 0 max 16384 2023-10-06T23:26:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.240+0000 7f7803fb5b80 1 Processor -- start 2023-10-06T23:26:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.240+0000 7f7803fb5b80 1 -- start start 2023-10-06T23:26:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.240+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0260 0x55b65acf1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.240+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65acf1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.240+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.240+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65ace98a0 con 0x55b65ace1a60 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.240+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65aab3920 con 0x55b65ace0260 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.240+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65ace9180 con 0x55b65ace0bc0 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77eeb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77ee39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0260 0x55b65acf1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77eeb9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43434/0 (socket says 172.21.15.8:43434) 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77eeb9c700 1 -- 172.21.15.8:0/386987358 learned_addr learned my addr 172.21.15.8:0/386987358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77edb9a700 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65acf1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77ee39b700 1 -- 172.21.15.8:0/386987358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 msgr2=0x55b65acf1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77ee39b700 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65acf1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77ee39b700 1 -- 172.21.15.8:0/386987358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 msgr2=0x55b65ace48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77ee39b700 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.241+0000 7f77ee39b700 1 -- 172.21.15.8:0/386987358 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b65aa84250 con 0x55b65ace0260 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.242+0000 7f77eeb9c700 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.242+0000 7f77ee39b700 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0260 0x55b65acf1b40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f77e4097260 tx=0x7f77e4099b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4fc5a025303c100 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.242+0000 7f77d93ff700 1 -- 172.21.15.8:0/386987358 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4022ea0 con 0x55b65ace0260 2023-10-06T23:26:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.242+0000 7f77d93ff700 1 -- 172.21.15.8:0/386987358 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77e409bc70 con 0x55b65ace0260 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.242+0000 7f77d93ff700 1 -- 172.21.15.8:0/386987358 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e409f1f0 con 0x55b65ace0260 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 -- 172.21.15.8:0/386987358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0260 msgr2=0x55b65acf1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0260 0x55b65acf1b40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f77e4097260 tx=0x7f77e4099b20 comp rx=0 tx=0).stop 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 -- 172.21.15.8:0/386987358 shutdown_connections 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace1a60 0x55b65ace48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace0260 0x55b65acf1b40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/386987358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65acf1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 -- 172.21.15.8:0/386987358 >> 172.21.15.8:0/386987358 conn(0x55b65ac54260 msgr2=0x55b65ace89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 -- 172.21.15.8:0/386987358 shutdown_connections 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.243+0000 7f7803fb5b80 1 -- 172.21.15.8:0/386987358 wait complete. 2023-10-06T23:26:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.244+0000 7f7803fb5b80 1 -- start start 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.244+0000 7f7803fb5b80 1 Processor -- start 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0260 0x55b65acecae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65aced020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f7803fb5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65aceffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65acf0520 con 0x55b65ace0260 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65acf0690 con 0x55b65ace1a60 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f7803fb5b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65acf0850 con 0x55b65ace0bc0 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f7803fb5b80 10 client.0 _ll_register_callbacks cb 0x7f77e000e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f77eeb9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65aceffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f77eeb9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65aceffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48064/0 (socket says 172.21.15.8:48064) 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f77eeb9c700 1 -- 172.21.15.8:0/3370603681 learned_addr learned my addr 172.21.15.8:0/3370603681 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f77edb9a700 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65aced020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.245+0000 7f77ee39b700 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0260 0x55b65acecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.246+0000 7f77eeb9c700 1 -- 172.21.15.8:0/3370603681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 msgr2=0x55b65aced020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.246+0000 7f77eeb9c700 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65aced020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.246+0000 7f77eeb9c700 1 -- 172.21.15.8:0/3370603681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0260 msgr2=0x55b65acecae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.246+0000 7f77eeb9c700 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0260 0x55b65acecae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.246+0000 7f77eeb9c700 1 -- 172.21.15.8:0/3370603681 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e000e530 con 0x55b65ace1a60 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.246+0000 7f77edb9a700 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65aced020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.246+0000 7f77eeb9c700 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65aceffe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f77e000ed10 tx=0x7f77e0007500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edced37214003b05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.246+0000 7f77d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:26:53.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.247+0000 7f77d1ffb700 1 -- 172.21.15.8:0/3370603681 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e001c070 con 0x55b65ace1a60 2023-10-06T23:26:53.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.247+0000 7f77d1ffb700 1 -- 172.21.15.8:0/3370603681 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77e0007d50 con 0x55b65ace1a60 2023-10-06T23:26:53.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.247+0000 7f7803fb5b80 1 -- 172.21.15.8:0/3370603681 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77e409aed0 con 0x55b65ace1a60 2023-10-06T23:26:53.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.247+0000 7f77d1ffb700 1 -- 172.21.15.8:0/3370603681 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77e000e040 con 0x55b65ace1a60 2023-10-06T23:26:53.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.247+0000 7f7803fb5b80 10 client.26840 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.247+0000 7f7803fb5b80 1 -- 172.21.15.8:0/3370603681 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55b65aa46c60 con 0x55b65ace1a60 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f77d1ffb700 1 -- 172.21.15.8:0/3370603681 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77e409aed0 con 0x55b65ace1a60 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f77d1ffb700 1 -- 172.21.15.8:0/3370603681 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77e0004640 con 0x55b65ace1a60 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f7803fb5b80 10 client.26840 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f7803fb5b80 10 client.26840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f7803fb5b80 20 client.26840 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b65ad49e10 0x55b65ad4c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f7803fb5b80 4 client.26840 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f7803fb5b80 1 -- 172.21.15.8:0/3370603681 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b65ac2bb30 con 0x55b65ad49e10 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.248+0000 7f77ee39b700 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b65ad49e10 0x55b65ad4c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:53.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.249+0000 7f77ee39b700 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b65ad49e10 0x55b65ad4c200 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15d305854b0babd server_cookie=d9ae81d5b8e579a3 in_seq=0 out_seq=0 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.249+0000 7f77d1ffb700 10 client.26840 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f77d1ffb700 1 -- 172.21.15.8:0/3370603681 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b65ac2bb30 con 0x55b65ad49e10 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f77d1ffb700 10 client.26840 handle_command_reply: tid=0 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 client.26840 shutdown 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 -- 172.21.15.8:0/3370603681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 msgr2=0x55b65aceffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65aceffe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f77e000ed10 tx=0x7f77e0007500 comp rx=0 tx=0).stop 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 -- 172.21.15.8:0/3370603681 shutdown_connections 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55b65ad49e10 0x55b65ad4c200 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b65ace0260 0x55b65acecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b65ace1a60 0x55b65aceffe0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 --2- 172.21.15.8:0/3370603681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b65ace0bc0 0x55b65aced020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f77d1ffb700 0 client.26840 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:53.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 -- 172.21.15.8:0/3370603681 >> 172.21.15.8:0/3370603681 conn(0x55b65ac54260 msgr2=0x55b65acdaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:53.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 -- 172.21.15.8:0/3370603681 shutdown_connections 2023-10-06T23:26:53.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 1 -- 172.21.15.8:0/3370603681 wait complete. 2023-10-06T23:26:53.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.250+0000 7f7803fb5b80 20 client.26840 trim_cache size 0 max 16384 2023-10-06T23:26:53.254 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:26:53.255 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:26:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.251+0000 7f77f05ff700 1 -- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77d40a1480 msgr2=0x7f77d40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.251+0000 7f77f05ff700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77d40a1480 0x7f77d40a3940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77e8100bb0 tx=0x7f77dc009260 comp rx=0 tx=0).stop 2023-10-06T23:26:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.251+0000 7f77f05ff700 1 -- 172.21.15.8:0/4055923479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77e8100e90 msgr2=0x7f77e8194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.251+0000 7f77f05ff700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77e8100e90 0x7f77e8194960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f77e4000c00 tx=0x7f77e4005740 comp rx=0 tx=0).stop 2023-10-06T23:26:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.252+0000 7f77f05ff700 1 -- 172.21.15.8:0/4055923479 shutdown_connections 2023-10-06T23:26:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.252+0000 7f77f05ff700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77d40a1480 0x7f77d40a3940 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.252+0000 7f77f05ff700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e8102a30 0x7f77e8194fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.252+0000 7f77f05ff700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77e8100e90 0x7f77e8194960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.252+0000 7f77f05ff700 1 --2- 172.21.15.8:0/4055923479 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77e8102070 0x7f77e8199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.252+0000 7f77f05ff700 1 -- 172.21.15.8:0/4055923479 >> 172.21.15.8:0/4055923479 conn(0x7f77e80fc430 msgr2=0x7f77e8107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.252+0000 7f77f05ff700 1 -- 172.21.15.8:0/4055923479 shutdown_connections 2023-10-06T23:26:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:26:53.252+0000 7f77f05ff700 1 -- 172.21.15.8:0/4055923479 wait complete. 2023-10-06T23:26:53.278 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:26:53.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:53 smithi008 ceph-mon[98532]: pgmap v772: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.3 MiB/s wr, 552 op/s 2023-10-06T23:26:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:53 smithi156 ceph-mon[102862]: pgmap v772: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.3 MiB/s wr, 552 op/s 2023-10-06T23:26:53.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:53 smithi190 ceph-mon[102658]: pgmap v772: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.3 MiB/s wr, 552 op/s 2023-10-06T23:26:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 720.0 s, 252.4 tps, lat 397.033 ms stddev 106.959 2023-10-06T23:26:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.706+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/401909649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a68102090 msgr2=0x7f9a68102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.706+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/401909649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a68102090 0x7f9a68102510 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009990 tx=0x7f9a54009ca0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.706+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/401909649 shutdown_connections 2023-10-06T23:26:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.706+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/401909649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a68100eb0 0x7f9a681012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.706+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/401909649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a68102a50 0x7f9a68109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.706+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/401909649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a68102090 0x7f9a68102510 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.706+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/401909649 >> 172.21.15.8:0/401909649 conn(0x7f9a680fc430 msgr2=0x7f9a680fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.707+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/401909649 shutdown_connections 2023-10-06T23:26:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.707+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/401909649 wait complete. 2023-10-06T23:26:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.709+0000 7f9a6c9ff700 1 Processor -- start 2023-10-06T23:26:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.709+0000 7f9a6c9ff700 1 -- start start 2023-10-06T23:26:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.709+0000 7f9a6c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a68100eb0 0x7f9a680732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.709+0000 7f9a6c9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a68102090 0x7f9a680737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.709+0000 7f9a6c9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a68102a50 0x7f9a68073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.709+0000 7f9a6c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a681a0c80 con 0x7f9a68100eb0 2023-10-06T23:26:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.709+0000 7f9a6c9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a681a0dc0 con 0x7f9a68102090 2023-10-06T23:26:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.710+0000 7f9a6c9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a681a0f00 con 0x7f9a68102a50 2023-10-06T23:26:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.710+0000 7f9a66d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a68102a50 0x7f9a68073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.710+0000 7f9a65d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a68102090 0x7f9a680737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.710+0000 7f9a6659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a68100eb0 0x7f9a680732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.710+0000 7f9a65d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a68102090 0x7f9a680737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48066/0 (socket says 172.21.15.8:48066) 2023-10-06T23:26:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.710+0000 7f9a65d9b700 1 -- 172.21.15.8:0/1152555472 learned_addr learned my addr 172.21.15.8:0/1152555472 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.710+0000 7f9a65d9b700 1 -- 172.21.15.8:0/1152555472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a68102a50 msgr2=0x7f9a68073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a65d9b700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a68102a50 0x7f9a68073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a65d9b700 1 -- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a68100eb0 msgr2=0x7f9a680732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a65d9b700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a68100eb0 0x7f9a680732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a65d9b700 1 -- 172.21.15.8:0/1152555472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a540095f0 con 0x7f9a68102090 2023-10-06T23:26:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a65d9b700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a68102090 0x7f9a680737e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9a540098e0 tx=0x7f9a540039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a5f7fe700 1 -- 172.21.15.8:0/1152555472 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5401d070 con 0x7f9a68102090 2023-10-06T23:26:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a5f7fe700 1 -- 172.21.15.8:0/1152555472 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a5400be50 con 0x7f9a68102090 2023-10-06T23:26:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/1152555472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a681a1130 con 0x7f9a68102090 2023-10-06T23:26:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.711+0000 7f9a5f7fe700 1 -- 172.21.15.8:0/1152555472 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a540173f0 con 0x7f9a68102090 2023-10-06T23:26:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.712+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/1152555472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a681a15d0 con 0x7f9a68102090 2023-10-06T23:26:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.717+0000 7f9a5f7fe700 1 -- 172.21.15.8:0/1152555472 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9a5400b9c0 con 0x7f9a68102090 2023-10-06T23:26:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.720+0000 7f9a803ccb80 1 Processor -- start 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a803ccb80 1 -- start start 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a5f7fe700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9a4c0a14d0 0x7f9a4c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a5f7fe700 1 -- 172.21.15.8:0/1152555472 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9a540ce320 con 0x7f9a68102090 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bbaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbb7e0 0x5567b2bbbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2b1a400 con 0x5567b2bbb7e0 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2b0bbc0 con 0x5567b2bba6d0 2023-10-06T23:26:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.722+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2b094e0 con 0x5567b2bbc1a0 2023-10-06T23:26:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.723+0000 7f9a6659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bbaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.723+0000 7f9a66d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.723+0000 7f9a6659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bbaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48078/0 (socket says 172.21.15.8:48078) 2023-10-06T23:26:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.723+0000 7f9a6659c700 1 -- 172.21.15.8:0/175889412 learned_addr learned my addr 172.21.15.8:0/175889412 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.724+0000 7f9a66d9d700 1 -- 172.21.15.8:0/175889412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 msgr2=0x5567b2bbaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.724+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/175889412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bbaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.724+0000 7f9a66d9d700 1 -- 172.21.15.8:0/175889412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbb7e0 msgr2=0x5567b2bbbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.724+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/175889412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbb7e0 0x5567b2bbbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.724+0000 7f9a66d9d700 1 -- 172.21.15.8:0/175889412 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b292fd80 con 0x5567b2bbc1a0 2023-10-06T23:26:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.724+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9a4c0a14d0 0x7f9a4c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.725+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/175889412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b4a0 tx=0x7f9a6000b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c41d3a91a8cc1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.725+0000 7f9a5cff9700 1 -- 172.21.15.8:0/175889412 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60018480 con 0x5567b2bbc1a0 2023-10-06T23:26:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.725+0000 7f9a5cff9700 1 -- 172.21.15.8:0/175889412 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a60017870 con 0x5567b2bbc1a0 2023-10-06T23:26:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.725+0000 7f9a5cff9700 1 -- 172.21.15.8:0/175889412 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600166b0 con 0x5567b2bbc1a0 2023-10-06T23:26:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.726+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9a4c0a14d0 0x7f9a4c0a3990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9a6001f000 tx=0x7f9a6001c000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.727+0000 7f9a803ccb80 1 -- 172.21.15.8:0/175889412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbc1a0 msgr2=0x5567b2bc2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.727+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/175889412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b4a0 tx=0x7f9a6000b7b0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.727+0000 7f9a803ccb80 1 -- 172.21.15.8:0/175889412 shutdown_connections 2023-10-06T23:26:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.727+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/175889412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2a30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.727+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/175889412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bbaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.727+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/175889412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbb7e0 0x5567b2bbbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.727+0000 7f9a803ccb80 1 -- 172.21.15.8:0/175889412 >> 172.21.15.8:0/175889412 conn(0x5567b2b26200 msgr2=0x5567b2bacb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.727+0000 7f9a803ccb80 1 -- 172.21.15.8:0/175889412 shutdown_connections 2023-10-06T23:26:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.728+0000 7f9a803ccb80 1 -- 172.21.15.8:0/175889412 wait complete. 2023-10-06T23:26:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.728+0000 7f9a803ccb80 1 -- start start 2023-10-06T23:26:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.729+0000 7f9a803ccb80 1 Processor -- start 2023-10-06T23:26:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bba6d0 0x5567b2bd5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbb7e0 0x5567b2bd59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 0x5567b2bdca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2b04dd0 con 0x5567b2bbc1a0 2023-10-06T23:26:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2aa16b0 con 0x5567b2bbb7e0 2023-10-06T23:26:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2aa1350 con 0x5567b2bba6d0 2023-10-06T23:26:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a803ccb80 10 client.0 _ll_register_callbacks cb 0x5567b28fe7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a65d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbb7e0 0x5567b2bd59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a65d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbb7e0 0x5567b2bd59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48086/0 (socket says 172.21.15.8:48086) 2023-10-06T23:26:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.730+0000 7f9a65d9b700 1 -- 172.21.15.8:0/148927179 learned_addr learned my addr 172.21.15.8:0/148927179 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.731+0000 7f9a6659c700 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bba6d0 0x5567b2bd5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.731+0000 7f9a65d9b700 1 -- 172.21.15.8:0/148927179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bba6d0 msgr2=0x5567b2bd5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.731+0000 7f9a65d9b700 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bba6d0 0x5567b2bd5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.731+0000 7f9a65d9b700 1 -- 172.21.15.8:0/148927179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 msgr2=0x5567b2bdca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.731+0000 7f9a65d9b700 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 0x5567b2bdca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.731+0000 7f9a65d9b700 1 -- 172.21.15.8:0/148927179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a60009d30 con 0x5567b2bbb7e0 2023-10-06T23:26:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.731+0000 7f9a65d9b700 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbb7e0 0x5567b2bd59d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a540095c0 tx=0x7f9a54097b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82146aef0ca1870f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.732+0000 7f9a49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:26:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.732+0000 7f9a49ffb700 1 -- 172.21.15.8:0/148927179 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5409b040 con 0x5567b2bbb7e0 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.732+0000 7f9a49ffb700 1 -- 172.21.15.8:0/148927179 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9a5400bc70 con 0x5567b2bbb7e0 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.732+0000 7f9a803ccb80 1 -- 172.21.15.8:0/148927179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567b2ba4d50 con 0x5567b2bbb7e0 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.733+0000 7f9a49ffb700 1 -- 172.21.15.8:0/148927179 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a5409bde0 con 0x5567b2bbb7e0 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.733+0000 7f9a803ccb80 10 client.26849 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.733+0000 7f9a803ccb80 1 -- 172.21.15.8:0/148927179 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5567b2918c00 con 0x5567b2bbb7e0 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.733+0000 7f9a49ffb700 1 -- 172.21.15.8:0/148927179 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a540b3030 con 0x5567b2bbb7e0 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.733+0000 7f9a49ffb700 1 -- 172.21.15.8:0/148927179 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9a5409abd0 con 0x5567b2bbb7e0 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.734+0000 7f9a803ccb80 10 client.26849 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.734+0000 7f9a803ccb80 10 client.26849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.734+0000 7f9a803ccb80 20 client.26849 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.734+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5567b2be0f90 0x5567b2be3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.734+0000 7f9a803ccb80 4 client.26849 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:26:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.734+0000 7f9a803ccb80 1 -- 172.21.15.8:0/148927179 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567b2afddb0 con 0x5567b2be0f90 2023-10-06T23:26:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.734+0000 7f9a6659c700 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5567b2be0f90 0x5567b2be3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.735+0000 7f9a6659c700 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5567b2be0f90 0x5567b2be3380 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e30008f8a29d7c50 server_cookie=5c337576fbfd3e92 in_seq=0 out_seq=0 2023-10-06T23:26:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.735+0000 7f9a49ffb700 10 client.26849 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.736+0000 7f9a49ffb700 1 -- 172.21.15.8:0/148927179 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5567b2afddb0 con 0x5567b2be0f90 2023-10-06T23:26:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.736+0000 7f9a49ffb700 10 client.26849 handle_command_reply: tid=0 2023-10-06T23:26:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.736+0000 7f9a803ccb80 1 client.26849 shutdown 2023-10-06T23:26:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.736+0000 7f9a803ccb80 1 -- 172.21.15.8:0/148927179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbb7e0 msgr2=0x5567b2bd59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.736+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbb7e0 0x5567b2bd59d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a540095c0 tx=0x7f9a54097b20 comp rx=0 tx=0).stop 2023-10-06T23:26:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a803ccb80 1 -- 172.21.15.8:0/148927179 shutdown_connections 2023-10-06T23:26:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5567b2be0f90 0x5567b2be3380 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 0x5567b2bdca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bba6d0 0x5567b2bd5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/148927179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbb7e0 0x5567b2bd59d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a803ccb80 1 -- 172.21.15.8:0/148927179 >> 172.21.15.8:0/148927179 conn(0x5567b2b26200 msgr2=0x5567b2bac250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a49ffb700 0 client.26849 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a803ccb80 1 -- 172.21.15.8:0/148927179 shutdown_connections 2023-10-06T23:26:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.737+0000 7f9a803ccb80 1 -- 172.21.15.8:0/148927179 wait complete. 2023-10-06T23:26:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.738+0000 7f9a803ccb80 20 client.26849 trim_cache size 0 max 16384 2023-10-06T23:26:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.765+0000 7f9a803ccb80 1 Processor -- start 2023-10-06T23:26:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.765+0000 7f9a803ccb80 1 -- start start 2023-10-06T23:26:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bba6d0 0x5567b2bd40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 0x5567b2bdc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b29858c0 con 0x5567b2bba6d0 2023-10-06T23:26:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2bbb3f0 con 0x5567b2bbc1a0 2023-10-06T23:26:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2bd5000 con 0x5567b2bbb7e0 2023-10-06T23:26:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a66d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a66d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48102/0 (socket says 172.21.15.8:48102) 2023-10-06T23:26:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a66d9d700 1 -- 172.21.15.8:0/2574082102 learned_addr learned my addr 172.21.15.8:0/2574082102 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.766+0000 7f9a6659c700 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bba6d0 0x5567b2bd40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.767+0000 7f9a65d9b700 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 0x5567b2bdc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.767+0000 7f9a66d9d700 1 -- 172.21.15.8:0/2574082102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 msgr2=0x5567b2bdc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.767+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 0x5567b2bdc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.767+0000 7f9a66d9d700 1 -- 172.21.15.8:0/2574082102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bba6d0 msgr2=0x5567b2bd40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.767+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bba6d0 0x5567b2bd40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.767+0000 7f9a66d9d700 1 -- 172.21.15.8:0/2574082102 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b29561f0 con 0x5567b2bbc1a0 2023-10-06T23:26:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.768+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9a60018040 tx=0x7f9a6001a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81fa2a2415e2eb46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.768+0000 7f9a5d7fa700 1 -- 172.21.15.8:0/2574082102 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60018480 con 0x5567b2bbc1a0 2023-10-06T23:26:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.768+0000 7f9a5d7fa700 1 -- 172.21.15.8:0/2574082102 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a600175e0 con 0x5567b2bbc1a0 2023-10-06T23:26:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.768+0000 7f9a5d7fa700 1 -- 172.21.15.8:0/2574082102 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60009970 con 0x5567b2bbc1a0 2023-10-06T23:26:54.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 -- 172.21.15.8:0/2574082102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbc1a0 msgr2=0x5567b2bc2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9a60018040 tx=0x7f9a6001a000 comp rx=0 tx=0).stop 2023-10-06T23:26:54.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 -- 172.21.15.8:0/2574082102 shutdown_connections 2023-10-06T23:26:54.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bba6d0 0x5567b2bd40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bbc1a0 0x5567b2bc2680 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/2574082102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 0x5567b2bdc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 -- 172.21.15.8:0/2574082102 >> 172.21.15.8:0/2574082102 conn(0x5567b2b26200 msgr2=0x5567b2bacaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 -- 172.21.15.8:0/2574082102 shutdown_connections 2023-10-06T23:26:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.770+0000 7f9a803ccb80 1 -- 172.21.15.8:0/2574082102 wait complete. 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.771+0000 7f9a803ccb80 1 -- start start 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.771+0000 7f9a803ccb80 1 Processor -- start 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.771+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bda2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 0x5567b2bda820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a803ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 0x5567b2bdb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2bdbd70 con 0x5567b2bbc1a0 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2bdbee0 con 0x5567b2bba6d0 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a803ccb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b2bdc0a0 con 0x5567b2bbb7e0 2023-10-06T23:26:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a803ccb80 10 client.0 _ll_register_callbacks cb 0x5567b28fe7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:26:54.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a6659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bda2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a6659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bda2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48118/0 (socket says 172.21.15.8:48118) 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a6659c700 1 -- 172.21.15.8:0/3279138261 learned_addr learned my addr 172.21.15.8:0/3279138261 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 0x5567b2bdb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.772+0000 7f9a65d9b700 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 0x5567b2bda820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.773+0000 7f9a66d9d700 1 -- 172.21.15.8:0/3279138261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 msgr2=0x5567b2bda820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.773+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 0x5567b2bda820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.773+0000 7f9a66d9d700 1 -- 172.21.15.8:0/3279138261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 msgr2=0x5567b2bda2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.773+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bda2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.773+0000 7f9a66d9d700 1 -- 172.21.15.8:0/3279138261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567b292fd80 con 0x5567b2bbc1a0 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.773+0000 7f9a66d9d700 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 0x5567b2bdb830 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9a60031040 tx=0x7f9a60017800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb940f06dcbae70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:26:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.773+0000 7f9a49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:26:54.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.774+0000 7f9a49ffb700 1 -- 172.21.15.8:0/3279138261 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60016340 con 0x5567b2bbc1a0 2023-10-06T23:26:54.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.774+0000 7f9a49ffb700 1 -- 172.21.15.8:0/3279138261 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9a60017cf0 con 0x5567b2bbc1a0 2023-10-06T23:26:54.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.774+0000 7f9a803ccb80 1 -- 172.21.15.8:0/3279138261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a60017870 con 0x5567b2bbc1a0 2023-10-06T23:26:54.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.774+0000 7f9a49ffb700 1 -- 172.21.15.8:0/3279138261 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a60003ac0 con 0x5567b2bbc1a0 2023-10-06T23:26:54.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.775+0000 7f9a803ccb80 10 client.16953 fetch_fsmap learned FSMap version 37 2023-10-06T23:26:54.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.775+0000 7f9a803ccb80 1 -- 172.21.15.8:0/3279138261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5567b292e250 con 0x5567b2bbc1a0 2023-10-06T23:26:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.775+0000 7f9a49ffb700 1 -- 172.21.15.8:0/3279138261 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a60017870 con 0x5567b2bbc1a0 2023-10-06T23:26:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.776+0000 7f9a49ffb700 1 -- 172.21.15.8:0/3279138261 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9a6003b830 con 0x5567b2bbc1a0 2023-10-06T23:26:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.776+0000 7f9a803ccb80 10 client.16953 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:26:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.776+0000 7f9a803ccb80 10 client.16953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:26:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.776+0000 7f9a803ccb80 20 client.16953 populate_metadata read hostname 'smithi008' 2023-10-06T23:26:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.776+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5567b2c353e0 0x5567b2c37800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:26:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.776+0000 7f9a803ccb80 4 client.16953 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:26:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.776+0000 7f9a803ccb80 1 -- 172.21.15.8:0/3279138261 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5567b2afdad0 con 0x5567b2c353e0 2023-10-06T23:26:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.776+0000 7f9a6659c700 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5567b2c353e0 0x5567b2c37800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:26:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.777+0000 7f9a6659c700 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5567b2c353e0 0x5567b2c37800 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b00b946a504e280e server_cookie=19b5c5bef2bc423c in_seq=0 out_seq=0 2023-10-06T23:26:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.777+0000 7f9a49ffb700 10 client.16953 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.804+0000 7f9a49ffb700 1 -- 172.21.15.8:0/3279138261 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5567b2afdad0 con 0x5567b2c353e0 2023-10-06T23:26:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.804+0000 7f9a49ffb700 10 client.16953 handle_command_reply: tid=0 2023-10-06T23:26:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.804+0000 7f9a803ccb80 1 client.16953 shutdown 2023-10-06T23:26:54.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a803ccb80 1 -- 172.21.15.8:0/3279138261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 msgr2=0x5567b2bdb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 0x5567b2bdb830 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9a60031040 tx=0x7f9a60017800 comp rx=0 tx=0).stop 2023-10-06T23:26:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a803ccb80 1 -- 172.21.15.8:0/3279138261 shutdown_connections 2023-10-06T23:26:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5567b2c353e0 0x5567b2c37800 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5567b2bbc1a0 0x5567b2bdb830 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5567b2bba6d0 0x5567b2bda2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a803ccb80 1 --2- 172.21.15.8:0/3279138261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5567b2bbb7e0 0x5567b2bda820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a803ccb80 1 -- 172.21.15.8:0/3279138261 >> 172.21.15.8:0/3279138261 conn(0x5567b2b26200 msgr2=0x5567b2bd40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.805+0000 7f9a49ffb700 0 client.16953 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:26:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.806+0000 7f9a803ccb80 1 -- 172.21.15.8:0/3279138261 shutdown_connections 2023-10-06T23:26:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.806+0000 7f9a803ccb80 1 -- 172.21.15.8:0/3279138261 wait complete. 2023-10-06T23:26:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:26:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:26:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:26:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:26:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.806+0000 7f9a803ccb80 20 client.16953 trim_cache size 0 max 16384 2023-10-06T23:26:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9a4c0a14d0 msgr2=0x7f9a4c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9a4c0a14d0 0x7f9a4c0a3990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9a6001f000 tx=0x7f9a6001c000 comp rx=0 tx=0).stop 2023-10-06T23:26:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/1152555472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a68102090 msgr2=0x7f9a680737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:26:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a68102090 0x7f9a680737e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9a540098e0 tx=0x7f9a540039f0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/1152555472 shutdown_connections 2023-10-06T23:26:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f9a4c0a14d0 0x7f9a4c0a3990 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a68100eb0 0x7f9a680732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a68102a50 0x7f9a68073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 --2- 172.21.15.8:0/1152555472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a68102090 0x7f9a680737e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:26:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.808+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/1152555472 >> 172.21.15.8:0/1152555472 conn(0x7f9a680fc430 msgr2=0x7f9a680fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:26:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.809+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/1152555472 shutdown_connections 2023-10-06T23:26:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:26:54.809+0000 7f9a6c9ff700 1 -- 172.21.15.8:0/1152555472 wait complete. 2023-10-06T23:26:55.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:55 smithi008 ceph-mon[98532]: pgmap v773: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 5.0 MiB/s wr, 508 op/s 2023-10-06T23:26:55.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:55 smithi190 ceph-mon[102658]: pgmap v773: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 5.0 MiB/s wr, 508 op/s 2023-10-06T23:26:56.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:55 smithi156 ceph-mon[102862]: pgmap v773: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 5.0 MiB/s wr, 508 op/s 2023-10-06T23:26:57.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:57 smithi008 ceph-mon[98532]: pgmap v774: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 5.7 MiB/s wr, 549 op/s 2023-10-06T23:26:57.944 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:57 smithi190 ceph-mon[102658]: pgmap v774: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 5.7 MiB/s wr, 549 op/s 2023-10-06T23:26:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:57 smithi156 ceph-mon[102862]: pgmap v774: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 5.7 MiB/s wr, 549 op/s 2023-10-06T23:26:59.006 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 725.0 s, 68.6 tps, lat 1075.382 ms stddev 711.624 2023-10-06T23:26:59.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:26:59 smithi008 ceph-mon[98532]: pgmap v775: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 5.3 MiB/s wr, 501 op/s 2023-10-06T23:26:59.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:26:59 smithi190 ceph-mon[102658]: pgmap v775: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 5.3 MiB/s wr, 501 op/s 2023-10-06T23:27:00.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:26:59 smithi156 ceph-mon[102862]: pgmap v775: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 5.3 MiB/s wr, 501 op/s 2023-10-06T23:27:01.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:01 smithi190 ceph-mon[102658]: pgmap v776: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 6.1 MiB/s wr, 507 op/s 2023-10-06T23:27:02.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:01 smithi156 ceph-mon[102862]: pgmap v776: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 6.1 MiB/s wr, 507 op/s 2023-10-06T23:27:02.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:01 smithi008 ceph-mon[98532]: pgmap v776: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 6.1 MiB/s wr, 507 op/s 2023-10-06T23:27:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:03 smithi156 ceph-mon[102862]: pgmap v777: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 5.0 MiB/s wr, 394 op/s 2023-10-06T23:27:03.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:03 smithi008 ceph-mon[98532]: pgmap v777: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 5.0 MiB/s wr, 394 op/s 2023-10-06T23:27:03.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:03 smithi190 ceph-mon[102658]: pgmap v777: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 5.0 MiB/s wr, 394 op/s 2023-10-06T23:27:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 730.0 s, 17.6 tps, lat 5127.647 ms stddev 783.908 2023-10-06T23:27:05.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:05 smithi008 ceph-mon[98532]: pgmap v778: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 4.0 MiB/s wr, 302 op/s 2023-10-06T23:27:05.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:05 smithi190 ceph-mon[102658]: pgmap v778: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 4.0 MiB/s wr, 302 op/s 2023-10-06T23:27:06.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:05 smithi156 ceph-mon[102862]: pgmap v778: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 4.0 MiB/s wr, 302 op/s 2023-10-06T23:27:07.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:07 smithi008 ceph-mon[98532]: pgmap v779: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 2.8 MiB/s wr, 209 op/s 2023-10-06T23:27:07.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:07 smithi190 ceph-mon[102658]: pgmap v779: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 2.8 MiB/s wr, 209 op/s 2023-10-06T23:27:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:07 smithi156 ceph-mon[102862]: pgmap v779: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 2.8 MiB/s wr, 209 op/s 2023-10-06T23:27:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.184+0000 7f21515ff700 1 -- 172.21.15.8:0/3348871335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c106bd0 msgr2=0x7f214c109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.184+0000 7f21515ff700 1 --2- 172.21.15.8:0/3348871335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c106bd0 0x7f214c109040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f214400b0a0 tx=0x7f214400b3b0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.185+0000 7f21515ff700 1 -- 172.21.15.8:0/3348871335 shutdown_connections 2023-10-06T23:27:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.185+0000 7f21515ff700 1 --2- 172.21.15.8:0/3348871335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c101970 0x7f214c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.185+0000 7f21515ff700 1 --2- 172.21.15.8:0/3348871335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c106bd0 0x7f214c109040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.185+0000 7f21515ff700 1 --2- 172.21.15.8:0/3348871335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f214c1042a0 0x7f214c106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.185+0000 7f21515ff700 1 -- 172.21.15.8:0/3348871335 >> 172.21.15.8:0/3348871335 conn(0x7f214c0fb340 msgr2=0x7f214c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.185+0000 7f21515ff700 1 -- 172.21.15.8:0/3348871335 shutdown_connections 2023-10-06T23:27:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.185+0000 7f21515ff700 1 -- 172.21.15.8:0/3348871335 wait complete. 2023-10-06T23:27:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.187+0000 7f21515ff700 1 Processor -- start 2023-10-06T23:27:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.187+0000 7f21515ff700 1 -- start start 2023-10-06T23:27:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.188+0000 7f21515ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f214c101970 0x7f214c19ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.188+0000 7f21515ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c1042a0 0x7f214c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.188+0000 7f21515ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c106bd0 0x7f214c194770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.188+0000 7f21515ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c194cb0 con 0x7f214c106bd0 2023-10-06T23:27:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.188+0000 7f21515ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c194e20 con 0x7f214c101970 2023-10-06T23:27:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.188+0000 7f21515ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c194fe0 con 0x7f214c1042a0 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214a7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c1042a0 0x7f214c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214a7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c1042a0 0x7f214c19ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:50278/0 (socket says 172.21.15.8:50278) 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214a7fc700 1 -- 172.21.15.8:0/3304449322 learned_addr learned my addr 172.21.15.8:0/3304449322 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214b7fe700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c106bd0 0x7f214c194770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214affd700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f214c101970 0x7f214c19ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214a7fc700 1 -- 172.21.15.8:0/3304449322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f214c101970 msgr2=0x7f214c19ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214a7fc700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f214c101970 0x7f214c19ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214a7fc700 1 -- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c106bd0 msgr2=0x7f214c194770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214a7fc700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c106bd0 0x7f214c194770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.189+0000 7f214a7fc700 1 -- 172.21.15.8:0/3304449322 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144009d00 con 0x7f214c1042a0 2023-10-06T23:27:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.190+0000 7f214a7fc700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c1042a0 0x7f214c19ef50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f213400e9a0 tx=0x7f213400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.190+0000 7f2143fff700 1 -- 172.21.15.8:0/3304449322 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134009790 con 0x7f214c1042a0 2023-10-06T23:27:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.190+0000 7f21515ff700 1 -- 172.21.15.8:0/3304449322 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c1952c0 con 0x7f214c1042a0 2023-10-06T23:27:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.190+0000 7f2143fff700 1 -- 172.21.15.8:0/3304449322 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f213400cbd0 con 0x7f214c1042a0 2023-10-06T23:27:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.190+0000 7f2143fff700 1 -- 172.21.15.8:0/3304449322 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134018680 con 0x7f214c1042a0 2023-10-06T23:27:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.190+0000 7f21515ff700 1 -- 172.21.15.8:0/3304449322 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1955f0 con 0x7f214c1042a0 2023-10-06T23:27:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.196+0000 7f2143fff700 1 -- 172.21.15.8:0/3304449322 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2134010430 con 0x7f214c1042a0 2023-10-06T23:27:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.196+0000 7f2164ec6b80 1 Processor -- start 2023-10-06T23:27:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.197+0000 7f2164ec6b80 1 -- start start 2023-10-06T23:27:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.197+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.197+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dbfd0 0x5633f61dc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.198+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.198+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6143400 con 0x5633f61dc990 2023-10-06T23:27:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.198+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6134bc0 con 0x5633f61daec0 2023-10-06T23:27:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.198+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f61324e0 con 0x5633f61dbfd0 2023-10-06T23:27:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.198+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.198+0000 7f214affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dbfd0 0x5633f61dc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.198+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61db2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36888/0 (socket says 172.21.15.8:36888) 2023-10-06T23:27:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.198+0000 7f214b7fe700 1 -- 172.21.15.8:0/4069495397 learned_addr learned my addr 172.21.15.8:0/4069495397 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.199+0000 7f214affd700 1 -- 172.21.15.8:0/4069495397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 msgr2=0x5633f61db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.199+0000 7f214affd700 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61db2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.199+0000 7f214affd700 1 -- 172.21.15.8:0/4069495397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 msgr2=0x5633f61e3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.200+0000 7f214a7fc700 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.200+0000 7f214affd700 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61e3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.200+0000 7f214affd700 1 -- 172.21.15.8:0/4069495397 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633f5f58d80 con 0x5633f61dbfd0 2023-10-06T23:27:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.200+0000 7f214a7fc700 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:27:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.200+0000 7f2143fff700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f21380a1480 0x7f21380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.200+0000 7f214affd700 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dbfd0 0x5633f61dc450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f213c009b60 tx=0x7f213c009e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94c258c273c5a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.200+0000 7f2143fff700 1 -- 172.21.15.8:0/3304449322 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2134014070 con 0x7f214c1042a0 2023-10-06T23:27:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.201+0000 7f214b7fe700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f21380a1480 0x7f21380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.201+0000 7f21417fa700 1 -- 172.21.15.8:0/4069495397 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c004a30 con 0x5633f61dbfd0 2023-10-06T23:27:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.201+0000 7f21417fa700 1 -- 172.21.15.8:0/4069495397 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f213c0054b0 con 0x5633f61dbfd0 2023-10-06T23:27:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.201+0000 7f21417fa700 1 -- 172.21.15.8:0/4069495397 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00ec40 con 0x5633f61dbfd0 2023-10-06T23:27:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.202+0000 7f2164ec6b80 1 -- 172.21.15.8:0/4069495397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dbfd0 msgr2=0x5633f61dc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.202+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dbfd0 0x5633f61dc450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f213c009b60 tx=0x7f213c009e70 comp rx=0 tx=0).stop 2023-10-06T23:27:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.202+0000 7f214b7fe700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f21380a1480 0x7f21380a3940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x5633f61dac60 tx=0x7f2144006210 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.202+0000 7f2164ec6b80 1 -- 172.21.15.8:0/4069495397 shutdown_connections 2023-10-06T23:27:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.202+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.202+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.202+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/4069495397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dbfd0 0x5633f61dc450 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.202+0000 7f2164ec6b80 1 -- 172.21.15.8:0/4069495397 >> 172.21.15.8:0/4069495397 conn(0x5633f614f200 msgr2=0x5633f61d5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.203+0000 7f2164ec6b80 1 -- 172.21.15.8:0/4069495397 shutdown_connections 2023-10-06T23:27:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.203+0000 7f2164ec6b80 1 -- 172.21.15.8:0/4069495397 wait complete. 2023-10-06T23:27:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.204+0000 7f2164ec6b80 1 -- start start 2023-10-06T23:27:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.204+0000 7f2164ec6b80 1 Processor -- start 2023-10-06T23:27:08.206 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f612ddd0 con 0x5633f61dc990 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f60ca6b0 con 0x5633f61dbfd0 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f60ca350 con 0x5633f61daec0 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f2164ec6b80 10 client.0 _ll_register_callbacks cb 0x5633f5f277a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f214affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f214affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:50296/0 (socket says 172.21.15.8:50296) 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f214affd700 1 -- 172.21.15.8:0/2860775507 learned_addr learned my addr 172.21.15.8:0/2860775507 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.205+0000 7f214a7fc700 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.206+0000 7f214b7fe700 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61ec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.206+0000 7f214a7fc700 1 -- 172.21.15.8:0/2860775507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 msgr2=0x5633f61e4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.206+0000 7f214a7fc700 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.206+0000 7f214a7fc700 1 -- 172.21.15.8:0/2860775507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 msgr2=0x5633f61ec0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.206+0000 7f214a7fc700 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61ec0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.206+0000 7f214a7fc700 1 -- 172.21.15.8:0/2860775507 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c009790 con 0x5633f61dbfd0 2023-10-06T23:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.206+0000 7f214a7fc700 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e5090 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f21340caad0 tx=0x7f213409a7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e1c3862a5035628 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.206+0000 7f21327fc700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.207+0000 7f21327fc700 1 -- 172.21.15.8:0/2860775507 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213409a2a0 con 0x5633f61dbfd0 2023-10-06T23:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.207+0000 7f2164ec6b80 1 -- 172.21.15.8:0/2860775507 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633f61cdd50 con 0x5633f61dbfd0 2023-10-06T23:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.207+0000 7f21327fc700 1 -- 172.21.15.8:0/2860775507 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f213409e3f0 con 0x5633f61dbfd0 2023-10-06T23:27:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.207+0000 7f21327fc700 1 -- 172.21.15.8:0/2860775507 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21340a2630 con 0x5633f61dbfd0 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.207+0000 7f2164ec6b80 10 client.26864 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.207+0000 7f2164ec6b80 1 -- 172.21.15.8:0/2860775507 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5633f5f41c00 con 0x5633f61dbfd0 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f21327fc700 1 -- 172.21.15.8:0/2860775507 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5633f61cdd50 con 0x5633f61dbfd0 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f21327fc700 1 -- 172.21.15.8:0/2860775507 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f21340a21a0 con 0x5633f61dbfd0 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f2164ec6b80 10 client.26864 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f2164ec6b80 10 client.26864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f2164ec6b80 20 client.26864 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5633f61f0860 0x5633f61f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f2164ec6b80 4 client.26864 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:27:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f2164ec6b80 1 -- 172.21.15.8:0/2860775507 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633f6126db0 con 0x5633f61f0860 2023-10-06T23:27:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.208+0000 7f214affd700 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5633f61f0860 0x5633f61f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.209+0000 7f214affd700 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5633f61f0860 0x5633f61f2c50 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e8ed682cd10620c server_cookie=eb430234cb834421 in_seq=0 out_seq=0 2023-10-06T23:27:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.209+0000 7f21327fc700 10 client.26864 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.210+0000 7f21327fc700 1 -- 172.21.15.8:0/2860775507 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5633f6126db0 con 0x5633f61f0860 2023-10-06T23:27:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.210+0000 7f21327fc700 10 client.26864 handle_command_reply: tid=0 2023-10-06T23:27:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.210+0000 7f2164ec6b80 1 client.26864 shutdown 2023-10-06T23:27:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.210+0000 7f2164ec6b80 1 -- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 msgr2=0x5633f61e5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.210+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e5090 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f21340caad0 tx=0x7f213409a7e0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 1 -- 172.21.15.8:0/2860775507 shutdown_connections 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5633f61f0860 0x5633f61f2c50 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61ec0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/2860775507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e5090 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 1 -- 172.21.15.8:0/2860775507 >> 172.21.15.8:0/2860775507 conn(0x5633f614f200 msgr2=0x5633f61d5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f21327fc700 0 client.26864 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 1 -- 172.21.15.8:0/2860775507 shutdown_connections 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 1 -- 172.21.15.8:0/2860775507 wait complete. 2023-10-06T23:27:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.211+0000 7f2164ec6b80 20 client.26864 trim_cache size 0 max 16384 2023-10-06T23:27:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f2164ec6b80 1 Processor -- start 2023-10-06T23:27:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f2164ec6b80 1 -- start start 2023-10-06T23:27:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61f2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dbfd0 0x5633f61ec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.236 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dc990 0x5633f61ec900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f5fae8c0 con 0x5633f61dbfd0 2023-10-06T23:27:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f6126db0 con 0x5633f61daec0 2023-10-06T23:27:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f61e4020 con 0x5633f61dc990 2023-10-06T23:27:08.237 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f214affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dc990 0x5633f61ec900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dc990 0x5633f61ec900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:50312/0 (socket says 172.21.15.8:50312) 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f214b7fe700 1 -- 172.21.15.8:0/3713598825 learned_addr learned my addr 172.21.15.8:0/3713598825 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.235+0000 7f214affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36902/0 (socket says 172.21.15.8:36902) 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.236+0000 7f214affd700 1 -- 172.21.15.8:0/3713598825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dc990 msgr2=0x5633f61ec900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.236+0000 7f214affd700 1 --2- 172.21.15.8:0/3713598825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dc990 0x5633f61ec900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.236+0000 7f214affd700 1 -- 172.21.15.8:0/3713598825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dbfd0 msgr2=0x5633f61ec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.236+0000 7f214affd700 1 --2- 172.21.15.8:0/3713598825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dbfd0 0x5633f61ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.236+0000 7f214affd700 1 -- 172.21.15.8:0/3713598825 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633f5f7f1f0 con 0x5633f61daec0 2023-10-06T23:27:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.236+0000 7f214affd700 1 --2- 172.21.15.8:0/3713598825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61f2870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5633f61f3500 tx=0x7f213c009ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f910ec19a7d552d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.237+0000 7f2141ffb700 1 -- 172.21.15.8:0/3713598825 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c021040 con 0x5633f61daec0 2023-10-06T23:27:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.237+0000 7f2141ffb700 1 -- 172.21.15.8:0/3713598825 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f213c022040 con 0x5633f61daec0 2023-10-06T23:27:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.237+0000 7f2141ffb700 1 -- 172.21.15.8:0/3713598825 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0295b0 con 0x5633f61daec0 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.237+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3713598825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 msgr2=0x5633f61f2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.237+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3713598825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61f2870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5633f61f3500 tx=0x7f213c009ab0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.238+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3713598825 shutdown_connections 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.238+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3713598825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61dc990 0x5633f61ec900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.238+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3713598825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61daec0 0x5633f61f2870 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.238+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3713598825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dbfd0 0x5633f61ec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.238+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3713598825 >> 172.21.15.8:0/3713598825 conn(0x5633f614f200 msgr2=0x5633f61d6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.238+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3713598825 shutdown_connections 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.238+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3713598825 wait complete. 2023-10-06T23:27:08.240 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.238+0000 7f2164ec6b80 1 -- start start 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f2164ec6b80 1 Processor -- start 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f2164ec6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f61eb410 con 0x5633f61dc990 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f61eb580 con 0x5633f61dbfd0 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f2164ec6b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633f61eb740 con 0x5633f61daec0 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f2164ec6b80 10 client.0 _ll_register_callbacks cb 0x7f2134099de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f214affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f214affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:50322/0 (socket says 172.21.15.8:50322) 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f214affd700 1 -- 172.21.15.8:0/3007348658 learned_addr learned my addr 172.21.15.8:0/3007348658 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.239+0000 7f214a7fc700 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.240+0000 7f214b7fe700 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.240+0000 7f214affd700 1 -- 172.21.15.8:0/3007348658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 msgr2=0x5633f61e9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.240+0000 7f214affd700 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.240+0000 7f214affd700 1 -- 172.21.15.8:0/3007348658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 msgr2=0x5633f61eaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.240+0000 7f214affd700 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61eaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.240+0000 7f214affd700 1 -- 172.21.15.8:0/3007348658 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633f5f58d80 con 0x5633f61daec0 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.240+0000 7f214b7fe700 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.241+0000 7f214affd700 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e9980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f213c000c00 tx=0x7f213c005080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22706e94fd16dcb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.241+0000 7f21327fc700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.241+0000 7f21327fc700 1 -- 172.21.15.8:0/3007348658 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0299f0 con 0x5633f61daec0 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.241+0000 7f21327fc700 1 -- 172.21.15.8:0/3007348658 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f213c029b50 con 0x5633f61daec0 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.241+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3007348658 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f213c0054b0 con 0x5633f61daec0 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f21327fc700 1 -- 172.21.15.8:0/3007348658 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f213c029d10 con 0x5633f61daec0 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f2164ec6b80 10 client.26881 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3007348658 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5633f5f57250 con 0x5633f61daec0 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f21327fc700 1 -- 172.21.15.8:0/3007348658 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f213c0054b0 con 0x5633f61daec0 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f21327fc700 1 -- 172.21.15.8:0/3007348658 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f213c00c070 con 0x5633f61daec0 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f2164ec6b80 10 client.26881 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f2164ec6b80 10 client.26881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f2164ec6b80 20 client.26881 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5633f6244c40 0x5633f6247030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f2164ec6b80 4 client.26881 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:27:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.242+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3007348658 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5633f6126ad0 con 0x5633f6244c40 2023-10-06T23:27:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.243+0000 7f214a7fc700 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5633f6244c40 0x5633f6247030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.243+0000 7f21327fc700 10 client.26881 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.243+0000 7f214a7fc700 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5633f6244c40 0x5633f6247030 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bc15581b4a604c4 server_cookie=3a85b45355ed99f7 in_seq=0 out_seq=0 2023-10-06T23:27:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.261+0000 7f21327fc700 1 -- 172.21.15.8:0/3007348658 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5633f6126ad0 con 0x5633f6244c40 2023-10-06T23:27:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f21327fc700 10 client.26881 handle_command_reply: tid=0 2023-10-06T23:27:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 client.26881 shutdown 2023-10-06T23:27:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3007348658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 msgr2=0x5633f61e9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.263 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e9980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f213c000c00 tx=0x7f213c005080 comp rx=0 tx=0).stop 2023-10-06T23:27:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3007348658 shutdown_connections 2023-10-06T23:27:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5633f6244c40 0x5633f6247030 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5633f61dc990 0x5633f61eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5633f61daec0 0x5633f61e9980 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 --2- 172.21.15.8:0/3007348658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5633f61dbfd0 0x5633f61e9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.264 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3007348658 >> 172.21.15.8:0/3007348658 conn(0x5633f614f200 msgr2=0x5633f61f2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f21327fc700 0 client.26881 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3007348658 shutdown_connections 2023-10-06T23:27:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.262+0000 7f2164ec6b80 1 -- 172.21.15.8:0/3007348658 wait complete. 2023-10-06T23:27:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.263+0000 7f2164ec6b80 20 client.26881 trim_cache size 0 max 16384 2023-10-06T23:27:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:27:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:27:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:27:08.265 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 -- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f21380a1480 msgr2=0x7f21380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f21380a1480 0x7f21380a3940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x5633f61dac60 tx=0x7f2144006210 comp rx=0 tx=0).stop 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 -- 172.21.15.8:0/3304449322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c1042a0 msgr2=0x7f214c19ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c1042a0 0x7f214c19ef50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f213400e9a0 tx=0x7f213400ecb0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 -- 172.21.15.8:0/3304449322 shutdown_connections 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f21380a1480 0x7f21380a3940 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f214c106bd0 0x7f214c194770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f214c101970 0x7f214c19ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 --2- 172.21.15.8:0/3304449322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f214c1042a0 0x7f214c19ef50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:08.266 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.264+0000 7f21515ff700 1 -- 172.21.15.8:0/3304449322 >> 172.21.15.8:0/3304449322 conn(0x7f214c0fb340 msgr2=0x7f214c0fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.265+0000 7f21515ff700 1 -- 172.21.15.8:0/3304449322 shutdown_connections 2023-10-06T23:27:08.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:08.266+0000 7f21515ff700 1 -- 172.21.15.8:0/3304449322 wait complete. 2023-10-06T23:27:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 735.0 s, 54.4 tps, lat 2262.751 ms stddev 2837.143 2023-10-06T23:27:09.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:09 smithi008 ceph-mon[98532]: pgmap v780: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.0 MiB/s wr, 125 op/s 2023-10-06T23:27:09.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:09 smithi190 ceph-mon[102658]: pgmap v780: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.0 MiB/s wr, 125 op/s 2023-10-06T23:27:10.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:09 smithi156 ceph-mon[102862]: pgmap v780: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.0 MiB/s wr, 125 op/s 2023-10-06T23:27:11.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:11 smithi008 ceph-mon[98532]: pgmap v781: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2023-10-06T23:27:11.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:11 smithi190 ceph-mon[102658]: pgmap v781: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2023-10-06T23:27:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:11 smithi156 ceph-mon[102862]: pgmap v781: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2023-10-06T23:27:13.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:13 smithi156 ceph-mon[102862]: pgmap v782: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 495 KiB/s wr, 67 op/s 2023-10-06T23:27:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:13 smithi008 ceph-mon[98532]: pgmap v782: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 495 KiB/s wr, 67 op/s 2023-10-06T23:27:13.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:13 smithi190 ceph-mon[102658]: pgmap v782: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 495 KiB/s wr, 67 op/s 2023-10-06T23:27:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 740.0 s, 83.8 tps, lat 1337.971 ms stddev 1788.543 2023-10-06T23:27:15.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:15 smithi008 ceph-mon[98532]: pgmap v783: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 769 KiB/s wr, 96 op/s 2023-10-06T23:27:16.028 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:15 smithi190 ceph-mon[102658]: pgmap v783: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 769 KiB/s wr, 96 op/s 2023-10-06T23:27:16.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:15 smithi156 ceph-mon[102862]: pgmap v783: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 769 KiB/s wr, 96 op/s 2023-10-06T23:27:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:17 smithi008 ceph-mon[98532]: pgmap v784: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2023-10-06T23:27:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:17 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:27:17.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:17 smithi190 ceph-mon[102658]: pgmap v784: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2023-10-06T23:27:17.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:17 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:27:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:17 smithi156 ceph-mon[102862]: pgmap v784: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2023-10-06T23:27:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:17 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:27:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 745.0 s, 304.0 tps, lat 330.699 ms stddev 33.246 2023-10-06T23:27:19.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:19 smithi008 ceph-mon[98532]: pgmap v785: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 1.5 MiB/s wr, 178 op/s 2023-10-06T23:27:19.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:19 smithi190 ceph-mon[102658]: pgmap v785: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 1.5 MiB/s wr, 178 op/s 2023-10-06T23:27:20.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:19 smithi156 ceph-mon[102862]: pgmap v785: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 1.5 MiB/s wr, 178 op/s 2023-10-06T23:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.531+0000 7f16f8dff700 1 -- 172.21.15.8:0/630465704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 msgr2=0x7f16f4102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.531+0000 7f16f8dff700 1 --2- 172.21.15.8:0/630465704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 0x7f16f4102500 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009990 tx=0x7f16e4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.532+0000 7f16f8dff700 1 -- 172.21.15.8:0/630465704 shutdown_connections 2023-10-06T23:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.532+0000 7f16f8dff700 1 --2- 172.21.15.8:0/630465704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4100f30 0x7f16f4101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.532+0000 7f16f8dff700 1 --2- 172.21.15.8:0/630465704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f4102a40 0x7f16f4109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.532+0000 7f16f8dff700 1 --2- 172.21.15.8:0/630465704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 0x7f16f4102500 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.532+0000 7f16f8dff700 1 -- 172.21.15.8:0/630465704 >> 172.21.15.8:0/630465704 conn(0x7f16f40fc480 msgr2=0x7f16f40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.533+0000 7f16f8dff700 1 -- 172.21.15.8:0/630465704 shutdown_connections 2023-10-06T23:27:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.533+0000 7f16f8dff700 1 -- 172.21.15.8:0/630465704 wait complete. 2023-10-06T23:27:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.534+0000 7f16f8dff700 1 Processor -- start 2023-10-06T23:27:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.534+0000 7f16f8dff700 1 -- start start 2023-10-06T23:27:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f8dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4100f30 0x7f16f419d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f8dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 0x7f16f419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f8dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f4102a40 0x7f16f419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f8dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f419ebd0 con 0x7f16f4100f30 2023-10-06T23:27:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f8dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f419ed40 con 0x7f16f4102a40 2023-10-06T23:27:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f8dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f419ef00 con 0x7f16f4102080 2023-10-06T23:27:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f1d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 0x7f16f419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f1d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 0x7f16f419d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:51226/0 (socket says 172.21.15.8:51226) 2023-10-06T23:27:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f1d9b700 1 -- 172.21.15.8:0/3919939211 learned_addr learned my addr 172.21.15.8:0/3919939211 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f259c700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4100f30 0x7f16f419d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.535+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f4102a40 0x7f16f419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.536+0000 7f16f1d9b700 1 -- 172.21.15.8:0/3919939211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f4102a40 msgr2=0x7f16f419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.536+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f4102a40 0x7f16f419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.536+0000 7f16f1d9b700 1 -- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4100f30 msgr2=0x7f16f419d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.536+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4100f30 0x7f16f419d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.536+0000 7f16f1d9b700 1 -- 172.21.15.8:0/3919939211 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40095f0 con 0x7f16f4102080 2023-10-06T23:27:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.536+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 0x7f16f419d6f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f16e4005910 tx=0x7f16e4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.537+0000 7f16e37fe700 1 -- 172.21.15.8:0/3919939211 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e401d070 con 0x7f16f4102080 2023-10-06T23:27:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.537+0000 7f16e37fe700 1 -- 172.21.15.8:0/3919939211 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16e400be70 con 0x7f16f4102080 2023-10-06T23:27:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.537+0000 7f16e37fe700 1 -- 172.21.15.8:0/3919939211 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4022e60 con 0x7f16f4102080 2023-10-06T23:27:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.537+0000 7f16f8dff700 1 -- 172.21.15.8:0/3919939211 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f419f180 con 0x7f16f4102080 2023-10-06T23:27:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.537+0000 7f16f8dff700 1 -- 172.21.15.8:0/3919939211 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f41a59a0 con 0x7f16f4102080 2023-10-06T23:27:21.544 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.543+0000 7f16e37fe700 1 -- 172.21.15.8:0/3919939211 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f16e4022600 con 0x7f16f4102080 2023-10-06T23:27:21.546 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.545+0000 7f170c74fb80 1 Processor -- start 2023-10-06T23:27:21.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.546+0000 7f170c74fb80 1 -- start start 2023-10-06T23:27:21.547 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.546+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4aec0 0x563dc3e4b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.546+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e4c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.546+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4c990 0x563dc3e53220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.546+0000 7f170c74fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3db3400 con 0x563dc3e4bfd0 2023-10-06T23:27:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.546+0000 7f170c74fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3da4bc0 con 0x563dc3e4c990 2023-10-06T23:27:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.546+0000 7f170c74fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3da24e0 con 0x563dc3e4aec0 2023-10-06T23:27:21.548 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.547+0000 7f16f2d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4aec0 0x563dc3e4b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.547+0000 7f16f2d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4aec0 0x563dc3e4b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:51238/0 (socket says 172.21.15.8:51238) 2023-10-06T23:27:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.547+0000 7f16f2d9d700 1 -- 172.21.15.8:0/2257332262 learned_addr learned my addr 172.21.15.8:0/2257332262 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.547+0000 7f16e37fe700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f16dc0a1580 0x7f16dc0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.547+0000 7f16e37fe700 1 -- 172.21.15.8:0/3919939211 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f16e40ce030 con 0x7f16f4102080 2023-10-06T23:27:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.548+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4c990 0x563dc3e53220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.548+0000 7f16f259c700 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e4c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.548+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f16dc0a1580 0x7f16dc0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.548+0000 7f16f2d9d700 1 -- 172.21.15.8:0/2257332262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4c990 msgr2=0x563dc3e53220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.548+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4c990 0x563dc3e53220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.548+0000 7f16f2d9d700 1 -- 172.21.15.8:0/2257332262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 msgr2=0x563dc3e4c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.548+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e4c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.548+0000 7f16f2d9d700 1 -- 172.21.15.8:0/2257332262 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dc3bc8d80 con 0x563dc3e4aec0 2023-10-06T23:27:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.549+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4aec0 0x563dc3e4b2e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00fc70 tx=0x7f16ec00ff80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fae3616ae0b84ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.549+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f16dc0a1580 0x7f16dc0a3a40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009000 tx=0x7f16ec01e000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.549+0000 7f16e0ff9700 1 -- 172.21.15.8:0/2257332262 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00e040 con 0x563dc3e4aec0 2023-10-06T23:27:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.549+0000 7f16e0ff9700 1 -- 172.21.15.8:0/2257332262 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16ec00f040 con 0x563dc3e4aec0 2023-10-06T23:27:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.549+0000 7f16e0ff9700 1 -- 172.21.15.8:0/2257332262 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec01a770 con 0x563dc3e4aec0 2023-10-06T23:27:21.552 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.550+0000 7f170c74fb80 1 -- 172.21.15.8:0/2257332262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4aec0 msgr2=0x563dc3e4b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.552 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.550+0000 7f170c74fb80 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4aec0 0x563dc3e4b2e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00fc70 tx=0x7f16ec00ff80 comp rx=0 tx=0).stop 2023-10-06T23:27:21.552 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.550+0000 7f170c74fb80 1 -- 172.21.15.8:0/2257332262 shutdown_connections 2023-10-06T23:27:21.552 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.550+0000 7f170c74fb80 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4c990 0x563dc3e53220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.552 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.550+0000 7f170c74fb80 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4aec0 0x563dc3e4b2e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.552 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.550+0000 7f170c74fb80 1 --2- 172.21.15.8:0/2257332262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e4c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.552 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.550+0000 7f170c74fb80 1 -- 172.21.15.8:0/2257332262 >> 172.21.15.8:0/2257332262 conn(0x563dc3dbf200 msgr2=0x563dc3e45bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:21.553 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.551+0000 7f170c74fb80 1 -- 172.21.15.8:0/2257332262 shutdown_connections 2023-10-06T23:27:21.553 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.551+0000 7f170c74fb80 1 -- 172.21.15.8:0/2257332262 wait complete. 2023-10-06T23:27:21.553 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.551+0000 7f170c74fb80 1 -- start start 2023-10-06T23:27:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.553+0000 7f170c74fb80 1 Processor -- start 2023-10-06T23:27:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e54c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e55140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 0x563dc3e5c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f170c74fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3d9ddd0 con 0x563dc3e4bfd0 2023-10-06T23:27:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f170c74fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3d3a6b0 con 0x563dc3e4aec0 2023-10-06T23:27:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f170c74fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3d3a350 con 0x563dc3e4c990 2023-10-06T23:27:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f170c74fb80 10 client.0 _ll_register_callbacks cb 0x563dc3b977a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f16f259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e54c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f16f259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e54c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58034/0 (socket says 172.21.15.8:58034) 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f16f259c700 1 -- 172.21.15.8:0/3856179117 learned_addr learned my addr 172.21.15.8:0/3856179117 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.554+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 0x563dc3e5c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e55140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16f259c700 1 -- 172.21.15.8:0/3856179117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 msgr2=0x563dc3e5c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16f259c700 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 0x563dc3e5c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16f259c700 1 -- 172.21.15.8:0/3856179117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 msgr2=0x563dc3e55140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16f259c700 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e55140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16f259c700 1 -- 172.21.15.8:0/3856179117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec00f820 con 0x563dc3e4aec0 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e55140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16f259c700 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e54c00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009fd0 tx=0x7f16e8012a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3de725372d0de7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.555+0000 7f16d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:27:21.558 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.556+0000 7f16d9ffb700 1 -- 172.21.15.8:0/3856179117 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8017070 con 0x563dc3e4aec0 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.556+0000 7f16d9ffb700 1 -- 172.21.15.8:0/3856179117 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f16e800f4e0 con 0x563dc3e4aec0 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.556+0000 7f170c74fb80 1 -- 172.21.15.8:0/3856179117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dc3e3dd50 con 0x563dc3e4aec0 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.556+0000 7f16d9ffb700 1 -- 172.21.15.8:0/3856179117 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e80122e0 con 0x563dc3e4aec0 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.556+0000 7f170c74fb80 10 client.26882 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.556+0000 7f170c74fb80 1 -- 172.21.15.8:0/3856179117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563dc3bb1c00 con 0x563dc3e4aec0 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.557+0000 7f16d9ffb700 1 -- 172.21.15.8:0/3856179117 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563dc3e3dd50 con 0x563dc3e4aec0 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.557+0000 7f16d9ffb700 1 -- 172.21.15.8:0/3856179117 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f16e8010800 con 0x563dc3e4aec0 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.557+0000 7f170c74fb80 10 client.26882 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.557+0000 7f170c74fb80 10 client.26882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.557+0000 7f170c74fb80 20 client.26882 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:21.559 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.557+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563dc3e60a10 0x563dc3e62e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.557+0000 7f170c74fb80 4 client.26882 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:27:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.557+0000 7f170c74fb80 1 -- 172.21.15.8:0/3856179117 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563dc3d96db0 con 0x563dc3e60a10 2023-10-06T23:27:21.560 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.558+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563dc3e60a10 0x563dc3e62e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.558+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563dc3e60a10 0x563dc3e62e30 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f10e60860c5343 server_cookie=f51e63076779443c in_seq=0 out_seq=0 2023-10-06T23:27:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.558+0000 7f16d9ffb700 10 client.26882 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.559+0000 7f16d9ffb700 1 -- 172.21.15.8:0/3856179117 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563dc3d96db0 con 0x563dc3e60a10 2023-10-06T23:27:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.559+0000 7f16d9ffb700 10 client.26882 handle_command_reply: tid=0 2023-10-06T23:27:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.559+0000 7f170c74fb80 1 client.26882 shutdown 2023-10-06T23:27:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.559+0000 7f170c74fb80 1 -- 172.21.15.8:0/3856179117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 msgr2=0x563dc3e54c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.561 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.559+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e54c00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009fd0 tx=0x7f16e8012a20 comp rx=0 tx=0).stop 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 1 -- 172.21.15.8:0/3856179117 shutdown_connections 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563dc3e60a10 0x563dc3e62e30 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 0x563dc3e5c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e54c00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3856179117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4bfd0 0x563dc3e55140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 1 -- 172.21.15.8:0/3856179117 >> 172.21.15.8:0/3856179117 conn(0x563dc3dbf200 msgr2=0x563dc3e45250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f16d9ffb700 0 client.26882 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 1 -- 172.21.15.8:0/3856179117 shutdown_connections 2023-10-06T23:27:21.562 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 1 -- 172.21.15.8:0/3856179117 wait complete. 2023-10-06T23:27:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.560+0000 7f170c74fb80 20 client.26882 trim_cache size 0 max 16384 2023-10-06T23:27:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.585+0000 7f170c74fb80 1 Processor -- start 2023-10-06T23:27:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.586+0000 7f170c74fb80 1 -- start start 2023-10-06T23:27:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.586+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e52ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.586+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4bfd0 0x563dc3e5c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.586+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4c990 0x563dc3e62a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.586+0000 7f170c74fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3e547d0 con 0x563dc3e4c990 2023-10-06T23:27:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.586+0000 7f170c74fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3c1e8c0 con 0x563dc3e4aec0 2023-10-06T23:27:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.586+0000 7f170c74fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3e5de70 con 0x563dc3e4bfd0 2023-10-06T23:27:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e52ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e52ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58040/0 (socket says 172.21.15.8:58040) 2023-10-06T23:27:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 -- 172.21.15.8:0/3730997764 learned_addr learned my addr 172.21.15.8:0/3730997764 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4c990 0x563dc3e62a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4bfd0 0x563dc3e5c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 -- 172.21.15.8:0/3730997764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4bfd0 msgr2=0x563dc3e5c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4bfd0 0x563dc3e5c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 -- 172.21.15.8:0/3730997764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4c990 msgr2=0x563dc3e62a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4c990 0x563dc3e62a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 -- 172.21.15.8:0/3730997764 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dc3bef1f0 con 0x563dc3e4aec0 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.587+0000 7f16f259c700 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e52ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f16e8012ed0 tx=0x7f16e80122e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec1b6a8e47aac6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.588+0000 7f16e17fa700 1 -- 172.21.15.8:0/3730997764 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8017070 con 0x563dc3e4aec0 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.588+0000 7f16e17fa700 1 -- 172.21.15.8:0/3730997764 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16e80108c0 con 0x563dc3e4aec0 2023-10-06T23:27:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.588+0000 7f16e17fa700 1 -- 172.21.15.8:0/3730997764 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8003680 con 0x563dc3e4aec0 2023-10-06T23:27:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 -- 172.21.15.8:0/3730997764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 msgr2=0x563dc3e52ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e52ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f16e8012ed0 tx=0x7f16e80122e0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 -- 172.21.15.8:0/3730997764 shutdown_connections 2023-10-06T23:27:21.591 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4c990 0x563dc3e62a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4aec0 0x563dc3e52ef0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 --2- 172.21.15.8:0/3730997764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4bfd0 0x563dc3e5c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 -- 172.21.15.8:0/3730997764 >> 172.21.15.8:0/3730997764 conn(0x563dc3dbf200 msgr2=0x563dc3e447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 -- 172.21.15.8:0/3730997764 shutdown_connections 2023-10-06T23:27:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.589+0000 7f170c74fb80 1 -- 172.21.15.8:0/3730997764 wait complete. 2023-10-06T23:27:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.590+0000 7f170c74fb80 1 -- start start 2023-10-06T23:27:21.592 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.590+0000 7f170c74fb80 1 Processor -- start 2023-10-06T23:27:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4aec0 0x563dc3e596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4bfd0 0x563dc3e59bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f170c74fb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 0x563dc3e5ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f170c74fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3e5b140 con 0x563dc3e4aec0 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f170c74fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3e5b2b0 con 0x563dc3e4bfd0 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f170c74fb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc3e5b470 con 0x563dc3e4c990 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f170c74fb80 10 client.0 _ll_register_callbacks cb 0x7f16e8009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f16f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4aec0 0x563dc3e596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f16f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4aec0 0x563dc3e596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36384/0 (socket says 172.21.15.8:36384) 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.591+0000 7f16f259c700 1 -- 172.21.15.8:0/1639286011 learned_addr learned my addr 172.21.15.8:0/1639286011 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4bfd0 0x563dc3e59bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f2d9d700 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 0x563dc3e5ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f259c700 1 -- 172.21.15.8:0/1639286011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 msgr2=0x563dc3e5ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f259c700 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 0x563dc3e5ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f259c700 1 -- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4bfd0 msgr2=0x563dc3e59bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f259c700 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4bfd0 0x563dc3e59bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f259c700 1 -- 172.21.15.8:0/1639286011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563dc3bb1c00 con 0x563dc3e4aec0 2023-10-06T23:27:21.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4bfd0 0x563dc3e59bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:27:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.592+0000 7f16f259c700 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4aec0 0x563dc3e596b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f16e8012f20 tx=0x7f16e8012a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ceff12c85dcdfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.593+0000 7f16d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:27:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.593+0000 7f16d9ffb700 1 -- 172.21.15.8:0/1639286011 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8017040 con 0x563dc3e4aec0 2023-10-06T23:27:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.593+0000 7f16d9ffb700 1 -- 172.21.15.8:0/1639286011 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f16e8005320 con 0x563dc3e4aec0 2023-10-06T23:27:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.593+0000 7f170c74fb80 1 -- 172.21.15.8:0/1639286011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16ec00f040 con 0x563dc3e4aec0 2023-10-06T23:27:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.593+0000 7f16d9ffb700 1 -- 172.21.15.8:0/1639286011 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e8003680 con 0x563dc3e4aec0 2023-10-06T23:27:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.593+0000 7f170c74fb80 10 client.16980 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:21.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f170c74fb80 1 -- 172.21.15.8:0/1639286011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563dc3bc7250 con 0x563dc3e4aec0 2023-10-06T23:27:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f16d9ffb700 1 -- 172.21.15.8:0/1639286011 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16ec00f040 con 0x563dc3e4aec0 2023-10-06T23:27:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f16d9ffb700 1 -- 172.21.15.8:0/1639286011 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f16e800f760 con 0x563dc3e4aec0 2023-10-06T23:27:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f170c74fb80 10 client.16980 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f170c74fb80 10 client.16980 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f170c74fb80 20 client.16980 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f170c74fb80 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563dc3eb4b20 0x563dc3eb6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f170c74fb80 4 client.16980 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:27:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.594+0000 7f170c74fb80 1 -- 172.21.15.8:0/1639286011 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563dc3d96ad0 con 0x563dc3eb4b20 2023-10-06T23:27:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.597+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563dc3eb4b20 0x563dc3eb6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.598+0000 7f16f1d9b700 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563dc3eb4b20 0x563dc3eb6f40 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=773668594d21b8e6 server_cookie=98d038bd393bc792 in_seq=0 out_seq=0 2023-10-06T23:27:21.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.598+0000 7f16d9ffb700 10 client.16980 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.619+0000 7f16d9ffb700 1 -- 172.21.15.8:0/1639286011 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563dc3d96ad0 con 0x563dc3eb4b20 2023-10-06T23:27:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.619+0000 7f16d9ffb700 10 client.16980 handle_command_reply: tid=0 2023-10-06T23:27:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.619+0000 7f170c74fb80 1 client.16980 shutdown 2023-10-06T23:27:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 -- 172.21.15.8:0/1639286011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4aec0 msgr2=0x563dc3e596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4aec0 0x563dc3e596b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f16e8012f20 tx=0x7f16e8012a20 comp rx=0 tx=0).stop 2023-10-06T23:27:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 -- 172.21.15.8:0/1639286011 shutdown_connections 2023-10-06T23:27:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563dc3eb4b20 0x563dc3eb6f40 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563dc3e4aec0 0x563dc3e596b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563dc3e4c990 0x563dc3e5ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 --2- 172.21.15.8:0/1639286011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc3e4bfd0 0x563dc3e59bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f16d9ffb700 0 client.16980 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 -- 172.21.15.8:0/1639286011 >> 172.21.15.8:0/1639286011 conn(0x563dc3dbf200 msgr2=0x563dc3e52ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:21.622 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.620+0000 7f170c74fb80 1 -- 172.21.15.8:0/1639286011 shutdown_connections 2023-10-06T23:27:21.623 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.621+0000 7f170c74fb80 1 -- 172.21.15.8:0/1639286011 wait complete. 2023-10-06T23:27:21.623 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.622+0000 7f170c74fb80 20 client.16980 trim_cache size 0 max 16384 2023-10-06T23:27:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:27:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:27:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:27:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:27:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.623+0000 7f16f8dff700 1 -- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f16dc0a1580 msgr2=0x7f16dc0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.623+0000 7f16f8dff700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f16dc0a1580 0x7f16dc0a3a40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009000 tx=0x7f16ec01e000 comp rx=0 tx=0).stop 2023-10-06T23:27:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.623+0000 7f16f8dff700 1 -- 172.21.15.8:0/3919939211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 msgr2=0x7f16f419d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.623+0000 7f16f8dff700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 0x7f16f419d6f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f16e4005910 tx=0x7f16e4005740 comp rx=0 tx=0).stop 2023-10-06T23:27:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.624+0000 7f16f8dff700 1 -- 172.21.15.8:0/3919939211 shutdown_connections 2023-10-06T23:27:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.624+0000 7f16f8dff700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f16dc0a1580 0x7f16dc0a3a40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.624+0000 7f16f8dff700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16f4100f30 0x7f16f419d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.624+0000 7f16f8dff700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f16f4102a40 0x7f16f419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.624+0000 7f16f8dff700 1 --2- 172.21.15.8:0/3919939211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f4102080 0x7f16f419d6f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.624+0000 7f16f8dff700 1 -- 172.21.15.8:0/3919939211 >> 172.21.15.8:0/3919939211 conn(0x7f16f40fc480 msgr2=0x7f16f40fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.624+0000 7f16f8dff700 1 -- 172.21.15.8:0/3919939211 shutdown_connections 2023-10-06T23:27:21.626 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:21.625+0000 7f16f8dff700 1 -- 172.21.15.8:0/3919939211 wait complete. 2023-10-06T23:27:21.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:21 smithi190 ceph-mon[102658]: pgmap v786: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.3 MiB/s wr, 258 op/s 2023-10-06T23:27:22.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:21 smithi156 ceph-mon[102862]: pgmap v786: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.3 MiB/s wr, 258 op/s 2023-10-06T23:27:22.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:21 smithi008 ceph-mon[98532]: pgmap v786: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.3 MiB/s wr, 258 op/s 2023-10-06T23:27:23.280 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:27:23.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:23 smithi156 ceph-mon[102862]: pgmap v787: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-10-06T23:27:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:23 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:27:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:23 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:27:23.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:23 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:27:23.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.888+0000 7f335fdff700 1 -- 172.21.15.8:0/4255921353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3358100ab0 msgr2=0x7f3358100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.888+0000 7f335fdff700 1 --2- 172.21.15.8:0/4255921353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3358100ab0 0x7f3358100f30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f335000b0d0 tx=0x7f335000b3e0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.889+0000 7f335fdff700 1 -- 172.21.15.8:0/4255921353 shutdown_connections 2023-10-06T23:27:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.889+0000 7f335fdff700 1 --2- 172.21.15.8:0/4255921353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3358100ab0 0x7f3358100f30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.889+0000 7f335fdff700 1 --2- 172.21.15.8:0/4255921353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33580ff790 0x7f33580ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.889+0000 7f335fdff700 1 --2- 172.21.15.8:0/4255921353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33581000f0 0x7f3358100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.889+0000 7f335fdff700 1 -- 172.21.15.8:0/4255921353 >> 172.21.15.8:0/4255921353 conn(0x7f33580fb330 msgr2=0x7f33580fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.889+0000 7f335fdff700 1 -- 172.21.15.8:0/4255921353 shutdown_connections 2023-10-06T23:27:23.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.889+0000 7f335fdff700 1 -- 172.21.15.8:0/4255921353 wait complete. 2023-10-06T23:27:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.890+0000 7f335fdff700 1 Processor -- start 2023-10-06T23:27:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.891+0000 7f335fdff700 1 -- start start 2023-10-06T23:27:23.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.891+0000 7f335fdff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33580ff790 0x7f3358198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.891+0000 7f335fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33581000f0 0x7f3358199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.891+0000 7f335fdff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3358100ab0 0x7f33581a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.891+0000 7f335fdff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33581a0870 con 0x7f33580ff790 2023-10-06T23:27:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.891+0000 7f335fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33581a09e0 con 0x7f33581000f0 2023-10-06T23:27:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.891+0000 7f335fdff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33581a0ba0 con 0x7f3358100ab0 2023-10-06T23:27:23.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335db9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33580ff790 0x7f3358198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335d39a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33581000f0 0x7f3358199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335db9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33580ff790 0x7f3358198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36406/0 (socket says 172.21.15.8:36406) 2023-10-06T23:27:23.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335db9b700 1 -- 172.21.15.8:0/2465022302 learned_addr learned my addr 172.21.15.8:0/2465022302 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:23.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335e39c700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3358100ab0 0x7f33581a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335d39a700 1 -- 172.21.15.8:0/2465022302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3358100ab0 msgr2=0x7f33581a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335d39a700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3358100ab0 0x7f33581a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335d39a700 1 -- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33580ff790 msgr2=0x7f3358198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335d39a700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33580ff790 0x7f3358198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335d39a700 1 -- 172.21.15.8:0/2465022302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3350009d00 con 0x7f33581000f0 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.892+0000 7f335db9b700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33580ff790 0x7f3358198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.893+0000 7f335d39a700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33581000f0 0x7f3358199270 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3348006fd0 tx=0x7f334800b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.893+0000 7f334effd700 1 -- 172.21.15.8:0/2465022302 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348011830 con 0x7f33581000f0 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.893+0000 7f334effd700 1 -- 172.21.15.8:0/2465022302 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334800be30 con 0x7f33581000f0 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.893+0000 7f334effd700 1 -- 172.21.15.8:0/2465022302 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348010d00 con 0x7f33581000f0 2023-10-06T23:27:23.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.893+0000 7f335fdff700 1 -- 172.21.15.8:0/2465022302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33581a0e80 con 0x7f33581000f0 2023-10-06T23:27:23.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.893+0000 7f335fdff700 1 -- 172.21.15.8:0/2465022302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33581a12d0 con 0x7f33581000f0 2023-10-06T23:27:23.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:23 smithi008 ceph-mon[98532]: pgmap v787: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-10-06T23:27:23.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:27:23.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:27:23.897 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:27:23.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.900+0000 7f334effd700 1 -- 172.21.15.8:0/2465022302 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3348011990 con 0x7f33581000f0 2023-10-06T23:27:23.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.901+0000 7f337375db80 1 Processor -- start 2023-10-06T23:27:23.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f337375db80 1 -- start start 2023-10-06T23:27:23.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f334effd700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33440a1550 0x7f33440a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f337375db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b4f7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f337375db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b4f8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f337375db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f8a60 0x55559b4f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f337375db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b45f460 con 0x55559b4f7bc0 2023-10-06T23:27:23.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f337375db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b450c20 con 0x55559b4f7260 2023-10-06T23:27:23.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f337375db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b44e540 con 0x55559b4f8a60 2023-10-06T23:27:23.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.902+0000 7f334effd700 1 -- 172.21.15.8:0/2465022302 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f33480cc640 con 0x7f33581000f0 2023-10-06T23:27:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.903+0000 7f335d39a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b4f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.903+0000 7f335d39a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b4f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36422/0 (socket says 172.21.15.8:36422) 2023-10-06T23:27:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.903+0000 7f335d39a700 1 -- 172.21.15.8:0/4216683970 learned_addr learned my addr 172.21.15.8:0/4216683970 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.903+0000 7f335db9b700 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b4f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.903+0000 7f335e39c700 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f8a60 0x55559b4f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.903+0000 7f335e39c700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33440a1550 0x7f33440a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f335d39a700 1 -- 172.21.15.8:0/4216683970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f8a60 msgr2=0x55559b4f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f335d39a700 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f8a60 0x55559b4f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f335d39a700 1 -- 172.21.15.8:0/4216683970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 msgr2=0x55559b4f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f335d39a700 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b4f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f335d39a700 1 -- 172.21.15.8:0/4216683970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55559b274de0 con 0x55559b4f7bc0 2023-10-06T23:27:23.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f335db9b700 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b4f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:27:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f335d39a700 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b4f8480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3348095e70 tx=0x7f3348099350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed438149a0afc141 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f335e39c700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33440a1550 0x7f33440a3a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55559b4f8240 tx=0x7f335000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f3343fff700 1 -- 172.21.15.8:0/4216683970 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348018310 con 0x55559b4f7bc0 2023-10-06T23:27:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.904+0000 7f3343fff700 1 -- 172.21.15.8:0/4216683970 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334809a070 con 0x55559b4f7bc0 2023-10-06T23:27:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.905+0000 7f3343fff700 1 -- 172.21.15.8:0/4216683970 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348098e60 con 0x55559b4f7bc0 2023-10-06T23:27:23.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.905+0000 7f337375db80 1 -- 172.21.15.8:0/4216683970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 msgr2=0x55559b4f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.905+0000 7f337375db80 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b4f8480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3348095e70 tx=0x7f3348099350 comp rx=0 tx=0).stop 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.906+0000 7f337375db80 1 -- 172.21.15.8:0/4216683970 shutdown_connections 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.906+0000 7f337375db80 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f8a60 0x55559b4f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.906+0000 7f337375db80 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b4f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.906+0000 7f337375db80 1 --2- 172.21.15.8:0/4216683970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b4f8480 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.906+0000 7f337375db80 1 -- 172.21.15.8:0/4216683970 >> 172.21.15.8:0/4216683970 conn(0x55559b46b260 msgr2=0x55559b4f2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.906+0000 7f337375db80 1 -- 172.21.15.8:0/4216683970 shutdown_connections 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.906+0000 7f337375db80 1 -- 172.21.15.8:0/4216683970 wait complete. 2023-10-06T23:27:23.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.907+0000 7f337375db80 1 -- start start 2023-10-06T23:27:23.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.907+0000 7f337375db80 1 Processor -- start 2023-10-06T23:27:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f337375db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b5010d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f337375db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7bc0 0x55559b501610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f337375db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f8a60 0x55559b508650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f337375db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b449e30 con 0x55559b4f8a60 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f337375db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b3e6710 con 0x55559b4f7260 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f337375db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b3e63b0 con 0x55559b4f7bc0 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f337375db80 10 client.0 _ll_register_callbacks cb 0x55559b243800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f335db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b5010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f335db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b5010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58076/0 (socket says 172.21.15.8:58076) 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f335db9b700 1 -- 172.21.15.8:0/3081259542 learned_addr learned my addr 172.21.15.8:0/3081259542 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.908+0000 7f335d39a700 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7bc0 0x55559b501610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.909+0000 7f335db9b700 1 -- 172.21.15.8:0/3081259542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7bc0 msgr2=0x55559b501610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.909+0000 7f335db9b700 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7bc0 0x55559b501610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.909+0000 7f335db9b700 1 -- 172.21.15.8:0/3081259542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f8a60 msgr2=0x55559b508650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:23.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.909+0000 7f335db9b700 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f8a60 0x55559b508650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.909+0000 7f335db9b700 1 -- 172.21.15.8:0/3081259542 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3354009d80 con 0x55559b4f7260 2023-10-06T23:27:23.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.909+0000 7f335d39a700 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7bc0 0x55559b501610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:27:23.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.909+0000 7f335db9b700 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b5010d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3354011d10 tx=0x7f335400f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1648f061c441c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:23.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.909+0000 7f33417fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:27:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.910+0000 7f33417fa700 1 -- 172.21.15.8:0/3081259542 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354016070 con 0x55559b4f7260 2023-10-06T23:27:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.910+0000 7f337375db80 1 -- 172.21.15.8:0/3081259542 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55559b4e9f10 con 0x55559b4f7260 2023-10-06T23:27:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.910+0000 7f33417fa700 1 -- 172.21.15.8:0/3081259542 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f335400fe40 con 0x55559b4f7260 2023-10-06T23:27:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.910+0000 7f33417fa700 1 -- 172.21.15.8:0/3081259542 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3354004050 con 0x55559b4f7260 2023-10-06T23:27:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.910+0000 7f337375db80 10 client.26900 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:23.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.910+0000 7f337375db80 1 -- 172.21.15.8:0/3081259542 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f33581a12d0 con 0x55559b4f7260 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.911+0000 7f33417fa700 1 -- 172.21.15.8:0/3081259542 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55559b4e9f10 con 0x55559b4f7260 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.911+0000 7f33417fa700 1 -- 172.21.15.8:0/3081259542 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f335401a410 con 0x55559b4f7260 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.911+0000 7f337375db80 10 client.26900 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.911+0000 7f337375db80 10 client.26900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.911+0000 7f337375db80 20 client.26900 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.911+0000 7f337375db80 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55559b51df00 0x55559b520320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.911+0000 7f337375db80 4 client.26900 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.911+0000 7f337375db80 1 -- 172.21.15.8:0/3081259542 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55559b442e10 con 0x55559b51df00 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.912+0000 7f335d39a700 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55559b51df00 0x55559b520320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.913+0000 7f335d39a700 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55559b51df00 0x55559b520320 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f42fb8c5017046d server_cookie=94103a321a7acbdf in_seq=0 out_seq=0 2023-10-06T23:27:23.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.913+0000 7f33417fa700 10 client.26900 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:23.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.914+0000 7f33417fa700 1 -- 172.21.15.8:0/3081259542 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55559b442e10 con 0x55559b51df00 2023-10-06T23:27:23.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.914+0000 7f33417fa700 10 client.26900 handle_command_reply: tid=0 2023-10-06T23:27:23.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.914+0000 7f337375db80 1 client.26900 shutdown 2023-10-06T23:27:23.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.914+0000 7f337375db80 1 -- 172.21.15.8:0/3081259542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 msgr2=0x55559b5010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.914+0000 7f337375db80 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b5010d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3354011d10 tx=0x7f335400f6a0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 1 -- 172.21.15.8:0/3081259542 shutdown_connections 2023-10-06T23:27:23.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55559b51df00 0x55559b520320 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f8a60 0x55559b508650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f7260 0x55559b5010d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 1 --2- 172.21.15.8:0/3081259542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7bc0 0x55559b501610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 1 -- 172.21.15.8:0/3081259542 >> 172.21.15.8:0/3081259542 conn(0x55559b46b260 msgr2=0x55559b4f1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:23.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f33417fa700 0 client.26900 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:23.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 1 -- 172.21.15.8:0/3081259542 shutdown_connections 2023-10-06T23:27:23.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 1 -- 172.21.15.8:0/3081259542 wait complete. 2023-10-06T23:27:23.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.915+0000 7f337375db80 20 client.26900 trim_cache size 0 max 16384 2023-10-06T23:27:23.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:23 smithi190 ceph-mon[102658]: pgmap v787: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-10-06T23:27:23.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:23 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:27:23.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:23 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:27:23.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:23 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:27:23.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.942+0000 7f337375db80 1 Processor -- start 2023-10-06T23:27:23.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.942+0000 7f337375db80 1 -- start start 2023-10-06T23:27:23.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f337375db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b519f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f337375db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b508570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f337375db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b4feef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f337375db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b2ca920 con 0x55559b4f7bc0 2023-10-06T23:27:23.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f337375db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b4ec570 con 0x55559b4f8a60 2023-10-06T23:27:23.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f337375db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b500580 con 0x55559b4f7260 2023-10-06T23:27:23.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f335d39a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b508570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f335db9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b519f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f335d39a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b508570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36440/0 (socket says 172.21.15.8:36440) 2023-10-06T23:27:23.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f335d39a700 1 -- 172.21.15.8:0/3576313371 learned_addr learned my addr 172.21.15.8:0/3576313371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:23.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.943+0000 7f335e39c700 1 --2- 172.21.15.8:0/3576313371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b4feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.944+0000 7f335d39a700 1 -- 172.21.15.8:0/3576313371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 msgr2=0x55559b519f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:23.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.944+0000 7f335d39a700 1 --2- 172.21.15.8:0/3576313371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b519f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.944+0000 7f335d39a700 1 -- 172.21.15.8:0/3576313371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 msgr2=0x55559b4feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:23.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.944+0000 7f335d39a700 1 --2- 172.21.15.8:0/3576313371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b4feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.944+0000 7f335d39a700 1 -- 172.21.15.8:0/3576313371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55559b25dc60 con 0x55559b4f7bc0 2023-10-06T23:27:23.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.944+0000 7f335d39a700 1 --2- 172.21.15.8:0/3576313371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b508570 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3348009fd0 tx=0x7f3348010620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4571902aaf9ab99d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:23.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.945+0000 7f334cbff700 1 -- 172.21.15.8:0/3576313371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348018310 con 0x55559b4f7bc0 2023-10-06T23:27:23.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.945+0000 7f334cbff700 1 -- 172.21.15.8:0/3576313371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33480a1d70 con 0x55559b4f7bc0 2023-10-06T23:27:23.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.945+0000 7f334cbff700 1 -- 172.21.15.8:0/3576313371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480b9320 con 0x55559b4f7bc0 2023-10-06T23:27:23.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 -- 172.21.15.8:0/3576313371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 msgr2=0x55559b508570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 --2- 172.21.15.8:0/3576313371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b508570 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3348009fd0 tx=0x7f3348010620 comp rx=0 tx=0).stop 2023-10-06T23:27:23.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 -- 172.21.15.8:0/3576313371 shutdown_connections 2023-10-06T23:27:23.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 --2- 172.21.15.8:0/3576313371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b4feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 --2- 172.21.15.8:0/3576313371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b519f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 --2- 172.21.15.8:0/3576313371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b4f7bc0 0x55559b508570 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 -- 172.21.15.8:0/3576313371 >> 172.21.15.8:0/3576313371 conn(0x55559b46b260 msgr2=0x55559b524c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:23.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 -- 172.21.15.8:0/3576313371 shutdown_connections 2023-10-06T23:27:23.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.946+0000 7f337375db80 1 -- 172.21.15.8:0/3576313371 wait complete. 2023-10-06T23:27:23.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.947+0000 7f337375db80 1 -- start start 2023-10-06T23:27:23.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.947+0000 7f337375db80 1 Processor -- start 2023-10-06T23:27:23.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.948+0000 7f337375db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b5061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.948+0000 7f337375db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b5066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.948+0000 7f337375db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b507680 0x55559b507b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.948+0000 7f337375db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b508040 con 0x55559b507680 2023-10-06T23:27:23.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.948+0000 7f337375db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b5081b0 con 0x55559b4f8a60 2023-10-06T23:27:23.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.948+0000 7f337375db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559b508370 con 0x55559b4f7260 2023-10-06T23:27:23.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.948+0000 7f337375db80 10 client.0 _ll_register_callbacks cb 0x7f33540117e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:23.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335db9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b5061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335d39a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b5066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335db9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b5061a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:51328/0 (socket says 172.21.15.8:51328) 2023-10-06T23:27:23.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335d39a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b5066e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58098/0 (socket says 172.21.15.8:58098) 2023-10-06T23:27:23.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335db9b700 1 -- 172.21.15.8:0/4075057533 learned_addr learned my addr 172.21.15.8:0/4075057533 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:23.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335e39c700 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b507680 0x55559b507b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335db9b700 1 -- 172.21.15.8:0/4075057533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 msgr2=0x55559b5066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:23.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335db9b700 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b5066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335db9b700 1 -- 172.21.15.8:0/4075057533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b507680 msgr2=0x55559b507b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:23.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335db9b700 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b507680 0x55559b507b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.949+0000 7f335db9b700 1 -- 172.21.15.8:0/4075057533 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55559b274de0 con 0x55559b4f7260 2023-10-06T23:27:23.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.950+0000 7f335db9b700 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b5061a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3354011ce0 tx=0x7f335401a640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75cb8e5c36b23d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:23.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.950+0000 7f33417fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:27:23.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.950+0000 7f33417fa700 1 -- 172.21.15.8:0/4075057533 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354016040 con 0x55559b4f7260 2023-10-06T23:27:23.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.950+0000 7f337375db80 1 -- 172.21.15.8:0/4075057533 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55559b442b30 con 0x55559b4f7260 2023-10-06T23:27:23.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.950+0000 7f33417fa700 1 -- 172.21.15.8:0/4075057533 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3354000e40 con 0x55559b4f7260 2023-10-06T23:27:23.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.950+0000 7f33417fa700 1 -- 172.21.15.8:0/4075057533 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f335401adf0 con 0x55559b4f7260 2023-10-06T23:27:23.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f337375db80 10 client.26911 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:23.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f337375db80 1 -- 172.21.15.8:0/4075057533 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55559b29b250 con 0x55559b4f7260 2023-10-06T23:27:23.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f33417fa700 1 -- 172.21.15.8:0/4075057533 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55559b442b30 con 0x55559b4f7260 2023-10-06T23:27:23.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f33417fa700 1 -- 172.21.15.8:0/4075057533 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f335402c030 con 0x55559b4f7260 2023-10-06T23:27:23.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f337375db80 10 client.26911 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:23.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f337375db80 10 client.26911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:23.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f337375db80 20 client.26911 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:23.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f337375db80 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55559b57b750 0x55559b57db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:23.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.951+0000 7f337375db80 4 client.26911 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:27:23.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.952+0000 7f337375db80 1 -- 172.21.15.8:0/4075057533 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55559b295f70 con 0x55559b57b750 2023-10-06T23:27:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.952+0000 7f335d39a700 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55559b57b750 0x55559b57db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.953+0000 7f33417fa700 10 client.26911 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.953+0000 7f335d39a700 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55559b57b750 0x55559b57db70 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be17525ae1f931 server_cookie=84fc6c221c4efbc8 in_seq=0 out_seq=0 2023-10-06T23:27:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f33417fa700 1 -- 172.21.15.8:0/4075057533 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55559b295f70 con 0x55559b57b750 2023-10-06T23:27:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f33417fa700 10 client.26911 handle_command_reply: tid=0 2023-10-06T23:27:23.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 client.26911 shutdown 2023-10-06T23:27:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 -- 172.21.15.8:0/4075057533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 msgr2=0x55559b5061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b5061a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3354011ce0 tx=0x7f335401a640 comp rx=0 tx=0).stop 2023-10-06T23:27:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 -- 172.21.15.8:0/4075057533 shutdown_connections 2023-10-06T23:27:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55559b57b750 0x55559b57db70 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55559b507680 0x55559b507b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55559b4f7260 0x55559b5061a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f33417fa700 0 client.26911 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:23.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 --2- 172.21.15.8:0/4075057533 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55559b4f8a60 0x55559b5066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 -- 172.21.15.8:0/4075057533 >> 172.21.15.8:0/4075057533 conn(0x55559b46b260 msgr2=0x55559b4ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:23.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 -- 172.21.15.8:0/4075057533 shutdown_connections 2023-10-06T23:27:23.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.954+0000 7f337375db80 1 -- 172.21.15.8:0/4075057533 wait complete. 2023-10-06T23:27:23.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.955+0000 7f337375db80 20 client.26911 trim_cache size 0 max 16384 2023-10-06T23:27:23.961 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:27:23.962 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:27:23.962 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:27:23.962 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:27:23.962 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:27:23.962 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:27:23.962 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:27:23.962 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:27:23.963 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:27:23.963 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:27:23.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.955+0000 7f335fdff700 1 -- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33440a1550 msgr2=0x7f33440a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.955+0000 7f335fdff700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33440a1550 0x7f33440a3a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55559b4f8240 tx=0x7f335000b040 comp rx=0 tx=0).stop 2023-10-06T23:27:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.955+0000 7f335fdff700 1 -- 172.21.15.8:0/2465022302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33581000f0 msgr2=0x7f3358199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.955+0000 7f335fdff700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33581000f0 0x7f3358199270 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3348006fd0 tx=0x7f334800b730 comp rx=0 tx=0).stop 2023-10-06T23:27:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.956+0000 7f335fdff700 1 -- 172.21.15.8:0/2465022302 shutdown_connections 2023-10-06T23:27:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.956+0000 7f335fdff700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f33440a1550 0x7f33440a3a10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.956+0000 7f335fdff700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33580ff790 0x7f3358198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.956+0000 7f335fdff700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3358100ab0 0x7f33581a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.956+0000 7f335fdff700 1 --2- 172.21.15.8:0/2465022302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33581000f0 0x7f3358199270 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:23.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.956+0000 7f335fdff700 1 -- 172.21.15.8:0/2465022302 >> 172.21.15.8:0/2465022302 conn(0x7f33580fb330 msgr2=0x7f33580fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:23.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.956+0000 7f335fdff700 1 -- 172.21.15.8:0/2465022302 shutdown_connections 2023-10-06T23:27:23.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:23.956+0000 7f335fdff700 1 -- 172.21.15.8:0/2465022302 wait complete. 2023-10-06T23:27:23.981 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:27:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 750.0 s, 285.6 tps, lat 349.906 ms stddev 28.211 2023-10-06T23:27:25.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:25 smithi008 ceph-mon[98532]: pgmap v788: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 2.7 MiB/s wr, 303 op/s 2023-10-06T23:27:25.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:25 smithi190 ceph-mon[102658]: pgmap v788: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 2.7 MiB/s wr, 303 op/s 2023-10-06T23:27:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:25 smithi156 ceph-mon[102862]: pgmap v788: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 2.7 MiB/s wr, 303 op/s 2023-10-06T23:27:27.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:27 smithi008 ceph-mon[98532]: pgmap v789: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 3.6 MiB/s wr, 398 op/s 2023-10-06T23:27:27.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:27 smithi190 ceph-mon[102658]: pgmap v789: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 3.6 MiB/s wr, 398 op/s 2023-10-06T23:27:28.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:27 smithi156 ceph-mon[102862]: pgmap v789: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 3.6 MiB/s wr, 398 op/s 2023-10-06T23:27:29.007 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 755.0 s, 285.2 tps, lat 353.189 ms stddev 37.820 2023-10-06T23:27:29.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:29 smithi190 ceph-mon[102658]: pgmap v790: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 3.1 MiB/s wr, 379 op/s 2023-10-06T23:27:30.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:29 smithi156 ceph-mon[102862]: pgmap v790: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 3.1 MiB/s wr, 379 op/s 2023-10-06T23:27:30.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:29 smithi008 ceph-mon[98532]: pgmap v790: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 3.1 MiB/s wr, 379 op/s 2023-10-06T23:27:31.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:31 smithi190 ceph-mon[102658]: pgmap v791: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2023-10-06T23:27:32.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:31 smithi156 ceph-mon[102862]: pgmap v791: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2023-10-06T23:27:32.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:31 smithi008 ceph-mon[98532]: pgmap v791: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2023-10-06T23:27:33.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:33 smithi156 ceph-mon[102862]: pgmap v792: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.5 MiB/s wr, 520 op/s 2023-10-06T23:27:33.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:33 smithi008 ceph-mon[98532]: pgmap v792: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.5 MiB/s wr, 520 op/s 2023-10-06T23:27:33.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:33 smithi190 ceph-mon[102658]: pgmap v792: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.5 MiB/s wr, 520 op/s 2023-10-06T23:27:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 760.0 s, 265.6 tps, lat 374.529 ms stddev 43.232 2023-10-06T23:27:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.895+0000 7f773f3ff700 1 -- 172.21.15.8:0/793897877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 msgr2=0x7f7738103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.895+0000 7f773f3ff700 1 --2- 172.21.15.8:0/793897877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 0x7f7738103dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f77340098f0 tx=0x7f7734009c00 comp rx=0 tx=0).stop 2023-10-06T23:27:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.895+0000 7f773f3ff700 1 -- 172.21.15.8:0/793897877 shutdown_connections 2023-10-06T23:27:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.895+0000 7f773f3ff700 1 --2- 172.21.15.8:0/793897877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7738106c30 0x7f7738109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.895+0000 7f773f3ff700 1 --2- 172.21.15.8:0/793897877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 0x7f7738103dc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.897 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.895+0000 7f773f3ff700 1 --2- 172.21.15.8:0/793897877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7738104300 0x7f77381066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.895+0000 7f773f3ff700 1 -- 172.21.15.8:0/793897877 >> 172.21.15.8:0/793897877 conn(0x7f77380fb340 msgr2=0x7f77380fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.895+0000 7f773f3ff700 1 -- 172.21.15.8:0/793897877 shutdown_connections 2023-10-06T23:27:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.896+0000 7f773f3ff700 1 -- 172.21.15.8:0/793897877 wait complete. 2023-10-06T23:27:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.897+0000 7f773f3ff700 1 Processor -- start 2023-10-06T23:27:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.897+0000 7f773f3ff700 1 -- start start 2023-10-06T23:27:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.898+0000 7f773f3ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 0x7f77380ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.898+0000 7f773f3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7738104300 0x7f77380ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.898+0000 7f773f3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7738106c30 0x7f7738100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.898+0000 7f773f3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7738101520 con 0x7f7738106c30 2023-10-06T23:27:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.898+0000 7f773f3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7738101690 con 0x7f7738104300 2023-10-06T23:27:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.898+0000 7f773f3ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7738101850 con 0x7f77381019d0 2023-10-06T23:27:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.899+0000 7f773d99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7738106c30 0x7f7738100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.899+0000 7f773c99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7738104300 0x7f77380ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.899+0000 7f773d99c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7738106c30 0x7f7738100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35982/0 (socket says 172.21.15.8:35982) 2023-10-06T23:27:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.899+0000 7f773d99c700 1 -- 172.21.15.8:0/3450804208 learned_addr learned my addr 172.21.15.8:0/3450804208 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.899+0000 7f773c99a700 1 -- 172.21.15.8:0/3450804208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 msgr2=0x7f77380ff980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.899+0000 7f773d19b700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 0x7f77380ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.900+0000 7f773c99a700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 0x7f77380ff980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.900+0000 7f773c99a700 1 -- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7738106c30 msgr2=0x7f7738100400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.900+0000 7f773c99a700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7738106c30 0x7f7738100400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.900+0000 7f773c99a700 1 -- 172.21.15.8:0/3450804208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734009520 con 0x7f7738104300 2023-10-06T23:27:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.900+0000 7f773d99c700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7738106c30 0x7f7738100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:27:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.900+0000 7f773d19b700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 0x7f77380ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:27:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.900+0000 7f773c99a700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7738104300 0x7f77380ffec0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f772800e9c0 tx=0x7f772800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:34.902 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.901+0000 7f772e7fc700 1 -- 172.21.15.8:0/3450804208 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800c9c0 con 0x7f7738104300 2023-10-06T23:27:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.901+0000 7f772e7fc700 1 -- 172.21.15.8:0/3450804208 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7728010430 con 0x7f7738104300 2023-10-06T23:27:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.901+0000 7f772e7fc700 1 -- 172.21.15.8:0/3450804208 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7728018680 con 0x7f7738104300 2023-10-06T23:27:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.901+0000 7f773f3ff700 1 -- 172.21.15.8:0/3450804208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773819acf0 con 0x7f7738104300 2023-10-06T23:27:34.903 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.902+0000 7f773f3ff700 1 -- 172.21.15.8:0/3450804208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773819b1b0 con 0x7f7738104300 2023-10-06T23:27:34.908 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.907+0000 7f772e7fc700 1 -- 172.21.15.8:0/3450804208 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f77280105a0 con 0x7f7738104300 2023-10-06T23:27:34.910 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.909+0000 7f7752c6bb80 1 Processor -- start 2023-10-06T23:27:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f7752c6bb80 1 -- start start 2023-10-06T23:27:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f772e7fc700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77240a1650 0x7f77240a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f772e7fc700 1 -- 172.21.15.8:0/3450804208 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7728014070 con 0x7f7738104300 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4dda2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4ddb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4d42400 con 0x55d7e4dd9ec0 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4d33bc0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4d314e0 con 0x55d7e4ddb990 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.910+0000 7f773d99c700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77240a1650 0x7f77240a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.911+0000 7f773d99c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.911+0000 7f773d99c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:50918/0 (socket says 172.21.15.8:50918) 2023-10-06T23:27:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.911+0000 7f773d99c700 1 -- 172.21.15.8:0/2521007977 learned_addr learned my addr 172.21.15.8:0/2521007977 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.911+0000 7f773c99a700 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4ddb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.912+0000 7f773d99c700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77240a1650 0x7f77240a3b10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7730009550 tx=0x7f7730007cc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.912+0000 7f773d99c700 1 -- 172.21.15.8:0/2521007977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 msgr2=0x55d7e4ddb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.912+0000 7f773d99c700 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4ddb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.912+0000 7f773d99c700 1 -- 172.21.15.8:0/2521007977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 msgr2=0x55d7e4dda2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.912+0000 7f773d99c700 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4dda2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.912+0000 7f773d99c700 1 -- 172.21.15.8:0/2521007977 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7e4b57d80 con 0x55d7e4ddb990 2023-10-06T23:27:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.912+0000 7f773c99a700 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4ddb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:27:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.913+0000 7f773d99c700 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de2220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f773000e7d0 tx=0x7f773001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c23225c1cbda2c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.913+0000 7f77237fe700 1 -- 172.21.15.8:0/2521007977 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773001abe0 con 0x55d7e4ddb990 2023-10-06T23:27:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.913+0000 7f77237fe700 1 -- 172.21.15.8:0/2521007977 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f773000f040 con 0x55d7e4ddb990 2023-10-06T23:27:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.913+0000 7f77237fe700 1 -- 172.21.15.8:0/2521007977 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730024dd0 con 0x55d7e4ddb990 2023-10-06T23:27:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.914+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2521007977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 msgr2=0x55d7e4de2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.914+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de2220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f773000e7d0 tx=0x7f773001f000 comp rx=0 tx=0).stop 2023-10-06T23:27:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.915+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2521007977 shutdown_connections 2023-10-06T23:27:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.915+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4dda2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.915+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de2220 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.915+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2521007977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4ddb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.915+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2521007977 >> 172.21.15.8:0/2521007977 conn(0x55d7e4d4e200 msgr2=0x55d7e4dd4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.915+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2521007977 shutdown_connections 2023-10-06T23:27:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.915+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2521007977 wait complete. 2023-10-06T23:27:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.916+0000 7f7752c6bb80 1 -- start start 2023-10-06T23:27:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.916+0000 7f7752c6bb80 1 Processor -- start 2023-10-06T23:27:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.917+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4df4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.917+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.917+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.917+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4d2cdd0 con 0x55d7e4dd9ec0 2023-10-06T23:27:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.917+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4cc96b0 con 0x55d7e4ddb990 2023-10-06T23:27:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.917+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4cc9350 con 0x55d7e4ddafd0 2023-10-06T23:27:34.919 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.917+0000 7f7752c6bb80 10 client.0 _ll_register_callbacks cb 0x55d7e4b267a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773c99a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773c99a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:50922/0 (socket says 172.21.15.8:50922) 2023-10-06T23:27:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773c99a700 1 -- 172.21.15.8:0/2493831310 learned_addr learned my addr 172.21.15.8:0/2493831310 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773d99c700 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.920 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773d19b700 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4df4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773c99a700 1 -- 172.21.15.8:0/2493831310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddb990 msgr2=0x55d7e4dfc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773c99a700 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773c99a700 1 -- 172.21.15.8:0/2493831310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 msgr2=0x55d7e4df4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773c99a700 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4df4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.918+0000 7f773c99a700 1 -- 172.21.15.8:0/2493831310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773819b1b0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.919+0000 7f773c99a700 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df5080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7728099cf0 tx=0x7f772809a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80537a02cf92db65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.919+0000 7f7720ff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.919+0000 7f7720ff9700 1 -- 172.21.15.8:0/2493831310 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280a20f0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.921 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.919+0000 7f7720ff9700 1 -- 172.21.15.8:0/2493831310 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f772809e140 con 0x55d7e4ddafd0 2023-10-06T23:27:34.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.919+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2493831310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7e4dccd50 con 0x55d7e4ddafd0 2023-10-06T23:27:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.919+0000 7f7720ff9700 1 -- 172.21.15.8:0/2493831310 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77280b82a0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.919+0000 7f7752c6bb80 10 client.26920 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.919+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2493831310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f773000e9e0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f7720ff9700 1 -- 172.21.15.8:0/2493831310 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d7e4dccd50 con 0x55d7e4ddafd0 2023-10-06T23:27:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f7720ff9700 1 -- 172.21.15.8:0/2493831310 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f77280b2ab0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f7752c6bb80 10 client.26920 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f7752c6bb80 10 client.26920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f7752c6bb80 20 client.26920 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d7e4e009b0 0x55d7e4e02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f7752c6bb80 4 client.26920 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:27:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2493831310 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7e4d25db0 con 0x55d7e4e009b0 2023-10-06T23:27:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.920+0000 7f773d19b700 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d7e4e009b0 0x55d7e4e02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.921+0000 7f7720ff9700 10 client.26920 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.922+0000 7f773d19b700 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d7e4e009b0 0x55d7e4e02dd0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4662042d8079cc72 server_cookie=d5eb8356da4ce811 in_seq=0 out_seq=0 2023-10-06T23:27:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.922+0000 7f7720ff9700 1 -- 172.21.15.8:0/2493831310 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d7e4d25db0 con 0x55d7e4e009b0 2023-10-06T23:27:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.922+0000 7f7720ff9700 10 client.26920 handle_command_reply: tid=0 2023-10-06T23:27:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.922+0000 7f7752c6bb80 1 client.26920 shutdown 2023-10-06T23:27:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.923+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2493831310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddafd0 msgr2=0x55d7e4df5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.923+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df5080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7728099cf0 tx=0x7f772809a530 comp rx=0 tx=0).stop 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2493831310 shutdown_connections 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d7e4e009b0 0x55d7e4e02dd0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4df4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/2493831310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df5080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2493831310 >> 172.21.15.8:0/2493831310 conn(0x55d7e4d4e200 msgr2=0x55d7e4dd4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7720ff9700 0 client.26920 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2493831310 shutdown_connections 2023-10-06T23:27:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.924+0000 7f7752c6bb80 1 -- 172.21.15.8:0/2493831310 wait complete. 2023-10-06T23:27:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.925+0000 7f7752c6bb80 20 client.26920 trim_cache size 0 max 16384 2023-10-06T23:27:34.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.950+0000 7f7752c6bb80 1 Processor -- start 2023-10-06T23:27:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.950+0000 7f7752c6bb80 1 -- start start 2023-10-06T23:27:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4e029c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4ddafd0 0x55d7e4dfc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4bad8c0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4df5d30 con 0x55d7e4dd9ec0 2023-10-06T23:27:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4df4040 con 0x55d7e4ddb990 2023-10-06T23:27:34.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f773d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4e029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f773d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4e029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:55212/0 (socket says 172.21.15.8:55212) 2023-10-06T23:27:34.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f773d19b700 1 -- 172.21.15.8:0/388594139 learned_addr learned my addr 172.21.15.8:0/388594139 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:34.955 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.951+0000 7f773d99c700 1 --2- 172.21.15.8:0/388594139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.952+0000 7f773d19b700 1 -- 172.21.15.8:0/388594139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 msgr2=0x55d7e4de1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.952+0000 7f773d19b700 1 --2- 172.21.15.8:0/388594139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.952+0000 7f773d19b700 1 -- 172.21.15.8:0/388594139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4ddafd0 msgr2=0x55d7e4dfc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.952+0000 7f773d19b700 1 --2- 172.21.15.8:0/388594139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4ddafd0 0x55d7e4dfc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.952+0000 7f773d19b700 1 -- 172.21.15.8:0/388594139 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7e4b40c00 con 0x55d7e4dd9ec0 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.952+0000 7f773d19b700 1 --2- 172.21.15.8:0/388594139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4e029c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7738101290 tx=0x7f7734005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3843501f3576049e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.952+0000 7f7723fff700 1 -- 172.21.15.8:0/388594139 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773401d040 con 0x55d7e4dd9ec0 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.952+0000 7f7723fff700 1 -- 172.21.15.8:0/388594139 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f773400fba0 con 0x55d7e4dd9ec0 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.953+0000 7f7723fff700 1 -- 172.21.15.8:0/388594139 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400b560 con 0x55d7e4dd9ec0 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.953+0000 7f7752c6bb80 1 -- 172.21.15.8:0/388594139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4dd9ec0 msgr2=0x55d7e4e029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.953+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/388594139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4e029c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7738101290 tx=0x7f7734005de0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.953+0000 7f7752c6bb80 1 -- 172.21.15.8:0/388594139 shutdown_connections 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.953+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/388594139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4de1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.953+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/388594139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4e029c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.953+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/388594139 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4ddafd0 0x55d7e4dfc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.954+0000 7f7752c6bb80 1 -- 172.21.15.8:0/388594139 >> 172.21.15.8:0/388594139 conn(0x55d7e4d4e200 msgr2=0x55d7e4df3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.954+0000 7f7752c6bb80 1 -- 172.21.15.8:0/388594139 shutdown_connections 2023-10-06T23:27:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.954+0000 7f7752c6bb80 1 -- 172.21.15.8:0/388594139 wait complete. 2023-10-06T23:27:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.954+0000 7f7752c6bb80 1 -- start start 2023-10-06T23:27:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.955+0000 7f7752c6bb80 1 Processor -- start 2023-10-06T23:27:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4df9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f7752c6bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4dfb2c0 con 0x55d7e4dd9ec0 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4dfb430 con 0x55d7e4ddafd0 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f7752c6bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7e4dfb5f0 con 0x55d7e4ddb990 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f7752c6bb80 10 client.0 _ll_register_callbacks cb 0x7f7728099950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f773c99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f773d99c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f773d19b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4df9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f773d99c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:50950/0 (socket says 172.21.15.8:50950) 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.956+0000 7f773d99c700 1 -- 172.21.15.8:0/147241357 learned_addr learned my addr 172.21.15.8:0/147241357 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.957+0000 7f773c99a700 1 -- 172.21.15.8:0/147241357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 msgr2=0x55d7e4dfad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.957+0000 7f773c99a700 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.957+0000 7f773c99a700 1 -- 172.21.15.8:0/147241357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 msgr2=0x55d7e4df9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.957+0000 7f773c99a700 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4df9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.957+0000 7f773c99a700 1 -- 172.21.15.8:0/147241357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7738109c30 con 0x55d7e4ddafd0 2023-10-06T23:27:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.958+0000 7f773c99a700 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df9d70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f77280964f0 tx=0x7f77280a21a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775d929e63154000 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.958+0000 7f7720ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:27:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.958+0000 7f7720ff9700 1 -- 172.21.15.8:0/147241357 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7728099dc0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.958+0000 7f7752c6bb80 1 -- 172.21.15.8:0/147241357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f773000f040 con 0x55d7e4ddafd0 2023-10-06T23:27:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.958+0000 7f7720ff9700 1 -- 172.21.15.8:0/147241357 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77280b82a0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.958+0000 7f7720ff9700 1 -- 172.21.15.8:0/147241357 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f772809e140 con 0x55d7e4ddafd0 2023-10-06T23:27:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.958+0000 7f7752c6bb80 10 client.26924 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.958+0000 7f7752c6bb80 1 -- 172.21.15.8:0/147241357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d7e4b7e1f0 con 0x55d7e4ddafd0 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f7720ff9700 1 -- 172.21.15.8:0/147241357 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f772807c020 con 0x55d7e4ddafd0 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f7720ff9700 1 -- 172.21.15.8:0/147241357 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7728099070 con 0x55d7e4ddafd0 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f7752c6bb80 10 client.26924 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f7752c6bb80 10 client.26924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f7752c6bb80 20 client.26924 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d7e4e54fd0 0x55d7e4e573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f7752c6bb80 4 client.26924 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f7752c6bb80 1 -- 172.21.15.8:0/147241357 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d7e4d25ad0 con 0x55d7e4e54fd0 2023-10-06T23:27:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.959+0000 7f773d19b700 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d7e4e54fd0 0x55d7e4e573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.960+0000 7f7720ff9700 10 client.26924 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.960+0000 7f773d19b700 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d7e4e54fd0 0x55d7e4e573c0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca379dace9c98ec server_cookie=d94bc31094bb43a6 in_seq=0 out_seq=0 2023-10-06T23:27:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.978+0000 7f7720ff9700 1 -- 172.21.15.8:0/147241357 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d7e4d25ad0 con 0x55d7e4e54fd0 2023-10-06T23:27:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.978+0000 7f7720ff9700 10 client.26924 handle_command_reply: tid=0 2023-10-06T23:27:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.978+0000 7f7752c6bb80 1 client.26924 shutdown 2023-10-06T23:27:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 -- 172.21.15.8:0/147241357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 msgr2=0x55d7e4df9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df9d70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f77280964f0 tx=0x7f77280a21a0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 -- 172.21.15.8:0/147241357 shutdown_connections 2023-10-06T23:27:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55d7e4e54fd0 0x55d7e4e573c0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d7e4dd9ec0 0x55d7e4df9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7e4ddb990 0x55d7e4dfad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7720ff9700 0 client.26924 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 --2- 172.21.15.8:0/147241357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7e4ddafd0 0x55d7e4df9d70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 -- 172.21.15.8:0/147241357 >> 172.21.15.8:0/147241357 conn(0x55d7e4d4e200 msgr2=0x55d7e4e029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:34.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 -- 172.21.15.8:0/147241357 shutdown_connections 2023-10-06T23:27:34.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 1 -- 172.21.15.8:0/147241357 wait complete. 2023-10-06T23:27:34.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.979+0000 7f7752c6bb80 20 client.26924 trim_cache size 0 max 16384 2023-10-06T23:27:34.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:27:34.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:27:34.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:27:34.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:27:34.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 -- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77240a1650 msgr2=0x7f77240a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77240a1650 0x7f77240a3b10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7730009550 tx=0x7f7730007cc0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 -- 172.21.15.8:0/3450804208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7738104300 msgr2=0x7f77380ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7738104300 0x7f77380ffec0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f772800e9c0 tx=0x7f772800ecd0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 -- 172.21.15.8:0/3450804208 shutdown_connections 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f77240a1650 0x7f77240a3b10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7738106c30 0x7f7738100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77381019d0 0x7f77380ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 --2- 172.21.15.8:0/3450804208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7738104300 0x7f77380ffec0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 -- 172.21.15.8:0/3450804208 >> 172.21.15.8:0/3450804208 conn(0x7f77380fb340 msgr2=0x7f7738102640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.980+0000 7f773f3ff700 1 -- 172.21.15.8:0/3450804208 shutdown_connections 2023-10-06T23:27:34.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:34.981+0000 7f773f3ff700 1 -- 172.21.15.8:0/3450804208 wait complete. 2023-10-06T23:27:35.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:35 smithi190 ceph-mon[102658]: pgmap v793: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 4.7 MiB/s wr, 545 op/s 2023-10-06T23:27:36.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:35 smithi156 ceph-mon[102862]: pgmap v793: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 4.7 MiB/s wr, 545 op/s 2023-10-06T23:27:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:35 smithi008 ceph-mon[98532]: pgmap v793: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 4.7 MiB/s wr, 545 op/s 2023-10-06T23:27:37.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:37 smithi190 ceph-mon[102658]: pgmap v794: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.6 MiB/s wr, 625 op/s 2023-10-06T23:27:38.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:37 smithi156 ceph-mon[102862]: pgmap v794: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.6 MiB/s wr, 625 op/s 2023-10-06T23:27:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:37 smithi008 ceph-mon[98532]: pgmap v794: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.6 MiB/s wr, 625 op/s 2023-10-06T23:27:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 765.0 s, 285.2 tps, lat 350.557 ms stddev 56.921 2023-10-06T23:27:39.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:39 smithi190 ceph-mon[102658]: pgmap v795: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 4.6 MiB/s wr, 543 op/s 2023-10-06T23:27:40.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:39 smithi156 ceph-mon[102862]: pgmap v795: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 4.6 MiB/s wr, 543 op/s 2023-10-06T23:27:40.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:39 smithi008 ceph-mon[98532]: pgmap v795: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 4.6 MiB/s wr, 543 op/s 2023-10-06T23:27:41.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:41 smithi190 ceph-mon[102658]: pgmap v796: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.9 MiB/s wr, 653 op/s 2023-10-06T23:27:42.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:41 smithi156 ceph-mon[102862]: pgmap v796: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.9 MiB/s wr, 653 op/s 2023-10-06T23:27:42.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:41 smithi008 ceph-mon[98532]: pgmap v796: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.9 MiB/s wr, 653 op/s 2023-10-06T23:27:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:43 smithi156 ceph-mon[102862]: pgmap v797: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2023-10-06T23:27:43.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:43 smithi008 ceph-mon[98532]: pgmap v797: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2023-10-06T23:27:43.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:43 smithi190 ceph-mon[102658]: pgmap v797: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 5.0 MiB/s wr, 573 op/s 2023-10-06T23:27:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 770.0 s, 274.6 tps, lat 364.414 ms stddev 39.108 2023-10-06T23:27:45.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:45 smithi190 ceph-mon[102658]: pgmap v798: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 4.4 MiB/s wr, 524 op/s 2023-10-06T23:27:46.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:45 smithi156 ceph-mon[102862]: pgmap v798: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 4.4 MiB/s wr, 524 op/s 2023-10-06T23:27:46.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:45 smithi008 ceph-mon[98532]: pgmap v798: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 4.4 MiB/s wr, 524 op/s 2023-10-06T23:27:47.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:47 smithi190 ceph-mon[102658]: pgmap v799: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 4.9 MiB/s wr, 571 op/s 2023-10-06T23:27:48.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:47 smithi156 ceph-mon[102862]: pgmap v799: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 4.9 MiB/s wr, 571 op/s 2023-10-06T23:27:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:47 smithi008 ceph-mon[98532]: pgmap v799: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 4.9 MiB/s wr, 571 op/s 2023-10-06T23:27:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.265+0000 7f6e967ff700 1 -- 172.21.15.8:0/3186360964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e9010d4d0 msgr2=0x7f6e9010f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.265+0000 7f6e967ff700 1 --2- 172.21.15.8:0/3186360964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e9010d4d0 0x7f6e9010f8c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800b0a0 tx=0x7f6e8800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.266+0000 7f6e967ff700 1 -- 172.21.15.8:0/3186360964 shutdown_connections 2023-10-06T23:27:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.266+0000 7f6e967ff700 1 --2- 172.21.15.8:0/3186360964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e9010d4d0 0x7f6e9010f8c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.266+0000 7f6e967ff700 1 --2- 172.21.15.8:0/3186360964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e90074ef0 0x7f6e90073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.266+0000 7f6e967ff700 1 --2- 172.21.15.8:0/3186360964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e90073910 0x7f6e90073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.266+0000 7f6e967ff700 1 -- 172.21.15.8:0/3186360964 >> 172.21.15.8:0/3186360964 conn(0x7f6e900fc430 msgr2=0x7f6e900fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.266+0000 7f6e967ff700 1 -- 172.21.15.8:0/3186360964 shutdown_connections 2023-10-06T23:27:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.266+0000 7f6e967ff700 1 -- 172.21.15.8:0/3186360964 wait complete. 2023-10-06T23:27:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.267+0000 7f6e967ff700 1 Processor -- start 2023-10-06T23:27:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.268+0000 7f6e967ff700 1 -- start start 2023-10-06T23:27:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.268+0000 7f6e967ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e90073910 0x7f6e9019d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.268+0000 7f6e967ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e90074ef0 0x7f6e9019d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.268+0000 7f6e967ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e9010d4d0 0x7f6e9019e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.268+0000 7f6e967ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9019ede0 con 0x7f6e90073910 2023-10-06T23:27:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.268+0000 7f6e967ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9019ef50 con 0x7f6e90074ef0 2023-10-06T23:27:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.268+0000 7f6e967ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9019f110 con 0x7f6e9010d4d0 2023-10-06T23:27:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.269+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e90074ef0 0x7f6e9019d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.269+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e90074ef0 0x7f6e9019d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:39230/0 (socket says 172.21.15.8:39230) 2023-10-06T23:27:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.269+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1071201002 learned_addr learned my addr 172.21.15.8:0/1071201002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.269+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e90073910 0x7f6e9019d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.269+0000 7f6e94d9c700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e9010d4d0 0x7f6e9019e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1071201002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e9010d4d0 msgr2=0x7f6e9019e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e9010d4d0 0x7f6e9019e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e90073910 msgr2=0x7f6e9019d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e90073910 0x7f6e9019d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1071201002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88009d00 con 0x7f6e90074ef0 2023-10-06T23:27:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e90074ef0 0x7f6e9019d900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000d980 tx=0x7f6e8000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8dffb700 1 -- 172.21.15.8:0/1071201002 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80004020 con 0x7f6e90074ef0 2023-10-06T23:27:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8dffb700 1 -- 172.21.15.8:0/1071201002 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e8000f690 con 0x7f6e90074ef0 2023-10-06T23:27:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.270+0000 7f6e8dffb700 1 -- 172.21.15.8:0/1071201002 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800039e0 con 0x7f6e90074ef0 2023-10-06T23:27:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.271+0000 7f6e967ff700 1 -- 172.21.15.8:0/1071201002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9019f3f0 con 0x7f6e90074ef0 2023-10-06T23:27:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.271+0000 7f6e967ff700 1 -- 172.21.15.8:0/1071201002 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e901a5bb0 con 0x7f6e90074ef0 2023-10-06T23:27:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.278+0000 7f6e8dffb700 1 -- 172.21.15.8:0/1071201002 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6e8000f800 con 0x7f6e90074ef0 2023-10-06T23:27:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.278+0000 7f6eaa130b80 1 Processor -- start 2023-10-06T23:27:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.280+0000 7f6eaa130b80 1 -- start start 2023-10-06T23:27:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.280+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd6082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.280+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd609450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.280+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd610220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.280+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd570400 con 0x55cedd607ec0 2023-10-06T23:27:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.280+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd561bc0 con 0x55cedd608fd0 2023-10-06T23:27:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.281+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd55f4e0 con 0x55cedd609990 2023-10-06T23:27:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.281+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd610220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.281+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd610220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55560/0 (socket says 172.21.15.8:55560) 2023-10-06T23:27:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.281+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1101265392 learned_addr learned my addr 172.21.15.8:0/1101265392 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.281+0000 7f6e94d9c700 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd6082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.282+0000 7f6e87fff700 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd609450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.282+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1101265392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 msgr2=0x55cedd609450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.282+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd609450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.282+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1101265392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 msgr2=0x55cedd6082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.282+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd6082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.282+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1101265392 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cedd385d80 con 0x55cedd609990 2023-10-06T23:27:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.282+0000 7f6e8dffb700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6e700a1500 0x7f6e700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.283+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd610220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6e800d2a90 tx=0x7f6e800d2da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca9d57e41578743a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.283+0000 7f6e8dffb700 1 -- 172.21.15.8:0/1071201002 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e800cc890 con 0x7f6e90074ef0 2023-10-06T23:27:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.283+0000 7f6e867fc700 1 -- 172.21.15.8:0/1101265392 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800d26d0 con 0x55cedd609990 2023-10-06T23:27:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.283+0000 7f6e867fc700 1 -- 172.21.15.8:0/1101265392 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e80095ea0 con 0x55cedd609990 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.283+0000 7f6e867fc700 1 -- 172.21.15.8:0/1101265392 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800994c0 con 0x55cedd609990 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.283+0000 7f6e94d9c700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6e700a1500 0x7f6e700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.284+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1101265392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 msgr2=0x55cedd610220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.284+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd610220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6e800d2a90 tx=0x7f6e800d2da0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.285+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1101265392 shutdown_connections 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.285+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd6082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.285+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd610220 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.285+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1101265392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd609450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.285+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1101265392 >> 172.21.15.8:0/1101265392 conn(0x55cedd57c200 msgr2=0x55cedd602bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.285+0000 7f6e94d9c700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6e700a1500 0x7f6e700a39c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800b830 tx=0x7f6e88006210 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.285+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1101265392 shutdown_connections 2023-10-06T23:27:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.285+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1101265392 wait complete. 2023-10-06T23:27:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.286+0000 7f6eaa130b80 1 -- start start 2023-10-06T23:27:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.287+0000 7f6eaa130b80 1 Processor -- start 2023-10-06T23:27:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.288+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd611be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.288+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd612120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.288+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd619160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.288+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd55add0 con 0x55cedd607ec0 2023-10-06T23:27:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.288+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd4f76b0 con 0x55cedd608fd0 2023-10-06T23:27:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.288+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd4f7350 con 0x55cedd609990 2023-10-06T23:27:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.288+0000 7f6eaa130b80 10 client.0 _ll_register_callbacks cb 0x55cedd3547a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.289+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd612120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.289+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd612120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:39258/0 (socket says 172.21.15.8:39258) 2023-10-06T23:27:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.289+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1741110250 learned_addr learned my addr 172.21.15.8:0/1741110250 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.289+0000 7f6e87fff700 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd611be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.290+0000 7f6e94d9c700 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd619160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.290+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1741110250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 msgr2=0x55cedd619160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:48.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.290+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd619160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.290+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1741110250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 msgr2=0x55cedd611be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.290+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd611be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.290+0000 7f6e8ffff700 1 -- 172.21.15.8:0/1741110250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e901a5bb0 con 0x55cedd608fd0 2023-10-06T23:27:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.290+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd612120 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6e80099aa0 tx=0x7f6e8000ffa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f9c5cf266c3ba25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.290+0000 7f6e7f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:27:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.291+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/1741110250 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800994c0 con 0x55cedd608fd0 2023-10-06T23:27:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.291+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/1741110250 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e80084030 con 0x55cedd608fd0 2023-10-06T23:27:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.291+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1741110250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cedd5fad50 con 0x55cedd608fd0 2023-10-06T23:27:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.291+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/1741110250 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e8000fb00 con 0x55cedd608fd0 2023-10-06T23:27:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.291+0000 7f6eaa130b80 10 client.26933 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.291+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1741110250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55cedd36ec00 con 0x55cedd608fd0 2023-10-06T23:27:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.292+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/1741110250 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cedd5fad50 con 0x55cedd608fd0 2023-10-06T23:27:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.292+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/1741110250 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e80003b40 con 0x55cedd608fd0 2023-10-06T23:27:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.292+0000 7f6eaa130b80 10 client.26933 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:48.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.292+0000 7f6eaa130b80 10 client.26933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:48.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.292+0000 7f6eaa130b80 20 client.26933 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:48.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.292+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cedd62e720 0x55cedd630b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.292+0000 7f6eaa130b80 4 client.26933 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:27:48.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.292+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1741110250 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cedd553db0 con 0x55cedd62e720 2023-10-06T23:27:48.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.293+0000 7f6e87fff700 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cedd62e720 0x55cedd630b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.294+0000 7f6e87fff700 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cedd62e720 0x55cedd630b40 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3534fa98fd8d751a server_cookie=d9f149c5789e45 in_seq=0 out_seq=0 2023-10-06T23:27:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.294+0000 7f6e7f7fe700 10 client.26933 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.295+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/1741110250 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cedd553db0 con 0x55cedd62e720 2023-10-06T23:27:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.295+0000 7f6e7f7fe700 10 client.26933 handle_command_reply: tid=0 2023-10-06T23:27:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.296+0000 7f6eaa130b80 1 client.26933 shutdown 2023-10-06T23:27:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.297+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1741110250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 msgr2=0x55cedd612120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.297+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd612120 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6e80099aa0 tx=0x7f6e8000ffa0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.297+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1741110250 shutdown_connections 2023-10-06T23:27:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.297+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cedd62e720 0x55cedd630b40 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.297+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd611be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.297+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd619160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.297+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/1741110250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd612120 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.297+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1741110250 >> 172.21.15.8:0/1741110250 conn(0x55cedd57c200 msgr2=0x55cedd602250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.298+0000 7f6e7f7fe700 0 client.26933 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.298+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1741110250 shutdown_connections 2023-10-06T23:27:48.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.298+0000 7f6eaa130b80 1 -- 172.21.15.8:0/1741110250 wait complete. 2023-10-06T23:27:48.304 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.299+0000 7f6eaa130b80 20 client.26933 trim_cache size 0 max 16384 2023-10-06T23:27:48.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.324+0000 7f6eaa130b80 1 Processor -- start 2023-10-06T23:27:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.324+0000 7f6eaa130b80 1 -- start start 2023-10-06T23:27:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.324+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd611290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.324+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd608fd0 0x55cedd619120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd609990 0x55cedd602b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd3db8c0 con 0x55cedd607ec0 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd5ff860 con 0x55cedd609990 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd6029a0 con 0x55cedd608fd0 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd611290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd608fd0 0x55cedd619120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd608fd0 0x55cedd619120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:55574/0 (socket says 172.21.15.8:55574) 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e8ffff700 1 -- 172.21.15.8:0/3972523371 learned_addr learned my addr 172.21.15.8:0/3972523371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e94d9c700 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd609990 0x55cedd602b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e8ffff700 1 -- 172.21.15.8:0/3972523371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd609990 msgr2=0x55cedd602b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd609990 0x55cedd602b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e8ffff700 1 -- 172.21.15.8:0/3972523371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 msgr2=0x55cedd611290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd611290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e8ffff700 1 -- 172.21.15.8:0/3972523371 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9010d340 con 0x55cedd608fd0 2023-10-06T23:27:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.325+0000 7f6e94d9c700 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd609990 0x55cedd602b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:27:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.326+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd608fd0 0x55cedd619120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e80099860 tx=0x7f6e80098110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f2959804afd561 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.326+0000 7f6e86ffd700 1 -- 172.21.15.8:0/3972523371 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80099930 con 0x55cedd608fd0 2023-10-06T23:27:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.326+0000 7f6e86ffd700 1 -- 172.21.15.8:0/3972523371 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e8009ae90 con 0x55cedd608fd0 2023-10-06T23:27:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.326+0000 7f6e86ffd700 1 -- 172.21.15.8:0/3972523371 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8009dcb0 con 0x55cedd608fd0 2023-10-06T23:27:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3972523371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd608fd0 msgr2=0x55cedd619120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd608fd0 0x55cedd619120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e80099860 tx=0x7f6e80098110 comp rx=0 tx=0).stop 2023-10-06T23:27:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3972523371 shutdown_connections 2023-10-06T23:27:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd611290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd609990 0x55cedd602b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3972523371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd608fd0 0x55cedd619120 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3972523371 >> 172.21.15.8:0/3972523371 conn(0x55cedd57c200 msgr2=0x55cedd602250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3972523371 shutdown_connections 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.327+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3972523371 wait complete. 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.328+0000 7f6eaa130b80 1 -- start start 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.328+0000 7f6eaa130b80 1 Processor -- start 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd616a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd616fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6eaa130b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd617f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd6184a0 con 0x55cedd607ec0 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd618610 con 0x55cedd608fd0 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6eaa130b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedd6187d0 con 0x55cedd609990 2023-10-06T23:27:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6eaa130b80 10 client.0 _ll_register_callbacks cb 0x7f6e88009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd616fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd616a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd616a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:59156/0 (socket says 172.21.15.8:59156) 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6e87fff700 1 -- 172.21.15.8:0/3397468090 learned_addr learned my addr 172.21.15.8:0/3397468090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.329+0000 7f6e94d9c700 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd617f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.330+0000 7f6e87fff700 1 -- 172.21.15.8:0/3397468090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 msgr2=0x55cedd617f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.330+0000 7f6e87fff700 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd617f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.330+0000 7f6e87fff700 1 -- 172.21.15.8:0/3397468090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 msgr2=0x55cedd616fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.330+0000 7f6e87fff700 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd616fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.330+0000 7f6e87fff700 1 -- 172.21.15.8:0/3397468090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cedd36ec00 con 0x55cedd607ec0 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.330+0000 7f6e87fff700 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd616a70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55cedd6313b0 tx=0x7f6e78009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3340dc1a0161a563 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.330+0000 7f6e7f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.331+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/3397468090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7801c9a0 con 0x55cedd607ec0 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.331+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3397468090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e80095ea0 con 0x55cedd607ec0 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.331+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/3397468090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6e7801cb00 con 0x55cedd607ec0 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/3397468090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e7802b030 con 0x55cedd607ec0 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6eaa130b80 10 client.17025 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3397468090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55cedd3ac1f0 con 0x55cedd607ec0 2023-10-06T23:27:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/3397468090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e80095ea0 con 0x55cedd607ec0 2023-10-06T23:27:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/3397468090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e78016430 con 0x55cedd607ec0 2023-10-06T23:27:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6eaa130b80 10 client.17025 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6eaa130b80 10 client.17025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6eaa130b80 20 client.17025 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.332+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cedd683120 0x55cedd685540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.333+0000 7f6eaa130b80 4 client.17025 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.333+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3397468090 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cedd553ad0 con 0x55cedd683120 2023-10-06T23:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.333+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cedd683120 0x55cedd685540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.334+0000 7f6e8ffff700 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cedd683120 0x55cedd685540 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=727b598f367e0fa8 server_cookie=2365ed6de3f651c2 in_seq=0 out_seq=0 2023-10-06T23:27:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.334+0000 7f6e7f7fe700 10 client.17025 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:48.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6e7f7fe700 1 -- 172.21.15.8:0/3397468090 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cedd553ad0 con 0x55cedd683120 2023-10-06T23:27:48.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6e7f7fe700 10 client.17025 handle_command_reply: tid=0 2023-10-06T23:27:48.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 client.17025 shutdown 2023-10-06T23:27:48.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3397468090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 msgr2=0x55cedd616a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd616a70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55cedd6313b0 tx=0x7f6e78009df0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3397468090 shutdown_connections 2023-10-06T23:27:48.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55cedd683120 0x55cedd685540 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cedd607ec0 0x55cedd616a70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cedd609990 0x55cedd617f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 --2- 172.21.15.8:0/3397468090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cedd608fd0 0x55cedd616fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3397468090 >> 172.21.15.8:0/3397468090 conn(0x55cedd57c200 msgr2=0x55cedd602b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6e7f7fe700 0 client.17025 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.352+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3397468090 shutdown_connections 2023-10-06T23:27:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.353+0000 7f6eaa130b80 1 -- 172.21.15.8:0/3397468090 wait complete. 2023-10-06T23:27:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.353+0000 7f6eaa130b80 20 client.17025 trim_cache size 0 max 16384 2023-10-06T23:27:48.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:27:48.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:27:48.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:27:48.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 -- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6e700a1500 msgr2=0x7f6e700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6e700a1500 0x7f6e700a39c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800b830 tx=0x7f6e88006210 comp rx=0 tx=0).stop 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 -- 172.21.15.8:0/1071201002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e90074ef0 msgr2=0x7f6e9019d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e90074ef0 0x7f6e9019d900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000d980 tx=0x7f6e8000dc90 comp rx=0 tx=0).stop 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 -- 172.21.15.8:0/1071201002 shutdown_connections 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f6e700a1500 0x7f6e700a39c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e90073910 0x7f6e9019d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e9010d4d0 0x7f6e9019e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:48.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 --2- 172.21.15.8:0/1071201002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e90074ef0 0x7f6e9019d900 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000d980 tx=0x7f6e8000dc90 comp rx=0 tx=0).stop 2023-10-06T23:27:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.354+0000 7f6e967ff700 1 -- 172.21.15.8:0/1071201002 >> 172.21.15.8:0/1071201002 conn(0x7f6e900fc430 msgr2=0x7f6e900fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.355+0000 7f6e967ff700 1 -- 172.21.15.8:0/1071201002 shutdown_connections 2023-10-06T23:27:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:27:48.355+0000 7f6e967ff700 1 -- 172.21.15.8:0/1071201002 wait complete. 2023-10-06T23:27:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 775.0 s, 259.4 tps, lat 384.418 ms stddev 49.925 2023-10-06T23:27:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:49 smithi190 ceph-mon[102658]: pgmap v800: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 4.6 MiB/s wr, 538 op/s 2023-10-06T23:27:50.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:49 smithi156 ceph-mon[102862]: pgmap v800: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 4.6 MiB/s wr, 538 op/s 2023-10-06T23:27:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:49 smithi008 ceph-mon[98532]: pgmap v800: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 4.6 MiB/s wr, 538 op/s 2023-10-06T23:27:51.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:51 smithi190 ceph-mon[102658]: pgmap v801: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 5.5 MiB/s wr, 616 op/s 2023-10-06T23:27:52.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:51 smithi156 ceph-mon[102862]: pgmap v801: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 5.5 MiB/s wr, 616 op/s 2023-10-06T23:27:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:51 smithi008 ceph-mon[98532]: pgmap v801: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 5.5 MiB/s wr, 616 op/s 2023-10-06T23:27:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:53 smithi156 ceph-mon[102862]: pgmap v802: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 4.2 MiB/s wr, 505 op/s 2023-10-06T23:27:53.859 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:53 smithi008 ceph-mon[98532]: pgmap v802: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 4.2 MiB/s wr, 505 op/s 2023-10-06T23:27:53.945 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:53 smithi190 ceph-mon[102658]: pgmap v802: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 4.2 MiB/s wr, 505 op/s 2023-10-06T23:27:53.982 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:27:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 780.0 s, 279.6 tps, lat 358.853 ms stddev 56.550 2023-10-06T23:27:54.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.303+0000 7f39c79ff700 1 -- 172.21.15.8:0/2860735226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c01019a0 msgr2=0x7f39c0103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.303+0000 7f39c79ff700 1 --2- 172.21.15.8:0/2860735226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c01019a0 0x7f39c0103d90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0098f0 tx=0x7f39bc009c00 comp rx=0 tx=0).stop 2023-10-06T23:27:54.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.303+0000 7f39c79ff700 1 -- 172.21.15.8:0/2860735226 shutdown_connections 2023-10-06T23:27:54.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.303+0000 7f39c79ff700 1 --2- 172.21.15.8:0/2860735226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c0106c00 0x7f39c0109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.303+0000 7f39c79ff700 1 --2- 172.21.15.8:0/2860735226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c01019a0 0x7f39c0103d90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.303+0000 7f39c79ff700 1 --2- 172.21.15.8:0/2860735226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c01042d0 0x7f39c01066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.303+0000 7f39c79ff700 1 -- 172.21.15.8:0/2860735226 >> 172.21.15.8:0/2860735226 conn(0x7f39c00fb330 msgr2=0x7f39c00fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:54.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.304+0000 7f39c79ff700 1 -- 172.21.15.8:0/2860735226 shutdown_connections 2023-10-06T23:27:54.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.304+0000 7f39c79ff700 1 -- 172.21.15.8:0/2860735226 wait complete. 2023-10-06T23:27:54.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.305+0000 7f39c79ff700 1 Processor -- start 2023-10-06T23:27:54.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.305+0000 7f39c79ff700 1 -- start start 2023-10-06T23:27:54.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.306+0000 7f39c79ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c01019a0 0x7f39c0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.306+0000 7f39c79ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c01042d0 0x7f39c0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.306+0000 7f39c79ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c0106c00 0x7f39c01a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.306+0000 7f39c79ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a0890 con 0x7f39c01042d0 2023-10-06T23:27:54.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.306+0000 7f39c79ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a0a00 con 0x7f39c01019a0 2023-10-06T23:27:54.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.306+0000 7f39c79ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01a0bc0 con 0x7f39c0106c00 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c5f9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c0106c00 0x7f39c01a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c579b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c01019a0 0x7f39c0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c5f9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c0106c00 0x7f39c01a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:51994/0 (socket says 172.21.15.8:51994) 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c5f9c700 1 -- 172.21.15.8:0/713370471 learned_addr learned my addr 172.21.15.8:0/713370471 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c01042d0 0x7f39c0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c5f9c700 1 -- 172.21.15.8:0/713370471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c01019a0 msgr2=0x7f39c0198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c5f9c700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c01019a0 0x7f39c0198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c5f9c700 1 -- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c01042d0 msgr2=0x7f39c0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c5f9c700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c01042d0 0x7f39c0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.307+0000 7f39c5f9c700 1 -- 172.21.15.8:0/713370471 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc009520 con 0x7f39c0106c00 2023-10-06T23:27:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.308+0000 7f39c5f9c700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c0106c00 0x7f39c01a02c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f39b800ef30 tx=0x7f39b800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.308+0000 7f39b67fc700 1 -- 172.21.15.8:0/713370471 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8018070 con 0x7f39c0106c00 2023-10-06T23:27:54.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.308+0000 7f39c79ff700 1 -- 172.21.15.8:0/713370471 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c01a0e40 con 0x7f39c0106c00 2023-10-06T23:27:54.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.308+0000 7f39b67fc700 1 -- 172.21.15.8:0/713370471 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b800f040 con 0x7f39c0106c00 2023-10-06T23:27:54.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.308+0000 7f39c79ff700 1 -- 172.21.15.8:0/713370471 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c01a1260 con 0x7f39c0106c00 2023-10-06T23:27:54.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.308+0000 7f39b67fc700 1 -- 172.21.15.8:0/713370471 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8007760 con 0x7f39c0106c00 2023-10-06T23:27:54.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.313+0000 7f39b67fc700 1 -- 172.21.15.8:0/713370471 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f39b800c930 con 0x7f39c0106c00 2023-10-06T23:27:54.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.314+0000 7f39db3e2b80 1 Processor -- start 2023-10-06T23:27:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.314+0000 7f39db3e2b80 1 -- start start 2023-10-06T23:27:54.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5e9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ea480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 0x563c2a5eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a551460 con 0x563c2a5e9260 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a542c20 con 0x563c2a5eaa60 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a540540 con 0x563c2a5e9bc0 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39c4f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39c4f9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5e9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52610/0 (socket says 172.21.15.8:52610) 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39c4f9a700 1 -- 172.21.15.8:0/4269591072 learned_addr learned my addr 172.21.15.8:0/4269591072 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39c579b700 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.315+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 0x563c2a5eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39c4f9a700 1 -- 172.21.15.8:0/4269591072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 msgr2=0x563c2a5ea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:54.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ea480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39c4f9a700 1 -- 172.21.15.8:0/4269591072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 msgr2=0x563c2a5eaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 0x563c2a5eaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39c4f9a700 1 -- 172.21.15.8:0/4269591072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2a366de0 con 0x563c2a5e9260 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39c579b700 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39b67fc700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f39ac0a1480 0x7f39ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5e9680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f39b0005d10 tx=0x7f39b0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb1e1414fb262d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.316+0000 7f39b67fc700 1 -- 172.21.15.8:0/713370471 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f39b80cc8e0 con 0x7f39c0106c00 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.317+0000 7f39c579b700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f39ac0a1480 0x7f39ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.317+0000 7f39ab7fe700 1 -- 172.21.15.8:0/4269591072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0018070 con 0x563c2a5e9260 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.317+0000 7f39ab7fe700 1 -- 172.21.15.8:0/4269591072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b0013e30 con 0x563c2a5e9260 2023-10-06T23:27:54.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.317+0000 7f39ab7fe700 1 -- 172.21.15.8:0/4269591072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0005680 con 0x563c2a5e9260 2023-10-06T23:27:54.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 -- 172.21.15.8:0/4269591072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 msgr2=0x563c2a5e9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39c579b700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f39ac0a1480 0x7f39ac0a3940 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0098c0 tx=0x7f39bc019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:54.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5e9680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f39b0005d10 tx=0x7f39b0009310 comp rx=0 tx=0).stop 2023-10-06T23:27:54.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 -- 172.21.15.8:0/4269591072 shutdown_connections 2023-10-06T23:27:54.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5e9680 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 0x563c2a5eaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/4269591072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 -- 172.21.15.8:0/4269591072 >> 172.21.15.8:0/4269591072 conn(0x563c2a55d260 msgr2=0x563c2a5e4140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:54.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 -- 172.21.15.8:0/4269591072 shutdown_connections 2023-10-06T23:27:54.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.318+0000 7f39db3e2b80 1 -- 172.21.15.8:0/4269591072 wait complete. 2023-10-06T23:27:54.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.319+0000 7f39db3e2b80 1 -- start start 2023-10-06T23:27:54.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.320+0000 7f39db3e2b80 1 Processor -- start 2023-10-06T23:27:54.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.320+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9260 0x563c2a5fb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.320+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9bc0 0x563c2a5fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.320+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 0x563c2a602d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.320+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a53be30 con 0x563c2a5e9bc0 2023-10-06T23:27:54.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.320+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a4d8710 con 0x563c2a5e9260 2023-10-06T23:27:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.320+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a4d83b0 con 0x563c2a5eaa60 2023-10-06T23:27:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39db3e2b80 10 client.0 _ll_register_callbacks cb 0x563c2a335800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c579b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9260 0x563c2a5fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c579b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9260 0x563c2a5fb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:55200/0 (socket says 172.21.15.8:55200) 2023-10-06T23:27:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c579b700 1 -- 172.21.15.8:0/1191326726 learned_addr learned my addr 172.21.15.8:0/1191326726 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9bc0 0x563c2a5fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c5f9c700 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 0x563c2a602d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c579b700 1 -- 172.21.15.8:0/1191326726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 msgr2=0x563c2a602d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:54.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c579b700 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 0x563c2a602d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c579b700 1 -- 172.21.15.8:0/1191326726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9bc0 msgr2=0x563c2a5fbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c579b700 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9bc0 0x563c2a5fbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.321+0000 7f39c579b700 1 -- 172.21.15.8:0/1191326726 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c0109c00 con 0x563c2a5e9260 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.322+0000 7f39c579b700 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9260 0x563c2a5fb800 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0098f0 tx=0x7f39bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b81df0788ad0530 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.322+0000 7f39a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.322+0000 7f39a8ff9700 1 -- 172.21.15.8:0/1191326726 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc02b070 con 0x563c2a5e9260 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.322+0000 7f39a8ff9700 1 -- 172.21.15.8:0/1191326726 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f39bc005250 con 0x563c2a5e9260 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.322+0000 7f39db3e2b80 1 -- 172.21.15.8:0/1191326726 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c2a5dbf10 con 0x563c2a5e9260 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39a8ff9700 1 -- 172.21.15.8:0/1191326726 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39bc005410 con 0x563c2a5e9260 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39db3e2b80 10 client.26951 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39db3e2b80 1 -- 172.21.15.8:0/1191326726 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f39b0013460 con 0x563c2a5e9260 2023-10-06T23:27:54.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39a8ff9700 1 -- 172.21.15.8:0/1191326726 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563c2a5dbf10 con 0x563c2a5e9260 2023-10-06T23:27:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39a8ff9700 1 -- 172.21.15.8:0/1191326726 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f39bc024420 con 0x563c2a5e9260 2023-10-06T23:27:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39db3e2b80 10 client.26951 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39db3e2b80 10 client.26951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39db3e2b80 20 client.26951 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563c2a6076c0 0x563c2a609ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39db3e2b80 4 client.26951 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:27:54.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.323+0000 7f39db3e2b80 1 -- 172.21.15.8:0/1191326726 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c2a534e10 con 0x563c2a6076c0 2023-10-06T23:27:54.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.324+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563c2a6076c0 0x563c2a609ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.325+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563c2a6076c0 0x563c2a609ae0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44e67f355dba3197 server_cookie=41a93e4195c8cd62 in_seq=0 out_seq=0 2023-10-06T23:27:54.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.325+0000 7f39a8ff9700 10 client.26951 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39a8ff9700 1 -- 172.21.15.8:0/1191326726 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563c2a534e10 con 0x563c2a6076c0 2023-10-06T23:27:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39a8ff9700 10 client.26951 handle_command_reply: tid=0 2023-10-06T23:27:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 client.26951 shutdown 2023-10-06T23:27:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 -- 172.21.15.8:0/1191326726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9260 msgr2=0x563c2a5fb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9260 0x563c2a5fb800 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0098f0 tx=0x7f39bc009c00 comp rx=0 tx=0).stop 2023-10-06T23:27:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 -- 172.21.15.8:0/1191326726 shutdown_connections 2023-10-06T23:27:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563c2a6076c0 0x563c2a609ae0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 0x563c2a602d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9260 0x563c2a5fb800 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/1191326726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9bc0 0x563c2a5fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39a8ff9700 0 client.26951 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:54.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.326+0000 7f39db3e2b80 1 -- 172.21.15.8:0/1191326726 >> 172.21.15.8:0/1191326726 conn(0x563c2a55d260 msgr2=0x563c2a5e3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:54.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.327+0000 7f39db3e2b80 1 -- 172.21.15.8:0/1191326726 shutdown_connections 2023-10-06T23:27:54.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.327+0000 7f39db3e2b80 1 -- 172.21.15.8:0/1191326726 wait complete. 2023-10-06T23:27:54.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.327+0000 7f39db3e2b80 20 client.26951 trim_cache size 0 max 16384 2023-10-06T23:27:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.355+0000 7f39db3e2b80 1 Processor -- start 2023-10-06T23:27:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.355+0000 7f39db3e2b80 1 -- start start 2023-10-06T23:27:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.355+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.355+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9bc0 0x563c2a5f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.355+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 0x563c2a602d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.355+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a3bc920 con 0x563c2a5e9260 2023-10-06T23:27:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.355+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a5f1b20 con 0x563c2a5e9bc0 2023-10-06T23:27:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.355+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a5ea180 con 0x563c2a5eaa60 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c579b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c579b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52624/0 (socket says 172.21.15.8:52624) 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c579b700 1 -- 172.21.15.8:0/702496726 learned_addr learned my addr 172.21.15.8:0/702496726 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c5f9c700 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 0x563c2a602d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9bc0 0x563c2a5f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c4f9a700 1 -- 172.21.15.8:0/702496726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 msgr2=0x563c2a602d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 0x563c2a602d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c4f9a700 1 -- 172.21.15.8:0/702496726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 msgr2=0x563c2a5f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.356+0000 7f39c4f9a700 1 -- 172.21.15.8:0/702496726 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2a34fc60 con 0x563c2a5e9bc0 2023-10-06T23:27:54.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.357+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9bc0 0x563c2a5f12b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x563c2a60a3f0 tx=0x7f39b00131b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac85558e197f319 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:54.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.357+0000 7f39abfff700 1 -- 172.21.15.8:0/702496726 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0018040 con 0x563c2a5e9bc0 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.357+0000 7f39abfff700 1 -- 172.21.15.8:0/702496726 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b0025040 con 0x563c2a5e9bc0 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.357+0000 7f39abfff700 1 -- 172.21.15.8:0/702496726 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0003680 con 0x563c2a5e9bc0 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 -- 172.21.15.8:0/702496726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9bc0 msgr2=0x563c2a5f12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9bc0 0x563c2a5f12b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x563c2a60a3f0 tx=0x7f39b00131b0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 -- 172.21.15.8:0/702496726 shutdown_connections 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5eaa60 0x563c2a602d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/702496726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5e9bc0 0x563c2a5f12b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 -- 172.21.15.8:0/702496726 >> 172.21.15.8:0/702496726 conn(0x563c2a55d260 msgr2=0x563c2a5fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 -- 172.21.15.8:0/702496726 shutdown_connections 2023-10-06T23:27:54.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.358+0000 7f39db3e2b80 1 -- 172.21.15.8:0/702496726 wait complete. 2023-10-06T23:27:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.359+0000 7f39db3e2b80 1 -- start start 2023-10-06T23:27:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.359+0000 7f39db3e2b80 1 Processor -- start 2023-10-06T23:27:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5fee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39db3e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 0x563c2a6023c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a602900 con 0x563c2a5e9260 2023-10-06T23:27:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a602a70 con 0x563c2a5eaa60 2023-10-06T23:27:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39db3e2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2a602c30 con 0x563c2a5e9bc0 2023-10-06T23:27:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39db3e2b80 10 client.0 _ll_register_callbacks cb 0x7f39bc00b560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:27:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39c4f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39c4f9a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ff3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:52032/0 (socket says 172.21.15.8:52032) 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39c4f9a700 1 -- 172.21.15.8:0/2506793725 learned_addr learned my addr 172.21.15.8:0/2506793725 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39c579b700 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.360+0000 7f39c5f9c700 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 0x563c2a6023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.361+0000 7f39c4f9a700 1 -- 172.21.15.8:0/2506793725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 msgr2=0x563c2a6023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.361+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 0x563c2a6023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.361+0000 7f39c4f9a700 1 -- 172.21.15.8:0/2506793725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 msgr2=0x563c2a5fee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.361+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5fee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.361+0000 7f39c4f9a700 1 -- 172.21.15.8:0/2506793725 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c2a366de0 con 0x563c2a5e9bc0 2023-10-06T23:27:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.361+0000 7f39c579b700 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:27:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.362+0000 7f39c4f9a700 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ff3a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f39b00132c0 tx=0x7f39b0005140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56c6da9dd75b6b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:27:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.362+0000 7f39a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:27:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.362+0000 7f39a8ff9700 1 -- 172.21.15.8:0/2506793725 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0018040 con 0x563c2a5e9bc0 2023-10-06T23:27:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.362+0000 7f39a8ff9700 1 -- 172.21.15.8:0/2506793725 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f39b002bb80 con 0x563c2a5e9bc0 2023-10-06T23:27:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.362+0000 7f39db3e2b80 1 -- 172.21.15.8:0/2506793725 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39b0013e30 con 0x563c2a5e9bc0 2023-10-06T23:27:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39a8ff9700 1 -- 172.21.15.8:0/2506793725 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b002bd40 con 0x563c2a5e9bc0 2023-10-06T23:27:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39db3e2b80 10 client.26959 fetch_fsmap learned FSMap version 37 2023-10-06T23:27:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39db3e2b80 1 -- 172.21.15.8:0/2506793725 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563c2a38d250 con 0x563c2a5e9bc0 2023-10-06T23:27:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39a8ff9700 1 -- 172.21.15.8:0/2506793725 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39b0013e30 con 0x563c2a5e9bc0 2023-10-06T23:27:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39a8ff9700 1 -- 172.21.15.8:0/2506793725 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f39b001d070 con 0x563c2a5e9bc0 2023-10-06T23:27:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39db3e2b80 10 client.26959 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:27:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39db3e2b80 10 client.26959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:27:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39db3e2b80 20 client.26959 populate_metadata read hostname 'smithi008' 2023-10-06T23:27:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563c2a65c3c0 0x563c2a65e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:27:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39db3e2b80 4 client.26959 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:27:54.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.363+0000 7f39db3e2b80 1 -- 172.21.15.8:0/2506793725 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563c2a534b30 con 0x563c2a65c3c0 2023-10-06T23:27:54.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.364+0000 7f39c579b700 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563c2a65c3c0 0x563c2a65e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:27:54.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.364+0000 7f39c579b700 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563c2a65c3c0 0x563c2a65e7e0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9675b7b3bb0a9be9 server_cookie=8f5ac8c2e4fc2ff5 in_seq=0 out_seq=0 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.364+0000 7f39a8ff9700 10 client.26959 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39a8ff9700 1 -- 172.21.15.8:0/2506793725 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563c2a534b30 con 0x563c2a65c3c0 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39a8ff9700 10 client.26959 handle_command_reply: tid=0 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 client.26959 shutdown 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 -- 172.21.15.8:0/2506793725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 msgr2=0x563c2a5ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ff3a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f39b00132c0 tx=0x7f39b0005140 comp rx=0 tx=0).stop 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 -- 172.21.15.8:0/2506793725 shutdown_connections 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563c2a65c3c0 0x563c2a65e7e0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563c2a5e9260 0x563c2a5fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563c2a5eaa60 0x563c2a6023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 --2- 172.21.15.8:0/2506793725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563c2a5e9bc0 0x563c2a5ff3a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39db3e2b80 1 -- 172.21.15.8:0/2506793725 >> 172.21.15.8:0/2506793725 conn(0x563c2a55d260 msgr2=0x563c2a5ed8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:54.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.365+0000 7f39a8ff9700 0 client.26959 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:27:54.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.366+0000 7f39db3e2b80 1 -- 172.21.15.8:0/2506793725 shutdown_connections 2023-10-06T23:27:54.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.366+0000 7f39db3e2b80 1 -- 172.21.15.8:0/2506793725 wait complete. 2023-10-06T23:27:54.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.366+0000 7f39db3e2b80 20 client.26959 trim_cache size 0 max 16384 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:27:54.369 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:27:54.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 -- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f39ac0a1480 msgr2=0x7f39ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f39ac0a1480 0x7f39ac0a3940 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0098c0 tx=0x7f39bc019040 comp rx=0 tx=0).stop 2023-10-06T23:27:54.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 -- 172.21.15.8:0/713370471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c0106c00 msgr2=0x7f39c01a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:27:54.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c0106c00 0x7f39c01a02c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f39b800ef30 tx=0x7f39b800c3a0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 -- 172.21.15.8:0/713370471 shutdown_connections 2023-10-06T23:27:54.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f39ac0a1480 0x7f39ac0a3940 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c0106c00 0x7f39c01a02c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c01019a0 0x7f39c0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 --2- 172.21.15.8:0/713370471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39c01042d0 0x7f39c0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:27:54.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 -- 172.21.15.8:0/713370471 >> 172.21.15.8:0/713370471 conn(0x7f39c00fb330 msgr2=0x7f39c0102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:27:54.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.367+0000 7f39c79ff700 1 -- 172.21.15.8:0/713370471 shutdown_connections 2023-10-06T23:27:54.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:27:54.368+0000 7f39c79ff700 1 -- 172.21.15.8:0/713370471 wait complete. 2023-10-06T23:27:54.391 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:27:55.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:55 smithi190 ceph-mon[102658]: pgmap v803: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.1 MiB/s wr, 490 op/s 2023-10-06T23:27:56.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:55 smithi156 ceph-mon[102862]: pgmap v803: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.1 MiB/s wr, 490 op/s 2023-10-06T23:27:56.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:55 smithi008 ceph-mon[98532]: pgmap v803: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.1 MiB/s wr, 490 op/s 2023-10-06T23:27:57.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:57 smithi190 ceph-mon[102658]: pgmap v804: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 5.0 MiB/s wr, 567 op/s 2023-10-06T23:27:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:57 smithi156 ceph-mon[102862]: pgmap v804: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 5.0 MiB/s wr, 567 op/s 2023-10-06T23:27:58.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:57 smithi008 ceph-mon[98532]: pgmap v804: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 5.0 MiB/s wr, 567 op/s 2023-10-06T23:27:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 785.0 s, 258.4 tps, lat 386.266 ms stddev 95.415 2023-10-06T23:27:59.948 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:27:59 smithi190 ceph-mon[102658]: pgmap v805: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2023-10-06T23:28:00.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:27:59 smithi156 ceph-mon[102862]: pgmap v805: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2023-10-06T23:28:00.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:27:59 smithi008 ceph-mon[98532]: pgmap v805: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2023-10-06T23:28:01.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.581+0000 7f75411ff700 1 -- 172.21.15.8:0/1846404885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f753c103130 msgr2=0x7f753c103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.581+0000 7f75411ff700 1 --2- 172.21.15.8:0/1846404885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f753c103130 0x7f753c103550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f752c0099c0 tx=0x7f752c009cd0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.581+0000 7f75411ff700 1 -- 172.21.15.8:0/1846404885 shutdown_connections 2023-10-06T23:28:01.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.581+0000 7f75411ff700 1 --2- 172.21.15.8:0/1846404885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753c104cc0 0x7f753c10b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.581+0000 7f75411ff700 1 --2- 172.21.15.8:0/1846404885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f753c103130 0x7f753c103550 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.581+0000 7f75411ff700 1 --2- 172.21.15.8:0/1846404885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753c104320 0x7f753c104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.581+0000 7f75411ff700 1 -- 172.21.15.8:0/1846404885 >> 172.21.15.8:0/1846404885 conn(0x7f753c0fe6a0 msgr2=0x7f753c100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.581+0000 7f75411ff700 1 -- 172.21.15.8:0/1846404885 shutdown_connections 2023-10-06T23:28:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.582+0000 7f75411ff700 1 -- 172.21.15.8:0/1846404885 wait complete. 2023-10-06T23:28:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.583+0000 7f75411ff700 1 Processor -- start 2023-10-06T23:28:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.583+0000 7f75411ff700 1 -- start start 2023-10-06T23:28:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f75411ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f753c103130 0x7f753c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f75411ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753c104320 0x7f753c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f75411ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753c104cc0 0x7f753c070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f75411ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0712a0 con 0x7f753c104cc0 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f75411ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c071410 con 0x7f753c103130 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f75411ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0715d0 con 0x7f753c104320 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f753c103130 0x7f753c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f753a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753c104320 0x7f753c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f753a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753c104320 0x7f753c06fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39732/0 (socket says 172.21.15.8:39732) 2023-10-06T23:28:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.584+0000 7f753a59c700 1 -- 172.21.15.8:0/1024038440 learned_addr learned my addr 172.21.15.8:0/1024038440 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:01.588 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.585+0000 7f753b59e700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753c104cc0 0x7f753c070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.585+0000 7f753a59c700 1 -- 172.21.15.8:0/1024038440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f753c103130 msgr2=0x7f753c06f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.585+0000 7f753a59c700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f753c103130 0x7f753c06f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.585+0000 7f753a59c700 1 -- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753c104cc0 msgr2=0x7f753c070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.585+0000 7f753a59c700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753c104cc0 0x7f753c070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.585+0000 7f753a59c700 1 -- 172.21.15.8:0/1024038440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c0095f0 con 0x7f753c104320 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.586+0000 7f753a59c700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753c104320 0x7f753c06fd70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f753000e9a0 tx=0x7f753000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.586+0000 7f7523fff700 1 -- 172.21.15.8:0/1024038440 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530009790 con 0x7f753c104320 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.586+0000 7f7523fff700 1 -- 172.21.15.8:0/1024038440 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7530010430 con 0x7f753c104320 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.586+0000 7f7523fff700 1 -- 172.21.15.8:0/1024038440 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000cea0 con 0x7f753c104320 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.586+0000 7f75411ff700 1 -- 172.21.15.8:0/1024038440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c0718b0 con 0x7f753c104320 2023-10-06T23:28:01.589 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.586+0000 7f75411ff700 1 -- 172.21.15.8:0/1024038440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c072060 con 0x7f753c104320 2023-10-06T23:28:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.592+0000 7f7523fff700 1 -- 172.21.15.8:0/1024038440 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f75300105a0 con 0x7f753c104320 2023-10-06T23:28:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.592+0000 7f7554aa4b80 1 Processor -- start 2023-10-06T23:28:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.593+0000 7f7554aa4b80 1 -- start start 2023-10-06T23:28:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.593+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf42502e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.593+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4250fd0 0x561cf4251450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.593+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4251990 0x561cf4258220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.593+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf41b8400 con 0x561cf4251990 2023-10-06T23:28:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.593+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf41a9bc0 con 0x561cf424fec0 2023-10-06T23:28:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.593+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf41a74e0 con 0x561cf4250fd0 2023-10-06T23:28:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.594+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4250fd0 0x561cf4251450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.594+0000 7f753b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf42502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.594+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4250fd0 0x561cf4251450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39740/0 (socket says 172.21.15.8:39740) 2023-10-06T23:28:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.594+0000 7f753ad9d700 1 -- 172.21.15.8:0/3668800872 learned_addr learned my addr 172.21.15.8:0/3668800872 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.594+0000 7f753a59c700 1 --2- 172.21.15.8:0/3668800872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4251990 0x561cf4258220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.595+0000 7f7523fff700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75240a1500 0x7f75240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.595+0000 7f753ad9d700 1 -- 172.21.15.8:0/3668800872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 msgr2=0x561cf42502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.595+0000 7f753ad9d700 1 --2- 172.21.15.8:0/3668800872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf42502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.595+0000 7f753ad9d700 1 -- 172.21.15.8:0/3668800872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4251990 msgr2=0x561cf4258220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.595+0000 7f753ad9d700 1 --2- 172.21.15.8:0/3668800872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4251990 0x561cf4258220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.595+0000 7f753ad9d700 1 -- 172.21.15.8:0/3668800872 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cf3fcdd80 con 0x561cf4250fd0 2023-10-06T23:28:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.595+0000 7f7523fff700 1 -- 172.21.15.8:0/1024038440 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7530014070 con 0x7f753c104320 2023-10-06T23:28:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.596+0000 7f753ad9d700 1 --2- 172.21.15.8:0/3668800872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4250fd0 0x561cf4251450 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b580 tx=0x7f752c005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f25be851168272a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.596+0000 7f753b59e700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75240a1500 0x7f75240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.596+0000 7f75217fa700 1 -- 172.21.15.8:0/3668800872 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c00ba10 con 0x561cf4250fd0 2023-10-06T23:28:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.596+0000 7f75217fa700 1 -- 172.21.15.8:0/3668800872 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f752c01e040 con 0x561cf4250fd0 2023-10-06T23:28:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.596+0000 7f75217fa700 1 -- 172.21.15.8:0/3668800872 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c0039c0 con 0x561cf4250fd0 2023-10-06T23:28:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3668800872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4250fd0 msgr2=0x561cf4251450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3668800872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4250fd0 0x561cf4251450 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b580 tx=0x7f752c005bc0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f753b59e700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75240a1500 0x7f75240a39c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x561cf424fc60 tx=0x7f7534004ad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3668800872 shutdown_connections 2023-10-06T23:28:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3668800872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4251990 0x561cf4258220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3668800872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf42502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3668800872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4250fd0 0x561cf4251450 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3668800872 >> 172.21.15.8:0/3668800872 conn(0x561cf41c4200 msgr2=0x561cf424abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3668800872 shutdown_connections 2023-10-06T23:28:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.597+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3668800872 wait complete. 2023-10-06T23:28:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.598+0000 7f7554aa4b80 1 -- start start 2023-10-06T23:28:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.598+0000 7f7554aa4b80 1 Processor -- start 2023-10-06T23:28:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf4259ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf425a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4261040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf41a2dd0 con 0x561cf4250fd0 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf413f6b0 con 0x561cf4251990 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf413f350 con 0x561cf424fec0 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f7554aa4b80 10 client.0 _ll_register_callbacks cb 0x561cf3f9c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf4259ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf4259ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39748/0 (socket says 172.21.15.8:39748) 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.599+0000 7f753ad9d700 1 -- 172.21.15.8:0/812831902 learned_addr learned my addr 172.21.15.8:0/812831902 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753b59e700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4261040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753a59c700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf425a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753ad9d700 1 -- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 msgr2=0x561cf4261040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753ad9d700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4261040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753ad9d700 1 -- 172.21.15.8:0/812831902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 msgr2=0x561cf425a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753ad9d700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf425a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753ad9d700 1 -- 172.21.15.8:0/812831902 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c10bec0 con 0x561cf424fec0 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753a59c700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf425a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.600+0000 7f753b59e700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4261040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.601+0000 7f753ad9d700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf4259ac0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f752c005cd0 tx=0x7f752c0059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83549e6643864dbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.601+0000 7f751eff5700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.601+0000 7f751eff5700 1 -- 172.21.15.8:0/812831902 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c004a30 con 0x561cf424fec0 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.601+0000 7f751eff5700 1 -- 172.21.15.8:0/812831902 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f752c004b90 con 0x561cf424fec0 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.601+0000 7f7554aa4b80 1 -- 172.21.15.8:0/812831902 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cf4242d50 con 0x561cf424fec0 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.601+0000 7f751eff5700 1 -- 172.21.15.8:0/812831902 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f752c03b030 con 0x561cf424fec0 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.601+0000 7f7554aa4b80 10 client.26971 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.601+0000 7f7554aa4b80 1 -- 172.21.15.8:0/812831902 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x561cf3fb6c00 con 0x561cf424fec0 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.602+0000 7f751eff5700 1 -- 172.21.15.8:0/812831902 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561cf4242d50 con 0x561cf424fec0 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.603+0000 7f751eff5700 1 -- 172.21.15.8:0/812831902 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f752c021070 con 0x561cf424fec0 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.603+0000 7f7554aa4b80 10 client.26971 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.603+0000 7f7554aa4b80 10 client.26971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.603+0000 7f7554aa4b80 20 client.26971 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.603+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561cf426dc40 0x561cf4270030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.603+0000 7f7554aa4b80 4 client.26971 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.603+0000 7f7554aa4b80 1 -- 172.21.15.8:0/812831902 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561cf419bdb0 con 0x561cf426dc40 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.603+0000 7f753a59c700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561cf426dc40 0x561cf4270030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.604+0000 7f751eff5700 10 client.26971 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.604+0000 7f753a59c700 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561cf426dc40 0x561cf4270030 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cbfce7e961d1d44 server_cookie=6510da355689e23b in_seq=0 out_seq=0 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f751eff5700 1 -- 172.21.15.8:0/812831902 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561cf419bdb0 con 0x561cf426dc40 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f751eff5700 10 client.26971 handle_command_reply: tid=0 2023-10-06T23:28:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 client.26971 shutdown 2023-10-06T23:28:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 -- 172.21.15.8:0/812831902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 msgr2=0x561cf4259ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf4259ac0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f752c005cd0 tx=0x7f752c0059d0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 -- 172.21.15.8:0/812831902 shutdown_connections 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561cf426dc40 0x561cf4270030 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4261040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf4259ac0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/812831902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf425a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.605+0000 7f7554aa4b80 1 -- 172.21.15.8:0/812831902 >> 172.21.15.8:0/812831902 conn(0x561cf41c4200 msgr2=0x561cf424a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.606+0000 7f751eff5700 0 client.26971 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.606+0000 7f7554aa4b80 1 -- 172.21.15.8:0/812831902 shutdown_connections 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.606+0000 7f7554aa4b80 1 -- 172.21.15.8:0/812831902 wait complete. 2023-10-06T23:28:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.606+0000 7f7554aa4b80 20 client.26971 trim_cache size 0 max 16384 2023-10-06T23:28:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.631+0000 7f7554aa4b80 1 Processor -- start 2023-10-06T23:28:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.631+0000 7f7554aa4b80 1 -- start start 2023-10-06T23:28:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf42513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf4261000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4258860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf40238c0 con 0x561cf4250fd0 2023-10-06T23:28:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf4258f70 con 0x561cf4251990 2023-10-06T23:28:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf424bf50 con 0x561cf424fec0 2023-10-06T23:28:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f753a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf4261000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf42513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f753a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf4261000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54738/0 (socket says 172.21.15.8:54738) 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f753a59c700 1 -- 172.21.15.8:0/1433401832 learned_addr learned my addr 172.21.15.8:0/1433401832 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf42513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39762/0 (socket says 172.21.15.8:39762) 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.632+0000 7f753b59e700 1 --2- 172.21.15.8:0/1433401832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4258860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f753ad9d700 1 -- 172.21.15.8:0/1433401832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 msgr2=0x561cf4258860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f753ad9d700 1 --2- 172.21.15.8:0/1433401832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4258860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f753ad9d700 1 -- 172.21.15.8:0/1433401832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 msgr2=0x561cf4261000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f753ad9d700 1 --2- 172.21.15.8:0/1433401832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf4261000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f753ad9d700 1 -- 172.21.15.8:0/1433401832 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cf3ff41f0 con 0x561cf424fec0 2023-10-06T23:28:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f753ad9d700 1 --2- 172.21.15.8:0/1433401832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf42513b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f752c004770 tx=0x7f752c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c24839412208f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f7521ffb700 1 -- 172.21.15.8:0/1433401832 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c03b030 con 0x561cf424fec0 2023-10-06T23:28:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f7521ffb700 1 -- 172.21.15.8:0/1433401832 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f752c030070 con 0x561cf424fec0 2023-10-06T23:28:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.633+0000 7f7521ffb700 1 -- 172.21.15.8:0/1433401832 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c004c20 con 0x561cf424fec0 2023-10-06T23:28:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.634+0000 7f7554aa4b80 1 -- 172.21.15.8:0/1433401832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 msgr2=0x561cf42513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.634+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/1433401832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf42513b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f752c004770 tx=0x7f752c000bc0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.635+0000 7f7554aa4b80 1 -- 172.21.15.8:0/1433401832 shutdown_connections 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.635+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/1433401832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf4251990 0x561cf4258860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.635+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/1433401832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf424fec0 0x561cf42513b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.635+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/1433401832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf4261000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.635+0000 7f7554aa4b80 1 -- 172.21.15.8:0/1433401832 >> 172.21.15.8:0/1433401832 conn(0x561cf41c4200 msgr2=0x561cf4274990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.635+0000 7f7554aa4b80 1 -- 172.21.15.8:0/1433401832 shutdown_connections 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.635+0000 7f7554aa4b80 1 -- 172.21.15.8:0/1433401832 wait complete. 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.635+0000 7f7554aa4b80 1 -- start start 2023-10-06T23:28:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.636+0000 7f7554aa4b80 1 Processor -- start 2023-10-06T23:28:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.636+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf425e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.636+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf425ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.636+0000 7f7554aa4b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4251990 0x561cf425fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.636+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf4260160 con 0x561cf4250fd0 2023-10-06T23:28:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.636+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf42602d0 con 0x561cf424fec0 2023-10-06T23:28:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.636+0000 7f7554aa4b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf4260490 con 0x561cf4251990 2023-10-06T23:28:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.636+0000 7f7554aa4b80 10 client.0 _ll_register_callbacks cb 0x7f75300d05c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf425e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf425e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:42330/0 (socket says 172.21.15.8:42330) 2023-10-06T23:28:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753ad9d700 1 -- 172.21.15.8:0/3370859901 learned_addr learned my addr 172.21.15.8:0/3370859901 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753b59e700 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4251990 0x561cf425fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753ad9d700 1 -- 172.21.15.8:0/3370859901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4251990 msgr2=0x561cf425fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753ad9d700 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4251990 0x561cf425fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753ad9d700 1 -- 172.21.15.8:0/3370859901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 msgr2=0x561cf425ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753ad9d700 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf425ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.637+0000 7f753ad9d700 1 -- 172.21.15.8:0/3370859901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561cf3fb6c00 con 0x561cf424fec0 2023-10-06T23:28:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.638+0000 7f753ad9d700 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf425e6d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f752c0052e0 tx=0x7f752c005660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3446f9016e258d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.638+0000 7f751eff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:28:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.639+0000 7f751eff5700 1 -- 172.21.15.8:0/3370859901 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c03b040 con 0x561cf424fec0 2023-10-06T23:28:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.639+0000 7f751eff5700 1 -- 172.21.15.8:0/3370859901 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f752c000e40 con 0x561cf424fec0 2023-10-06T23:28:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.639+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3370859901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f752c01e040 con 0x561cf424fec0 2023-10-06T23:28:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.639+0000 7f751eff5700 1 -- 172.21.15.8:0/3370859901 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f752c004e70 con 0x561cf424fec0 2023-10-06T23:28:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.639+0000 7f7554aa4b80 10 client.26975 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.639+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3370859901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x561cf3fcc250 con 0x561cf424fec0 2023-10-06T23:28:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.640+0000 7f751eff5700 1 -- 172.21.15.8:0/3370859901 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f752c01e040 con 0x561cf424fec0 2023-10-06T23:28:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.640+0000 7f751eff5700 1 -- 172.21.15.8:0/3370859901 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f752c0099f0 con 0x561cf424fec0 2023-10-06T23:28:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.640+0000 7f7554aa4b80 10 client.26975 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.640+0000 7f7554aa4b80 10 client.26975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.640+0000 7f7554aa4b80 20 client.26975 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.640+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561cf42c1ef0 0x561cf42c4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.640+0000 7f7554aa4b80 4 client.26975 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:28:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.640+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3370859901 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561cf419bad0 con 0x561cf42c1ef0 2023-10-06T23:28:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.641+0000 7f753a59c700 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561cf42c1ef0 0x561cf42c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:01.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.643+0000 7f751eff5700 10 client.26975 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:01.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.643+0000 7f753a59c700 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561cf42c1ef0 0x561cf42c4310 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e7b413f6205c25e server_cookie=97f06d42f36b45c3 in_seq=0 out_seq=0 2023-10-06T23:28:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.885+0000 7f751eff5700 1 -- 172.21.15.8:0/3370859901 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561cf419bad0 con 0x561cf42c1ef0 2023-10-06T23:28:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.885+0000 7f751eff5700 10 client.26975 handle_command_reply: tid=0 2023-10-06T23:28:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.885+0000 7f7554aa4b80 1 client.26975 shutdown 2023-10-06T23:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3370859901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 msgr2=0x561cf425e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf425e6d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f752c0052e0 tx=0x7f752c005660 comp rx=0 tx=0).stop 2023-10-06T23:28:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3370859901 shutdown_connections 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x561cf42c1ef0 0x561cf42c4310 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561cf4251990 0x561cf425fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f751eff5700 0 client.26975 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561cf424fec0 0x561cf425e6d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 --2- 172.21.15.8:0/3370859901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561cf4250fd0 0x561cf425ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3370859901 >> 172.21.15.8:0/3370859901 conn(0x561cf41c4200 msgr2=0x561cf4257d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3370859901 shutdown_connections 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.886+0000 7f7554aa4b80 1 -- 172.21.15.8:0/3370859901 wait complete. 2023-10-06T23:28:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f7554aa4b80 20 client.26975 trim_cache size 0 max 16384 2023-10-06T23:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:28:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 -- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75240a1500 msgr2=0x7f75240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75240a1500 0x7f75240a39c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x561cf424fc60 tx=0x7f7534004ad0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 -- 172.21.15.8:0/1024038440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753c104320 msgr2=0x7f753c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753c104320 0x7f753c06fd70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f753000e9a0 tx=0x7f753000ecb0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 -- 172.21.15.8:0/1024038440 shutdown_connections 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f75240a1500 0x7f75240a39c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f753c104cc0 0x7f753c070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f753c103130 0x7f753c06f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 --2- 172.21.15.8:0/1024038440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753c104320 0x7f753c06fd70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.887+0000 7f75411ff700 1 -- 172.21.15.8:0/1024038440 >> 172.21.15.8:0/1024038440 conn(0x7f753c0fe6a0 msgr2=0x7f753c107880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.888+0000 7f75411ff700 1 -- 172.21.15.8:0/1024038440 shutdown_connections 2023-10-06T23:28:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:01.888+0000 7f75411ff700 1 -- 172.21.15.8:0/1024038440 wait complete. 2023-10-06T23:28:01.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:01 smithi190 ceph-mon[102658]: pgmap v806: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 4.3 MiB/s wr, 513 op/s 2023-10-06T23:28:02.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:01 smithi156 ceph-mon[102862]: pgmap v806: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 4.3 MiB/s wr, 513 op/s 2023-10-06T23:28:02.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:01 smithi008 ceph-mon[98532]: pgmap v806: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 4.3 MiB/s wr, 513 op/s 2023-10-06T23:28:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:03 smithi156 ceph-mon[102862]: pgmap v807: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 3.9 MiB/s wr, 475 op/s 2023-10-06T23:28:03.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:03 smithi008 ceph-mon[98532]: pgmap v807: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 3.9 MiB/s wr, 475 op/s 2023-10-06T23:28:03.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:03 smithi190 ceph-mon[102658]: pgmap v807: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 3.9 MiB/s wr, 475 op/s 2023-10-06T23:28:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 790.0 s, 262.2 tps, lat 380.441 ms stddev 112.233 2023-10-06T23:28:05.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:05 smithi190 ceph-mon[102658]: pgmap v808: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 3.9 MiB/s wr, 470 op/s 2023-10-06T23:28:06.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:05 smithi156 ceph-mon[102862]: pgmap v808: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 3.9 MiB/s wr, 470 op/s 2023-10-06T23:28:06.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:05 smithi008 ceph-mon[98532]: pgmap v808: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 3.9 MiB/s wr, 470 op/s 2023-10-06T23:28:07.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:07 smithi190 ceph-mon[102658]: pgmap v809: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.7 MiB/s wr, 540 op/s 2023-10-06T23:28:08.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:07 smithi156 ceph-mon[102862]: pgmap v809: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.7 MiB/s wr, 540 op/s 2023-10-06T23:28:08.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:07 smithi008 ceph-mon[98532]: pgmap v809: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.7 MiB/s wr, 540 op/s 2023-10-06T23:28:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 795.0 s, 285.4 tps, lat 351.594 ms stddev 42.137 2023-10-06T23:28:09.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:09 smithi190 ceph-mon[102658]: pgmap v810: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2023-10-06T23:28:10.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:09 smithi156 ceph-mon[102862]: pgmap v810: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2023-10-06T23:28:10.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:09 smithi008 ceph-mon[98532]: pgmap v810: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2023-10-06T23:28:11.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:11 smithi190 ceph-mon[102658]: pgmap v811: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 4.1 MiB/s wr, 489 op/s 2023-10-06T23:28:12.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:11 smithi156 ceph-mon[102862]: pgmap v811: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 4.1 MiB/s wr, 489 op/s 2023-10-06T23:28:12.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:11 smithi008 ceph-mon[98532]: pgmap v811: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 4.1 MiB/s wr, 489 op/s 2023-10-06T23:28:13.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:13 smithi156 ceph-mon[102862]: pgmap v812: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 4.2 MiB/s wr, 490 op/s 2023-10-06T23:28:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:13 smithi008 ceph-mon[98532]: pgmap v812: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 4.2 MiB/s wr, 490 op/s 2023-10-06T23:28:13.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:13 smithi190 ceph-mon[102658]: pgmap v812: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 4.2 MiB/s wr, 490 op/s 2023-10-06T23:28:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 800.0 s, 288.4 tps, lat 346.999 ms stddev 32.935 2023-10-06T23:28:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 -- 172.21.15.8:0/1550075755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2920101100 msgr2=0x7f29201079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 --2- 172.21.15.8:0/1550075755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2920101100 0x7f29201079b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f291800c1b0 tx=0x7f291800c4c0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 -- 172.21.15.8:0/1550075755 shutdown_connections 2023-10-06T23:28:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 --2- 172.21.15.8:0/1550075755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29200ff570 0x7f29200ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 --2- 172.21.15.8:0/1550075755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2920101100 0x7f29201079b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 --2- 172.21.15.8:0/1550075755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2920100760 0x7f2920100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 -- 172.21.15.8:0/1550075755 >> 172.21.15.8:0/1550075755 conn(0x7f29200faac0 msgr2=0x7f29200fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 -- 172.21.15.8:0/1550075755 shutdown_connections 2023-10-06T23:28:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.121+0000 7f2927bff700 1 -- 172.21.15.8:0/1550075755 wait complete. 2023-10-06T23:28:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.123+0000 7f2927bff700 1 Processor -- start 2023-10-06T23:28:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.123+0000 7f2927bff700 1 -- start start 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.123+0000 7f2927bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29200ff570 0x7f2920196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.123+0000 7f2927bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920100760 0x7f29201972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.123+0000 7f2927bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2920101100 0x7f2920198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.123+0000 7f2927bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2920198750 con 0x7f2920100760 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.123+0000 7f2927bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201988c0 con 0x7f2920101100 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.123+0000 7f2927bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2920198a80 con 0x7f29200ff570 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29200ff570 0x7f2920196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29200ff570 0x7f2920196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58504/0 (socket says 172.21.15.8:58504) 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 -- 172.21.15.8:0/3757779536 learned_addr learned my addr 172.21.15.8:0/3757779536 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292619c700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2920101100 0x7f2920198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 -- 172.21.15.8:0/3757779536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2920101100 msgr2=0x7f2920198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2920101100 0x7f2920198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 -- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920100760 msgr2=0x7f29201972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920100760 0x7f29201972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 -- 172.21.15.8:0/3757779536 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29140095f0 con 0x7f29200ff570 2023-10-06T23:28:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.124+0000 7f292599b700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29200ff570 0x7f2920196d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f291000e970 tx=0x7f291000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.125+0000 7f291effd700 1 -- 172.21.15.8:0/3757779536 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910009790 con 0x7f29200ff570 2023-10-06T23:28:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.125+0000 7f291effd700 1 -- 172.21.15.8:0/3757779536 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f291000eec0 con 0x7f29200ff570 2023-10-06T23:28:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.125+0000 7f2927bff700 1 -- 172.21.15.8:0/3757779536 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291800ad50 con 0x7f29200ff570 2023-10-06T23:28:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.125+0000 7f291effd700 1 -- 172.21.15.8:0/3757779536 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910003c10 con 0x7f29200ff570 2023-10-06T23:28:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.125+0000 7f2927bff700 1 -- 172.21.15.8:0/3757779536 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2920101980 con 0x7f29200ff570 2023-10-06T23:28:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.131+0000 7f291effd700 1 -- 172.21.15.8:0/3757779536 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2910003d90 con 0x7f29200ff570 2023-10-06T23:28:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.132+0000 7f293b43bb80 1 Processor -- start 2023-10-06T23:28:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.132+0000 7f293b43bb80 1 -- start start 2023-10-06T23:28:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.132+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.132+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300ba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.132+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.132+0000 7f293b43bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559430021400 con 0x5594300b8ec0 2023-10-06T23:28:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.132+0000 7f293b43bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559430012bc0 con 0x5594300b9fd0 2023-10-06T23:28:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.132+0000 7f293b43bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594300104e0 con 0x5594300ba990 2023-10-06T23:28:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.133+0000 7f292599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.133+0000 7f292619c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.133+0000 7f292519a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.133+0000 7f292599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300ba450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:40410/0 (socket says 172.21.15.8:40410) 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.133+0000 7f292599b700 1 -- 172.21.15.8:0/2103441758 learned_addr learned my addr 172.21.15.8:0/2103441758 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.134+0000 7f292519a700 1 -- 172.21.15.8:0/2103441758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 msgr2=0x5594300ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.134+0000 7f292519a700 1 --2- 172.21.15.8:0/2103441758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300ba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.134+0000 7f292519a700 1 -- 172.21.15.8:0/2103441758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 msgr2=0x5594300b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.134+0000 7f292519a700 1 --2- 172.21.15.8:0/2103441758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.134+0000 7f292519a700 1 -- 172.21.15.8:0/2103441758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942fe36d80 con 0x5594300ba990 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.134+0000 7f292519a700 1 --2- 172.21.15.8:0/2103441758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c1220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2914009e60 tx=0x7f291400e630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae50bcddb45c4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.135+0000 7f2907fff700 1 -- 172.21.15.8:0/2103441758 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400ed30 con 0x5594300ba990 2023-10-06T23:28:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.135+0000 7f2907fff700 1 -- 172.21.15.8:0/2103441758 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f291400ee90 con 0x5594300ba990 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.135+0000 7f2907fff700 1 -- 172.21.15.8:0/2103441758 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140187a0 con 0x5594300ba990 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.135+0000 7f291effd700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29080a59e0 0x7f29080a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.135+0000 7f291effd700 1 -- 172.21.15.8:0/3757779536 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2910014070 con 0x7f29200ff570 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f293b43bb80 1 -- 172.21.15.8:0/2103441758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 msgr2=0x5594300c1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2103441758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c1220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2914009e60 tx=0x7f291400e630 comp rx=0 tx=0).stop 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f292619c700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29080a59e0 0x7f29080a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f293b43bb80 1 -- 172.21.15.8:0/2103441758 shutdown_connections 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2103441758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.141 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2103441758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c1220 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.142 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2103441758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.142 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f293b43bb80 1 -- 172.21.15.8:0/2103441758 >> 172.21.15.8:0/2103441758 conn(0x55943002d200 msgr2=0x5594300b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:15.142 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.136+0000 7f293b43bb80 1 -- 172.21.15.8:0/2103441758 shutdown_connections 2023-10-06T23:28:15.142 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.137+0000 7f293b43bb80 1 -- 172.21.15.8:0/2103441758 wait complete. 2023-10-06T23:28:15.142 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.137+0000 7f292619c700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29080a59e0 0x7f29080a7ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5594300b8c60 tx=0x7f2918005040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:15.143 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.137+0000 7f293b43bb80 1 -- start start 2023-10-06T23:28:15.143 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.138+0000 7f293b43bb80 1 Processor -- start 2023-10-06T23:28:15.143 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.138+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.143 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.138+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.138+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.139+0000 7f293b43bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943000bdd0 con 0x5594300b8ec0 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.139+0000 7f293b43bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942ffa86b0 con 0x5594300b9fd0 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.139+0000 7f293b43bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942ffa8350 con 0x5594300ba990 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.139+0000 7f293b43bb80 10 client.0 _ll_register_callbacks cb 0x55942fe057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.139+0000 7f292619c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.139+0000 7f292619c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300d28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:58522/0 (socket says 172.21.15.8:58522) 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.139+0000 7f292619c700 1 -- 172.21.15.8:0/1585798945 learned_addr learned my addr 172.21.15.8:0/1585798945 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.140+0000 7f292599b700 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.140+0000 7f292519a700 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.144 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.140+0000 7f292619c700 1 -- 172.21.15.8:0/1585798945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 msgr2=0x5594300cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.140+0000 7f292619c700 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.140+0000 7f292619c700 1 -- 172.21.15.8:0/1585798945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 msgr2=0x5594300cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.140+0000 7f292619c700 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.140+0000 7f292619c700 1 -- 172.21.15.8:0/1585798945 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2914009b40 con 0x5594300ba990 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.140+0000 7f292599b700 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.141+0000 7f292619c700 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300d28f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2918008940 tx=0x7f291800c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a36cce6dec8bfe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.141+0000 7f29057fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.141+0000 7f29057fa700 1 -- 172.21.15.8:0/1585798945 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291800f040 con 0x5594300ba990 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.141+0000 7f29057fa700 1 -- 172.21.15.8:0/1585798945 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2918003cd0 con 0x5594300ba990 2023-10-06T23:28:15.145 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.141+0000 7f293b43bb80 1 -- 172.21.15.8:0/1585798945 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594300abd50 con 0x5594300ba990 2023-10-06T23:28:15.146 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.141+0000 7f29057fa700 1 -- 172.21.15.8:0/1585798945 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29180050b0 con 0x5594300ba990 2023-10-06T23:28:15.146 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f293b43bb80 10 client.26989 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f293b43bb80 1 -- 172.21.15.8:0/1585798945 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55942fe1fc00 con 0x5594300ba990 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f29057fa700 1 -- 172.21.15.8:0/1585798945 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5594300abd50 con 0x5594300ba990 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f29057fa700 1 -- 172.21.15.8:0/1585798945 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2918025070 con 0x5594300ba990 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f293b43bb80 10 client.26989 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f293b43bb80 10 client.26989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f293b43bb80 20 client.26989 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f293b43bb80 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5594300c6ad0 0x5594300c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f293b43bb80 4 client.26989 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.142+0000 7f293b43bb80 1 -- 172.21.15.8:0/1585798945 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559430004db0 con 0x5594300c6ad0 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.143+0000 7f292599b700 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5594300c6ad0 0x5594300c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.143+0000 7f292599b700 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5594300c6ad0 0x5594300c8ef0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d36c249773ff83a6 server_cookie=546bd79e9683cc82 in_seq=0 out_seq=0 2023-10-06T23:28:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.143+0000 7f29057fa700 10 client.26989 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.144+0000 7f29057fa700 1 -- 172.21.15.8:0/1585798945 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559430004db0 con 0x5594300c6ad0 2023-10-06T23:28:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.144+0000 7f29057fa700 10 client.26989 handle_command_reply: tid=0 2023-10-06T23:28:15.148 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.144+0000 7f293b43bb80 1 client.26989 shutdown 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.145+0000 7f293b43bb80 1 -- 172.21.15.8:0/1585798945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 msgr2=0x5594300d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.145+0000 7f293b43bb80 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300d28f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2918008940 tx=0x7f291800c4c0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f293b43bb80 1 -- 172.21.15.8:0/1585798945 shutdown_connections 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f293b43bb80 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5594300c6ad0 0x5594300c8ef0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f293b43bb80 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f293b43bb80 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300d28f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f293b43bb80 1 --2- 172.21.15.8:0/1585798945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f293b43bb80 1 -- 172.21.15.8:0/1585798945 >> 172.21.15.8:0/1585798945 conn(0x55943002d200 msgr2=0x5594300b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f29057fa700 0 client.26989 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f293b43bb80 1 -- 172.21.15.8:0/1585798945 shutdown_connections 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.146+0000 7f293b43bb80 1 -- 172.21.15.8:0/1585798945 wait complete. 2023-10-06T23:28:15.149 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.147+0000 7f293b43bb80 20 client.26989 trim_cache size 0 max 16384 2023-10-06T23:28:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.170+0000 7f293b43bb80 1 Processor -- start 2023-10-06T23:28:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.170+0000 7f293b43bb80 1 -- start start 2023-10-06T23:28:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.170+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.170+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.170+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.170+0000 7f293b43bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942fe8c8c0 con 0x5594300b8ec0 2023-10-06T23:28:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.170+0000 7f293b43bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594300ae2c0 con 0x5594300b9fd0 2023-10-06T23:28:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.170+0000 7f293b43bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594300cbff0 con 0x5594300ba990 2023-10-06T23:28:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300d28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:40436/0 (socket says 172.21.15.8:40436) 2023-10-06T23:28:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292519a700 1 -- 172.21.15.8:0/3235082789 learned_addr learned my addr 172.21.15.8:0/3235082789 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292619c700 1 --2- 172.21.15.8:0/3235082789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292599b700 1 -- 172.21.15.8:0/3235082789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 msgr2=0x5594300c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292599b700 1 --2- 172.21.15.8:0/3235082789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292599b700 1 -- 172.21.15.8:0/3235082789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 msgr2=0x5594300d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292599b700 1 --2- 172.21.15.8:0/3235082789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.171+0000 7f292599b700 1 -- 172.21.15.8:0/3235082789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942fe5d1f0 con 0x5594300b8ec0 2023-10-06T23:28:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.172+0000 7f292599b700 1 --2- 172.21.15.8:0/3235082789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300c8ae0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2910000c00 tx=0x7f29100964d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9fd9af689d7f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.172+0000 7f291cbff700 1 -- 172.21.15.8:0/3235082789 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910099af0 con 0x5594300b8ec0 2023-10-06T23:28:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.172+0000 7f291cbff700 1 -- 172.21.15.8:0/3235082789 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f291000ccd0 con 0x5594300b8ec0 2023-10-06T23:28:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.172+0000 7f291cbff700 1 -- 172.21.15.8:0/3235082789 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100a2590 con 0x5594300b8ec0 2023-10-06T23:28:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.173+0000 7f293b43bb80 1 -- 172.21.15.8:0/3235082789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 msgr2=0x5594300c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.173+0000 7f293b43bb80 1 --2- 172.21.15.8:0/3235082789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300c8ae0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2910000c00 tx=0x7f29100964d0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.173+0000 7f293b43bb80 1 -- 172.21.15.8:0/3235082789 shutdown_connections 2023-10-06T23:28:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.173+0000 7f293b43bb80 1 --2- 172.21.15.8:0/3235082789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300c8ae0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.173+0000 7f293b43bb80 1 --2- 172.21.15.8:0/3235082789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300ba990 0x5594300c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.173+0000 7f293b43bb80 1 --2- 172.21.15.8:0/3235082789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300b9fd0 0x5594300d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.173+0000 7f293b43bb80 1 -- 172.21.15.8:0/3235082789 >> 172.21.15.8:0/3235082789 conn(0x55943002d200 msgr2=0x5594300b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.174+0000 7f293b43bb80 1 -- 172.21.15.8:0/3235082789 shutdown_connections 2023-10-06T23:28:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.174+0000 7f293b43bb80 1 -- 172.21.15.8:0/3235082789 wait complete. 2023-10-06T23:28:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.174+0000 7f293b43bb80 1 -- start start 2023-10-06T23:28:15.177 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.174+0000 7f293b43bb80 1 Processor -- start 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300b9fd0 0x5594300d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f293b43bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300ba990 0x5594300ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f293b43bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594300cf040 con 0x5594300b8ec0 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f293b43bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594300cf180 con 0x5594300ba990 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f293b43bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594300cf340 con 0x5594300b9fd0 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f293b43bb80 10 client.0 _ll_register_callbacks cb 0x7f2918008bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f292599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f292599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300d2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52970/0 (socket says 172.21.15.8:52970) 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f292599b700 1 -- 172.21.15.8:0/2191005716 learned_addr learned my addr 172.21.15.8:0/2191005716 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:15.178 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.175+0000 7f292519a700 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300b9fd0 0x5594300d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f292619c700 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300ba990 0x5594300ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f292519a700 1 -- 172.21.15.8:0/2191005716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300ba990 msgr2=0x5594300ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f292519a700 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300ba990 0x5594300ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f292519a700 1 -- 172.21.15.8:0/2191005716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 msgr2=0x5594300d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f292519a700 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300d2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.179 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f292519a700 1 -- 172.21.15.8:0/2191005716 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2920101980 con 0x5594300b9fd0 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f292599b700 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f292519a700 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300b9fd0 0x5594300d25a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2914009b10 tx=0x7f29140043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d6964d60f7664 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.176+0000 7f29057fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f29057fa700 1 -- 172.21.15.8:0/2191005716 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914004830 con 0x5594300b9fd0 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 1 -- 172.21.15.8:0/2191005716 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f291400ee90 con 0x5594300b9fd0 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f29057fa700 1 -- 172.21.15.8:0/2191005716 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2914014070 con 0x5594300b9fd0 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f29057fa700 1 -- 172.21.15.8:0/2191005716 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2914004990 con 0x5594300b9fd0 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 10 client.26995 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 1 -- 172.21.15.8:0/2191005716 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55942fe35250 con 0x5594300b9fd0 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f29057fa700 1 -- 172.21.15.8:0/2191005716 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f291400ee90 con 0x5594300b9fd0 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f29057fa700 1 -- 172.21.15.8:0/2191005716 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2914020070 con 0x5594300b9fd0 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 10 client.26995 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 10 client.26995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 20 client.26995 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5594301343a0 0x5594301367c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 4 client.26995 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.177+0000 7f293b43bb80 1 -- 172.21.15.8:0/2191005716 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559430004ad0 con 0x5594301343a0 2023-10-06T23:28:15.181 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.178+0000 7f292599b700 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5594301343a0 0x5594301367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.179+0000 7f29057fa700 10 client.26995 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:15.182 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.179+0000 7f292599b700 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5594301343a0 0x5594301367c0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=141f633c60dafb48 server_cookie=8a99cfdac5d53e5f in_seq=0 out_seq=0 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f29057fa700 1 -- 172.21.15.8:0/2191005716 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559430004ad0 con 0x5594301343a0 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f29057fa700 10 client.26995 handle_command_reply: tid=0 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 client.26995 shutdown 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 -- 172.21.15.8:0/2191005716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300b9fd0 msgr2=0x5594300d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300b9fd0 0x5594300d25a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2914009b10 tx=0x7f29140043b0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 -- 172.21.15.8:0/2191005716 shutdown_connections 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5594301343a0 0x5594301367c0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5594300b8ec0 0x5594300d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594300ba990 0x5594300ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 --2- 172.21.15.8:0/2191005716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594300b9fd0 0x5594300d25a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f293b43bb80 1 -- 172.21.15.8:0/2191005716 >> 172.21.15.8:0/2191005716 conn(0x55943002d200 msgr2=0x5594300c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.198+0000 7f29057fa700 0 client.26995 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.199+0000 7f293b43bb80 1 -- 172.21.15.8:0/2191005716 shutdown_connections 2023-10-06T23:28:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.199+0000 7f293b43bb80 1 -- 172.21.15.8:0/2191005716 wait complete. 2023-10-06T23:28:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.199+0000 7f293b43bb80 20 client.26995 trim_cache size 0 max 16384 2023-10-06T23:28:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:28:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:28:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:28:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 -- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29080a59e0 msgr2=0x7f29080a7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29080a59e0 0x7f29080a7ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5594300b8c60 tx=0x7f2918005040 comp rx=0 tx=0).stop 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 -- 172.21.15.8:0/3757779536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29200ff570 msgr2=0x7f2920196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29200ff570 0x7f2920196d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f291000e970 tx=0x7f291000ec80 comp rx=0 tx=0).stop 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 -- 172.21.15.8:0/3757779536 shutdown_connections 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f29080a59e0 0x7f29080a7ea0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2920101100 0x7f2920198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29200ff570 0x7f2920196d60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 --2- 172.21.15.8:0/3757779536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920100760 0x7f29201972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 -- 172.21.15.8:0/3757779536 >> 172.21.15.8:0/3757779536 conn(0x7f29200faac0 msgr2=0x7f2920105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 -- 172.21.15.8:0/3757779536 shutdown_connections 2023-10-06T23:28:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:15.200+0000 7f2927bff700 1 -- 172.21.15.8:0/3757779536 wait complete. 2023-10-06T23:28:15.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:15 smithi190 ceph-mon[102658]: pgmap v813: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.4 MiB/s wr, 509 op/s 2023-10-06T23:28:16.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:15 smithi156 ceph-mon[102862]: pgmap v813: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.4 MiB/s wr, 509 op/s 2023-10-06T23:28:16.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:15 smithi008 ceph-mon[98532]: pgmap v813: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 4.4 MiB/s wr, 509 op/s 2023-10-06T23:28:17.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:17 smithi190 ceph-mon[102658]: pgmap v814: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 5.2 MiB/s wr, 584 op/s 2023-10-06T23:28:18.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:17 smithi156 ceph-mon[102862]: pgmap v814: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 5.2 MiB/s wr, 584 op/s 2023-10-06T23:28:18.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:17 smithi008 ceph-mon[98532]: pgmap v814: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 5.2 MiB/s wr, 584 op/s 2023-10-06T23:28:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 805.0 s, 260.6 tps, lat 382.663 ms stddev 59.885 2023-10-06T23:28:19.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:19 smithi190 ceph-mon[102658]: pgmap v815: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.3 MiB/s wr, 509 op/s 2023-10-06T23:28:20.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:19 smithi156 ceph-mon[102862]: pgmap v815: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.3 MiB/s wr, 509 op/s 2023-10-06T23:28:20.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:19 smithi008 ceph-mon[98532]: pgmap v815: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 4.3 MiB/s wr, 509 op/s 2023-10-06T23:28:21.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:21 smithi190 ceph-mon[102658]: pgmap v816: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-10-06T23:28:22.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:21 smithi156 ceph-mon[102862]: pgmap v816: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-10-06T23:28:22.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:21 smithi008 ceph-mon[98532]: pgmap v816: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 4.0 MiB/s wr, 494 op/s 2023-10-06T23:28:23.851 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:23 smithi156 ceph-mon[102862]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 3.9 MiB/s wr, 478 op/s 2023-10-06T23:28:23.851 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:23 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:28:23.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:23 smithi008 ceph-mon[98532]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 3.9 MiB/s wr, 478 op/s 2023-10-06T23:28:23.898 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:23 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:28:23.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:23 smithi190 ceph-mon[102658]: pgmap v817: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 3.9 MiB/s wr, 478 op/s 2023-10-06T23:28:23.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:23 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:28:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 810.0 s, 255.4 tps, lat 390.419 ms stddev 78.671 2023-10-06T23:28:24.392 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-06T23:28:24.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.731+0000 7f99d9fff700 1 -- 172.21.15.8:0/128726554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d4100fb0 msgr2=0x7f99d4101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.731+0000 7f99d9fff700 1 --2- 172.21.15.8:0/128726554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d4100fb0 0x7f99d4101410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99c80099c0 tx=0x7f99c8009cd0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.731+0000 7f99d9fff700 1 -- 172.21.15.8:0/128726554 shutdown_connections 2023-10-06T23:28:24.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.731+0000 7f99d9fff700 1 --2- 172.21.15.8:0/128726554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40ffdc0 0x7f99d41001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.731+0000 7f99d9fff700 1 --2- 172.21.15.8:0/128726554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99d4101950 0x7f99d4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.731+0000 7f99d9fff700 1 --2- 172.21.15.8:0/128726554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d4100fb0 0x7f99d4101410 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.731+0000 7f99d9fff700 1 -- 172.21.15.8:0/128726554 >> 172.21.15.8:0/128726554 conn(0x7f99d40fb330 msgr2=0x7f99d40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:24.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.732+0000 7f99d9fff700 1 -- 172.21.15.8:0/128726554 shutdown_connections 2023-10-06T23:28:24.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.732+0000 7f99d9fff700 1 -- 172.21.15.8:0/128726554 wait complete. 2023-10-06T23:28:24.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.733+0000 7f99d9fff700 1 Processor -- start 2023-10-06T23:28:24.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.733+0000 7f99d9fff700 1 -- start start 2023-10-06T23:28:24.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d9fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40ffdc0 0x7f99d406f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d9fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d4100fb0 0x7f99d406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d9fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99d4101950 0x7f99d4193a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d9fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4070290 con 0x7f99d40ffdc0 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d9fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4070400 con 0x7f99d4100fb0 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d9fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4194000 con 0x7f99d4101950 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99d4101950 0x7f99d4193a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99d4101950 0x7f99d4193a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38508/0 (socket says 172.21.15.8:38508) 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d4100fb0 0x7f99d406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.734+0000 7f99d3fff700 1 -- 172.21.15.8:0/1094740877 learned_addr learned my addr 172.21.15.8:0/1094740877 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.735+0000 7f99d3fff700 1 -- 172.21.15.8:0/1094740877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d4100fb0 msgr2=0x7f99d406fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.735+0000 7f99d3fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d4100fb0 0x7f99d406fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.735+0000 7f99d3fff700 1 -- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40ffdc0 msgr2=0x7f99d406f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.735+0000 7f99d3fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40ffdc0 0x7f99d406f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.735+0000 7f99d3fff700 1 -- 172.21.15.8:0/1094740877 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009c40 con 0x7f99d4101950 2023-10-06T23:28:24.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.735+0000 7f99d3fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99d4101950 0x7f99d4193a90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00e610 tx=0x7f99cc00e920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:24.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.736+0000 7f99d0ff9700 1 -- 172.21.15.8:0/1094740877 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc003c00 con 0x7f99d4101950 2023-10-06T23:28:24.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.736+0000 7f99d0ff9700 1 -- 172.21.15.8:0/1094740877 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99cc0093a0 con 0x7f99d4101950 2023-10-06T23:28:24.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.736+0000 7f99d0ff9700 1 -- 172.21.15.8:0/1094740877 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc004440 con 0x7f99d4101950 2023-10-06T23:28:24.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.736+0000 7f99d9fff700 1 -- 172.21.15.8:0/1094740877 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c80095f0 con 0x7f99d4101950 2023-10-06T23:28:24.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.736+0000 7f99d9fff700 1 -- 172.21.15.8:0/1094740877 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d41945e0 con 0x7f99d4101950 2023-10-06T23:28:24.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.744+0000 7f99d0ff9700 1 -- 172.21.15.8:0/1094740877 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f99cc003d60 con 0x7f99d4101950 2023-10-06T23:28:24.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.747+0000 7f99ed9b3b80 1 Processor -- start 2023-10-06T23:28:24.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.747+0000 7f99d0ff9700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99bc0a15d0 0x7f99bc0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.747+0000 7f99d0ff9700 1 -- 172.21.15.8:0/1094740877 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f99cc0d0f50 con 0x7f99d4101950 2023-10-06T23:28:24.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.747+0000 7f99ed9b3b80 1 -- start start 2023-10-06T23:28:24.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.747+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7a1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.747+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 0x56005b7a2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.747+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.748+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b709460 con 0x56005b7a1bc0 2023-10-06T23:28:24.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.748+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b6fac20 con 0x56005b7a2a60 2023-10-06T23:28:24.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.748+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b6f8540 con 0x56005b7a1260 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.748+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99bc0a15d0 0x7f99bc0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.748+0000 7f99d37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.748+0000 7f99d37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38516/0 (socket says 172.21.15.8:38516) 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.748+0000 7f99d37fe700 1 -- 172.21.15.8:0/3815317521 learned_addr learned my addr 172.21.15.8:0/3815317521 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.748+0000 7f99d3fff700 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.749+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 0x56005b7a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.749+0000 7f99d37fe700 1 -- 172.21.15.8:0/3815317521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 msgr2=0x56005b7a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.749+0000 7f99d37fe700 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7a2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.749+0000 7f99d37fe700 1 -- 172.21.15.8:0/3815317521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 msgr2=0x56005b7a2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.749+0000 7f99d37fe700 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 0x56005b7a2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.749+0000 7f99d37fe700 1 -- 172.21.15.8:0/3815317521 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005b51ede0 con 0x56005b7a1260 2023-10-06T23:28:24.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.749+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99bc0a15d0 0x7f99bc0a3a90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006010 tx=0x7f99c8009550 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:24.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.749+0000 7f99d37fe700 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7a1680 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f99c400bb70 tx=0x7f99c400be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbe8bfb5ab64feac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:24.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.750+0000 7f99b9ffb700 1 -- 172.21.15.8:0/3815317521 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400d890 con 0x56005b7a1260 2023-10-06T23:28:24.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.750+0000 7f99b9ffb700 1 -- 172.21.15.8:0/3815317521 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99c400de80 con 0x56005b7a1260 2023-10-06T23:28:24.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.750+0000 7f99b9ffb700 1 -- 172.21.15.8:0/3815317521 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40183c0 con 0x56005b7a1260 2023-10-06T23:28:24.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.751+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3815317521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 msgr2=0x56005b7a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.751+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7a1680 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f99c400bb70 tx=0x7f99c400be80 comp rx=0 tx=0).stop 2023-10-06T23:28:24.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.752+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3815317521 shutdown_connections 2023-10-06T23:28:24.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.752+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7a2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.752+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7a1680 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.752+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3815317521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 0x56005b7a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.752+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3815317521 >> 172.21.15.8:0/3815317521 conn(0x56005b715260 msgr2=0x56005b79c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.752+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3815317521 shutdown_connections 2023-10-06T23:28:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.752+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3815317521 wait complete. 2023-10-06T23:28:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.753+0000 7f99ed9b3b80 1 -- start start 2023-10-06T23:28:24.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.753+0000 7f99ed9b3b80 1 Processor -- start 2023-10-06T23:28:24.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.754+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.754+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.754+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 0x56005b7b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.754+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b6f3e30 con 0x56005b7a1260 2023-10-06T23:28:24.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.754+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b690710 con 0x56005b7a1bc0 2023-10-06T23:28:24.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.754+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b6903b0 con 0x56005b7a2a60 2023-10-06T23:28:24.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.754+0000 7f99ed9b3b80 10 client.0 _ll_register_callbacks cb 0x56005b4ed800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36374/0 (socket says 172.21.15.8:36374) 2023-10-06T23:28:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d2ffd700 1 -- 172.21.15.8:0/1516943475 learned_addr learned my addr 172.21.15.8:0/1516943475 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d3fff700 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 0x56005b7b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d2ffd700 1 -- 172.21.15.8:0/1516943475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 msgr2=0x56005b7b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d37fe700 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 0x56005b7b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d2ffd700 1 -- 172.21.15.8:0/1516943475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 msgr2=0x56005b7aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:24.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.755+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.756+0000 7f99d2ffd700 1 -- 172.21.15.8:0/1516943475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c400b7a0 con 0x56005b7a1bc0 2023-10-06T23:28:24.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.756+0000 7f99d37fe700 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:28:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.757+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7ab4d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99c80095c0 tx=0x7f99c800b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f670d0e97787aeeb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.757+0000 7f99b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:28:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.757+0000 7f99b2ffd700 1 -- 172.21.15.8:0/1516943475 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c800f660 con 0x56005b7a1bc0 2023-10-06T23:28:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.757+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1516943475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56005b6ece10 con 0x56005b7a1bc0 2023-10-06T23:28:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.757+0000 7f99b2ffd700 1 -- 172.21.15.8:0/1516943475 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f99c800f7c0 con 0x56005b7a1bc0 2023-10-06T23:28:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.757+0000 7f99b2ffd700 1 -- 172.21.15.8:0/1516943475 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99c800f980 con 0x56005b7a1bc0 2023-10-06T23:28:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.757+0000 7f99ed9b3b80 10 client.27005 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:24.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.757+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1516943475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56005b507c60 con 0x56005b7a1bc0 2023-10-06T23:28:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.758+0000 7f99b2ffd700 1 -- 172.21.15.8:0/1516943475 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99c803e020 con 0x56005b7a1bc0 2023-10-06T23:28:24.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.758+0000 7f99b2ffd700 1 -- 172.21.15.8:0/1516943475 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f99c803ab40 con 0x56005b7a1bc0 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.758+0000 7f99ed9b3b80 10 client.27005 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.758+0000 7f99ed9b3b80 10 client.27005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.758+0000 7f99ed9b3b80 20 client.27005 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.758+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56005b7b6c90 0x56005b7b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.758+0000 7f99ed9b3b80 4 client.27005 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.758+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1516943475 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56005b6ecb30 con 0x56005b7b6c90 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.759+0000 7f99d37fe700 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56005b7b6c90 0x56005b7b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.759+0000 7f99b2ffd700 10 client.27005 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.759+0000 7f99d37fe700 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56005b7b6c90 0x56005b7b90b0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5df3490526b2530f server_cookie=14769a259b2a15fb in_seq=0 out_seq=0 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.760+0000 7f99b2ffd700 1 -- 172.21.15.8:0/1516943475 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56005b6ecb30 con 0x56005b7b6c90 2023-10-06T23:28:24.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.760+0000 7f99b2ffd700 10 client.27005 handle_command_reply: tid=0 2023-10-06T23:28:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.761+0000 7f99ed9b3b80 1 client.27005 shutdown 2023-10-06T23:28:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1516943475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 msgr2=0x56005b7ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7ab4d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99c80095c0 tx=0x7f99c800b540 comp rx=0 tx=0).stop 2023-10-06T23:28:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1516943475 shutdown_connections 2023-10-06T23:28:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56005b7b6c90 0x56005b7b90b0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 0x56005b7b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1516943475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7ab4d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1516943475 >> 172.21.15.8:0/1516943475 conn(0x56005b715260 msgr2=0x56005b79bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.762+0000 7f99b2ffd700 0 client.27005 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.763+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1516943475 shutdown_connections 2023-10-06T23:28:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.763+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1516943475 wait complete. 2023-10-06T23:28:24.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.763+0000 7f99ed9b3b80 20 client.27005 trim_cache size 0 max 16384 2023-10-06T23:28:24.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.788+0000 7f99ed9b3b80 1 Processor -- start 2023-10-06T23:28:24.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.788+0000 7f99ed9b3b80 1 -- start start 2023-10-06T23:28:24.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.789+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.789+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.789+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 0x56005b7ab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.789+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b574920 con 0x56005b7a1260 2023-10-06T23:28:24.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.789+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b7a28d0 con 0x56005b7a1bc0 2023-10-06T23:28:24.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.789+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b7aab30 con 0x56005b7a2a60 2023-10-06T23:28:24.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.789+0000 7f99d37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39164/0 (socket says 172.21.15.8:39164) 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36380/0 (socket says 172.21.15.8:36380) 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d37fe700 1 -- 172.21.15.8:0/1910811800 learned_addr learned my addr 172.21.15.8:0/1910811800 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d3fff700 1 --2- 172.21.15.8:0/1910811800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 0x56005b7ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d37fe700 1 -- 172.21.15.8:0/1910811800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 msgr2=0x56005b7ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d37fe700 1 --2- 172.21.15.8:0/1910811800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 0x56005b7ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d37fe700 1 -- 172.21.15.8:0/1910811800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 msgr2=0x56005b7b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d37fe700 1 --2- 172.21.15.8:0/1910811800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.790+0000 7f99d37fe700 1 -- 172.21.15.8:0/1910811800 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005b545250 con 0x56005b7a1260 2023-10-06T23:28:24.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.791+0000 7f99d37fe700 1 --2- 172.21.15.8:0/1910811800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aad40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005d90 tx=0x7f99c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f00b0d0f0aec2ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:24.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.791+0000 7f99ba7fc700 1 -- 172.21.15.8:0/1910811800 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c401e040 con 0x56005b7a1260 2023-10-06T23:28:24.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.791+0000 7f99ba7fc700 1 -- 172.21.15.8:0/1910811800 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99c4020040 con 0x56005b7a1260 2023-10-06T23:28:24.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.791+0000 7f99ba7fc700 1 -- 172.21.15.8:0/1910811800 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4025d30 con 0x56005b7a1260 2023-10-06T23:28:24.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.792+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1910811800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 msgr2=0x56005b7aad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.792+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1910811800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aad40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005d90 tx=0x7f99c4000bc0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.793+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1910811800 shutdown_connections 2023-10-06T23:28:24.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.793+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1910811800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1260 0x56005b7aad40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.793+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1910811800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a2a60 0x56005b7ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.793+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/1910811800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a1bc0 0x56005b7b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.793+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1910811800 >> 172.21.15.8:0/1910811800 conn(0x56005b715260 msgr2=0x56005b7a5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.793+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1910811800 shutdown_connections 2023-10-06T23:28:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.793+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/1910811800 wait complete. 2023-10-06T23:28:24.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.794+0000 7f99ed9b3b80 1 -- start start 2023-10-06T23:28:24.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.794+0000 7f99ed9b3b80 1 Processor -- start 2023-10-06T23:28:24.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.795+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.795+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 0x56005b7b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.795+0000 7f99ed9b3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.796+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b7aed60 con 0x56005b7a1bc0 2023-10-06T23:28:24.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.796+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b7aeed0 con 0x56005b7a2a60 2023-10-06T23:28:24.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.796+0000 7f99ed9b3b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005b7af090 con 0x56005b7a1260 2023-10-06T23:28:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.796+0000 7f99ed9b3b80 10 client.0 _ll_register_callbacks cb 0x7f99c8005360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.796+0000 7f99d37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.796+0000 7f99d37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38534/0 (socket says 172.21.15.8:38534) 2023-10-06T23:28:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.796+0000 7f99d37fe700 1 -- 172.21.15.8:0/3133160518 learned_addr learned my addr 172.21.15.8:0/3133160518 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.796+0000 7f99d3fff700 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.797+0000 7f99d37fe700 1 -- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 msgr2=0x56005b7ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.797+0000 7f99d37fe700 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.797+0000 7f99d37fe700 1 -- 172.21.15.8:0/3133160518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 msgr2=0x56005b7b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.797+0000 7f99d37fe700 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 0x56005b7b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.797+0000 7f99d37fe700 1 -- 172.21.15.8:0/3133160518 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56005b51ede0 con 0x56005b7a1260 2023-10-06T23:28:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.797+0000 7f99d3fff700 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:28:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.797+0000 7f99d37fe700 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7b1d40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f99c40059d0 tx=0x7f99c4025460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7653a31980a4f37d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:24.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.797+0000 7f99b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:28:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.798+0000 7f99b2ffd700 1 -- 172.21.15.8:0/3133160518 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c401e050 con 0x56005b7a1260 2023-10-06T23:28:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.798+0000 7f99b2ffd700 1 -- 172.21.15.8:0/3133160518 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f99c4025cc0 con 0x56005b7a1260 2023-10-06T23:28:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.798+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3133160518 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56005b793f10 con 0x56005b7a1260 2023-10-06T23:28:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.798+0000 7f99b2ffd700 1 -- 172.21.15.8:0/3133160518 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99c4025ea0 con 0x56005b7a1260 2023-10-06T23:28:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.799+0000 7f99ed9b3b80 10 client.27013 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:24.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.799+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3133160518 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56005b51d2b0 con 0x56005b7a1260 2023-10-06T23:28:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99b2ffd700 1 -- 172.21.15.8:0/3133160518 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56005b793f10 con 0x56005b7a1260 2023-10-06T23:28:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99b2ffd700 1 -- 172.21.15.8:0/3133160518 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f99c4004940 con 0x56005b7a1260 2023-10-06T23:28:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99ed9b3b80 10 client.27013 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:24.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99ed9b3b80 10 client.27013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99ed9b3b80 20 client.27013 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56005b814360 0x56005b816780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99ed9b3b80 4 client.27013 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-06T23:28:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3133160518 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56005b53ff70 con 0x56005b814360 2023-10-06T23:28:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.800+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56005b814360 0x56005b816780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.801+0000 7f99d2ffd700 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56005b814360 0x56005b816780 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=199ea0ef14352e04 server_cookie=88ba830076f57770 in_seq=0 out_seq=0 2023-10-06T23:28:24.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.801+0000 7f99b2ffd700 10 client.27013 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99b2ffd700 1 -- 172.21.15.8:0/3133160518 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56005b53ff70 con 0x56005b814360 2023-10-06T23:28:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99b2ffd700 10 client.27013 handle_command_reply: tid=0 2023-10-06T23:28:24.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 client.27013 shutdown 2023-10-06T23:28:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3133160518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 msgr2=0x56005b7b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7b1d40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f99c40059d0 tx=0x7f99c4025460 comp rx=0 tx=0).stop 2023-10-06T23:28:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3133160518 shutdown_connections 2023-10-06T23:28:24.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56005b814360 0x56005b816780 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56005b7a2a60 0x56005b7ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56005b7a1260 0x56005b7b1d40 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f99c40059d0 tx=0x7f99c4025460 comp rx=0 tx=0).stop 2023-10-06T23:28:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99b2ffd700 0 client.27013 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 --2- 172.21.15.8:0/3133160518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56005b7a1bc0 0x56005b7b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.802+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3133160518 >> 172.21.15.8:0/3133160518 conn(0x56005b715260 msgr2=0x56005b7aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.803+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3133160518 shutdown_connections 2023-10-06T23:28:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.803+0000 7f99ed9b3b80 1 -- 172.21.15.8:0/3133160518 wait complete. 2023-10-06T23:28:24.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.803+0000 7f99ed9b3b80 20 client.27013 trim_cache size 0 max 16384 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "909cdce0-3b92-4072-b1f6-aa73ff016e8c": { 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "909cdce0-3b92-4072-b1f6-aa73ff016e8c", 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:28:24.806 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:28:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.804+0000 7f99d9fff700 1 -- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99bc0a15d0 msgr2=0x7f99bc0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.804+0000 7f99d9fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99bc0a15d0 0x7f99bc0a3a90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006010 tx=0x7f99c8009550 comp rx=0 tx=0).stop 2023-10-06T23:28:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.804+0000 7f99d9fff700 1 -- 172.21.15.8:0/1094740877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99d4101950 msgr2=0x7f99d4193a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.804+0000 7f99d9fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99d4101950 0x7f99d4193a90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00e610 tx=0x7f99cc00e920 comp rx=0 tx=0).stop 2023-10-06T23:28:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.805+0000 7f99d9fff700 1 -- 172.21.15.8:0/1094740877 shutdown_connections 2023-10-06T23:28:24.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.805+0000 7f99d9fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f99bc0a15d0 0x7f99bc0a3a90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.805+0000 7f99d9fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f99d40ffdc0 0x7f99d406f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.805+0000 7f99d9fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99d4101950 0x7f99d4193a90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.805+0000 7f99d9fff700 1 --2- 172.21.15.8:0/1094740877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99d4100fb0 0x7f99d406fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.805+0000 7f99d9fff700 1 -- 172.21.15.8:0/1094740877 >> 172.21.15.8:0/1094740877 conn(0x7f99d40fb330 msgr2=0x7f99d40fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.805+0000 7f99d9fff700 1 -- 172.21.15.8:0/1094740877 shutdown_connections 2023-10-06T23:28:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:28:24.805+0000 7f99d9fff700 1 -- 172.21.15.8:0/1094740877 wait complete. 2023-10-06T23:28:24.833 INFO:tasks.cephfs.filesystem:scrub status for tag:909cdce0-3b92-4072-b1f6-aa73ff016e8c - {'path': '/', 'tag': '909cdce0-3b92-4072-b1f6-aa73ff016e8c', 'options': 'recursive,force'} 2023-10-06T23:28:24.834 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/cephfs/filesystem.py", line 1730, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-10-06T23:28:25.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:25 smithi190 ceph-mon[102658]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 4.4 MiB/s wr, 519 op/s 2023-10-06T23:28:25.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:28:25.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:28:25.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:25 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:28:26.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:25 smithi156 ceph-mon[102862]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 4.4 MiB/s wr, 519 op/s 2023-10-06T23:28:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:28:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:28:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:25 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:28:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:25 smithi008 ceph-mon[98532]: pgmap v818: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 4.4 MiB/s wr, 519 op/s 2023-10-06T23:28:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:28:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:28:26.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:25 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:28:27.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:27 smithi190 ceph-mon[102658]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 4.1 MiB/s wr, 495 op/s 2023-10-06T23:28:28.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:27 smithi156 ceph-mon[102862]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 4.1 MiB/s wr, 495 op/s 2023-10-06T23:28:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:27 smithi008 ceph-mon[98532]: pgmap v819: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 4.1 MiB/s wr, 495 op/s 2023-10-06T23:28:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 -- 172.21.15.8:0/3911394995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f0100eb0 msgr2=0x7f27f01012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 --2- 172.21.15.8:0/3911394995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f0100eb0 0x7f27f01012d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009990 tx=0x7f27ec009ca0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 -- 172.21.15.8:0/3911394995 shutdown_connections 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 --2- 172.21.15.8:0/3911394995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27f0102a50 0x7f27f0109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 --2- 172.21.15.8:0/3911394995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f0100eb0 0x7f27f01012d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 --2- 172.21.15.8:0/3911394995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27f0102090 0x7f27f0102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 -- 172.21.15.8:0/3911394995 >> 172.21.15.8:0/3911394995 conn(0x7f27f00fc430 msgr2=0x7f27f00fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 -- 172.21.15.8:0/3911394995 shutdown_connections 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.431+0000 7f27f7bff700 1 -- 172.21.15.8:0/3911394995 wait complete. 2023-10-06T23:28:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.432+0000 7f27f7bff700 1 Processor -- start 2023-10-06T23:28:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.433+0000 7f27f7bff700 1 -- start start 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.433+0000 7f27f7bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27f0100eb0 0x7f27f0198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.433+0000 7f27f7bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f0102090 0x7f27f01993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.433+0000 7f27f7bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27f0102a50 0x7f27f019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.433+0000 7f27f7bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019a8b0 con 0x7f27f0100eb0 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.433+0000 7f27f7bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019aa20 con 0x7f27f0102090 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.433+0000 7f27f7bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019abe0 con 0x7f27f0102a50 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27f0102a50 0x7f27f019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27f0102a50 0x7f27f019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38558/0 (socket says 172.21.15.8:38558) 2023-10-06T23:28:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 -- 172.21.15.8:0/252021888 learned_addr learned my addr 172.21.15.8:0/252021888 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f599b700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27f0100eb0 0x7f27f0198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f519a700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f0102090 0x7f27f01993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 -- 172.21.15.8:0/252021888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f0102090 msgr2=0x7f27f01993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f0102090 0x7f27f01993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 -- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27f0100eb0 msgr2=0x7f27f0198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27f0100eb0 0x7f27f0198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 -- 172.21.15.8:0/252021888 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec0095f0 con 0x7f27f0102a50 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.434+0000 7f27f619c700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27f0102a50 0x7f27f019a250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f27e800ef30 tx=0x7f27e800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.435+0000 7f27e6ffd700 1 -- 172.21.15.8:0/252021888 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8018070 con 0x7f27f0102a50 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.435+0000 7f27e6ffd700 1 -- 172.21.15.8:0/252021888 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27e800f040 con 0x7f27f0102a50 2023-10-06T23:28:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.435+0000 7f27e6ffd700 1 -- 172.21.15.8:0/252021888 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800cbc0 con 0x7f27f0102a50 2023-10-06T23:28:28.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.435+0000 7f27f7bff700 1 -- 172.21.15.8:0/252021888 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f019ae60 con 0x7f27f0102a50 2023-10-06T23:28:28.438 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.435+0000 7f27f7bff700 1 -- 172.21.15.8:0/252021888 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f01a1680 con 0x7f27f0102a50 2023-10-06T23:28:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.439+0000 7f27e6ffd700 1 -- 172.21.15.8:0/252021888 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f27e8007500 con 0x7f27f0102a50 2023-10-06T23:28:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.441+0000 7f27e6ffd700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f27dc0a1480 0x7f27dc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.441+0000 7f27e6ffd700 1 -- 172.21.15.8:0/252021888 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f27e80cc810 con 0x7f27f0102a50 2023-10-06T23:28:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.441+0000 7f27f599b700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f27dc0a1480 0x7f27dc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.442+0000 7f280b4f8b80 1 Processor -- start 2023-10-06T23:28:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.442+0000 7f27f599b700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f27dc0a1480 0x7f27dc0a3940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0098e0 tx=0x7f27ec00b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.442+0000 7f280b4f8b80 1 -- start start 2023-10-06T23:28:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb386d0 0x55774fb38af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb39c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb40a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fa98400 con 0x55774fb3a1a0 2023-10-06T23:28:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fa89bc0 con 0x55774fb386d0 2023-10-06T23:28:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fa874e0 con 0x55774fb397e0 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f519a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb39c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f519a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb39c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38560/0 (socket says 172.21.15.8:38560) 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f519a700 1 -- 172.21.15.8:0/1426144671 learned_addr learned my addr 172.21.15.8:0/1426144671 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f599b700 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb386d0 0x55774fb38af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f619c700 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb40a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f519a700 1 -- 172.21.15.8:0/1426144671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb386d0 msgr2=0x55774fb38af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f519a700 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb386d0 0x55774fb38af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f519a700 1 -- 172.21.15.8:0/1426144671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 msgr2=0x55774fb40a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.443+0000 7f27f519a700 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb40a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.444+0000 7f27f519a700 1 -- 172.21.15.8:0/1426144671 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774f8add80 con 0x55774fb397e0 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.444+0000 7f27f599b700 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb386d0 0x55774fb38af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:28:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.444+0000 7f27f519a700 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb39c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009d30 tx=0x7f27e0011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a215bb41f91d9a87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.444+0000 7f27dbfff700 1 -- 172.21.15.8:0/1426144671 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0004220 con 0x55774fb397e0 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.444+0000 7f27dbfff700 1 -- 172.21.15.8:0/1426144671 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27e0004380 con 0x55774fb397e0 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.444+0000 7f27dbfff700 1 -- 172.21.15.8:0/1426144671 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00197a0 con 0x55774fb397e0 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.445+0000 7f280b4f8b80 1 -- 172.21.15.8:0/1426144671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 msgr2=0x55774fb39c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.445+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb39c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009d30 tx=0x7f27e0011720 comp rx=0 tx=0).stop 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.445+0000 7f280b4f8b80 1 -- 172.21.15.8:0/1426144671 shutdown_connections 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.445+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb40a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.445+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb386d0 0x55774fb38af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.445+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/1426144671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb39c60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.445+0000 7f280b4f8b80 1 -- 172.21.15.8:0/1426144671 >> 172.21.15.8:0/1426144671 conn(0x55774faa4200 msgr2=0x55774fb2ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.445+0000 7f280b4f8b80 1 -- 172.21.15.8:0/1426144671 shutdown_connections 2023-10-06T23:28:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.446+0000 7f280b4f8b80 1 -- 172.21.15.8:0/1426144671 wait complete. 2023-10-06T23:28:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.446+0000 7f280b4f8b80 1 -- start start 2023-10-06T23:28:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.446+0000 7f280b4f8b80 1 Processor -- start 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb42320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb397e0 0x55774fb42860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 0x55774fb498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fa82dd0 con 0x55774fb397e0 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fa1f6b0 con 0x55774fb3a1a0 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fa1f350 con 0x55774fb386d0 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f280b4f8b80 10 client.0 _ll_register_callbacks cb 0x55774f87c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f27f599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb42320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f27f599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb42320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38572/0 (socket says 172.21.15.8:38572) 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.447+0000 7f27f599b700 1 -- 172.21.15.8:0/2922443271 learned_addr learned my addr 172.21.15.8:0/2922443271 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.448+0000 7f27f519a700 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb397e0 0x55774fb42860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.448+0000 7f27f619c700 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 0x55774fb498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.448+0000 7f27f599b700 1 -- 172.21.15.8:0/2922443271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 msgr2=0x55774fb498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.448+0000 7f27f599b700 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 0x55774fb498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.448+0000 7f27f599b700 1 -- 172.21.15.8:0/2922443271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb397e0 msgr2=0x55774fb42860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.448+0000 7f27f599b700 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb397e0 0x55774fb42860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.448+0000 7f27f599b700 1 -- 172.21.15.8:0/2922443271 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e0009960 con 0x55774fb386d0 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.448+0000 7f27f599b700 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb42320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f27f0101c00 tx=0x7f27ec01a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6edc45f5c37a936c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.449+0000 7f27d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:28:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.449+0000 7f27d97fa700 1 -- 172.21.15.8:0/2922443271 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec00bb70 con 0x55774fb386d0 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.449+0000 7f27d97fa700 1 -- 172.21.15.8:0/2922443271 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f27ec00bcd0 con 0x55774fb386d0 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.449+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2922443271 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55774fb22d50 con 0x55774fb386d0 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.449+0000 7f27d97fa700 1 -- 172.21.15.8:0/2922443271 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27ec00bed0 con 0x55774fb386d0 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.449+0000 7f280b4f8b80 10 client.27025 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.449+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2922443271 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55774f896c00 con 0x55774fb386d0 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.449+0000 7f27d97fa700 1 -- 172.21.15.8:0/2922443271 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55774fb22d50 con 0x55774fb386d0 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.450+0000 7f27d97fa700 1 -- 172.21.15.8:0/2922443271 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f27ec00f460 con 0x55774fb386d0 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.450+0000 7f280b4f8b80 10 client.27025 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.450+0000 7f280b4f8b80 10 client.27025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.450+0000 7f280b4f8b80 20 client.27025 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.450+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55774fb4e120 0x55774fb50540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.450+0000 7f280b4f8b80 4 client.27025 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:28:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.450+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2922443271 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55774fa7bdb0 con 0x55774fb4e120 2023-10-06T23:28:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.450+0000 7f27f519a700 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55774fb4e120 0x55774fb50540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.451+0000 7f27f519a700 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55774fb4e120 0x55774fb50540 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919559b202146454 server_cookie=454bd3ef555fddc3 in_seq=0 out_seq=0 2023-10-06T23:28:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.451+0000 7f27d97fa700 10 client.27025 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f27d97fa700 1 -- 172.21.15.8:0/2922443271 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55774fa7bdb0 con 0x55774fb4e120 2023-10-06T23:28:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f27d97fa700 10 client.27025 handle_command_reply: tid=0 2023-10-06T23:28:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 client.27025 shutdown 2023-10-06T23:28:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2922443271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 msgr2=0x55774fb42320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb42320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f27f0101c00 tx=0x7f27ec01a050 comp rx=0 tx=0).stop 2023-10-06T23:28:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2922443271 shutdown_connections 2023-10-06T23:28:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55774fb4e120 0x55774fb50540 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 0x55774fb498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f27d97fa700 0 client.27025 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb42320 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2922443271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb397e0 0x55774fb42860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2922443271 >> 172.21.15.8:0/2922443271 conn(0x55774faa4200 msgr2=0x55774fb2a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2922443271 shutdown_connections 2023-10-06T23:28:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.453+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2922443271 wait complete. 2023-10-06T23:28:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.454+0000 7f280b4f8b80 20 client.27025 trim_cache size 0 max 16384 2023-10-06T23:28:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.476+0000 7f280b4f8b80 1 Processor -- start 2023-10-06T23:28:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.476+0000 7f280b4f8b80 1 -- start start 2023-10-06T23:28:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.476+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb39bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.476+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb397e0 0x55774fb49860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.476+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb2aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.476+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f9038c0 con 0x55774fb3a1a0 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.476+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fb41800 con 0x55774fb397e0 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.476+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fb22890 con 0x55774fb386d0 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb39bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb39bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:38576/0 (socket says 172.21.15.8:38576) 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 -- 172.21.15.8:0/2343816382 learned_addr learned my addr 172.21.15.8:0/2343816382 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f519a700 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb397e0 0x55774fb49860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f619c700 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb2aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 -- 172.21.15.8:0/2343816382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb397e0 msgr2=0x55774fb49860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb397e0 0x55774fb49860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 -- 172.21.15.8:0/2343816382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 msgr2=0x55774fb2aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb2aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 -- 172.21.15.8:0/2343816382 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774f8d41f0 con 0x55774fb386d0 2023-10-06T23:28:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f619c700 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb2aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:28:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.477+0000 7f27f599b700 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb39bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f27ec000c00 tx=0x7f27ec004310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1f8dda86b963d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.478+0000 7f27e4bff700 1 -- 172.21.15.8:0/2343816382 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec00f460 con 0x55774fb386d0 2023-10-06T23:28:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.478+0000 7f27e4bff700 1 -- 172.21.15.8:0/2343816382 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27ec01e040 con 0x55774fb386d0 2023-10-06T23:28:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.478+0000 7f27e4bff700 1 -- 172.21.15.8:0/2343816382 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0047f0 con 0x55774fb386d0 2023-10-06T23:28:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2343816382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 msgr2=0x55774fb39bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb39bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f27ec000c00 tx=0x7f27ec004310 comp rx=0 tx=0).stop 2023-10-06T23:28:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2343816382 shutdown_connections 2023-10-06T23:28:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb3a1a0 0x55774fb2aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb386d0 0x55774fb39bc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/2343816382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb397e0 0x55774fb49860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2343816382 >> 172.21.15.8:0/2343816382 conn(0x55774faa4200 msgr2=0x55774fb54ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2343816382 shutdown_connections 2023-10-06T23:28:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.479+0000 7f280b4f8b80 1 -- 172.21.15.8:0/2343816382 wait complete. 2023-10-06T23:28:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.480+0000 7f280b4f8b80 1 -- start start 2023-10-06T23:28:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.480+0000 7f280b4f8b80 1 Processor -- start 2023-10-06T23:28:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb386d0 0x55774fb471f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb47730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f280b4f8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 0x55774fb48740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fb48c80 con 0x55774fb386d0 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fb48df0 con 0x55774fb3a1a0 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f280b4f8b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774fb48fb0 con 0x55774fb397e0 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f280b4f8b80 10 client.0 _ll_register_callbacks cb 0x55774f87c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f27f599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb386d0 0x55774fb471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f27f599b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb386d0 0x55774fb471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39226/0 (socket says 172.21.15.8:39226) 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f27f599b700 1 -- 172.21.15.8:0/376772864 learned_addr learned my addr 172.21.15.8:0/376772864 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f27f619c700 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 0x55774fb48740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.481+0000 7f27f519a700 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb47730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.482+0000 7f27f599b700 1 -- 172.21.15.8:0/376772864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 msgr2=0x55774fb47730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.482+0000 7f27f599b700 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb47730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.482+0000 7f27f599b700 1 -- 172.21.15.8:0/376772864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 msgr2=0x55774fb48740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.482+0000 7f27f599b700 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 0x55774fb48740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.485 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.482+0000 7f27f599b700 1 -- 172.21.15.8:0/376772864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55774f896c00 con 0x55774fb386d0 2023-10-06T23:28:28.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.482+0000 7f27f599b700 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb386d0 0x55774fb471f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0095c0 tx=0x7f27ec00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3e890f34374f1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:28.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.482+0000 7f27d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:28:28.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.482+0000 7f27d97fa700 1 -- 172.21.15.8:0/376772864 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec004570 con 0x55774fb386d0 2023-10-06T23:28:28.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.483+0000 7f27d97fa700 1 -- 172.21.15.8:0/376772864 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f27ec0046d0 con 0x55774fb386d0 2023-10-06T23:28:28.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.483+0000 7f280b4f8b80 1 -- 172.21.15.8:0/376772864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27e0004380 con 0x55774fb386d0 2023-10-06T23:28:28.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.483+0000 7f27d97fa700 1 -- 172.21.15.8:0/376772864 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27ec004890 con 0x55774fb386d0 2023-10-06T23:28:28.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.483+0000 7f280b4f8b80 10 client.17097 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:28.486 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.483+0000 7f280b4f8b80 1 -- 172.21.15.8:0/376772864 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55774f8ac250 con 0x55774fb386d0 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.483+0000 7f27d97fa700 1 -- 172.21.15.8:0/376772864 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27e0004380 con 0x55774fb386d0 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.484+0000 7f27d97fa700 1 -- 172.21.15.8:0/376772864 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f27ec045960 con 0x55774fb386d0 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.484+0000 7f280b4f8b80 10 client.17097 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.484+0000 7f280b4f8b80 10 client.17097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.484+0000 7f280b4f8b80 20 client.17097 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.484+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55774fba26f0 0x55774fba4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.484+0000 7f280b4f8b80 4 client.17097 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.484+0000 7f280b4f8b80 1 -- 172.21.15.8:0/376772864 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55774fa7bad0 con 0x55774fba26f0 2023-10-06T23:28:28.487 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.484+0000 7f27f519a700 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55774fba26f0 0x55774fba4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.485+0000 7f27f519a700 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55774fba26f0 0x55774fba4b10 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf341c3c6f85f04e server_cookie=c54fe23469db59e9 in_seq=0 out_seq=0 2023-10-06T23:28:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.485+0000 7f27d97fa700 10 client.17097 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f27d97fa700 1 -- 172.21.15.8:0/376772864 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55774fa7bad0 con 0x55774fba26f0 2023-10-06T23:28:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f27d97fa700 10 client.17097 handle_command_reply: tid=0 2023-10-06T23:28:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 client.17097 shutdown 2023-10-06T23:28:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 -- 172.21.15.8:0/376772864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb386d0 msgr2=0x55774fb471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb386d0 0x55774fb471f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0095c0 tx=0x7f27ec00f690 comp rx=0 tx=0).stop 2023-10-06T23:28:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 -- 172.21.15.8:0/376772864 shutdown_connections 2023-10-06T23:28:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55774fba26f0 0x55774fba4b10 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55774fb386d0 0x55774fb471f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55774fb3a1a0 0x55774fb48740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 --2- 172.21.15.8:0/376772864 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55774fb397e0 0x55774fb47730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 -- 172.21.15.8:0/376772864 >> 172.21.15.8:0/376772864 conn(0x55774faa4200 msgr2=0x55774fb40550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f27d97fa700 0 client.17097 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 -- 172.21.15.8:0/376772864 shutdown_connections 2023-10-06T23:28:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.505+0000 7f280b4f8b80 1 -- 172.21.15.8:0/376772864 wait complete. 2023-10-06T23:28:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f280b4f8b80 20 client.17097 trim_cache size 0 max 16384 2023-10-06T23:28:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:28:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:28:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:28:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:28:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 -- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f27dc0a1480 msgr2=0x7f27dc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f27dc0a1480 0x7f27dc0a3940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0098e0 tx=0x7f27ec00b260 comp rx=0 tx=0).stop 2023-10-06T23:28:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 -- 172.21.15.8:0/252021888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27f0102a50 msgr2=0x7f27f019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27f0102a50 0x7f27f019a250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f27e800ef30 tx=0x7f27e800c3a0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 -- 172.21.15.8:0/252021888 shutdown_connections 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f27dc0a1480 0x7f27dc0a3940 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27f0100eb0 0x7f27f0198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27f0102a50 0x7f27f019a250 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 --2- 172.21.15.8:0/252021888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f0102090 0x7f27f01993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.506+0000 7f27f7bff700 1 -- 172.21.15.8:0/252021888 >> 172.21.15.8:0/252021888 conn(0x7f27f00fc430 msgr2=0x7f27f0105730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.507+0000 7f27f7bff700 1 -- 172.21.15.8:0/252021888 shutdown_connections 2023-10-06T23:28:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:28.507+0000 7f27f7bff700 1 -- 172.21.15.8:0/252021888 wait complete. 2023-10-06T23:28:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 815.0 s, 257.4 tps, lat 392.928 ms stddev 55.406 2023-10-06T23:28:29.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:29 smithi190 ceph-mon[102658]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 3.2 MiB/s wr, 408 op/s 2023-10-06T23:28:30.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:29 smithi156 ceph-mon[102862]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 3.2 MiB/s wr, 408 op/s 2023-10-06T23:28:30.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:29 smithi008 ceph-mon[98532]: pgmap v820: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 3.2 MiB/s wr, 408 op/s 2023-10-06T23:28:31.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:31 smithi190 ceph-mon[102658]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 4.4 MiB/s wr, 517 op/s 2023-10-06T23:28:32.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:31 smithi156 ceph-mon[102862]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 4.4 MiB/s wr, 517 op/s 2023-10-06T23:28:32.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:31 smithi008 ceph-mon[98532]: pgmap v821: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 4.4 MiB/s wr, 517 op/s 2023-10-06T23:28:33.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:33 smithi156 ceph-mon[102862]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 4.3 MiB/s wr, 499 op/s 2023-10-06T23:28:33.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:33 smithi008 ceph-mon[98532]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 4.3 MiB/s wr, 499 op/s 2023-10-06T23:28:33.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:33 smithi190 ceph-mon[102658]: pgmap v822: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 4.3 MiB/s wr, 499 op/s 2023-10-06T23:28:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 820.0 s, 281.2 tps, lat 357.566 ms stddev 45.464 2023-10-06T23:28:35.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:35 smithi190 ceph-mon[102658]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 4.0 MiB/s wr, 483 op/s 2023-10-06T23:28:36.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:35 smithi156 ceph-mon[102862]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 4.0 MiB/s wr, 483 op/s 2023-10-06T23:28:36.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:35 smithi008 ceph-mon[98532]: pgmap v823: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 4.0 MiB/s wr, 483 op/s 2023-10-06T23:28:37.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:37 smithi190 ceph-mon[102658]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-10-06T23:28:38.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:37 smithi156 ceph-mon[102862]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-10-06T23:28:38.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:37 smithi008 ceph-mon[98532]: pgmap v824: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-10-06T23:28:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 825.0 s, 285.6 tps, lat 347.408 ms stddev 110.374 2023-10-06T23:28:39.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:39 smithi190 ceph-mon[102658]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 4.1 MiB/s wr, 507 op/s 2023-10-06T23:28:40.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:39 smithi156 ceph-mon[102862]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 4.1 MiB/s wr, 507 op/s 2023-10-06T23:28:40.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:39 smithi008 ceph-mon[98532]: pgmap v825: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 4.1 MiB/s wr, 507 op/s 2023-10-06T23:28:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 -- 172.21.15.8:0/3932575004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 msgr2=0x7f57c0073d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3932575004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 0x7f57c0073d30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f57a80098f0 tx=0x7f57a8009c00 comp rx=0 tx=0).stop 2023-10-06T23:28:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 -- 172.21.15.8:0/3932575004 shutdown_connections 2023-10-06T23:28:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3932575004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57c0108dc0 0x7f57c010b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3932575004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0074e90 0x7f57c00732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3932575004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 0x7f57c0073d30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 -- 172.21.15.8:0/3932575004 >> 172.21.15.8:0/3932575004 conn(0x7f57c00fc480 msgr2=0x7f57c00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 -- 172.21.15.8:0/3932575004 shutdown_connections 2023-10-06T23:28:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.759+0000 7f57c59ff700 1 -- 172.21.15.8:0/3932575004 wait complete. 2023-10-06T23:28:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.760+0000 7f57c59ff700 1 Processor -- start 2023-10-06T23:28:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57c59ff700 1 -- start start 2023-10-06T23:28:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57c59ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 0x7f57c019d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57c59ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57c0074e90 0x7f57c019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57c59ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0108dc0 0x7f57c019e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57c59ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c019ec60 con 0x7f57c00738b0 2023-10-06T23:28:41.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57c59ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c019edd0 con 0x7f57c0074e90 2023-10-06T23:28:41.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57c59ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c019ef90 con 0x7f57c0108dc0 2023-10-06T23:28:41.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 0x7f57c019d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.761+0000 7f57b67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57c0074e90 0x7f57c019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57b67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57c0074e90 0x7f57c019d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:51624/0 (socket says 172.21.15.8:51624) 2023-10-06T23:28:41.764 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57b67fc700 1 -- 172.21.15.8:0/3477794474 learned_addr learned my addr 172.21.15.8:0/3477794474 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:41.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57bf7fe700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0108dc0 0x7f57c019e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57b67fc700 1 -- 172.21.15.8:0/3477794474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0108dc0 msgr2=0x7f57c019e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57b67fc700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0108dc0 0x7f57c019e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57b67fc700 1 -- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 msgr2=0x7f57c019d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57b67fc700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 0x7f57c019d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57b67fc700 1 -- 172.21.15.8:0/3477794474 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009d00 con 0x7f57c0074e90 2023-10-06T23:28:41.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57beffd700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 0x7f57c019d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:28:41.765 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.762+0000 7f57b67fc700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57c0074e90 0x7f57c019d780 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f57a800b790 tx=0x7f57a800b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:41.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.763+0000 7f57c49fd700 1 -- 172.21.15.8:0/3477794474 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a801c070 con 0x7f57c0074e90 2023-10-06T23:28:41.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.763+0000 7f57c59ff700 1 -- 172.21.15.8:0/3477794474 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a8009520 con 0x7f57c0074e90 2023-10-06T23:28:41.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.763+0000 7f57c49fd700 1 -- 172.21.15.8:0/3477794474 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57a800f7b0 con 0x7f57c0074e90 2023-10-06T23:28:41.766 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.763+0000 7f57c49fd700 1 -- 172.21.15.8:0/3477794474 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8004a50 con 0x7f57c0074e90 2023-10-06T23:28:41.767 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.763+0000 7f57c59ff700 1 -- 172.21.15.8:0/3477794474 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c01a5850 con 0x7f57c0074e90 2023-10-06T23:28:41.769 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.768+0000 7f57c49fd700 1 -- 172.21.15.8:0/3477794474 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f57a8020070 con 0x7f57c0074e90 2023-10-06T23:28:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.770+0000 7f57c49fd700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57ac0a1500 0x7f57ac0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.770+0000 7f57c49fd700 1 -- 172.21.15.8:0/3477794474 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57a80cdb20 con 0x7f57c0074e90 2023-10-06T23:28:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.770+0000 7f57d92d2b80 1 Processor -- start 2023-10-06T23:28:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.770+0000 7f57beffd700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57ac0a1500 0x7f57ac0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.770+0000 7f57d92d2b80 1 -- start start 2023-10-06T23:28:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e19542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1955450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 0x5641e195c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e18bc400 con 0x5641e1955990 2023-10-06T23:28:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e18adbc0 con 0x5641e1953ec0 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e18ab4e0 con 0x5641e1954fd0 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e19542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 0x5641e195c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e19542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:51634/0 (socket says 172.21.15.8:51634) 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57beffd700 1 -- 172.21.15.8:0/3824822359 learned_addr learned my addr 172.21.15.8:0/3824822359 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.771+0000 7f57b67fc700 1 --2- 172.21.15.8:0/3824822359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1955450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57beffd700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57ac0a1500 0x7f57ac0a39c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f57b00156a0 tx=0x7f57b0015a60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57beffd700 1 -- 172.21.15.8:0/3824822359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 msgr2=0x5641e1955450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57beffd700 1 --2- 172.21.15.8:0/3824822359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1955450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57beffd700 1 -- 172.21.15.8:0/3824822359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 msgr2=0x5641e195c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57beffd700 1 --2- 172.21.15.8:0/3824822359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 0x5641e195c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57beffd700 1 -- 172.21.15.8:0/3824822359 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641e16d1d80 con 0x5641e1953ec0 2023-10-06T23:28:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57beffd700 1 --2- 172.21.15.8:0/3824822359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e19542e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f57b00117c0 tx=0x7f57b001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dee127efa4ac340 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57b5ffb700 1 -- 172.21.15.8:0/3824822359 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00152d0 con 0x5641e1953ec0 2023-10-06T23:28:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57b5ffb700 1 -- 172.21.15.8:0/3824822359 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57b001b070 con 0x5641e1953ec0 2023-10-06T23:28:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.772+0000 7f57b5ffb700 1 -- 172.21.15.8:0/3824822359 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0003c60 con 0x5641e1953ec0 2023-10-06T23:28:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.773+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3824822359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 msgr2=0x5641e19542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.773+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3824822359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e19542e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f57b00117c0 tx=0x7f57b001f000 comp rx=0 tx=0).stop 2023-10-06T23:28:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.774+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3824822359 shutdown_connections 2023-10-06T23:28:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.774+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3824822359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 0x5641e195c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.774+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3824822359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e19542e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.774+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3824822359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1955450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.774+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3824822359 >> 172.21.15.8:0/3824822359 conn(0x5641e18c8200 msgr2=0x5641e194ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.774+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3824822359 shutdown_connections 2023-10-06T23:28:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.774+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3824822359 wait complete. 2023-10-06T23:28:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.775+0000 7f57d92d2b80 1 -- start start 2023-10-06T23:28:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.775+0000 7f57d92d2b80 1 Processor -- start 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e195db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e195e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 0x5641e1965080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e18a6dd0 con 0x5641e1955990 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e18436b0 con 0x5641e1953ec0 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e1843350 con 0x5641e1954fd0 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57d92d2b80 10 client.0 _ll_register_callbacks cb 0x5641e16a07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e195db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57b67fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e195e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57b67fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e195e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:48670/0 (socket says 172.21.15.8:48670) 2023-10-06T23:28:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57b67fc700 1 -- 172.21.15.8:0/3530776826 learned_addr learned my addr 172.21.15.8:0/3530776826 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.776+0000 7f57bf7fe700 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 0x5641e1965080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.777+0000 7f57b67fc700 1 -- 172.21.15.8:0/3530776826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 msgr2=0x5641e195db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.777+0000 7f57b67fc700 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e195db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.777+0000 7f57b67fc700 1 -- 172.21.15.8:0/3530776826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 msgr2=0x5641e1965080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.777+0000 7f57b67fc700 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 0x5641e1965080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.777+0000 7f57b67fc700 1 -- 172.21.15.8:0/3530776826 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b0011510 con 0x5641e1954fd0 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.777+0000 7f57b67fc700 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e195e040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f57a809ae10 tx=0x7f57a809a8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3dd8fb23e9654ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.777+0000 7f579effd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.778+0000 7f579effd700 1 -- 172.21.15.8:0/3530776826 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a809a570 con 0x5641e1954fd0 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.778+0000 7f579effd700 1 -- 172.21.15.8:0/3530776826 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57a809ae80 con 0x5641e1954fd0 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.778+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3530776826 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641e1946d50 con 0x5641e1954fd0 2023-10-06T23:28:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.778+0000 7f579effd700 1 -- 172.21.15.8:0/3530776826 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57a809efd0 con 0x5641e1954fd0 2023-10-06T23:28:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.778+0000 7f57d92d2b80 10 client.27043 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.778+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3530776826 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5641e16bac00 con 0x5641e1954fd0 2023-10-06T23:28:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.778+0000 7f579effd700 1 -- 172.21.15.8:0/3530776826 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57a80b9030 con 0x5641e1954fd0 2023-10-06T23:28:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.779+0000 7f579effd700 1 -- 172.21.15.8:0/3530776826 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f57a80a2cf0 con 0x5641e1954fd0 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.779+0000 7f57d92d2b80 10 client.27043 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.779+0000 7f57d92d2b80 10 client.27043 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.779+0000 7f57d92d2b80 20 client.27043 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.779+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5641e19695b0 0x5641e196b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.779+0000 7f57d92d2b80 4 client.27043 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.779+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3530776826 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641e189fdb0 con 0x5641e19695b0 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.780+0000 7f57beffd700 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5641e19695b0 0x5641e196b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.780+0000 7f579effd700 10 client.27043 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.780+0000 7f57beffd700 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5641e19695b0 0x5641e196b9a0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f56520122ea88ab3 server_cookie=988b1a9f46d7b89f in_seq=0 out_seq=0 2023-10-06T23:28:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.781+0000 7f579effd700 1 -- 172.21.15.8:0/3530776826 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5641e189fdb0 con 0x5641e19695b0 2023-10-06T23:28:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.781+0000 7f579effd700 10 client.27043 handle_command_reply: tid=0 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.781+0000 7f57d92d2b80 1 client.27043 shutdown 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3530776826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 msgr2=0x5641e195e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e195e040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f57a809ae10 tx=0x7f57a809a8b0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3530776826 shutdown_connections 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5641e19695b0 0x5641e196b9a0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1955990 0x5641e1965080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1953ec0 0x5641e195db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/3530776826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e195e040 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3530776826 >> 172.21.15.8:0/3530776826 conn(0x5641e18c8200 msgr2=0x5641e194e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f579effd700 0 client.27043 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3530776826 shutdown_connections 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 1 -- 172.21.15.8:0/3530776826 wait complete. 2023-10-06T23:28:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.782+0000 7f57d92d2b80 20 client.27043 trim_cache size 0 max 16384 2023-10-06T23:28:41.806 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.805+0000 7f57d92d2b80 1 Processor -- start 2023-10-06T23:28:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.805+0000 7f57d92d2b80 1 -- start start 2023-10-06T23:28:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1953ec0 0x5641e194e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.807 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1965040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e196b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e17278c0 con 0x5641e1953ec0 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e195cfe0 con 0x5641e1955990 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e195d670 con 0x5641e1954fd0 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1953ec0 0x5641e194e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1953ec0 0x5641e194e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34222/0 (socket says 172.21.15.8:34222) 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57beffd700 1 -- 172.21.15.8:0/4121556964 learned_addr learned my addr 172.21.15.8:0/4121556964 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57bf7fe700 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e196b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.806+0000 7f57b67fc700 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1965040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.807+0000 7f57beffd700 1 -- 172.21.15.8:0/4121556964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 msgr2=0x5641e1965040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.807+0000 7f57beffd700 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1965040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.807+0000 7f57beffd700 1 -- 172.21.15.8:0/4121556964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 msgr2=0x5641e196b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.807+0000 7f57beffd700 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e196b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.807+0000 7f57beffd700 1 -- 172.21.15.8:0/4121556964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641e16f81f0 con 0x5641e1953ec0 2023-10-06T23:28:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.807+0000 7f57b67fc700 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1965040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:28:41.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.807+0000 7f57beffd700 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1953ec0 0x5641e194e250 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f57b0003710 tx=0x7f57b0015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa0c5eb97c47b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:41.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.807+0000 7f57b6ffd700 1 -- 172.21.15.8:0/4121556964 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0003740 con 0x5641e1953ec0 2023-10-06T23:28:41.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.808+0000 7f57b6ffd700 1 -- 172.21.15.8:0/4121556964 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57b0011db0 con 0x5641e1953ec0 2023-10-06T23:28:41.810 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.808+0000 7f57b6ffd700 1 -- 172.21.15.8:0/4121556964 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0003ba0 con 0x5641e1953ec0 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.808+0000 7f57d92d2b80 1 -- 172.21.15.8:0/4121556964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1953ec0 msgr2=0x5641e194e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.808+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1953ec0 0x5641e194e250 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f57b0003710 tx=0x7f57b0015f90 comp rx=0 tx=0).stop 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 -- 172.21.15.8:0/4121556964 shutdown_connections 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1953ec0 0x5641e194e250 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e196b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/4121556964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1954fd0 0x5641e1965040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 -- 172.21.15.8:0/4121556964 >> 172.21.15.8:0/4121556964 conn(0x5641e18c8200 msgr2=0x5641e195c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 -- 172.21.15.8:0/4121556964 shutdown_connections 2023-10-06T23:28:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 -- 172.21.15.8:0/4121556964 wait complete. 2023-10-06T23:28:41.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 -- start start 2023-10-06T23:28:41.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.809+0000 7f57d92d2b80 1 Processor -- start 2023-10-06T23:28:41.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.810+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1953ec0 0x5641e1960b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.812 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.810+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1954fd0 0x5641e19610a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.810+0000 7f57d92d2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e19640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.810+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e1964600 con 0x5641e1954fd0 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.810+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e1964770 con 0x5641e1955990 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.810+0000 7f57d92d2b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e19648e0 con 0x5641e1953ec0 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.810+0000 7f57d92d2b80 10 client.0 _ll_register_callbacks cb 0x5641e16a07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57beffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1953ec0 0x5641e1960b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57beffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1953ec0 0x5641e1960b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:48694/0 (socket says 172.21.15.8:48694) 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57beffd700 1 -- 172.21.15.8:0/846802485 learned_addr learned my addr 172.21.15.8:0/846802485 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57bf7fe700 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e19640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57b67fc700 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1954fd0 0x5641e19610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57beffd700 1 -- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 msgr2=0x5641e19640c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57beffd700 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e19640c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57beffd700 1 -- 172.21.15.8:0/846802485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1954fd0 msgr2=0x5641e19610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57beffd700 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1954fd0 0x5641e19610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57beffd700 1 -- 172.21.15.8:0/846802485 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b0025040 con 0x5641e1953ec0 2023-10-06T23:28:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.811+0000 7f57bf7fe700 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e19640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:28:41.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.812+0000 7f57beffd700 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1953ec0 0x5641e1960b60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f57b0005d90 tx=0x7f57b0009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86256b5fecc57ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:41.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.812+0000 7f579effd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:28:41.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.812+0000 7f579effd700 1 -- 172.21.15.8:0/846802485 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b002f350 con 0x5641e1953ec0 2023-10-06T23:28:41.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.812+0000 7f579effd700 1 -- 172.21.15.8:0/846802485 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57b0015030 con 0x5641e1953ec0 2023-10-06T23:28:41.815 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.812+0000 7f57d92d2b80 1 -- 172.21.15.8:0/846802485 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57b001b070 con 0x5641e1953ec0 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.812+0000 7f579effd700 1 -- 172.21.15.8:0/846802485 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57b00151f0 con 0x5641e1953ec0 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.812+0000 7f57d92d2b80 10 client.27049 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.812+0000 7f57d92d2b80 1 -- 172.21.15.8:0/846802485 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5641e16d0250 con 0x5641e1953ec0 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.813+0000 7f579effd700 1 -- 172.21.15.8:0/846802485 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57b001b070 con 0x5641e1953ec0 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.813+0000 7f579effd700 1 -- 172.21.15.8:0/846802485 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f57b0036030 con 0x5641e1953ec0 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.813+0000 7f57d92d2b80 10 client.27049 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.813+0000 7f57d92d2b80 10 client.27049 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.813+0000 7f57d92d2b80 20 client.27049 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.813+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5641e19dfbd0 0x5641e19e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.813+0000 7f57d92d2b80 4 client.27049 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.813+0000 7f57d92d2b80 1 -- 172.21.15.8:0/846802485 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5641e189fad0 con 0x5641e19dfbd0 2023-10-06T23:28:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.814+0000 7f57b67fc700 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5641e19dfbd0 0x5641e19e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:41.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.814+0000 7f579effd700 10 client.27049 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:41.817 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.814+0000 7f57b67fc700 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5641e19dfbd0 0x5641e19e1ff0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b9e8017175d6b47 server_cookie=e19750fca4325806 in_seq=0 out_seq=0 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f579effd700 1 -- 172.21.15.8:0/846802485 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5641e189fad0 con 0x5641e19dfbd0 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f579effd700 10 client.27049 handle_command_reply: tid=0 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 client.27049 shutdown 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 -- 172.21.15.8:0/846802485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1953ec0 msgr2=0x5641e1960b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1953ec0 0x5641e1960b60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f57b0005d90 tx=0x7f57b0009c70 comp rx=0 tx=0).stop 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 -- 172.21.15.8:0/846802485 shutdown_connections 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x5641e19dfbd0 0x5641e19e1ff0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641e1955990 0x5641e19640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641e1953ec0 0x5641e1960b60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 --2- 172.21.15.8:0/846802485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5641e1954fd0 0x5641e19610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f579effd700 0 client.27049 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 -- 172.21.15.8:0/846802485 >> 172.21.15.8:0/846802485 conn(0x5641e18c8200 msgr2=0x5641e196b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.834+0000 7f57d92d2b80 1 -- 172.21.15.8:0/846802485 shutdown_connections 2023-10-06T23:28:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.835+0000 7f57d92d2b80 1 -- 172.21.15.8:0/846802485 wait complete. 2023-10-06T23:28:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.835+0000 7f57d92d2b80 20 client.27049 trim_cache size 0 max 16384 2023-10-06T23:28:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:28:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:28:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:28:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 -- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57ac0a1500 msgr2=0x7f57ac0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57ac0a1500 0x7f57ac0a39c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f57b00156a0 tx=0x7f57b0015a60 comp rx=0 tx=0).stop 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 -- 172.21.15.8:0/3477794474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57c0074e90 msgr2=0x7f57c019d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57c0074e90 0x7f57c019d780 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f57a800b790 tx=0x7f57a800b7c0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 -- 172.21.15.8:0/3477794474 shutdown_connections 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f57ac0a1500 0x7f57ac0a39c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57c00738b0 0x7f57c019d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57c0108dc0 0x7f57c019e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 --2- 172.21.15.8:0/3477794474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57c0074e90 0x7f57c019d780 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 -- 172.21.15.8:0/3477794474 >> 172.21.15.8:0/3477794474 conn(0x7f57c00fc480 msgr2=0x7f57c00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 -- 172.21.15.8:0/3477794474 shutdown_connections 2023-10-06T23:28:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:41.836+0000 7f57c59ff700 1 -- 172.21.15.8:0/3477794474 wait complete. 2023-10-06T23:28:41.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:41 smithi190 ceph-mon[102658]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 5.5 MiB/s wr, 643 op/s 2023-10-06T23:28:42.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:41 smithi156 ceph-mon[102862]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 5.5 MiB/s wr, 643 op/s 2023-10-06T23:28:42.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:41 smithi008 ceph-mon[98532]: pgmap v826: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 5.5 MiB/s wr, 643 op/s 2023-10-06T23:28:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:43 smithi156 ceph-mon[102862]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.5 MiB/s wr, 552 op/s 2023-10-06T23:28:43.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:43 smithi008 ceph-mon[98532]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.5 MiB/s wr, 552 op/s 2023-10-06T23:28:43.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:43 smithi190 ceph-mon[102658]: pgmap v827: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.5 MiB/s wr, 552 op/s 2023-10-06T23:28:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 830.0 s, 282.2 tps, lat 353.833 ms stddev 111.949 2023-10-06T23:28:45.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:45 smithi190 ceph-mon[102658]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 4.4 MiB/s wr, 549 op/s 2023-10-06T23:28:46.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:45 smithi156 ceph-mon[102862]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 4.4 MiB/s wr, 549 op/s 2023-10-06T23:28:46.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:45 smithi008 ceph-mon[98532]: pgmap v828: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 4.4 MiB/s wr, 549 op/s 2023-10-06T23:28:47.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:47 smithi190 ceph-mon[102658]: pgmap v829: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 5.3 MiB/s wr, 628 op/s 2023-10-06T23:28:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:47 smithi156 ceph-mon[102862]: pgmap v829: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 5.3 MiB/s wr, 628 op/s 2023-10-06T23:28:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:47 smithi008 ceph-mon[98532]: pgmap v829: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 5.3 MiB/s wr, 628 op/s 2023-10-06T23:28:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 835.0 s, 272.8 tps, lat 364.832 ms stddev 75.525 2023-10-06T23:28:49.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:49 smithi190 ceph-mon[102658]: pgmap v830: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-10-06T23:28:50.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:49 smithi156 ceph-mon[102862]: pgmap v830: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-10-06T23:28:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:49 smithi008 ceph-mon[98532]: pgmap v830: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-10-06T23:28:51.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:51 smithi190 ceph-mon[102658]: pgmap v831: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.4 MiB/s wr, 542 op/s 2023-10-06T23:28:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:51 smithi156 ceph-mon[102862]: pgmap v831: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.4 MiB/s wr, 542 op/s 2023-10-06T23:28:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:51 smithi008 ceph-mon[98532]: pgmap v831: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.4 MiB/s wr, 542 op/s 2023-10-06T23:28:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:53 smithi156 ceph-mon[102862]: pgmap v832: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 3.8 MiB/s wr, 478 op/s 2023-10-06T23:28:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:53 smithi008 ceph-mon[98532]: pgmap v832: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 3.8 MiB/s wr, 478 op/s 2023-10-06T23:28:53.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:53 smithi190 ceph-mon[102658]: pgmap v832: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 3.8 MiB/s wr, 478 op/s 2023-10-06T23:28:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 840.0 s, 267.6 tps, lat 377.116 ms stddev 70.767 2023-10-06T23:28:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 -- 172.21.15.8:0/1020319609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0838100eb0 msgr2=0x7f08381012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 --2- 172.21.15.8:0/1020319609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0838100eb0 0x7f08381012d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0828009990 tx=0x7f0828009ca0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 -- 172.21.15.8:0/1020319609 shutdown_connections 2023-10-06T23:28:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 --2- 172.21.15.8:0/1020319609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0838100eb0 0x7f08381012d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 --2- 172.21.15.8:0/1020319609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0838102a50 0x7f0838109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 --2- 172.21.15.8:0/1020319609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0838102090 0x7f0838102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 -- 172.21.15.8:0/1020319609 >> 172.21.15.8:0/1020319609 conn(0x7f08380fc430 msgr2=0x7f08380fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 -- 172.21.15.8:0/1020319609 shutdown_connections 2023-10-06T23:28:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.277+0000 7f083c9ff700 1 -- 172.21.15.8:0/1020319609 wait complete. 2023-10-06T23:28:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.279+0000 7f083c9ff700 1 Processor -- start 2023-10-06T23:28:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.279+0000 7f083c9ff700 1 -- start start 2023-10-06T23:28:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f083c9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0838100eb0 0x7f0838198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f083c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0838102090 0x7f0838199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f083c9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0838102a50 0x7f083819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f083c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083819a8e0 con 0x7f0838102090 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f083c9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083819aa50 con 0x7f0838102a50 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f083c9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083819ac10 con 0x7f0838100eb0 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f082e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0838100eb0 0x7f0838198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f082e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0838100eb0 0x7f0838198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39940/0 (socket says 172.21.15.8:39940) 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f082e59c700 1 -- 172.21.15.8:0/787532500 learned_addr learned my addr 172.21.15.8:0/787532500 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f0836d9d700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0838102a50 0x7f083819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.280+0000 7f083659c700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0838102090 0x7f0838199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.281+0000 7f082e59c700 1 -- 172.21.15.8:0/787532500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0838102a50 msgr2=0x7f083819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.281+0000 7f082e59c700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0838102a50 0x7f083819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.281+0000 7f082e59c700 1 -- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0838102090 msgr2=0x7f0838199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.281+0000 7f082e59c700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0838102090 0x7f0838199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.281+0000 7f082e59c700 1 -- 172.21.15.8:0/787532500 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280095f0 con 0x7f0838100eb0 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.281+0000 7f0836d9d700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0838102a50 0x7f083819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.281+0000 7f082e59c700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0838100eb0 0x7f0838198ef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f08280098e0 tx=0x7f0828004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.281+0000 7f082ffff700 1 -- 172.21.15.8:0/787532500 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082801d070 con 0x7f0838100eb0 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.282+0000 7f083c9ff700 1 -- 172.21.15.8:0/787532500 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083819ae90 con 0x7f0838100eb0 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.282+0000 7f082ffff700 1 -- 172.21.15.8:0/787532500 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f082800bdb0 con 0x7f0838100eb0 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.282+0000 7f082ffff700 1 -- 172.21.15.8:0/787532500 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828022cf0 con 0x7f0838100eb0 2023-10-06T23:28:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.282+0000 7f083c9ff700 1 -- 172.21.15.8:0/787532500 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08381a1600 con 0x7f0838100eb0 2023-10-06T23:28:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.287+0000 7f082ffff700 1 -- 172.21.15.8:0/787532500 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0828022470 con 0x7f0838100eb0 2023-10-06T23:28:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.287+0000 7f085041db80 1 Processor -- start 2023-10-06T23:28:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.288+0000 7f085041db80 1 -- start start 2023-10-06T23:28:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.288+0000 7f085041db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3cec0 0x56211ff3d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.288+0000 7f085041db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff3e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.288+0000 7f085041db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3e990 0x56211ff45220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.288+0000 7f085041db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211fea5400 con 0x56211ff3e990 2023-10-06T23:28:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.288+0000 7f085041db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211fe96bc0 con 0x56211ff3cec0 2023-10-06T23:28:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.288+0000 7f085041db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211fe944e0 con 0x56211ff3dfd0 2023-10-06T23:28:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.289+0000 7f0836d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3cec0 0x56211ff3d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.289+0000 7f0836d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3cec0 0x56211ff3d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:36120/0 (socket says 172.21.15.8:36120) 2023-10-06T23:28:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.289+0000 7f0836d9d700 1 -- 172.21.15.8:0/415726779 learned_addr learned my addr 172.21.15.8:0/415726779 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.289+0000 7f082e59c700 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff3e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.289+0000 7f083659c700 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3e990 0x56211ff45220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.289+0000 7f082ffff700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08240a1500 0x7f08240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f082e59c700 1 -- 172.21.15.8:0/415726779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3cec0 msgr2=0x56211ff3d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f082e59c700 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3cec0 0x56211ff3d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f082e59c700 1 -- 172.21.15.8:0/415726779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3e990 msgr2=0x56211ff45220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f082e59c700 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3e990 0x56211ff45220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f082e59c700 1 -- 172.21.15.8:0/415726779 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56211fcbad80 con 0x56211ff3dfd0 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f0836d9d700 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3cec0 0x56211ff3d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:28:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f082ffff700 1 -- 172.21.15.8:0/787532500 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f08280ce2d0 con 0x7f0838100eb0 2023-10-06T23:28:55.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f083659c700 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3e990 0x56211ff45220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:28:55.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f082e59c700 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff3e450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f08280cbdb0 tx=0x7f0828009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e31a5b74228452c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:55.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.290+0000 7f0836d9d700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08240a1500 0x7f08240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.291+0000 7f082cd99700 1 -- 172.21.15.8:0/415726779 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280d1ea0 con 0x56211ff3dfd0 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.291+0000 7f082cd99700 1 -- 172.21.15.8:0/415726779 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f082809b580 con 0x56211ff3dfd0 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.291+0000 7f082cd99700 1 -- 172.21.15.8:0/415726779 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082809f900 con 0x56211ff3dfd0 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 -- 172.21.15.8:0/415726779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 msgr2=0x56211ff3e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff3e450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f08280cbdb0 tx=0x7f0828009310 comp rx=0 tx=0).stop 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f0836d9d700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08240a1500 0x7f08240a39c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x56211ff3cc60 tx=0x7f0830009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 -- 172.21.15.8:0/415726779 shutdown_connections 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3e990 0x56211ff45220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3cec0 0x56211ff3d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 --2- 172.21.15.8:0/415726779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff3e450 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 -- 172.21.15.8:0/415726779 >> 172.21.15.8:0/415726779 conn(0x56211feb1200 msgr2=0x56211ff37bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:55.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 -- 172.21.15.8:0/415726779 shutdown_connections 2023-10-06T23:28:55.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 -- 172.21.15.8:0/415726779 wait complete. 2023-10-06T23:28:55.296 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.292+0000 7f085041db80 1 -- start start 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.293+0000 7f085041db80 1 Processor -- start 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.293+0000 7f085041db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3cec0 0x56211ff46750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.293+0000 7f085041db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff46c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.293+0000 7f085041db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.293+0000 7f085041db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211fe8fdd0 con 0x56211ff3cec0 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.293+0000 7f085041db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211fe2c6b0 con 0x56211ff3e990 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.293+0000 7f085041db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211fe2c350 con 0x56211ff3dfd0 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.293+0000 7f085041db80 10 client.0 _ll_register_callbacks cb 0x56211fc897a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f082e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3cec0 0x56211ff46750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f082e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3cec0 0x56211ff46750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48350/0 (socket says 172.21.15.8:48350) 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f082e59c700 1 -- 172.21.15.8:0/2604734162 learned_addr learned my addr 172.21.15.8:0/2604734162 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f083659c700 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff46c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f0836d9d700 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f082e59c700 1 -- 172.21.15.8:0/2604734162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 msgr2=0x56211ff46c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f082e59c700 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff46c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f082e59c700 1 -- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 msgr2=0x56211ff4dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f082e59c700 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f082e59c700 1 -- 172.21.15.8:0/2604734162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08200098e0 con 0x56211ff3cec0 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.294+0000 7f0836d9d700 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f082e59c700 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3cec0 0x56211ff46750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f08280cc150 tx=0x7f08280d1bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26332d233b1e10e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f081dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:28:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f081dffb700 1 -- 172.21.15.8:0/2604734162 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280d1ea0 con 0x56211ff3cec0 2023-10-06T23:28:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f081dffb700 1 -- 172.21.15.8:0/2604734162 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f08280a3ab0 con 0x56211ff3cec0 2023-10-06T23:28:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f085041db80 1 -- 172.21.15.8:0/2604734162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56211ff2fd50 con 0x56211ff3cec0 2023-10-06T23:28:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f081dffb700 1 -- 172.21.15.8:0/2604734162 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f082809b2f0 con 0x56211ff3cec0 2023-10-06T23:28:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f085041db80 10 client.17127 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f085041db80 1 -- 172.21.15.8:0/2604734162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f08381a1600 con 0x56211ff3cec0 2023-10-06T23:28:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.295+0000 7f081dffb700 1 -- 172.21.15.8:0/2604734162 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56211ff2fd50 con 0x56211ff3cec0 2023-10-06T23:28:55.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.296+0000 7f081dffb700 1 -- 172.21.15.8:0/2604734162 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f08280a3620 con 0x56211ff3cec0 2023-10-06T23:28:55.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.296+0000 7f085041db80 10 client.17127 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.296+0000 7f085041db80 10 client.17127 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.296+0000 7f085041db80 20 client.17127 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.296+0000 7f085041db80 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56211ff52070 0x56211ff54460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.296+0000 7f085041db80 4 client.17127 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.296+0000 7f085041db80 1 -- 172.21.15.8:0/2604734162 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56211fe88db0 con 0x56211ff52070 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.296+0000 7f083659c700 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56211ff52070 0x56211ff54460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.297+0000 7f083659c700 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56211ff52070 0x56211ff54460 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdaf12d7eb42ca32 server_cookie=b69436671eb1373e in_seq=0 out_seq=0 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.297+0000 7f081dffb700 10 client.17127 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f081dffb700 1 -- 172.21.15.8:0/2604734162 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56211fe88db0 con 0x56211ff52070 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f081dffb700 10 client.17127 handle_command_reply: tid=0 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 client.17127 shutdown 2023-10-06T23:28:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 -- 172.21.15.8:0/2604734162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3cec0 msgr2=0x56211ff46750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3cec0 0x56211ff46750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f08280cc150 tx=0x7f08280d1bc0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 -- 172.21.15.8:0/2604734162 shutdown_connections 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56211ff52070 0x56211ff54460 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3cec0 0x56211ff46750 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 --2- 172.21.15.8:0/2604734162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3dfd0 0x56211ff46c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f081dffb700 0 client.17127 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.298+0000 7f085041db80 1 -- 172.21.15.8:0/2604734162 >> 172.21.15.8:0/2604734162 conn(0x56211feb1200 msgr2=0x56211ff37250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.299+0000 7f085041db80 1 -- 172.21.15.8:0/2604734162 shutdown_connections 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.299+0000 7f085041db80 1 -- 172.21.15.8:0/2604734162 wait complete. 2023-10-06T23:28:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.299+0000 7f085041db80 20 client.17127 trim_cache size 0 max 16384 2023-10-06T23:28:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.323+0000 7f085041db80 1 Processor -- start 2023-10-06T23:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.323+0000 7f085041db80 1 -- start start 2023-10-06T23:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.323+0000 7f085041db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff37250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.323+0000 7f085041db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff37980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.323+0000 7f085041db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.323+0000 7f085041db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211fd108c0 con 0x56211ff3dfd0 2023-10-06T23:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.323+0000 7f085041db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211ff3ee60 con 0x56211ff3e990 2023-10-06T23:28:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.323+0000 7f085041db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211ff34860 con 0x56211ff3cec0 2023-10-06T23:28:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f082e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff37250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f082e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff37250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39960/0 (socket says 172.21.15.8:39960) 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f082e59c700 1 -- 172.21.15.8:0/1323509572 learned_addr learned my addr 172.21.15.8:0/1323509572 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f083659c700 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff37980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f0836d9d700 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f082e59c700 1 -- 172.21.15.8:0/1323509572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 msgr2=0x56211ff4dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f082e59c700 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f082e59c700 1 -- 172.21.15.8:0/1323509572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 msgr2=0x56211ff37980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f082e59c700 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff37980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f082e59c700 1 -- 172.21.15.8:0/1323509572 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56211fca3c00 con 0x56211ff3cec0 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f083659c700 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff37980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:28:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.324+0000 7f0836d9d700 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:28:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.325+0000 7f082e59c700 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff37250 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f08280a3580 tx=0x7f082809b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b6a0e1211dc9b28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.325+0000 7f082d59a700 1 -- 172.21.15.8:0/1323509572 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280d1ea0 con 0x56211ff3cec0 2023-10-06T23:28:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.325+0000 7f082d59a700 1 -- 172.21.15.8:0/1323509572 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f082809b2f0 con 0x56211ff3cec0 2023-10-06T23:28:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.325+0000 7f082d59a700 1 -- 172.21.15.8:0/1323509572 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082809aca0 con 0x56211ff3cec0 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 -- 172.21.15.8:0/1323509572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 msgr2=0x56211ff37250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff37250 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f08280a3580 tx=0x7f082809b820 comp rx=0 tx=0).stop 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 -- 172.21.15.8:0/1323509572 shutdown_connections 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff37250 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 --2- 172.21.15.8:0/1323509572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff37980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 -- 172.21.15.8:0/1323509572 >> 172.21.15.8:0/1323509572 conn(0x56211feb1200 msgr2=0x56211ff58dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 -- 172.21.15.8:0/1323509572 shutdown_connections 2023-10-06T23:28:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 -- 172.21.15.8:0/1323509572 wait complete. 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.326+0000 7f085041db80 1 -- start start 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.327+0000 7f085041db80 1 Processor -- start 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.327+0000 7f085041db80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff49ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.327+0000 7f085041db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff49ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.327+0000 7f085041db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.327+0000 7f085041db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211ff4d550 con 0x56211ff3dfd0 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.327+0000 7f085041db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211ff4d6c0 con 0x56211ff3e990 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.327+0000 7f085041db80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211ff4d880 con 0x56211ff3cec0 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.327+0000 7f085041db80 10 client.0 _ll_register_callbacks cb 0x56211fc897a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f082e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff49ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f082e59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff49ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:39972/0 (socket says 172.21.15.8:39972) 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f082e59c700 1 -- 172.21.15.8:0/2504822892 learned_addr learned my addr 172.21.15.8:0/2504822892 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:28:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f083659c700 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff49ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f0836d9d700 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f083659c700 1 -- 172.21.15.8:0/2504822892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 msgr2=0x56211ff49ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f083659c700 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff49ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f083659c700 1 -- 172.21.15.8:0/2504822892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 msgr2=0x56211ff4d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f083659c700 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f083659c700 1 -- 172.21.15.8:0/2504822892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082001f9f0 con 0x56211ff3dfd0 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f082e59c700 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff49ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f083659c700 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff49ff0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x56211ff54a40 tx=0x7f0820010710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f654a344868a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.328+0000 7f081dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.329+0000 7f081dffb700 1 -- 172.21.15.8:0/2504822892 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0820017040 con 0x56211ff3dfd0 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.329+0000 7f085041db80 1 -- 172.21.15.8:0/2504822892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f082809b580 con 0x56211ff3dfd0 2023-10-06T23:28:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.329+0000 7f081dffb700 1 -- 172.21.15.8:0/2504822892 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0820010cc0 con 0x56211ff3dfd0 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.329+0000 7f081dffb700 1 -- 172.21.15.8:0/2504822892 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0820010e80 con 0x56211ff3dfd0 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.329+0000 7f085041db80 10 client.17133 fetch_fsmap learned FSMap version 37 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.329+0000 7f085041db80 1 -- 172.21.15.8:0/2504822892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f08381a1600 con 0x56211ff3dfd0 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.329+0000 7f081dffb700 1 -- 172.21.15.8:0/2504822892 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f082809b580 con 0x56211ff3dfd0 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.330+0000 7f081dffb700 1 -- 172.21.15.8:0/2504822892 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0820030070 con 0x56211ff3dfd0 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.330+0000 7f085041db80 10 client.17133 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.330+0000 7f085041db80 10 client.17133 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.330+0000 7f085041db80 20 client.17133 populate_metadata read hostname 'smithi008' 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.330+0000 7f085041db80 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56211ffaf520 0x56211ffb1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.330+0000 7f085041db80 4 client.17133 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:28:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.330+0000 7f085041db80 1 -- 172.21.15.8:0/2504822892 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56211fe88ad0 con 0x56211ffaf520 2023-10-06T23:28:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.331+0000 7f082e59c700 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56211ffaf520 0x56211ffb1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:28:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.331+0000 7f082e59c700 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56211ffaf520 0x56211ffb1910 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd344932f295d60 server_cookie=e1eac6b6f1908e1f in_seq=0 out_seq=0 2023-10-06T23:28:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.331+0000 7f081dffb700 10 client.17133 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.351+0000 7f081dffb700 1 -- 172.21.15.8:0/2504822892 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56211fe88ad0 con 0x56211ffaf520 2023-10-06T23:28:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.351+0000 7f081dffb700 10 client.17133 handle_command_reply: tid=0 2023-10-06T23:28:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.351+0000 7f085041db80 1 client.17133 shutdown 2023-10-06T23:28:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.351+0000 7f085041db80 1 -- 172.21.15.8:0/2504822892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 msgr2=0x56211ff49ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.351+0000 7f085041db80 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff49ff0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x56211ff54a40 tx=0x7f0820010710 comp rx=0 tx=0).stop 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 1 -- 172.21.15.8:0/2504822892 shutdown_connections 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x56211ffaf520 0x56211ffb1910 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56211ff3e990 0x56211ff4d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56211ff3cec0 0x56211ff49ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f081dffb700 0 client.17133 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 1 --2- 172.21.15.8:0/2504822892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56211ff3dfd0 0x56211ff49ff0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 1 -- 172.21.15.8:0/2504822892 >> 172.21.15.8:0/2504822892 conn(0x56211feb1200 msgr2=0x56211ff41640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 1 -- 172.21.15.8:0/2504822892 shutdown_connections 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 1 -- 172.21.15.8:0/2504822892 wait complete. 2023-10-06T23:28:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.352+0000 7f085041db80 20 client.17133 trim_cache size 0 max 16384 2023-10-06T23:28:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:28:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:28:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:28:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 -- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08240a1500 msgr2=0x7f08240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08240a1500 0x7f08240a39c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x56211ff3cc60 tx=0x7f0830009040 comp rx=0 tx=0).stop 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 -- 172.21.15.8:0/787532500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0838100eb0 msgr2=0x7f0838198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0838100eb0 0x7f0838198ef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f08280098e0 tx=0x7f0828004730 comp rx=0 tx=0).stop 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 -- 172.21.15.8:0/787532500 shutdown_connections 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f08240a1500 0x7f08240a39c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0838102a50 0x7f083819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0838100eb0 0x7f0838198ef0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 --2- 172.21.15.8:0/787532500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0838102090 0x7f0838199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:28:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 -- 172.21.15.8:0/787532500 >> 172.21.15.8:0/787532500 conn(0x7f08380fc430 msgr2=0x7f08380fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:28:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 -- 172.21.15.8:0/787532500 shutdown_connections 2023-10-06T23:28:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:28:55.353+0000 7f083c9ff700 1 -- 172.21.15.8:0/787532500 wait complete. 2023-10-06T23:28:55.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:55 smithi190 ceph-mon[102658]: pgmap v833: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 3.7 MiB/s wr, 461 op/s 2023-10-06T23:28:56.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:55 smithi156 ceph-mon[102862]: pgmap v833: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 3.7 MiB/s wr, 461 op/s 2023-10-06T23:28:56.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:55 smithi008 ceph-mon[98532]: pgmap v833: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 3.7 MiB/s wr, 461 op/s 2023-10-06T23:28:57.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:57 smithi190 ceph-mon[102658]: pgmap v834: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.4 MiB/s wr, 522 op/s 2023-10-06T23:28:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:57 smithi156 ceph-mon[102862]: pgmap v834: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.4 MiB/s wr, 522 op/s 2023-10-06T23:28:58.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:57 smithi008 ceph-mon[98532]: pgmap v834: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.4 MiB/s wr, 522 op/s 2023-10-06T23:28:59.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 845.0 s, 306.4 tps, lat 324.164 ms stddev 39.059 2023-10-06T23:28:59.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:28:59 smithi190 ceph-mon[102658]: pgmap v835: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 4.2 MiB/s wr, 507 op/s 2023-10-06T23:29:00.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:28:59 smithi156 ceph-mon[102862]: pgmap v835: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 4.2 MiB/s wr, 507 op/s 2023-10-06T23:29:00.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:28:59 smithi008 ceph-mon[98532]: pgmap v835: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 4.2 MiB/s wr, 507 op/s 2023-10-06T23:29:01.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:01 smithi190 ceph-mon[102658]: pgmap v836: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 4.7 MiB/s wr, 570 op/s 2023-10-06T23:29:02.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:01 smithi156 ceph-mon[102862]: pgmap v836: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 4.7 MiB/s wr, 570 op/s 2023-10-06T23:29:02.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:01 smithi008 ceph-mon[98532]: pgmap v836: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 4.7 MiB/s wr, 570 op/s 2023-10-06T23:29:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:03 smithi156 ceph-mon[102862]: pgmap v837: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.4 MiB/s wr, 543 op/s 2023-10-06T23:29:03.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:03 smithi008 ceph-mon[98532]: pgmap v837: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.4 MiB/s wr, 543 op/s 2023-10-06T23:29:03.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:03 smithi190 ceph-mon[102658]: pgmap v837: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.4 MiB/s wr, 543 op/s 2023-10-06T23:29:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 850.0 s, 282.8 tps, lat 356.553 ms stddev 38.827 2023-10-06T23:29:05.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:05 smithi190 ceph-mon[102658]: pgmap v838: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 4.6 MiB/s wr, 552 op/s 2023-10-06T23:29:06.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:05 smithi156 ceph-mon[102862]: pgmap v838: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 4.6 MiB/s wr, 552 op/s 2023-10-06T23:29:06.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:05 smithi008 ceph-mon[98532]: pgmap v838: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 4.6 MiB/s wr, 552 op/s 2023-10-06T23:29:07.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:07 smithi190 ceph-mon[102658]: pgmap v839: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.7 MiB/s wr, 576 op/s 2023-10-06T23:29:08.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:07 smithi156 ceph-mon[102862]: pgmap v839: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.7 MiB/s wr, 576 op/s 2023-10-06T23:29:08.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:07 smithi008 ceph-mon[98532]: pgmap v839: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.7 MiB/s wr, 576 op/s 2023-10-06T23:29:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.648+0000 7f1387fff700 1 -- 172.21.15.8:0/3320445988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388100d50 msgr2=0x7f1388101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.648+0000 7f1387fff700 1 --2- 172.21.15.8:0/3320445988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388100d50 0x7f1388101170 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1370009990 tx=0x7f1370009ca0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.649+0000 7f1387fff700 1 -- 172.21.15.8:0/3320445988 shutdown_connections 2023-10-06T23:29:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.649+0000 7f1387fff700 1 --2- 172.21.15.8:0/3320445988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13881028e0 0x7f1388109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.649+0000 7f1387fff700 1 --2- 172.21.15.8:0/3320445988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388100d50 0x7f1388101170 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.649+0000 7f1387fff700 1 --2- 172.21.15.8:0/3320445988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1388101f40 0x7f13881023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.649+0000 7f1387fff700 1 -- 172.21.15.8:0/3320445988 >> 172.21.15.8:0/3320445988 conn(0x7f13880fc2a0 msgr2=0x7f13880fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.649+0000 7f1387fff700 1 -- 172.21.15.8:0/3320445988 shutdown_connections 2023-10-06T23:29:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.649+0000 7f1387fff700 1 -- 172.21.15.8:0/3320445988 wait complete. 2023-10-06T23:29:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.651+0000 7f1387fff700 1 Processor -- start 2023-10-06T23:29:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.652+0000 7f1387fff700 1 -- start start 2023-10-06T23:29:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.652+0000 7f1387fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1388100d50 0x7f13880704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.652+0000 7f1387fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388101f40 0x7f1388070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.652+0000 7f1387fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13881028e0 0x7f1388071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.652+0000 7f1387fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388072010 con 0x7f1388100d50 2023-10-06T23:29:08.654 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.652+0000 7f1387fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388072180 con 0x7f1388101f40 2023-10-06T23:29:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.652+0000 7f1387fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388072340 con 0x7f13881028e0 2023-10-06T23:29:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13867fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388101f40 0x7f1388070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.657 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13867fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388101f40 0x7f1388070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48758/0 (socket says 172.21.15.8:48758) 2023-10-06T23:29:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13867fc700 1 -- 172.21.15.8:0/2325155266 learned_addr learned my addr 172.21.15.8:0/2325155266 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13877fe700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13881028e0 0x7f1388071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f1386ffd700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1388100d50 0x7f13880704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13867fc700 1 -- 172.21.15.8:0/2325155266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13881028e0 msgr2=0x7f1388071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13867fc700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13881028e0 0x7f1388071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13867fc700 1 -- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1388100d50 msgr2=0x7f13880704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13867fc700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1388100d50 0x7f13880704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.653+0000 7f13867fc700 1 -- 172.21.15.8:0/2325155266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1378009c40 con 0x7f1388101f40 2023-10-06T23:29:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.654+0000 7f13877fe700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13881028e0 0x7f1388071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:29:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.654+0000 7f13867fc700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388101f40 0x7f1388070a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f137800c370 tx=0x7f137800c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.654+0000 7f137ffff700 1 -- 172.21.15.8:0/2325155266 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137800e050 con 0x7f1388101f40 2023-10-06T23:29:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.654+0000 7f137ffff700 1 -- 172.21.15.8:0/2325155266 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f137800f040 con 0x7f1388101f40 2023-10-06T23:29:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.654+0000 7f1387fff700 1 -- 172.21.15.8:0/2325155266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13700095f0 con 0x7f1388101f40 2023-10-06T23:29:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.654+0000 7f137ffff700 1 -- 172.21.15.8:0/2325155266 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378013400 con 0x7f1388101f40 2023-10-06T23:29:08.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.655+0000 7f1387fff700 1 -- 172.21.15.8:0/2325155266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1388072930 con 0x7f1388101f40 2023-10-06T23:29:08.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.660+0000 7f137ffff700 1 -- 172.21.15.8:0/2325155266 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f137800cbe0 con 0x7f1388101f40 2023-10-06T23:29:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.662+0000 7f13a10e1b80 1 Processor -- start 2023-10-06T23:29:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.662+0000 7f13a10e1b80 1 -- start start 2023-10-06T23:29:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c52c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c53dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c5ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713bb2400 con 0x562713c54300 2023-10-06T23:29:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713ba3bc0 con 0x562713c53940 2023-10-06T23:29:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713ba14e0 con 0x562713c52830 2023-10-06T23:29:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13877fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c52c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13877fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c52c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44402/0 (socket says 172.21.15.8:44402) 2023-10-06T23:29:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.663+0000 7f13877fe700 1 -- 172.21.15.8:0/2821859776 learned_addr learned my addr 172.21.15.8:0/2821859776 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f13867fc700 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c5ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f1386ffd700 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c53dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f13877fe700 1 -- 172.21.15.8:0/2821859776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 msgr2=0x562713c53dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f13877fe700 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c53dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f13877fe700 1 -- 172.21.15.8:0/2821859776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 msgr2=0x562713c5ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f13877fe700 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c5ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f13877fe700 1 -- 172.21.15.8:0/2821859776 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627139c7d80 con 0x562713c52830 2023-10-06T23:29:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f13867fc700 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c5ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:29:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.664+0000 7f137ffff700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13740a1580 0x7f13740a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.665+0000 7f137ffff700 1 -- 172.21.15.8:0/2325155266 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f13780ccd20 con 0x7f1388101f40 2023-10-06T23:29:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.665+0000 7f13877fe700 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c52c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1380011540 tx=0x7f1380011850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43d2409831d5c01a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.665+0000 7f1386ffd700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13740a1580 0x7f13740a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.665+0000 7f137d7fa700 1 -- 172.21.15.8:0/2821859776 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380019630 con 0x562713c52830 2023-10-06T23:29:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.665+0000 7f137d7fa700 1 -- 172.21.15.8:0/2821859776 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1380019c20 con 0x562713c52830 2023-10-06T23:29:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.665+0000 7f137d7fa700 1 -- 172.21.15.8:0/2821859776 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000ebd0 con 0x562713c52830 2023-10-06T23:29:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.666+0000 7f1386ffd700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13740a1580 0x7f13740a3a40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1370005910 tx=0x7f137000b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.666+0000 7f13a10e1b80 1 -- 172.21.15.8:0/2821859776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 msgr2=0x562713c52c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.666+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c52c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1380011540 tx=0x7f1380011850 comp rx=0 tx=0).stop 2023-10-06T23:29:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.667+0000 7f13a10e1b80 1 -- 172.21.15.8:0/2821859776 shutdown_connections 2023-10-06T23:29:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.667+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c5ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.667+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c52c50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.667+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/2821859776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c53dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.667+0000 7f13a10e1b80 1 -- 172.21.15.8:0/2821859776 >> 172.21.15.8:0/2821859776 conn(0x562713bbe200 msgr2=0x562713c44ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.667+0000 7f13a10e1b80 1 -- 172.21.15.8:0/2821859776 shutdown_connections 2023-10-06T23:29:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.667+0000 7f13a10e1b80 1 -- 172.21.15.8:0/2821859776 wait complete. 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.668+0000 7f13a10e1b80 1 -- start start 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.668+0000 7f13a10e1b80 1 Processor -- start 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.669+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.669+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c53940 0x562713c5cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.669+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c54300 0x562713c63b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.669+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713b9cdd0 con 0x562713c53940 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.669+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713b396b0 con 0x562713c54300 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.669+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713b39350 con 0x562713c52830 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.669+0000 7f13a10e1b80 10 client.0 _ll_register_callbacks cb 0x5627139967a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:29:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c53940 0x562713c5cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c53940 0x562713c5cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32978/0 (socket says 172.21.15.8:32978) 2023-10-06T23:29:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13867fc700 1 -- 172.21.15.8:0/3554535941 learned_addr learned my addr 172.21.15.8:0/3554535941 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13877fe700 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c54300 0x562713c63b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13867fc700 1 -- 172.21.15.8:0/3554535941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 msgr2=0x562713c5c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13867fc700 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13867fc700 1 -- 172.21.15.8:0/3554535941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c54300 msgr2=0x562713c63b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13867fc700 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c54300 0x562713c63b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f13867fc700 1 -- 172.21.15.8:0/3554535941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1380009dd0 con 0x562713c53940 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.670+0000 7f1386ffd700 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.671+0000 7f13867fc700 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c53940 0x562713c5cad0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f13780a1e50 tx=0x7f137809a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23218eb4d3ba4502 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.671+0000 7f136e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.671+0000 7f136e7fc700 1 -- 172.21.15.8:0/3554535941 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378099b30 con 0x562713c53940 2023-10-06T23:29:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.671+0000 7f136e7fc700 1 -- 172.21.15.8:0/3554535941 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f137809a6f0 con 0x562713c53940 2023-10-06T23:29:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.671+0000 7f13a10e1b80 1 -- 172.21.15.8:0/3554535941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562713c3ceb0 con 0x562713c53940 2023-10-06T23:29:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.671+0000 7f136e7fc700 1 -- 172.21.15.8:0/3554535941 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1378099950 con 0x562713c53940 2023-10-06T23:29:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f13a10e1b80 10 client.17142 fetch_fsmap learned FSMap version 37 2023-10-06T23:29:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f13a10e1b80 1 -- 172.21.15.8:0/3554535941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5627139b0c00 con 0x562713c53940 2023-10-06T23:29:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f136e7fc700 1 -- 172.21.15.8:0/3554535941 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f137807c080 con 0x562713c53940 2023-10-06T23:29:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f136e7fc700 1 -- 172.21.15.8:0/3554535941 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f13780a1ef0 con 0x562713c53940 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f13a10e1b80 10 client.17142 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f13a10e1b80 10 client.17142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f13a10e1b80 20 client.17142 populate_metadata read hostname 'smithi008' 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562713c68260 0x562713c6a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f13a10e1b80 4 client.17142 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.672+0000 7f13a10e1b80 1 -- 172.21.15.8:0/3554535941 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562713b95db0 con 0x562713c68260 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.673+0000 7f1386ffd700 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562713c68260 0x562713c6a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.674+0000 7f1386ffd700 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562713c68260 0x562713c6a680 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c7d19caa09bfb5 server_cookie=b8a1091f463a8c2e in_seq=0 out_seq=0 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.674+0000 7f136e7fc700 10 client.17142 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.675+0000 7f136e7fc700 1 -- 172.21.15.8:0/3554535941 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562713b95db0 con 0x562713c68260 2023-10-06T23:29:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.675+0000 7f136e7fc700 10 client.17142 handle_command_reply: tid=0 2023-10-06T23:29:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.675+0000 7f13a10e1b80 1 client.17142 shutdown 2023-10-06T23:29:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.675+0000 7f13a10e1b80 1 -- 172.21.15.8:0/3554535941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c53940 msgr2=0x562713c5cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.675+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c53940 0x562713c5cad0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f13780a1e50 tx=0x7f137809a530 comp rx=0 tx=0).stop 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f13a10e1b80 1 -- 172.21.15.8:0/3554535941 shutdown_connections 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562713c68260 0x562713c6a680 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c54300 0x562713c63b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/3554535941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c53940 0x562713c5cad0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f13a10e1b80 1 -- 172.21.15.8:0/3554535941 >> 172.21.15.8:0/3554535941 conn(0x562713bbe200 msgr2=0x562713c443b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f136e7fc700 0 client.17142 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f13a10e1b80 1 -- 172.21.15.8:0/3554535941 shutdown_connections 2023-10-06T23:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.676+0000 7f13a10e1b80 1 -- 172.21.15.8:0/3554535941 wait complete. 2023-10-06T23:29:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.677+0000 7f13a10e1b80 20 client.17142 trim_cache size 0 max 16384 2023-10-06T23:29:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.707+0000 7f13a10e1b80 1 Processor -- start 2023-10-06T23:29:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.707+0000 7f13a10e1b80 1 -- start start 2023-10-06T23:29:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.707+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c63ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c57300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713a1d8c0 con 0x562713c54300 2023-10-06T23:29:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713c3f6b0 con 0x562713c53940 2023-10-06T23:29:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713c5ba40 con 0x562713c52830 2023-10-06T23:29:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44414/0 (socket says 172.21.15.8:44414) 2023-10-06T23:29:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f1386ffd700 1 -- 172.21.15.8:0/900866575 learned_addr learned my addr 172.21.15.8:0/900866575 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f13877fe700 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c57300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.708+0000 7f13867fc700 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c63ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f1386ffd700 1 -- 172.21.15.8:0/900866575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 msgr2=0x562713c63ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f1386ffd700 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c63ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f1386ffd700 1 -- 172.21.15.8:0/900866575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 msgr2=0x562713c57300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f1386ffd700 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c57300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f1386ffd700 1 -- 172.21.15.8:0/900866575 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627139ee1f0 con 0x562713c52830 2023-10-06T23:29:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f1386ffd700 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5a7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1370009990 tx=0x7f1370023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e09f77068bb841 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f137dffb700 1 -- 172.21.15.8:0/900866575 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370003ce0 con 0x562713c52830 2023-10-06T23:29:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f137dffb700 1 -- 172.21.15.8:0/900866575 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f137001e040 con 0x562713c52830 2023-10-06T23:29:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.709+0000 7f137dffb700 1 -- 172.21.15.8:0/900866575 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000bcd0 con 0x562713c52830 2023-10-06T23:29:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.710+0000 7f13a10e1b80 1 -- 172.21.15.8:0/900866575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 msgr2=0x562713c5a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.710+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5a7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1370009990 tx=0x7f1370023000 comp rx=0 tx=0).stop 2023-10-06T23:29:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.711+0000 7f13a10e1b80 1 -- 172.21.15.8:0/900866575 shutdown_connections 2023-10-06T23:29:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.711+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c57300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.711+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c5a7a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.711+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/900866575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c63ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.711+0000 7f13a10e1b80 1 -- 172.21.15.8:0/900866575 >> 172.21.15.8:0/900866575 conn(0x562713bbe200 msgr2=0x562713c6a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.711+0000 7f13a10e1b80 1 -- 172.21.15.8:0/900866575 shutdown_connections 2023-10-06T23:29:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.711+0000 7f13a10e1b80 1 -- 172.21.15.8:0/900866575 wait complete. 2023-10-06T23:29:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.712+0000 7f13a10e1b80 1 -- start start 2023-10-06T23:29:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.712+0000 7f13a10e1b80 1 Processor -- start 2023-10-06T23:29:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c60f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f13a10e1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713c62a00 con 0x562713c54300 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713c62b70 con 0x562713c53940 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f13a10e1b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562713c62d30 con 0x562713c52830 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f13a10e1b80 10 client.0 _ll_register_callbacks cb 0x7f13780ce040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c60f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c60f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:44426/0 (socket says 172.21.15.8:44426) 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f1386ffd700 1 -- 172.21.15.8:0/218093810 learned_addr learned my addr 172.21.15.8:0/218093810 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.713+0000 7f13867fc700 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.714+0000 7f13877fe700 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.714+0000 7f1386ffd700 1 -- 172.21.15.8:0/218093810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 msgr2=0x562713c614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.714+0000 7f1386ffd700 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.714+0000 7f1386ffd700 1 -- 172.21.15.8:0/218093810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 msgr2=0x562713c624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.714+0000 7f1386ffd700 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.714+0000 7f1386ffd700 1 -- 172.21.15.8:0/218093810 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13880732a0 con 0x562713c52830 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.714+0000 7f1386ffd700 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c60f70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1370009ce0 tx=0x7f137000b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93e4e773629d6522 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.714+0000 7f136e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.715+0000 7f136e7fc700 1 -- 172.21.15.8:0/218093810 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370003700 con 0x562713c52830 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.715+0000 7f136e7fc700 1 -- 172.21.15.8:0/218093810 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1370037370 con 0x562713c52830 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.715+0000 7f13a10e1b80 1 -- 172.21.15.8:0/218093810 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1380019c20 con 0x562713c52830 2023-10-06T23:29:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.715+0000 7f136e7fc700 1 -- 172.21.15.8:0/218093810 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1370037550 con 0x562713c52830 2023-10-06T23:29:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.715+0000 7f13a10e1b80 10 client.27085 fetch_fsmap learned FSMap version 37 2023-10-06T23:29:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.715+0000 7f13a10e1b80 1 -- 172.21.15.8:0/218093810 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5627139c6250 con 0x562713c52830 2023-10-06T23:29:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.716+0000 7f136e7fc700 1 -- 172.21.15.8:0/218093810 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1380019c20 con 0x562713c52830 2023-10-06T23:29:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.716+0000 7f136e7fc700 1 -- 172.21.15.8:0/218093810 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1370048050 con 0x562713c52830 2023-10-06T23:29:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.716+0000 7f13a10e1b80 10 client.27085 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:29:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.716+0000 7f13a10e1b80 10 client.27085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:29:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.716+0000 7f13a10e1b80 20 client.27085 populate_metadata read hostname 'smithi008' 2023-10-06T23:29:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.716+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562713cbc1b0 0x562713cbe5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.716+0000 7f13a10e1b80 4 client.27085 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:29:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.716+0000 7f13a10e1b80 1 -- 172.21.15.8:0/218093810 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562713b95ad0 con 0x562713cbc1b0 2023-10-06T23:29:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.717+0000 7f13867fc700 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562713cbc1b0 0x562713cbe5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.718+0000 7f13867fc700 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562713cbc1b0 0x562713cbe5a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2221768efd5818a5 server_cookie=ef77c7b283d3d8de in_seq=0 out_seq=0 2023-10-06T23:29:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.718+0000 7f136e7fc700 10 client.27085 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:08.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f136e7fc700 1 -- 172.21.15.8:0/218093810 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562713b95ad0 con 0x562713cbc1b0 2023-10-06T23:29:08.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f136e7fc700 10 client.27085 handle_command_reply: tid=0 2023-10-06T23:29:08.738 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 client.27085 shutdown 2023-10-06T23:29:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 -- 172.21.15.8:0/218093810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 msgr2=0x562713c60f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c60f70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1370009ce0 tx=0x7f137000b7e0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 -- 172.21.15.8:0/218093810 shutdown_connections 2023-10-06T23:29:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x562713cbc1b0 0x562713cbe5a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562713c54300 0x562713c624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f136e7fc700 0 client.27085 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562713c52830 0x562713c60f70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 --2- 172.21.15.8:0/218093810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562713c53940 0x562713c614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.737+0000 7f13a10e1b80 1 -- 172.21.15.8:0/218093810 >> 172.21.15.8:0/218093810 conn(0x562713bbe200 msgr2=0x562713c5a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.738+0000 7f13a10e1b80 1 -- 172.21.15.8:0/218093810 shutdown_connections 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.738+0000 7f13a10e1b80 1 -- 172.21.15.8:0/218093810 wait complete. 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.738+0000 7f13a10e1b80 20 client.27085 trim_cache size 0 max 16384 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:29:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:29:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:29:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 -- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13740a1580 msgr2=0x7f13740a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13740a1580 0x7f13740a3a40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1370005910 tx=0x7f137000b260 comp rx=0 tx=0).stop 2023-10-06T23:29:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 -- 172.21.15.8:0/2325155266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388101f40 msgr2=0x7f1388070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388101f40 0x7f1388070a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f137800c370 tx=0x7f137800c680 comp rx=0 tx=0).stop 2023-10-06T23:29:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 -- 172.21.15.8:0/2325155266 shutdown_connections 2023-10-06T23:29:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f13740a1580 0x7f13740a3a40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1388100d50 0x7f13880704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13881028e0 0x7f1388071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 --2- 172.21.15.8:0/2325155266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1388101f40 0x7f1388070a00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 -- 172.21.15.8:0/2325155266 >> 172.21.15.8:0/2325155266 conn(0x7f13880fc2a0 msgr2=0x7f13880fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 -- 172.21.15.8:0/2325155266 shutdown_connections 2023-10-06T23:29:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:08.739+0000 7f1387fff700 1 -- 172.21.15.8:0/2325155266 wait complete. 2023-10-06T23:29:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 855.0 s, 269.2 tps, lat 368.568 ms stddev 37.981 2023-10-06T23:29:09.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:09 smithi190 ceph-mon[102658]: pgmap v840: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.9 MiB/s wr, 587 op/s 2023-10-06T23:29:10.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:09 smithi156 ceph-mon[102862]: pgmap v840: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.9 MiB/s wr, 587 op/s 2023-10-06T23:29:10.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:09 smithi008 ceph-mon[98532]: pgmap v840: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.9 MiB/s wr, 587 op/s 2023-10-06T23:29:11.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:11 smithi190 ceph-mon[102658]: pgmap v841: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 4.3 MiB/s wr, 545 op/s 2023-10-06T23:29:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:11 smithi156 ceph-mon[102862]: pgmap v841: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 4.3 MiB/s wr, 545 op/s 2023-10-06T23:29:12.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:11 smithi008 ceph-mon[98532]: pgmap v841: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 4.3 MiB/s wr, 545 op/s 2023-10-06T23:29:13.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:13 smithi156 ceph-mon[102862]: pgmap v842: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 3.9 MiB/s wr, 495 op/s 2023-10-06T23:29:13.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:13 smithi008 ceph-mon[98532]: pgmap v842: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 3.9 MiB/s wr, 495 op/s 2023-10-06T23:29:13.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:13 smithi190 ceph-mon[102658]: pgmap v842: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 3.9 MiB/s wr, 495 op/s 2023-10-06T23:29:14.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 860.0 s, 287.0 tps, lat 349.618 ms stddev 35.362 2023-10-06T23:29:15.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:15 smithi190 ceph-mon[102658]: pgmap v843: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 3.9 MiB/s wr, 497 op/s 2023-10-06T23:29:16.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:15 smithi156 ceph-mon[102862]: pgmap v843: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 3.9 MiB/s wr, 497 op/s 2023-10-06T23:29:16.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:15 smithi008 ceph-mon[98532]: pgmap v843: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 3.9 MiB/s wr, 497 op/s 2023-10-06T23:29:17.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:17 smithi190 ceph-mon[102658]: pgmap v844: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.4 MiB/s wr, 553 op/s 2023-10-06T23:29:18.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:17 smithi156 ceph-mon[102862]: pgmap v844: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.4 MiB/s wr, 553 op/s 2023-10-06T23:29:18.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:17 smithi008 ceph-mon[98532]: pgmap v844: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 4.4 MiB/s wr, 553 op/s 2023-10-06T23:29:19.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 865.0 s, 271.2 tps, lat 349.826 ms stddev 64.124 2023-10-06T23:29:19.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:19 smithi190 ceph-mon[102658]: pgmap v845: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 4.2 MiB/s wr, 528 op/s 2023-10-06T23:29:20.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:19 smithi156 ceph-mon[102862]: pgmap v845: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 4.2 MiB/s wr, 528 op/s 2023-10-06T23:29:20.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:19 smithi008 ceph-mon[98532]: pgmap v845: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 4.2 MiB/s wr, 528 op/s 2023-10-06T23:29:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.977+0000 7f876f1ff700 1 -- 172.21.15.8:0/1197820080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8768101940 msgr2=0x7f8768108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.977+0000 7f876f1ff700 1 --2- 172.21.15.8:0/1197820080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8768101940 0x7f8768108260 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8760009f90 tx=0x7f876000b330 comp rx=0 tx=0).stop 2023-10-06T23:29:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.978+0000 7f876f1ff700 1 -- 172.21.15.8:0/1197820080 shutdown_connections 2023-10-06T23:29:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.978+0000 7f876f1ff700 1 --2- 172.21.15.8:0/1197820080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87680ffe30 0x7f8768100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.978+0000 7f876f1ff700 1 --2- 172.21.15.8:0/1197820080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8768101940 0x7f8768108260 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.978+0000 7f876f1ff700 1 --2- 172.21.15.8:0/1197820080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8768100f80 0x7f8768101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.978+0000 7f876f1ff700 1 -- 172.21.15.8:0/1197820080 >> 172.21.15.8:0/1197820080 conn(0x7f87680fb380 msgr2=0x7f87680fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.978+0000 7f876f1ff700 1 -- 172.21.15.8:0/1197820080 shutdown_connections 2023-10-06T23:29:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.978+0000 7f876f1ff700 1 -- 172.21.15.8:0/1197820080 wait complete. 2023-10-06T23:29:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.979+0000 7f876f1ff700 1 Processor -- start 2023-10-06T23:29:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.979+0000 7f876f1ff700 1 -- start start 2023-10-06T23:29:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.979+0000 7f876f1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87680ffe30 0x7f8768198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.979+0000 7f876f1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768100f80 0x7f8768199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.979+0000 7f876f1ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8768101940 0x7f876819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.979+0000 7f876f1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819a940 con 0x7f8768100f80 2023-10-06T23:29:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.979+0000 7f876f1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819aab0 con 0x7f87680ffe30 2023-10-06T23:29:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.979+0000 7f876f1ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876819ac70 con 0x7f8768101940 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87680ffe30 0x7f8768198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87680ffe30 0x7f8768198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:60300/0 (socket says 172.21.15.8:60300) 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876cf9b700 1 -- 172.21.15.8:0/2509167007 learned_addr learned my addr 172.21.15.8:0/2509167007 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f8767fff700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768100f80 0x7f8768199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876d79c700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8768101940 0x7f876819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876cf9b700 1 -- 172.21.15.8:0/2509167007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8768101940 msgr2=0x7f876819a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876cf9b700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8768101940 0x7f876819a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876cf9b700 1 -- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768100f80 msgr2=0x7f8768199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876cf9b700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768100f80 0x7f8768199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f876cf9b700 1 -- 172.21.15.8:0/2509167007 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009c40 con 0x7f87680ffe30 2023-10-06T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.980+0000 7f8767fff700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768100f80 0x7f8768199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.981+0000 7f876cf9b700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87680ffe30 0x7f8768198f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f875c00e9a0 tx=0x7f875c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.981+0000 7f8765ffb700 1 -- 172.21.15.8:0/2509167007 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c009790 con 0x7f87680ffe30 2023-10-06T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.981+0000 7f8765ffb700 1 -- 172.21.15.8:0/2509167007 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f875c00cbd0 con 0x7f87680ffe30 2023-10-06T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.981+0000 7f8765ffb700 1 -- 172.21.15.8:0/2509167007 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c018680 con 0x7f87680ffe30 2023-10-06T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.981+0000 7f876f1ff700 1 -- 172.21.15.8:0/2509167007 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876819af50 con 0x7f87680ffe30 2023-10-06T23:29:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.981+0000 7f876f1ff700 1 -- 172.21.15.8:0/2509167007 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87681a1710 con 0x7f87680ffe30 2023-10-06T23:29:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.986+0000 7f8765ffb700 1 -- 172.21.15.8:0/2509167007 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f875c00cd40 con 0x7f87680ffe30 2023-10-06T23:29:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.988+0000 7f8782a30b80 1 Processor -- start 2023-10-06T23:29:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.988+0000 7f8765ffb700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87580a1580 0x7f87580a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.988+0000 7f8765ffb700 1 -- 172.21.15.8:0/2509167007 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f875c014070 con 0x7f87680ffe30 2023-10-06T23:29:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f8782a30b80 1 -- start start 2023-10-06T23:29:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f876d79c700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87580a1580 0x7f87580a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae4baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 0x55a88ae4cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4d1a0 0x55a88ae53a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f8782a30b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88adab400 con 0x55a88ae4b6d0 2023-10-06T23:29:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f8782a30b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ad9cbc0 con 0x55a88ae4c7e0 2023-10-06T23:29:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f8782a30b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ad9a4e0 con 0x55a88ae4d1a0 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae4baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae4baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53350/0 (socket says 172.21.15.8:53350) 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.989+0000 7f876cf9b700 1 -- 172.21.15.8:0/3594869385 learned_addr learned my addr 172.21.15.8:0/3594869385 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.990+0000 7f876d79c700 1 --2- 172.21.15.8:0/3594869385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4d1a0 0x55a88ae53a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.990+0000 7f876cf9b700 1 -- 172.21.15.8:0/3594869385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4d1a0 msgr2=0x55a88ae53a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.990+0000 7f876cf9b700 1 --2- 172.21.15.8:0/3594869385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4d1a0 0x55a88ae53a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.990+0000 7f876cf9b700 1 -- 172.21.15.8:0/3594869385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 msgr2=0x55a88ae4cc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.990+0000 7f876cf9b700 1 --2- 172.21.15.8:0/3594869385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 0x55a88ae4cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.990+0000 7f876cf9b700 1 -- 172.21.15.8:0/3594869385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a88abc0d80 con 0x55a88ae4b6d0 2023-10-06T23:29:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.990+0000 7f876d79c700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87580a1580 0x7f87580a3a40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8760007820 tx=0x7f87600096c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.990+0000 7f876cf9b700 1 --2- 172.21.15.8:0/3594869385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae4baf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f875c09a1c0 tx=0x7f875c099df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7944755415d5aaea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.991+0000 7f8752ffd700 1 -- 172.21.15.8:0/3594869385 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c09a230 con 0x55a88ae4b6d0 2023-10-06T23:29:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.991+0000 7f8752ffd700 1 -- 172.21.15.8:0/3594869385 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f875c09e380 con 0x55a88ae4b6d0 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.991+0000 7f8752ffd700 1 -- 172.21.15.8:0/3594869385 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c099980 con 0x55a88ae4b6d0 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 -- 172.21.15.8:0/3594869385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 msgr2=0x55a88ae4baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3594869385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae4baf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f875c09a1c0 tx=0x7f875c099df0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 -- 172.21.15.8:0/3594869385 shutdown_connections 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3594869385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae4baf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3594869385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4d1a0 0x55a88ae53a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3594869385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 0x55a88ae4cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 -- 172.21.15.8:0/3594869385 >> 172.21.15.8:0/3594869385 conn(0x55a88adb7200 msgr2=0x55a88ae3db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 -- 172.21.15.8:0/3594869385 shutdown_connections 2023-10-06T23:29:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 -- 172.21.15.8:0/3594869385 wait complete. 2023-10-06T23:29:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.992+0000 7f8782a30b80 1 -- start start 2023-10-06T23:29:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.993+0000 7f8782a30b80 1 Processor -- start 2023-10-06T23:29:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.993+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae55410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.993+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4c7e0 0x55a88ae55950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 0x55a88ae5c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f8782a30b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ad95dd0 con 0x55a88ae4c7e0 2023-10-06T23:29:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f8782a30b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ad326b0 con 0x55a88ae4d1a0 2023-10-06T23:29:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f8782a30b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ad32350 con 0x55a88ae4b6d0 2023-10-06T23:29:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f8782a30b80 10 client.0 _ll_register_callbacks cb 0x55a88ab8f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:29:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae55410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae55410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34734/0 (socket says 172.21.15.8:34734) 2023-10-06T23:29:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f876cf9b700 1 -- 172.21.15.8:0/3463351447 learned_addr learned my addr 172.21.15.8:0/3463351447 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f876d79c700 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 0x55a88ae5c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.994+0000 7f8767fff700 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4c7e0 0x55a88ae55950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f876cf9b700 1 -- 172.21.15.8:0/3463351447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 msgr2=0x55a88ae5c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f876cf9b700 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 0x55a88ae5c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f876cf9b700 1 -- 172.21.15.8:0/3463351447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4c7e0 msgr2=0x55a88ae55950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f876cf9b700 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4c7e0 0x55a88ae55950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f876cf9b700 1 -- 172.21.15.8:0/3463351447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87681a1710 con 0x55a88ae4b6d0 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f8767fff700 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4c7e0 0x55a88ae55950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f876cf9b700 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae55410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f875c09d040 tx=0x7f875c0a23e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91bff3165ae3290d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f8747fff700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:29:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f8747fff700 1 -- 172.21.15.8:0/3463351447 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0cac00 con 0x55a88ae4b6d0 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.995+0000 7f8747fff700 1 -- 172.21.15.8:0/3463351447 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f875c094e40 con 0x55a88ae4b6d0 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.996+0000 7f8782a30b80 1 -- 172.21.15.8:0/3463351447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a88ae35d50 con 0x55a88ae4b6d0 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.996+0000 7f8747fff700 1 -- 172.21.15.8:0/3463351447 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f875c0a25c0 con 0x55a88ae4b6d0 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.996+0000 7f8782a30b80 10 client.27097 fetch_fsmap learned FSMap version 37 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.996+0000 7f8782a30b80 1 -- 172.21.15.8:0/3463351447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a88aba9c00 con 0x55a88ae4b6d0 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.996+0000 7f8747fff700 1 -- 172.21.15.8:0/3463351447 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a88ae35d50 con 0x55a88ae4b6d0 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.997+0000 7f8747fff700 1 -- 172.21.15.8:0/3463351447 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f875c099190 con 0x55a88ae4b6d0 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.997+0000 7f8782a30b80 10 client.27097 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.997+0000 7f8782a30b80 10 client.27097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.997+0000 7f8782a30b80 20 client.27097 populate_metadata read hostname 'smithi008' 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.997+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a88ae60d60 0x55a88ae63180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.997+0000 7f8782a30b80 4 client.27097 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:29:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.997+0000 7f8782a30b80 1 -- 172.21.15.8:0/3463351447 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a88ad8edb0 con 0x55a88ae60d60 2023-10-06T23:29:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.998+0000 7f8767fff700 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a88ae60d60 0x55a88ae63180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.998+0000 7f8747fff700 10 client.27097 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.998+0000 7f8767fff700 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a88ae60d60 0x55a88ae63180 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6995f6a642bed4 server_cookie=b031615cb31b3c28 in_seq=0 out_seq=0 2023-10-06T23:29:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.999+0000 7f8747fff700 1 -- 172.21.15.8:0/3463351447 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a88ad8edb0 con 0x55a88ae60d60 2023-10-06T23:29:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.999+0000 7f8747fff700 10 client.27097 handle_command_reply: tid=0 2023-10-06T23:29:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:21.999+0000 7f8782a30b80 1 client.27097 shutdown 2023-10-06T23:29:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 -- 172.21.15.8:0/3463351447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 msgr2=0x55a88ae55410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae55410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f875c09d040 tx=0x7f875c0a23e0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 -- 172.21.15.8:0/3463351447 shutdown_connections 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a88ae60d60 0x55a88ae63180 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 0x55a88ae5c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae55410 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 --2- 172.21.15.8:0/3463351447 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4c7e0 0x55a88ae55950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 -- 172.21.15.8:0/3463351447 >> 172.21.15.8:0/3463351447 conn(0x55a88adb7200 msgr2=0x55a88ae3d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8747fff700 0 client.27097 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 -- 172.21.15.8:0/3463351447 shutdown_connections 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.000+0000 7f8782a30b80 1 -- 172.21.15.8:0/3463351447 wait complete. 2023-10-06T23:29:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.001+0000 7f8782a30b80 20 client.27097 trim_cache size 0 max 16384 2023-10-06T23:29:22.022 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.021+0000 7f8782a30b80 1 Processor -- start 2023-10-06T23:29:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.021+0000 7f8782a30b80 1 -- start start 2023-10-06T23:29:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4d1a0 0x55a88ae62d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f8782a30b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ac168c0 con 0x55a88ae4d1a0 2023-10-06T23:29:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f8782a30b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ae548f0 con 0x55a88ae4c7e0 2023-10-06T23:29:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f8782a30b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ae54f80 con 0x55a88ae4b6d0 2023-10-06T23:29:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f876d79c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4d1a0 0x55a88ae62d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34744/0 (socket says 172.21.15.8:34744) 2023-10-06T23:29:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.022+0000 7f876cf9b700 1 -- 172.21.15.8:0/4214755048 learned_addr learned my addr 172.21.15.8:0/4214755048 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.023+0000 7f8767fff700 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.023+0000 7f876cf9b700 1 -- 172.21.15.8:0/4214755048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 msgr2=0x55a88ae5c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.023+0000 7f876cf9b700 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.023+0000 7f876cf9b700 1 -- 172.21.15.8:0/4214755048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4d1a0 msgr2=0x55a88ae62d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.023+0000 7f876cf9b700 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4d1a0 0x55a88ae62d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.023+0000 7f876cf9b700 1 -- 172.21.15.8:0/4214755048 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a88abe71f0 con 0x55a88ae4b6d0 2023-10-06T23:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.023+0000 7f876d79c700 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4d1a0 0x55a88ae62d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.023+0000 7f876cf9b700 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae536e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f875c098580 tx=0x7f875c0a2340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7132e1e842510311 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.024+0000 7f87537fe700 1 -- 172.21.15.8:0/4214755048 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c094e40 con 0x55a88ae4b6d0 2023-10-06T23:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.024+0000 7f87537fe700 1 -- 172.21.15.8:0/4214755048 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f875c07a070 con 0x55a88ae4b6d0 2023-10-06T23:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.024+0000 7f87537fe700 1 -- 172.21.15.8:0/4214755048 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c09f440 con 0x55a88ae4b6d0 2023-10-06T23:29:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 -- 172.21.15.8:0/4214755048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 msgr2=0x55a88ae536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae536e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f875c098580 tx=0x7f875c0a2340 comp rx=0 tx=0).stop 2023-10-06T23:29:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 -- 172.21.15.8:0/4214755048 shutdown_connections 2023-10-06T23:29:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4d1a0 0x55a88ae62d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4b6d0 0x55a88ae536e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4214755048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 -- 172.21.15.8:0/4214755048 >> 172.21.15.8:0/4214755048 conn(0x55a88adb7200 msgr2=0x55a88ae3d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 -- 172.21.15.8:0/4214755048 shutdown_connections 2023-10-06T23:29:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.025+0000 7f8782a30b80 1 -- 172.21.15.8:0/4214755048 wait complete. 2023-10-06T23:29:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.026+0000 7f8782a30b80 1 -- start start 2023-10-06T23:29:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.026+0000 7f8782a30b80 1 Processor -- start 2023-10-06T23:29:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae5a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8782a30b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 0x55a88ae5b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8782a30b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ae5b920 con 0x55a88ae4b6d0 2023-10-06T23:29:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8782a30b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ae5ba90 con 0x55a88ae4d1a0 2023-10-06T23:29:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8782a30b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a88ae5bc50 con 0x55a88ae4c7e0 2023-10-06T23:29:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8782a30b80 10 client.0 _ll_register_callbacks cb 0x7f875c09a090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae5a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8767fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f876cf9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae5a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53376/0 (socket says 172.21.15.8:53376) 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f876cf9b700 1 -- 172.21.15.8:0/4139269536 learned_addr learned my addr 172.21.15.8:0/4139269536 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f876d79c700 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 0x55a88ae5b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.027+0000 7f8767fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:34752/0 (socket says 172.21.15.8:34752) 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.028+0000 7f876cf9b700 1 -- 172.21.15.8:0/4139269536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4c7e0 msgr2=0x55a88ae5a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.028+0000 7f876cf9b700 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.028+0000 7f876cf9b700 1 -- 172.21.15.8:0/4139269536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 msgr2=0x55a88ae5b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.028+0000 7f876cf9b700 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 0x55a88ae5b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.028+0000 7f876cf9b700 1 -- 172.21.15.8:0/4139269536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a88aba9c00 con 0x55a88ae4b6d0 2023-10-06T23:29:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.028+0000 7f876cf9b700 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae5a000 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f875c096730 tx=0x7f875c0a23e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6dcee0e89b4eda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.028+0000 7f8747fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:29:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.028+0000 7f8747fff700 1 -- 172.21.15.8:0/4139269536 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0a25c0 con 0x55a88ae4b6d0 2023-10-06T23:29:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.029+0000 7f8747fff700 1 -- 172.21.15.8:0/4139269536 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f875c099240 con 0x55a88ae4b6d0 2023-10-06T23:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.029+0000 7f8782a30b80 1 -- 172.21.15.8:0/4139269536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f875c09e380 con 0x55a88ae4b6d0 2023-10-06T23:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.029+0000 7f8747fff700 1 -- 172.21.15.8:0/4139269536 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f875c09a230 con 0x55a88ae4b6d0 2023-10-06T23:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.029+0000 7f8782a30b80 10 client.17163 fetch_fsmap learned FSMap version 37 2023-10-06T23:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.029+0000 7f8782a30b80 1 -- 172.21.15.8:0/4139269536 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a88abbf250 con 0x55a88ae4b6d0 2023-10-06T23:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.030+0000 7f8747fff700 1 -- 172.21.15.8:0/4139269536 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f875c09e380 con 0x55a88ae4b6d0 2023-10-06T23:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.030+0000 7f8747fff700 1 -- 172.21.15.8:0/4139269536 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f875c083090 con 0x55a88ae4b6d0 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.030+0000 7f8782a30b80 10 client.17163 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.030+0000 7f8782a30b80 10 client.17163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.030+0000 7f8782a30b80 20 client.17163 populate_metadata read hostname 'smithi008' 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.030+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a88aeb4cb0 0x55a88aeb70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.030+0000 7f8782a30b80 4 client.17163 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.030+0000 7f8782a30b80 1 -- 172.21.15.8:0/4139269536 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a88ad8ead0 con 0x55a88aeb4cb0 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.031+0000 7f8767fff700 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a88aeb4cb0 0x55a88aeb70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.031+0000 7f8767fff700 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a88aeb4cb0 0x55a88aeb70a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da1e30ad7fa64ae0 server_cookie=5865be599dd233a4 in_seq=0 out_seq=0 2023-10-06T23:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.031+0000 7f8747fff700 10 client.17163 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.050+0000 7f8747fff700 1 -- 172.21.15.8:0/4139269536 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a88ad8ead0 con 0x55a88aeb4cb0 2023-10-06T23:29:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.050+0000 7f8747fff700 10 client.17163 handle_command_reply: tid=0 2023-10-06T23:29:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.050+0000 7f8782a30b80 1 client.17163 shutdown 2023-10-06T23:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.050+0000 7f8782a30b80 1 -- 172.21.15.8:0/4139269536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 msgr2=0x55a88ae5a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.050+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae5a000 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f875c096730 tx=0x7f875c0a23e0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.050+0000 7f8782a30b80 1 -- 172.21.15.8:0/4139269536 shutdown_connections 2023-10-06T23:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.050+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55a88aeb4cb0 0x55a88aeb70a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.050+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a88ae4b6d0 0x55a88ae5a000 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.051+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a88ae4d1a0 0x55a88ae5b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.051+0000 7f8782a30b80 1 --2- 172.21.15.8:0/4139269536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a88ae4c7e0 0x55a88ae5a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.051+0000 7f8782a30b80 1 -- 172.21.15.8:0/4139269536 >> 172.21.15.8:0/4139269536 conn(0x55a88adb7200 msgr2=0x55a88ae536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.051+0000 7f8747fff700 0 client.17163 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.051+0000 7f8782a30b80 1 -- 172.21.15.8:0/4139269536 shutdown_connections 2023-10-06T23:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.051+0000 7f8782a30b80 1 -- 172.21.15.8:0/4139269536 wait complete. 2023-10-06T23:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.051+0000 7f8782a30b80 20 client.17163 trim_cache size 0 max 16384 2023-10-06T23:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 -- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87580a1580 msgr2=0x7f87580a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87580a1580 0x7f87580a3a40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8760007820 tx=0x7f87600096c0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 -- 172.21.15.8:0/2509167007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87680ffe30 msgr2=0x7f8768198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87680ffe30 0x7f8768198f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f875c00e9a0 tx=0x7f875c00ecb0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 -- 172.21.15.8:0/2509167007 shutdown_connections 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f87580a1580 0x7f87580a3a40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8768101940 0x7f876819a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87680ffe30 0x7f8768198f20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 --2- 172.21.15.8:0/2509167007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768100f80 0x7f8768199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.052+0000 7f876f1ff700 1 -- 172.21.15.8:0/2509167007 >> 172.21.15.8:0/2509167007 conn(0x7f87680fb380 msgr2=0x7f8768068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.053+0000 7f876f1ff700 1 -- 172.21.15.8:0/2509167007 shutdown_connections 2023-10-06T23:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:22.053+0000 7f876f1ff700 1 -- 172.21.15.8:0/2509167007 wait complete. 2023-10-06T23:29:22.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:21 smithi156 ceph-mon[102862]: pgmap v846: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.3 MiB/s wr, 538 op/s 2023-10-06T23:29:22.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:21 smithi008 ceph-mon[98532]: pgmap v846: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.3 MiB/s wr, 538 op/s 2023-10-06T23:29:22.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:21 smithi190 ceph-mon[102658]: pgmap v846: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 4.3 MiB/s wr, 538 op/s 2023-10-06T23:29:23.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:23 smithi156 ceph-mon[102862]: pgmap v847: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 4.1 MiB/s wr, 513 op/s 2023-10-06T23:29:23.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:23 smithi008 ceph-mon[98532]: pgmap v847: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 4.1 MiB/s wr, 513 op/s 2023-10-06T23:29:23.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:23 smithi190 ceph-mon[102658]: pgmap v847: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 4.1 MiB/s wr, 513 op/s 2023-10-06T23:29:24.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 870.0 s, 265.6 tps, lat 385.223 ms stddev 86.468 2023-10-06T23:29:25.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:25 smithi190 ceph-mon[102658]: pgmap v848: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 4.1 MiB/s wr, 516 op/s 2023-10-06T23:29:26.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:25 smithi156 ceph-mon[102862]: pgmap v848: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 4.1 MiB/s wr, 516 op/s 2023-10-06T23:29:26.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:25 smithi008 ceph-mon[98532]: pgmap v848: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 4.1 MiB/s wr, 516 op/s 2023-10-06T23:29:26.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:26 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:29:27.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:26 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:29:27.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:26 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:29:27.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:27 smithi190 ceph-mon[102658]: pgmap v849: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.8 MiB/s wr, 585 op/s 2023-10-06T23:29:28.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:27 smithi156 ceph-mon[102862]: pgmap v849: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.8 MiB/s wr, 585 op/s 2023-10-06T23:29:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:27 smithi008 ceph-mon[98532]: pgmap v849: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 4.8 MiB/s wr, 585 op/s 2023-10-06T23:29:29.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 875.0 s, 250.0 tps, lat 409.361 ms stddev 103.468 2023-10-06T23:29:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:29 smithi190 ceph-mon[102658]: pgmap v850: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 3.5 MiB/s wr, 456 op/s 2023-10-06T23:29:30.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:29 smithi156 ceph-mon[102862]: pgmap v850: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 3.5 MiB/s wr, 456 op/s 2023-10-06T23:29:30.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:29 smithi008 ceph-mon[98532]: pgmap v850: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 3.5 MiB/s wr, 456 op/s 2023-10-06T23:29:31.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:31 smithi190 ceph-mon[102658]: pgmap v851: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 553 op/s 2023-10-06T23:29:32.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:31 smithi156 ceph-mon[102862]: pgmap v851: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 553 op/s 2023-10-06T23:29:32.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:31 smithi008 ceph-mon[98532]: pgmap v851: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 4.7 MiB/s wr, 553 op/s 2023-10-06T23:29:33.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:29:33.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:29:33.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:29:33.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:29:33.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:29:33.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:29:33.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:29:33.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:29:33.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:29:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 880.0 s, 259.0 tps, lat 386.158 ms stddev 109.564 2023-10-06T23:29:34.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:33 smithi156 ceph-mon[102862]: pgmap v852: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 4.4 MiB/s wr, 501 op/s 2023-10-06T23:29:34.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:33 smithi008 ceph-mon[98532]: pgmap v852: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 4.4 MiB/s wr, 501 op/s 2023-10-06T23:29:34.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:33 smithi190 ceph-mon[102658]: pgmap v852: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 4.4 MiB/s wr, 501 op/s 2023-10-06T23:29:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.266+0000 7fe7e5dff700 1 -- 172.21.15.8:0/960426308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102a50 msgr2=0x7fe7e0109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.266+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/960426308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102a50 0x7fe7e0109370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800b0a0 tx=0x7fe7d800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.266+0000 7fe7e5dff700 1 -- 172.21.15.8:0/960426308 shutdown_connections 2023-10-06T23:29:35.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.266+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/960426308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e0100eb0 0x7fe7e01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.266+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/960426308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102a50 0x7fe7e0109370 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.269 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.266+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/960426308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7e0102090 0x7fe7e0102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.266+0000 7fe7e5dff700 1 -- 172.21.15.8:0/960426308 >> 172.21.15.8:0/960426308 conn(0x7fe7e00fc430 msgr2=0x7fe7e00fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:35.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.266+0000 7fe7e5dff700 1 -- 172.21.15.8:0/960426308 shutdown_connections 2023-10-06T23:29:35.270 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.267+0000 7fe7e5dff700 1 -- 172.21.15.8:0/960426308 wait complete. 2023-10-06T23:29:35.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.268+0000 7fe7e5dff700 1 Processor -- start 2023-10-06T23:29:35.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.268+0000 7fe7e5dff700 1 -- start start 2023-10-06T23:29:35.273 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7e5dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e0100eb0 0x7fe7e00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7e5dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102090 0x7fe7e00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7e5dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7e0102a50 0x7fe7e0073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7e5dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e01a0d00 con 0x7fe7e0100eb0 2023-10-06T23:29:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7e5dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e01a0e40 con 0x7fe7e0102090 2023-10-06T23:29:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7e5dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e01a0f80 con 0x7fe7e0102a50 2023-10-06T23:29:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7dffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7e0102a50 0x7fe7e0073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7dffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7e0102a50 0x7fe7e0073d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:46718/0 (socket says 172.21.15.8:46718) 2023-10-06T23:29:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7dffff700 1 -- 172.21.15.8:0/2888092774 learned_addr learned my addr 172.21.15.8:0/2888092774 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7df7fe700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102090 0x7fe7e00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.269+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e0100eb0 0x7fe7e00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7df7fe700 1 -- 172.21.15.8:0/2888092774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7e0102a50 msgr2=0x7fe7e0073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7df7fe700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7e0102a50 0x7fe7e0073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7df7fe700 1 -- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e0100eb0 msgr2=0x7fe7e00732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7df7fe700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e0100eb0 0x7fe7e00732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7df7fe700 1 -- 172.21.15.8:0/2888092774 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009d00 con 0x7fe7e0102090 2023-10-06T23:29:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7dffff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7e0102a50 0x7fe7e0073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:29:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7df7fe700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102090 0x7fe7e00737e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800e9c0 tx=0x7fe7c800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7dd7fa700 1 -- 172.21.15.8:0/2888092774 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8004220 con 0x7fe7e0102090 2023-10-06T23:29:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7dd7fa700 1 -- 172.21.15.8:0/2888092774 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7c8004380 con 0x7fe7e0102090 2023-10-06T23:29:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7dd7fa700 1 -- 172.21.15.8:0/2888092774 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8003b40 con 0x7fe7e0102090 2023-10-06T23:29:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.270+0000 7fe7e5dff700 1 -- 172.21.15.8:0/2888092774 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e01a1210 con 0x7fe7e0102090 2023-10-06T23:29:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.271+0000 7fe7e5dff700 1 -- 172.21.15.8:0/2888092774 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e01a16d0 con 0x7fe7e0102090 2023-10-06T23:29:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.275+0000 7fe7dd7fa700 1 -- 172.21.15.8:0/2888092774 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe7c8003ca0 con 0x7fe7e0102090 2023-10-06T23:29:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.277+0000 7fe7f97ccb80 1 Processor -- start 2023-10-06T23:29:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7dd7fa700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7cc0a1480 0x7fe7cc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7f97ccb80 1 -- start start 2023-10-06T23:29:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7dd7fa700 1 -- 172.21.15.8:0/2888092774 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe7c8014070 con 0x7fe7e0102090 2023-10-06T23:29:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7dffff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7cc0a1480 0x7fe7cc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 0x559c134672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c13468450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1346f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c133cf400 con 0x559c13466ec0 2023-10-06T23:29:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c133c0bc0 con 0x559c13468990 2023-10-06T23:29:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.278+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c133be4e0 con 0x559c13467fd0 2023-10-06T23:29:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.279+0000 7fe7df7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c13468450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.279+0000 7fe7df7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c13468450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:46734/0 (socket says 172.21.15.8:46734) 2023-10-06T23:29:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.279+0000 7fe7df7fe700 1 -- 172.21.15.8:0/3258649428 learned_addr learned my addr 172.21.15.8:0/3258649428 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.279+0000 7fe7dffff700 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1346f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.279+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 0x559c134672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7dffff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7cc0a1480 0x7fe7cc0a3940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009610 tx=0x7fe7d80076f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7dffff700 1 -- 172.21.15.8:0/3258649428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 msgr2=0x559c13468450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7dffff700 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c13468450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7dffff700 1 -- 172.21.15.8:0/3258649428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 msgr2=0x559c134672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7dffff700 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 0x559c134672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7dffff700 1 -- 172.21.15.8:0/3258649428 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c131e4d80 con 0x559c13468990 2023-10-06T23:29:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7dffff700 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1346f220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80062a0 tx=0x7fe7d8029000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=959f5c33cc41a80d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7d5ffb700 1 -- 172.21.15.8:0/3258649428 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800e040 con 0x559c13468990 2023-10-06T23:29:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7d5ffb700 1 -- 172.21.15.8:0/3258649428 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7d8003c00 con 0x559c13468990 2023-10-06T23:29:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.280+0000 7fe7d5ffb700 1 -- 172.21.15.8:0/3258649428 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80123f0 con 0x559c13468990 2023-10-06T23:29:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.281+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/3258649428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 msgr2=0x559c1346f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.281+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1346f220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80062a0 tx=0x7fe7d8029000 comp rx=0 tx=0).stop 2023-10-06T23:29:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.282+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/3258649428 shutdown_connections 2023-10-06T23:29:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.282+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 0x559c134672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.282+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1346f220 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.282+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/3258649428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c13468450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.282+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/3258649428 >> 172.21.15.8:0/3258649428 conn(0x559c133db200 msgr2=0x559c13461bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.282+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/3258649428 shutdown_connections 2023-10-06T23:29:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.282+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/3258649428 wait complete. 2023-10-06T23:29:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.283+0000 7fe7f97ccb80 1 -- start start 2023-10-06T23:29:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.283+0000 7fe7f97ccb80 1 Processor -- start 2023-10-06T23:29:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c13479380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c134798c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13480900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c133b9dd0 con 0x559c13468990 2023-10-06T23:29:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c133566b0 con 0x559c13466ec0 2023-10-06T23:29:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c13356350 con 0x559c13467fd0 2023-10-06T23:29:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7f97ccb80 10 client.0 _ll_register_callbacks cb 0x559c131b37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:29:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7d77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c13479380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7d77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c13479380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58898/0 (socket says 172.21.15.8:58898) 2023-10-06T23:29:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7d77fe700 1 -- 172.21.15.8:0/1402182670 learned_addr learned my addr 172.21.15.8:0/1402182670 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7df7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c134798c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.284+0000 7fe7dffff700 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13480900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.285+0000 7fe7dffff700 1 -- 172.21.15.8:0/1402182670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 msgr2=0x559c134798c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.285+0000 7fe7dffff700 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c134798c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.285+0000 7fe7dffff700 1 -- 172.21.15.8:0/1402182670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 msgr2=0x559c13479380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.285+0000 7fe7dffff700 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c13479380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.285+0000 7fe7dffff700 1 -- 172.21.15.8:0/1402182670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d8027050 con 0x559c13468990 2023-10-06T23:29:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.285+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c13479380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:29:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.285+0000 7fe7dffff700 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13480900 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8005bd0 tx=0x7fe7d80054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5172db8351b67c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.285+0000 7fe7beffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-06T23:29:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.286+0000 7fe7beffd700 1 -- 172.21.15.8:0/1402182670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800e030 con 0x559c13468990 2023-10-06T23:29:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.286+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1402182670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c13459d50 con 0x559c13468990 2023-10-06T23:29:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.286+0000 7fe7beffd700 1 -- 172.21.15.8:0/1402182670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe7d801c440 con 0x559c13468990 2023-10-06T23:29:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.286+0000 7fe7beffd700 1 -- 172.21.15.8:0/1402182670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d801c600 con 0x559c13468990 2023-10-06T23:29:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.286+0000 7fe7f97ccb80 10 client.17175 fetch_fsmap learned FSMap version 37 2023-10-06T23:29:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.286+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1402182670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x559c131cdc00 con 0x559c13468990 2023-10-06T23:29:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.287+0000 7fe7beffd700 1 -- 172.21.15.8:0/1402182670 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559c13459d50 con 0x559c13468990 2023-10-06T23:29:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.287+0000 7fe7beffd700 1 -- 172.21.15.8:0/1402182670 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe7d803c070 con 0x559c13468990 2023-10-06T23:29:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.287+0000 7fe7f97ccb80 10 client.17175 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:29:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.287+0000 7fe7f97ccb80 10 client.17175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:29:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.287+0000 7fe7f97ccb80 20 client.17175 populate_metadata read hostname 'smithi008' 2023-10-06T23:29:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.287+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559c13484dc0 0x559c134871e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.287+0000 7fe7f97ccb80 4 client.17175 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:29:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.287+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1402182670 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c133b2db0 con 0x559c13484dc0 2023-10-06T23:29:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.288+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559c13484dc0 0x559c134871e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.288+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559c13484dc0 0x559c134871e0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d13a3bcd478614b server_cookie=f0577d223e565a7e in_seq=0 out_seq=0 2023-10-06T23:29:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.288+0000 7fe7beffd700 10 client.17175 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.289+0000 7fe7beffd700 1 -- 172.21.15.8:0/1402182670 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559c133b2db0 con 0x559c13484dc0 2023-10-06T23:29:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.289+0000 7fe7beffd700 10 client.17175 handle_command_reply: tid=0 2023-10-06T23:29:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.289+0000 7fe7f97ccb80 1 client.17175 shutdown 2023-10-06T23:29:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1402182670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 msgr2=0x559c13480900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13480900 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8005bd0 tx=0x7fe7d80054a0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1402182670 shutdown_connections 2023-10-06T23:29:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559c13484dc0 0x559c134871e0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13480900 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c13479380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1402182670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c134798c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1402182670 >> 172.21.15.8:0/1402182670 conn(0x559c133db200 msgr2=0x559c13461250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7beffd700 0 client.17175 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.290+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1402182670 shutdown_connections 2023-10-06T23:29:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.291+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1402182670 wait complete. 2023-10-06T23:29:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.291+0000 7fe7f97ccb80 20 client.17175 trim_cache size 0 max 16384 2023-10-06T23:29:35.315 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.313+0000 7fe7f97ccb80 1 Processor -- start 2023-10-06T23:29:35.315 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.314+0000 7fe7f97ccb80 1 -- start start 2023-10-06T23:29:35.316 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.314+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c134683b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.316 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.314+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c134808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.316 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.314+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13461b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.316 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.314+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1323a8c0 con 0x559c13468990 2023-10-06T23:29:35.316 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.314+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1347a000 con 0x559c13466ec0 2023-10-06T23:29:35.316 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.314+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c134620c0 con 0x559c13467fd0 2023-10-06T23:29:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c134683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c134683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58908/0 (socket says 172.21.15.8:58908) 2023-10-06T23:29:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 -- 172.21.15.8:0/1878674499 learned_addr learned my addr 172.21.15.8:0/1878674499 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7df7fe700 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c134808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7dffff700 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13461b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 -- 172.21.15.8:0/1878674499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 msgr2=0x559c134808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c134808c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 -- 172.21.15.8:0/1878674499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 msgr2=0x559c13461b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13461b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 -- 172.21.15.8:0/1878674499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c1320b1f0 con 0x559c13466ec0 2023-10-06T23:29:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.315+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c134683b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0005d90 tx=0x7fe7d0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc22ffabcaf6c07c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.316+0000 7fe7d67fc700 1 -- 172.21.15.8:0/1878674499 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0017030 con 0x559c13466ec0 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.316+0000 7fe7d67fc700 1 -- 172.21.15.8:0/1878674499 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7d0018040 con 0x559c13466ec0 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.316+0000 7fe7d67fc700 1 -- 172.21.15.8:0/1878674499 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d001f3f0 con 0x559c13466ec0 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1878674499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 msgr2=0x559c134683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c134683b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0005d90 tx=0x7fe7d0009260 comp rx=0 tx=0).stop 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1878674499 shutdown_connections 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13468990 0x559c13461b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13466ec0 0x559c134683b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/1878674499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c134808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.320 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1878674499 >> 172.21.15.8:0/1878674499 conn(0x559c133db200 msgr2=0x559c1348bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1878674499 shutdown_connections 2023-10-06T23:29:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.317+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/1878674499 wait complete. 2023-10-06T23:29:35.321 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.318+0000 7fe7f97ccb80 1 -- start start 2023-10-06T23:29:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.318+0000 7fe7f97ccb80 1 Processor -- start 2023-10-06T23:29:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 0x559c1347e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c1347e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7f97ccb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1347f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1347fde0 con 0x559c13466ec0 2023-10-06T23:29:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1347ff50 con 0x559c13468990 2023-10-06T23:29:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7f97ccb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c13480110 con 0x559c13467fd0 2023-10-06T23:29:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7f97ccb80 10 client.0 _ll_register_callbacks cb 0x7fe7d0009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:29:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7dffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1347f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7df7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c1347e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7dffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1347f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:58912/0 (socket says 172.21.15.8:58912) 2023-10-06T23:29:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7dffff700 1 -- 172.21.15.8:0/2642734943 learned_addr learned my addr 172.21.15.8:0/2642734943 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.319+0000 7fe7df7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c1347e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:46748/0 (socket says 172.21.15.8:46748) 2023-10-06T23:29:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 0x559c1347e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7dffff700 1 -- 172.21.15.8:0/2642734943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 msgr2=0x559c1347e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7dffff700 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c1347e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7dffff700 1 -- 172.21.15.8:0/2642734943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 msgr2=0x559c1347e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7dffff700 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 0x559c1347e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7dffff700 1 -- 172.21.15.8:0/2642734943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d0012040 con 0x559c13468990 2023-10-06T23:29:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7df7fe700 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c1347e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:29:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7dffff700 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1347f8a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800d010 tx=0x7fe7d8007550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ead9a304c1582fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.320+0000 7fe7beffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:29:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.321+0000 7fe7beffd700 1 -- 172.21.15.8:0/2642734943 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800e040 con 0x559c13468990 2023-10-06T23:29:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.321+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/2642734943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7d8003c00 con 0x559c13468990 2023-10-06T23:29:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.321+0000 7fe7beffd700 1 -- 172.21.15.8:0/2642734943 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe7d801fa20 con 0x559c13468990 2023-10-06T23:29:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.321+0000 7fe7beffd700 1 -- 172.21.15.8:0/2642734943 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d801fc00 con 0x559c13468990 2023-10-06T23:29:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.321+0000 7fe7f97ccb80 10 client.27110 fetch_fsmap learned FSMap version 37 2023-10-06T23:29:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.321+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/2642734943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x559c131e3250 con 0x559c13468990 2023-10-06T23:29:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7beffd700 1 -- 172.21.15.8:0/2642734943 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7d8003c00 con 0x559c13468990 2023-10-06T23:29:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7beffd700 1 -- 172.21.15.8:0/2642734943 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe7d800bce0 con 0x559c13468990 2023-10-06T23:29:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7f97ccb80 10 client.27110 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:29:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7f97ccb80 10 client.27110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:29:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7f97ccb80 20 client.27110 populate_metadata read hostname 'smithi008' 2023-10-06T23:29:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559c134d9310 0x559c134db730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7f97ccb80 4 client.27110 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:29:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/2642734943 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559c133b2ad0 con 0x559c134d9310 2023-10-06T23:29:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.322+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559c134d9310 0x559c134db730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.323+0000 7fe7d77fe700 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559c134d9310 0x559c134db730 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13dc8dbf9a4a4de1 server_cookie=3f169ffad0687391 in_seq=0 out_seq=0 2023-10-06T23:29:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.323+0000 7fe7beffd700 10 client.27110 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7beffd700 1 -- 172.21.15.8:0/2642734943 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559c133b2ad0 con 0x559c134d9310 2023-10-06T23:29:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7beffd700 10 client.27110 handle_command_reply: tid=0 2023-10-06T23:29:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 client.27110 shutdown 2023-10-06T23:29:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/2642734943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 msgr2=0x559c1347f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1347f8a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800d010 tx=0x7fe7d8007550 comp rx=0 tx=0).stop 2023-10-06T23:29:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/2642734943 shutdown_connections 2023-10-06T23:29:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x559c134d9310 0x559c134db730 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559c13466ec0 0x559c1347e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c13468990 0x559c1347f8a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 --2- 172.21.15.8:0/2642734943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559c13467fd0 0x559c1347e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/2642734943 >> 172.21.15.8:0/2642734943 conn(0x559c133db200 msgr2=0x559c13478000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7beffd700 0 client.27110 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/2642734943 shutdown_connections 2023-10-06T23:29:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.339+0000 7fe7f97ccb80 1 -- 172.21.15.8:0/2642734943 wait complete. 2023-10-06T23:29:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.340+0000 7fe7f97ccb80 20 client.27110 trim_cache size 0 max 16384 2023-10-06T23:29:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:29:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:29:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:29:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:29:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.340+0000 7fe7e5dff700 1 -- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7cc0a1480 msgr2=0x7fe7cc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.340+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7cc0a1480 0x7fe7cc0a3940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009610 tx=0x7fe7d80076f0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.340+0000 7fe7e5dff700 1 -- 172.21.15.8:0/2888092774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102090 msgr2=0x7fe7e00737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.340+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102090 0x7fe7e00737e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800e9c0 tx=0x7fe7c800ecd0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.340+0000 7fe7e5dff700 1 -- 172.21.15.8:0/2888092774 shutdown_connections 2023-10-06T23:29:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.341+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fe7cc0a1480 0x7fe7cc0a3940 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.341+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7e0100eb0 0x7fe7e00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.341+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7e0102a50 0x7fe7e0073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.341+0000 7fe7e5dff700 1 --2- 172.21.15.8:0/2888092774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0102090 0x7fe7e00737e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.341+0000 7fe7e5dff700 1 -- 172.21.15.8:0/2888092774 >> 172.21.15.8:0/2888092774 conn(0x7fe7e00fc430 msgr2=0x7fe7e00fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.341+0000 7fe7e5dff700 1 -- 172.21.15.8:0/2888092774 shutdown_connections 2023-10-06T23:29:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:35.341+0000 7fe7e5dff700 1 -- 172.21.15.8:0/2888092774 wait complete. 2023-10-06T23:29:36.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:35 smithi156 ceph-mon[102862]: pgmap v853: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 5.1 MiB/s wr, 542 op/s 2023-10-06T23:29:36.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:35 smithi008 ceph-mon[98532]: pgmap v853: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 5.1 MiB/s wr, 542 op/s 2023-10-06T23:29:36.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:35 smithi190 ceph-mon[102658]: pgmap v853: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 5.1 MiB/s wr, 542 op/s 2023-10-06T23:29:38.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:37 smithi156 ceph-mon[102862]: pgmap v854: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 6.5 MiB/s wr, 635 op/s 2023-10-06T23:29:38.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:37 smithi008 ceph-mon[98532]: pgmap v854: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 6.5 MiB/s wr, 635 op/s 2023-10-06T23:29:38.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:37 smithi190 ceph-mon[102658]: pgmap v854: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 6.5 MiB/s wr, 635 op/s 2023-10-06T23:29:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 885.0 s, 281.4 tps, lat 356.268 ms stddev 46.169 2023-10-06T23:29:40.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:39 smithi156 ceph-mon[102862]: pgmap v855: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2023-10-06T23:29:40.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:39 smithi008 ceph-mon[98532]: pgmap v855: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2023-10-06T23:29:40.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:39 smithi190 ceph-mon[102658]: pgmap v855: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2023-10-06T23:29:42.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:41 smithi156 ceph-mon[102862]: pgmap v856: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 6.4 MiB/s wr, 620 op/s 2023-10-06T23:29:42.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:41 smithi008 ceph-mon[98532]: pgmap v856: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 6.4 MiB/s wr, 620 op/s 2023-10-06T23:29:42.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:41 smithi190 ceph-mon[102658]: pgmap v856: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 6.4 MiB/s wr, 620 op/s 2023-10-06T23:29:43.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:43 smithi156 ceph-mon[102862]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2023-10-06T23:29:43.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:43 smithi008 ceph-mon[98532]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2023-10-06T23:29:43.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:43 smithi190 ceph-mon[102658]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2023-10-06T23:29:44.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 890.0 s, 278.8 tps, lat 359.249 ms stddev 47.223 2023-10-06T23:29:45.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:45 smithi190 ceph-mon[102658]: pgmap v858: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 6.2 MiB/s wr, 591 op/s 2023-10-06T23:29:46.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:45 smithi156 ceph-mon[102862]: pgmap v858: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 6.2 MiB/s wr, 591 op/s 2023-10-06T23:29:46.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:45 smithi008 ceph-mon[98532]: pgmap v858: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 6.2 MiB/s wr, 591 op/s 2023-10-06T23:29:47.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:47 smithi190 ceph-mon[102658]: pgmap v859: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 6.0 MiB/s wr, 583 op/s 2023-10-06T23:29:48.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:47 smithi156 ceph-mon[102862]: pgmap v859: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 6.0 MiB/s wr, 583 op/s 2023-10-06T23:29:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:47 smithi008 ceph-mon[98532]: pgmap v859: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 6.0 MiB/s wr, 583 op/s 2023-10-06T23:29:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 -- 172.21.15.8:0/748752229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 msgr2=0x7feb14103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 --2- 172.21.15.8:0/748752229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 0x7feb14103d60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7feb04009990 tx=0x7feb04009ca0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 -- 172.21.15.8:0/748752229 shutdown_connections 2023-10-06T23:29:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 --2- 172.21.15.8:0/748752229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb14106bd0 0x7feb14109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 --2- 172.21.15.8:0/748752229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 0x7feb14103d60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 --2- 172.21.15.8:0/748752229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb141042a0 0x7feb14106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 -- 172.21.15.8:0/748752229 >> 172.21.15.8:0/748752229 conn(0x7feb140fb340 msgr2=0x7feb140fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 -- 172.21.15.8:0/748752229 shutdown_connections 2023-10-06T23:29:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.579+0000 7feb199ff700 1 -- 172.21.15.8:0/748752229 wait complete. 2023-10-06T23:29:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.581+0000 7feb199ff700 1 Processor -- start 2023-10-06T23:29:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.581+0000 7feb199ff700 1 -- start start 2023-10-06T23:29:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.581+0000 7feb199ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 0x7feb1406f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.581+0000 7feb199ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb141042a0 0x7feb1406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.582+0000 7feb199ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb14106bd0 0x7feb14070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.582+0000 7feb199ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140712d0 con 0x7feb141042a0 2023-10-06T23:29:48.584 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.582+0000 7feb199ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14071440 con 0x7feb14101970 2023-10-06T23:29:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.582+0000 7feb199ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14071600 con 0x7feb14106bd0 2023-10-06T23:29:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.582+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 0x7feb1406f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.582+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 0x7feb1406f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:54682/0 (socket says 172.21.15.8:54682) 2023-10-06T23:29:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.582+0000 7feb12ffd700 1 -- 172.21.15.8:0/1415878476 learned_addr learned my addr 172.21.15.8:0/1415878476 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.582+0000 7feb137fe700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb14106bd0 0x7feb14070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.583+0000 7feb137fe700 1 -- 172.21.15.8:0/1415878476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 msgr2=0x7feb1406f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.583+0000 7feb137fe700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 0x7feb1406f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.583+0000 7feb137fe700 1 -- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb141042a0 msgr2=0x7feb1406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.583+0000 7feb137fe700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb141042a0 0x7feb1406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.583+0000 7feb137fe700 1 -- 172.21.15.8:0/1415878476 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040095f0 con 0x7feb14106bd0 2023-10-06T23:29:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.583+0000 7feb12ffd700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 0x7feb1406f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:29:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.583+0000 7feb137fe700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb14106bd0 0x7feb14070c70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0123c0 tx=0x7feb0c0126d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.584+0000 7feb189fd700 1 -- 172.21.15.8:0/1415878476 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c01c070 con 0x7feb14106bd0 2023-10-06T23:29:48.586 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.584+0000 7feb189fd700 1 -- 172.21.15.8:0/1415878476 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb0c013040 con 0x7feb14106bd0 2023-10-06T23:29:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.584+0000 7feb189fd700 1 -- 172.21.15.8:0/1415878476 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00bcb0 con 0x7feb14106bd0 2023-10-06T23:29:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.584+0000 7feb199ff700 1 -- 172.21.15.8:0/1415878476 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb14071880 con 0x7feb14106bd0 2023-10-06T23:29:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.584+0000 7feb199ff700 1 -- 172.21.15.8:0/1415878476 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb14072090 con 0x7feb14106bd0 2023-10-06T23:29:48.593 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.591+0000 7feb189fd700 1 -- 172.21.15.8:0/1415878476 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7feb0c003a00 con 0x7feb14106bd0 2023-10-06T23:29:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.592+0000 7feb2d39bb80 1 Processor -- start 2023-10-06T23:29:48.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.592+0000 7feb2d39bb80 1 -- start start 2023-10-06T23:29:48.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.593+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d54b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.595 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.593+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d54c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.593+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 0x55fe4d553220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.593+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d4b3400 con 0x55fe4d54bfd0 2023-10-06T23:29:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.593+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d4a4bc0 con 0x55fe4d54c990 2023-10-06T23:29:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.593+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d4a24e0 con 0x55fe4d54aec0 2023-10-06T23:29:48.596 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.593+0000 7feb189fd700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feafc0a15d0 0x7feafc0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb189fd700 1 -- 172.21.15.8:0/1415878476 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb0c0d0b20 con 0x7feb14106bd0 2023-10-06T23:29:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d54c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d54c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50082/0 (socket says 172.21.15.8:50082) 2023-10-06T23:29:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb12ffd700 1 -- 172.21.15.8:0/3388677536 learned_addr learned my addr 172.21.15.8:0/3388677536 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb127fc700 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 0x55fe4d553220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb127fc700 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d54b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb137fe700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feafc0a15d0 0x7feafc0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb127fc700 1 -- 172.21.15.8:0/3388677536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 msgr2=0x55fe4d553220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb127fc700 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 0x55fe4d553220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb127fc700 1 -- 172.21.15.8:0/3388677536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 msgr2=0x55fe4d54c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb127fc700 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d54c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.594+0000 7feb127fc700 1 -- 172.21.15.8:0/3388677536 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe4d2c8d80 con 0x55fe4d54aec0 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.595+0000 7feb127fc700 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d54b2e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feb08005950 tx=0x7feb080058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b2a6d62903e6a15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.595+0000 7feaf9ffb700 1 -- 172.21.15.8:0/3388677536 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08013110 con 0x55fe4d54aec0 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.595+0000 7feb137fe700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feafc0a15d0 0x7feafc0a3a90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00dfd0 tx=0x7feb0c020000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.595+0000 7feaf9ffb700 1 -- 172.21.15.8:0/3388677536 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb08019030 con 0x55fe4d54aec0 2023-10-06T23:29:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.595+0000 7feaf9ffb700 1 -- 172.21.15.8:0/3388677536 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080039f0 con 0x55fe4d54aec0 2023-10-06T23:29:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3388677536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 msgr2=0x55fe4d54b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d54b2e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feb08005950 tx=0x7feb080058e0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3388677536 shutdown_connections 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 0x55fe4d553220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d54b2e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3388677536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d54c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3388677536 >> 172.21.15.8:0/3388677536 conn(0x55fe4d4bf200 msgr2=0x55fe4d545bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3388677536 shutdown_connections 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.596+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3388677536 wait complete. 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.597+0000 7feb2d39bb80 1 -- start start 2023-10-06T23:29:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.597+0000 7feb2d39bb80 1 Processor -- start 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.598+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.598+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.598+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54c990 0x55fe4d564950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.598+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d49ddd0 con 0x55fe4d54c990 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.598+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d43a6b0 con 0x55fe4d54bfd0 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.598+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d43a350 con 0x55fe4d54aec0 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.598+0000 7feb2d39bb80 10 client.0 _ll_register_callbacks cb 0x55fe4d2977a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:54698/0 (socket says 172.21.15.8:54698) 2023-10-06T23:29:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb12ffd700 1 -- 172.21.15.8:0/2442838554 learned_addr learned my addr 172.21.15.8:0/2442838554 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb127fc700 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb12ffd700 1 -- 172.21.15.8:0/2442838554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 msgr2=0x55fe4d55d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb12ffd700 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb12ffd700 1 -- 172.21.15.8:0/2442838554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54c990 msgr2=0x55fe4d564950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb127fc700 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54c990 0x55fe4d564950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb12ffd700 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54c990 0x55fe4d564950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.599+0000 7feb12ffd700 1 -- 172.21.15.8:0/2442838554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb08013520 con 0x55fe4d54bfd0 2023-10-06T23:29:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.600+0000 7feb127fc700 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54c990 0x55fe4d564950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:29:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.600+0000 7feb12ffd700 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feb04005c80 tx=0x7feb040050f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d00f5ebe047ffc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.600+0000 7feaf2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:29:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.600+0000 7feaf2ffd700 1 -- 172.21.15.8:0/2442838554 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0401d070 con 0x55fe4d54bfd0 2023-10-06T23:29:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.600+0000 7feaf2ffd700 1 -- 172.21.15.8:0/2442838554 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb0400b910 con 0x55fe4d54bfd0 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.600+0000 7feb2d39bb80 1 -- 172.21.15.8:0/2442838554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe4d53dd50 con 0x55fe4d54bfd0 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.601+0000 7feaf2ffd700 1 -- 172.21.15.8:0/2442838554 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb0400bad0 con 0x55fe4d54bfd0 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.601+0000 7feb2d39bb80 10 client.27122 fetch_fsmap learned FSMap version 37 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.601+0000 7feb2d39bb80 1 -- 172.21.15.8:0/2442838554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55fe4d2b1c00 con 0x55fe4d54bfd0 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feaf2ffd700 1 -- 172.21.15.8:0/2442838554 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fe4d53dd50 con 0x55fe4d54bfd0 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feaf2ffd700 1 -- 172.21.15.8:0/2442838554 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feb0400f460 con 0x55fe4d54bfd0 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feb2d39bb80 10 client.27122 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feb2d39bb80 10 client.27122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feb2d39bb80 20 client.27122 populate_metadata read hostname 'smithi008' 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe4d569220 0x55fe4d56b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feb2d39bb80 4 client.27122 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:29:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feb2d39bb80 1 -- 172.21.15.8:0/2442838554 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe4d496db0 con 0x55fe4d569220 2023-10-06T23:29:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.602+0000 7feb127fc700 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe4d569220 0x55fe4d56b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.603+0000 7feb127fc700 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe4d569220 0x55fe4d56b640 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d834a7ef7144eb3 server_cookie=3a7a6c220cb9671c in_seq=0 out_seq=0 2023-10-06T23:29:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.603+0000 7feaf2ffd700 10 client.27122 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.604+0000 7feaf2ffd700 1 -- 172.21.15.8:0/2442838554 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fe4d496db0 con 0x55fe4d569220 2023-10-06T23:29:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.604+0000 7feaf2ffd700 10 client.27122 handle_command_reply: tid=0 2023-10-06T23:29:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 client.27122 shutdown 2023-10-06T23:29:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 -- 172.21.15.8:0/2442838554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54bfd0 msgr2=0x55fe4d55d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feb04005c80 tx=0x7feb040050f0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 -- 172.21.15.8:0/2442838554 shutdown_connections 2023-10-06T23:29:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe4d569220 0x55fe4d56b640 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54c990 0x55fe4d564950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feaf2ffd700 0 client.27122 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/2442838554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 -- 172.21.15.8:0/2442838554 >> 172.21.15.8:0/2442838554 conn(0x55fe4d4bf200 msgr2=0x55fe4d545250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 -- 172.21.15.8:0/2442838554 shutdown_connections 2023-10-06T23:29:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.605+0000 7feb2d39bb80 1 -- 172.21.15.8:0/2442838554 wait complete. 2023-10-06T23:29:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.606+0000 7feb2d39bb80 20 client.27122 trim_cache size 0 max 16384 2023-10-06T23:29:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.631+0000 7feb2d39bb80 1 Processor -- start 2023-10-06T23:29:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb2d39bb80 1 -- start start 2023-10-06T23:29:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54c990 0x55fe4d564910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d31e8c0 con 0x55fe4d54bfd0 2023-10-06T23:29:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d5476c0 con 0x55fe4d54aec0 2023-10-06T23:29:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d55cf40 con 0x55fe4d54c990 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb127fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb127fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:54706/0 (socket says 172.21.15.8:54706) 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb127fc700 1 -- 172.21.15.8:0/4290841025 learned_addr learned my addr 172.21.15.8:0/4290841025 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.632+0000 7feb127fc700 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54c990 0x55fe4d564910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.633+0000 7feb12ffd700 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.633+0000 7feb127fc700 1 -- 172.21.15.8:0/4290841025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54c990 msgr2=0x55fe4d564910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.633+0000 7feb127fc700 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54c990 0x55fe4d564910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.633+0000 7feb127fc700 1 -- 172.21.15.8:0/4290841025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 msgr2=0x55fe4d55d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.633+0000 7feb127fc700 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.633+0000 7feb127fc700 1 -- 172.21.15.8:0/4290841025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe4d2ef1f0 con 0x55fe4d54aec0 2023-10-06T23:29:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.633+0000 7feb127fc700 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feb080094f0 tx=0x7feb08009440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8339720753f6dd2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.633+0000 7feafa7fc700 1 -- 172.21.15.8:0/4290841025 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08024040 con 0x55fe4d54aec0 2023-10-06T23:29:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.634+0000 7feafa7fc700 1 -- 172.21.15.8:0/4290841025 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb08009b00 con 0x55fe4d54aec0 2023-10-06T23:29:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.634+0000 7feafa7fc700 1 -- 172.21.15.8:0/4290841025 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08004ea0 con 0x55fe4d54aec0 2023-10-06T23:29:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.634+0000 7feb2d39bb80 1 -- 172.21.15.8:0/4290841025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54aec0 msgr2=0x55fe4d55d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.635+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feb080094f0 tx=0x7feb08009440 comp rx=0 tx=0).stop 2023-10-06T23:29:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.635+0000 7feb2d39bb80 1 -- 172.21.15.8:0/4290841025 shutdown_connections 2023-10-06T23:29:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.635+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54c990 0x55fe4d564910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.635+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54aec0 0x55fe4d55d3d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.635+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/4290841025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d55d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.635+0000 7feb2d39bb80 1 -- 172.21.15.8:0/4290841025 >> 172.21.15.8:0/4290841025 conn(0x55fe4d4bf200 msgr2=0x55fe4d552dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.635+0000 7feb2d39bb80 1 -- 172.21.15.8:0/4290841025 shutdown_connections 2023-10-06T23:29:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.635+0000 7feb2d39bb80 1 -- 172.21.15.8:0/4290841025 wait complete. 2023-10-06T23:29:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.636+0000 7feb2d39bb80 1 -- start start 2023-10-06T23:29:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.636+0000 7feb2d39bb80 1 Processor -- start 2023-10-06T23:29:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d562530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d562a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb2d39bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 0x55fe4d563a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d563fc0 con 0x55fe4d54bfd0 2023-10-06T23:29:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d564130 con 0x55fe4d54c990 2023-10-06T23:29:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb2d39bb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe4d5642f0 con 0x55fe4d54aec0 2023-10-06T23:29:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb2d39bb80 10 client.0 _ll_register_callbacks cb 0x7feb04003a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:29:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb127fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d562530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d562a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb127fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d562530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:54488/0 (socket says 172.21.15.8:54488) 2023-10-06T23:29:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.637+0000 7feb127fc700 1 -- 172.21.15.8:0/3970078352 learned_addr learned my addr 172.21.15.8:0/3970078352 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:29:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.638+0000 7feb127fc700 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 0x55fe4d563a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.638+0000 7feb127fc700 1 -- 172.21.15.8:0/3970078352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 msgr2=0x55fe4d563a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.638+0000 7feb127fc700 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 0x55fe4d563a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.638+0000 7feb127fc700 1 -- 172.21.15.8:0/3970078352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 msgr2=0x55fe4d562a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:29:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.638+0000 7feb127fc700 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d562a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.638+0000 7feb127fc700 1 -- 172.21.15.8:0/3970078352 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe4d2c8d80 con 0x55fe4d54aec0 2023-10-06T23:29:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.639+0000 7feb127fc700 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d562530 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb08013810 tx=0x7feb08009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84142e5d019150e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:29:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.639+0000 7feaf2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:29:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.639+0000 7feaf2ffd700 1 -- 172.21.15.8:0/3970078352 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080130d0 con 0x55fe4d54aec0 2023-10-06T23:29:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.639+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3970078352 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb08019030 con 0x55fe4d54aec0 2023-10-06T23:29:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.639+0000 7feaf2ffd700 1 -- 172.21.15.8:0/3970078352 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb08027440 con 0x55fe4d54aec0 2023-10-06T23:29:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.639+0000 7feaf2ffd700 1 -- 172.21.15.8:0/3970078352 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb08027880 con 0x55fe4d54aec0 2023-10-06T23:29:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.639+0000 7feb2d39bb80 10 client.27136 fetch_fsmap learned FSMap version 37 2023-10-06T23:29:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.639+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3970078352 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55fe4d2c7250 con 0x55fe4d54aec0 2023-10-06T23:29:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.640+0000 7feaf2ffd700 1 -- 172.21.15.8:0/3970078352 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb08019030 con 0x55fe4d54aec0 2023-10-06T23:29:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.640+0000 7feaf2ffd700 1 -- 172.21.15.8:0/3970078352 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feb080036f0 con 0x55fe4d54aec0 2023-10-06T23:29:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.640+0000 7feb2d39bb80 10 client.27136 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:29:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.640+0000 7feb2d39bb80 10 client.27136 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:29:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.640+0000 7feb2d39bb80 20 client.27136 populate_metadata read hostname 'smithi008' 2023-10-06T23:29:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.640+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe4d5bda40 0x55fe4d5bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:29:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.640+0000 7feb2d39bb80 4 client.27136 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:29:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.640+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3970078352 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fe4d496ad0 con 0x55fe4d5bda40 2023-10-06T23:29:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.641+0000 7feb12ffd700 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe4d5bda40 0x55fe4d5bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:29:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.642+0000 7feaf2ffd700 10 client.27136 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.642+0000 7feb12ffd700 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe4d5bda40 0x55fe4d5bfe60 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d6313a2b1b17c82 server_cookie=eba1e8bc76e97fd3 in_seq=0 out_seq=0 2023-10-06T23:29:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.657+0000 7feaf2ffd700 1 -- 172.21.15.8:0/3970078352 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fe4d496ad0 con 0x55fe4d5bda40 2023-10-06T23:29:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.657+0000 7feaf2ffd700 10 client.27136 handle_command_reply: tid=0 2023-10-06T23:29:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.657+0000 7feb2d39bb80 1 client.27136 shutdown 2023-10-06T23:29:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.657+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3970078352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 msgr2=0x55fe4d562530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.657+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d562530 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb08013810 tx=0x7feb08009260 comp rx=0 tx=0).stop 2023-10-06T23:29:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3970078352 shutdown_connections 2023-10-06T23:29:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x55fe4d5bda40 0x55fe4d5bfe60 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe4d54c990 0x55fe4d563a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fe4d54aec0 0x55fe4d562530 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 1 --2- 172.21.15.8:0/3970078352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe4d54bfd0 0x55fe4d562a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3970078352 >> 172.21.15.8:0/3970078352 conn(0x55fe4d4bf200 msgr2=0x55fe4d54f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feaf2ffd700 0 client.27136 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:29:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3970078352 shutdown_connections 2023-10-06T23:29:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 1 -- 172.21.15.8:0/3970078352 wait complete. 2023-10-06T23:29:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.658+0000 7feb2d39bb80 20 client.27136 trim_cache size 0 max 16384 2023-10-06T23:29:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:29:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:29:48.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:29:48.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:29:48.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 -- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feafc0a15d0 msgr2=0x7feafc0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feafc0a15d0 0x7feafc0a3a90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00dfd0 tx=0x7feb0c020000 comp rx=0 tx=0).stop 2023-10-06T23:29:48.663 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 -- 172.21.15.8:0/1415878476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb14106bd0 msgr2=0x7feb14070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb14106bd0 0x7feb14070c70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0123c0 tx=0x7feb0c0126d0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 -- 172.21.15.8:0/1415878476 shutdown_connections 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7feafc0a15d0 0x7feafc0a3a90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb14106bd0 0x7feb14070c70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb14101970 0x7feb1406f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 --2- 172.21.15.8:0/1415878476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb141042a0 0x7feb1406fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 -- 172.21.15.8:0/1415878476 >> 172.21.15.8:0/1415878476 conn(0x7feb140fb340 msgr2=0x7feb141025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 -- 172.21.15.8:0/1415878476 shutdown_connections 2023-10-06T23:29:48.664 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:29:48.659+0000 7feb199ff700 1 -- 172.21.15.8:0/1415878476 wait complete. 2023-10-06T23:29:49.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 895.0 s, 295.4 tps, lat 337.956 ms stddev 34.480 2023-10-06T23:29:49.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:49 smithi190 ceph-mon[102658]: pgmap v860: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2023-10-06T23:29:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:49 smithi156 ceph-mon[102862]: pgmap v860: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2023-10-06T23:29:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:49 smithi008 ceph-mon[98532]: pgmap v860: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2023-10-06T23:29:52.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:51 smithi156 ceph-mon[102862]: pgmap v861: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 6.6 MiB/s wr, 596 op/s 2023-10-06T23:29:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:51 smithi008 ceph-mon[98532]: pgmap v861: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 6.6 MiB/s wr, 596 op/s 2023-10-06T23:29:52.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:51 smithi190 ceph-mon[102658]: pgmap v861: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 6.6 MiB/s wr, 596 op/s 2023-10-06T23:29:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:53 smithi156 ceph-mon[102862]: pgmap v862: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.8 MiB/s wr, 528 op/s 2023-10-06T23:29:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:53 smithi008 ceph-mon[98532]: pgmap v862: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.8 MiB/s wr, 528 op/s 2023-10-06T23:29:53.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:53 smithi190 ceph-mon[102658]: pgmap v862: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 5.8 MiB/s wr, 528 op/s 2023-10-06T23:29:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 900.0 s, 286.8 tps, lat 343.975 ms stddev 51.007 2023-10-06T23:29:54.543 INFO:teuthology.orchestra.run.smithi008.stdout:transaction type: 2023-10-06T23:29:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:scaling factor: 32 2023-10-06T23:29:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:query mode: simple 2023-10-06T23:29:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:number of clients: 100 2023-10-06T23:29:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:number of threads: 4 2023-10-06T23:29:54.544 INFO:teuthology.orchestra.run.smithi008.stdout:duration: 900 s 2023-10-06T23:29:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:number of transactions actually processed: 229900 2023-10-06T23:29:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:latency average = 391.408 ms 2023-10-06T23:29:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:latency stddev = 260.150 ms 2023-10-06T23:29:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:tps = 255.291737 (including connections establishing) 2023-10-06T23:29:54.545 INFO:teuthology.orchestra.run.smithi008.stdout:tps = 255.297222 (excluding connections establishing) 2023-10-06T23:29:54.555 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-10-06T23:29:55.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:55 smithi190 ceph-mon[102658]: pgmap v863: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 5.5 MiB/s wr, 501 op/s 2023-10-06T23:29:56.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:55 smithi156 ceph-mon[102862]: pgmap v863: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 5.5 MiB/s wr, 501 op/s 2023-10-06T23:29:56.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:55 smithi008 ceph-mon[98532]: pgmap v863: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 5.5 MiB/s wr, 501 op/s 2023-10-06T23:29:57.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:57 smithi190 ceph-mon[102658]: pgmap v864: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 6.0 MiB/s wr, 549 op/s 2023-10-06T23:29:58.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:57 smithi156 ceph-mon[102862]: pgmap v864: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 6.0 MiB/s wr, 549 op/s 2023-10-06T23:29:58.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:57 smithi008 ceph-mon[98532]: pgmap v864: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 6.0 MiB/s wr, 549 op/s 2023-10-06T23:29:59.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:29:59 smithi190 ceph-mon[102658]: pgmap v865: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2023-10-06T23:30:00.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:29:59 smithi156 ceph-mon[102862]: pgmap v865: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2023-10-06T23:30:00.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:29:59 smithi008 ceph-mon[98532]: pgmap v865: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2023-10-06T23:30:01.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:00 smithi156 ceph-mon[102862]: overall HEALTH_OK 2023-10-06T23:30:01.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:00 smithi008 ceph-mon[98532]: overall HEALTH_OK 2023-10-06T23:30:01.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:00 smithi190 ceph-mon[102658]: overall HEALTH_OK 2023-10-06T23:30:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.920+0000 7fbcb11ff700 1 -- 172.21.15.8:0/1248976411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac10d1f0 msgr2=0x7fbcac10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.920+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/1248976411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac10d1f0 0x7fbcac10d670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009990 tx=0x7fbc94009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.922+0000 7fbcb11ff700 1 -- 172.21.15.8:0/1248976411 shutdown_connections 2023-10-06T23:30:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.922+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/1248976411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac10d1f0 0x7fbcac10d670 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.922+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/1248976411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac107eb0 0x7fbcac10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.922+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/1248976411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac10a820 0x7fbcac10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.922+0000 7fbcb11ff700 1 -- 172.21.15.8:0/1248976411 >> 172.21.15.8:0/1248976411 conn(0x7fbcac06dd10 msgr2=0x7fbcac070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.922+0000 7fbcb11ff700 1 -- 172.21.15.8:0/1248976411 shutdown_connections 2023-10-06T23:30:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.923+0000 7fbcb11ff700 1 -- 172.21.15.8:0/1248976411 wait complete. 2023-10-06T23:30:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.925+0000 7fbcb11ff700 1 Processor -- start 2023-10-06T23:30:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.925+0000 7fbcb11ff700 1 -- start start 2023-10-06T23:30:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.925+0000 7fbcb11ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac107eb0 0x7fbcac118890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.925+0000 7fbcb11ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac10a820 0x7fbcac118dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.925+0000 7fbcb11ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac10d1f0 0x7fbcac1171d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.925+0000 7fbcb11ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac119680 con 0x7fbcac10a820 2023-10-06T23:30:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.925+0000 7fbcb11ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac117710 con 0x7fbcac107eb0 2023-10-06T23:30:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.925+0000 7fbcb11ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1178d0 con 0x7fbcac10d1f0 2023-10-06T23:30:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.926+0000 7fbcaad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac107eb0 0x7fbcac118890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.926+0000 7fbcaad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac107eb0 0x7fbcac118890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:54070/0 (socket says 172.21.15.8:54070) 2023-10-06T23:30:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.926+0000 7fbcaad9d700 1 -- 172.21.15.8:0/2439525745 learned_addr learned my addr 172.21.15.8:0/2439525745 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.926+0000 7fbcaa59c700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac10a820 0x7fbcac118dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.927+0000 7fbcaad9d700 1 -- 172.21.15.8:0/2439525745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac10d1f0 msgr2=0x7fbcac1171d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T23:30:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.927+0000 7fbcaad9d700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac10d1f0 0x7fbcac1171d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.927+0000 7fbcaad9d700 1 -- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac10a820 msgr2=0x7fbcac118dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.927+0000 7fbcaad9d700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac10a820 0x7fbcac118dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.927+0000 7fbcaad9d700 1 -- 172.21.15.8:0/2439525745 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc940095f0 con 0x7fbcac107eb0 2023-10-06T23:30:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.927+0000 7fbcaad9d700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac107eb0 0x7fbcac118890 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbca400b530 tx=0x7fbca400b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.928+0000 7fbca3fff700 1 -- 172.21.15.8:0/2439525745 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4011830 con 0x7fbcac107eb0 2023-10-06T23:30:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.928+0000 7fbca3fff700 1 -- 172.21.15.8:0/2439525745 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbca4011e20 con 0x7fbcac107eb0 2023-10-06T23:30:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.928+0000 7fbca3fff700 1 -- 172.21.15.8:0/2439525745 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4010da0 con 0x7fbcac107eb0 2023-10-06T23:30:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.928+0000 7fbcb11ff700 1 -- 172.21.15.8:0/2439525745 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac117bb0 con 0x7fbcac107eb0 2023-10-06T23:30:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.929+0000 7fbcb11ff700 1 -- 172.21.15.8:0/2439525745 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac1b6c30 con 0x7fbcac107eb0 2023-10-06T23:30:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.936+0000 7fbcc4b2eb80 1 Processor -- start 2023-10-06T23:30:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.937+0000 7fbcc4b2eb80 1 -- start start 2023-10-06T23:30:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.937+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459bd92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.937+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459bda450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.937+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bda990 0x563459be1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.937+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459b41400 con 0x563459bda990 2023-10-06T23:30:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.937+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459b32bc0 con 0x563459bd9fd0 2023-10-06T23:30:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.937+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459b304e0 con 0x563459bd8ec0 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.938+0000 7fbcab59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459bd92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.938+0000 7fbcab59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459bd92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49584/0 (socket says 172.21.15.8:49584) 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.938+0000 7fbcab59e700 1 -- 172.21.15.8:0/2115579949 learned_addr learned my addr 172.21.15.8:0/2115579949 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.938+0000 7fbca3fff700 1 -- 172.21.15.8:0/2439525745 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbca4010380 con 0x7fbcac107eb0 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.938+0000 7fbcab59e700 1 -- 172.21.15.8:0/2115579949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 msgr2=0x563459bda450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.938+0000 7fbcab59e700 1 --2- 172.21.15.8:0/2115579949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459bda450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.939+0000 7fbcab59e700 1 -- 172.21.15.8:0/2115579949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bda990 msgr2=0x563459be1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.939+0000 7fbcab59e700 1 --2- 172.21.15.8:0/2115579949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bda990 0x563459be1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.939+0000 7fbcab59e700 1 -- 172.21.15.8:0/2115579949 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563459956d80 con 0x563459bd8ec0 2023-10-06T23:30:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.939+0000 7fbcab59e700 1 --2- 172.21.15.8:0/2115579949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459bd92e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbc94005be0 tx=0x7fbc94005c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97224ca53d253ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.940+0000 7fbca17fa700 1 -- 172.21.15.8:0/2115579949 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9401d070 con 0x563459bd8ec0 2023-10-06T23:30:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.940+0000 7fbca17fa700 1 -- 172.21.15.8:0/2115579949 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc9400bc60 con 0x563459bd8ec0 2023-10-06T23:30:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.940+0000 7fbca17fa700 1 -- 172.21.15.8:0/2115579949 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94003f10 con 0x563459bd8ec0 2023-10-06T23:30:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.940+0000 7fbca3fff700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc980a1680 0x7fbc980a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.941+0000 7fbca3fff700 1 -- 172.21.15.8:0/2439525745 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbca40cc670 con 0x7fbcac107eb0 2023-10-06T23:30:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.941+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/2115579949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 msgr2=0x563459bd92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.941+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/2115579949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459bd92e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbc94005be0 tx=0x7fbc94005c10 comp rx=0 tx=0).stop 2023-10-06T23:30:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.942+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/2115579949 shutdown_connections 2023-10-06T23:30:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.942+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/2115579949 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bda990 0x563459be1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.942+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/2115579949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459bd92e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.942+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/2115579949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459bda450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.942+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/2115579949 >> 172.21.15.8:0/2115579949 conn(0x563459b4d200 msgr2=0x563459bd3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.942+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/2115579949 shutdown_connections 2023-10-06T23:30:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.942+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/2115579949 wait complete. 2023-10-06T23:30:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.943+0000 7fbcc4b2eb80 1 -- start start 2023-10-06T23:30:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.943+0000 7fbcc4b2eb80 1 Processor -- start 2023-10-06T23:30:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.944+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd8ec0 0x563459be2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.944+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd9fd0 0x563459be31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.944+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bda990 0x563459bea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.944+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459b2bdd0 con 0x563459bda990 2023-10-06T23:30:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.944+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459ac86b0 con 0x563459bd8ec0 2023-10-06T23:30:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.944+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459ac8350 con 0x563459bd9fd0 2023-10-06T23:30:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.944+0000 7fbcc4b2eb80 10 client.0 _ll_register_callbacks cb 0x5634599257a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:30:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.945+0000 7fbcaa59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd9fd0 0x563459be31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.945+0000 7fbcaa59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd9fd0 0x563459be31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49594/0 (socket says 172.21.15.8:49594) 2023-10-06T23:30:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.945+0000 7fbcaa59c700 1 -- 172.21.15.8:0/3491025612 learned_addr learned my addr 172.21.15.8:0/3491025612 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.945+0000 7fbcab59e700 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd8ec0 0x563459be2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.946+0000 7fbcaa59c700 1 -- 172.21.15.8:0/3491025612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd8ec0 msgr2=0x563459be2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:30:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.946+0000 7fbcaa59c700 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd8ec0 0x563459be2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.946+0000 7fbcaa59c700 1 -- 172.21.15.8:0/3491025612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bda990 msgr2=0x563459bea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:30:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.946+0000 7fbcaa59c700 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bda990 0x563459bea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.946+0000 7fbcaa59c700 1 -- 172.21.15.8:0/3491025612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac10e290 con 0x563459bd9fd0 2023-10-06T23:30:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.946+0000 7fbcaa59c700 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd9fd0 0x563459be31b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00ca40 tx=0x7fbc9c00cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36452f11171608e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.947+0000 7fbc927fc700 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2023-10-06T23:30:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.948+0000 7fbc927fc700 1 -- 172.21.15.8:0/3491025612 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c011070 con 0x563459bd9fd0 2023-10-06T23:30:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.948+0000 7fbc927fc700 1 -- 172.21.15.8:0/3491025612 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbc9c006e40 con 0x563459bd9fd0 2023-10-06T23:30:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.948+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3491025612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563459bcbd50 con 0x563459bd9fd0 2023-10-06T23:30:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.948+0000 7fbc927fc700 1 -- 172.21.15.8:0/3491025612 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc9c007530 con 0x563459bd9fd0 2023-10-06T23:30:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.948+0000 7fbcaad9d700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc980a1680 0x7fbc980a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbcc4b2eb80 10 client.27142 fetch_fsmap learned FSMap version 37 2023-10-06T23:30:01.951 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3491025612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56345993fc00 con 0x563459bd9fd0 2023-10-06T23:30:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbc927fc700 1 -- 172.21.15.8:0/3491025612 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563459bcbd50 con 0x563459bd9fd0 2023-10-06T23:30:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbc927fc700 1 -- 172.21.15.8:0/3491025612 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbc9c015640 con 0x563459bd9fd0 2023-10-06T23:30:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbcc4b2eb80 10 client.27142 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:30:01.952 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbcc4b2eb80 10 client.27142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:30:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbcc4b2eb80 20 client.27142 populate_metadata read hostname 'smithi008' 2023-10-06T23:30:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563459beeb00 0x563459bf0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbcc4b2eb80 4 client.27142 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-06T23:30:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.949+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3491025612 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563459b24db0 con 0x563459beeb00 2023-10-06T23:30:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.950+0000 7fbcaad9d700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc980a1680 0x7fbc980a3b40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbca4099640 tx=0x7fbca4009300 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.950+0000 7fbcab59e700 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563459beeb00 0x563459bf0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.953 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.951+0000 7fbcab59e700 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563459beeb00 0x563459bf0f20 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6961fe039b51f28 server_cookie=595a32adfc03128c in_seq=0 out_seq=0 2023-10-06T23:30:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.951+0000 7fbc927fc700 10 client.27142 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:30:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.952+0000 7fbc927fc700 1 -- 172.21.15.8:0/3491025612 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563459b24db0 con 0x563459beeb00 2023-10-06T23:30:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.952+0000 7fbc927fc700 10 client.27142 handle_command_reply: tid=0 2023-10-06T23:30:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.952+0000 7fbcc4b2eb80 1 client.27142 shutdown 2023-10-06T23:30:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3491025612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd9fd0 msgr2=0x563459be31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd9fd0 0x563459be31b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00ca40 tx=0x7fbc9c00cb20 comp rx=0 tx=0).stop 2023-10-06T23:30:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3491025612 shutdown_connections 2023-10-06T23:30:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563459beeb00 0x563459bf0f20 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bda990 0x563459bea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd8ec0 0x563459be2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3491025612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd9fd0 0x563459be31b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbc927fc700 0 client.27142 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:30:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3491025612 >> 172.21.15.8:0/3491025612 conn(0x563459b4d200 msgr2=0x563459bd3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3491025612 shutdown_connections 2023-10-06T23:30:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.955+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3491025612 wait complete. 2023-10-06T23:30:01.957 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.956+0000 7fbcc4b2eb80 20 client.27142 trim_cache size 0 max 16384 2023-10-06T23:30:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.981+0000 7fbcc4b2eb80 1 Processor -- start 2023-10-06T23:30:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.981+0000 7fbcc4b2eb80 1 -- start start 2023-10-06T23:30:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.981+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459be18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.981+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd9fd0 0x563459bea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.981+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bda990 0x563459be2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.981+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634599ac8c0 con 0x563459bd9fd0 2023-10-06T23:30:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.981+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459bd48e0 con 0x563459bda990 2023-10-06T23:30:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.981+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459bce2f0 con 0x563459bd8ec0 2023-10-06T23:30:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459be18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459be18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:49610/0 (socket says 172.21.15.8:49610) 2023-10-06T23:30:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 -- 172.21.15.8:0/647531775 learned_addr learned my addr 172.21.15.8:0/647531775 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bda990 0x563459be2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcaa59c700 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd9fd0 0x563459bea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 -- 172.21.15.8:0/647531775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bda990 msgr2=0x563459be2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:30:01.984 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bda990 0x563459be2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 -- 172.21.15.8:0/647531775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd9fd0 msgr2=0x563459bea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:30:01.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd9fd0 0x563459bea1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.982+0000 7fbcab59e700 1 -- 172.21.15.8:0/647531775 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56345997d1f0 con 0x563459bd8ec0 2023-10-06T23:30:01.985 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.983+0000 7fbcab59e700 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459be18d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbc940038c0 tx=0x7fbc94009910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab77019d764750b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.983+0000 7fbca1ffb700 1 -- 172.21.15.8:0/647531775 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9401d040 con 0x563459bd8ec0 2023-10-06T23:30:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.984+0000 7fbca1ffb700 1 -- 172.21.15.8:0/647531775 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc94034020 con 0x563459bd8ec0 2023-10-06T23:30:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.984+0000 7fbca1ffb700 1 -- 172.21.15.8:0/647531775 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94003f10 con 0x563459bd8ec0 2023-10-06T23:30:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.984+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/647531775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 msgr2=0x563459be18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.984+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459be18d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbc940038c0 tx=0x7fbc94009910 comp rx=0 tx=0).stop 2023-10-06T23:30:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.985+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/647531775 shutdown_connections 2023-10-06T23:30:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.985+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bda990 0x563459be2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.985+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bd8ec0 0x563459be18d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.985+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/647531775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd9fd0 0x563459bea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.985+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/647531775 >> 172.21.15.8:0/647531775 conn(0x563459b4d200 msgr2=0x563459be0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.985+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/647531775 shutdown_connections 2023-10-06T23:30:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.985+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/647531775 wait complete. 2023-10-06T23:30:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.986+0000 7fbcc4b2eb80 1 -- start start 2023-10-06T23:30:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.986+0000 7fbcc4b2eb80 1 Processor -- start 2023-10-06T23:30:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd8ec0 0x563459be79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459be7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcc4b2eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bda990 0x563459be8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459be9430 con 0x563459bd8ec0 2023-10-06T23:30:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459be95a0 con 0x563459bd9fd0 2023-10-06T23:30:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcc4b2eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563459be9760 con 0x563459bda990 2023-10-06T23:30:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcc4b2eb80 10 client.0 _ll_register_callbacks cb 0x7fbc9c009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T23:30:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcaa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459be7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcaa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459be7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:54100/0 (socket says 172.21.15.8:54100) 2023-10-06T23:30:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.987+0000 7fbcaa59c700 1 -- 172.21.15.8:0/3655812074 learned_addr learned my addr 172.21.15.8:0/3655812074 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.988+0000 7fbcab59e700 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bda990 0x563459be8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.991 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.988+0000 7fbcab59e700 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd8ec0 0x563459be79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.988+0000 7fbcaa59c700 1 -- 172.21.15.8:0/3655812074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bda990 msgr2=0x563459be8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:30:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.988+0000 7fbcaa59c700 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bda990 0x563459be8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.988+0000 7fbcaa59c700 1 -- 172.21.15.8:0/3655812074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd8ec0 msgr2=0x563459be79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T23:30:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.988+0000 7fbcaa59c700 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd8ec0 0x563459be79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.988+0000 7fbcaa59c700 1 -- 172.21.15.8:0/3655812074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563459956d80 con 0x563459bd9fd0 2023-10-06T23:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.989+0000 7fbcaa59c700 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459be7ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c004c20 tx=0x7fbc9c007070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46b336b524cdbe70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.989+0000 7fbc927fc700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-10-06T23:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.989+0000 7fbc927fc700 1 -- 172.21.15.8:0/3655812074 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c011040 con 0x563459bd9fd0 2023-10-06T23:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.989+0000 7fbc927fc700 1 -- 172.21.15.8:0/3655812074 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbc9c015d70 con 0x563459bd9fd0 2023-10-06T23:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.990+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3655812074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc9400bc60 con 0x563459bd9fd0 2023-10-06T23:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.990+0000 7fbc927fc700 1 -- 172.21.15.8:0/3655812074 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc9c015410 con 0x563459bd9fd0 2023-10-06T23:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.990+0000 7fbcc4b2eb80 10 client.27143 fetch_fsmap learned FSMap version 37 2023-10-06T23:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.990+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3655812074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563459955250 con 0x563459bd9fd0 2023-10-06T23:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.991+0000 7fbc927fc700 1 -- 172.21.15.8:0/3655812074 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc9400bc60 con 0x563459bd9fd0 2023-10-06T23:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.991+0000 7fbc927fc700 1 -- 172.21.15.8:0/3655812074 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbc9c031070 con 0x563459bd9fd0 2023-10-06T23:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.991+0000 7fbcc4b2eb80 10 client.27143 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T23:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.991+0000 7fbcc4b2eb80 10 client.27143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-06T23:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.991+0000 7fbcc4b2eb80 20 client.27143 populate_metadata read hostname 'smithi008' 2023-10-06T23:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.991+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563459c43230 0x563459c45620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.991+0000 7fbcc4b2eb80 4 client.27143 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-06T23:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.991+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3655812074 --> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563459b24ad0 con 0x563459c43230 2023-10-06T23:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.992+0000 7fbcab59e700 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563459c43230 0x563459c45620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.992+0000 7fbcab59e700 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563459c43230 0x563459c45620 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f643d88be7700b36 server_cookie=3d542ced4d53475c in_seq=0 out_seq=0 2023-10-06T23:30:01.997 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:01.992+0000 7fbc927fc700 10 client.27143 ms_handle_connect on v2:172.21.15.156:6838/1606000246 2023-10-06T23:30:02.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:01 smithi156 ceph-mon[102862]: pgmap v866: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-10-06T23:30:02.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:01 smithi008 ceph-mon[98532]: pgmap v866: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-10-06T23:30:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:01 smithi190 ceph-mon[102658]: pgmap v866: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-10-06T23:30:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.223+0000 7fbc927fc700 1 -- 172.21.15.8:0/3655812074 <== mds.0 v2:172.21.15.156:6838/1606000246 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563459b24ad0 con 0x563459c43230 2023-10-06T23:30:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.223+0000 7fbc927fc700 10 client.27143 handle_command_reply: tid=0 2023-10-06T23:30:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.224+0000 7fbcc4b2eb80 1 client.27143 shutdown 2023-10-06T23:30:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3655812074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 msgr2=0x563459be7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459be7ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c004c20 tx=0x7fbc9c007070 comp rx=0 tx=0).stop 2023-10-06T23:30:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3655812074 shutdown_connections 2023-10-06T23:30:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.156:6838/1606000246,v1:172.21.15.156:6839/1606000246] conn(0x563459c43230 0x563459c45620 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563459bd8ec0 0x563459be79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563459bda990 0x563459be8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 --2- 172.21.15.8:0/3655812074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563459bd9fd0 0x563459be7ee0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3655812074 >> 172.21.15.8:0/3655812074 conn(0x563459b4d200 msgr2=0x563459be18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbc927fc700 0 client.27143 ms_handle_reset on v2:172.21.15.156:6838/1606000246 2023-10-06T23:30:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:{ 2023-10-06T23:30:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "message": "", 2023-10-06T23:30:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout: "return_code": 0 2023-10-06T23:30:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stdout:} 2023-10-06T23:30:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3655812074 shutdown_connections 2023-10-06T23:30:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.225+0000 7fbcc4b2eb80 1 -- 172.21.15.8:0/3655812074 wait complete. 2023-10-06T23:30:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.226+0000 7fbcc4b2eb80 20 client.27143 trim_cache size 0 max 16384 2023-10-06T23:30:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 -- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc980a1680 msgr2=0x7fbc980a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc980a1680 0x7fbc980a3b40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbca4099640 tx=0x7fbca4009300 comp rx=0 tx=0).stop 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 -- 172.21.15.8:0/2439525745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac107eb0 msgr2=0x7fbcac118890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac107eb0 0x7fbcac118890 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbca400b530 tx=0x7fbca400b8f0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 -- 172.21.15.8:0/2439525745 shutdown_connections 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbc980a1680 0x7fbc980a3b40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcac10d1f0 0x7fbcac1171d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcac107eb0 0x7fbcac118890 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 --2- 172.21.15.8:0/2439525745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcac10a820 0x7fbcac118dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.229+0000 7fbcb11ff700 1 -- 172.21.15.8:0/2439525745 >> 172.21.15.8:0/2439525745 conn(0x7fbcac06dd10 msgr2=0x7fbcac10b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.230+0000 7fbcb11ff700 1 -- 172.21.15.8:0/2439525745 shutdown_connections 2023-10-06T23:30:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi008.front.sepia.ceph.com.smithi008.stderr:2023-10-06T23:30:02.230+0000 7fbcb11ff700 1 -- 172.21.15.8:0/2439525745 wait complete. 2023-10-06T23:30:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:03 smithi156 ceph-mon[102862]: pgmap v867: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2023-10-06T23:30:03.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:03 smithi008 ceph-mon[98532]: pgmap v867: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2023-10-06T23:30:03.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:03 smithi190 ceph-mon[102658]: pgmap v867: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 4.8 MiB/s wr, 534 op/s 2023-10-06T23:30:05.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:05 smithi190 ceph-mon[102658]: pgmap v868: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 5.8 MiB/s wr, 635 op/s 2023-10-06T23:30:06.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:05 smithi156 ceph-mon[102862]: pgmap v868: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 5.8 MiB/s wr, 635 op/s 2023-10-06T23:30:06.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:05 smithi008 ceph-mon[98532]: pgmap v868: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 5.8 MiB/s wr, 635 op/s 2023-10-06T23:30:07.532 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-06T23:30:07.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:07 smithi008 ceph-mon[98532]: pgmap v869: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.3 MiB/s wr, 822 op/s 2023-10-06T23:30:07.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:07 smithi190 ceph-mon[102658]: pgmap v869: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.3 MiB/s wr, 822 op/s 2023-10-06T23:30:08.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:07 smithi156 ceph-mon[102862]: pgmap v869: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.3 MiB/s wr, 822 op/s 2023-10-06T23:30:08.316 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/: 2023-10-06T23:30:08.316 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-06T23:30:08.316 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1620514768 Oct 6 23:13 . 2023-10-06T23:30:08.316 INFO:teuthology.orchestra.run.smithi008.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1620514768 Oct 6 23:13 .. 2023-10-06T23:30:08.316 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 data 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data: 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:total 41 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 . 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1620514768 Oct 6 23:13 .. 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 545693837 Oct 6 23:14 base 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Oct 6 23:13 current_logfiles 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Oct 6 23:13 global 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Oct 6 23:13 log 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_commit_ts 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_dynshmem 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 6 23:13 pg_hba.conf 2023-10-06T23:30:08.317 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 6 23:13 pg_ident.conf 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:30 pg_logical 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 pg_multixact 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 pg_notify 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_replslot 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_serial 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_snapshots 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 6 23:30 pg_stat 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 6 23:30 pg_stat_tmp 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 Oct 6 23:30 pg_subtrans 2023-10-06T23:30:08.318 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_tblspc 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 pg_twophase 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 6 23:13 PG_VERSION 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Oct 6 23:30 pg_wal 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Oct 6 23:13 pg_xact 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 6 23:13 postgresql.auto.conf 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 6 23:13 postgresql.conf 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Oct 6 23:13 postmaster.opts 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base: 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:total 3 2023-10-06T23:30:08.319 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 545693837 Oct 6 23:14 . 2023-10-06T23:30:08.320 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:08.320 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 1 2023-10-06T23:30:08.320 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 12346 2023-10-06T23:30:08.320 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 530930823 Oct 6 23:15 12347 2023-10-06T23:30:08.320 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:14 pgsql_tmp 2023-10-06T23:30:08.321 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:08.321 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-06T23:30:08.321 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-06T23:30:08.321 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 . 2023-10-06T23:30:08.321 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 545693837 Oct 6 23:14 .. 2023-10-06T23:30:08.321 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 112 2023-10-06T23:30:08.321 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 113 2023-10-06T23:30:08.321 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 6 23:13 12182 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12182_fsm 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12182_vm 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12184 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12186 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12187_fsm 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187_vm 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12189 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12191 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192 2023-10-06T23:30:08.322 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12192_fsm 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192_vm 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12194 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12196 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12197_fsm 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197_vm 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12199 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12201 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12202_fsm 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202_vm 2023-10-06T23:30:08.323 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12204 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12206 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12207_fsm 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207_vm 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12209 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12211 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12212 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12214 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12216 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 6 23:13 1247 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1247_fsm 2023-10-06T23:30:08.324 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1247_vm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 6 23:13 1249 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1249_fsm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1249_vm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 6 23:13 1255 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1255_fsm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1255_vm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 6 23:13 1259 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1259_fsm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1259_vm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417_vm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418_vm 2023-10-06T23:30:08.325 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 174 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 175 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2187 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224_vm 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328_vm 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336_vm 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2337 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2600 2023-10-06T23:30:08.326 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2600_fsm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2600_vm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2601_fsm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601_vm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2602 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2602_fsm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2602_vm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2603 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2603_fsm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2603_vm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604_vm 2023-10-06T23:30:08.327 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2605 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2605_fsm 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2605_vm 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2606_fsm 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606_vm 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607_fsm 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2607_vm 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 6 23:13 2608 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2608_fsm 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2608_vm 2023-10-06T23:30:08.328 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 6 23:13 2609 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2609_fsm 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2609_vm 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610_fsm 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2610_vm 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611_vm 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612 2023-10-06T23:30:08.329 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2612_fsm 2023-10-06T23:30:08.330 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612_vm 2023-10-06T23:30:08.330 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613 2023-10-06T23:30:08.330 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613_vm 2023-10-06T23:30:08.330 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615 2023-10-06T23:30:08.330 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2615_fsm 2023-10-06T23:30:08.330 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615_vm 2023-10-06T23:30:08.331 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616 2023-10-06T23:30:08.331 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616_fsm 2023-10-06T23:30:08.331 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2616_vm 2023-10-06T23:30:08.331 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 6 23:13 2617 2023-10-06T23:30:08.331 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2617_fsm 2023-10-06T23:30:08.331 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2617_vm 2023-10-06T23:30:08.331 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 6 23:13 2618 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2618_fsm 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2618_vm 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 6 23:13 2619 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2619_fsm 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2619_vm 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620_vm 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2650 2023-10-06T23:30:08.332 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2651 2023-10-06T23:30:08.333 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2652 2023-10-06T23:30:08.333 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2653 2023-10-06T23:30:08.333 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2654 2023-10-06T23:30:08.333 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2655 2023-10-06T23:30:08.333 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2656 2023-10-06T23:30:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2657 2023-10-06T23:30:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 6 23:13 2658 2023-10-06T23:30:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2659 2023-10-06T23:30:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2660 2023-10-06T23:30:08.334 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2661 2023-10-06T23:30:08.335 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2662 2023-10-06T23:30:08.335 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2663 2023-10-06T23:30:08.335 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2664 2023-10-06T23:30:08.335 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2665 2023-10-06T23:30:08.335 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2666 2023-10-06T23:30:08.335 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2667 2023-10-06T23:30:08.335 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2668 2023-10-06T23:30:08.335 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2669 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2670 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 6 23:13 2673 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 6 23:13 2674 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 6 23:13 2675 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2678 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2679 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2680 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2681 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2682 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2683 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2684 2023-10-06T23:30:08.336 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2685 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2686 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2687 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2688 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2689 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2690 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 6 23:13 2691 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2692 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2693 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2696 2023-10-06T23:30:08.337 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2699 2023-10-06T23:30:08.338 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2701 2023-10-06T23:30:08.338 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2702 2023-10-06T23:30:08.338 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2703 2023-10-06T23:30:08.338 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2704 2023-10-06T23:30:08.338 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2753 2023-10-06T23:30:08.338 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2753_fsm 2023-10-06T23:30:08.338 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2753_vm 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2754 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2755 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2756 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2757 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830_vm 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2831 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832_vm 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2833 2023-10-06T23:30:08.339 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834_vm 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2835 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836_vm 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2837 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 6 23:13 2838 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2838_fsm 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2838_vm 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2839 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840_fsm 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2840_vm 2023-10-06T23:30:08.340 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2841 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995_vm 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2996 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3079_fsm 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079_vm 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3080 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3081 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3085 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118_vm 2023-10-06T23:30:08.341 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3119 2023-10-06T23:30:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3164 2023-10-06T23:30:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256 2023-10-06T23:30:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256_vm 2023-10-06T23:30:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3257 2023-10-06T23:30:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3258 2023-10-06T23:30:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350 2023-10-06T23:30:08.342 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350_vm 2023-10-06T23:30:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3351 2023-10-06T23:30:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3379 2023-10-06T23:30:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3380 2023-10-06T23:30:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381 2023-10-06T23:30:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381_vm 2023-10-06T23:30:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3394 2023-10-06T23:30:08.343 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3394_fsm 2023-10-06T23:30:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3394_vm 2023-10-06T23:30:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3395 2023-10-06T23:30:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439 2023-10-06T23:30:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439_vm 2023-10-06T23:30:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3440 2023-10-06T23:30:08.344 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 3455 2023-10-06T23:30:08.345 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3456 2023-10-06T23:30:08.345 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3456_fsm 2023-10-06T23:30:08.345 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3456_vm 2023-10-06T23:30:08.345 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466 2023-10-06T23:30:08.345 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466_vm 2023-10-06T23:30:08.345 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3467 2023-10-06T23:30:08.346 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3468 2023-10-06T23:30:08.346 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501 2023-10-06T23:30:08.346 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501_vm 2023-10-06T23:30:08.346 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3502 2023-10-06T23:30:08.346 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3503 2023-10-06T23:30:08.346 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3534 2023-10-06T23:30:08.346 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541 2023-10-06T23:30:08.347 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3541_fsm 2023-10-06T23:30:08.347 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541_vm 2023-10-06T23:30:08.347 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3542 2023-10-06T23:30:08.347 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3574 2023-10-06T23:30:08.347 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3575 2023-10-06T23:30:08.347 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576 2023-10-06T23:30:08.348 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576_vm 2023-10-06T23:30:08.348 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596 2023-10-06T23:30:08.348 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596_vm 2023-10-06T23:30:08.348 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3597 2023-10-06T23:30:08.348 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598 2023-10-06T23:30:08.348 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598_vm 2023-10-06T23:30:08.348 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3599 2023-10-06T23:30:08.349 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600 2023-10-06T23:30:08.349 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3600_fsm 2023-10-06T23:30:08.349 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600_vm 2023-10-06T23:30:08.349 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601 2023-10-06T23:30:08.349 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3601_fsm 2023-10-06T23:30:08.349 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601_vm 2023-10-06T23:30:08.350 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602 2023-10-06T23:30:08.350 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3602_fsm 2023-10-06T23:30:08.350 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602_vm 2023-10-06T23:30:08.350 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3603 2023-10-06T23:30:08.350 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3603_fsm 2023-10-06T23:30:08.350 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3603_vm 2023-10-06T23:30:08.351 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3604 2023-10-06T23:30:08.351 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3605 2023-10-06T23:30:08.351 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3606 2023-10-06T23:30:08.351 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3607 2023-10-06T23:30:08.351 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3608 2023-10-06T23:30:08.351 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 3609 2023-10-06T23:30:08.352 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3712 2023-10-06T23:30:08.352 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764 2023-10-06T23:30:08.352 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3764_fsm 2023-10-06T23:30:08.352 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764_vm 2023-10-06T23:30:08.352 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3766 2023-10-06T23:30:08.352 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3767 2023-10-06T23:30:08.353 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3997 2023-10-06T23:30:08.353 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 5002 2023-10-06T23:30:08.353 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 548 2023-10-06T23:30:08.353 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 549 2023-10-06T23:30:08.353 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102 2023-10-06T23:30:08.353 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102_vm 2023-10-06T23:30:08.353 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104 2023-10-06T23:30:08.354 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104_vm 2023-10-06T23:30:08.354 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106 2023-10-06T23:30:08.354 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106_vm 2023-10-06T23:30:08.354 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6110 2023-10-06T23:30:08.354 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6111 2023-10-06T23:30:08.355 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6112 2023-10-06T23:30:08.355 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6113 2023-10-06T23:30:08.355 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6117 2023-10-06T23:30:08.355 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826 2023-10-06T23:30:08.355 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826_vm 2023-10-06T23:30:08.355 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 827 2023-10-06T23:30:08.355 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 828 2023-10-06T23:30:08.356 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 6 23:13 pg_filenode.map 2023-10-06T23:30:09.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 6 23:13 PG_VERSION 2023-10-06T23:30:09.083 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.083 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-06T23:30:09.083 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-06T23:30:09.083 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 6 23:13 . 2023-10-06T23:30:09.083 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 545693837 Oct 6 23:14 .. 2023-10-06T23:30:09.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 112 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 113 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 6 23:13 12182 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12182_fsm 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12182_vm 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12184 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12186 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12187_fsm 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187_vm 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12189 2023-10-06T23:30:09.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12191 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12192_fsm 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192_vm 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12194 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12196 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12197_fsm 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197_vm 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12199 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12201 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12202_fsm 2023-10-06T23:30:09.085 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202_vm 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12204 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12206 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12207_fsm 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207_vm 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12209 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12211 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12212 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12214 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12216 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 6 23:13 1247 2023-10-06T23:30:09.086 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1247_fsm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1247_vm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 6 23:13 1249 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1249_fsm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1249_vm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 6 23:13 1255 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1255_fsm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1255_vm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 6 23:13 1259 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1259_fsm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1259_vm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417_vm 2023-10-06T23:30:09.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418_vm 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 174 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 175 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2187 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224_vm 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328_vm 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336_vm 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2337 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2600 2023-10-06T23:30:09.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2600_fsm 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2600_vm 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2601_fsm 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601_vm 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2602 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2602_fsm 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2602_vm 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2603 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2603_fsm 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2603_vm 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604 2023-10-06T23:30:09.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604_vm 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2605 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2605_fsm 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2605_vm 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2606_fsm 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2606_vm 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607_fsm 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2607_vm 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 6 23:13 2608 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2608_fsm 2023-10-06T23:30:09.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2608_vm 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 6 23:13 2609 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2609_fsm 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2609_vm 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2610_fsm 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2610_vm 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611_vm 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2612_fsm 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612_vm 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613 2023-10-06T23:30:09.091 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613_vm 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2615_fsm 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615_vm 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616_fsm 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2616_vm 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 6 23:13 2617 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2617_fsm 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2617_vm 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 6 23:13 2618 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2618_fsm 2023-10-06T23:30:09.092 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2618_vm 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 6 23:13 2619 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2619_fsm 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2619_vm 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620_vm 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2650 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2651 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2652 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2653 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2654 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2655 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2656 2023-10-06T23:30:09.093 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2657 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 6 23:13 2658 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2659 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2660 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2661 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2662 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2663 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2664 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2665 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2666 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2667 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2668 2023-10-06T23:30:09.094 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2669 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2670 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 6 23:13 2673 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 6 23:13 2674 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 6 23:13 2675 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2678 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2679 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2680 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2681 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2682 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2683 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2684 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2685 2023-10-06T23:30:09.095 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2686 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2687 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2688 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2689 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2690 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 6 23:13 2691 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2692 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2693 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2696 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2699 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2701 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2702 2023-10-06T23:30:09.096 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2703 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2704 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2753 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2753_fsm 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2753_vm 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2754 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2755 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2756 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2757 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830_vm 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2831 2023-10-06T23:30:09.097 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832_vm 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2833 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834_vm 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2835 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836_vm 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2837 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 6 23:13 2838 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2838_fsm 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2838_vm 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2839 2023-10-06T23:30:09.098 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840_fsm 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2840_vm 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2841 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995_vm 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2996 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3079_fsm 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079_vm 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3080 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3081 2023-10-06T23:30:09.099 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3085 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118_vm 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3119 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3164 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256_vm 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3257 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3258 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350_vm 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3351 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3379 2023-10-06T23:30:09.100 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3380 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381_vm 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3394 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3394_fsm 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3394_vm 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3395 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439_vm 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3440 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 3455 2023-10-06T23:30:09.101 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3456 2023-10-06T23:30:09.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3456_fsm 2023-10-06T23:30:09.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3456_vm 2023-10-06T23:30:09.103 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466_vm 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3467 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3468 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501_vm 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3502 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3503 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3534 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3541_fsm 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541_vm 2023-10-06T23:30:09.104 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3542 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3574 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3575 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576_vm 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596_vm 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3597 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598_vm 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3599 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600 2023-10-06T23:30:09.105 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3600_fsm 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600_vm 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3601_fsm 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601_vm 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3602_fsm 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602_vm 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3603 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3603_fsm 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3603_vm 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3604 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3605 2023-10-06T23:30:09.106 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3606 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3607 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3608 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 3609 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3712 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3764_fsm 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764_vm 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3766 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3767 2023-10-06T23:30:09.107 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3997 2023-10-06T23:30:09.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 5002 2023-10-06T23:30:09.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 548 2023-10-06T23:30:09.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 549 2023-10-06T23:30:09.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102 2023-10-06T23:30:09.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102_vm 2023-10-06T23:30:09.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104 2023-10-06T23:30:09.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104_vm 2023-10-06T23:30:09.110 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106 2023-10-06T23:30:09.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106_vm 2023-10-06T23:30:09.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6110 2023-10-06T23:30:09.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6111 2023-10-06T23:30:09.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6112 2023-10-06T23:30:09.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6113 2023-10-06T23:30:09.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6117 2023-10-06T23:30:09.111 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826 2023-10-06T23:30:09.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826_vm 2023-10-06T23:30:09.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 827 2023-10-06T23:30:09.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 828 2023-10-06T23:30:09.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 6 23:13 pg_filenode.map 2023-10-06T23:30:09.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 6 23:13 PG_VERSION 2023-10-06T23:30:09.733 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:total 518489 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 530930823 Oct 6 23:15 . 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 545693837 Oct 6 23:14 .. 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 112 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 113 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 6 23:13 12182 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12182_fsm 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12182_vm 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12184 2023-10-06T23:30:09.734 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12186 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12187_fsm 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12187_vm 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12189 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12191 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12192_fsm 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12192_vm 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12194 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12196 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12197_fsm 2023-10-06T23:30:09.735 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12197_vm 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12199 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12201 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12202_fsm 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12202_vm 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12204 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12206 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 12207_fsm 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12207_vm 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12209 2023-10-06T23:30:09.736 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12211 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12212 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 12214 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 12216 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 6 23:14 1247 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:14 1247_fsm 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 1247_vm 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 6 23:14 1249 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:14 1249_fsm 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 1249_vm 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 6 23:13 1255 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1255_fsm 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1255_vm 2023-10-06T23:30:09.737 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 6 23:30 1259 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1259_fsm 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 1259_vm 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1417_vm 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 1418_vm 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 204800 Oct 6 23:30 16387 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:30 16387_fsm 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:30 16387_vm 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Oct 6 23:30 16393 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:30 16393_fsm 2023-10-06T23:30:09.738 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:27 16393_vm 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 437157888 Oct 6 23:30 16396 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 6 23:29 16396_fsm 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:29 16396_vm 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:29 16397 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:29 16399 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Oct 6 23:30 16401 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 13582336 Oct 6 23:30 16403 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:29 16403_fsm 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 174 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 175 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2187 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224 2023-10-06T23:30:09.739 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2224_vm 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2328_vm 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2336_vm 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2337 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2600 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2600_fsm 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2600_vm 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2601_fsm 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2601_vm 2023-10-06T23:30:09.740 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2602 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2602_fsm 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2602_vm 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2603 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2603_fsm 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2603_vm 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2604_vm 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2605 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2605_fsm 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2605_vm 2023-10-06T23:30:09.741 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 2606 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2606_fsm 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 2606_vm 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2607_fsm 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2607_vm 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Oct 6 23:14 2608 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:14 2608_fsm 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 2608_vm 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 6 23:13 2609 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2609_fsm 2023-10-06T23:30:09.742 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2609_vm 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:14 2610 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:14 2610_fsm 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 2610_vm 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2611_vm 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2612_fsm 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2612_vm 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2613_vm 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2615_fsm 2023-10-06T23:30:09.743 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2615_vm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2616_fsm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2616_vm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 6 23:13 2617 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2617_fsm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2617_vm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 6 23:13 2618 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2618_fsm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2618_vm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Oct 6 23:30 2619 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:20 2619_fsm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 2619_vm 2023-10-06T23:30:09.744 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2620_vm 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2650 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2651 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2652 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2653 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2654 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2655 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2656 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2657 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Oct 6 23:14 2658 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:14 2659 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2660 2023-10-06T23:30:09.745 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2661 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:14 2662 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:14 2663 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:14 2664 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:14 2665 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:14 2666 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:14 2667 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2668 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2669 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2670 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 6 23:14 2673 2023-10-06T23:30:09.746 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 6 23:14 2674 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 6 23:13 2675 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:14 2678 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:14 2679 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2680 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2681 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2682 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2683 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2684 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2685 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2686 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2687 2023-10-06T23:30:09.747 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:13 2688 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 6 23:13 2689 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 6 23:13 2690 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 6 23:13 2691 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2692 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2693 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:26 2696 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2699 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2701 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2702 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:14 2703 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:14 2704 2023-10-06T23:30:09.748 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2753 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2753_fsm 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2753_vm 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2754 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2755 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2756 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 2757 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2830_vm 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2831 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2832_vm 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2833 2023-10-06T23:30:09.749 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2834_vm 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2835 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2836_vm 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2837 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 6 23:13 2838 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2838_fsm 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2838_vm 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2839 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2840_fsm 2023-10-06T23:30:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2840_vm 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2841 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2995_vm 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2996 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3079_fsm 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3079_vm 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3080 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3081 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3085 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118 2023-10-06T23:30:09.751 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3118_vm 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3119 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3164 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3256_vm 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3257 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3258 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3350_vm 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3351 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3379 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3380 2023-10-06T23:30:09.752 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3381_vm 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3394 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3394_fsm 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3394_vm 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3395 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3439_vm 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3440 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 6 23:14 3455 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3456 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3456_fsm 2023-10-06T23:30:09.753 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3456_vm 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3466_vm 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3467 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3468 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3501_vm 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3502 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3503 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3534 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3541_fsm 2023-10-06T23:30:09.754 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3541_vm 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3542 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3574 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3575 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3576_vm 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3596_vm 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3597 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3598_vm 2023-10-06T23:30:09.755 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3599 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3600_fsm 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3600_vm 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3601_fsm 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3601_vm 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3602_fsm 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3602_vm 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3603 2023-10-06T23:30:09.756 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3603_fsm 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3603_vm 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3604 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3605 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3606 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3607 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3608 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 6 23:13 3609 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3712 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764 2023-10-06T23:30:09.757 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 3764_fsm 2023-10-06T23:30:09.850 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3764_vm 2023-10-06T23:30:09.850 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3766 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 3767 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3997 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 5002 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 548 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 549 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6102_vm 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6104_vm 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6106_vm 2023-10-06T23:30:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6110 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6111 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6112 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6113 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6117 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 826_vm 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 827 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 828 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 6 23:13 pg_filenode.map 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Oct 6 23:13 pg_internal.init 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 6 23:13 PG_VERSION 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.852 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:14 . 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 545693837 Oct 6 23:14 .. 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/global: 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:total 575 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Oct 6 23:13 . 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1136 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1136_fsm 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1136_vm 2023-10-06T23:30:09.853 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 1137 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1213 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1213_fsm 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1213_vm 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1214 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1214_fsm 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1214_vm 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 1232 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 1233 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1260 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1260_fsm 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1260_vm 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1261 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1261_fsm 2023-10-06T23:30:09.854 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1261_vm 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1262 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 1262_fsm 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 1262_vm 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2396 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 6 23:13 2396_fsm 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2396_vm 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2397 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2671 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2672 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2676 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2677 2023-10-06T23:30:09.855 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2694 2023-10-06T23:30:09.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2695 2023-10-06T23:30:09.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2697 2023-10-06T23:30:09.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 2698 2023-10-06T23:30:09.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2846 2023-10-06T23:30:09.857 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2846_vm 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2847 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2964 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2964_vm 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2965 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2966 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 2966_vm 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 2967 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3592 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 3592_vm 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 3593 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 4060 2023-10-06T23:30:09.858 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 4060_vm 2023-10-06T23:30:09.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 4061 2023-10-06T23:30:09.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6000 2023-10-06T23:30:09.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6000_vm 2023-10-06T23:30:09.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6001 2023-10-06T23:30:09.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6002 2023-10-06T23:30:09.859 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6100 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 6100_vm 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6114 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 6115 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:30 pg_control 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 6 23:13 pg_filenode.map 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Oct 6 23:13 pg_internal.init 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/log: 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Oct 6 23:13 . 2023-10-06T23:30:09.925 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 594 Oct 6 23:30 postgresql-Fri.log 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:09.926 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:total 3 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:30 . 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 mappings 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:30 replorigin_checkpoint 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 snapshots 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:09.927 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:30 .. 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 6 23:30 .. 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 . 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 members 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 offsets 2023-10-06T23:30:09.928 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 . 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 .. 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 0000 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 . 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 6 23:13 .. 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:14 0000 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.929 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-06T23:30:09.930 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-06T23:30:09.930 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 . 2023-10-06T23:30:09.930 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:09.930 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 6 23:13 0000 2023-10-06T23:30:09.930 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:09.930 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-06T23:30:09.930 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:09.930 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:10.076 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.076 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.076 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:total 14 2023-10-06T23:30:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 6 23:30 . 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Oct 6 23:30 db_0.stat 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Oct 6 23:30 db_12347.stat 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Oct 6 23:30 global.stat 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 6 23:30 . 2023-10-06T23:30:10.078 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:total 137 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 Oct 6 23:30 . 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 Oct 6 23:30 0003 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.079 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:total 1048578 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Oct 6 23:30 . 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:29 000000010000000000000061 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:29 000000010000000000000062 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:29 000000010000000000000063 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:29 000000010000000000000064 2023-10-06T23:30:10.080 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:30 000000010000000000000065 2023-10-06T23:30:10.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:19 000000010000000000000066 2023-10-06T23:30:10.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:15 000000010000000000000067 2023-10-06T23:30:10.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:15 000000010000000000000068 2023-10-06T23:30:10.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:15 000000010000000000000069 2023-10-06T23:30:10.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:15 00000001000000000000006A 2023-10-06T23:30:10.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:17 00000001000000000000006B 2023-10-06T23:30:10.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:16 00000001000000000000006C 2023-10-06T23:30:10.081 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:18 00000001000000000000006D 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:17 00000001000000000000006E 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:16 00000001000000000000006F 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:14 000000010000000000000070 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:14 000000010000000000000071 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:19 000000010000000000000072 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:22 000000010000000000000073 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:21 000000010000000000000074 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:19 000000010000000000000075 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:21 000000010000000000000076 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:20 000000010000000000000077 2023-10-06T23:30:10.082 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:20 000000010000000000000078 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:22 000000010000000000000079 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:22 00000001000000000000007A 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:20 00000001000000000000007B 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:19 00000001000000000000007C 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:21 00000001000000000000007D 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:23 00000001000000000000007E 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:20 00000001000000000000007F 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:21 000000010000000000000080 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:19 000000010000000000000081 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:22 000000010000000000000082 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:19 000000010000000000000083 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:20 000000010000000000000084 2023-10-06T23:30:10.083 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:24 000000010000000000000085 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:23 000000010000000000000086 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:21 000000010000000000000087 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:23 000000010000000000000088 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:20 000000010000000000000089 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:24 00000001000000000000008A 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:26 00000001000000000000008B 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:25 00000001000000000000008C 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:26 00000001000000000000008D 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:27 00000001000000000000008E 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:24 00000001000000000000008F 2023-10-06T23:30:10.084 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:25 000000010000000000000090 2023-10-06T23:30:10.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:28 000000010000000000000091 2023-10-06T23:30:10.087 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:26 000000010000000000000092 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:28 000000010000000000000093 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:25 000000010000000000000094 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:27 000000010000000000000095 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:26 000000010000000000000096 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:24 000000010000000000000097 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:26 000000010000000000000098 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:27 000000010000000000000099 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:24 00000001000000000000009A 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:24 00000001000000000000009B 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:25 00000001000000000000009C 2023-10-06T23:30:10.088 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:25 00000001000000000000009D 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:29 00000001000000000000009E 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:25 00000001000000000000009F 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 6 23:28 0000000100000000000000A0 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 archive_status 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 6 23:13 . 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Oct 6 23:30 .. 2023-10-06T23:30:10.089 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.090 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-06T23:30:10.090 INFO:teuthology.orchestra.run.smithi008.stdout:total 65 2023-10-06T23:30:10.090 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Oct 6 23:13 . 2023-10-06T23:30:10.090 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1620305579 Oct 6 23:30 .. 2023-10-06T23:30:10.090 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Oct 6 23:30 0000 2023-10-06T23:30:10.090 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:09 smithi008 ceph-mon[98532]: pgmap v870: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.1 MiB/s wr, 730 op/s 2023-10-06T23:30:10.093 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-06T23:30:10.104 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T23:30:10.104 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:09 smithi156 ceph-mon[102862]: pgmap v870: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.1 MiB/s wr, 730 op/s 2023-10-06T23:30:10.115 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-06T23:30:10.167 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-06T23:30:10.167 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-06T23:30:10.168 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-06T23:30:10.228 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:30:10.229 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:09 smithi190 ceph-mon[102658]: pgmap v870: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.1 MiB/s wr, 730 op/s 2023-10-06T23:30:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.442+0000 7f47d57ff700 1 -- 172.21.15.8:0/4090251442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0100ea0 msgr2=0x7f47d01012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.442+0000 7f47d57ff700 1 --2- 172.21.15.8:0/4090251442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0100ea0 0x7f47d01012c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009990 tx=0x7f47c0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.443+0000 7f47d57ff700 1 -- 172.21.15.8:0/4090251442 shutdown_connections 2023-10-06T23:30:10.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.443+0000 7f47d57ff700 1 --2- 172.21.15.8:0/4090251442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0100ea0 0x7f47d01012c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.443+0000 7f47d57ff700 1 --2- 172.21.15.8:0/4090251442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47d0102a40 0x7f47d0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.443+0000 7f47d57ff700 1 --2- 172.21.15.8:0/4090251442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47d0102080 0x7f47d0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.443+0000 7f47d57ff700 1 -- 172.21.15.8:0/4090251442 >> 172.21.15.8:0/4090251442 conn(0x7f47d00fc420 msgr2=0x7f47d00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.443+0000 7f47d57ff700 1 -- 172.21.15.8:0/4090251442 shutdown_connections 2023-10-06T23:30:10.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.443+0000 7f47d57ff700 1 -- 172.21.15.8:0/4090251442 wait complete. 2023-10-06T23:30:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47d57ff700 1 Processor -- start 2023-10-06T23:30:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47d57ff700 1 -- start start 2023-10-06T23:30:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47d57ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47d0100ea0 0x7f47d0198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47d57ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0102080 0x7f47d0199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47d57ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47d0102a40 0x7f47d01a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47d57ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d01a0860 con 0x7f47d0102080 2023-10-06T23:30:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47d57ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d01a09d0 con 0x7f47d0100ea0 2023-10-06T23:30:10.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47d57ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d01a0b90 con 0x7f47d0102a40 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47ce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0102080 0x7f47d0199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47ceffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47d0100ea0 0x7f47d0198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47ce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0102080 0x7f47d0199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60640/0 (socket says 172.21.15.8:60640) 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47ce7fc700 1 -- 172.21.15.8:0/863013567 learned_addr learned my addr 172.21.15.8:0/863013567 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.444+0000 7f47cf7fe700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47d0102a40 0x7f47d01a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47ce7fc700 1 -- 172.21.15.8:0/863013567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47d0102a40 msgr2=0x7f47d01a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47ce7fc700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47d0102a40 0x7f47d01a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47ce7fc700 1 -- 172.21.15.8:0/863013567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47d0100ea0 msgr2=0x7f47d0198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47ce7fc700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47d0100ea0 0x7f47d0198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47ce7fc700 1 -- 172.21.15.8:0/863013567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00095f0 con 0x7f47d0102080 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47ce7fc700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0102080 0x7f47d0199260 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f47c400e970 tx=0x7f47c400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47b7fff700 1 -- 172.21.15.8:0/863013567 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4009790 con 0x7f47d0102080 2023-10-06T23:30:10.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47b7fff700 1 -- 172.21.15.8:0/863013567 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47c400c7e0 con 0x7f47d0102080 2023-10-06T23:30:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47b7fff700 1 -- 172.21.15.8:0/863013567 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4003bd0 con 0x7f47d0102080 2023-10-06T23:30:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d01a0e70 con 0x7f47d0102080 2023-10-06T23:30:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.445+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d01a1290 con 0x7f47d0102080 2023-10-06T23:30:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.446+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d0193400 con 0x7f47d0102080 2023-10-06T23:30:10.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.448+0000 7f47b7fff700 1 -- 172.21.15.8:0/863013567 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f47c400c950 con 0x7f47d0102080 2023-10-06T23:30:10.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.451+0000 7f47b7fff700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47b80a1550 0x7f47b80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:10.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.451+0000 7f47b7fff700 1 -- 172.21.15.8:0/863013567 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f47c4014070 con 0x7f47d0102080 2023-10-06T23:30:10.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.451+0000 7f47ceffd700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47b80a1550 0x7f47b80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:10.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.451+0000 7f47ceffd700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47b80a1550 0x7f47b80a3a10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f47c0005910 tx=0x7f47c000b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:10.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.455+0000 7f47b7fff700 1 -- 172.21.15.8:0/863013567 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f47c40964b0 con 0x7f47d0102080 2023-10-06T23:30:10.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.673+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47d010c660 con 0x7f47d0102080 2023-10-06T23:30:10.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.674+0000 7f47b7fff700 1 -- 172.21.15.8:0/863013567 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22491 (secure 0 0 0) 0x7f47c4099ad0 con 0x7f47d0102080 2023-10-06T23:30:10.676 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:10.676 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:19:48.224731+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47b80a1550 msgr2=0x7f47b80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47b80a1550 0x7f47b80a3a10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f47c0005910 tx=0x7f47c000b260 comp rx=0 tx=0).stop 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0102080 msgr2=0x7f47d0199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0102080 0x7f47d0199260 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f47c400e970 tx=0x7f47c400ec80 comp rx=0 tx=0).stop 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 shutdown_connections 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47b80a1550 0x7f47b80a3a10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47d0102a40 0x7f47d01a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47d0100ea0 0x7f47d0198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 --2- 172.21.15.8:0/863013567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47d0102080 0x7f47d0199260 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.677+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 >> 172.21.15.8:0/863013567 conn(0x7f47d00fc420 msgr2=0x7f47d0107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:10.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.678+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 shutdown_connections 2023-10-06T23:30:10.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.678+0000 7f47d57ff700 1 -- 172.21.15.8:0/863013567 wait complete. 2023-10-06T23:30:10.699 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:30:10.699 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:30:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 -- 172.21.15.8:0/2164005845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304100ea0 msgr2=0x7fd3041012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/2164005845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304100ea0 0x7fd3041012c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009990 tx=0x7fd2f4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 -- 172.21.15.8:0/2164005845 shutdown_connections 2023-10-06T23:30:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/2164005845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd304102a40 0x7fd304109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/2164005845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304100ea0 0x7fd3041012c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/2164005845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd304102080 0x7fd304102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 -- 172.21.15.8:0/2164005845 >> 172.21.15.8:0/2164005845 conn(0x7fd3040fc460 msgr2=0x7fd3040fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 -- 172.21.15.8:0/2164005845 shutdown_connections 2023-10-06T23:30:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.904+0000 7fd30a1ff700 1 -- 172.21.15.8:0/2164005845 wait complete. 2023-10-06T23:30:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd30a1ff700 1 Processor -- start 2023-10-06T23:30:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd30a1ff700 1 -- start start 2023-10-06T23:30:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd30a1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd304100ea0 0x7fd304074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd30a1ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd304102080 0x7fd3040732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd30a1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304102a40 0x7fd3040737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd30a1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd304073f80 con 0x7fd304100ea0 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd30a1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040740f0 con 0x7fd304102a40 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd30a1ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3041a0c70 con 0x7fd304102080 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd3037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd304100ea0 0x7fd304074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.905+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd304102080 0x7fd3040732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd304102080 0x7fd3040732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47618/0 (socket says 172.21.15.8:47618) 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd3037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd304100ea0 0x7fd304074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60652/0 (socket says 172.21.15.8:60652) 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd302ffd700 1 -- 172.21.15.8:0/878493271 learned_addr learned my addr 172.21.15.8:0/878493271 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:10.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd303fff700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304102a40 0x7fd3040737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd3037fe700 1 -- 172.21.15.8:0/878493271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd304102080 msgr2=0x7fd3040732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd3037fe700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd304102080 0x7fd3040732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd3037fe700 1 -- 172.21.15.8:0/878493271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304102a40 msgr2=0x7fd3040737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd3037fe700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304102a40 0x7fd3040737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd3037fe700 1 -- 172.21.15.8:0/878493271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8009520 con 0x7fd304100ea0 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd3037fe700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd304100ea0 0x7fd304074c60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40098e0 tx=0x7fd2f4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd300ff9700 1 -- 172.21.15.8:0/878493271 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f401d070 con 0x7fd304100ea0 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc009c40 con 0x7fd304100ea0 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd300ff9700 1 -- 172.21.15.8:0/878493271 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd2f400bdb0 con 0x7fd304100ea0 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.906+0000 7fd300ff9700 1 -- 172.21.15.8:0/878493271 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4022ca0 con 0x7fd304100ea0 2023-10-06T23:30:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.907+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f40095f0 con 0x7fd304100ea0 2023-10-06T23:30:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.908+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30410c610 con 0x7fd304100ea0 2023-10-06T23:30:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.910+0000 7fd300ff9700 1 -- 172.21.15.8:0/878493271 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd2f4022470 con 0x7fd304100ea0 2023-10-06T23:30:10.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.911+0000 7fd300ff9700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2ec0a1480 0x7fd2ec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:10.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.911+0000 7fd300ff9700 1 -- 172.21.15.8:0/878493271 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd2f4022e40 con 0x7fd304100ea0 2023-10-06T23:30:10.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.911+0000 7fd302ffd700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2ec0a1480 0x7fd2ec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:10.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.912+0000 7fd302ffd700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2ec0a1480 0x7fd2ec0a3940 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8005950 tx=0x7fd2f8009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:10.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:10.915+0000 7fd300ff9700 1 -- 172.21.15.8:0/878493271 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd2f40978d0 con 0x7fd304100ea0 2023-10-06T23:30:11.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:10 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/863013567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:30:11.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.124+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd304107f60 con 0x7fd304100ea0 2023-10-06T23:30:11.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.124+0000 7fd300ff9700 1 -- 172.21.15.8:0/878493271 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2f4027020 con 0x7fd304100ea0 2023-10-06T23:30:11.126 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2ec0a1480 msgr2=0x7fd2ec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2ec0a1480 0x7fd2ec0a3940 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8005950 tx=0x7fd2f8009260 comp rx=0 tx=0).stop 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd304100ea0 msgr2=0x7fd304074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd304100ea0 0x7fd304074c60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40098e0 tx=0x7fd2f4005740 comp rx=0 tx=0).stop 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 shutdown_connections 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fd2ec0a1480 0x7fd2ec0a3940 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd304100ea0 0x7fd304074c60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304102a40 0x7fd3040737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 --2- 172.21.15.8:0/878493271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd304102080 0x7fd3040732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.126+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 >> 172.21.15.8:0/878493271 conn(0x7fd3040fc460 msgr2=0x7fd3040fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:11.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.127+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 shutdown_connections 2023-10-06T23:30:11.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.127+0000 7fd30a1ff700 1 -- 172.21.15.8:0/878493271 wait complete. 2023-10-06T23:30:11.144 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:10 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/863013567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:30:11.147 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:30:11.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:10 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/863013567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:30:11.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 -- 172.21.15.8:0/2763678893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 msgr2=0x7f55bc073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 --2- 172.21.15.8:0/2763678893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 0x7f55bc073d90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009990 tx=0x7f55a8009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 -- 172.21.15.8:0/2763678893 shutdown_connections 2023-10-06T23:30:11.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 --2- 172.21.15.8:0/2763678893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc108da0 0x7f55bc10b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 --2- 172.21.15.8:0/2763678893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55bc074ef0 0x7f55bc073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 --2- 172.21.15.8:0/2763678893 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 0x7f55bc073d90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 -- 172.21.15.8:0/2763678893 >> 172.21.15.8:0/2763678893 conn(0x7f55bc0fc430 msgr2=0x7f55bc0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 -- 172.21.15.8:0/2763678893 shutdown_connections 2023-10-06T23:30:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.351+0000 7f55c2bff700 1 -- 172.21.15.8:0/2763678893 wait complete. 2023-10-06T23:30:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.353+0000 7f55c2bff700 1 Processor -- start 2023-10-06T23:30:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.353+0000 7f55c2bff700 1 -- start start 2023-10-06T23:30:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.353+0000 7f55c2bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 0x7f55bc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.353+0000 7f55c2bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55bc074ef0 0x7f55bc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c2bff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc108da0 0x7f55bc1a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c2bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc1a0890 con 0x7f55bc073910 2023-10-06T23:30:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c2bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc1a0a00 con 0x7f55bc074ef0 2023-10-06T23:30:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c2bff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc1a0bc0 con 0x7f55bc108da0 2023-10-06T23:30:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c099b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 0x7f55bc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55bbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55bc074ef0 0x7f55bc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c099b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 0x7f55bc198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60678/0 (socket says 172.21.15.8:60678) 2023-10-06T23:30:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c099b700 1 -- 172.21.15.8:0/4032259440 learned_addr learned my addr 172.21.15.8:0/4032259440 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c119c700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc108da0 0x7f55bc1a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:11.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c099b700 1 -- 172.21.15.8:0/4032259440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc108da0 msgr2=0x7f55bc1a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c099b700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc108da0 0x7f55bc1a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c099b700 1 -- 172.21.15.8:0/4032259440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55bc074ef0 msgr2=0x7f55bc199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c099b700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55bc074ef0 0x7f55bc199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c099b700 1 -- 172.21.15.8:0/4032259440 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a80095f0 con 0x7f55bc073910 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55bbfff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55bc074ef0 0x7f55bc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.354+0000 7f55c119c700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc108da0 0x7f55bc1a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.355+0000 7f55c099b700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 0x7f55bc198d50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f55b000e9a0 tx=0x7f55b000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.355+0000 7f55b9ffb700 1 -- 172.21.15.8:0/4032259440 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0009790 con 0x7f55bc073910 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.355+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc1a0ea0 con 0x7f55bc073910 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.355+0000 7f55b9ffb700 1 -- 172.21.15.8:0/4032259440 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55b0010430 con 0x7f55bc073910 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.355+0000 7f55b9ffb700 1 -- 172.21.15.8:0/4032259440 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b000cea0 con 0x7f55bc073910 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.355+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc1a12c0 con 0x7f55bc073910 2023-10-06T23:30:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.356+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc107450 con 0x7f55bc073910 2023-10-06T23:30:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.358+0000 7f55b9ffb700 1 -- 172.21.15.8:0/4032259440 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f55b00105a0 con 0x7f55bc073910 2023-10-06T23:30:11.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.359+0000 7f55b9ffb700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55ac0a1480 0x7f55ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:11.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.359+0000 7f55b9ffb700 1 -- 172.21.15.8:0/4032259440 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f55b0014070 con 0x7f55bc073910 2023-10-06T23:30:11.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.360+0000 7f55bbfff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55ac0a1480 0x7f55ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.360+0000 7f55bbfff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55ac0a1480 0x7f55ac0a3940 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f55a8006010 tx=0x7f55a8005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:11.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.363+0000 7f55b9ffb700 1 -- 172.21.15.8:0/4032259440 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f55b0052100 con 0x7f55bc073910 2023-10-06T23:30:11.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.574+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55bc02cf70 con 0x7f55bc073910 2023-10-06T23:30:11.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.574+0000 7f55b9ffb700 1 -- 172.21.15.8:0/4032259440 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55b00964f0 con 0x7f55bc073910 2023-10-06T23:30:11.576 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:30:11.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55ac0a1480 msgr2=0x7f55ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55ac0a1480 0x7f55ac0a3940 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f55a8006010 tx=0x7f55a8005960 comp rx=0 tx=0).stop 2023-10-06T23:30:11.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 msgr2=0x7f55bc198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 0x7f55bc198d50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f55b000e9a0 tx=0x7f55b000ecb0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 shutdown_connections 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f55ac0a1480 0x7f55ac0a3940 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55bc073910 0x7f55bc198d50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55bc108da0 0x7f55bc1a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 --2- 172.21.15.8:0/4032259440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55bc074ef0 0x7f55bc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 >> 172.21.15.8:0/4032259440 conn(0x7f55bc0fc430 msgr2=0x7f55bc0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 shutdown_connections 2023-10-06T23:30:11.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.577+0000 7f55c2bff700 1 -- 172.21.15.8:0/4032259440 wait complete. 2023-10-06T23:30:11.597 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:30:11.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 -- 172.21.15.8:0/745017444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad0100e90 msgr2=0x7fbad01012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 --2- 172.21.15.8:0/745017444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad0100e90 0x7fbad01012b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009990 tx=0x7fbac0009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 -- 172.21.15.8:0/745017444 shutdown_connections 2023-10-06T23:30:11.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 --2- 172.21.15.8:0/745017444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad0102a30 0x7fbad0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 --2- 172.21.15.8:0/745017444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad0100e90 0x7fbad01012b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 --2- 172.21.15.8:0/745017444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbad0102070 0x7fbad01024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 -- 172.21.15.8:0/745017444 >> 172.21.15.8:0/745017444 conn(0x7fbad00fc430 msgr2=0x7fbad00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:11.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 -- 172.21.15.8:0/745017444 shutdown_connections 2023-10-06T23:30:11.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.803+0000 7fbad5fff700 1 -- 172.21.15.8:0/745017444 wait complete. 2023-10-06T23:30:11.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.804+0000 7fbad5fff700 1 Processor -- start 2023-10-06T23:30:11.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.804+0000 7fbad5fff700 1 -- start start 2023-10-06T23:30:11.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbad5fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbad0100e90 0x7fbad0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:11.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbad5fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad0102070 0x7fbad01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:11.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbad5fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad0102a30 0x7fbad01a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbad5fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad01a08f0 con 0x7fbad0102070 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbad5fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad01a0a60 con 0x7fbad0102a30 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbad5fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad01a0c20 con 0x7fbad0100e90 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbacf7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbad0100e90 0x7fbad0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbaceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad0102070 0x7fbad01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbacf7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbad0100e90 0x7fbad0198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:47662/0 (socket says 172.21.15.8:47662) 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbacf7fe700 1 -- 172.21.15.8:0/4277080776 learned_addr learned my addr 172.21.15.8:0/4277080776 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbacffff700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad0102a30 0x7fbad01a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbaceffd700 1 -- 172.21.15.8:0/4277080776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbad0100e90 msgr2=0x7fbad0198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbaceffd700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbad0100e90 0x7fbad0198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbaceffd700 1 -- 172.21.15.8:0/4277080776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad0102a30 msgr2=0x7fbad01a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbaceffd700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad0102a30 0x7fbad01a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbaceffd700 1 -- 172.21.15.8:0/4277080776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8009c40 con 0x7fbad0102070 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.805+0000 7fbacf7fe700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbad0100e90 0x7fbad0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.806+0000 7fbaceffd700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad0102070 0x7fbad01992f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbac400e9c0 tx=0x7fbac400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.806+0000 7fbaccff9700 1 -- 172.21.15.8:0/4277080776 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4004220 con 0x7fbad0102070 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.806+0000 7fbaccff9700 1 -- 172.21.15.8:0/4277080776 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbac4004380 con 0x7fbad0102070 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.806+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac00095f0 con 0x7fbad0102070 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.806+0000 7fbaccff9700 1 -- 172.21.15.8:0/4277080776 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4003b20 con 0x7fbad0102070 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.806+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad01a1210 con 0x7fbad0102070 2023-10-06T23:30:11.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.807+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad010c600 con 0x7fbad0102070 2023-10-06T23:30:11.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.809+0000 7fbaccff9700 1 -- 172.21.15.8:0/4277080776 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbac4003c80 con 0x7fbad0102070 2023-10-06T23:30:11.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.810+0000 7fbaccff9700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbab80a1500 0x7fbab80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:11.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.811+0000 7fbaccff9700 1 -- 172.21.15.8:0/4277080776 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbac4014070 con 0x7fbad0102070 2023-10-06T23:30:11.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.811+0000 7fbacf7fe700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbab80a1500 0x7fbab80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:11.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.811+0000 7fbacf7fe700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbab80a1500 0x7fbab80a39c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbad019a280 tx=0x7fbac000b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:11.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:11.814+0000 7fbaccff9700 1 -- 172.21.15.8:0/4277080776 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbac40964d0 con 0x7fbad0102070 2023-10-06T23:30:11.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:11 smithi008 ceph-mon[98532]: pgmap v871: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 6.0 MiB/s wr, 715 op/s 2023-10-06T23:30:11.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:11 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/878493271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:30:11.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:11 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4032259440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:30:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.026+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbad01a1460 con 0x7fbad0102070 2023-10-06T23:30:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.026+0000 7fbaccff9700 1 -- 172.21.15.8:0/4277080776 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbac4099af0 con 0x7fbad0102070 2023-10-06T23:30:12.028 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:30:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbab80a1500 msgr2=0x7fbab80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbab80a1500 0x7fbab80a39c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbad019a280 tx=0x7fbac000b260 comp rx=0 tx=0).stop 2023-10-06T23:30:12.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad0102070 msgr2=0x7fbad01992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad0102070 0x7fbad01992f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbac400e9c0 tx=0x7fbac400ecd0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 shutdown_connections 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fbab80a1500 0x7fbab80a39c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad0102a30 0x7fbad01a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbad0100e90 0x7fbad0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 --2- 172.21.15.8:0/4277080776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbad0102070 0x7fbad01992f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 >> 172.21.15.8:0/4277080776 conn(0x7fbad00fc430 msgr2=0x7fbad00fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 shutdown_connections 2023-10-06T23:30:12.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.029+0000 7fbad5fff700 1 -- 172.21.15.8:0/4277080776 wait complete. 2023-10-06T23:30:12.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-06T23:30:12.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:11 smithi156 ceph-mon[102862]: pgmap v871: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 6.0 MiB/s wr, 715 op/s 2023-10-06T23:30:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:11 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/878493271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:30:12.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:11 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4032259440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:30:12.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:11 smithi190 ceph-mon[102658]: pgmap v871: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 6.0 MiB/s wr, 715 op/s 2023-10-06T23:30:12.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:11 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/878493271' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:30:12.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:11 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4032259440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:30:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 -- 172.21.15.8:0/1004875680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb998102080 msgr2=0x7fb998102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 --2- 172.21.15.8:0/1004875680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb998102080 0x7fb998102500 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb988009990 tx=0x7fb988009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 -- 172.21.15.8:0/1004875680 shutdown_connections 2023-10-06T23:30:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 --2- 172.21.15.8:0/1004875680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb998102a40 0x7fb998109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 --2- 172.21.15.8:0/1004875680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb998100ea0 0x7fb9981012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 --2- 172.21.15.8:0/1004875680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb998102080 0x7fb998102500 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 -- 172.21.15.8:0/1004875680 >> 172.21.15.8:0/1004875680 conn(0x7fb9980fc420 msgr2=0x7fb9980fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 -- 172.21.15.8:0/1004875680 shutdown_connections 2023-10-06T23:30:12.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.250+0000 7fb99fbff700 1 -- 172.21.15.8:0/1004875680 wait complete. 2023-10-06T23:30:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.251+0000 7fb99fbff700 1 Processor -- start 2023-10-06T23:30:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99fbff700 1 -- start start 2023-10-06T23:30:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99fbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb998100ea0 0x7fb998198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99fbff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb998102080 0x7fb998199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99fbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb998102a40 0x7fb9981a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:12.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99fbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981a0880 con 0x7fb998102a40 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99fbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981a09f0 con 0x7fb998100ea0 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99fbff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981a0bb0 con 0x7fb998102080 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb998100ea0 0x7fb998198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb998100ea0 0x7fb998198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:48314/0 (socket says 172.21.15.8:48314) 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99d99b700 1 -- 172.21.15.8:0/2569996304 learned_addr learned my addr 172.21.15.8:0/2569996304 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99d19a700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb998102080 0x7fb998199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.252+0000 7fb99e19c700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb998102a40 0x7fb9981a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99d19a700 1 -- 172.21.15.8:0/2569996304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb998100ea0 msgr2=0x7fb998198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99d19a700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb998100ea0 0x7fb998198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99d19a700 1 -- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb998102a40 msgr2=0x7fb9981a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99d19a700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb998102a40 0x7fb9981a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:12.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99d19a700 1 -- 172.21.15.8:0/2569996304 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880095f0 con 0x7fb998102080 2023-10-06T23:30:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99d99b700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb998100ea0 0x7fb998198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99d19a700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb998102080 0x7fb998199280 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb988003f60 tx=0x7fb988004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb98effd700 1 -- 172.21.15.8:0/2569996304 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98801d070 con 0x7fb998102080 2023-10-06T23:30:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9981a0e30 con 0x7fb998102080 2023-10-06T23:30:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb98effd700 1 -- 172.21.15.8:0/2569996304 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb98800bdb0 con 0x7fb998102080 2023-10-06T23:30:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb98effd700 1 -- 172.21.15.8:0/2569996304 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988022cd0 con 0x7fb998102080 2023-10-06T23:30:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.253+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9981a11a0 con 0x7fb998102080 2023-10-06T23:30:12.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.254+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb998193400 con 0x7fb998102080 2023-10-06T23:30:12.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.256+0000 7fb98effd700 1 -- 172.21.15.8:0/2569996304 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb988022470 con 0x7fb998102080 2023-10-06T23:30:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.258+0000 7fb98effd700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb9840a14d0 0x7fb9840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.258+0000 7fb98effd700 1 -- 172.21.15.8:0/2569996304 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb9880ce260 con 0x7fb998102080 2023-10-06T23:30:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.258+0000 7fb99d99b700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb9840a14d0 0x7fb9840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:12.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.258+0000 7fb99d99b700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb9840a14d0 0x7fb9840a3990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb99819a210 tx=0x7fb994009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:12.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.261+0000 7fb98effd700 1 -- 172.21.15.8:0/2569996304 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb988097900 con 0x7fb998102080 2023-10-06T23:30:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.532+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fb99810c7e0 con 0x7fb998102080 2023-10-06T23:30:12.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.543+0000 7fb98effd700 1 -- 172.21.15.8:0/2569996304 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v16) v1 ==== 81+0+733868 (secure 0 0 0) 0x7fb98809af20 con 0x7fb998102080 2023-10-06T23:30:12.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 16, 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: "active_gid": 14148, 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: "active_name": "x", 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: "active_addrs": { 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6800", 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3959613712 2023-10-06T23:30:12.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6801", 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3959613712 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: "active_addr": "172.21.15.8:6801/3959613712", 2023-10-06T23:30:12.556 INFO:teuthology.orchestra.run.smithi008.stdout: "active_change": "2023-10-06T23:03:48.853371+0000", 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "active_mgr_features": 4540138322906710015, 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "available": true, 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "standbys": [ 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "gid": 14220, 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "y", 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr_features": 4540138322906710015, 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.557 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.558 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.559 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.561 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.561 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.561 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.561 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.561 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.561 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.561 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.561 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.562 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.562 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.562 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.562 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.562 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.563 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-10-06T23:30:12.565 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.566 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.567 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.568 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.569 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-10-06T23:30:12.570 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.571 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.572 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.573 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-10-06T23:30:12.574 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-10-06T23:30:12.575 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.577 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-06T23:30:12.578 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-10-06T23:30:12.579 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-10-06T23:30:12.580 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.581 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.582 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-10-06T23:30:12.583 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.584 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.585 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.586 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.587 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.588 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.589 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-10-06T23:30:12.590 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-10-06T23:30:12.592 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.593 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.594 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-10-06T23:30:12.595 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.596 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.597 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:12.598 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-10-06T23:30:12.599 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-10-06T23:30:12.600 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.601 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-06T23:30:12.602 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.603 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.604 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.605 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.606 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-06T23:30:12.609 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.610 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.611 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-06T23:30:12.612 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.613 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-10-06T23:30:12.614 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.615 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.616 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-10-06T23:30:12.617 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.618 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.619 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-06T23:30:12.620 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.621 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-10-06T23:30:12.622 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.623 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.624 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.625 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.626 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.627 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.628 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.629 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-10-06T23:30:12.630 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.631 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.632 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-06T23:30:12.633 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.634 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.635 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.636 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.637 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.638 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.639 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.640 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.642 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.643 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.644 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.645 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-10-06T23:30:12.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.647 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.648 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.649 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.650 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.651 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-10-06T23:30:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-10-06T23:30:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.655 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.656 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.657 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.658 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-10-06T23:30:12.659 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.660 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.661 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-06T23:30:12.662 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.663 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.664 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.665 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.666 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.667 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.669 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.670 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.671 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.673 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.674 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.675 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.676 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.677 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.678 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.679 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.680 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.681 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-06T23:30:12.682 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-06T23:30:12.683 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.685 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.686 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.687 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.688 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.689 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-06T23:30:12.690 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.692 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.693 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.694 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.695 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.696 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.697 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.698 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-06T23:30:12.699 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.700 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.702 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.703 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.704 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.705 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-06T23:30:12.706 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-06T23:30:12.707 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.709 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.710 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.711 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.713 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.714 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-06T23:30:12.715 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-10-06T23:30:12.716 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.717 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.718 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.719 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.720 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "UNSAFE_TLS_v1_2": { 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.721 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.722 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.723 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-06T23:30:12.724 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.725 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.726 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.727 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.729 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-10-06T23:30:12.730 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-06T23:30:12.731 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.732 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.733 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.734 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.735 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.736 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.737 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-10-06T23:30:12.738 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.739 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.741 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.743 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-10-06T23:30:12.744 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.745 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.746 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.747 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.748 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-10-06T23:30:12.749 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.751 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.752 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.753 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.754 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.755 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.756 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-10-06T23:30:12.757 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.758 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.759 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-06T23:30:12.761 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.762 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.763 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-10-06T23:30:12.764 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.765 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.766 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.767 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.768 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.769 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.771 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.772 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.773 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.775 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-10-06T23:30:12.776 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.777 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.778 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.779 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.780 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.781 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.782 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.783 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.784 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-10-06T23:30:12.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-06T23:30:12.787 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.792 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.793 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.794 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.795 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.796 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.797 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.798 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.799 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.801 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.802 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.803 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.804 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.805 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-10-06T23:30:12.806 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.808 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.809 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.810 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.811 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.812 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.814 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.815 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.816 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.817 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.818 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.819 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.820 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-06T23:30:12.821 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.822 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.823 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.824 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.825 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.827 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.828 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.830 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.831 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.832 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.833 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.834 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.835 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.836 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.837 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.838 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.839 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.840 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.841 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.842 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.844 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.845 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-06T23:30:12.846 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.847 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.848 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.850 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.851 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-06T23:30:12.852 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-10-06T23:30:12.853 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.855 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.856 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.857 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.858 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.859 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.860 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.861 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.862 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.863 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.864 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.865 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.866 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.867 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.868 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.870 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.871 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:12.872 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.873 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-06T23:30:12.874 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.875 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-06T23:30:12.876 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.877 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.878 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.879 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.881 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.882 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.883 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.884 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.885 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.886 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.887 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.888 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.889 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.890 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.891 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.892 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.893 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.894 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-10-06T23:30:12.895 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.896 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.897 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:12.898 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.899 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.901 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-06T23:30:12.902 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.903 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.904 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.906 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.907 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.908 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.910 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.911 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.912 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.913 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.914 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.915 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.916 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.917 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.918 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-10-06T23:30:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-10-06T23:30:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.939 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.940 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.941 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.942 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.943 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.944 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.947 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-10-06T23:30:12.948 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.949 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-10-06T23:30:12.950 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-10-06T23:30:12.951 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.953 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.954 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.955 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.956 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-10-06T23:30:12.957 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.958 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.959 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.960 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-10-06T23:30:12.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.963 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.964 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.965 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.966 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.967 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.968 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.969 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.970 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.972 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.973 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.975 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.976 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.977 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.978 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.979 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.980 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.981 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.982 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.983 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.984 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.985 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.986 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.987 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.988 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.990 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.991 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-10-06T23:30:12.992 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.994 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.995 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.996 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.997 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:12.998 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:12.999 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-06T23:30:13.000 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.002 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.003 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.004 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.005 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.006 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.007 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.008 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.009 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.010 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.011 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.012 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.013 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.014 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.015 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.017 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.018 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.019 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.020 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.021 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.022 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.023 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.024 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.025 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.026 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.027 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.028 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.029 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.030 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-10-06T23:30:13.031 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.032 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.033 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.034 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.035 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.036 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.037 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.038 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.039 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.040 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.041 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-10-06T23:30:13.042 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.043 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:13.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "gid": 24106, 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "z", 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr_features": 4540138322906710015, 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.045 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.046 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.047 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.048 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.049 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.050 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.051 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.052 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-10-06T23:30:13.053 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.054 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.055 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-10-06T23:30:13.056 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.057 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.058 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.059 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.060 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-10-06T23:30:13.061 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.062 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-10-06T23:30:13.063 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.064 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-10-06T23:30:13.065 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.066 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.067 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-10-06T23:30:13.068 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.069 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-06T23:30:13.070 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.071 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.072 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.073 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.074 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.075 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.076 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.077 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-10-06T23:30:13.078 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.079 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.080 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.081 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.082 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.083 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.084 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-06T23:30:13.085 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.086 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-10-06T23:30:13.087 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.088 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-10-06T23:30:13.089 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.090 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.091 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2023-10-06T23:30:13.092 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.093 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-10-06T23:30:13.094 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.095 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.096 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:13.097 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.098 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.099 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.100 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.101 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-10-06T23:30:13.102 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.103 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.105 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.106 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.107 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.108 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.109 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-10-06T23:30:13.110 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.112 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-10-06T23:30:13.113 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.114 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.115 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.116 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.117 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.118 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.120 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.121 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.122 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.123 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.124 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.125 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.126 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.127 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.128 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.129 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.130 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.131 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-06T23:30:13.132 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.133 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.134 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.135 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.136 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.139 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.141 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-06T23:30:13.142 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.143 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.144 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.145 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-10-06T23:30:13.146 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-10-06T23:30:13.147 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.148 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.149 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.151 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.152 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.153 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.154 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.155 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.156 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.157 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.158 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.159 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.160 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.161 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.162 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.163 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.164 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.165 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.166 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.167 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-10-06T23:30:13.168 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-06T23:30:13.169 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.170 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.171 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.172 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.173 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.174 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.175 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-06T23:30:13.176 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-06T23:30:13.177 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.178 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.179 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.180 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.181 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.182 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.183 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-06T23:30:13.184 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.185 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.186 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.187 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.188 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-06T23:30:13.192 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.193 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.194 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.195 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.196 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.197 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.198 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-06T23:30:13.199 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.200 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.201 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.202 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.203 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-10-06T23:30:13.204 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.205 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-06T23:30:13.206 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-06T23:30:13.207 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.209 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.210 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "UNSAFE_TLS_v1_2": { 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.211 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.212 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-06T23:30:13.213 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.215 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.216 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.217 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.218 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-10-06T23:30:13.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.220 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.221 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.222 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.224 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.225 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.226 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.227 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.228 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:13.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.230 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.231 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.232 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.233 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.234 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-06T23:30:13.235 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.236 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.237 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.238 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.239 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.240 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.241 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.242 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.243 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.244 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.245 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.246 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-10-06T23:30:13.247 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.248 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.249 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-06T23:30:13.250 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.251 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.252 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.253 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.254 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.256 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.257 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.258 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-10-06T23:30:13.259 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.260 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.262 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-10-06T23:30:13.263 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.265 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.266 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-10-06T23:30:13.267 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.268 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.269 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.270 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.271 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.272 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.273 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.274 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.275 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.276 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-10-06T23:30:13.277 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.279 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T23:30:13.280 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.281 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.282 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.283 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.284 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.285 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.286 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.287 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.288 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.289 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.290 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.291 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.292 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.293 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.294 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.295 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.296 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.297 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.298 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.299 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.301 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.302 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.303 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.304 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.305 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.306 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.307 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.308 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.309 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.310 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.311 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-10-06T23:30:13.312 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.314 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.315 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.316 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.317 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.318 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.319 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.320 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.321 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.322 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.323 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.324 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.325 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.326 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.327 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.328 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.329 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.330 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.331 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.332 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.336 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.337 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.338 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.342 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.343 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.344 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.345 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.346 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.347 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.348 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.349 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.350 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.352 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.353 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.354 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.355 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.356 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-10-06T23:30:13.357 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.358 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.359 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.360 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.361 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.362 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.363 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-06T23:30:13.365 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.366 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-06T23:30:13.367 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.368 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.369 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.370 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.371 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.372 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.373 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-10-06T23:30:13.374 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.375 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.376 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.377 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-10-06T23:30:13.378 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.379 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.380 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.381 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.382 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-06T23:30:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.388 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-06T23:30:13.389 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.390 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-10-06T23:30:13.391 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.392 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.394 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.395 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.396 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.397 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.398 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.399 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.400 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.401 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.402 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.403 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.404 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.405 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.406 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.407 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.408 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.409 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.410 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.411 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.412 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.413 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.414 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.415 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.416 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.417 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.418 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.419 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.420 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.421 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-10-06T23:30:13.422 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.423 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.424 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.425 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.426 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.427 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.428 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.429 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.430 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.431 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.432 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.433 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.434 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.435 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.436 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-10-06T23:30:13.437 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.438 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.439 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-10-06T23:30:13.440 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-10-06T23:30:13.441 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.443 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.444 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.445 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.446 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.447 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.448 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-10-06T23:30:13.449 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.450 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.451 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.452 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.453 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.454 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.455 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.456 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.457 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.458 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.459 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.460 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.461 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.462 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.463 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.464 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.465 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.466 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.467 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.468 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.469 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-06T23:30:13.471 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.472 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.473 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.474 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.475 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.476 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.478 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-10-06T23:30:13.479 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.481 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.482 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.483 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.484 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.485 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.486 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-10-06T23:30:13.487 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.488 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.489 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.490 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.491 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.492 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.493 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.494 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.495 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.496 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.497 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.498 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.499 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.500 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.501 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-06T23:30:13.502 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.503 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.504 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.505 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.506 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.507 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-10-06T23:30:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.510 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.513 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.514 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-10-06T23:30:13.515 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.517 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-06T23:30:13.518 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-10-06T23:30:13.519 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-10-06T23:30:13.520 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.521 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.522 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.523 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.524 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.526 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.527 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.528 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-10-06T23:30:13.529 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.530 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.531 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: "modules": [ 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: "dashboard", 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: "iostat", 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: "nfs", 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: "restful" 2023-10-06T23:30:13.532 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.533 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.534 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.535 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.536 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.537 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.538 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.540 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.541 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-10-06T23:30:13.542 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.543 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-10-06T23:30:13.544 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.545 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.546 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-10-06T23:30:13.547 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.549 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.550 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.551 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-10-06T23:30:13.552 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.553 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.554 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-10-06T23:30:13.556 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-06T23:30:13.557 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.558 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.559 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.560 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.561 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.563 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.565 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.566 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.567 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.568 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.570 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-06T23:30:13.571 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.572 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-10-06T23:30:13.573 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.575 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.576 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-06T23:30:13.577 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.578 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-10-06T23:30:13.579 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.580 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.582 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-06T23:30:13.583 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.584 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.585 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.586 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.587 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-10-06T23:30:13.588 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-10-06T23:30:13.589 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.591 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-10-06T23:30:13.592 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.593 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.594 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.595 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.596 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-10-06T23:30:13.597 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.599 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.600 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.601 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.602 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.603 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.604 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-10-06T23:30:13.605 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-10-06T23:30:13.606 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.607 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.609 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-10-06T23:30:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.611 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.612 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.614 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-06T23:30:13.615 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.616 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.617 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.618 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.619 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.620 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.621 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.622 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.623 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.624 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-10-06T23:30:13.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.627 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.628 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-06T23:30:13.629 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.630 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.631 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.632 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.633 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-10-06T23:30:13.634 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-10-06T23:30:13.635 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.636 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.638 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.639 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.640 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.641 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.642 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.644 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.645 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-10-06T23:30:13.646 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.647 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.648 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.649 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.650 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.651 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.652 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.653 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-06T23:30:13.654 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-06T23:30:13.655 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.657 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.658 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.659 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.660 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.661 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.662 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.663 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.664 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-06T23:30:13.665 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.667 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.668 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.669 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.670 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.671 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.672 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.673 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-06T23:30:13.674 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-06T23:30:13.675 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.676 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.677 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.678 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.679 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.680 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.681 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.682 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.683 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-06T23:30:13.684 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-06T23:30:13.685 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.687 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.688 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.689 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-06T23:30:13.690 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.691 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.692 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "UNSAFE_TLS_v1_2": { 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.693 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-06T23:30:13.694 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.695 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.697 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.698 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.699 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.700 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.701 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-06T23:30:13.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.703 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.704 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.705 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.706 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.707 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.708 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.709 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.710 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.711 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.712 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-06T23:30:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-10-06T23:30:13.714 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.716 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-06T23:30:13.717 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.718 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.719 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.720 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.721 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.722 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.723 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.724 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.725 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-10-06T23:30:13.726 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.727 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.728 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.729 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.730 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.731 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.732 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.733 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-10-06T23:30:13.734 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.735 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.736 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.737 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.738 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.739 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.740 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-10-06T23:30:13.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.742 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.743 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.744 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-10-06T23:30:13.746 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.747 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.748 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.749 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.750 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.751 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.753 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.754 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-10-06T23:30:13.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.757 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.758 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.759 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.760 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.761 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.762 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.763 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.764 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.765 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.766 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.767 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.768 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.769 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.770 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.771 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.772 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.773 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.774 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-10-06T23:30:13.775 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.776 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.777 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.778 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.779 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.780 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.781 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.782 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.783 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.784 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.785 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.787 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.788 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.789 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.791 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-10-06T23:30:13.791 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-10-06T23:30:13.791 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.791 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.791 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.791 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.791 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.791 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.792 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.792 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-10-06T23:30:13.792 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-06T23:30:13.792 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.792 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.792 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-10-06T23:30:13.793 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-10-06T23:30:13.793 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.793 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.793 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.793 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-10-06T23:30:13.793 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.793 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.793 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.794 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-10-06T23:30:13.794 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.794 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.794 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.794 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-10-06T23:30:13.795 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-10-06T23:30:13.795 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.795 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.795 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.795 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-10-06T23:30:13.795 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.795 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.796 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.796 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-10-06T23:30:13.796 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.796 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.796 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.797 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-10-06T23:30:13.797 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-10-06T23:30:13.797 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.797 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.797 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.797 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.798 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.798 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.798 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.798 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-10-06T23:30:13.798 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.798 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.799 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.799 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-10-06T23:30:13.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-10-06T23:30:13.799 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.799 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.799 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.802 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.803 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.804 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.806 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.807 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.808 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.809 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.810 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.811 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.812 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.814 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.815 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.816 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.817 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.818 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.819 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.820 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.821 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.822 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.825 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.828 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.829 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.830 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.831 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.832 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.833 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.834 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.835 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.836 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.837 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.838 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.839 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.840 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.841 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.842 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.843 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.844 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.845 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.846 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-10-06T23:30:13.847 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.848 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.849 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.850 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.851 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.852 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.853 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.854 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.855 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-10-06T23:30:13.856 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.858 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.859 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-10-06T23:30:13.860 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.861 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.862 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.863 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.864 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.865 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.866 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.867 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.868 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-10-06T23:30:13.869 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.870 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.872 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.873 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.874 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.875 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.876 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.877 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.878 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.880 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.881 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-10-06T23:30:13.882 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.883 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.884 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.885 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.886 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-06T23:30:13.887 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.888 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.889 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.890 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.891 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.892 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.893 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.894 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.897 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.899 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.900 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-10-06T23:30:13.903 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.904 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.905 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.906 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.907 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.909 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-06T23:30:13.910 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.911 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.912 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.913 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.914 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.915 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.918 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-10-06T23:30:13.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.920 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.922 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.923 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.924 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.925 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-10-06T23:30:13.926 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.927 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.928 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.929 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.930 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.931 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.933 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.934 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.935 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.936 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.937 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.938 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.939 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.940 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.941 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.942 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.943 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.944 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.946 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.947 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.948 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.949 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.950 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.951 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-10-06T23:30:13.952 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.954 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.955 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.957 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.958 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.959 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.960 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.961 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.962 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.963 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.964 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.965 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.966 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.967 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.968 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-10-06T23:30:13.969 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.970 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.971 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.972 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.973 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.974 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.975 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.976 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.977 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.978 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.979 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.980 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.981 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.982 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.983 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.984 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-06T23:30:13.985 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.986 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.987 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.988 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.989 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.990 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.991 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.992 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.993 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.994 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.995 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:13.996 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.997 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:13.998 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:13.999 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:14.000 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:14.001 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.002 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.003 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.004 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-06T23:30:14.005 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.006 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.007 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.008 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.009 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.010 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.011 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.012 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.013 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-06T23:30:14.014 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: "services": { 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: "dashboard": "https://172.21.15.8:8443/" 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: "always_on_modules": { 2023-10-06T23:30:14.015 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus": [ 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific": [ 2023-10-06T23:30:14.016 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy": [ 2023-10-06T23:30:14.017 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "reef": [ 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-10-06T23:30:14.018 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "last_failure_osd_epoch": 3, 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: "active_clients": [ 2023-10-06T23:30:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 699473775 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "libcephsqlite", 2023-10-06T23:30:14.020 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 691108914 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-06T23:30:14.021 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2960809242 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1263711010 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.022 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:14.023 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:14.023 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-06T23:30:14.023 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:30:14.024 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:12 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/4277080776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:30:14.024 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:12 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2569996304' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-06T23:30:14.024 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:12 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/4277080776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:30:14.024 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:12 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2569996304' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-06T23:30:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.550+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb9840a14d0 msgr2=0x7fb9840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.550+0000 7fb99fbff700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb9840a14d0 0x7fb9840a3990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb99819a210 tx=0x7fb994009260 comp rx=0 tx=0).stop 2023-10-06T23:30:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.550+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb998102080 msgr2=0x7fb998199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.550+0000 7fb99fbff700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb998102080 0x7fb998199280 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb988003f60 tx=0x7fb988004730 comp rx=0 tx=0).stop 2023-10-06T23:30:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.551+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 shutdown_connections 2023-10-06T23:30:14.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.551+0000 7fb99fbff700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fb9840a14d0 0x7fb9840a3990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.551+0000 7fb99fbff700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb998102a40 0x7fb9981a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.551+0000 7fb99fbff700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb998100ea0 0x7fb998198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.551+0000 7fb99fbff700 1 --2- 172.21.15.8:0/2569996304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb998102080 0x7fb998199280 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.551+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 >> 172.21.15.8:0/2569996304 conn(0x7fb9980fc420 msgr2=0x7fb998107a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.551+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 shutdown_connections 2023-10-06T23:30:14.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:12.551+0000 7fb99fbff700 1 -- 172.21.15.8:0/2569996304 wait complete. 2023-10-06T23:30:14.032 DEBUG:tasks.check_counter:Getting stats from a 2023-10-06T23:30:14.032 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-06T23:30:14.033 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:12 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/4277080776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:30:14.033 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:12 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2569996304' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-06T23:30:14.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:13 smithi156 ceph-mon[102862]: pgmap v872: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.0 MiB/s wr, 581 op/s 2023-10-06T23:30:14.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:13 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:14.101 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:13 smithi008 ceph-mon[98532]: pgmap v872: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.0 MiB/s wr, 581 op/s 2023-10-06T23:30:14.101 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:13 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:14.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:13 smithi190 ceph-mon[102658]: pgmap v872: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.0 MiB/s wr, 581 op/s 2023-10-06T23:30:14.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:13 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:14.888 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:30:16.066 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:15 smithi008 ceph-mon[98532]: pgmap v873: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.4 MiB/s wr, 502 op/s 2023-10-06T23:30:16.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:15 smithi156 ceph-mon[102862]: pgmap v873: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.4 MiB/s wr, 502 op/s 2023-10-06T23:30:16.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:15 smithi190 ceph-mon[102658]: pgmap v873: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.4 MiB/s wr, 502 op/s 2023-10-06T23:30:17.093 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:30:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2023-10-06T23:30:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2023-10-06T23:30:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2023-10-06T23:30:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2023-10-06T23:30:17.093 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.003729872, 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.000737440, 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:17.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 307, 2023-10-06T23:30:17.095 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 306, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 226208, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 184576, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.049581069, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.022670464, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.014777025, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.007488685, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 305, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.020959861, 2023-10-06T23:30:17.096 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000068720 2023-10-06T23:30:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 226208, 2023-10-06T23:30:17.097 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 184576 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 6, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 236, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 3312, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 194976, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.021798431, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.016259014, 2023-10-06T23:30:17.098 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.002831662, 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 235, 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.013218114, 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000056247 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.099 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 194976 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:17.100 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:17.101 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:17.102 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:17.103 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 148704, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 29, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2023-10-06T23:30:17.104 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:17.105 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 309, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 182798, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 309, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 309, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 182798, 2023-10-06T23:30:17.106 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-06T23:30:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:17.107 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:17.107 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:30:17.585 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-10-06T23:30:17.586 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-10-06T23:30:17.586 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2023-10-06T23:30:17.586 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2023-10-06T23:30:17.586 DEBUG:tasks.check_counter:Getting stats from d 2023-10-06T23:30:17.586 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-06T23:30:17.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:17 smithi008 ceph-mon[98532]: pgmap v874: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.9 MiB/s wr, 349 op/s 2023-10-06T23:30:18.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:17 smithi156 ceph-mon[102862]: pgmap v874: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.9 MiB/s wr, 349 op/s 2023-10-06T23:30:18.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:17 smithi190 ceph-mon[102658]: pgmap v874: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.9 MiB/s wr, 349 op/s 2023-10-06T23:30:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2023-10-06T23:30:19.890 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.004006269, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.000659138, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:19.891 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 318, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 315, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 231168, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 188928, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2023-10-06T23:30:19.892 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.050140558, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.022975394, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.014870827, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.007613573, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 315, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.021258371, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000067486 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:19.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 231168, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 188928 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 239, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 320, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 195408, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:19.894 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.022085296, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.017125977, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.002147948, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 237, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.014307848, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000060370 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:19.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 195408 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:19.896 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:19.897 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:19.898 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 148744, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 30, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:19.899 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2023-10-06T23:30:19.900 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 316, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 183772, 2023-10-06T23:30:19.901 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 316, 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 316, 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 183772, 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:19.902 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:19.903 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:30:19.903 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:19 smithi008 ceph-mon[98532]: pgmap v875: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 647 KiB/s wr, 89 op/s 2023-10-06T23:30:20.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:19 smithi156 ceph-mon[102862]: pgmap v875: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 647 KiB/s wr, 89 op/s 2023-10-06T23:30:20.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:19 smithi190 ceph-mon[102658]: pgmap v875: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 647 KiB/s wr, 89 op/s 2023-10-06T23:30:20.419 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-06T23:30:20.420 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-06T23:30:20.420 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-10-06T23:30:20.420 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-10-06T23:30:20.420 DEBUG:tasks.check_counter:Getting stats from g 2023-10-06T23:30:20.420 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-06T23:30:21.162 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:30:21.773 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:21 smithi008 ceph-mon[98532]: pgmap v876: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 343 KiB/s wr, 49 op/s 2023-10-06T23:30:22.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:21 smithi156 ceph-mon[102862]: pgmap v876: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 343 KiB/s wr, 49 op/s 2023-10-06T23:30:22.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:21 smithi190 ceph-mon[102658]: pgmap v876: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 343 KiB/s wr, 49 op/s 2023-10-06T23:30:22.722 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 313, 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 310, 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 229744, 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 186272, 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.052813706, 2023-10-06T23:30:22.723 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.022601953, 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.015591728, 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.007470552, 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 310, 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.016842021, 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000054329 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:22.724 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 229744, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 186272 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 236, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 320, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 194880, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:22.725 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.021224970, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.016478140, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.001974294, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 234, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.015483138, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000066167 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:22.726 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 194880 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2023-10-06T23:30:22.727 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.000878752, 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.000705914, 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:22.728 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.729 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:22.730 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:22.731 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:22.732 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 148704, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 29, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2023-10-06T23:30:22.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:22.734 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 311, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 183058, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 311, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 311, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 183058, 2023-10-06T23:30:22.735 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-06T23:30:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:22.736 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:22.736 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:30:23.258 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2023-10-06T23:30:23.258 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2023-10-06T23:30:23.259 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2023-10-06T23:30:23.259 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2023-10-06T23:30:23.259 DEBUG:tasks.check_counter:Getting stats from j 2023-10-06T23:30:23.259 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-06T23:30:23.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:23 smithi156 ceph-mon[102862]: pgmap v877: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-06T23:30:23.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:23 smithi008 ceph-mon[98532]: pgmap v877: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-06T23:30:23.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:23 smithi190 ceph-mon[102658]: pgmap v877: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-06T23:30:23.996 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-06T23:30:24.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:24 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:24.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:24 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:24.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:24 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:25.645 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:25 smithi008 ceph-mon[98532]: pgmap v878: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-10-06T23:30:25.662 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-06T23:30:25.662 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:25.662 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 320, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 317, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 231712, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 190176, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.049093866, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.016791373, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.017387418, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.007623614, 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:25.663 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 317, 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.020027459, 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000063178 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 231712, 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 190176 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.664 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 241, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 320, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 195760, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.022928488, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.017804444, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.002224982, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:25.665 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 239, 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.014178340, 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000059323 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 195760 2023-10-06T23:30:25.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.001015275, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.000854814, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:25.667 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:25.668 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:25.668 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:25.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.668 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:25.668 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:25.668 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:25.668 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:25.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:25.669 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:25.670 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:25.671 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 148704, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 29, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:25.672 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:25.673 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-06T23:30:25.674 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 318, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 184032, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 318, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 318, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 184032, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-06T23:30:25.675 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-06T23:30:25.676 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:25.676 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-06T23:30:25.676 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-06T23:30:25.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:25 smithi156 ceph-mon[102862]: pgmap v878: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-10-06T23:30:25.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:25 smithi190 ceph-mon[102658]: pgmap v878: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-10-06T23:30:26.208 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-06T23:30:26.209 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-06T23:30:26.209 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-06T23:30:26.209 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-06T23:30:26.209 DEBUG:tasks.check_counter:Getting stats from b 2023-10-06T23:30:26.210 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-06T23:30:27.383 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:30:28.101 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:27 smithi156 ceph-mon[102862]: pgmap v879: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-10-06T23:30:28.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:27 smithi008 ceph-mon[98532]: pgmap v879: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-10-06T23:30:28.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:27 smithi190 ceph-mon[102658]: pgmap v879: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-10-06T23:30:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:29 smithi156 ceph-mon[102862]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:29.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:29 smithi156 ceph-mon[102862]: pgmap v880: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-10-06T23:30:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:29 smithi008 ceph-mon[98532]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:29.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:29 smithi008 ceph-mon[98532]: pgmap v880: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-10-06T23:30:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:29 smithi190 ceph-mon[102658]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2023-10-06T23:30:29.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:29 smithi190 ceph-mon[102658]: pgmap v880: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-10-06T23:30:31.648 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 3691111, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 3366729, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 658483609, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 589300641, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 226, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 190.809609227, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 81.244558811, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 127.944285632, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 1.692935302, 2023-10-06T23:30:31.649 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3366732, 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 63.147519386, 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000018756 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 6890995, 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.952815087, 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000138 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 333904, 2023-10-06T23:30:31.650 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 194960 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1510531, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 2209938, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 268859275, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 529328334, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 9, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 5, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 101.550310492, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 45.586461355, 2023-10-06T23:30:31.651 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 60.545327779, 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 1.329480808, 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2209939, 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 42.857172902, 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000019392 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3449230, 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.624752705, 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000181 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.652 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 560320 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 981737, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1514532, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 307847700, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 616402900, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 18, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 8, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 77.598968547, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 34.043480500, 2023-10-06T23:30:31.653 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 44.875864829, 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 2.325428712, 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1514524, 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 31.674998129, 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000020914 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2360105, 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.491318504, 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000208 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.654 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 47722, 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 17.639214877, 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000369624 2023-10-06T23:30:31.655 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 98, 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.004699732, 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000047956 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 422171, 2023-10-06T23:30:31.656 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 420330, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 420330, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 478.187054981, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001137646 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 1841, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 0, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 482, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 3, 2023-10-06T23:30:31.657 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 591, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 0, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 579, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 12, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 591, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 989, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 572, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 572, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 19, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 840311, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 838338, 2023-10-06T23:30:31.658 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 1797, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 1, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 0, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 3, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 29769, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 7, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 40, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 979, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 23, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 529, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 541, 2023-10-06T23:30:31.659 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 1037, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 1620305579, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 0, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 541, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 24, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 2, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 22, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 517, 2023-10-06T23:30:31.660 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 7, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 549831, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 513070, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 553174, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 21622, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 8, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 1087 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-10-06T23:30:31.661 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 76, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 0, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 0, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 1, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 204, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 21, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 20, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 4, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-10-06T23:30:31.662 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 2, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 42, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 3, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-10-06T23:30:31.663 INFO:teuthology.orchestra.run.smithi156.stdout: "evlrg": 0, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 26416, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 26293, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 26293, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 123, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 144, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 93, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 92, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 92, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 1, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "segmjr": 1, 2023-10-06T23:30:31.664 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 1, 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 59708289, 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 59974258, 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 0, 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 23274, 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 55.693646514, 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.002392955 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 0 2023-10-06T23:30:31.665 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 584, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 1538, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 954, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 59, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 65, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 6, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 591, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 1603, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 1012, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 572, 2023-10-06T23:30:31.666 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 1530, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 958, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 68032, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207152 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 772004, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 1250, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 422171, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 44, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 2526, 2023-10-06T23:30:31.667 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 982, 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 4.832232612, 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.004920807 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 416569, 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 423.273517333, 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001016094 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.668 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1, 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.001810276, 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001810276 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1877, 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 49.158529186, 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.026189946 2023-10-06T23:30:31.669 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-10-06T23:30:31.670 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.671 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 29, 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.032780509, 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001130362 2023-10-06T23:30:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-10-06T23:30:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 761, 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.444115883, 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000583595 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 76, 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.148199464, 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001949992 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 14, 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.267272396, 2023-10-06T23:30:31.674 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.019090885 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-10-06T23:30:31.675 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.676 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.676 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.676 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.676 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-10-06T23:30:31.676 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.676 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.676 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.676 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1, 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000781450, 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000781450 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.677 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-10-06T23:30:31.679 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 20, 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.027815872, 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001390793 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-10-06T23:30:31.680 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 1, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 1, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 0, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 1, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 37222, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 37222, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 1046, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "mdthresh_evicted": 0 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:31.681 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:31.682 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:31.683 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 273763, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 105, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:31.684 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 7528, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 158, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:31.685 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 1919942, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 10765, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 25866, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 57649633, 2023-10-06T23:30:31.686 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 31, 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 25866, 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 25866, 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 101.208556436, 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.003912802 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 25866, 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 28848 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.687 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 25866, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 555, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 25311, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 419, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 1013, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 12, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 23284, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 256, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-10-06T23:30:31.688 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 3, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 73, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 543, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 2026, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-10-06T23:30:31.689 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-10-06T23:30:31.690 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 89, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 4, 2023-10-06T23:30:31.691 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 12, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 12, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 1168, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 0, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 51 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 1, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-10-06T23:30:31.692 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 0 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 16, 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 7, 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 20, 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-10-06T23:30:31.693 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 6183376, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 678664869, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 6183376, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:31.694 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 6183376, 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 678664869, 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:31.695 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 25866, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 57651653, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 25866, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 57651653, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.696 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 25866, 2023-10-06T23:30:31.697 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 25866, 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 25866, 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 25866, 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-10-06T23:30:31.698 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 20, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 2020, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 20, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 10, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 2020, 2023-10-06T23:30:31.699 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x55b28143c6e0": { 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 26416, 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 55779954, 2023-10-06T23:30:31.700 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 26416, 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 23274, 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 55779954, 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:31.701 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-10-06T23:30:32.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:31 smithi156 ceph-mon[102862]: pgmap v881: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 9 op/s 2023-10-06T23:30:32.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:31 smithi008 ceph-mon[98532]: pgmap v881: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 9 op/s 2023-10-06T23:30:32.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:31 smithi190 ceph-mon[102658]: pgmap v881: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 9 op/s 2023-10-06T23:30:32.609 INFO:tasks.check_counter:Daemon mds.b mds.exported=40 2023-10-06T23:30:32.609 INFO:tasks.check_counter:Daemon mds.b mds.imported=23 2023-10-06T23:30:32.609 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=76 2023-10-06T23:30:32.609 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2023-10-06T23:30:32.609 DEBUG:tasks.check_counter:Getting stats from e 2023-10-06T23:30:32.610 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-06T23:30:32.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:32 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:30:33.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:32 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:30:33.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:32 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-06T23:30:33.414 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:30:34.017 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:33 smithi156 ceph-mon[102862]: pgmap v882: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2023-10-06T23:30:34.017 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.017 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.017 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.017 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:33 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.018 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:33 smithi156 ceph-mon[102862]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-10-06T23:30:34.018 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:33 smithi156 ceph-mon[102862]: Unable to set osd_memory_target on smithi008 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-06T23:30:34.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:33 smithi008 ceph-mon[98532]: pgmap v882: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2023-10-06T23:30:34.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:33 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:33 smithi008 ceph-mon[98532]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-10-06T23:30:34.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:33 smithi008 ceph-mon[98532]: Unable to set osd_memory_target on smithi008 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-06T23:30:34.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:33 smithi190 ceph-mon[102658]: pgmap v882: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2023-10-06T23:30:34.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:33 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-06T23:30:34.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:33 smithi190 ceph-mon[102658]: Adjusting osd_memory_target on smithi008 to 222.0M 2023-10-06T23:30:34.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:33 smithi190 ceph-mon[102658]: Unable to set osd_memory_target on smithi008 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-06T23:30:35.018 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-10-06T23:30:35.019 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:35.019 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 459, 2023-10-06T23:30:35.019 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 439, 2023-10-06T23:30:35.019 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 344338, 2023-10-06T23:30:35.019 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 227309, 2023-10-06T23:30:35.020 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 7, 2023-10-06T23:30:35.020 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:35.020 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.059928147, 2023-10-06T23:30:35.020 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.022739839, 2023-10-06T23:30:35.020 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.019384416, 2023-10-06T23:30:35.020 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.010858887, 2023-10-06T23:30:35.020 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:35.021 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 439, 2023-10-06T23:30:35.021 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.020707470, 2023-10-06T23:30:35.021 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000047169 2023-10-06T23:30:35.021 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.021 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:35.021 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.021 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.022 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.022 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.022 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 315952, 2023-10-06T23:30:35.022 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 192160 2023-10-06T23:30:35.022 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.022 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:35.022 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1176, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1416, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 6041910, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 828550, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 5, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.121673219, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.037570637, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.039253107, 2023-10-06T23:30:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.032279083, 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1414, 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.056191369, 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000039739 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.025 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-06T23:30:35.025 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 463120 2023-10-06T23:30:35.025 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.025 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:35.025 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 2391, 2023-10-06T23:30:35.026 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 2393, 2023-10-06T23:30:35.026 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 9097307, 2023-10-06T23:30:35.026 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 743659, 2023-10-06T23:30:35.027 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 5, 2023-10-06T23:30:35.027 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-10-06T23:30:35.027 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.230531094, 2023-10-06T23:30:35.027 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.078389973, 2023-10-06T23:30:35.027 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.064632191, 2023-10-06T23:30:35.027 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.065748050, 2023-10-06T23:30:35.027 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:35.027 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2391, 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.094122619, 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000039365 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:35.028 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:35.029 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.029 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-10-06T23:30:35.029 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-10-06T23:30:35.029 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-10-06T23:30:35.029 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.029 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-10-06T23:30:35.029 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-10-06T23:30:35.029 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-10-06T23:30:35.030 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 6180, 2023-10-06T23:30:35.030 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.164353031, 2023-10-06T23:30:35.030 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000026594 2023-10-06T23:30:35.030 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.030 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.030 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-10-06T23:30:35.030 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-10-06T23:30:35.030 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 0, 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 0, 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-10-06T23:30:35.031 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 0, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 0, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 0, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 0, 2023-10-06T23:30:35.032 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 352, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 0, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 0, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 352, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 352, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 0, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 0, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 0, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 3, 2023-10-06T23:30:35.033 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-10-06T23:30:35.034 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 0, 2023-10-06T23:30:35.035 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 0, 2023-10-06T23:30:35.035 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 0, 2023-10-06T23:30:35.035 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 0, 2023-10-06T23:30:35.035 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-10-06T23:30:35.035 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 0, 2023-10-06T23:30:35.035 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-10-06T23:30:35.035 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 0, 2023-10-06T23:30:35.035 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 0, 2023-10-06T23:30:35.036 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 0, 2023-10-06T23:30:35.036 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 0, 2023-10-06T23:30:35.036 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-10-06T23:30:35.036 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T23:30:35.036 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-10-06T23:30:35.036 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 0, 2023-10-06T23:30:35.036 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 0, 2023-10-06T23:30:35.036 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 0, 2023-10-06T23:30:35.037 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 0, 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 0, 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 0 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 0, 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 0, 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 0, 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 0, 2023-10-06T23:30:35.038 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-10-06T23:30:35.039 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 0, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 0, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 0, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.040 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-10-06T23:30:35.041 INFO:teuthology.orchestra.run.smithi156.stdout: "evlrg": 0, 2023-10-06T23:30:35.041 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 0, 2023-10-06T23:30:35.041 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 0, 2023-10-06T23:30:35.041 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 0, 2023-10-06T23:30:35.041 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 11057, 2023-10-06T23:30:35.041 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-10-06T23:30:35.041 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 0, 2023-10-06T23:30:35.041 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 0, 2023-10-06T23:30:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 0, 2023-10-06T23:30:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 0, 2023-10-06T23:30:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 15, 2023-10-06T23:30:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: "segmjr": 2, 2023-10-06T23:30:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-10-06T23:30:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 0, 2023-10-06T23:30:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 4194304, 2023-10-06T23:30:35.042 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 18325080, 2023-10-06T23:30:35.043 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 18321159, 2023-10-06T23:30:35.043 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-10-06T23:30:35.043 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.043 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.043 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.043 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.043 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 11057 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 79, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 697, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 618, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 14, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 33, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 19, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 352, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 972, 2023-10-06T23:30:35.044 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 620, 2023-10-06T23:30:35.045 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 0, 2023-10-06T23:30:35.045 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 0, 2023-10-06T23:30:35.045 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 0, 2023-10-06T23:30:35.045 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 50176, 2023-10-06T23:30:35.045 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207152 2023-10-06T23:30:35.045 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.045 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-10-06T23:30:35.045 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 0, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 0, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 0, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 0, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 0, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.046 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-10-06T23:30:35.047 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.048 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.049 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.050 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.051 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.052 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.053 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.054 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.055 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.055 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-10-06T23:30:35.055 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.055 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.055 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.055 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.055 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-10-06T23:30:35.057 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.057 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.057 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.057 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.057 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-10-06T23:30:35.057 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.057 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.057 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.058 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.058 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-10-06T23:30:35.058 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.058 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.058 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.059 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.060 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 1, 2023-10-06T23:30:35.061 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 1, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 0, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 1, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 0, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 0, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 2762, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "mdthresh_evicted": 0 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:35.062 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:35.063 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:35.064 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:35.065 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 207111, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 62, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 7528, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 158, 2023-10-06T23:30:35.066 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 431608, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 8804, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-10-06T23:30:35.067 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 3679, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 21, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 3, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 3679, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3679, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 2.448965309, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000665660 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-10-06T23:30:35.068 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3679, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 3680 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 3679, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 3679, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 0, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 2178, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 0, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 1499, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 0, 2023-10-06T23:30:35.069 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 1, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-10-06T23:30:35.070 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-10-06T23:30:35.071 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 89, 2023-10-06T23:30:35.072 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 3, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 7, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 8, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 1, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 0, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 2, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 0 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-10-06T23:30:35.073 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 0, 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 0 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 0, 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-10-06T23:30:35.074 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 0, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 0, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 4022, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 15101062, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 4022, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:35.075 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 4022, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 15101062, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:35.076 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 3679, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 14139431, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 3679, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 14139431, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.077 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 3679, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 3679, 2023-10-06T23:30:35.078 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 3679, 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 3679, 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:35.079 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.080 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x55f458ec6a00": { 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-10-06T23:30:35.081 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:35.082 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:35.082 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:35.082 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:35.082 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.082 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:35.082 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-10-06T23:30:35.083 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:30:35.083 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:30:35.083 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:34 smithi156 ceph-mon[102862]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:30:35.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:30:35.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:30:35.146 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:34 smithi008 ceph-mon[98532]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:30:35.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-06T23:30:35.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-06T23:30:35.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:34 smithi190 ceph-mon[102658]: from='mgr.14148 172.21.15.8:0/4275810645' entity='mgr.x' 2023-10-06T23:30:36.026 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-06T23:30:36.026 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-06T23:30:36.026 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-10-06T23:30:36.026 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-10-06T23:30:36.026 DEBUG:tasks.check_counter:Getting stats from h 2023-10-06T23:30:36.026 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-06T23:30:36.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:36 smithi156 ceph-mon[102862]: pgmap v883: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-10-06T23:30:36.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:36 smithi008 ceph-mon[98532]: pgmap v883: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-10-06T23:30:36.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:36 smithi190 ceph-mon[102658]: pgmap v883: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-10-06T23:30:36.826 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:30:38.268 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:38 smithi156 ceph-mon[102862]: pgmap v884: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 8 op/s 2023-10-06T23:30:38.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:38 smithi008 ceph-mon[98532]: pgmap v884: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 8 op/s 2023-10-06T23:30:38.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:38 smithi190 ceph-mon[102658]: pgmap v884: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 8 op/s 2023-10-06T23:30:38.659 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-10-06T23:30:38.659 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:38.659 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 187, 2023-10-06T23:30:38.659 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 183, 2023-10-06T23:30:38.659 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 215074, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 106718, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 6, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.028677188, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.007550126, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.015699712, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.003860874, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 182, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.014239451, 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000078238 2023-10-06T23:30:38.660 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 213728, 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 105776 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 842, 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 975, 2023-10-06T23:30:38.661 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 4441787, 2023-10-06T23:30:38.662 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 578188, 2023-10-06T23:30:38.662 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 6, 2023-10-06T23:30:38.662 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 5, 2023-10-06T23:30:38.662 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.098887415, 2023-10-06T23:30:38.662 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.036927225, 2023-10-06T23:30:38.662 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.028875379, 2023-10-06T23:30:38.662 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.024078785, 2023-10-06T23:30:38.662 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:38.663 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 973, 2023-10-06T23:30:38.663 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.046899588, 2023-10-06T23:30:38.663 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000048201 2023-10-06T23:30:38.663 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.663 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:38.663 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.664 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.664 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.664 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.664 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-06T23:30:38.664 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 316576 2023-10-06T23:30:38.664 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.664 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:38.665 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1729, 2023-10-06T23:30:38.665 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1729, 2023-10-06T23:30:38.665 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 22667893, 2023-10-06T23:30:38.665 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 536930, 2023-10-06T23:30:38.665 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 5, 2023-10-06T23:30:38.665 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-10-06T23:30:38.665 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.159825056, 2023-10-06T23:30:38.666 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.043362313, 2023-10-06T23:30:38.666 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.064450862, 2023-10-06T23:30:38.666 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.040963469, 2023-10-06T23:30:38.666 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:38.666 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1728, 2023-10-06T23:30:38.666 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.070838194, 2023-10-06T23:30:38.666 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000040994 2023-10-06T23:30:38.666 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.667 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:38.667 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.667 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.667 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.667 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.667 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-06T23:30:38.667 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 448 2023-10-06T23:30:38.667 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.668 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-10-06T23:30:38.668 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-10-06T23:30:38.668 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-10-06T23:30:38.668 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.668 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-10-06T23:30:38.668 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-10-06T23:30:38.668 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-10-06T23:30:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 4440, 2023-10-06T23:30:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.124665145, 2023-10-06T23:30:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000028077 2023-10-06T23:30:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-10-06T23:30:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-10-06T23:30:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-10-06T23:30:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-10-06T23:30:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 0, 2023-10-06T23:30:38.671 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 0, 2023-10-06T23:30:38.671 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-10-06T23:30:38.671 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.671 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.671 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.671 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.671 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-10-06T23:30:38.672 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 0, 2023-10-06T23:30:38.672 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 0, 2023-10-06T23:30:38.672 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-10-06T23:30:38.672 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 0, 2023-10-06T23:30:38.672 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 0, 2023-10-06T23:30:38.672 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-10-06T23:30:38.672 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 41, 2023-10-06T23:30:38.672 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 4, 2023-10-06T23:30:38.673 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 36, 2023-10-06T23:30:38.673 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 1, 2023-10-06T23:30:38.673 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 35, 2023-10-06T23:30:38.673 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 0, 2023-10-06T23:30:38.673 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 0, 2023-10-06T23:30:38.673 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 0, 2023-10-06T23:30:38.673 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 19, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 0, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 0, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 0, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 0, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 0, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 0, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 0, 2023-10-06T23:30:38.674 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 1037, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 1620305579, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 0, 2023-10-06T23:30:38.675 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 0, 2023-10-06T23:30:38.676 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 0 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 0, 2023-10-06T23:30:38.677 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-10-06T23:30:38.678 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-10-06T23:30:38.679 INFO:teuthology.orchestra.run.smithi156.stdout: "evlrg": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 12337, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 0, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 2, 2023-10-06T23:30:38.680 INFO:teuthology.orchestra.run.smithi156.stdout: "segmjr": 47, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 0, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 59708289, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 59979229, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 59977314, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 12337 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.681 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 33, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 34, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 1, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 26, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 26, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 0, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 41, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 41, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 0, 2023-10-06T23:30:38.682 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 0, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 0, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 0, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 49348, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207128 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 0, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 0, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 0, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 0, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 0, 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-10-06T23:30:38.683 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.684 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.685 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-10-06T23:30:38.686 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.687 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.688 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-10-06T23:30:38.689 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.690 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.691 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-10-06T23:30:38.692 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.693 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.694 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.695 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.696 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 1, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 1, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 0, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 0, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 0, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 0, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 2766, 2023-10-06T23:30:38.697 INFO:teuthology.orchestra.run.smithi156.stdout: "mdthresh_evicted": 0 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:38.698 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:38.699 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:38.700 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 213623, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 62, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:38.701 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 7528, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 158, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 132448, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 395, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-10-06T23:30:38.702 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 2569, 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 26, 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 3, 2023-10-06T23:30:38.703 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 2569, 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2569, 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1.516978788, 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000590493 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2569, 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 2570 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 2569, 2023-10-06T23:30:38.704 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 2569, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 1296, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 1270, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 0, 2023-10-06T23:30:38.705 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 2, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-10-06T23:30:38.706 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-10-06T23:30:38.707 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 0, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 8, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 8, 2023-10-06T23:30:38.708 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 0, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 2, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 0 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 0, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.709 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 0 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 0, 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 0, 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 0, 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:38.710 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 2754, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 27064422, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 2754, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 2754, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 27064422, 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:38.711 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:38.712 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 2569, 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 26404775, 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 2569, 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 26404775, 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-10-06T23:30:38.713 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 2569, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 2569, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 2569, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 2569, 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:38.714 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:38.715 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:38.716 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x56064a30ea00": { 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-10-06T23:30:38.717 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:38.718 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:38.718 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:38.718 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:38.718 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.718 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:38.718 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-10-06T23:30:39.145 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-10-06T23:30:39.145 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-10-06T23:30:39.145 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2023-10-06T23:30:39.145 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2023-10-06T23:30:39.145 DEBUG:tasks.check_counter:Getting stats from k 2023-10-06T23:30:39.146 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-06T23:30:39.923 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-06T23:30:40.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:40 smithi156 ceph-mon[102862]: pgmap v885: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2023-10-06T23:30:40.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:40 smithi008 ceph-mon[98532]: pgmap v885: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2023-10-06T23:30:40.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:40 smithi190 ceph-mon[102658]: pgmap v885: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2023-10-06T23:30:42.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:42 smithi156 ceph-mon[102862]: pgmap v886: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2023-10-06T23:30:42.395 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:42 smithi008 ceph-mon[98532]: pgmap v886: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2023-10-06T23:30:42.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:42 smithi190 ceph-mon[102658]: pgmap v886: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2023-10-06T23:30:42.522 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-10-06T23:30:42.522 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:42.522 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 4, 2023-10-06T23:30:42.522 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 4, 2023-10-06T23:30:42.522 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 2992, 2023-10-06T23:30:42.522 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 448, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 0, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.003483110, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.000059002, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.001130023, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.001230775, 2023-10-06T23:30:42.523 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000410258 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 448 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 321, 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 320, 2023-10-06T23:30:42.524 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 230080, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 192848, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 2, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 1, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.047059005, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.020662034, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.015188092, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.007254719, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 319, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.013901864, 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000043579 2023-10-06T23:30:42.525 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.526 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:42.526 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:42.526 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:42.526 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:42.526 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.526 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 230080, 2023-10-06T23:30:42.526 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 192848 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 2, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 245, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 320, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 165776, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.014287835, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.009642607, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.001833249, 2023-10-06T23:30:42.527 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 243, 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.013108707, 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000053945 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.528 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 165776 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 0, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:42.529 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:42.530 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:42.531 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 148784, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 31, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-10-06T23:30:42.532 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 928, 2023-10-06T23:30:42.533 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 2, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 323, 2023-10-06T23:30:42.534 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 184682, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 323, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 323, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 184682, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:42.535 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-10-06T23:30:42.536 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-10-06T23:30:43.039 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-10-06T23:30:43.039 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-10-06T23:30:43.039 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2023-10-06T23:30:43.039 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2023-10-06T23:30:43.040 DEBUG:tasks.check_counter:Getting stats from c 2023-10-06T23:30:43.040 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-06T23:30:43.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:43 smithi156 ceph-mon[102862]: pgmap v887: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2023-10-06T23:30:43.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:43 smithi008 ceph-mon[98532]: pgmap v887: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2023-10-06T23:30:43.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:43 smithi190 ceph-mon[102658]: pgmap v887: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2023-10-06T23:30:44.498 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:30:46.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:45 smithi156 ceph-mon[102862]: pgmap v888: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-06T23:30:46.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:45 smithi008 ceph-mon[98532]: pgmap v888: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-06T23:30:46.188 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:45 smithi190 ceph-mon[102658]: pgmap v888: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-06T23:30:46.544 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-10-06T23:30:46.545 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:46.545 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 3643, 2023-10-06T23:30:46.545 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 3643, 2023-10-06T23:30:46.545 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 6042288, 2023-10-06T23:30:46.546 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 1132184, 2023-10-06T23:30:46.546 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 6, 2023-10-06T23:30:46.546 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:46.546 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.297952775, 2023-10-06T23:30:46.546 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.096216613, 2023-10-06T23:30:46.547 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.077957272, 2023-10-06T23:30:46.547 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.098559511, 2023-10-06T23:30:46.547 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:46.547 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3642, 2023-10-06T23:30:46.548 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.131373947, 2023-10-06T23:30:46.548 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000036071 2023-10-06T23:30:46.548 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.548 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:46.549 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.549 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.549 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.549 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.549 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-06T23:30:46.549 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 448 2023-10-06T23:30:46.550 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.550 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:46.550 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 347, 2023-10-06T23:30:46.550 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 326, 2023-10-06T23:30:46.550 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 323532, 2023-10-06T23:30:46.551 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 192860, 2023-10-06T23:30:46.551 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 3, 2023-10-06T23:30:46.551 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:46.551 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.046609497, 2023-10-06T23:30:46.551 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.019895429, 2023-10-06T23:30:46.552 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.016121123, 2023-10-06T23:30:46.552 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.007246191, 2023-10-06T23:30:46.552 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:46.552 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 325, 2023-10-06T23:30:46.552 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.015967176, 2023-10-06T23:30:46.552 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000049129 2023-10-06T23:30:46.553 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.553 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:46.553 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.553 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.554 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.554 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.554 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 322976, 2023-10-06T23:30:46.554 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 192176 2023-10-06T23:30:46.554 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.554 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 3, 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 244, 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 588, 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 522103, 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 6, 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 3, 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.015325605, 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.009715391, 2023-10-06T23:30:46.555 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.002976282, 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.000033612, 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 242, 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.012533112, 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000051789 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.556 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 521792 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 1, 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-MDSRank": { 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2023-10-06T23:30:46.557 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 6161, 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.153475100, 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000024910 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-PurgeQueue": { 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2023-10-06T23:30:46.558 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "mds": { 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "request": 0, 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "reply": 0, 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "reply_latency": { 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.559 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_reply": 0, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "forward": 0, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_complete": 0, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_keys": 0, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_commit": 0, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_split": 0, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_merge": 0, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes": 715, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_top": 189, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_bottom": 519, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pin_tail": 7, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pinned": 445, 2023-10-06T23:30:46.560 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_expired": 10, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_with_caps": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "caps": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "subtrees": 18, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_hit": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_forward": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_discover": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_dir_fetch": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_remote_ino": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_lock": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "load_cent": 0, 2023-10-06T23:30:46.561 INFO:teuthology.orchestra.run.smithi190.stdout: "q": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "exported": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "exported_inodes": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "imported": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "imported_inodes": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_dir_fetch": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_backtrace_fetch": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_peer_discover": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rfiles": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rbytes": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rsnaps": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_fetch": 0, 2023-10-06T23:30:46.562 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_set_tag": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_inotable_repaired": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_inodes": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_base_inodes": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dirfrag_rstats": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_file_inodes": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_inode_file_caps": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_revoke": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_grant": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T23:30:46.563 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps_dirty": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_cap_release": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "process_request_cap_release": 0 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_cache": { 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update_receipt": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_try_discover": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_send_discover": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_handle_discover": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays": 0, 2023-10-06T23:30:46.564 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_delayed": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_enqueuing": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_created": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_enqueued": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_reintegrated": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_migrated": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_processing": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_enqueued": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_prioritized": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_started": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_completed": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_enqueue_scrub": 0, 2023-10-06T23:30:46.565 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_exportdir": 0, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_flush": 0, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragmentdir": 0, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragstats": 0, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_inodestats": 0 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_log": { 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "evlrg": 0, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "evadd": 0, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "evex": 0, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "evtrm": 0, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "ev": 4201, 2023-10-06T23:30:46.566 INFO:teuthology.orchestra.run.smithi190.stdout: "evexg": 0, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "evexd": 0, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "segadd": 0, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "segex": 0, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "segtrm": 0, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "seg": 6, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "segmjr": 2, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "segexg": 0, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "segexd": 0, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "expos": 4194304, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "wrpos": 9214323, 2023-10-06T23:30:46.567 INFO:teuthology.orchestra.run.smithi190.stdout: "rdpos": 9214262, 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: "jlat": { 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: "replayed": 4201 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_mem": { 2023-10-06T23:30:46.568 INFO:teuthology.orchestra.run.smithi190.stdout: "ino": 450, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "ino+": 826, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "ino-": 376, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "dir": 30, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "dir+": 44, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "dir-": 14, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "dn": 715, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "dn+": 893, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "dn-": 178, 2023-10-06T23:30:46.569 INFO:teuthology.orchestra.run.smithi190.stdout: "cap": 0, 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: "cap+": 0, 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: "cap-": 0, 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: "rss": 50372, 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: "heap": 207152 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_server": { 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_client_request": 0, 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_server_request": 0, 2023-10-06T23:30:46.570 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_request": 0, 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_session": 0, 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_peer_request": 0, 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: "req_create_latency": { 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getattr_latency": { 2023-10-06T23:30:46.571 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getfilelock_latency": { 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.572 INFO:teuthology.orchestra.run.smithi190.stdout: "req_link_latency": { 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookup_latency": { 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookuphash_latency": { 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.573 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupino_latency": { 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupname_latency": { 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.574 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.575 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupparent_latency": { 2023-10-06T23:30:46.575 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.575 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.575 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.575 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.575 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupsnap_latency": { 2023-10-06T23:30:46.575 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.576 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.576 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.576 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.576 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lssnap_latency": { 2023-10-06T23:30:46.576 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.576 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.577 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.577 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.577 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mkdir_latency": { 2023-10-06T23:30:46.577 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.577 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.577 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.577 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.577 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mknod_latency": { 2023-10-06T23:30:46.578 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.578 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.578 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.578 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.578 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mksnap_latency": { 2023-10-06T23:30:46.578 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.579 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.579 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.579 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.579 INFO:teuthology.orchestra.run.smithi190.stdout: "req_open_latency": { 2023-10-06T23:30:46.579 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.579 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.580 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.580 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.580 INFO:teuthology.orchestra.run.smithi190.stdout: "req_readdir_latency": { 2023-10-06T23:30:46.580 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.580 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.580 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.581 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.581 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rename_latency": { 2023-10-06T23:30:46.581 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.581 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.581 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.581 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.581 INFO:teuthology.orchestra.run.smithi190.stdout: "req_renamesnap_latency": { 2023-10-06T23:30:46.581 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.582 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.582 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.582 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.582 INFO:teuthology.orchestra.run.smithi190.stdout: "req_snapdiff_latency": { 2023-10-06T23:30:46.582 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.582 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.583 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.583 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.583 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmdir_latency": { 2023-10-06T23:30:46.583 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.583 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.583 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.584 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.584 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmsnap_latency": { 2023-10-06T23:30:46.584 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.584 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.584 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.584 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmxattr_latency": { 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setattr_latency": { 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.585 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setdirlayout_latency": { 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setfilelock_latency": { 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.586 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setlayout_latency": { 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setxattr_latency": { 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "req_symlink_latency": { 2023-10-06T23:30:46.587 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "req_unlink_latency": { 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_revoke_eviction": 0, 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_acquisition_throttle": 0, 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getvxattr_latency": { 2023-10-06T23:30:46.588 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_sessions": { 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "session_count": 1, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "session_add": 1, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "session_remove": 0, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_open": 1, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_stale": 0, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "total_load": 0, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "average_load": 0, 2023-10-06T23:30:46.589 INFO:teuthology.orchestra.run.smithi190.stdout: "avg_session_uptime": 2746, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "mdthresh_evicted": 0 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:46.590 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:46.591 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2023-10-06T23:30:46.592 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 182144, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 50, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:46.593 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 7528, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 158, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 1435021, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 3760, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:46.594 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "objecter": { 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "op_active": 0, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "op_laggy": 0, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send": 3642, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send_bytes": 21, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "op_resend": 3, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "op_reply": 3642, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "op_latency": { 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3642, 2023-10-06T23:30:46.595 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2.812923403, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000772356 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "op_inflight": 0, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "oplen_avg": { 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3642, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 3643 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "op": 3642, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "op_r": 3642, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "op_w": 0, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "op_rmw": 0, 2023-10-06T23:30:46.596 INFO:teuthology.orchestra.run.smithi190.stdout: "op_pg": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_stat": 2228, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_create": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_read": 1412, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_write": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writefull": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writesame": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_append": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_zero": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_truncate": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_delete": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_mapext": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_sparse_read": 0, 2023-10-06T23:30:46.597 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_clonerange": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_getxattr": 1, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_setxattr": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_cmpxattr": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_rmxattr": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_resetxattrs": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_call": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_watch": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_notify": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls_filter": 0, 2023-10-06T23:30:46.598 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_other": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_active": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_send": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_resend": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_ping": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_active": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_send": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_resend": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_active": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_send": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_resend": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_active": 0, 2023-10-06T23:30:46.599 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_send": 0, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_resend": 0, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "command_active": 0, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "command_send": 0, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "command_resend": 0, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "map_epoch": 89, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "map_full": 0, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "map_inc": 3, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_sessions": 4, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_open": 5, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_close": 1, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_laggy": 0, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_wr": 0, 2023-10-06T23:30:46.600 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_rd": 2, 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_del": 0 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "oft": { 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_objs": 0, 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_kv_pairs": 0, 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_updates": 0, 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_removes": 0 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "osd-slow-ops": { 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_ops_count": 0 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.601 INFO:teuthology.orchestra.run.smithi190.stdout: "purge_queue": { 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops": 0, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops_high_water": 0, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing": 0, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_high_water": 0, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed": 0, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_item_in_journal": 0 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:46.602 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 3989, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 5986693, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 3989, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 3989, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 5986693, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.603 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_bytes": { 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 3642, 2023-10-06T23:30:46.604 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 5020024, 2023-10-06T23:30:46.605 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 3642, 2023-10-06T23:30:46.605 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 5020024, 2023-10-06T23:30:46.605 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:46.605 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.605 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.605 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.605 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.605 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_ops": { 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 1024, 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:46.606 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 3642, 2023-10-06T23:30:46.607 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 3642, 2023-10-06T23:30:46.607 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 3642, 2023-10-06T23:30:46.607 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 3642, 2023-10-06T23:30:46.607 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:46.607 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.607 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.607 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.607 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.608 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.608 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle": { 2023-10-06T23:30:46.608 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:46.608 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2023-10-06T23:30:46.608 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:46.608 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2023-10-06T23:30:46.608 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2023-10-06T23:30:46.609 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:46.609 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:46.609 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:46.609 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:46.609 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 0, 2023-10-06T23:30:46.609 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 0, 2023-10-06T23:30:46.610 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:46.610 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.610 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.610 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle-0x5578bf804a00": { 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2023-10-06T23:30:46.611 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 0, 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 0, 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.612 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:46.613 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-10-06T23:30:47.024 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-10-06T23:30:47.024 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-10-06T23:30:47.024 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-10-06T23:30:47.024 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-10-06T23:30:47.024 DEBUG:tasks.check_counter:Getting stats from f 2023-10-06T23:30:47.025 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-06T23:30:47.834 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:30:48.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:47 smithi156 ceph-mon[102862]: pgmap v889: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:48.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:47 smithi008 ceph-mon[98532]: pgmap v889: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:48.153 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:47 smithi190 ceph-mon[102658]: pgmap v889: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:49.394 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-10-06T23:30:49.394 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 655569, 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 329243, 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 177137442, 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 69857877, 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 12, 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 3, 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 48.299395710, 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 24.877701439, 2023-10-06T23:30:49.395 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 32.513172183, 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.018784612, 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 329241, 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 8.240249371, 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000025028 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 983305, 2023-10-06T23:30:49.396 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.136318828, 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000138 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 529723, 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 1041353, 2023-10-06T23:30:49.397 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 184987775, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 372725305, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 14, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 5, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 49.589233386, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 23.443825287, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 26.649198086, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.025498535, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1041351, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 26.562971482, 2023-10-06T23:30:49.398 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000025508 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1361271, 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.318171993, 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000233 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 530112 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 2201993, 2023-10-06T23:30:49.399 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 1502797, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 509144067, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 271233673, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 7, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 6, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 102.288715767, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 44.324841308, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 74.223385341, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.029978276, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1502797, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 29.593767831, 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000019692 2023-10-06T23:30:49.400 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3517972, 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.651490823, 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000185 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 327536, 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 199264 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 1, 2023-10-06T23:30:49.401 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-MDSRank": { 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3763, 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2.777467907, 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000738099 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-PurgeQueue": { 2023-10-06T23:30:49.402 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 40, 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.001055110, 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000026377 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "mds": { 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "request": 5129, 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "reply": 4866, 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "reply_latency": { 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 4866, 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 8.192334241, 2023-10-06T23:30:49.403 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001683586 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_reply": 0, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "forward": 263, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_complete": 0, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_keys": 0, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_commit": 11, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_split": 0, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_merge": 0, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes": 367, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_top": 6, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_bottom": 325, 2023-10-06T23:30:49.404 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pin_tail": 36, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pinned": 358, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_expired": 614, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_with_caps": 72, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "caps": 72, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "subtrees": 14, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse": 15051, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_hit": 11788, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_forward": 263, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_discover": 41, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_dir_fetch": 0, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_remote_ino": 0, 2023-10-06T23:30:49.405 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_lock": 639, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "load_cent": 3229, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "q": 0, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "exported": 16, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "exported_inodes": 613, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "imported": 17, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "imported_inodes": 625, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_dir_fetch": 0, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_backtrace_fetch": 202, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_peer_discover": 0, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rfiles": 1034, 2023-10-06T23:30:49.406 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rbytes": 1620293880, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rsnaps": 0, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_fetch": 202, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_set_tag": 0, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_inotable_repaired": 0, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_inodes": 0, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_base_inodes": 0, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dirfrag_rstats": 0, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_file_inodes": 202, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_inode_file_caps": 8, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_revoke": 512354, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_grant": 512756, 2023-10-06T23:30:49.407 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps": 523888, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps_dirty": 8467, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_cap_release": 2, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "process_request_cap_release": 434 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_cache": { 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update": 9, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update_receipt": 221, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_try_discover": 121, 2023-10-06T23:30:49.408 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_send_discover": 217, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_handle_discover": 12, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays": 0, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_delayed": 0, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_enqueuing": 0, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_created": 143, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_enqueued": 4, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_reintegrated": 425, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_migrated": 0, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_processing": 0, 2023-10-06T23:30:49.409 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_enqueued": 0, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_prioritized": 0, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_started": 0, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_completed": 0, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_enqueue_scrub": 0, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_exportdir": 16, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_flush": 0, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragmentdir": 0, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragstats": 0, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_inodestats": 0 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.410 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_log": { 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "evlrg": 0, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "evadd": 11057, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "evex": 0, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "evtrm": 0, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "ev": 11057, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "evexg": 0, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "evexd": 0, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "segadd": 15, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "segex": 0, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "segtrm": 0, 2023-10-06T23:30:49.411 INFO:teuthology.orchestra.run.smithi190.stdout: "seg": 15, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "segmjr": 2, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "segexg": 0, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "segexd": 0, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "expos": 4194304, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "wrpos": 18325080, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "rdpos": 0, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "jlat": { 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1754, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 5.153626843, 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002938213 2023-10-06T23:30:49.412 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "replayed": 0 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_mem": { 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "ino": 98, 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "ino+": 708, 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "ino-": 610, 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "dir": 45, 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "dir+": 134, 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "dir-": 89, 2023-10-06T23:30:49.413 INFO:teuthology.orchestra.run.smithi190.stdout: "dn": 367, 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: "dn+": 988, 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: "dn-": 621, 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: "cap": 72, 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: "cap+": 681, 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: "cap-": 609, 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: "rss": 59620, 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: "heap": 198960 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.414 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_server": { 2023-10-06T23:30:49.415 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_client_request": 9421, 2023-10-06T23:30:49.415 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_server_request": 36, 2023-10-06T23:30:49.415 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_request": 5129, 2023-10-06T23:30:49.415 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_session": 28, 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_peer_request": 771, 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: "req_create_latency": { 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 57, 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.138216359, 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002424848 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getattr_latency": { 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3, 2023-10-06T23:30:49.416 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.005909567, 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001969855 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getfilelock_latency": { 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "req_link_latency": { 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 139, 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.430676532, 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.003098392 2023-10-06T23:30:49.417 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookup_latency": { 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3453, 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2.236323327, 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000647646 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookuphash_latency": { 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.418 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupino_latency": { 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupname_latency": { 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.419 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupparent_latency": { 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupsnap_latency": { 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lssnap_latency": { 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.420 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mkdir_latency": { 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mknod_latency": { 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.421 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mksnap_latency": { 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: "req_open_latency": { 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 630, 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.433806108, 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000688581 2023-10-06T23:30:49.422 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "req_readdir_latency": { 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 16, 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.016179485, 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001011217 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rename_latency": { 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 425, 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 4.516476669, 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.010627003 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.423 INFO:teuthology.orchestra.run.smithi190.stdout: "req_renamesnap_latency": { 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "req_snapdiff_latency": { 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmdir_latency": { 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.424 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmsnap_latency": { 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmxattr_latency": { 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.425 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setattr_latency": { 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setdirlayout_latency": { 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.426 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setfilelock_latency": { 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setlayout_latency": { 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setxattr_latency": { 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.427 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.428 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.428 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.428 INFO:teuthology.orchestra.run.smithi190.stdout: "req_symlink_latency": { 2023-10-06T23:30:49.428 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.428 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.428 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.428 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.428 INFO:teuthology.orchestra.run.smithi190.stdout: "req_unlink_latency": { 2023-10-06T23:30:49.429 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 143, 2023-10-06T23:30:49.429 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.414746194, 2023-10-06T23:30:49.429 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002900323 2023-10-06T23:30:49.429 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.430 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_revoke_eviction": 0, 2023-10-06T23:30:49.430 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_acquisition_throttle": 0, 2023-10-06T23:30:49.430 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getvxattr_latency": { 2023-10-06T23:30:49.430 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.430 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.430 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.430 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.430 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.431 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_sessions": { 2023-10-06T23:30:49.431 INFO:teuthology.orchestra.run.smithi190.stdout: "session_count": 1, 2023-10-06T23:30:49.431 INFO:teuthology.orchestra.run.smithi190.stdout: "session_add": 1, 2023-10-06T23:30:49.431 INFO:teuthology.orchestra.run.smithi190.stdout: "session_remove": 0, 2023-10-06T23:30:49.431 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_open": 1, 2023-10-06T23:30:49.431 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_stale": 0, 2023-10-06T23:30:49.431 INFO:teuthology.orchestra.run.smithi190.stdout: "total_load": 2032, 2023-10-06T23:30:49.432 INFO:teuthology.orchestra.run.smithi190.stdout: "average_load": 2032, 2023-10-06T23:30:49.432 INFO:teuthology.orchestra.run.smithi190.stdout: "avg_session_uptime": 1045, 2023-10-06T23:30:49.432 INFO:teuthology.orchestra.run.smithi190.stdout: "mdthresh_evicted": 0 2023-10-06T23:30:49.432 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.432 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2023-10-06T23:30:49.432 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:49.433 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:49.433 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:49.433 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:49.433 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:49.433 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:49.433 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:49.433 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:49.434 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:49.434 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:49.434 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:49.434 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:49.434 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:49.435 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:49.435 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:49.435 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:49.435 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:49.435 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:49.435 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:49.436 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:49.436 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:49.436 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:49.436 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:49.436 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:49.436 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:49.437 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:49.437 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:49.437 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:49.437 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:49.437 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:49.437 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:49.437 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2023-10-06T23:30:49.438 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:49.438 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:49.438 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:49.438 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:49.438 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 802959, 2023-10-06T23:30:49.439 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 235, 2023-10-06T23:30:49.439 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:49.439 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:49.439 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2023-10-06T23:30:49.439 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2023-10-06T23:30:49.439 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:49.440 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:49.440 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:49.440 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:49.440 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 7528, 2023-10-06T23:30:49.440 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 158, 2023-10-06T23:30:49.440 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 572472, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 11942, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.441 INFO:teuthology.orchestra.run.smithi190.stdout: "objecter": { 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "op_active": 0, 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "op_laggy": 0, 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send": 2235, 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send_bytes": 14190044, 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "op_resend": 27, 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "op_reply": 2235, 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "op_latency": { 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2235, 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 6.211830807, 2023-10-06T23:30:49.442 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002779342 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "op_inflight": 0, 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "oplen_avg": { 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2235, 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2448 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "op": 2235, 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "op_r": 204, 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "op_w": 2031, 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "op_rmw": 0, 2023-10-06T23:30:49.443 INFO:teuthology.orchestra.run.smithi190.stdout: "op_pg": 0, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_stat": 0, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_create": 10, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_read": 2, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_write": 1756, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writefull": 74, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writesame": 0, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_append": 0, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_zero": 0, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_truncate": 0, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_delete": 31, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_mapext": 0, 2023-10-06T23:30:49.444 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_sparse_read": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_clonerange": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_getxattr": 202, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_setxattr": 20, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_cmpxattr": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_rmxattr": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_resetxattrs": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_call": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_watch": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_notify": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T23:30:49.445 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls_filter": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_other": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_active": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_send": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_resend": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_ping": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_active": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_send": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_resend": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_active": 0, 2023-10-06T23:30:49.446 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_send": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_resend": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_active": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_send": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_resend": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "command_active": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "command_send": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "command_resend": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "map_epoch": 89, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "map_full": 0, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "map_inc": 3, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_sessions": 12, 2023-10-06T23:30:49.447 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_open": 12, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_close": 0, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_laggy": 0, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_wr": 263, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_rd": 0, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_del": 90 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "oft": { 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_objs": 1, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_kv_pairs": 0, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_updates": 0, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_removes": 0 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.448 INFO:teuthology.orchestra.run.smithi190.stdout: "osd-slow-ops": { 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_ops_count": 0 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "purge_queue": { 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops": 0, 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops_high_water": 12, 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing": 0, 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_high_water": 3, 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed": 4, 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_item_in_journal": 0 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.449 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:49.450 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:49.450 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2023-10-06T23:30:49.450 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:49.450 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 3387281, 2023-10-06T23:30:49.450 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 566392088, 2023-10-06T23:30:49.450 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:49.450 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 3387281, 2023-10-06T23:30:49.450 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 3387281, 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 566392088, 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_bytes": { 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:49.451 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 2235, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 14190448, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2235, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 14190448, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.452 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_ops": { 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 1024, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 2235, 2023-10-06T23:30:49.453 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 2235, 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2235, 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 2235, 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle": { 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:49.454 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 4, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 404, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 4, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 404, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.455 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle-0x5611d61506e0": { 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 11057, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 14130776, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 11057, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:49.456 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 1754, 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 14130776, 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:49.457 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-10-06T23:30:49.942 INFO:tasks.check_counter:Daemon mds.f mds.exported=16 2023-10-06T23:30:49.942 INFO:tasks.check_counter:Daemon mds.f mds.imported=17 2023-10-06T23:30:49.942 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=9 2023-10-06T23:30:49.942 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=221 2023-10-06T23:30:49.942 DEBUG:tasks.check_counter:Getting stats from i 2023-10-06T23:30:49.942 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-06T23:30:50.021 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:49 smithi190 ceph-mon[102658]: pgmap v890: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:50.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:49 smithi156 ceph-mon[102862]: pgmap v890: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:50.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:49 smithi008 ceph-mon[98532]: pgmap v890: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:50.746 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:30:52.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:51 smithi156 ceph-mon[102862]: pgmap v891: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:52.131 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:51 smithi190 ceph-mon[102658]: pgmap v891: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:52.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:51 smithi008 ceph-mon[98532]: pgmap v891: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:52.438 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 3477577, 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 3801935, 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 576974877, 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 679949856, 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 9, 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 4, 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 201.135780314, 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 85.405791277, 2023-10-06T23:30:52.439 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 134.828574663, 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.055313832, 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3801933, 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 75.766984772, 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000019928 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 7217377, 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 1.440844682, 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000199 2023-10-06T23:30:52.440 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 433811, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 597199, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 136209053, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 241499312, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 15, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 6, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 37.438058410, 2023-10-06T23:30:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 16.542313822, 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 23.617100890, 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.010287179, 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 597196, 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 17.560596740, 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000029405 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1022379, 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.228326310, 2023-10-06T23:30:52.442 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000223 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 328848, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 197712 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 328967, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 655532, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 65588471, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 177627748, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 8, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 5, 2023-10-06T23:30:52.443 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 47.341304346, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 25.285239990, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 24.750607080, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.010185644, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 655533, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 17.569881770, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000026802 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 971934, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.214073010, 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000220 2023-10-06T23:30:52.444 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 476672 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 1, 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-MDSRank": { 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3483, 2023-10-06T23:30:52.445 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 1.104170814, 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000317017 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-PurgeQueue": { 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 829, 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.044340141, 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000053486 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.446 INFO:teuthology.orchestra.run.smithi190.stdout: "mds": { 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "request": 189386, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "reply": 188226, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "reply_latency": { 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 188226, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 204.236069698, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001085057 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_reply": 0, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "forward": 1160, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_complete": 0, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_keys": 0, 2023-10-06T23:30:52.447 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_commit": 11, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_split": 0, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_merge": 0, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes": 481, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_top": 0, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_bottom": 349, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pin_tail": 132, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pinned": 481, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_expired": 157, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_with_caps": 443, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "caps": 443, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "subtrees": 19, 2023-10-06T23:30:52.448 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse": 379541, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_hit": 376196, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_forward": 1157, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_discover": 25, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_dir_fetch": 0, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_remote_ino": 0, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_lock": 63, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "load_cent": 210, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "q": 0, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "exported": 14, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "exported_inodes": 140, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "imported": 30, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "imported_inodes": 578, 2023-10-06T23:30:52.449 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_dir_fetch": 0, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_backtrace_fetch": 168, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_peer_discover": 0, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rfiles": 1034, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rbytes": 1620293880, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rsnaps": 0, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_fetch": 168, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_set_tag": 0, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_inotable_repaired": 0, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_inodes": 5, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_base_inodes": 0, 2023-10-06T23:30:52.450 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dirfrag_rstats": 5, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_file_inodes": 163, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_inode_file_caps": 7, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_revoke": 240695, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_grant": 164779, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps": 243820, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps_dirty": 591, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_cap_release": 64, 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: "process_request_cap_release": 1234 2023-10-06T23:30:52.451 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_cache": { 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update": 58, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update_receipt": 97, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_try_discover": 54, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_send_discover": 78, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_handle_discover": 80, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays": 0, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_delayed": 0, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_enqueuing": 0, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_created": 256, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_enqueued": 236, 2023-10-06T23:30:52.452 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_reintegrated": 62, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_migrated": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_processing": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_enqueued": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_prioritized": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_started": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_completed": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_enqueue_scrub": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_exportdir": 14, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_flush": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragmentdir": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragstats": 0, 2023-10-06T23:30:52.453 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_inodestats": 0 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_log": { 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "evlrg": 0, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "evadd": 4201, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "evex": 0, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "evtrm": 0, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "ev": 4201, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "evexg": 0, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "evexd": 0, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "segadd": 6, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "segex": 0, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "segtrm": 0, 2023-10-06T23:30:52.454 INFO:teuthology.orchestra.run.smithi190.stdout: "seg": 6, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "segmjr": 2, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "segexg": 0, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "segexd": 0, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "expos": 4194304, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "wrpos": 9214323, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "rdpos": 0, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "jlat": { 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1645, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 4.371867885, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002657670 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.455 INFO:teuthology.orchestra.run.smithi190.stdout: "replayed": 0 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_mem": { 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "ino": 459, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "ino+": 835, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "ino-": 376, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "dir": 44, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "dir+": 76, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "dir-": 32, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "dn": 481, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "dn+": 911, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "dn-": 430, 2023-10-06T23:30:52.456 INFO:teuthology.orchestra.run.smithi190.stdout: "cap": 443, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "cap+": 808, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "cap-": 365, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "rss": 58120, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "heap": 198960 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_server": { 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_client_request": 354908, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_server_request": 62, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_request": 189386, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_session": 17, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_peer_request": 738, 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "req_create_latency": { 2023-10-06T23:30:52.457 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 255, 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.660685804, 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002590924 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getattr_latency": { 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 185430, 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 200.839838160, 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001083103 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getfilelock_latency": { 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.458 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "req_link_latency": { 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 20, 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.058368653, 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002918432 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookup_latency": { 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1591, 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.842710827, 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000529673 2023-10-06T23:30:52.459 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookuphash_latency": { 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupino_latency": { 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupname_latency": { 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.460 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupparent_latency": { 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupsnap_latency": { 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.461 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lssnap_latency": { 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mkdir_latency": { 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mknod_latency": { 2023-10-06T23:30:52.462 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mksnap_latency": { 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "req_open_latency": { 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 578, 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.327600861, 2023-10-06T23:30:52.463 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000566783 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "req_readdir_latency": { 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 31, 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.017086843, 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000551188 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rename_latency": { 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 293, 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 1.417007720, 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.004836203 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "req_renamesnap_latency": { 2023-10-06T23:30:52.464 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "req_snapdiff_latency": { 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmdir_latency": { 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.465 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmsnap_latency": { 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmxattr_latency": { 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.466 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setattr_latency": { 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setdirlayout_latency": { 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setfilelock_latency": { 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.467 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setlayout_latency": { 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setxattr_latency": { 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.468 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "req_symlink_latency": { 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "req_unlink_latency": { 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 28, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.072770830, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002598958 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_revoke_eviction": 0, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_acquisition_throttle": 0, 2023-10-06T23:30:52.469 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getvxattr_latency": { 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_sessions": { 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "session_count": 1, 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "session_add": 1, 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "session_remove": 0, 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_open": 1, 2023-10-06T23:30:52.470 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_stale": 0, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "total_load": 16934, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "average_load": 16934, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "avg_session_uptime": 1073, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "mdthresh_evicted": 0 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:52.471 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:52.472 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:52.473 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 289674, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 112, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2023-10-06T23:30:52.474 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 7528, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 158, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 1498565, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 6817, 2023-10-06T23:30:52.475 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "objecter": { 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "op_active": 0, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "op_laggy": 0, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send": 2536, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send_bytes": 5101165, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "op_resend": 27, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "op_reply": 2536, 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "op_latency": { 2023-10-06T23:30:52.476 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2536, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 6.931810200, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002733363 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "op_inflight": 0, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "oplen_avg": { 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2536, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2681 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "op": 2536, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "op_r": 276, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "op_w": 2260, 2023-10-06T23:30:52.477 INFO:teuthology.orchestra.run.smithi190.stdout: "op_rmw": 0, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "op_pg": 0, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_stat": 0, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_create": 10, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_read": 108, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_write": 1753, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writefull": 144, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writesame": 0, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_append": 0, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_zero": 0, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_truncate": 0, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_delete": 249, 2023-10-06T23:30:52.478 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_mapext": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_sparse_read": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_clonerange": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_getxattr": 168, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_setxattr": 20, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_cmpxattr": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_rmxattr": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_resetxattrs": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_call": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_watch": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_notify": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls": 0, 2023-10-06T23:30:52.479 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls_filter": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_other": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_active": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_send": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_resend": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_ping": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_active": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_send": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_resend": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_active": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_send": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_resend": 0, 2023-10-06T23:30:52.480 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_active": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_send": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_resend": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "command_active": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "command_send": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "command_resend": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "map_epoch": 89, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "map_full": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "map_inc": 3, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_sessions": 12, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_open": 12, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_close": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_laggy": 0, 2023-10-06T23:30:52.481 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_wr": 170, 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_rd": 0, 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_del": 59 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "oft": { 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_objs": 1, 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_kv_pairs": 0, 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_updates": 0, 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_removes": 0 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "osd-slow-ops": { 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_ops_count": 0 2023-10-06T23:30:52.482 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "purge_queue": { 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops": 0, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops_high_water": 10, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing": 0, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_high_water": 10, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed": 236, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_item_in_journal": 0 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2023-10-06T23:30:52.483 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 4240353, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 397119100, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 4240353, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 4240353, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 397119100, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.484 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_bytes": { 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 2536, 2023-10-06T23:30:52.485 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 5125001, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2536, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 5125001, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_ops": { 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 1024, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:52.486 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 2536, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 2536, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2536, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 2536, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.487 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle": { 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 236, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 23836, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 236, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:52.488 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 108, 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 23836, 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle-0x56316382c6e0": { 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:52.489 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 4201, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 5020019, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 4201, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 1645, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 5020019, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:52.490 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.491 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:52.491 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-10-06T23:30:52.962 INFO:tasks.check_counter:Daemon mds.i mds.exported=14 2023-10-06T23:30:52.962 INFO:tasks.check_counter:Daemon mds.i mds.imported=30 2023-10-06T23:30:52.962 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=58 2023-10-06T23:30:52.962 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=97 2023-10-06T23:30:52.963 DEBUG:tasks.check_counter:Getting stats from l 2023-10-06T23:30:52.963 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:14d8d032507701c76ca224e769ee65a96b660a8c shell --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-06T23:30:53.732 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-06T23:30:53.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:53 smithi156 ceph-mon[102862]: pgmap v892: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:53.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:53 smithi008 ceph-mon[98532]: pgmap v892: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:53.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:53 smithi190 ceph-mon[102658]: pgmap v892: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-10-06T23:30:55.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:55 smithi190 ceph-mon[102658]: pgmap v893: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-06T23:30:55.949 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-10-06T23:30:55.950 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T23:30:55.950 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 0, 2023-10-06T23:30:55.950 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 2, 2023-10-06T23:30:55.950 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 0, 2023-10-06T23:30:55.950 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 0, 2023-10-06T23:30:55.950 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:55.950 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 0, 2023-10-06T23:30:55.951 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.002911441, 2023-10-06T23:30:55.951 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.000000000, 2023-10-06T23:30:55.951 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.000587633, 2023-10-06T23:30:55.951 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:55.951 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:55.951 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:55.951 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:55.951 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:55.952 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.952 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:55.952 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:55.952 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:55.952 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:55.952 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.952 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-06T23:30:55.953 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 0 2023-10-06T23:30:55.953 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.953 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T23:30:55.953 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 6, 2023-10-06T23:30:55.953 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 250, 2023-10-06T23:30:55.953 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 3312, 2023-10-06T23:30:55.953 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 136064, 2023-10-06T23:30:55.953 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 4, 2023-10-06T23:30:55.954 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 2, 2023-10-06T23:30:55.954 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.014533976, 2023-10-06T23:30:55.954 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.009726264, 2023-10-06T23:30:55.954 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.002301432, 2023-10-06T23:30:55.954 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-06T23:30:55.954 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:55.954 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 249, 2023-10-06T23:30:55.954 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.013478534, 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000054130 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-06T23:30:55.955 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 136064 2023-10-06T23:30:55.956 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.956 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T23:30:55.956 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 325, 2023-10-06T23:30:55.956 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 324, 2023-10-06T23:30:55.956 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 231168, 2023-10-06T23:30:55.956 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 195344, 2023-10-06T23:30:55.956 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 2, 2023-10-06T23:30:55.957 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 1, 2023-10-06T23:30:55.957 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.047332467, 2023-10-06T23:30:55.957 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.020984943, 2023-10-06T23:30:55.957 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.013880495, 2023-10-06T23:30:55.957 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.007697881, 2023-10-06T23:30:55.957 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T23:30:55.957 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 323, 2023-10-06T23:30:55.958 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.017005609, 2023-10-06T23:30:55.958 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000052648 2023-10-06T23:30:55.958 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.958 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2023-10-06T23:30:55.958 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:55.958 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:55.958 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:55.958 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 231168, 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 195344 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 0, 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2023-10-06T23:30:55.959 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T23:30:55.960 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T23:30:55.961 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T23:30:55.961 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2023-10-06T23:30:55.961 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-06T23:30:55.961 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_items": 0, 2023-10-06T23:30:55.961 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_bytes": 0, 2023-10-06T23:30:55.961 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_items": 0, 2023-10-06T23:30:55.961 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_bytes": 0, 2023-10-06T23:30:55.961 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_items": 0, 2023-10-06T23:30:55.962 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-06T23:30:55.962 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_items": 0, 2023-10-06T23:30:55.962 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T23:30:55.962 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T23:30:55.962 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T23:30:55.962 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2023-10-06T23:30:55.962 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2023-10-06T23:30:55.963 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2023-10-06T23:30:55.963 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T23:30:55.963 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T23:30:55.963 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2023-10-06T23:30:55.963 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2023-10-06T23:30:55.963 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2023-10-06T23:30:55.963 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2023-10-06T23:30:55.963 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T23:30:55.964 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2023-10-06T23:30:55.964 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T23:30:55.964 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2023-10-06T23:30:55.964 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 148721, 2023-10-06T23:30:55.964 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 30, 2023-10-06T23:30:55.964 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2023-10-06T23:30:55.964 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2023-10-06T23:30:55.964 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T23:30:55.965 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2023-10-06T23:30:55.966 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2023-10-06T23:30:55.966 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2023-10-06T23:30:55.966 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 928, 2023-10-06T23:30:55.966 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 2, 2023-10-06T23:30:55.966 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2023-10-06T23:30:55.966 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2023-10-06T23:30:55.966 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2023-10-06T23:30:55.966 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2023-10-06T23:30:55.967 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-10-06T23:30:55.967 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T23:30:55.967 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2023-10-06T23:30:55.967 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2023-10-06T23:30:55.967 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2023-10-06T23:30:55.967 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 327, 2023-10-06T23:30:55.967 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 185202, 2023-10-06T23:30:55.967 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 327, 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 327, 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 185202, 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2023-10-06T23:30:55.968 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2023-10-06T23:30:55.969 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:55.969 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-10-06T23:30:55.969 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-10-06T23:30:56.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:55 smithi156 ceph-mon[102862]: pgmap v893: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-06T23:30:56.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:55 smithi008 ceph-mon[98532]: pgmap v893: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-06T23:30:56.446 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-10-06T23:30:56.446 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-10-06T23:30:56.446 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2023-10-06T23:30:56.446 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2023-10-06T23:30:56.447 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T23:30:56.465 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T23:30:56.465 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:30:56.465 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-06T23:30:56.522 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:30:56.522 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-06T23:30:56.570 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:30:56.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 -- 172.21.15.8:0/2745261554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb80106ba0 msgr2=0x7fcb80109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 --2- 172.21.15.8:0/2745261554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb80106ba0 0x7fcb80109010 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800b0a0 tx=0x7fcb7800b3b0 comp rx=0 tx=0).stop 2023-10-06T23:30:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 -- 172.21.15.8:0/2745261554 shutdown_connections 2023-10-06T23:30:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 --2- 172.21.15.8:0/2745261554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb80106ba0 0x7fcb80109010 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 --2- 172.21.15.8:0/2745261554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb80101940 0x7fcb80103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 --2- 172.21.15.8:0/2745261554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb80104270 0x7fcb80106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 -- 172.21.15.8:0/2745261554 >> 172.21.15.8:0/2745261554 conn(0x7fcb800fb310 msgr2=0x7fcb800fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 -- 172.21.15.8:0/2745261554 shutdown_connections 2023-10-06T23:30:56.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.818+0000 7fcb883ff700 1 -- 172.21.15.8:0/2745261554 wait complete. 2023-10-06T23:30:56.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.819+0000 7fcb883ff700 1 Processor -- start 2023-10-06T23:30:56.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.819+0000 7fcb883ff700 1 -- start start 2023-10-06T23:30:56.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.819+0000 7fcb883ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb80101940 0x7fcb80198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.819+0000 7fcb883ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb80104270 0x7fcb801992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.819+0000 7fcb883ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb80106ba0 0x7fcb801a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.819+0000 7fcb883ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801a08e0 con 0x7fcb80106ba0 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.819+0000 7fcb883ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801a0a50 con 0x7fcb80104270 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb883ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801a0c10 con 0x7fcb80101940 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8699c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb80106ba0 0x7fcb801a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8619b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb80101940 0x7fcb80198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8599a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb80104270 0x7fcb801992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8619b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb80101940 0x7fcb80198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42562/0 (socket says 172.21.15.8:42562) 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8619b700 1 -- 172.21.15.8:0/3764520900 learned_addr learned my addr 172.21.15.8:0/3764520900 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8699c700 1 -- 172.21.15.8:0/3764520900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb80101940 msgr2=0x7fcb80198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:56.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8699c700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb80101940 0x7fcb80198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8699c700 1 -- 172.21.15.8:0/3764520900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb80104270 msgr2=0x7fcb801992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8699c700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb80104270 0x7fcb801992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8699c700 1 -- 172.21.15.8:0/3764520900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb70009520 con 0x7fcb80106ba0 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.820+0000 7fcb8699c700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb80106ba0 0x7fcb801a0310 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800b070 tx=0x7fcb7800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.821+0000 7fcb777fe700 1 -- 172.21.15.8:0/3764520900 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7800e040 con 0x7fcb80106ba0 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.821+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb78009d00 con 0x7fcb80106ba0 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.821+0000 7fcb777fe700 1 -- 172.21.15.8:0/3764520900 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb78003c00 con 0x7fcb80106ba0 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.821+0000 7fcb777fe700 1 -- 172.21.15.8:0/3764520900 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb78005040 con 0x7fcb80106ba0 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.821+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb801a1180 con 0x7fcb80106ba0 2023-10-06T23:30:56.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.822+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb80108720 con 0x7fcb80106ba0 2023-10-06T23:30:56.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.824+0000 7fcb777fe700 1 -- 172.21.15.8:0/3764520900 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fcb7801d480 con 0x7fcb80106ba0 2023-10-06T23:30:56.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.825+0000 7fcb777fe700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb6c0a14d0 0x7fcb6c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:56.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.825+0000 7fcb777fe700 1 -- 172.21.15.8:0/3764520900 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcb780cdce0 con 0x7fcb80106ba0 2023-10-06T23:30:56.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.825+0000 7fcb8619b700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb6c0a14d0 0x7fcb6c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:56.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.826+0000 7fcb8619b700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb6c0a14d0 0x7fcb6c0a3990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcb8019a270 tx=0x7fcb7c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:56.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:56.830+0000 7fcb777fe700 1 -- 172.21.15.8:0/3764520900 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcb78097380 con 0x7fcb80106ba0 2023-10-06T23:30:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.042+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb8010c550 con 0x7fcb80106ba0 2023-10-06T23:30:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.044+0000 7fcb777fe700 1 -- 172.21.15.8:0/3764520900 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22491 (secure 0 0 0) 0x7fcb7809a9a0 con 0x7fcb80106ba0 2023-10-06T23:30:57.045 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:57.046 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:19:48.224731+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb6c0a14d0 msgr2=0x7fcb6c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb6c0a14d0 0x7fcb6c0a3990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcb8019a270 tx=0x7fcb7c009260 comp rx=0 tx=0).stop 2023-10-06T23:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb80106ba0 msgr2=0x7fcb801a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb80106ba0 0x7fcb801a0310 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800b070 tx=0x7fcb7800bab0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 shutdown_connections 2023-10-06T23:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fcb6c0a14d0 0x7fcb6c0a3990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb80106ba0 0x7fcb801a0310 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb80101940 0x7fcb80198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 --2- 172.21.15.8:0/3764520900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb80104270 0x7fcb801992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 >> 172.21.15.8:0/3764520900 conn(0x7fcb800fb310 msgr2=0x7fcb800fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 shutdown_connections 2023-10-06T23:30:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.046+0000 7fcb883ff700 1 -- 172.21.15.8:0/3764520900 wait complete. 2023-10-06T23:30:57.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:30:57.067 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:30:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 -- 172.21.15.8:0/1495553386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8102a30 msgr2=0x7f68f8109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/1495553386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8102a30 0x7f68f8109350 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f68f000b0a0 tx=0x7f68f000b3b0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 -- 172.21.15.8:0/1495553386 shutdown_connections 2023-10-06T23:30:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/1495553386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8102a30 0x7f68f8109350 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/1495553386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68f8100e90 0x7f68f81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/1495553386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f8102070 0x7f68f81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 -- 172.21.15.8:0/1495553386 >> 172.21.15.8:0/1495553386 conn(0x7f68f80fc430 msgr2=0x7f68f80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 -- 172.21.15.8:0/1495553386 shutdown_connections 2023-10-06T23:30:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.271+0000 7f68fe1ff700 1 -- 172.21.15.8:0/1495553386 wait complete. 2023-10-06T23:30:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.272+0000 7f68fe1ff700 1 Processor -- start 2023-10-06T23:30:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68fe1ff700 1 -- start start 2023-10-06T23:30:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68fe1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8100e90 0x7f68f8196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68fe1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f8102070 0x7f68f8197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68fe1ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68f8102a30 0x7f68f819e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68fe1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f819e770 con 0x7f68f8100e90 2023-10-06T23:30:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68fe1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f819e8b0 con 0x7f68f8102070 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68fe1ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f819ea40 con 0x7f68f8102a30 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8100e90 0x7f68f8196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8100e90 0x7f68f8196bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49570/0 (socket says 172.21.15.8:49570) 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68f77fe700 1 -- 172.21.15.8:0/2814011649 learned_addr learned my addr 172.21.15.8:0/2814011649 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68f6ffd700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f8102070 0x7f68f8197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.273+0000 7f68f7fff700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68f8102a30 0x7f68f819e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f77fe700 1 -- 172.21.15.8:0/2814011649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68f8102a30 msgr2=0x7f68f819e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f77fe700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68f8102a30 0x7f68f819e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f77fe700 1 -- 172.21.15.8:0/2814011649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f8102070 msgr2=0x7f68f8197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f77fe700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f8102070 0x7f68f8197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f77fe700 1 -- 172.21.15.8:0/2814011649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f0009d00 con 0x7f68f8100e90 2023-10-06T23:30:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f6ffd700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f8102070 0x7f68f8197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T23:30:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f7fff700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68f8102a30 0x7f68f819e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T23:30:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f77fe700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8100e90 0x7f68f8196bf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f68e800e970 tx=0x7f68e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f4ff9700 1 -- 172.21.15.8:0/2814011649 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8009790 con 0x7f68f8100e90 2023-10-06T23:30:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f4ff9700 1 -- 172.21.15.8:0/2814011649 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68e80044b0 con 0x7f68f8100e90 2023-10-06T23:30:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f819ed20 con 0x7f68f8100e90 2023-10-06T23:30:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68f4ff9700 1 -- 172.21.15.8:0/2814011649 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8003dd0 con 0x7f68f8100e90 2023-10-06T23:30:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.274+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f819f1d0 con 0x7f68f8100e90 2023-10-06T23:30:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.275+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f81084f0 con 0x7f68f8100e90 2023-10-06T23:30:57.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.277+0000 7f68f4ff9700 1 -- 172.21.15.8:0/2814011649 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f68e8004000 con 0x7f68f8100e90 2023-10-06T23:30:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.278+0000 7f68f4ff9700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68e00a1500 0x7f68e00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.279+0000 7f68f4ff9700 1 -- 172.21.15.8:0/2814011649 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f68e8014070 con 0x7f68f8100e90 2023-10-06T23:30:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.279+0000 7f68f6ffd700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68e00a1500 0x7f68e00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.279+0000 7f68f6ffd700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68e00a1500 0x7f68e00a39c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f68f8100bb0 tx=0x7f68ec009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.283+0000 7f68f4ff9700 1 -- 172.21.15.8:0/2814011649 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f68e80965f0 con 0x7f68f8100e90 2023-10-06T23:30:57.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.494+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68f802d090 con 0x7f68f8100e90 2023-10-06T23:30:57.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.495+0000 7f68f4ff9700 1 -- 172.21.15.8:0/2814011649 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68e8099c10 con 0x7f68f8100e90 2023-10-06T23:30:57.496 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:30:57.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68e00a1500 msgr2=0x7f68e00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68e00a1500 0x7f68e00a39c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f68f8100bb0 tx=0x7f68ec009260 comp rx=0 tx=0).stop 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8100e90 msgr2=0x7f68f8196bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8100e90 0x7f68f8196bf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f68e800e970 tx=0x7f68e800ed30 comp rx=0 tx=0).stop 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 shutdown_connections 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f68e00a1500 0x7f68e00a39c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68f8100e90 0x7f68f8196bf0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68f8102a30 0x7f68f819e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 --2- 172.21.15.8:0/2814011649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68f8102070 0x7f68f8197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 >> 172.21.15.8:0/2814011649 conn(0x7f68f80fc430 msgr2=0x7f68f8105630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 shutdown_connections 2023-10-06T23:30:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.497+0000 7f68fe1ff700 1 -- 172.21.15.8:0/2814011649 wait complete. 2023-10-06T23:30:57.516 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:30:57.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 -- 172.21.15.8:0/279514369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c102070 msgr2=0x7f609c1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 --2- 172.21.15.8:0/279514369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c102070 0x7f609c1024f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f60900098f0 tx=0x7f6090009c00 comp rx=0 tx=0).stop 2023-10-06T23:30:57.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 -- 172.21.15.8:0/279514369 shutdown_connections 2023-10-06T23:30:57.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 --2- 172.21.15.8:0/279514369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f609c100e90 0x7f609c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 --2- 172.21.15.8:0/279514369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f609c102a30 0x7f609c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 --2- 172.21.15.8:0/279514369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c102070 0x7f609c1024f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 -- 172.21.15.8:0/279514369 >> 172.21.15.8:0/279514369 conn(0x7f609c0fc430 msgr2=0x7f609c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:57.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 -- 172.21.15.8:0/279514369 shutdown_connections 2023-10-06T23:30:57.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.722+0000 7f60a25ff700 1 -- 172.21.15.8:0/279514369 wait complete. 2023-10-06T23:30:57.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.723+0000 7f60a25ff700 1 Processor -- start 2023-10-06T23:30:57.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f60a25ff700 1 -- start start 2023-10-06T23:30:57.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f60a25ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c100e90 0x7f609c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:57.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f60a25ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f609c102070 0x7f609c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:57.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f60a25ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f609c102a30 0x7f609c1a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:57.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f60a25ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1a0960 con 0x7f609c102070 2023-10-06T23:30:57.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f60a25ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1a0aa0 con 0x7f609c102a30 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f60a25ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1a0c30 con 0x7f609c100e90 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f609bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c100e90 0x7f609c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f609b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f609c102070 0x7f609c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f609bfff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c100e90 0x7f609c198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42608/0 (socket says 172.21.15.8:42608) 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f609bfff700 1 -- 172.21.15.8:0/1148319357 learned_addr learned my addr 172.21.15.8:0/1148319357 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.724+0000 7f60a0b9c700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f609c102a30 0x7f609c1a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f609bfff700 1 -- 172.21.15.8:0/1148319357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f609c102a30 msgr2=0x7f609c1a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f609bfff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f609c102a30 0x7f609c1a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f609bfff700 1 -- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f609c102070 msgr2=0x7f609c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f609bfff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f609c102070 0x7f609c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f609bfff700 1 -- 172.21.15.8:0/1148319357 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0095f0 con 0x7f609c100e90 2023-10-06T23:30:57.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f609b7fe700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f609c102070 0x7f609c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:57.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f609bfff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c100e90 0x7f609c198de0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f608c00ebf0 tx=0x7f608c00ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:57.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f60997fa700 1 -- 172.21.15.8:0/1148319357 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c009a10 con 0x7f609c100e90 2023-10-06T23:30:57.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f60997fa700 1 -- 172.21.15.8:0/1148319357 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f608c00cc90 con 0x7f609c100e90 2023-10-06T23:30:57.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6090009520 con 0x7f609c100e90 2023-10-06T23:30:57.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f60997fa700 1 -- 172.21.15.8:0/1148319357 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c018680 con 0x7f609c100e90 2023-10-06T23:30:57.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.725+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c1a1220 con 0x7f609c100e90 2023-10-06T23:30:57.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.726+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c10c600 con 0x7f609c100e90 2023-10-06T23:30:57.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.728+0000 7f60997fa700 1 -- 172.21.15.8:0/1148319357 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f608c010430 con 0x7f609c100e90 2023-10-06T23:30:57.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.729+0000 7f60997fa700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f60840a1500 0x7f60840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:57.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.730+0000 7f60997fa700 1 -- 172.21.15.8:0/1148319357 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f608c014070 con 0x7f609c100e90 2023-10-06T23:30:57.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.730+0000 7f609b7fe700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f60840a1500 0x7f60840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:57.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.730+0000 7f609b7fe700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f60840a1500 0x7f60840a39c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6090009fd0 tx=0x7f6090019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:57.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.734+0000 7f60997fa700 1 -- 172.21.15.8:0/1148319357 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f608c0968b0 con 0x7f609c100e90 2023-10-06T23:30:57.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:57 smithi008 ceph-mon[98532]: pgmap v894: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2023-10-06T23:30:57.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:57 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3764520900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:30:57.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:57 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2814011649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:30:57.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.947+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f609c1a15a0 con 0x7f609c100e90 2023-10-06T23:30:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.947+0000 7f60997fa700 1 -- 172.21.15.8:0/1148319357 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f608c099ed0 con 0x7f609c100e90 2023-10-06T23:30:57.949 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:30:57.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f60840a1500 msgr2=0x7f60840a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f60840a1500 0x7f60840a39c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6090009fd0 tx=0x7f6090019040 comp rx=0 tx=0).stop 2023-10-06T23:30:57.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c100e90 msgr2=0x7f609c198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:57.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c100e90 0x7f609c198de0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f608c00ebf0 tx=0x7f608c00ef00 comp rx=0 tx=0).stop 2023-10-06T23:30:57.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 shutdown_connections 2023-10-06T23:30:57.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f60840a1500 0x7f60840a39c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f609c102a30 0x7f609c1a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f609c100e90 0x7f609c198de0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 --2- 172.21.15.8:0/1148319357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f609c102070 0x7f609c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:57.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 >> 172.21.15.8:0/1148319357 conn(0x7f609c0fc430 msgr2=0x7f609c0730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:57.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 shutdown_connections 2023-10-06T23:30:57.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:57.950+0000 7f60a25ff700 1 -- 172.21.15.8:0/1148319357 wait complete. 2023-10-06T23:30:57.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:30:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:57 smithi156 ceph-mon[102862]: pgmap v894: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2023-10-06T23:30:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:57 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3764520900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:30:58.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:57 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2814011649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:30:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 -- 172.21.15.8:0/2844649827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0074ef0 msgr2=0x7f0da0073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 --2- 172.21.15.8:0/2844649827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0074ef0 0x7f0da0073340 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009990 tx=0x7f0d9c009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 -- 172.21.15.8:0/2844649827 shutdown_connections 2023-10-06T23:30:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 --2- 172.21.15.8:0/2844649827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0074ef0 0x7f0da0073340 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 --2- 172.21.15.8:0/2844649827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0da0108da0 0x7f0da010b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 --2- 172.21.15.8:0/2844649827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0da0073910 0x7f0da0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 -- 172.21.15.8:0/2844649827 >> 172.21.15.8:0/2844649827 conn(0x7f0da00fc430 msgr2=0x7f0da00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 -- 172.21.15.8:0/2844649827 shutdown_connections 2023-10-06T23:30:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.174+0000 7f0da85ff700 1 -- 172.21.15.8:0/2844649827 wait complete. 2023-10-06T23:30:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.175+0000 7f0da85ff700 1 Processor -- start 2023-10-06T23:30:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.175+0000 7f0da85ff700 1 -- start start 2023-10-06T23:30:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da85ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0da0073910 0x7f0da0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da85ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0da0074ef0 0x7f0da0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da85ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0108da0 0x7f0da01a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da85ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01a08d0 con 0x7f0da0108da0 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da85ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01a0a10 con 0x7f0da0074ef0 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da85ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01a0ba0 con 0x7f0da0073910 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da639b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0da0073910 0x7f0da0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da6b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0108da0 0x7f0da01a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da5b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0da0074ef0 0x7f0da0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da639b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0da0073910 0x7f0da0198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.8:42614/0 (socket says 172.21.15.8:42614) 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da6b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0108da0 0x7f0da01a0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49598/0 (socket says 172.21.15.8:49598) 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da639b700 1 -- 172.21.15.8:0/1598343176 learned_addr learned my addr 172.21.15.8:0/1598343176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da5b9a700 1 -- 172.21.15.8:0/1598343176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0da0073910 msgr2=0x7f0da0198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da5b9a700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0da0073910 0x7f0da0198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da5b9a700 1 -- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0108da0 msgr2=0x7f0da01a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da5b9a700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0108da0 0x7f0da01a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.176+0000 7f0da5b9a700 1 -- 172.21.15.8:0/1598343176 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c0095f0 con 0x7f0da0074ef0 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.177+0000 7f0da6b9c700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0108da0 0x7f0da01a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.177+0000 7f0da5b9a700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0da0074ef0 0x7f0da0199290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e9c0 tx=0x7f0d9000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.177+0000 7f0d977fe700 1 -- 172.21.15.8:0/1598343176 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90004220 con 0x7f0da0074ef0 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.177+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da01a0e80 con 0x7f0da0074ef0 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.177+0000 7f0d977fe700 1 -- 172.21.15.8:0/1598343176 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d90004380 con 0x7f0da0074ef0 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.177+0000 7f0d977fe700 1 -- 172.21.15.8:0/1598343176 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90003b40 con 0x7f0da0074ef0 2023-10-06T23:30:58.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.177+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da01a1350 con 0x7f0da0074ef0 2023-10-06T23:30:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.178+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da0107450 con 0x7f0da0074ef0 2023-10-06T23:30:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.180+0000 7f0d977fe700 1 -- 172.21.15.8:0/1598343176 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0d90003ca0 con 0x7f0da0074ef0 2023-10-06T23:30:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.182+0000 7f0d977fe700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d8c0a1480 0x7f0d8c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.182+0000 7f0d977fe700 1 -- 172.21.15.8:0/1598343176 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0d90014070 con 0x7f0da0074ef0 2023-10-06T23:30:58.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.182+0000 7f0da639b700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d8c0a1480 0x7f0d8c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:58.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.183+0000 7f0da639b700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d8c0a1480 0x7f0d8c0a3940 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c006010 tx=0x7f0d9c00b260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.187+0000 7f0d977fe700 1 -- 172.21.15.8:0/1598343176 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0d900966e0 con 0x7f0da0074ef0 2023-10-06T23:30:58.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:57 smithi190 ceph-mon[102658]: pgmap v894: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2023-10-06T23:30:58.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:57 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3764520900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:30:58.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:57 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2814011649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:30:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.397+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0da002d1e0 con 0x7f0da0074ef0 2023-10-06T23:30:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.398+0000 7f0d977fe700 1 -- 172.21.15.8:0/1598343176 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d90099d00 con 0x7f0da0074ef0 2023-10-06T23:30:58.399 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:30:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d8c0a1480 msgr2=0x7f0d8c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d8c0a1480 0x7f0d8c0a3940 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c006010 tx=0x7f0d9c00b260 comp rx=0 tx=0).stop 2023-10-06T23:30:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0da0074ef0 msgr2=0x7f0da0199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0da0074ef0 0x7f0da0199290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e9c0 tx=0x7f0d9000ecd0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 shutdown_connections 2023-10-06T23:30:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f0d8c0a1480 0x7f0d8c0a3940 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0da0108da0 0x7f0da01a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0da0073910 0x7f0da0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 --2- 172.21.15.8:0/1598343176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0da0074ef0 0x7f0da0199290 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.400+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 >> 172.21.15.8:0/1598343176 conn(0x7f0da00fc430 msgr2=0x7f0da00fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.401+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 shutdown_connections 2023-10-06T23:30:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.401+0000 7f0da85ff700 1 -- 172.21.15.8:0/1598343176 wait complete. 2023-10-06T23:30:58.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-06T23:30:58.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.622+0000 7f471a9ff700 1 -- 172.21.15.8:0/892747102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4714102070 msgr2=0x7f47141024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.622+0000 7f471a9ff700 1 --2- 172.21.15.8:0/892747102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4714102070 0x7f47141024f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009990 tx=0x7f46fc009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.623+0000 7f471a9ff700 1 -- 172.21.15.8:0/892747102 shutdown_connections 2023-10-06T23:30:58.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.623+0000 7f471a9ff700 1 --2- 172.21.15.8:0/892747102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714100e90 0x7f47141012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.623+0000 7f471a9ff700 1 --2- 172.21.15.8:0/892747102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4714102a30 0x7f4714109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.623+0000 7f471a9ff700 1 --2- 172.21.15.8:0/892747102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4714102070 0x7f47141024f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.623+0000 7f471a9ff700 1 -- 172.21.15.8:0/892747102 >> 172.21.15.8:0/892747102 conn(0x7f47140fc430 msgr2=0x7f47140fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.623+0000 7f471a9ff700 1 -- 172.21.15.8:0/892747102 shutdown_connections 2023-10-06T23:30:58.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.623+0000 7f471a9ff700 1 -- 172.21.15.8:0/892747102 wait complete. 2023-10-06T23:30:58.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f471a9ff700 1 Processor -- start 2023-10-06T23:30:58.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f471a9ff700 1 -- start start 2023-10-06T23:30:58.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f471a9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4714100e90 0x7f4714074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:58.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f471a9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714102070 0x7f47140732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:58.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f471a9ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4714102a30 0x7f47140737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:58.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f471a9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714073f80 con 0x7f4714102070 2023-10-06T23:30:58.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f471a9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140740f0 con 0x7f4714100e90 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f471a9ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141a0b50 con 0x7f4714102a30 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f4713fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714102070 0x7f47140732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f470bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4714100e90 0x7f4714074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.624+0000 7f4713fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714102070 0x7f47140732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49608/0 (socket says 172.21.15.8:49608) 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4718f9c700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4714102a30 0x7f47140737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4713fff700 1 -- 172.21.15.8:0/2291188284 learned_addr learned my addr 172.21.15.8:0/2291188284 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4713fff700 1 -- 172.21.15.8:0/2291188284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4714102a30 msgr2=0x7f47140737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4713fff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4714102a30 0x7f47140737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4713fff700 1 -- 172.21.15.8:0/2291188284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4714100e90 msgr2=0x7f4714074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4713fff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4714100e90 0x7f4714074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4713fff700 1 -- 172.21.15.8:0/2291188284 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0095f0 con 0x7f4714102070 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f470bfff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4714100e90 0x7f4714074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:58.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4713fff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714102070 0x7f47140732a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f46fc005910 tx=0x7f46fc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:58.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.625+0000 7f4711ffb700 1 -- 172.21.15.8:0/2291188284 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc01d070 con 0x7f4714102070 2023-10-06T23:30:58.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.626+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47141a0dd0 con 0x7f4714102070 2023-10-06T23:30:58.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.626+0000 7f4711ffb700 1 -- 172.21.15.8:0/2291188284 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46fc00bdb0 con 0x7f4714102070 2023-10-06T23:30:58.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.626+0000 7f4711ffb700 1 -- 172.21.15.8:0/2291188284 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc022d40 con 0x7f4714102070 2023-10-06T23:30:58.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.626+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47141a11a0 con 0x7f4714102070 2023-10-06T23:30:58.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.627+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47141081f0 con 0x7f4714102070 2023-10-06T23:30:58.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.629+0000 7f4711ffb700 1 -- 172.21.15.8:0/2291188284 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f46fc022470 con 0x7f4714102070 2023-10-06T23:30:58.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.630+0000 7f4711ffb700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47000a1480 0x7f47000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.630+0000 7f4711ffb700 1 -- 172.21.15.8:0/2291188284 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f46fc0ce2a0 con 0x7f4714102070 2023-10-06T23:30:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.630+0000 7f470bfff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47000a1480 0x7f47000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.631+0000 7f470bfff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47000a1480 0x7f47000a3940 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4714101be0 tx=0x7f4704009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:58.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.634+0000 7f4711ffb700 1 -- 172.21.15.8:0/2291188284 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f46fc097940 con 0x7f4714102070 2023-10-06T23:30:58.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.867+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f471410c600 con 0x7f4714102070 2023-10-06T23:30:58.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.867+0000 7f4711ffb700 1 -- 172.21.15.8:0/2291188284 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+579 (secure 0 0 0) 0x7f46fc09af60 con 0x7f4714102070 2023-10-06T23:30:58.869 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2416919540 2023-10-07T23:03:48.853244+0000 2023-10-06T23:30:58.869 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/297059453 2023-10-07T23:03:48.853244+0000 2023-10-06T23:30:58.869 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2948074146 2023-10-07T23:03:21.609864+0000 2023-10-06T23:30:58.869 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2416919540 2023-10-07T23:03:48.853244+0000 2023-10-06T23:30:58.869 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3650897985 2023-10-07T23:03:21.609864+0000 2023-10-06T23:30:58.869 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2349179296 2023-10-07T23:03:48.853244+0000 2023-10-06T23:30:58.869 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/166376639 2023-10-07T23:03:21.609864+0000 2023-10-06T23:30:58.870 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/166376639 2023-10-07T23:03:21.609864+0000 2023-10-06T23:30:58.870 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2680339710 2023-10-07T23:03:21.609864+0000 2023-10-06T23:30:58.870 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2455618842 2023-10-07T23:03:48.853244+0000 2023-10-06T23:30:58.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47000a1480 msgr2=0x7f47000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47000a1480 0x7f47000a3940 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4714101be0 tx=0x7f4704009260 comp rx=0 tx=0).stop 2023-10-06T23:30:58.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714102070 msgr2=0x7f47140732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:58.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714102070 0x7f47140732a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f46fc005910 tx=0x7f46fc005740 comp rx=0 tx=0).stop 2023-10-06T23:30:58.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 shutdown_connections 2023-10-06T23:30:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f47000a1480 0x7f47000a3940 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4714102a30 0x7f47140737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4714100e90 0x7f4714074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 --2- 172.21.15.8:0/2291188284 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4714102070 0x7f47140732a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 >> 172.21.15.8:0/2291188284 conn(0x7f47140fc430 msgr2=0x7f4714105330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 shutdown_connections 2023-10-06T23:30:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:58.870+0000 7f471a9ff700 1 -- 172.21.15.8:0/2291188284 wait complete. 2023-10-06T23:30:58.872 INFO:teuthology.orchestra.run.smithi008.stderr:listed 10 entries 2023-10-06T23:30:58.889 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-06T23:30:58.889 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-06T23:30:58.933 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T23:30:59.082 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:58 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1148319357' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:30:59.082 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:58 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1598343176' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:30:59.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:58 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1148319357' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:30:59.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:58 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1598343176' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:30:59.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:58 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1148319357' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:30:59.512 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:58 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1598343176' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:30:59.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 -- 172.21.15.8:0/3962713041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea54102080 msgr2=0x7fea54102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:59.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 --2- 172.21.15.8:0/3962713041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea54102080 0x7fea54102500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fea480098f0 tx=0x7fea48009c00 comp rx=0 tx=0).stop 2023-10-06T23:30:59.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 -- 172.21.15.8:0/3962713041 shutdown_connections 2023-10-06T23:30:59.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 --2- 172.21.15.8:0/3962713041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea54102a40 0x7fea54109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 --2- 172.21.15.8:0/3962713041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea54100ea0 0x7fea541012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 --2- 172.21.15.8:0/3962713041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea54102080 0x7fea54102500 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 -- 172.21.15.8:0/3962713041 >> 172.21.15.8:0/3962713041 conn(0x7fea540fc420 msgr2=0x7fea540fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:59.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 -- 172.21.15.8:0/3962713041 shutdown_connections 2023-10-06T23:30:59.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.225+0000 7fea59dff700 1 -- 172.21.15.8:0/3962713041 wait complete. 2023-10-06T23:30:59.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea59dff700 1 Processor -- start 2023-10-06T23:30:59.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea59dff700 1 -- start start 2023-10-06T23:30:59.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea59dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea54100ea0 0x7fea54198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:59.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea59dff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea54102080 0x7fea541992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:59.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea59dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea54102a40 0x7fea541a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:59.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea59dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea541a08e0 con 0x7fea54100ea0 2023-10-06T23:30:59.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea59dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea541a0a50 con 0x7fea54102a40 2023-10-06T23:30:59.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea59dff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea541a0c10 con 0x7fea54102080 2023-10-06T23:30:59.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.226+0000 7fea537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea54100ea0 0x7fea54198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:59.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea54100ea0 0x7fea54198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49626/0 (socket says 172.21.15.8:49626) 2023-10-06T23:30:59.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea537fe700 1 -- 172.21.15.8:0/2399897192 learned_addr learned my addr 172.21.15.8:0/2399897192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:59.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea53fff700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea54102a40 0x7fea541a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:59.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea52ffd700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea54102080 0x7fea541992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:59.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea537fe700 1 -- 172.21.15.8:0/2399897192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea54102080 msgr2=0x7fea541992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:59.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea537fe700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea54102080 0x7fea541992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea537fe700 1 -- 172.21.15.8:0/2399897192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea54102a40 msgr2=0x7fea541a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:59.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea537fe700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea54102a40 0x7fea541a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea537fe700 1 -- 172.21.15.8:0/2399897192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c009d00 con 0x7fea54100ea0 2023-10-06T23:30:59.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea537fe700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea54100ea0 0x7fea54198da0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fea4400e970 tx=0x7fea4400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:59.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea50ff9700 1 -- 172.21.15.8:0/2399897192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44009790 con 0x7fea54100ea0 2023-10-06T23:30:59.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea48009520 con 0x7fea54100ea0 2023-10-06T23:30:59.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea50ff9700 1 -- 172.21.15.8:0/2399897192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea4400c7e0 con 0x7fea54100ea0 2023-10-06T23:30:59.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.227+0000 7fea50ff9700 1 -- 172.21.15.8:0/2399897192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44003bd0 con 0x7fea54100ea0 2023-10-06T23:30:59.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.228+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea541a1200 con 0x7fea54100ea0 2023-10-06T23:30:59.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.228+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5410c610 con 0x7fea54100ea0 2023-10-06T23:30:59.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.231+0000 7fea50ff9700 1 -- 172.21.15.8:0/2399897192 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fea4400c950 con 0x7fea54100ea0 2023-10-06T23:30:59.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.232+0000 7fea50ff9700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fea3c0a14d0 0x7fea3c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:59.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.232+0000 7fea50ff9700 1 -- 172.21.15.8:0/2399897192 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fea44014070 con 0x7fea54100ea0 2023-10-06T23:30:59.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.232+0000 7fea52ffd700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fea3c0a14d0 0x7fea3c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:59.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.233+0000 7fea52ffd700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fea3c0a14d0 0x7fea3c0a3990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fea48009fd0 tx=0x7fea48019040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:59.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.234+0000 7fea50ff9700 1 -- 172.21.15.8:0/2399897192 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fea44096620 con 0x7fea54100ea0 2023-10-06T23:30:59.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.450+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea5410c7d0 con 0x7fea54100ea0 2023-10-06T23:30:59.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.451+0000 7fea50ff9700 1 -- 172.21.15.8:0/2399897192 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22491 (secure 0 0 0) 0x7fea440a0070 con 0x7fea54100ea0 2023-10-06T23:30:59.525 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-06T23:30:59.525 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":89,"fsid":"5a0d88f6-649c-11ee-8db5-212e2dc638e7","created":"2023-10-06T23:02:51.456001+0000","modified":"2023-10-06T23:19:48.224731+0000","last_up_change":"2023-10-06T23:10:20.878768+0000","last_in_change":"2023-10-06T23:10:00.398353+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T23:06:23.471377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-06T23:11:16.130653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-06T23:11:17.230928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33d4e1c7-0b0f-46e0-a24f-4f9e4a5b87fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6803","nonce":36091553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6805","nonce":36091553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6809","nonce":36091553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36091553},{"type":"v1","addr":"172.21.15.8:6807","nonce":36091553}]},"public_addr":"172.21.15.8:6803/36091553","cluster_addr":"172.21.15.8:6805/36091553","heartbeat_back_addr":"172.21.15.8:6809/36091553","heartbeat_front_addr":"172.21.15.8:6807/36091553","state":["exists","up"]},{"osd":1,"uuid":"f340f2e0-7165-45d3-9222-f55119169cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6801","nonce":2428171530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6803","nonce":2428171530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6807","nonce":2428171530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2428171530},{"type":"v1","addr":"172.21.15.156:6805","nonce":2428171530}]},"public_addr":"172.21.15.156:6801/2428171530","cluster_addr":"172.21.15.156:6803/2428171530","heartbeat_back_addr":"172.21.15.156:6807/2428171530","heartbeat_front_addr":"172.21.15.156:6805/2428171530","state":["exists","up"]},{"osd":2,"uuid":"0986122c-3438-4e4e-bad5-857c27371b25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6801","nonce":2202331729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6803","nonce":2202331729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6807","nonce":2202331729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":2202331729},{"type":"v1","addr":"172.21.15.190:6805","nonce":2202331729}]},"public_addr":"172.21.15.190:6801/2202331729","cluster_addr":"172.21.15.190:6803/2202331729","heartbeat_back_addr":"172.21.15.190:6807/2202331729","heartbeat_front_addr":"172.21.15.190:6805/2202331729","state":["exists","up"]},{"osd":3,"uuid":"956d60a4-72e7-4072-8e10-396101b01a36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6811","nonce":322809496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6813","nonce":322809496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6817","nonce":322809496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":322809496},{"type":"v1","addr":"172.21.15.8:6815","nonce":322809496}]},"public_addr":"172.21.15.8:6811/322809496","cluster_addr":"172.21.15.8:6813/322809496","heartbeat_back_addr":"172.21.15.8:6817/322809496","heartbeat_front_addr":"172.21.15.8:6815/322809496","state":["exists","up"]},{"osd":4,"uuid":"f7560640-14b6-458a-adfe-dae3821de4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6809","nonce":2478764015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6811","nonce":2478764015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6815","nonce":2478764015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2478764015},{"type":"v1","addr":"172.21.15.156:6813","nonce":2478764015}]},"public_addr":"172.21.15.156:6809/2478764015","cluster_addr":"172.21.15.156:6811/2478764015","heartbeat_back_addr":"172.21.15.156:6815/2478764015","heartbeat_front_addr":"172.21.15.156:6813/2478764015","state":["exists","up"]},{"osd":5,"uuid":"7c9e854b-52ad-4f73-a354-e0ca49b57389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6809","nonce":2047362324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6811","nonce":2047362324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6815","nonce":2047362324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2047362324},{"type":"v1","addr":"172.21.15.190:6813","nonce":2047362324}]},"public_addr":"172.21.15.190:6809/2047362324","cluster_addr":"172.21.15.190:6811/2047362324","heartbeat_back_addr":"172.21.15.190:6815/2047362324","heartbeat_front_addr":"172.21.15.190:6813/2047362324","state":["exists","up"]},{"osd":6,"uuid":"2d19254b-4665-4044-806b-2db2a15ece1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6819","nonce":1054185701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6821","nonce":1054185701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6825","nonce":1054185701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":1054185701},{"type":"v1","addr":"172.21.15.8:6823","nonce":1054185701}]},"public_addr":"172.21.15.8:6819/1054185701","cluster_addr":"172.21.15.8:6821/1054185701","heartbeat_back_addr":"172.21.15.8:6825/1054185701","heartbeat_front_addr":"172.21.15.8:6823/1054185701","state":["exists","up"]},{"osd":7,"uuid":"0631aa31-44e8-4f3b-8306-b7c9d5a64d02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6817","nonce":3888485282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6819","nonce":3888485282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6823","nonce":3888485282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":3888485282},{"type":"v1","addr":"172.21.15.156:6821","nonce":3888485282}]},"public_addr":"172.21.15.156:6817/3888485282","cluster_addr":"172.21.15.156:6819/3888485282","heartbeat_back_addr":"172.21.15.156:6823/3888485282","heartbeat_front_addr":"172.21.15.156:6821/3888485282","state":["exists","up"]},{"osd":8,"uuid":"491859be-3372-46a8-be19-6b70bee94107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6817","nonce":1600949484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6819","nonce":1600949484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6823","nonce":1600949484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1600949484},{"type":"v1","addr":"172.21.15.190:6821","nonce":1600949484}]},"public_addr":"172.21.15.190:6817/1600949484","cluster_addr":"172.21.15.190:6819/1600949484","heartbeat_back_addr":"172.21.15.190:6823/1600949484","heartbeat_front_addr":"172.21.15.190:6821/1600949484","state":["exists","up"]},{"osd":9,"uuid":"4ed52c56-1603-45a4-b9dd-aa6c07d0181c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6827","nonce":3250757826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6829","nonce":3250757826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6833","nonce":3250757826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3250757826},{"type":"v1","addr":"172.21.15.8:6831","nonce":3250757826}]},"public_addr":"172.21.15.8:6827/3250757826","cluster_addr":"172.21.15.8:6829/3250757826","heartbeat_back_addr":"172.21.15.8:6833/3250757826","heartbeat_front_addr":"172.21.15.8:6831/3250757826","state":["exists","up"]},{"osd":10,"uuid":"8f6af790-47f8-4faf-80de-d04e11236910","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6825","nonce":3857289859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6827","nonce":3857289859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6831","nonce":3857289859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3857289859},{"type":"v1","addr":"172.21.15.156:6829","nonce":3857289859}]},"public_addr":"172.21.15.156:6825/3857289859","cluster_addr":"172.21.15.156:6827/3857289859","heartbeat_back_addr":"172.21.15.156:6831/3857289859","heartbeat_front_addr":"172.21.15.156:6829/3857289859","state":["exists","up"]},{"osd":11,"uuid":"d7d0e66f-912f-4088-bf84-ef021b8a2883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6825","nonce":2460808720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6827","nonce":2460808720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6831","nonce":2460808720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2460808720},{"type":"v1","addr":"172.21.15.190:6829","nonce":2460808720}]},"public_addr":"172.21.15.190:6825/2460808720","cluster_addr":"172.21.15.190:6827/2460808720","heartbeat_back_addr":"172.21.15.190:6831/2460808720","heartbeat_front_addr":"172.21.15.190:6829/2460808720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:27.411019+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:05:53.930654+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:20.242042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:06:46.957911+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:13.438907+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:07:39.719311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:06.446018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:32.424484+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:08:58.774578+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:25.968325+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:09:52.571282+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T23:10:19.116652+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6801/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/297059453":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/2948074146":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6800/2416919540":"2023-10-07T23:03:48.853244+0000","172.21.15.8:0/3650897985":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2349179296":"2023-10-07T23:03:48.853244+0000","172.21.15.8:6800/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:6801/166376639":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2680339710":"2023-10-07T23:03:21.609864+0000","172.21.15.8:0/2455618842":"2023-10-07T23:03:48.853244+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T23:30:59.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fea3c0a14d0 msgr2=0x7fea3c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:59.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fea3c0a14d0 0x7fea3c0a3990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fea48009fd0 tx=0x7fea48019040 comp rx=0 tx=0).stop 2023-10-06T23:30:59.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea54100ea0 msgr2=0x7fea54198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:59.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea54100ea0 0x7fea54198da0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fea4400e970 tx=0x7fea4400ec80 comp rx=0 tx=0).stop 2023-10-06T23:30:59.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 shutdown_connections 2023-10-06T23:30:59.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fea3c0a14d0 0x7fea3c0a3990 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea54100ea0 0x7fea54198da0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea54102a40 0x7fea541a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 --2- 172.21.15.8:0/2399897192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea54102080 0x7fea541992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 >> 172.21.15.8:0/2399897192 conn(0x7fea540fc420 msgr2=0x7fea540fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:59.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 shutdown_connections 2023-10-06T23:30:59.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.454+0000 7fea59dff700 1 -- 172.21.15.8:0/2399897192 wait complete. 2023-10-06T23:30:59.530 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T23:06:23.471377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T23:11:16.130653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T23:11:17.230928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-06T23:30:59.664 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T23:30:59.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:59 smithi008 ceph-mon[98532]: pgmap v895: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:30:59.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:59 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2291188284' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-06T23:30:59.726 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:30:59 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/2399897192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:30:59.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 -- 172.21.15.8:0/3990197820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 msgr2=0x7fa3b01024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:59.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/3990197820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 0x7fa3b01024f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009990 tx=0x7fa3a4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 -- 172.21.15.8:0/3990197820 shutdown_connections 2023-10-06T23:30:59.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/3990197820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3b0102a30 0x7fa3b0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/3990197820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b0100e90 0x7fa3b01012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/3990197820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 0x7fa3b01024f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 -- 172.21.15.8:0/3990197820 >> 172.21.15.8:0/3990197820 conn(0x7fa3b00fc430 msgr2=0x7fa3b00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:30:59.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 -- 172.21.15.8:0/3990197820 shutdown_connections 2023-10-06T23:30:59.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.870+0000 7fa3b57ff700 1 -- 172.21.15.8:0/3990197820 wait complete. 2023-10-06T23:30:59.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.871+0000 7fa3b57ff700 1 Processor -- start 2023-10-06T23:30:59.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.871+0000 7fa3b57ff700 1 -- start start 2023-10-06T23:30:59.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3b57ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b0100e90 0x7fa3b0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:59.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3b57ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 0x7fa3b01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:59.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3b57ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3b0102a30 0x7fa3b01a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:59.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3b57ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01a08e0 con 0x7fa3b0102070 2023-10-06T23:30:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3b57ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01a0a20 con 0x7fa3b0102a30 2023-10-06T23:30:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3b57ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01a0bb0 con 0x7fa3b0100e90 2023-10-06T23:30:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3ae7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 0x7fa3b01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3af7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3b0102a30 0x7fa3b01a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3aeffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b0100e90 0x7fa3b0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3af7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3b0102a30 0x7fa3b01a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.8:33266/0 (socket says 172.21.15.8:33266) 2023-10-06T23:30:59.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3af7fe700 1 -- 172.21.15.8:0/292494218 learned_addr learned my addr 172.21.15.8:0/292494218 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:30:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3ae7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 0x7fa3b01992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48110/0 (socket says 172.21.15.8:48110) 2023-10-06T23:30:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3af7fe700 1 -- 172.21.15.8:0/292494218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b0100e90 msgr2=0x7fa3b0198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3af7fe700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b0100e90 0x7fa3b0198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3af7fe700 1 -- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 msgr2=0x7fa3b01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:30:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3af7fe700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 0x7fa3b01992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:30:59.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3af7fe700 1 -- 172.21.15.8:0/292494218 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40095f0 con 0x7fa3b0102a30 2023-10-06T23:30:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3aeffd700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b0100e90 0x7fa3b0198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.872+0000 7fa3ae7fc700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 0x7fa3b01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:30:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.873+0000 7fa3af7fe700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3b0102a30 0x7fa3b01a0310 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800ef30 tx=0x7fa3a800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.873+0000 7fa397fff700 1 -- 172.21.15.8:0/292494218 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8018070 con 0x7fa3b0102a30 2023-10-06T23:30:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.873+0000 7fa397fff700 1 -- 172.21.15.8:0/292494218 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3a800f040 con 0x7fa3b0102a30 2023-10-06T23:30:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.873+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b01a0e30 con 0x7fa3b0102a30 2023-10-06T23:30:59.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.873+0000 7fa397fff700 1 -- 172.21.15.8:0/292494218 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800cbc0 con 0x7fa3b0102a30 2023-10-06T23:30:59.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.873+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b01a1260 con 0x7fa3b0102a30 2023-10-06T23:30:59.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.874+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b01933a0 con 0x7fa3b0102a30 2023-10-06T23:30:59.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.877+0000 7fa397fff700 1 -- 172.21.15.8:0/292494218 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa3a8003a00 con 0x7fa3b0102a30 2023-10-06T23:30:59.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.878+0000 7fa397fff700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa3980a1480 0x7fa3980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:30:59.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.878+0000 7fa397fff700 1 -- 172.21.15.8:0/292494218 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa3a80ccdf0 con 0x7fa3b0102a30 2023-10-06T23:30:59.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.878+0000 7fa3aeffd700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa3980a1480 0x7fa3980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:30:59.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.879+0000 7fa3aeffd700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa3980a1480 0x7fa3980a3940 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0101be0 tx=0x7fa3a0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:30:59.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:30:59.883+0000 7fa397fff700 1 -- 172.21.15.8:0/292494218 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa3a8096490 con 0x7fa3b0102a30 2023-10-06T23:31:00.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.097+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3b010c740 con 0x7fa3b0102a30 2023-10-06T23:31:00.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:59 smithi156 ceph-mon[102862]: pgmap v895: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:31:00.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:59 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2291188284' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-06T23:31:00.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:30:59 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/2399897192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:31:00.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.098+0000 7fa397fff700 1 -- 172.21.15.8:0/292494218 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3a8003cb0 con 0x7fa3b0102a30 2023-10-06T23:31:00.100 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-06T23:31:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa3980a1480 msgr2=0x7fa3980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa3980a1480 0x7fa3980a3940 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0101be0 tx=0x7fa3a0009260 comp rx=0 tx=0).stop 2023-10-06T23:31:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3b0102a30 msgr2=0x7fa3b01a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3b0102a30 0x7fa3b01a0310 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800ef30 tx=0x7fa3a800c3a0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 shutdown_connections 2023-10-06T23:31:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7fa3980a1480 0x7fa3980a3940 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3b0102a30 0x7fa3b01a0310 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b0100e90 0x7fa3b0198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 --2- 172.21.15.8:0/292494218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3b0102070 0x7fa3b01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.100+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 >> 172.21.15.8:0/292494218 conn(0x7fa3b00fc430 msgr2=0x7fa3b0107b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:31:00.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.101+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 shutdown_connections 2023-10-06T23:31:00.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.101+0000 7fa3b57ff700 1 -- 172.21.15.8:0/292494218 wait complete. 2023-10-06T23:31:00.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T23:31:00.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:59 smithi190 ceph-mon[102658]: pgmap v895: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-10-06T23:31:00.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:59 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2291188284' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-06T23:31:00.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:30:59 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/2399897192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-06T23:31:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/3634288684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb8100e90 msgr2=0x7f1cb81012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/3634288684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb8100e90 0x7f1cb81012b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009990 tx=0x7f1cb4009ca0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/3634288684 shutdown_connections 2023-10-06T23:31:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/3634288684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb8102a30 0x7f1cb8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/3634288684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb8100e90 0x7f1cb81012b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/3634288684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cb8102070 0x7f1cb81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/3634288684 >> 172.21.15.8:0/3634288684 conn(0x7f1cb80fc430 msgr2=0x7f1cb80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:31:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/3634288684 shutdown_connections 2023-10-06T23:31:00.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.325+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/3634288684 wait complete. 2023-10-06T23:31:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.326+0000 7f1cbf7ff700 1 Processor -- start 2023-10-06T23:31:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbf7ff700 1 -- start start 2023-10-06T23:31:00.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbf7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb8100e90 0x7f1cb8198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbf7ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cb8102070 0x7f1cb8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbf7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb8102a30 0x7f1cb81a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbf7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb81a0890 con 0x7f1cb8102a30 2023-10-06T23:31:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbf7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb81a0a00 con 0x7f1cb8100e90 2023-10-06T23:31:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbf7ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb81a0bc0 con 0x7f1cb8102070 2023-10-06T23:31:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbdd9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb8102a30 0x7f1cb81a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbdd9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb8102a30 0x7f1cb81a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48134/0 (socket says 172.21.15.8:48134) 2023-10-06T23:31:00.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbdd9c700 1 -- 172.21.15.8:0/1148230164 learned_addr learned my addr 172.21.15.8:0/1148230164 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:31:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbd59b700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb8100e90 0x7f1cb8198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbcd9a700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cb8102070 0x7f1cb8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbdd9c700 1 -- 172.21.15.8:0/1148230164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cb8102070 msgr2=0x7f1cb8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.327+0000 7f1cbdd9c700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cb8102070 0x7f1cb8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cbdd9c700 1 -- 172.21.15.8:0/1148230164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb8100e90 msgr2=0x7f1cb8198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cbdd9c700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb8100e90 0x7f1cb8198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cbdd9c700 1 -- 172.21.15.8:0/1148230164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40095f0 con 0x7f1cb8102a30 2023-10-06T23:31:00.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cbdd9c700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb8102a30 0x7f1cb81a02c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000ef30 tx=0x7f1cb000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:31:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cae7fc700 1 -- 172.21.15.8:0/1148230164 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0018070 con 0x7f1cb8102a30 2023-10-06T23:31:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb81a0e40 con 0x7f1cb8102a30 2023-10-06T23:31:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cae7fc700 1 -- 172.21.15.8:0/1148230164 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cb000f040 con 0x7f1cb8102a30 2023-10-06T23:31:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cae7fc700 1 -- 172.21.15.8:0/1148230164 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000cbc0 con 0x7f1cb8102a30 2023-10-06T23:31:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.328+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb81a1260 con 0x7f1cb8102a30 2023-10-06T23:31:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.329+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb81933a0 con 0x7f1cb8102a30 2023-10-06T23:31:00.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.331+0000 7f1cae7fc700 1 -- 172.21.15.8:0/1148230164 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1cb0003a00 con 0x7f1cb8102a30 2023-10-06T23:31:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.332+0000 7f1cae7fc700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ca40a1500 0x7f1ca40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.333+0000 7f1cae7fc700 1 -- 172.21.15.8:0/1148230164 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1cb00ccd50 con 0x7f1cb8102a30 2023-10-06T23:31:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.333+0000 7f1cbd59b700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ca40a1500 0x7f1ca40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:00.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.334+0000 7f1cbd59b700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ca40a1500 0x7f1ca40a39c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4006010 tx=0x7f1cb4005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:31:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.335+0000 7f1cae7fc700 1 -- 172.21.15.8:0/1148230164 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1cb00963f0 con 0x7f1cb8102a30 2023-10-06T23:31:00.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.545+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1cb802cf70 con 0x7f1cb8102a30 2023-10-06T23:31:00.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.546+0000 7f1cae7fc700 1 -- 172.21.15.8:0/1148230164 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1cb0003cb0 con 0x7f1cb8102a30 2023-10-06T23:31:00.548 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ca40a1500 msgr2=0x7f1ca40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ca40a1500 0x7f1ca40a39c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4006010 tx=0x7f1cb4005960 comp rx=0 tx=0).stop 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb8102a30 msgr2=0x7f1cb81a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb8102a30 0x7f1cb81a02c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000ef30 tx=0x7f1cb000c3a0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 shutdown_connections 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f1ca40a1500 0x7f1ca40a39c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb8102a30 0x7f1cb81a02c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb8100e90 0x7f1cb8198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 --2- 172.21.15.8:0/1148230164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cb8102070 0x7f1cb8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 >> 172.21.15.8:0/1148230164 conn(0x7f1cb80fc430 msgr2=0x7f1cb8107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:31:00.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.548+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 shutdown_connections 2023-10-06T23:31:00.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.549+0000 7f1cbf7ff700 1 -- 172.21.15.8:0/1148230164 wait complete. 2023-10-06T23:31:00.568 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T23:31:00.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.774+0000 7f11af5ff700 1 -- 172.21.15.8:0/2751641067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 msgr2=0x7f11a81024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.774+0000 7f11af5ff700 1 --2- 172.21.15.8:0/2751641067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a81024f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1198009990 tx=0x7f1198009ca0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.774+0000 7f11af5ff700 1 -- 172.21.15.8:0/2751641067 shutdown_connections 2023-10-06T23:31:00.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.774+0000 7f11af5ff700 1 --2- 172.21.15.8:0/2751641067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8102a30 0x7f11a8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.774+0000 7f11af5ff700 1 --2- 172.21.15.8:0/2751641067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8100e90 0x7f11a81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.774+0000 7f11af5ff700 1 --2- 172.21.15.8:0/2751641067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8102070 0x7f11a81024f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.774+0000 7f11af5ff700 1 -- 172.21.15.8:0/2751641067 >> 172.21.15.8:0/2751641067 conn(0x7f11a80fc430 msgr2=0x7f11a80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:31:00.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.775+0000 7f11af5ff700 1 -- 172.21.15.8:0/2751641067 shutdown_connections 2023-10-06T23:31:00.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.775+0000 7f11af5ff700 1 -- 172.21.15.8:0/2751641067 wait complete. 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.775+0000 7f11af5ff700 1 Processor -- start 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11af5ff700 1 -- start start 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11af5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11af5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102070 0x7f11a8197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11af5ff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8102a30 0x7f11a819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11af5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a819e6d0 con 0x7f11a8100e90 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11af5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a819e810 con 0x7f11a8102070 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11af5ff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a819e9a0 con 0x7f11a8102a30 2023-10-06T23:31:00.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11ad39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11acb9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102070 0x7f11a8197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11ad39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48148/0 (socket says 172.21.15.8:48148) 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11ad39b700 1 -- 172.21.15.8:0/3568130364 learned_addr learned my addr 172.21.15.8:0/3568130364 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.776+0000 7f11adb9c700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8102a30 0x7f11a819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11acb9a700 1 -- 172.21.15.8:0/3568130364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8102a30 msgr2=0x7f11a819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11acb9a700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8102a30 0x7f11a819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11acb9a700 1 -- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8100e90 msgr2=0x7f11a8196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11acb9a700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11acb9a700 1 -- 172.21.15.8:0/3568130364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980095f0 con 0x7f11a8102070 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11ad39b700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11acb9a700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102070 0x7f11a8197090 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1198000c00 tx=0x7f1198005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:31:00.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f119e7fc700 1 -- 172.21.15.8:0/3568130364 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119801d070 con 0x7f11a8102070 2023-10-06T23:31:00.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f119e7fc700 1 -- 172.21.15.8:0/3568130364 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f119800bdb0 con 0x7f11a8102070 2023-10-06T23:31:00.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a819ec20 con 0x7f11a8102070 2023-10-06T23:31:00.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f119e7fc700 1 -- 172.21.15.8:0/3568130364 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198022d40 con 0x7f11a8102070 2023-10-06T23:31:00.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.777+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a819f040 con 0x7f11a8102070 2023-10-06T23:31:00.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.778+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a8107f20 con 0x7f11a8102070 2023-10-06T23:31:00.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.780+0000 7f119e7fc700 1 -- 172.21.15.8:0/3568130364 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1198022470 con 0x7f11a8102070 2023-10-06T23:31:00.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.782+0000 7f119e7fc700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11940a1480 0x7f11940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:00.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.782+0000 7f119e7fc700 1 -- 172.21.15.8:0/3568130364 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f11980ce3f0 con 0x7f11a8102070 2023-10-06T23:31:00.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.782+0000 7f11ad39b700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11940a1480 0x7f11940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:00.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.783+0000 7f11ad39b700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11940a1480 0x7f11940a3940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f11a4005950 tx=0x7f11a4009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:31:00.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.787+0000 7f119e7fc700 1 -- 172.21.15.8:0/3568130364 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1198097a90 con 0x7f11a8102070 2023-10-06T23:31:00.895 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:00 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/292494218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:31:00.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:00 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/1148230164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:31:00.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.997+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11a802d020 con 0x7f11a8102070 2023-10-06T23:31:00.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:00.997+0000 7f119e7fc700 1 -- 172.21.15.8:0/3568130364 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f119809b0b0 con 0x7f11a8102070 2023-10-06T23:31:00.999 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-06T23:31:01.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11940a1480 msgr2=0x7f11940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:01.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11940a1480 0x7f11940a3940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f11a4005950 tx=0x7f11a4009260 comp rx=0 tx=0).stop 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102070 msgr2=0x7f11a8197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102070 0x7f11a8197090 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1198000c00 tx=0x7f1198005740 comp rx=0 tx=0).stop 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 shutdown_connections 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f11940a1480 0x7f11940a3940 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11a8100e90 0x7f11a8196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a8102a30 0x7f11a819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 --2- 172.21.15.8:0/3568130364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11a8102070 0x7f11a8197090 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 >> 172.21.15.8:0/3568130364 conn(0x7f11a80fc430 msgr2=0x7f11a80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 shutdown_connections 2023-10-06T23:31:01.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.000+0000 7f11af5ff700 1 -- 172.21.15.8:0/3568130364 wait complete. 2023-10-06T23:31:01.019 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-06T23:31:01.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:00 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/292494218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:31:01.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:00 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/1148230164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:31:01.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:00 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/292494218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-06T23:31:01.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:00 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/1148230164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-06T23:31:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.220+0000 7f31c7fff700 1 -- 172.21.15.8:0/509050446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0100ea0 msgr2=0x7f31c01012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.220+0000 7f31c7fff700 1 --2- 172.21.15.8:0/509050446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0100ea0 0x7f31c01012c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0098f0 tx=0x7f31bc009c00 comp rx=0 tx=0).stop 2023-10-06T23:31:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.220+0000 7f31c7fff700 1 -- 172.21.15.8:0/509050446 shutdown_connections 2023-10-06T23:31:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.220+0000 7f31c7fff700 1 --2- 172.21.15.8:0/509050446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31c0102a40 0x7f31c0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.220+0000 7f31c7fff700 1 --2- 172.21.15.8:0/509050446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0100ea0 0x7f31c01012c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.220+0000 7f31c7fff700 1 --2- 172.21.15.8:0/509050446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31c0102080 0x7f31c0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.220+0000 7f31c7fff700 1 -- 172.21.15.8:0/509050446 >> 172.21.15.8:0/509050446 conn(0x7f31c00fc460 msgr2=0x7f31c00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:31:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.221+0000 7f31c7fff700 1 -- 172.21.15.8:0/509050446 shutdown_connections 2023-10-06T23:31:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.221+0000 7f31c7fff700 1 -- 172.21.15.8:0/509050446 wait complete. 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.221+0000 7f31c7fff700 1 Processor -- start 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c7fff700 1 -- start start 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31c0100ea0 0x7f31c0074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31c0102080 0x7f31c00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0102a40 0x7f31c00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c7fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0073f80 con 0x7f31c0100ea0 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00740f0 con 0x7f31c0102a40 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c7fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01a0c50 con 0x7f31c0102080 2023-10-06T23:31:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31c0100ea0 0x7f31c0074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c559a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31c0102080 0x7f31c00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31c0100ea0 0x7f31c0074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48164/0 (socket says 172.21.15.8:48164) 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c5d9b700 1 -- 172.21.15.8:0/3237868564 learned_addr learned my addr 172.21.15.8:0/3237868564 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.222+0000 7f31c659c700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0102a40 0x7f31c00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c5d9b700 1 -- 172.21.15.8:0/3237868564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31c0102080 msgr2=0x7f31c00732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c5d9b700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31c0102080 0x7f31c00732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c5d9b700 1 -- 172.21.15.8:0/3237868564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0102a40 msgr2=0x7f31c00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c5d9b700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0102a40 0x7f31c00737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c5d9b700 1 -- 172.21.15.8:0/3237868564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009520 con 0x7f31c0100ea0 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c659c700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0102a40 0x7f31c00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T23:31:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c5d9b700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31c0100ea0 0x7f31c0074c60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f31bc000c00 tx=0x7f31bc00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:31:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31b6ffd700 1 -- 172.21.15.8:0/3237868564 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc01c070 con 0x7f31c0100ea0 2023-10-06T23:31:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31b6ffd700 1 -- 172.21.15.8:0/3237868564 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31bc00f7b0 con 0x7f31c0100ea0 2023-10-06T23:31:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b8009d00 con 0x7f31c0100ea0 2023-10-06T23:31:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31b6ffd700 1 -- 172.21.15.8:0/3237868564 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0038e0 con 0x7f31c0100ea0 2023-10-06T23:31:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.223+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc009520 con 0x7f31c0100ea0 2023-10-06T23:31:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.224+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c0108610 con 0x7f31c0100ea0 2023-10-06T23:31:01.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.226+0000 7f31b6ffd700 1 -- 172.21.15.8:0/3237868564 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f31bc020030 con 0x7f31c0100ea0 2023-10-06T23:31:01.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.228+0000 7f31b6ffd700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31ac0a1480 0x7f31ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T23:31:01.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.228+0000 7f31b6ffd700 1 -- 172.21.15.8:0/3237868564 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f31bc0ce150 con 0x7f31c0100ea0 2023-10-06T23:31:01.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.228+0000 7f31c559a700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31ac0a1480 0x7f31ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T23:31:01.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.228+0000 7f31c559a700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31ac0a1480 0x7f31ac0a3940 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f31c0100bc0 tx=0x7f31b0009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T23:31:01.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.230+0000 7f31b6ffd700 1 -- 172.21.15.8:0/3237868564 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f31bc0977f0 con 0x7f31c0100ea0 2023-10-06T23:31:01.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.460+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31c010c810 con 0x7f31c0100ea0 2023-10-06T23:31:01.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.461+0000 7f31b6ffd700 1 -- 172.21.15.8:0/3237868564 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+579 (secure 0 0 0) 0x7f31bc09ae10 con 0x7f31c0100ea0 2023-10-06T23:31:01.462 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2416919540 2023-10-07T23:03:48.853244+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/297059453 2023-10-07T23:03:48.853244+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2948074146 2023-10-07T23:03:21.609864+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2416919540 2023-10-07T23:03:48.853244+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3650897985 2023-10-07T23:03:21.609864+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2349179296 2023-10-07T23:03:48.853244+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/166376639 2023-10-07T23:03:21.609864+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/166376639 2023-10-07T23:03:21.609864+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2680339710 2023-10-07T23:03:21.609864+0000 2023-10-06T23:31:01.463 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2455618842 2023-10-07T23:03:48.853244+0000 2023-10-06T23:31:01.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31ac0a1480 msgr2=0x7f31ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:01.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31ac0a1480 0x7f31ac0a3940 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f31c0100bc0 tx=0x7f31b0009260 comp rx=0 tx=0).stop 2023-10-06T23:31:01.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31c0100ea0 msgr2=0x7f31c0074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T23:31:01.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31c0100ea0 0x7f31c0074c60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f31bc000c00 tx=0x7f31bc00b790 comp rx=0 tx=0).stop 2023-10-06T23:31:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 shutdown_connections 2023-10-06T23:31:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:6800/3959613712,v1:172.21.15.8:6801/3959613712] conn(0x7f31ac0a1480 0x7f31ac0a3940 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31c0100ea0 0x7f31c0074c60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31c0102a40 0x7f31c00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 --2- 172.21.15.8:0/3237868564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f31c0102080 0x7f31c00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T23:31:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 >> 172.21.15.8:0/3237868564 conn(0x7f31c00fc460 msgr2=0x7f31c0105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T23:31:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 shutdown_connections 2023-10-06T23:31:01.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-06T23:31:01.464+0000 7f31c7fff700 1 -- 172.21.15.8:0/3237868564 wait complete. 2023-10-06T23:31:01.467 INFO:teuthology.orchestra.run.smithi008.stderr:listed 10 entries 2023-10-06T23:31:01.485 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi008.front.sepia.ceph.com... 2023-10-06T23:31:01.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:31:01.486 DEBUG:teuthology.orchestra.run.smithi008:> sudo fusermount -u /tmp/cephfs 2023-10-06T23:31:01.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[161984]: fuse finished with error 0 and tester_r 0 2023-10-06T23:31:01.898 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:01 smithi008 ceph-mon[98532]: pgmap v896: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:31:01.898 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3568130364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:31:01.898 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:01 smithi008 ceph-mon[98532]: from='client.? 172.21.15.8:0/3237868564' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-06T23:31:02.042 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T23:31:02.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:01 smithi156 ceph-mon[102862]: pgmap v896: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:31:02.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3568130364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:31:02.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:01 smithi156 ceph-mon[102862]: from='client.? 172.21.15.8:0/3237868564' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-06T23:31:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:01 smithi190 ceph-mon[102658]: pgmap v896: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-06T23:31:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3568130364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-06T23:31:02.193 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:01 smithi190 ceph-mon[102658]: from='client.? 172.21.15.8:0/3237868564' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-06T23:31:03.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:03 smithi156 ceph-mon[102862]: pgmap v897: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-10-06T23:31:03.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:03 smithi008 ceph-mon[98532]: pgmap v897: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-10-06T23:31:03.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:03 smithi190 ceph-mon[102658]: pgmap v897: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-10-06T23:31:06.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:05 smithi156 ceph-mon[102862]: pgmap v898: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-10-06T23:31:06.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:05 smithi008 ceph-mon[98532]: pgmap v898: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-10-06T23:31:06.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:05 smithi190 ceph-mon[102658]: pgmap v898: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2023-10-06T23:31:08.098 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:07 smithi156 ceph-mon[102862]: pgmap v899: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2023-10-06T23:31:08.143 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T23:31:08.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:31:08.143 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-10-06T23:31:08.145 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:07 smithi008 ceph-mon[98532]: pgmap v899: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2023-10-06T23:31:08.192 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:07 smithi190 ceph-mon[102658]: pgmap v899: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2023-10-06T23:31:08.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:31:08.202 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-06T23:31:08.272 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-10-06T23:31:08.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:31:08.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-10-06T23:31:08.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T23:31:08.347 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-06T23:31:08.458 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-06T23:31:08.469 INFO:tasks.cephadm:Teardown begin 2023-10-06T23:31:08.469 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/cephadm.py", line 1756, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-06T23:31:08.470 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:31:08.541 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:31:08.643 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:31:08.740 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-06T23:31:08.741 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-06T23:31:08.794 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-06T23:31:08.845 DEBUG:teuthology.orchestra.run.smithi190:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-06T23:31:08.906 INFO:tasks.cephadm:Stopping all daemons... 2023-10-06T23:31:08.906 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-06T23:31:08.906 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.a 2023-10-06T23:31:09.396 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:09 smithi008 systemd[1]: Stopping Ceph mon.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:09 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-a[98508]: 2023-10-06T23:31:09.426+0000 7fe37c09c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:09.896 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:09 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-a[98508]: 2023-10-06T23:31:09.426+0000 7fe37c09c700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-06T23:31:10.267 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 06 23:31:09 smithi008 bash[176003]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-a 2023-10-06T23:31:10.302 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-06T23:31:10.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:10.410 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-06T23:31:10.410 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-06T23:31:10.410 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.b 2023-10-06T23:31:11.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:10 smithi156 systemd[1]: Stopping Ceph mon.b for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:11.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-b[102838]: 2023-10-06T23:31:11.443+0000 7fbbbfaed700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:11.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-b[102838]: 2023-10-06T23:31:11.444+0000 7fbbbfaed700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-06T23:31:12.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Oct 06 23:31:12 smithi156 bash[146178]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-b 2023-10-06T23:31:12.427 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-06T23:31:12.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:12.541 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-06T23:31:12.541 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-06T23:31:12.541 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.c 2023-10-06T23:31:12.943 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:12 smithi190 systemd[1]: Stopping Ceph mon.c for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:13.442 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-c[102634]: 2023-10-06T23:31:13.181+0000 7f3a673c6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:13.443 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-c[102634]: 2023-10-06T23:31:13.181+0000 7f3a673c6700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-06T23:31:13.942 INFO:journalctl@ceph.mon.c.smithi190.stdout:Oct 06 23:31:13 smithi190 bash[144508]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mon-c 2023-10-06T23:31:14.027 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-06T23:31:14.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:14.136 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-06T23:31:14.136 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-06T23:31:14.137 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.x 2023-10-06T23:31:14.637 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:31:14 smithi008 systemd[1]: Stopping Ceph mgr.x for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:14.895 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:31:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:31:14.634+0000 7f1aac5ac700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:14.896 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:31:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x[98779]: 2023-10-06T23:31:14.634+0000 7f1aac5ac700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-06T23:31:15.396 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 06 23:31:14 smithi008 bash[176141]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-x 2023-10-06T23:31:15.438 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-06T23:31:15.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:15.534 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-06T23:31:15.534 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-06T23:31:15.534 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.y 2023-10-06T23:31:16.099 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:31:15 smithi156 systemd[1]: Stopping Ceph mgr.y for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:16.753 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:31:16 smithi156 bash[146330]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-y 2023-10-06T23:31:16.753 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:31:16 smithi156 systemd[1]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-06T23:31:16.988 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-06T23:31:17.061 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:31:16 smithi156 systemd[1]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.y.service: Failed with result 'exit-code'. 2023-10-06T23:31:17.061 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Oct 06 23:31:16 smithi156 systemd[1]: Stopped Ceph mgr.y for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:31:17.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:17.087 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-06T23:31:17.087 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-06T23:31:17.087 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.z 2023-10-06T23:31:17.443 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:31:17 smithi190 systemd[1]: Stopping Ceph mgr.z for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:18.192 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:31:17 smithi190 bash[144666]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mgr-z 2023-10-06T23:31:18.429 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-06T23:31:18.493 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:31:18 smithi190 systemd[1]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-06T23:31:18.493 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:31:18 smithi190 systemd[1]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mgr.z.service: Failed with result 'exit-code'. 2023-10-06T23:31:18.493 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Oct 06 23:31:18 smithi190 systemd[1]: Stopped Ceph mgr.z for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:31:18.520 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:18.520 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-06T23:31:18.521 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-06T23:31:18.521 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.0 2023-10-06T23:31:18.896 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:31:18 smithi008 systemd[1]: Stopping Ceph osd.0 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:19.395 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:31:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-0[117354]: 2023-10-06T23:31:19.041+0000 7f32deaf4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:19.396 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:31:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-0[117354]: 2023-10-06T23:31:19.041+0000 7f32deaf4700 -1 osd.0 89 *** Got signal Terminated *** 2023-10-06T23:31:19.396 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:31:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-0[117354]: 2023-10-06T23:31:19.041+0000 7f32deaf4700 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:31:25.395 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 06 23:31:25 smithi008 bash[176287]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-0 2023-10-06T23:31:27.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-06T23:31:27.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:27.257 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-06T23:31:27.257 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-06T23:31:27.257 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.1 2023-10-06T23:31:27.599 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:31:27 smithi156 systemd[1]: Stopping Ceph osd.1 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:29.349 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:31:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-1[107959]: 2023-10-06T23:31:29.061+0000 7f73af656700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:29.349 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:31:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-1[107959]: 2023-10-06T23:31:29.061+0000 7f73af656700 -1 osd.1 89 *** Got signal Terminated *** 2023-10-06T23:31:29.349 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:31:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-1[107959]: 2023-10-06T23:31:29.061+0000 7f73af656700 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:31:35.349 INFO:journalctl@ceph.osd.1.smithi156.stdout:Oct 06 23:31:34 smithi156 bash[146481]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-1 2023-10-06T23:31:37.264 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-06T23:31:37.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:37.353 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-06T23:31:37.353 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-06T23:31:37.353 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.2 2023-10-06T23:31:37.693 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:31:37 smithi190 systemd[1]: Stopping Ceph osd.2 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:38.193 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:31:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-2[108490]: 2023-10-06T23:31:37.863+0000 7fae7c2cf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:38.193 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:31:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-2[108490]: 2023-10-06T23:31:37.863+0000 7fae7c2cf700 -1 osd.2 89 *** Got signal Terminated *** 2023-10-06T23:31:38.193 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:31:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-2[108490]: 2023-10-06T23:31:37.863+0000 7fae7c2cf700 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:31:44.192 INFO:journalctl@ceph.osd.2.smithi190.stdout:Oct 06 23:31:43 smithi190 bash[144815]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-2 2023-10-06T23:31:45.463 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:45.197+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:45.751 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-06T23:31:45.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:45.841 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-06T23:31:45.841 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-06T23:31:45.841 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.3 2023-10-06T23:31:45.910 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:45 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:45.689+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:45.911 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:45 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:45.657+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:46.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:45.722+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:46.365 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:45 smithi008 systemd[1]: Stopping Ceph osd.3 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:46.646 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:46 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:31:46.363+0000 7fd98c685700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:46.646 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:46 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:31:46.363+0000 7fd98c685700 -1 osd.3 89 *** Got signal Terminated *** 2023-10-06T23:31:46.646 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:46 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:31:46.363+0000 7fd98c685700 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:31:46.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:46.229+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:47.145 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:46 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:46.667+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:47.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:46 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:46.668+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:47.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:46.755+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:47.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:47.234+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:47.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:47.647+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:47.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:47.639+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:47.896 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:47 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:31:47.738+0000 7fd984c73700 -1 osd.3 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.617795+0000 front 2023-10-06T23:31:21.617885+0000 (oldest deadline 2023-10-06T23:31:46.918049+0000) 2023-10-06T23:31:48.098 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:47 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:47.632+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:48.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:47.780+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:48.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:48.274+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:48.896 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:48 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:31:48.780+0000 7fd984c73700 -1 osd.3 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.617795+0000 front 2023-10-06T23:31:21.617885+0000 (oldest deadline 2023-10-06T23:31:46.918049+0000) 2023-10-06T23:31:48.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:48 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:48.678+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:48.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:48 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:48.630+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:49.098 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:48.609+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:49.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:48.758+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:49.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:48.793+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:49.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:49.239+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:49.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:49.568+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:50.146 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:49 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:31:49.804+0000 7fd984c73700 -1 osd.3 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.617795+0000 front 2023-10-06T23:31:21.617885+0000 (oldest deadline 2023-10-06T23:31:46.918049+0000) 2023-10-06T23:31:50.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:49 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:49.678+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:50.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:49 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:49.671+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:50.192 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:49.833+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:50.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:49.743+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:50.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:50.249+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:50.848 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:50 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:50.536+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:50.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:50 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:50.630+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:50.896 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:50 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3[125213]: 2023-10-06T23:31:50.826+0000 7fd984c73700 -1 osd.3 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.617795+0000 front 2023-10-06T23:31:21.617885+0000 (oldest deadline 2023-10-06T23:31:46.918049+0000) 2023-10-06T23:31:50.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:50 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:50.727+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:51.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:50.762+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:51.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:50.803+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:51.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:51.220+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:51.848 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:51 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:51.543+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:51.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:51 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:51.711+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:51.897 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:51 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:51.616+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:52.175 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:51.798+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:52.176 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:51.718+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:52.442 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:52.173+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:52.606 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 06 23:31:52 smithi008 bash[176566]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-3 2023-10-06T23:31:52.848 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:52 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:52.585+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:52.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:52 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:52.683+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:52.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:52 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:52.604+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:53.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:52.758+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:53.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:52.718+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:53.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:53.215+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:53.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:53 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:53.540+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:53.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:53 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:53.682+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:53.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:53 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:53.556+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:54.184 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:53.802+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:54.185 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:53.756+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:54.416 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-06T23:31:54.442 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:54.183+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:54.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:31:54.513 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-06T23:31:54.513 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-06T23:31:54.513 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.4 2023-10-06T23:31:54.675 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:54 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:54.522+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:54.848 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:54 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:54.541+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:54.849 INFO:journalctl@ceph.osd.4.smithi156.stdout:Oct 06 23:31:54 smithi156 systemd[1]: Stopping Ceph osd.4 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:31:55.145 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:54 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:54.673+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:55.186 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:54.796+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:55.186 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:54.801+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:55.349 INFO:journalctl@ceph.osd.4.smithi156.stdout:Oct 06 23:31:55 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-4[115931]: 2023-10-06T23:31:55.021+0000 7f0c7e5f9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:31:55.349 INFO:journalctl@ceph.osd.4.smithi156.stdout:Oct 06 23:31:55 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-4[115931]: 2023-10-06T23:31:55.021+0000 7f0c7e5f9700 -1 osd.4 89 *** Got signal Terminated *** 2023-10-06T23:31:55.349 INFO:journalctl@ceph.osd.4.smithi156.stdout:Oct 06 23:31:55 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-4[115931]: 2023-10-06T23:31:55.021+0000 7f0c7e5f9700 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:31:55.442 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:55.184+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:55.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:55 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:55.550+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:55.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:55 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:55.642+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:55.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:55 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:55.642+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:31:55.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:55 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:55.487+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:55.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:55 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:55.487+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:31:56.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:55.778+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:56.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:55.794+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:56.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:56.218+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:56.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:56 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:56.592+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:56.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:56 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:56.592+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:31:56.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:56 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:56.653+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:56.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:56 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:56.653+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:31:56.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:56 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:56.484+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:56.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:56 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:56.484+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:31:57.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:56.799+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:57.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:56.799+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:31:57.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:56.754+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:57.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:56.754+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:31:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:57.217+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:57.217+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:31:57.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:57 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:57.578+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:57.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:57 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:57.578+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:31:57.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:31:57 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:31:57.501+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:31:57.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:57 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:57.614+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:57.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:57 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:57.614+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:31:57.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:57 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:57.458+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:57.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:57 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:57.458+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:31:58.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:57.745+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:58.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:57.745+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:31:58.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:57.795+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:58.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:57.795+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:31:58.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:58.264+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:58.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:58.264+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:31:58.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:31:58 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:31:58.549+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:31:58.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:58 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:58.538+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:58.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:58 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:58.538+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:31:58.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:58 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:58.661+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:58.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:58 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:58.661+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:31:58.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:58 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:58.452+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:58.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:58 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:58.452+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:31:59.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:58.765+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:31:59.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:58.765+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:31:59.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:58.779+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:31:59.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:58.779+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:31:59.349 INFO:journalctl@ceph.osd.4.smithi156.stdout:Oct 06 23:31:59 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-4[115931]: 2023-10-06T23:31:59.079+0000 7f0c783ea700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.319067+0000 front 2023-10-06T23:31:30.318925+0000 (oldest deadline 2023-10-06T23:31:58.519862+0000) 2023-10-06T23:31:59.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:59 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:59.226+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:31:59.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:31:59 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:31:59.226+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:31:59.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:31:59 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:31:59.507+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:31:59.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:59 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:59.527+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:31:59.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:31:59 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:31:59.527+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:31:59.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:59.640+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:31:59.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:31:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:31:59.640+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:31:59.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:59.468+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:31:59.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:31:59 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:31:59.468+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:00.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:59 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:59.809+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:00.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:31:59 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:31:59.809+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:00.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:59 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:59.783+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:00.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:31:59 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:31:59.783+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:00.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:00 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:00.200+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:00.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:00 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:00.200+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:00.784 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:00 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:00.529+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:00.784 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:00 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:00.529+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:00.784 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:00 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:00.545+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:00.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:00 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:00.632+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:00.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:00 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:00.632+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:00.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:00 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:00.452+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:00.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:00 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:00.452+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:01.099 INFO:journalctl@ceph.osd.4.smithi156.stdout:Oct 06 23:32:01 smithi156 bash[146754]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-4 2023-10-06T23:32:01.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:00 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:00.822+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:01.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:00 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:00.822+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:01.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:00 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:00.759+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:01.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:00 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:00.759+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:01.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:01.243+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:01.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:01.243+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:01.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:01 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:01.528+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:01.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:01 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:01.563+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:01.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:01 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:01.563+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:01.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:01 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:01.623+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:01.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:01 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:01.623+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:01.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:01 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:01.493+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:01.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:01 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:01.493+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:02.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:01.807+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:02.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:01.807+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:02.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:01.798+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:02.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:01 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:01.798+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:02.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:02.287+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:02.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:02.287+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:02.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:02 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:02.571+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:02.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:02 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:02.603+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:02.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:02 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:02.603+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:02.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:02 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:02.643+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:02.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:02 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:02.643+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:02.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:02 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:02.473+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:02.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:02 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:02.473+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:02.948 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-06T23:32:03.039 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:32:03.039 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-06T23:32:03.040 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-06T23:32:03.040 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.5 2023-10-06T23:32:03.107 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:02.782+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:03.108 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:02.782+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:03.108 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:02.800+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:03.108 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:02 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:02.800+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:03.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:03.264+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:03.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:03.264+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:03.443 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:03 smithi190 systemd[1]: Stopping Ceph osd.5 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:32:03.803 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:03.534+0000 7fa78be36700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:32:03.803 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:03.534+0000 7fa78be36700 -1 osd.5 89 *** Got signal Terminated *** 2023-10-06T23:32:03.804 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:03.534+0000 7fa78be36700 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:32:03.804 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:03.760+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:03.804 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:03.760+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:03.848 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:03 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:03.557+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:03.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:03 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:03.570+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:03.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:03 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:03.570+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:03.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:03 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:03.666+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:03.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:03 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:03.666+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:03.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:03 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:03.666+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:03.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:03 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:03.498+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:03.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:03 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:03.498+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:04.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:03.802+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:04.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:03 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:03.802+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:04.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:04 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:04.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:04.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:04 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:04.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:04.848 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:04.583+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:04.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:04.530+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:04.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:04.530+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:04.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:04 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:04.530+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:04.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:04 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:04.655+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:04.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:04 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:04.655+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:04.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:04 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:04.655+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:04.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:04 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:04.453+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:04.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:04 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:04.453+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:05.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:04 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:04.777+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:05.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:04 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:04.777+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:05.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:04 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:04.730+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:05.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:04 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:04.730+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:05.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:05.299+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:05.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:05.299+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:05.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:05 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:05.569+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:05.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:05 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:05.521+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:05.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:05 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:05.521+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:05.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:05 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:05.521+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:05.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:05.632+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:05.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:05.632+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:05.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:05.632+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:05.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:05.453+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:05.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:05.453+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:06.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:05.753+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:06.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:05.753+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:06.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:05.744+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:06.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:05 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:05.744+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:06.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:06.295+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:06.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:06.295+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:06.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:06 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:06.523+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:06.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:06 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:06.523+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:06.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:06 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:06.523+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:06.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:06 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:06.540+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:06.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:06.603+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:06.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:06.603+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:06.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:06.603+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:06.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:06.495+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:06.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:06 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:06.495+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:07.192 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:06.729+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:07.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:06.729+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:07.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:06.737+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:07.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:06.737+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:07.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:06 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:06.737+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:07.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:07.260+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:07.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:07.260+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:07.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:07 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:07.555+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:07.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:07 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:07.555+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:07.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:07 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:07.555+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:07.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:07 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:07.576+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:07.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:07 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:07.576+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:07.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:07 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:07.616+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:07.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:07 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:07.616+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:07.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:07 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:07.616+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:07.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:07 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:07.455+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:07.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:07 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:07.455+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:08.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:07.740+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.920336+0000 front 2023-10-06T23:31:23.920415+0000 (oldest deadline 2023-10-06T23:31:48.620109+0000) 2023-10-06T23:32:08.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:07.740+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.821844+0000 front 2023-10-06T23:31:33.821931+0000 (oldest deadline 2023-10-06T23:31:56.721900+0000) 2023-10-06T23:32:08.193 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5[116311]: 2023-10-06T23:32:07.740+0000 7fa785426700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.423114+0000 front 2023-10-06T23:31:41.423210+0000 (oldest deadline 2023-10-06T23:32:07.323273+0000) 2023-10-06T23:32:08.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:07.735+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:08.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:07.735+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:08.194 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:07 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:07.735+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:08.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:08.260+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:08.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:08.260+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:08.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:08 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:08.574+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:08.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:08 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:08.574+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:08.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:08 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:08.545+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:08.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:08 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:08.545+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:08.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:08 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:08.545+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:08.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:08 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:08.665+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:08.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:08 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:08.665+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:08.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:08 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:08.665+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:08.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:08 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:08.478+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:08.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:08 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:08.478+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:08.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:08 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:08.478+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:09.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:08.753+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:09.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:08.753+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:09.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:08 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:08.753+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:09.538 INFO:journalctl@ceph.osd.5.smithi190.stdout:Oct 06 23:32:09 smithi190 bash[145085]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-5 2023-10-06T23:32:09.538 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:09 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:09.293+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:09.538 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:09 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:09.293+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:09.538 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:09 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:09.293+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:09.848 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:09.595+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:09.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:09.595+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:09.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:09.595+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:09.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:09.542+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:09.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:09 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:09.542+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:09.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:09 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:09.699+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:09.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:09 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:09.699+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:09.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:09 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:09.699+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:09.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:09 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:09.494+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:09.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:09 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:09.494+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:09.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:09 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:09.494+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:10.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:09 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:09.777+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:10.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:09 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:09.777+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:10.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:09 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:09.777+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:10.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:10 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:10.303+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:10.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:10 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:10.303+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:10.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:10 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:10.303+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:10.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:10 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:10.514+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:10.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:10 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:10.514+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:10.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:10 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:10.593+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:10.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:10 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:10.593+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:10.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:10 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:10.593+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:10.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:10 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:10.671+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:10.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:10 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:10.671+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:10.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:10 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:10.671+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:10.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:10 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:10.524+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:10.897 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:10 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:10.524+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:10.897 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:10 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:10.524+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:11.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:10 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:10.772+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:11.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:10 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:10.772+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:11.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:10 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:10.772+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:11.268 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-06T23:32:11.356 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:32:11.357 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-06T23:32:11.357 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-06T23:32:11.357 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.6 2023-10-06T23:32:11.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:11 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:11.281+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:11.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:11 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:11.281+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:11.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:11 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:11.281+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:11.704 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:11 smithi008 systemd[1]: Stopping Ceph osd.6 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:32:11.704 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:11.518+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:11.704 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:11.518+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:11.704 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:11.518+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:11.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:11.512+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:11.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:11.512+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:11.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:11.599+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:11.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:11.599+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:11.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:11 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:11.599+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:12.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:11.702+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:12.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:11.702+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:12.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:11.702+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:12.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:11.868+0000 7f46d77a2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:32:12.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:11.868+0000 7f46d77a2700 -1 osd.6 89 *** Got signal Terminated *** 2023-10-06T23:32:12.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:11 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:11.868+0000 7f46d77a2700 -1 osd.6 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:32:12.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:11 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:11.795+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:12.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:11 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:11.795+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:12.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:11 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:11.795+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:12.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:12 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:12.287+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:12.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:12 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:12.287+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:12.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:12 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:12.287+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:12.848 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:12 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:12.535+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:12.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:12 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:12.535+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:12.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:12 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:12.560+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:12.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:12 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:12.560+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:12.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:12 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:12.560+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:12.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:12 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:12.566+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:12.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:12 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:12.566+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:12.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:12 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:12.566+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:12.897 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:12 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:12.696+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:12.897 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:12 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:12.696+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:12.897 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:12 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:12.696+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:13.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:12 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:12.794+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:13.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:12 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:12.794+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:13.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:12 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:12.794+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:13.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:12 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:12.794+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:13.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:13.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:13.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:13.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:13.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:13.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:13.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:13 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:13.516+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:13.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:13 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:13.516+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:13.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:13 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:13.532+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:13.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:13 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:13.532+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:13.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:13 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:13.532+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:13.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:13.567+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:13.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:13.567+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:13.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:13.567+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:13.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:13.679+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:13.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:13.679+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:13.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:13 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:13.679+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:14.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:13.754+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:14.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:13.754+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:14.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:13.754+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:14.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:13 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:13.754+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:14.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:14 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:14.325+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:14.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:14 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:14.325+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:14.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:14 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:14.325+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:14.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:14 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:14.574+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:14.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:14 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:14.574+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:14.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:14 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:14.574+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:14.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:14 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:14.574+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:14.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:14 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:14.554+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:14.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:14 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:14.554+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:14.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:14.588+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:14.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:14.588+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:14.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:14.588+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:14.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:14.692+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:14.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:14.692+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:14.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:14.692+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:14.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:14.692+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:49.493231+0000 front 2023-10-06T23:31:49.493302+0000 (oldest deadline 2023-10-06T23:32:14.193574+0000) 2023-10-06T23:32:15.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:14 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:14.800+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:15.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:14 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:14.800+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:15.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:14 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:14.800+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:15.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:14 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:14.800+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:15.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:15 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:15.345+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:15.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:15 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:15.345+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:15.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:15 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:15.345+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:15.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:15 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:15.602+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:15.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:15 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:15.602+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:15.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:15 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:15.596+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:15.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:15 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:15.596+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:15.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:15 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:15.596+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:15.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:15 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:15.596+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:15.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:15.717+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:15.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:15.718+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:15.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:15.718+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:15.896 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:15.718+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:49.493231+0000 front 2023-10-06T23:31:49.493302+0000 (oldest deadline 2023-10-06T23:32:14.193574+0000) 2023-10-06T23:32:15.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:15.604+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:15.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:15.604+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:15.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:15.604+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:15.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:15 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:15.604+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:16.194 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:15 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:15.756+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:16.208 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:15 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:15.756+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:16.208 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:15 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:15.756+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:16.208 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:15 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:15.756+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:16.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:16 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:16.330+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:16.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:16 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:16.330+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:16.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:16 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:16.330+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:17.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:16 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:16.648+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:17.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:16 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:16.648+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:17.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:16 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:16.648+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:17.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:16 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:16.599+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:17.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:16 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:16.599+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:17.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:16 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:16.599+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:17.100 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:16 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:16.599+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:17.145 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:16.703+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:18.989445+0000 front 2023-10-06T23:31:18.989695+0000 (oldest deadline 2023-10-06T23:31:44.889577+0000) 2023-10-06T23:32:17.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:16.703+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.091241+0000 front 2023-10-06T23:31:33.091191+0000 (oldest deadline 2023-10-06T23:31:54.791052+0000) 2023-10-06T23:32:17.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:16.703+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.092176+0000 front 2023-10-06T23:31:40.092279+0000 (oldest deadline 2023-10-06T23:32:03.592180+0000) 2023-10-06T23:32:17.146 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6[133089]: 2023-10-06T23:32:16.703+0000 7f46d3d98700 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:49.493231+0000 front 2023-10-06T23:31:49.493302+0000 (oldest deadline 2023-10-06T23:32:14.193574+0000) 2023-10-06T23:32:17.149 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:16.647+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:17.149 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:16.647+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:17.149 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:16.647+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:17.149 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:16 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:16.647+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:17.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:16 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:16.718+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:17.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:16 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:16.718+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:17.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:16 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:16.718+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:17.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:16 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:16.718+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:17.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:17 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:17.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:17.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:17 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:17.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:17.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:17 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:17.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:17.830 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 06 23:32:17 smithi008 bash[176842]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-6 2023-10-06T23:32:17.830 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:17 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:17.647+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:17.830 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:17 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:17.647+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:17.830 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:17 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:17.647+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:17.831 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:17 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:17.647+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:18.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:17 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:17.632+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:18.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:17 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:17.632+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:18.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:17 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:17.632+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:18.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:17 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:17.619+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:18.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:17 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:17.619+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:18.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:17 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:17.619+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:18.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:17 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:17.619+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:18.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:17 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:17.740+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:18.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:17 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:17.740+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:18.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:17 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:17.740+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:18.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:17 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:17.740+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:18.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:18 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:18.362+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:18.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:18 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:18.362+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:18.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:18 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:18.362+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:18.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:18 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:18.665+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:18.850 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:18 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:18.665+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:18.851 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:18 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:18.665+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:18.851 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:18 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:18.594+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:18.851 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:18 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:18.594+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:18.851 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:18 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:18.594+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:18.851 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:18 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:18.594+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:19.138 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:18 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:18.683+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:19.138 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:18 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:18.683+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:19.138 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:18 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:18.683+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:19.138 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:18 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:18.683+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:19.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:18 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:18.725+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:19.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:18 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:18.725+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:19.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:18 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:18.725+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:19.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:18 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:18.725+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:19.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-06T23:32:19.656 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:32:19.657 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-06T23:32:19.657 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-06T23:32:19.657 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.7 2023-10-06T23:32:19.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:19.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:19.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:19.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:19.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:19.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:19.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:19.553+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:19.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:19.553+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:19.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:19.553+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:19.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:19.553+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:19.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:19.711+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:19.850 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:19.711+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:19.850 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:19.711+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:19.850 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:19 smithi156 systemd[1]: Stopping Ceph osd.7 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:32:19.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:19.635+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:19.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:19.635+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:19.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:19.635+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:19.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:19 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:19.635+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:20.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:19.709+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:20.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:19.709+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:20.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:19.709+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:20.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:19 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:19.710+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:20.530 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:20.528+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:20.530 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:20.175+0000 7f920abac700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:32:20.531 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:20.175+0000 7f920abac700 -1 osd.7 89 *** Got signal Terminated *** 2023-10-06T23:32:20.531 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:20.175+0000 7f920abac700 -1 osd.7 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:32:20.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:20.401+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:20.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:20.401+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:20.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:20.401+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:20.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:20.736+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:20.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:20.736+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:20.850 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:20.736+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:20.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:20.528+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:20.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:20.528+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:20.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:20 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:20.528+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:21.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:20 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:20.657+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:21.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:20 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:20.657+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:21.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:20 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:20.657+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:21.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:20 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:20.657+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:21.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:20.711+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:21.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:20.711+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:21.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:20.711+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:21.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:20 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:20.711+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:21.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:21 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:21.352+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:21.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:21 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:21.352+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:21.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:21 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:21.352+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:21.848 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:21 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:21.759+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:21.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:21 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:21.759+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:21.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:21 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:21.759+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:21.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:21 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:21.518+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:21.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:21 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:21.518+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:21.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:21 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:21.518+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:21.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:21 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:21.518+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:21.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:21 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:21.631+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:21.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:21 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:21.631+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:21.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:21 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:21.631+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:21.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:21 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:21.631+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:21.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:21 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:21.631+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:22.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:21 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:21.700+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:22.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:21 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:21.700+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:22.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:21 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:21.700+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:22.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:21 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:21.700+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:22.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:21 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:21.700+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:22.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:22.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:22.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:22.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:22.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:22.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:22.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:22.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:22.848 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:22.716+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:22.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:22.716+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:22.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:22.716+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:22.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:22.510+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:22.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:22.510+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:22.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:22.510+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:22.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:22.510+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:22.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:22 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:22.510+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:23.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:22 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:22.652+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:23.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:22 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:22.652+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:23.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:22 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:22.652+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:23.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:22 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:22.652+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:23.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:22 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:22.652+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:23.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:22.721+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:23.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:22.721+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:23.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:22.721+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:23.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:22.721+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:23.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:22 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:22.721+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:23.680 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:23.374+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:23.680 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:23.374+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:23.680 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:23.374+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:23.680 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:23.374+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:23.755 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:23 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:23.488+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:23.755 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:23 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:23.488+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:23.755 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:23 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:23.488+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:23.755 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:23 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:23.488+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:23.755 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:23 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:23.488+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:23.942 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:23.679+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:23.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:23.679+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:23.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:23.679+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:23.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:23.679+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:23.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:23 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:23.679+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:24.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:23 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:23.753+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:24.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:23 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:23.753+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:24.099 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:23 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:23.753+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:24.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:23 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:23.674+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:24.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:23 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:23.674+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:24.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:23 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:23.674+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:24.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:23 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:23.674+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:24.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:23 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:23.674+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:24.642 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:24.355+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:24.643 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:24.355+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:24.643 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:24.355+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:24.643 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:24.355+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:24.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:24.749+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:33.330971+0000 front 2023-10-06T23:31:33.330947+0000 (oldest deadline 2023-10-06T23:31:56.831101+0000) 2023-10-06T23:32:24.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:24.749+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.932467+0000 front 2023-10-06T23:31:40.932253+0000 (oldest deadline 2023-10-06T23:32:06.831934+0000) 2023-10-06T23:32:24.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:24.749+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:46.832678+0000 front 2023-10-06T23:31:46.832507+0000 (oldest deadline 2023-10-06T23:32:15.633040+0000) 2023-10-06T23:32:24.849 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7[124488]: 2023-10-06T23:32:24.749+0000 7f920499d700 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.533918+0000 front 2023-10-06T23:31:58.533953+0000 (oldest deadline 2023-10-06T23:32:24.434053+0000) 2023-10-06T23:32:24.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:24.522+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:24.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:24.522+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:24.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:24.522+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:24.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:24.522+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:24.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:24 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:24.522+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:24.942 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:24.641+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:24.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:24.641+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:24.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:24.641+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:24.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:24.641+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:24.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:24 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:24.641+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:25.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:24 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:24.648+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:25.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:24 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:24.648+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:25.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:24 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:24.648+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:25.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:24 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:24.648+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:25.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:24 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:24.648+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:25.637 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:25.333+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:25.637 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:25.333+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:25.637 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:25.333+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:25.637 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:25.333+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:25.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:25 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:25.560+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:25.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:25 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:25.560+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:25.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:25 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:25.560+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:25.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:25 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:25.560+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:25.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:25 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:25.560+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:25.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:25 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:25.627+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:25.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:25 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:25.627+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:25.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:25 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:25.627+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:25.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:25 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:25.627+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:25.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:25 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:25.627+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:25.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:25.636+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:25.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:25.636+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:25.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:25.636+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:25.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:25.636+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:25.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:25 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:25.636+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:26.348 INFO:journalctl@ceph.osd.7.smithi156.stdout:Oct 06 23:32:26 smithi156 bash[147027]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-7 2023-10-06T23:32:26.621 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:26.362+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:26.621 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:26.362+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:26.621 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:26.362+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:26.621 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:26.362+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:26.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:26 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:26.514+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:26.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:26 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:26.514+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:26.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:26 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:26.514+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:26.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:26 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:26.514+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:26.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:26 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:26.514+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:26.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:26.601+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:26.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:26.601+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:26.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:26.601+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:26.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:26.601+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:26.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:26 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:26.601+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:26.942 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:26.620+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:26.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:26.620+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:26.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:26.620+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:26.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:26.620+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:26.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:26 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:26.620+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:27.617 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:27.338+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:27.618 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:27.338+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:27.618 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:27.338+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:27.618 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:27.338+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:27.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:27 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:27.491+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:27.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:27 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:27.491+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:27.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:27 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:27.491+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:27.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:27 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:27.491+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:27.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:27 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:27.491+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:27.887 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-06T23:32:27.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:27 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:27.628+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:27.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:27 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:27.628+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:27.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:27 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:27.628+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:27.895 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:27 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:27.628+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:27.896 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:27 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:27.628+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:27.942 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:27.616+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:27.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:27.616+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:27.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:27.616+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:27.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:27.616+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:27.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:27 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:27.616+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:27.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:32:27.979 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-06T23:32:27.979 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-06T23:32:27.979 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.8 2023-10-06T23:32:28.345 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 systemd[1]: Stopping Ceph osd.8 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:32:28.638 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:28.480+0000 7f88266f6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:32:28.638 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:28.480+0000 7f88266f6700 -1 osd.8 89 *** Got signal Terminated *** 2023-10-06T23:32:28.638 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:28.480+0000 7f88266f6700 -1 osd.8 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:32:28.638 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:28.635+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:28.638 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:28.343+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:28.638 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:28.343+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:28.639 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:28.343+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:28.639 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:28.343+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:28.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:28 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:28.501+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:28.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:28 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:28.501+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:28.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:28 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:28.501+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:28.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:28 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:28.501+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:28.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:28 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:28.501+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:28.942 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:28.635+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:28.942 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:28.635+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:28.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:28.635+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:28.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:28 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:28.635+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:29.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:28 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:28.666+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:29.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:28 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:28.666+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:29.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:28 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:28.666+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:29.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:28 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:28.666+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:29.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:28 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:28.666+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:29.595 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:29.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:29.595 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:29.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:29.595 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:29.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:29.595 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:29.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:29.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:29.473+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:29.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:29.473+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:29.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:29.473+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:29.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:29.473+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:29.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:29.473+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:29.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:29 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:29.473+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:29.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:29.593+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:29.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:29.593+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:29.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:29.593+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:29.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:29.593+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:29.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:29 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:29.593+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:30.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:29 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:29.707+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:30.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:29 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:29.707+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:30.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:29 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:29.707+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:30.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:29 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:29.707+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:30.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:29 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:29.707+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:30.628 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:30.293+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:30.628 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:30.293+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:30.628 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:30.293+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:30.628 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:30.293+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:30.628 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:30.293+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:30.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:30 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:30.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:30.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:30 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:30.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:30.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:30 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:30.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:30.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:30 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:30.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:30.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:30 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:30.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:30.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:30 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:30.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:30.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:30.626+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:30.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:30.626+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:30.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:30.626+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:30.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:30.626+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:30.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:30 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:30.626+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:31.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:30 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:30.696+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:31.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:30 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:30.696+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:31.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:30 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:30.696+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:31.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:30 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:30.696+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:31.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:30 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:30.696+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:31.665 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:31.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:31.665 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:31.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:31.665 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:31.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:31.665 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:31.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:31.665 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:31.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:31.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:31 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:31.477+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:31.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:31 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:31.477+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:31.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:31 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:31.477+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:31.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:31 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:31.477+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:31.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:31 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:31.477+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:31.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:31 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:31.477+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:31.942 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:31.663+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:31.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:31.663+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:31.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:31.663+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:31.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:31.663+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:31.943 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:31 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:31.663+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:32.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:31 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:31.712+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:32.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:31 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:31.712+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:32.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:31 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:31.712+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:32.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:31 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:31.712+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:32.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:31 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:31.712+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:32.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:32.243+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:32.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:32.243+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:32.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:32.243+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:32.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:32.243+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:32.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:32.243+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:32.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:32 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:32.463+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:32.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:32 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:32.463+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:32.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:32 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:32.463+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:32.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:32 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:32.463+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:32.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:32 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:32.463+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:32.850 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:32 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:32.463+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:33.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:32 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:32.754+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:33.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:32 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:32.754+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:33.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:32 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:32.754+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:33.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:32 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:32.754+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:33.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:32 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:32.754+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:33.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:32 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:32.754+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:33.192 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:32.698+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:23.822996+0000 front 2023-10-06T23:31:23.822967+0000 (oldest deadline 2023-10-06T23:31:44.922962+0000) 2023-10-06T23:32:33.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:32.698+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:30.725430+0000 front 2023-10-06T23:31:30.725405+0000 (oldest deadline 2023-10-06T23:31:56.625364+0000) 2023-10-06T23:32:33.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:32.698+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.327599+0000 front 2023-10-06T23:31:42.327949+0000 (oldest deadline 2023-10-06T23:32:05.827744+0000) 2023-10-06T23:32:33.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:32.698+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:50.529112+0000 front 2023-10-06T23:31:50.529201+0000 (oldest deadline 2023-10-06T23:32:12.129399+0000) 2023-10-06T23:32:33.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:32.698+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:56.230575+0000 front 2023-10-06T23:31:56.230771+0000 (oldest deadline 2023-10-06T23:32:20.930611+0000) 2023-10-06T23:32:33.193 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:32 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8[124182]: 2023-10-06T23:32:32.698+0000 7f88214e9700 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.332323+0000 front 2023-10-06T23:32:07.332406+0000 (oldest deadline 2023-10-06T23:32:32.632502+0000) 2023-10-06T23:32:33.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:33 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:33.197+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:33.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:33 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:33.197+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:33.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:33 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:33.197+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:33.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:33 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:33.197+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:33.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:33 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:33.197+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:33.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:33.489+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:33.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:33.489+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:33.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:33.489+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:33.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:33.489+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:33.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:33.489+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:33.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:33.489+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:34.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:33 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:33.760+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:34.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:33 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:33.760+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:34.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:33 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:33.760+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:34.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:33 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:33.760+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:34.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:33 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:33.760+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:34.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:33 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:33.760+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:34.693 INFO:journalctl@ceph.osd.8.smithi190.stdout:Oct 06 23:32:34 smithi190 bash[145356]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-8 2023-10-06T23:32:34.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:34 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:34.245+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:34.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:34 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:34.245+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:34.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:34 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:34.245+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:34.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:34 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:34.245+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:34.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:34 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:34.245+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:34.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:34 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:34.457+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:34.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:34 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:34.457+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:34.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:34 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:34.457+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:34.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:34 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:34.457+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:34.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:34 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:34.457+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:34.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:34 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:34.457+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:35.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:34 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:34.748+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:35.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:34 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:34.748+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:35.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:34 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:34.748+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:35.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:34 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:34.748+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:35.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:34 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:34.748+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:35.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:34 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:34.748+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:35.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:35 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:35.213+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:35.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:35 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:35.213+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:35.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:35 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:35.213+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:35.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:35 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:35.213+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:35.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:35 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:35.213+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:35.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:35 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:35.487+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:35.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:35 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:35.487+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:35.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:35 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:35.487+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:35.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:35 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:35.487+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:35.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:35 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:35.487+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:35.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:35 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:35.487+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:36.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:35 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:35.762+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:36.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:35 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:35.762+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:36.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:35 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:35.762+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:36.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:35 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:35.762+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:36.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:35 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:35.762+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:36.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:35 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:35.762+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:36.186 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-06T23:32:36.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:32:36.275 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-06T23:32:36.275 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-06T23:32:36.275 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.9 2023-10-06T23:32:36.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:36 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:36.195+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:36.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:36 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:36.195+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:36.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:36 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:36.195+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:36.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:36 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:36.195+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:36.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:36 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:36.195+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:36.646 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 systemd[1]: Stopping Ceph osd.9 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:32:36.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:36 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:36.520+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:36.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:36 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:36.520+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:36.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:36 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:36.520+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:36.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:36 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:36.520+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:36.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:36 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:36.520+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:36.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:36 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:36.520+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:37.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.736+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:37.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.736+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:37.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.736+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:37.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.736+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:37.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.736+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:37.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.736+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:37.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.798+0000 7f88b3f10700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:32:37.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.798+0000 7f88b3f10700 -1 osd.9 89 *** Got signal Terminated *** 2023-10-06T23:32:37.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:36 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:36.798+0000 7f88b3f10700 -1 osd.9 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:32:37.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:37.150+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:37.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:37.150+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:37.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:37.150+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:37.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:37.150+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:37.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:37.150+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:37.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:37 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:37.513+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:37.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:37 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:37.513+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:37.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:37 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:37.513+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:37.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:37 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:37.513+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:37.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:37 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:37.513+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:37.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:37 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:37.513+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:37.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:37 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:37.513+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:38.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:37 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:37.732+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:38.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:37 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:37.732+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:38.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:37 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:37.732+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:38.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:37 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:37.732+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:38.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:37 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:37.732+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:38.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:37 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:37.732+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:38.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:37 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:37.732+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.332378+0000 front 2023-10-06T23:32:15.332406+0000 (oldest deadline 2023-10-06T23:32:37.632500+0000) 2023-10-06T23:32:38.442 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:38 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:38.147+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:38.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:38 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:38.148+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:38.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:38 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:38.148+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:38.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:38 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:38.148+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:38.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:38 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:38.148+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:38.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:38 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:38.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:38.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:38 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:38.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:38.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:38 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:38.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:38.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:38 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:38.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:38.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:38 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:38.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:38.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:38 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:38.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:38.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:38 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:38.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:39.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:38 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:38.774+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:39.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:38 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:38.774+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:39.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:38 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:38.774+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:39.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:38 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:38.774+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:39.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:38 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:38.774+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:39.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:38 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:38.774+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:39.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:38 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:38.774+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.332378+0000 front 2023-10-06T23:32:15.332406+0000 (oldest deadline 2023-10-06T23:32:37.632500+0000) 2023-10-06T23:32:39.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:39 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:39.179+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:39.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:39 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:39.179+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:39.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:39 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:39.179+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:39.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:39 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:39.179+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:39.443 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:39 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:39.179+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:39.848 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:39 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:39.436+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:39.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:39 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:39.436+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:39.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:39 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:39.436+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:39.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:39 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:39.436+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:39.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:39 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:39.436+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:39.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:39 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:39.436+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:39.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:39 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:39.436+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:40.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:39.738+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:40.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:39.738+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:40.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:39.738+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:40.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:39.738+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:40.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:39.738+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:40.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:39.738+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:40.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:39 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:39.738+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.332378+0000 front 2023-10-06T23:32:15.332406+0000 (oldest deadline 2023-10-06T23:32:37.632500+0000) 2023-10-06T23:32:40.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:40 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:40.227+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:40.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:40 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:40.227+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:40.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:40 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:40.227+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:40.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:40 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:40.227+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:40.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:40 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:40.227+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:40.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:40 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:40.442+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:40.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:40 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:40.442+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:40.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:40 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:40.442+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:40.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:40 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:40.442+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:40.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:40 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:40.442+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:40.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:40 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:40.442+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:40.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:40 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:40.442+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:41.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:40.705+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:41.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:40.705+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:41.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:40.705+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:41.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:40.705+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:41.147 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:40.705+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:41.147 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:40.705+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:41.147 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:40 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:40.705+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.332378+0000 front 2023-10-06T23:32:15.332406+0000 (oldest deadline 2023-10-06T23:32:37.632500+0000) 2023-10-06T23:32:41.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:41 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:41.262+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:41.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:41 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:41.262+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:41.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:41 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:41.262+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:41.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:41 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:41.262+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:41.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:41 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:41.262+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:41.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:41 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:41.262+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:41.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:41 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:41.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:41.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:41 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:41.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:41.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:41 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:41.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:41.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:41 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:41.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:41.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:41 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:41.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:41.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:41 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:41.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:41.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:41 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:41.484+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:42.145 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:41.700+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.520627+0000 front 2023-10-06T23:31:21.520756+0000 (oldest deadline 2023-10-06T23:31:45.620772+0000) 2023-10-06T23:32:42.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:41.700+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.422416+0000 front 2023-10-06T23:31:31.422528+0000 (oldest deadline 2023-10-06T23:31:54.922252+0000) 2023-10-06T23:32:42.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:41.700+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:42.325228+0000 front 2023-10-06T23:31:42.325484+0000 (oldest deadline 2023-10-06T23:32:07.625298+0000) 2023-10-06T23:32:42.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:41.700+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:51.027494+0000 front 2023-10-06T23:31:51.027156+0000 (oldest deadline 2023-10-06T23:32:15.127303+0000) 2023-10-06T23:32:42.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:41.700+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:58.028537+0000 front 2023-10-06T23:31:58.028524+0000 (oldest deadline 2023-10-06T23:32:20.928563+0000) 2023-10-06T23:32:42.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:41.700+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.331196+0000 front 2023-10-06T23:32:08.331244+0000 (oldest deadline 2023-10-06T23:32:31.831192+0000) 2023-10-06T23:32:42.146 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:41 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9[140973]: 2023-10-06T23:32:41.700+0000 7f88afd05700 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.332378+0000 front 2023-10-06T23:32:15.332406+0000 (oldest deadline 2023-10-06T23:32:37.632500+0000) 2023-10-06T23:32:42.692 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:42 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:42.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:42.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:42 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:42.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:42.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:42 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:42.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:42.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:42 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:42.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:42.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:42 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:42.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:42.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:42 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:42.270+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:42.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:42 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:42.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:42.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:42 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:42.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:42.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:42 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:42.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:42.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:42 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:42.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:42.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:42 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:42.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:42.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:42 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:42.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:42.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:42 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:42.481+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:42.887 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 06 23:32:42 smithi008 bash[177114]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-9 2023-10-06T23:32:43.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:43 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:43.242+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:43.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:43 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:43.242+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:43.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:43 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:43.242+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:43.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:43 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:43.242+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:43.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:43 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:43.242+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:43.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:43 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:43.242+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:43.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:43 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:43.482+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:43.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:43 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:43.482+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:43.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:43 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:43.482+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:43.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:43 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:43.482+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:43.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:43 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:43.482+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:43.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:43 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:43.482+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:43.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:43 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:43.482+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:44.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-06T23:32:44.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:44 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:44.269+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:44.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:44 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:44.269+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:44.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:44 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:44.269+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:44.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:44 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:44.269+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:44.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:44 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:44.269+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:44.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:44 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:44.269+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:44.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:32:44.718 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-06T23:32:44.718 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-06T23:32:44.718 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.10 2023-10-06T23:32:44.785 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:44 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:44.467+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:44.786 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:44 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:44.467+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:44.786 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:44 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:44.467+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:44.786 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:44 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:44.467+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:44.786 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:44 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:44.467+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:44.786 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:44 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:44.467+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:44.786 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:44 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:44.467+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:45.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:44 smithi156 systemd[1]: Stopping Ceph osd.10 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:32:45.500 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.237+0000 7f582d1a7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:32:45.500 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.237+0000 7f582d1a7700 -1 osd.10 89 *** Got signal Terminated *** 2023-10-06T23:32:45.500 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.238+0000 7f582d1a7700 -1 osd.10 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:32:45.500 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.498+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:45.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:45.305+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:45.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:45.305+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:45.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:45.305+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:45.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:45.305+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:45.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:45.305+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:45.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:45.305+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:45.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.498+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:45.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.498+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:45.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.498+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:45.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.498+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:45.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.498+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:45.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:45 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:45.498+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:46.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:46.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:46.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:46.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:46.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:46.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:46.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:46.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:46.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:46.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:46.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:46.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:46.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:46 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:46.354+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:46.848 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:46 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:46.541+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:46.865 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:46 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:46.541+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:46.865 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:46 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:46.541+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:46.865 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:46 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:46.541+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:46.866 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:46 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:46.541+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:46.866 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:46 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:46.541+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:46.866 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:46 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:46.541+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:47.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:47.313+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:47.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:47.313+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:47.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:47.313+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:47.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:47.313+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:47.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:47.313+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:47.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:47.313+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:47.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:47 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:47.313+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:47.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:47 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:47.586+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:47.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:47 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:47.586+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:47.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:47 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:47.586+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:47.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:47 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:47.586+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:47.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:47 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:47.586+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:47.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:47 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:47.586+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:47.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:47 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:47.586+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:48.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:48.301+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:48.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:48.301+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:48.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:48.301+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:48.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:48.301+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:48.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:48.301+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:48.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:48.301+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:48.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:48 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:48.301+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:48.848 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:48.577+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:48.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:48.577+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:48.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:48.577+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:48.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:48.577+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:48.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:48.577+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:48.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:48.577+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:48.849 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:48 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:48.577+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:49.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:49.283+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:49.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:49.283+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:49.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:49.283+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:49.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:49.283+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:49.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:49.283+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:49.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:49.283+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:49.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:49 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:49.283+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:50.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:49.618+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:21.825552+0000 front 2023-10-06T23:31:21.825796+0000 (oldest deadline 2023-10-06T23:31:47.125604+0000) 2023-10-06T23:32:50.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:49.618+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:32.227707+0000 front 2023-10-06T23:31:32.227745+0000 (oldest deadline 2023-10-06T23:31:56.327685+0000) 2023-10-06T23:32:50.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:49.618+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:41.028921+0000 front 2023-10-06T23:31:41.028988+0000 (oldest deadline 2023-10-06T23:32:03.928910+0000) 2023-10-06T23:32:50.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:49.618+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-06T23:31:48.630311+0000 front 2023-10-06T23:31:48.630321+0000 (oldest deadline 2023-10-06T23:32:13.929961+0000) 2023-10-06T23:32:50.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:49.618+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:59.230869+0000 front 2023-10-06T23:31:59.230900+0000 (oldest deadline 2023-10-06T23:32:22.031324+0000) 2023-10-06T23:32:50.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:49.618+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:07.134062+0000 front 2023-10-06T23:32:07.133915+0000 (oldest deadline 2023-10-06T23:32:29.433595+0000) 2023-10-06T23:32:50.099 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:49 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10[133120]: 2023-10-06T23:32:49.618+0000 7f582879b700 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:16.336005+0000 front 2023-10-06T23:32:16.336024+0000 (oldest deadline 2023-10-06T23:32:37.435899+0000) 2023-10-06T23:32:50.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:50.266+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:50.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:50.266+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:50.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:50.266+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:50.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:50.266+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:50.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:50.266+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:50.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:50.266+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:50.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:50 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:50.266+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:51.348 INFO:journalctl@ceph.osd.10.smithi156.stdout:Oct 06 23:32:50 smithi156 bash[147297]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-10 2023-10-06T23:32:51.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:51.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:51.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:51.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:51.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:51.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:51.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:51.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:51.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:51.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:51.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:51.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:51.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:51.289+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:52.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:52.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:52.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:52.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:52.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:52.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:52.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:52.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:52.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:52.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:52.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:52.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:52.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:52 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:52.317+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:52.892 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-06T23:32:52.980 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:32:52.980 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-06T23:32:52.980 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-06T23:32:52.980 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.11 2023-10-06T23:32:53.328 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 systemd[1]: Stopping Ceph osd.11 for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:32:53.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.326+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:53.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.326+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:53.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.326+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:53.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.326+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:53.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.326+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:53.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.326+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:53.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.326+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:53.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.493+0000 7f31e585c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:32:53.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.493+0000 7f31e585c700 -1 osd.11 89 *** Got signal Terminated *** 2023-10-06T23:32:53.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:53 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:53.493+0000 7f31e585c700 -1 osd.11 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-06T23:32:54.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:54.348+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:54.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:54.348+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:54.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:54.348+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:54.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:54.348+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:54.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:54.348+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:54.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:54.348+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:54.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:54 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:54.348+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:55.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:55.396+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:55.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:55.396+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:55.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:55.396+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:55.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:55.396+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:55.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:55.396+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:55.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:55.396+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:55.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:55 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:55.396+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:56.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:56.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:56.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:56.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:56.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:56.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:56.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:56.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:56.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:56.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:56.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:56.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:56.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:56.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:56.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:56 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:56.363+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6820 osd.8 since back 2023-10-06T23:32:31.543052+0000 front 2023-10-06T23:32:31.543075+0000 (oldest deadline 2023-10-06T23:32:55.643036+0000) 2023-10-06T23:32:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:57.371+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:57.371+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:57.371+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:57.371+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:57.371+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:57.371+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:57.371+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:57.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:57 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:57.371+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6820 osd.8 since back 2023-10-06T23:32:31.543052+0000 front 2023-10-06T23:32:31.543075+0000 (oldest deadline 2023-10-06T23:32:55.643036+0000) 2023-10-06T23:32:58.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:58.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-06T23:31:20.831258+0000 front 2023-10-06T23:31:20.831247+0000 (oldest deadline 2023-10-06T23:31:44.931202+0000) 2023-10-06T23:32:58.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:58.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-10-06T23:31:31.933417+0000 front 2023-10-06T23:31:31.933385+0000 (oldest deadline 2023-10-06T23:31:56.632933+0000) 2023-10-06T23:32:58.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:58.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2023-10-06T23:31:40.133865+0000 front 2023-10-06T23:31:40.133839+0000 (oldest deadline 2023-10-06T23:32:08.334766+0000) 2023-10-06T23:32:58.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:58.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-10-06T23:31:57.137105+0000 front 2023-10-06T23:31:57.137002+0000 (oldest deadline 2023-10-06T23:32:21.837083+0000) 2023-10-06T23:32:58.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:58.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2023-10-06T23:32:08.239108+0000 front 2023-10-06T23:32:08.239087+0000 (oldest deadline 2023-10-06T23:32:29.339213+0000) 2023-10-06T23:32:58.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:58.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-06T23:32:15.240725+0000 front 2023-10-06T23:32:15.240702+0000 (oldest deadline 2023-10-06T23:32:41.140688+0000) 2023-10-06T23:32:58.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:58.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-10-06T23:32:24.041755+0000 front 2023-10-06T23:32:24.041732+0000 (oldest deadline 2023-10-06T23:32:46.341703+0000) 2023-10-06T23:32:58.694 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:58 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11[132082]: 2023-10-06T23:32:58.377+0000 7f31dfe4e700 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.190:6820 osd.8 since back 2023-10-06T23:32:31.543052+0000 front 2023-10-06T23:32:31.543075+0000 (oldest deadline 2023-10-06T23:32:55.643036+0000) 2023-10-06T23:32:59.693 INFO:journalctl@ceph.osd.11.smithi190.stdout:Oct 06 23:32:59 smithi190 bash[145629]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-osd-11 2023-10-06T23:33:01.304 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-06T23:33:01.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:01.392 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-06T23:33:01.392 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-06T23:33:01.392 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.a 2023-10-06T23:33:01.895 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:33:01 smithi008 systemd[1]: Stopping Ceph mds.a for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:02.395 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:33:01 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-a[149014]: 2023-10-06T23:33:01.958+0000 7f4705442700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:02.395 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:33:01 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-a[149014]: 2023-10-06T23:33:01.958+0000 7f4705442700 -1 mds.a *** got signal Terminated *** 2023-10-06T23:33:04.896 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 06 23:33:04 smithi008 bash[177384]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-a 2023-10-06T23:33:05.131 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-06T23:33:05.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:05.225 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-06T23:33:05.225 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-06T23:33:05.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.d 2023-10-06T23:33:05.395 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:33:05 smithi008 systemd[1]: Stopping Ceph mds.d for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:06.145 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:33:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-d[147946]: 2023-10-06T23:33:05.727+0000 7f8419f06700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:06.146 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:33:05 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-d[147946]: 2023-10-06T23:33:05.727+0000 7f8419f06700 -1 mds.d *** got signal Terminated *** 2023-10-06T23:33:10.145 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 06 23:33:09 smithi008 bash[177533]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-d 2023-10-06T23:33:10.399 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-06T23:33:10.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:10.489 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-06T23:33:10.489 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-06T23:33:10.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.g 2023-10-06T23:33:10.645 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:33:10 smithi008 systemd[1]: Stopping Ceph mds.g for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:11.395 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:33:10 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-g[148615]: 2023-10-06T23:33:10.984+0000 7f9f76962700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:11.395 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:33:10 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-g[148615]: 2023-10-06T23:33:10.984+0000 7f9f76962700 -1 mds.g *** got signal Terminated *** 2023-10-06T23:33:13.645 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 06 23:33:13 smithi008 bash[177679]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-g 2023-10-06T23:33:13.746 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-06T23:33:13.836 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:13.836 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-06T23:33:13.836 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-06T23:33:13.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.j 2023-10-06T23:33:14.145 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:33:13 smithi008 systemd[1]: Stopping Ceph mds.j for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:14.645 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:33:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-j[147529]: 2023-10-06T23:33:14.325+0000 7f56da681700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:14.646 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:33:14 smithi008 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-j[147529]: 2023-10-06T23:33:14.325+0000 7f56da681700 -1 mds.j *** got signal Terminated *** 2023-10-06T23:33:18.818 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 06 23:33:18 smithi008 bash[177825]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-j 2023-10-06T23:33:18.997 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-06T23:33:19.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:19.086 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-06T23:33:19.087 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-06T23:33:19.087 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.b 2023-10-06T23:33:19.599 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:33:19 smithi156 systemd[1]: Stopping Ceph mds.b for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:20.098 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:33:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-b[139365]: 2023-10-06T23:33:19.607+0000 7f873fcf7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:20.099 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:33:19 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-b[139365]: 2023-10-06T23:33:19.607+0000 7f873fcf7700 -1 mds.b *** got signal Terminated *** 2023-10-06T23:33:25.348 INFO:journalctl@ceph.mds.b.smithi156.stdout:Oct 06 23:33:25 smithi156 bash[147573]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-b 2023-10-06T23:33:25.465 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-06T23:33:25.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:25.551 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-06T23:33:25.551 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-06T23:33:25.551 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.e 2023-10-06T23:33:25.849 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:33:25 smithi156 systemd[1]: Stopping Ceph mds.e for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:26.349 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:33:26 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-e[138680]: 2023-10-06T23:33:26.039+0000 7f1ed4851700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:26.349 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:33:26 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-e[138680]: 2023-10-06T23:33:26.039+0000 7f1ed4851700 -1 mds.e *** got signal Terminated *** 2023-10-06T23:33:29.922 INFO:journalctl@ceph.mds.e.smithi156.stdout:Oct 06 23:33:29 smithi156 bash[147720]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-e 2023-10-06T23:33:30.219 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-06T23:33:30.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:30.302 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-06T23:33:30.303 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-06T23:33:30.303 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.h 2023-10-06T23:33:30.598 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:33:30 smithi156 systemd[1]: Stopping Ceph mds.h for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:31.099 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:33:30 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-h[139022]: 2023-10-06T23:33:30.805+0000 7f6b8698a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:31.099 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:33:30 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-h[139022]: 2023-10-06T23:33:30.805+0000 7f6b8698a700 -1 mds.h *** got signal Terminated *** 2023-10-06T23:33:32.848 INFO:journalctl@ceph.mds.h.smithi156.stdout:Oct 06 23:33:32 smithi156 bash[147859]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-h 2023-10-06T23:33:32.961 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-06T23:33:33.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:33.043 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-06T23:33:33.043 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-06T23:33:33.043 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.k 2023-10-06T23:33:33.349 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:33:33 smithi156 systemd[1]: Stopping Ceph mds.k for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:33.849 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:33:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-k[138329]: 2023-10-06T23:33:33.530+0000 7f566c513700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:33.849 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:33:33 smithi156 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-k[138329]: 2023-10-06T23:33:33.530+0000 7f566c513700 -1 mds.k *** got signal Terminated *** 2023-10-06T23:33:36.450 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:33:36 smithi156 bash[148004]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-k 2023-10-06T23:33:36.655 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-06T23:33:36.715 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:33:36 smithi156 systemd[1]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.k.service: Succeeded. 2023-10-06T23:33:36.715 INFO:journalctl@ceph.mds.k.smithi156.stdout:Oct 06 23:33:36 smithi156 systemd[1]: Stopped Ceph mds.k for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:33:36.737 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:36.737 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-06T23:33:36.738 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-06T23:33:36.738 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.c 2023-10-06T23:33:37.192 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:33:36 smithi190 systemd[1]: Stopping Ceph mds.c for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:37.692 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:33:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-c[138304]: 2023-10-06T23:33:37.236+0000 7f068317d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:37.693 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:33:37 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-c[138304]: 2023-10-06T23:33:37.236+0000 7f068317d700 -1 mds.c *** got signal Terminated *** 2023-10-06T23:33:40.584 INFO:journalctl@ceph.mds.c.smithi190.stdout:Oct 06 23:33:40 smithi190 bash[145908]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-c 2023-10-06T23:33:40.618 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-06T23:33:40.701 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:40.702 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-06T23:33:40.702 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-06T23:33:40.702 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.f 2023-10-06T23:33:40.942 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:33:40 smithi190 systemd[1]: Stopping Ceph mds.f for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:41.692 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:33:41 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-f[137961]: 2023-10-06T23:33:41.195+0000 7f2e7c1eb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:41.693 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:33:41 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-f[137961]: 2023-10-06T23:33:41.195+0000 7f2e7c1eb700 -1 mds.f *** got signal Terminated *** 2023-10-06T23:33:44.393 INFO:journalctl@ceph.mds.f.smithi190.stdout:Oct 06 23:33:44 smithi190 bash[146048]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-f 2023-10-06T23:33:44.421 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-06T23:33:44.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:44.505 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-06T23:33:44.505 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-06T23:33:44.506 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.i 2023-10-06T23:33:44.692 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:33:44 smithi190 systemd[1]: Stopping Ceph mds.i for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:45.442 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:33:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-i[138644]: 2023-10-06T23:33:45.001+0000 7f66bf621700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:45.443 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:33:45 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-i[138644]: 2023-10-06T23:33:45.001+0000 7f66bf621700 -1 mds.i *** got signal Terminated *** 2023-10-06T23:33:51.193 INFO:journalctl@ceph.mds.i.smithi190.stdout:Oct 06 23:33:50 smithi190 bash[146194]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-i 2023-10-06T23:33:51.274 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-06T23:33:51.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:51.356 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-06T23:33:51.356 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-06T23:33:51.356 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.l 2023-10-06T23:33:51.692 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:33:51 smithi190 systemd[1]: Stopping Ceph mds.l for 5a0d88f6-649c-11ee-8db5-212e2dc638e7... 2023-10-06T23:33:52.192 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:33:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-l[137616]: 2023-10-06T23:33:51.841+0000 7f643415e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-06T23:33:52.193 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:33:51 smithi190 ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-l[137616]: 2023-10-06T23:33:51.841+0000 7f643415e700 -1 mds.l *** got signal Terminated *** 2023-10-06T23:33:56.341 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:33:56 smithi190 bash[146339]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7-mds-l 2023-10-06T23:33:56.543 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-06T23:33:56.601 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:33:56 smithi190 systemd[1]: ceph-5a0d88f6-649c-11ee-8db5-212e2dc638e7@mds.l.service: Succeeded. 2023-10-06T23:33:56.601 INFO:journalctl@ceph.mds.l.smithi190.stdout:Oct 06 23:33:56 smithi190 systemd[1]: Stopped Ceph mds.l for 5a0d88f6-649c-11ee-8db5-212e2dc638e7. 2023-10-06T23:33:56.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-06T23:33:56.622 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-06T23:33:56.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-06T23:33:57.026 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:34:00.496 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-06T23:34:00.905 INFO:teuthology.orchestra.run.smithi156.stdout:Deleting cluster with fsid: 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:34:04.205 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-06T23:34:04.613 INFO:teuthology.orchestra.run.smithi190.stdout:Deleting cluster with fsid: 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:34:07.867 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:34:07.947 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:34:08.027 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-06T23:34:08.097 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-06T23:34:08.099 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi008/crash 2023-10-06T23:34:08.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash -- . 2023-10-06T23:34:08.185 INFO:teuthology.orchestra.run.smithi008.stderr:tar: /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-06T23:34:08.185 INFO:teuthology.orchestra.run.smithi008.stderr:tar: Error is not recoverable: exiting now 2023-10-06T23:34:08.188 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi156/crash 2023-10-06T23:34:08.189 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash -- . 2023-10-06T23:34:08.275 INFO:teuthology.orchestra.run.smithi156.stderr:tar: /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-06T23:34:08.275 INFO:teuthology.orchestra.run.smithi156.stderr:tar: Error is not recoverable: exiting now 2023-10-06T23:34:08.278 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi190/crash 2023-10-06T23:34:08.279 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash -- . 2023-10-06T23:34:08.384 INFO:teuthology.orchestra.run.smithi190.stderr:tar: /var/lib/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-06T23:34:08.385 INFO:teuthology.orchestra.run.smithi190.stderr:tar: Error is not recoverable: exiting now 2023-10-06T23:34:08.387 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-06T23:34:08.387 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-06T23:34:08.470 INFO:teuthology.orchestra.run.smithi008.stderr:grep: /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-06T23:34:08.475 INFO:tasks.cephadm:Compressing logs... 2023-10-06T23:34:08.475 DEBUG:teuthology.orchestra.run.smithi008:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-06T23:34:08.479 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-06T23:34:08.484 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-06T23:34:08.552 INFO:teuthology.orchestra.run.smithi008.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-06T23:34:08.552 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-06T23:34:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-06T23:34:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-06T23:34:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-06T23:34:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-06T23:34:08.559 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-06T23:34:08.560 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-06T23:34:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-06T23:34:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.d.log: 94.7% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-06T23:34:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-06T23:34:08.562 INFO:teuthology.orchestra.run.smithi008.stderr: 94.5% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-06T23:34:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-06T23:34:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-06T23:34:08.566 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-06T23:34:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-06T23:34:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-10-06T23:34:08.568 INFO:teuthology.orchestra.run.smithi156.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-06T23:34:08.568 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-06T23:34:08.573 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.a.log: /var/log/ceph/ceph-client.0.log: 94.5% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-06T23:34:08.576 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.10.log 2023-10-06T23:34:08.577 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-06T23:34:08.578 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-06T23:34:08.579 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-06T23:34:08.579 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-06T23:34:08.580 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-06T23:34:08.581 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-06T23:34:08.582 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-06T23:34:08.583 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-06T23:34:08.584 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-06T23:34:08.585 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-06T23:34:08.587 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.b.log: 94.5% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-06T23:34:08.593 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: 93.2% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-06T23:34:08.598 INFO:teuthology.orchestra.run.smithi190.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-06T23:34:08.599 INFO:teuthology.orchestra.run.smithi190.stderr:: No such file or directory 2023-10-06T23:34:08.607 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-06T23:34:08.608 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-06T23:34:08.609 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-06T23:34:08.610 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-06T23:34:08.611 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-06T23:34:08.612 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-06T23:34:08.613 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-06T23:34:08.614 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-06T23:34:08.615 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-06T23:34:08.616 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-06T23:34:08.618 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose 93.4%-- -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-06T23:34:08.618 INFO:teuthology.orchestra.run.smithi190.stderr: 2023-10-06T23:34:08.623 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log: /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 94.7% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-06T23:34:08.762 INFO:teuthology.orchestra.run.smithi156.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-06T23:34:08.776 INFO:teuthology.orchestra.run.smithi008.stderr: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-06T23:34:09.012 INFO:teuthology.orchestra.run.smithi190.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-06T23:34:09.026 INFO:teuthology.orchestra.run.smithi156.stderr: 90.9% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-06T23:34:09.286 INFO:teuthology.orchestra.run.smithi008.stderr: 90.9% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-06T23:34:09.452 INFO:teuthology.orchestra.run.smithi190.stderr: 90.9% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-06T23:34:09.507 INFO:teuthology.orchestra.run.smithi190.stderr: 94.2% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-06T23:34:09.884 INFO:teuthology.orchestra.run.smithi008.stderr: 90.2% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-06T23:34:10.007 INFO:teuthology.orchestra.run.smithi190.stderr: 91.9% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-06T23:34:10.369 INFO:teuthology.orchestra.run.smithi156.stderr: 96.0% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-06T23:34:10.554 INFO:teuthology.orchestra.run.smithi156.stderr: 92.1% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-06T23:34:11.373 INFO:teuthology.orchestra.run.smithi008.stderr: 90.3% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-06T23:34:14.204 INFO:teuthology.orchestra.run.smithi156.stderr: 95.6% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-06T23:34:39.031 INFO:teuthology.orchestra.run.smithi008.stderr: 91.8% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-06T23:34:45.623 INFO:teuthology.orchestra.run.smithi008.stderr: 90.8% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-06T23:34:52.642 INFO:teuthology.orchestra.run.smithi008.stderr: 90.8% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-06T23:34:58.041 INFO:teuthology.orchestra.run.smithi008.stderr: 90.7% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-06T23:35:00.661 INFO:teuthology.orchestra.run.smithi156.stderr: 91.8% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-06T23:35:01.470 INFO:teuthology.orchestra.run.smithi190.stderr: 91.3% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-06T23:35:02.076 INFO:teuthology.orchestra.run.smithi156.stderr: 91.3% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-06T23:35:02.929 INFO:teuthology.orchestra.run.smithi190.stderr: 91.0% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-06T23:35:03.782 INFO:teuthology.orchestra.run.smithi190.stderr: 91.3% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-06T23:35:08.534 INFO:teuthology.orchestra.run.smithi190.stderr: 91.1% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-06T23:35:09.975 INFO:teuthology.orchestra.run.smithi156.stderr: 91.4% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-06T23:35:16.046 INFO:teuthology.orchestra.run.smithi156.stderr: 90.7% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-06T23:36:10.683 INFO:teuthology.orchestra.run.smithi190.stderr: 96.8% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-06T23:36:53.626 INFO:teuthology.orchestra.run.smithi008.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-10-06T23:36:53.629 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-06T23:36:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:real 2m45.114s 2023-10-06T23:36:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:user 4m12.985s 2023-10-06T23:36:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:sys 0m22.850s 2023-10-06T23:37:03.707 INFO:teuthology.orchestra.run.smithi190.stderr: 94.5% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-06T23:37:03.720 INFO:teuthology.orchestra.run.smithi190.stderr: 2023-10-06T23:37:03.720 INFO:teuthology.orchestra.run.smithi190.stderr:real 2m55.195s 2023-10-06T23:37:03.720 INFO:teuthology.orchestra.run.smithi190.stderr:user 4m43.251s 2023-10-06T23:37:03.720 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m33.155s 2023-10-06T23:39:57.127 INFO:teuthology.orchestra.run.smithi156.stderr: 94.6% -- replaced with /var/log/ceph/5a0d88f6-649c-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-06T23:39:57.137 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-10-06T23:39:57.137 INFO:teuthology.orchestra.run.smithi156.stderr:real 5m48.614s 2023-10-06T23:39:57.137 INFO:teuthology.orchestra.run.smithi156.stderr:user 6m1.260s 2023-10-06T23:39:57.137 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m46.785s 2023-10-06T23:39:57.138 INFO:tasks.cephadm:Archiving logs... 2023-10-06T23:39:57.139 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi008/log 2023-10-06T23:39:57.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T23:40:34.504 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi156/log 2023-10-06T23:40:34.505 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T23:41:27.379 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi190/log 2023-10-06T23:41:27.387 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T23:42:05.964 INFO:tasks.cephadm:Removing cluster... 2023-10-06T23:42:05.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 --force 2023-10-06T23:42:06.372 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:42:07.558 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 --force 2023-10-06T23:42:08.287 INFO:teuthology.orchestra.run.smithi156.stdout:Deleting cluster with fsid: 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:42:09.909 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a0d88f6-649c-11ee-8db5-212e2dc638e7 --force 2023-10-06T23:42:10.802 INFO:teuthology.orchestra.run.smithi190.stdout:Deleting cluster with fsid: 5a0d88f6-649c-11ee-8db5-212e2dc638e7 2023-10-06T23:42:12.360 INFO:tasks.cephadm:Removing cephadm ... 2023-10-06T23:42:12.360 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-06T23:42:12.409 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-06T23:42:12.459 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-06T23:42:12.502 INFO:tasks.cephadm:Teardown complete 2023-10-06T23:42:12.503 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T23:42:12.513 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_14d8d032507701c76ca224e769ee65a96b660a8c/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-06T23:42:12.514 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T23:42:12.514 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T23:42:12.519 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T23:42:12.524 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T23:42:12.723 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T23:42:12.733 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T23:42:12.734 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T23:42:12.738 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T23:42:12.743 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T23:42:12.778 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-06T23:42:12.781 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-10-06T23:42:12.784 INFO:teuthology.orchestra.run.smithi190.stderr:bash: ntpq: command not found 2023-10-06T23:42:12.785 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T23:42:12.786 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-06T23:42:12.786 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 -1007us[ -999us] +/- 73ms 2023-10-06T23:42:12.786 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv02.front.sepia.ceph.com 3 6 377 12 +430us[ +439us] +/- 52ms 2023-10-06T23:42:12.786 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +408us[ +417us] +/- 71ms 2023-10-06T23:42:12.786 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:42:12.802 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T23:42:12.802 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-10-06T23:42:12.802 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 -1038us[-1038us] +/- 73ms 2023-10-06T23:42:12.802 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 +404us[ +404us] +/- 52ms 2023-10-06T23:42:12.803 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +402us[ +402us] +/- 71ms 2023-10-06T23:42:12.803 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:42:12.804 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T23:42:12.804 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2023-10-06T23:42:12.804 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 -1035us[-1009us] +/- 73ms 2023-10-06T23:42:12.804 INFO:teuthology.orchestra.run.smithi190.stdout:^* hv02.front.sepia.ceph.com 3 6 377 12 +458us[ +484us] +/- 52ms 2023-10-06T23:42:12.804 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +429us[ +455us] +/- 71ms 2023-10-06T23:42:12.804 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T23:42:12.805 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T23:42:12.816 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T23:42:12.816 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T23:42:12.853 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T23:42:13.089 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T23:42:13.918 DEBUG:teuthology.orchestra.run.smithi190:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T23:42:14.132 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T23:42:14.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:42:14.218 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T23:42:14.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:42:14.297 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T23:42:14.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:42:14.374 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T23:42:14.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T23:42:15.438 INFO:teuthology.task.internal:Duration was 3401.957614 seconds 2023-10-06T23:42:15.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T23:42:15.756 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T23:42:15.756 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T23:42:15.763 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T23:42:15.768 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T23:42:15.937 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T23:42:15.994 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T23:42:16.066 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T23:42:16.266 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T23:42:16.267 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-10-06T23:42:16.267 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T23:42:16.330 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2023-10-06T23:42:16.330 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T23:42:16.407 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2023-10-06T23:42:16.407 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T23:42:16.489 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T23:42:16.490 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T23:42:16.494 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T23:42:16.499 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T23:42:16.618 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T23:42:16.618 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T23:42:16.622 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T23:42:16.627 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T23:42:16.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T23:42:16.800 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T23:42:16.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T23:42:16.878 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T23:42:16.955 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T23:42:17.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T23:42:17.044 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T23:42:17.048 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T23:42:17.053 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T23:42:17.131 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2023-10-06T23:42:17.132 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-10-06T23:42:17.140 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2023-10-06T23:42:17.192 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T23:42:17.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:42:17.233 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T23:42:17.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:42:17.275 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T23:42:17.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T23:42:17.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T23:42:17.331 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T23:42:17.332 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi008 2023-10-06T23:42:17.333 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T23:42:17.417 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi156 2023-10-06T23:42:17.417 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T23:42:17.500 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744/remote/smithi190 2023-10-06T23:42:17.501 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T23:42:17.586 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T23:42:17.586 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T23:42:17.591 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T23:42:17.595 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T23:42:17.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T23:42:17.651 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T23:42:17.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T23:42:17.691 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T23:42:17.691 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T23:42:17.698 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T23:42:17.702 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T23:42:17.737 INFO:teuthology.orchestra.run.smithi008.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 23:42 /home/ubuntu/cephtest 2023-10-06T23:42:17.741 INFO:teuthology.orchestra.run.smithi156.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 23:42 /home/ubuntu/cephtest 2023-10-06T23:42:17.745 INFO:teuthology.orchestra.run.smithi190.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 23:42 /home/ubuntu/cephtest 2023-10-06T23:42:17.749 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T23:42:17.793 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T23:42:17.840 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-06T23:42:17.840 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T23:42:17.863 DEBUG:teuthology.nuke:shortname: smithi008 2023-10-06T23:42:17.863 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T23:42:17.886 DEBUG:teuthology.nuke:shortname: smithi156 2023-10-06T23:42:17.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T23:42:17.894 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 22:36:02.580710', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T23:42:17.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 22:36:02.582118', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T23:42:17.918 DEBUG:teuthology.nuke:shortname: smithi190 2023-10-06T23:42:17.918 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T23:42:17.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-06_11:56:52-fs-rishabh-cephfs-mon-testing-default-smithi/7414744', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 22:36:02.583679', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-06T23:42:17.951 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-06T23:42:17.951 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T23:42:17.973 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-06T23:42:17.973 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:17.991 INFO:teuthology.orchestra.console.smithi156:Power off 2023-10-06T23:42:17.991 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T23:42:18.001 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-06T23:42:18.012 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-10-06T23:42:18.013 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:18.029 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-06T23:42:18.029 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T23:42:18.042 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-10-06T23:42:18.057 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-06T23:42:18.057 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:18.080 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-06T23:42:22.003 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:22.043 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:22.081 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:22.113 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-06T23:42:22.153 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-10-06T23:42:22.191 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-06T23:42:26.118 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:26.155 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:26.193 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:26.230 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-06T23:42:26.268 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-10-06T23:42:26.306 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-06T23:42:26.331 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-06T23:42:26.369 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-10-06T23:42:30.310 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T23:42:30.420 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-06T23:42:30.521 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-06T23:42:30.626 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} duration: 3401.9576144218445 failure_reason: 'error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds' flavor: default mon.a-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c mon.b-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c mon.c-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c owner: scheduled_rishabh@teuthology status: fail success: false 2023-10-06T23:42:30.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T23:42:30.708 INFO:teuthology.run:FAIL